2024-09-12T00:14:23.710 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-12T00:14:23.733 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:14:23.848 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} email: null first_in_suite: false job_id: '7901860' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd fast shutdown: false osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f openssl_keys: rgw.client.0: ca: root client: client.0 embed-key: true root: client: client.0 cn: teuthology install: - client.0 key-type: rsa:4096 rgw: client.0: ssl certificate: rgw.client.0 valgrind: - --tool=memcheck - --max-threads=1024 compression type: random ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi019.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHoKEHhfw8r/gbnjfI7a1eic3Ug1vlI1vqWyDDJIZfswlkfJMmEOlrIUbmGyzDbRVpMvxnnTdB5OhSe3LkTidKw= smithi135.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfb1jbjg0l38XTh5CYhs8QMCXCxqGN7lz6ahaYmtwXLlMwTeGcP3Bsj1ddSFCs38LnvRXTlG+DsEcoGZNBWdkQ= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-12T00:14:23.849 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-12T00:14:23.850 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-12T00:14:23.850 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-12T00:14:23.851 INFO:teuthology.task.internal:Checking packages... 2024-09-12T00:14:23.874 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-12T00:14:23.875 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-12T00:14:23.875 INFO:teuthology.packaging:ref: None 2024-09-12T00:14:23.875 INFO:teuthology.packaging:tag: None 2024-09-12T00:14:23.875 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-12T00:14:23.875 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:14:23.875 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-12T00:14:24.027 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753.gd011c522 2024-09-12T00:14:24.028 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-12T00:14:24.034 INFO:teuthology.task.internal:no buildpackages task found 2024-09-12T00:14:24.034 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-12T00:14:24.046 INFO:teuthology.task.internal:Saving configuration 2024-09-12T00:14:24.062 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-12T00:14:24.069 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-12T00:14:24.103 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:09:38.344601', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHoKEHhfw8r/gbnjfI7a1eic3Ug1vlI1vqWyDDJIZfswlkfJMmEOlrIUbmGyzDbRVpMvxnnTdB5OhSe3LkTidKw='} 2024-09-12T00:14:24.136 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi135.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-12 00:09:38.342655', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfb1jbjg0l38XTh5CYhs8QMCXCxqGN7lz6ahaYmtwXLlMwTeGcP3Bsj1ddSFCs38LnvRXTlG+DsEcoGZNBWdkQ='} 2024-09-12T00:14:24.136 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-12T00:14:24.142 INFO:teuthology.task.internal:roles: ubuntu@smithi019.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:14:24.143 INFO:teuthology.task.internal:roles: ubuntu@smithi135.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:14:24.143 INFO:teuthology.run_tasks:Running task console_log... 2024-09-12T00:14:24.223 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4b4e0f7490>, signals=[15]) 2024-09-12T00:14:24.223 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-12T00:14:24.229 INFO:teuthology.task.internal:Opening connections... 2024-09-12T00:14:24.229 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:14:24.231 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:14:24.318 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:14:24.319 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:14:24.426 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-12T00:14:24.433 DEBUG:teuthology.orchestra.run.smithi019:> uname -m 2024-09-12T00:14:24.451 INFO:teuthology.orchestra.run.smithi019.stdout:x86_64 2024-09-12T00:14:24.451 DEBUG:teuthology.orchestra.run.smithi019:> cat /etc/os-release 2024-09-12T00:14:24.509 INFO:teuthology.orchestra.run.smithi019.stdout:NAME="CentOS Stream" 2024-09-12T00:14:24.509 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION="9" 2024-09-12T00:14:24.509 INFO:teuthology.orchestra.run.smithi019.stdout:ID="centos" 2024-09-12T00:14:24.509 INFO:teuthology.orchestra.run.smithi019.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:14:24.509 INFO:teuthology.orchestra.run.smithi019.stdout:VERSION_ID="9" 2024-09-12T00:14:24.509 INFO:teuthology.orchestra.run.smithi019.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:14:24.509 INFO:teuthology.orchestra.run.smithi019.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:14:24.509 INFO:teuthology.orchestra.run.smithi019.stdout:ANSI_COLOR="0;31" 2024-09-12T00:14:24.509 INFO:teuthology.orchestra.run.smithi019.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:14:24.509 INFO:teuthology.orchestra.run.smithi019.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:14:24.509 INFO:teuthology.orchestra.run.smithi019.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:14:24.510 INFO:teuthology.orchestra.run.smithi019.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:14:24.510 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:14:24.510 INFO:teuthology.orchestra.run.smithi019.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:14:24.510 INFO:teuthology.lock.ops:Updating smithi019.front.sepia.ceph.com on lock server 2024-09-12T00:14:24.544 DEBUG:teuthology.orchestra.run.smithi135:> uname -m 2024-09-12T00:14:24.563 INFO:teuthology.orchestra.run.smithi135.stdout:x86_64 2024-09-12T00:14:24.563 DEBUG:teuthology.orchestra.run.smithi135:> cat /etc/os-release 2024-09-12T00:14:24.621 INFO:teuthology.orchestra.run.smithi135.stdout:NAME="CentOS Stream" 2024-09-12T00:14:24.621 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION="9" 2024-09-12T00:14:24.621 INFO:teuthology.orchestra.run.smithi135.stdout:ID="centos" 2024-09-12T00:14:24.621 INFO:teuthology.orchestra.run.smithi135.stdout:ID_LIKE="rhel fedora" 2024-09-12T00:14:24.621 INFO:teuthology.orchestra.run.smithi135.stdout:VERSION_ID="9" 2024-09-12T00:14:24.621 INFO:teuthology.orchestra.run.smithi135.stdout:PLATFORM_ID="platform:el9" 2024-09-12T00:14:24.621 INFO:teuthology.orchestra.run.smithi135.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-12T00:14:24.621 INFO:teuthology.orchestra.run.smithi135.stdout:ANSI_COLOR="0;31" 2024-09-12T00:14:24.621 INFO:teuthology.orchestra.run.smithi135.stdout:LOGO="fedora-logo-icon" 2024-09-12T00:14:24.621 INFO:teuthology.orchestra.run.smithi135.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-12T00:14:24.621 INFO:teuthology.orchestra.run.smithi135.stdout:HOME_URL="https://centos.org/" 2024-09-12T00:14:24.622 INFO:teuthology.orchestra.run.smithi135.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-12T00:14:24.622 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-12T00:14:24.622 INFO:teuthology.orchestra.run.smithi135.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-12T00:14:24.622 INFO:teuthology.lock.ops:Updating smithi135.front.sepia.ceph.com on lock server 2024-09-12T00:14:24.652 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-12T00:14:24.661 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-12T00:14:24.666 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-12T00:14:24.666 DEBUG:teuthology.orchestra.run.smithi019:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:14:24.669 DEBUG:teuthology.orchestra.run.smithi135:> test '!' -e /home/ubuntu/cephtest 2024-09-12T00:14:24.686 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-12T00:14:24.692 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-12T00:14:24.692 DEBUG:teuthology.orchestra.run.smithi019:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:14:24.727 DEBUG:teuthology.orchestra.run.smithi135:> test -z $(ls -A /var/lib/ceph) 2024-09-12T00:14:24.805 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-12T00:14:24.876 INFO:teuthology.run_tasks:Running task kernel... 2024-09-12T00:14:24.891 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-12T00:14:24.891 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-12T00:14:24.892 DEBUG:teuthology.orchestra.run.smithi019:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:14:24.892 DEBUG:teuthology.orchestra.run.smithi135:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-12T00:14:24.909 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:24.909 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-12T00:14:24.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:14:24.910 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-12T00:14:24.967 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-503.el9.x86_64 2024-09-12T00:14:24.967 INFO:teuthology.task.kernel:Running kernel on smithi019: 5.14.0-503.el9.x86_64 2024-09-12T00:14:24.967 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum install -y kernel 2024-09-12T00:14:24.968 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-503.el9.x86_64 2024-09-12T00:14:24.969 INFO:teuthology.task.kernel:Running kernel on smithi135: 5.14.0-503.el9.x86_64 2024-09-12T00:14:24.969 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum install -y kernel 2024-09-12T00:14:28.274 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 5.6 MB/s | 8.2 MB 00:01 2024-09-12T00:14:28.285 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.2 MB 00:01 2024-09-12T00:14:30.195 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-12T00:14:30.800 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 15 MB/s | 20 MB 00:01 2024-09-12T00:14:35.059 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.5 MB 00:00 2024-09-12T00:14:36.004 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-12T00:14:36.719 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 41 kB/s | 19 kB 00:00 2024-09-12T00:14:37.613 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 19 kB 00:00 2024-09-12T00:14:37.956 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 20 MB/s | 23 MB 00:01 2024-09-12T00:14:38.567 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-12T00:14:43.431 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-09-12T00:14:44.273 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 40 kB/s | 1.7 kB 00:00 2024-09-12T00:14:45.421 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T00:14:45.421 INFO:teuthology.orchestra.run.smithi135.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T00:14:45.523 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-12T00:14:45.530 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-12T00:14:45.530 INFO:teuthology.orchestra.run.smithi135.stdout: Package Architecture Version Repository Size 2024-09-12T00:14:45.531 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-12T00:14:45.531 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-12T00:14:45.531 INFO:teuthology.orchestra.run.smithi135.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T00:14:45.531 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-12T00:14:45.531 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T00:14:45.531 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T00:14:45.531 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T00:14:45.531 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:14:45.531 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-12T00:14:45.532 INFO:teuthology.orchestra.run.smithi135.stdout:================================================================================ 2024-09-12T00:14:45.532 INFO:teuthology.orchestra.run.smithi135.stdout:Install 4 Packages 2024-09-12T00:14:45.532 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:14:45.532 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 79 M 2024-09-12T00:14:45.532 INFO:teuthology.orchestra.run.smithi135.stdout:Installed size: 126 M 2024-09-12T00:14:45.532 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-12T00:14:45.682 INFO:teuthology.orchestra.run.smithi135.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 188 kB/s | 23 kB 00:00 2024-09-12T00:14:46.338 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-12T00:14:46.338 INFO:teuthology.orchestra.run.smithi019.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-12T00:14:46.428 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-12T00:14:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T00:14:46.444 INFO:teuthology.orchestra.run.smithi019.stdout: Package Architecture Version Repository Size 2024-09-12T00:14:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T00:14:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-12T00:14:46.444 INFO:teuthology.orchestra.run.smithi019.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-12T00:14:46.444 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-12T00:14:46.444 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-12T00:14:46.444 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-12T00:14:46.445 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-12T00:14:46.445 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:14:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-12T00:14:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T00:14:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:Install 4 Packages 2024-09-12T00:14:46.445 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:14:46.445 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 79 M 2024-09-12T00:14:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 126 M 2024-09-12T00:14:46.446 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-12T00:14:46.666 INFO:teuthology.orchestra.run.smithi019.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 194 kB/s | 23 kB 00:00 2024-09-12T00:14:48.416 INFO:teuthology.orchestra.run.smithi135.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 5.5 MB/s | 16 MB 00:02 2024-09-12T00:14:49.074 INFO:teuthology.orchestra.run.smithi019.stdout:(2/4): kernel-modules-core-5.14.0-505.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-12T00:14:51.699 INFO:teuthology.orchestra.run.smithi135.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 5.6 MB/s | 35 MB 00:06 2024-09-12T00:14:52.216 INFO:teuthology.orchestra.run.smithi135.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 4.4 MB/s | 29 MB 00:06 2024-09-12T00:14:52.216 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:14:52.216 INFO:teuthology.orchestra.run.smithi135.stdout:Total 12 MB/s | 79 MB 00:06 2024-09-12T00:14:52.782 INFO:teuthology.orchestra.run.smithi019.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 5.5 MB/s | 35 MB 00:06 2024-09-12T00:14:52.901 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-12T00:14:52.941 INFO:teuthology.orchestra.run.smithi019.stdout:(4/4): kernel-core-5.14.0-505.el9.x86_64.rpm 2.4 MB/s | 16 MB 00:06 2024-09-12T00:14:52.941 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:14:52.941 INFO:teuthology.orchestra.run.smithi019.stdout:Total 12 MB/s | 79 MB 00:06 2024-09-12T00:14:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-12T00:14:53.275 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-12T00:14:53.649 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-12T00:14:54.014 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-12T00:14:54.014 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-12T00:14:54.256 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-12T00:14:54.256 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-12T00:14:55.033 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-12T00:14:55.034 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-12T00:14:56.708 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-12T00:14:57.377 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:14:57.474 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:14:57.610 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-12T00:14:58.310 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:14:58.400 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:15:00.278 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:15:00.417 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:15:01.199 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:15:01.328 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:15:05.295 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:15:05.334 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:06.453 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:15:06.504 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:10.218 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:11.645 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:48.573 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:48.612 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:15:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:15:48.916 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi135.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:15:49.776 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-12T00:15:50.136 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:15:50.231 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:15:50.232 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:15:50.232 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T00:15:50.232 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:15:50.232 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:15:50.233 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-12T00:15:50.233 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi135.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:15:50.233 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:15:50.293 INFO:teuthology.orchestra.run.smithi135.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:15:50.294 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:15:50.294 DEBUG:teuthology.orchestra.run.smithi135:> sudo rpm -qi grub2-tools 2024-09-12T00:15:50.325 INFO:teuthology.orchestra.run.smithi135.stdout:Name : grub2-tools 2024-09-12T00:15:50.325 INFO:teuthology.orchestra.run.smithi135.stdout:Epoch : 1 2024-09-12T00:15:50.325 INFO:teuthology.orchestra.run.smithi135.stdout:Version : 2.06 2024-09-12T00:15:50.325 INFO:teuthology.orchestra.run.smithi135.stdout:Release : 82.el9 2024-09-12T00:15:50.325 INFO:teuthology.orchestra.run.smithi135.stdout:Architecture: x86_64 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:Group : Unspecified 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:Size : 8274670 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:License : GPLv3+ 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:Packager : builder@centos.org 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:Vendor : CentOS 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:Summary : Support tools for GRUB. 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:Description : 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:15:50.326 INFO:teuthology.orchestra.run.smithi135.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T00:15:50.327 INFO:teuthology.orchestra.run.smithi135.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T00:15:50.327 INFO:teuthology.orchestra.run.smithi135.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T00:15:50.327 INFO:teuthology.orchestra.run.smithi135.stdout:hardware devices. 2024-09-12T00:15:50.327 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:15:50.327 INFO:teuthology.orchestra.run.smithi135.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T00:15:50.328 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T00:15:50.328 INFO:teuthology.task.kernel:Updating grub on smithi135 to boot 5.14.0-505.el9.x86_64 2024-09-12T00:15:50.328 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T00:15:50.819 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:50.860 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:51.072 INFO:teuthology.orchestra.run.smithi135.stderr:Generating grub configuration file ... 2024-09-12T00:15:51.302 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:51.303 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-12T00:15:51.303 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-12T00:15:51.303 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-12T00:15:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-12T00:15:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:15:52.142 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-12T00:15:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-12T00:15:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-12T00:15:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-12T00:15:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-12T00:15:52.142 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:15:52.143 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-12T00:15:52.445 INFO:teuthology.orchestra.run.smithi135.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T00:15:52.461 INFO:teuthology.orchestra.run.smithi135.stderr:done 2024-09-12T00:15:52.463 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-12T00:15:52.479 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.5fB4E7EO49 2024-09-12T00:15:52.479 DEBUG:teuthology.orchestra.run.smithi135:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5fB4E7EO49 2024-09-12T00:15:52.490 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:15:52.546 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.5fB4E7EO49 2024-09-12T00:15:52.584 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:15:52.584 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:15:52.584 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-12T00:15:52.584 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-12T00:15:52.584 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-12T00:15:52.584 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-12T00:15:52.585 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi019.front.sepia.ceph.com, path=None, version=distro) 2024-09-12T00:15:52.585 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q kernel | sort -rV | head -n 1 2024-09-12T00:15:52.643 INFO:teuthology.orchestra.run.smithi019.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-12T00:15:52.643 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-12T00:15:52.644 DEBUG:teuthology.orchestra.run.smithi019:> sudo rpm -qi grub2-tools 2024-09-12T00:15:52.679 INFO:teuthology.orchestra.run.smithi019.stdout:Name : grub2-tools 2024-09-12T00:15:52.679 INFO:teuthology.orchestra.run.smithi019.stdout:Epoch : 1 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Version : 2.06 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Release : 82.el9 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Architecture: x86_64 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Group : Unspecified 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Size : 8274670 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:License : GPLv3+ 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Packager : builder@centos.org 2024-09-12T00:15:52.680 INFO:teuthology.orchestra.run.smithi019.stdout:Vendor : CentOS 2024-09-12T00:15:52.681 INFO:teuthology.orchestra.run.smithi019.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-12T00:15:52.681 INFO:teuthology.orchestra.run.smithi019.stdout:Summary : Support tools for GRUB. 2024-09-12T00:15:52.681 INFO:teuthology.orchestra.run.smithi019.stdout:Description : 2024-09-12T00:15:52.681 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:15:52.681 INFO:teuthology.orchestra.run.smithi019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-12T00:15:52.681 INFO:teuthology.orchestra.run.smithi019.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-12T00:15:52.681 INFO:teuthology.orchestra.run.smithi019.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-12T00:15:52.681 INFO:teuthology.orchestra.run.smithi019.stdout:hardware devices. 2024-09-12T00:15:52.681 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:15:52.681 INFO:teuthology.orchestra.run.smithi019.stdout:This subpackage provides tools for support of all platforms. 2024-09-12T00:15:52.682 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-12T00:15:52.682 INFO:teuthology.task.kernel:Updating grub on smithi019 to boot 5.14.0-505.el9.x86_64 2024-09-12T00:15:52.683 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-12T00:15:52.691 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.5fB4E7EO49 is 6KB 2024-09-12T00:15:52.742 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.5fB4E7EO49 2024-09-12T00:15:52.757 DEBUG:teuthology.orchestra.run.smithi135:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T00:15:52.822 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T00:15:52.823 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T00:15:52.823 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T00:15:52.823 INFO:teuthology.orchestra.run.smithi135.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T00:15:52.823 DEBUG:teuthology.orchestra.run.smithi135:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T00:15:52.975 DEBUG:teuthology.orchestra.run.smithi135:> sudo shutdown -r now 2024-09-12T00:15:53.359 INFO:teuthology.orchestra.run.smithi019.stderr:Generating grub configuration file ... 2024-09-12T00:15:54.723 INFO:teuthology.orchestra.run.smithi019.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-12T00:15:54.755 INFO:teuthology.orchestra.run.smithi019.stderr:done 2024-09-12T00:15:54.757 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T00:15:54.773 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.QsBx3pAjRr 2024-09-12T00:15:54.773 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QsBx3pAjRr 2024-09-12T00:15:54.839 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.QsBx3pAjRr 2024-09-12T00:15:54.976 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.QsBx3pAjRr is 6KB 2024-09-12T00:15:55.024 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.QsBx3pAjRr 2024-09-12T00:15:55.039 DEBUG:teuthology.orchestra.run.smithi019:> sudo /bin/ls /boot/loader/entries || true 2024-09-12T00:15:55.102 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-12T00:15:55.102 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-12T00:15:55.102 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-12T00:15:55.102 INFO:teuthology.orchestra.run.smithi019.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-12T00:15:55.104 DEBUG:teuthology.orchestra.run.smithi019:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-12T00:15:55.240 DEBUG:teuthology.orchestra.run.smithi019:> sudo shutdown -r now 2024-09-12T00:16:23.005 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-12T00:16:23.006 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T00:16:23.007 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:16:25.248 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-12T00:16:25.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T00:16:25.249 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:16:41.533 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-09-12T00:16:50.541 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T00:16:50.542 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:16:53.629 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.135 2024-09-12T00:17:05.637 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T00:17:05.638 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:17:25.280 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T00:17:34.289 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T00:17:34.290 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:17:34.687 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-12T00:17:35.082 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T00:17:35.082 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-505.el9.x86_64"... 2024-09-12T00:17:35.082 DEBUG:teuthology.orchestra.run.smithi019:> uname -r 2024-09-12T00:17:35.097 INFO:teuthology.orchestra.run.smithi019.stdout:5.14.0-505.el9.x86_64 2024-09-12T00:17:35.098 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T00:17:35.098 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:17:35.098 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T00:17:36.099 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-12T00:17:36.100 DEBUG:teuthology.orchestra.run.smithi019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:17:36.169 INFO:teuthology.orchestra.run.smithi019.stdout:ttyS1 2024-09-12T00:17:36.198 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:37.756 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-12T00:17:38.258 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T00:17:38.259 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-505.el9.x86_64"... 2024-09-12T00:17:38.259 DEBUG:teuthology.orchestra.run.smithi135:> uname -r 2024-09-12T00:17:38.280 INFO:teuthology.orchestra.run.smithi135.stdout:5.14.0-505.el9.x86_64 2024-09-12T00:17:38.280 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-12T00:17:38.281 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:17:38.281 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-12T00:17:39.282 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T00:17:39.282 DEBUG:teuthology.orchestra.run.smithi135:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:17:39.356 INFO:teuthology.orchestra.run.smithi135.stdout:ttyS1 2024-09-12T00:17:39.386 DEBUG:teuthology.parallel:result is None 2024-09-12T00:17:39.386 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:17:39.394 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:17:39.395 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:17:39.398 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:17:39.414 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:17:39.421 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:17:39.453 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:17:39.454 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:17:39.459 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:17:39.494 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:17:39.500 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:17:39.500 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:17:39.519 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:17:39.554 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:17:39.564 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:17:39.615 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:17:39.626 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:17:39.628 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:17:39.637 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:17:39.637 DEBUG:teuthology.orchestra.run.smithi019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:17:39.642 DEBUG:teuthology.orchestra.run.smithi135:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:17:39.667 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:17:39.678 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:17:39.678 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:17:39.712 DEBUG:teuthology.orchestra.run.smithi135:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:17:39.727 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:17:39.820 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:17:39.887 DEBUG:teuthology.orchestra.run.smithi019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:17:39.935 DEBUG:teuthology.orchestra.run.smithi019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:17:39.974 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:17:39.974 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:17:40.044 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:17:40.095 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:17:40.146 DEBUG:teuthology.orchestra.run.smithi135:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:17:40.238 DEBUG:teuthology.orchestra.run.smithi135:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:17:40.269 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:17:40.269 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:17:40.334 DEBUG:teuthology.orchestra.run.smithi019:> sudo service rsyslog restart 2024-09-12T00:17:40.337 DEBUG:teuthology.orchestra.run.smithi135:> sudo service rsyslog restart 2024-09-12T00:17:40.378 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:17:40.418 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T00:17:40.931 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:17:40.943 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:17:40.943 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:17:40.993 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:17:41.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo service auditd rotate 2024-09-12T00:17:41.070 INFO:teuthology.orchestra.run.smithi019.stdout:Rotating logs: 2024-09-12T00:17:41.072 DEBUG:teuthology.orchestra.run.smithi135:> sudo service auditd rotate 2024-09-12T00:17:41.125 INFO:teuthology.orchestra.run.smithi135.stdout:Rotating logs: 2024-09-12T00:17:41.127 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:17:41.127 DEBUG:teuthology.orchestra.run.smithi019:> /usr/sbin/getenforce 2024-09-12T00:17:41.151 INFO:teuthology.orchestra.run.smithi019.stdout:Permissive 2024-09-12T00:17:41.152 DEBUG:teuthology.orchestra.run.smithi135:> /usr/sbin/getenforce 2024-09-12T00:17:41.195 INFO:teuthology.orchestra.run.smithi135.stdout:Permissive 2024-09-12T00:17:41.195 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi019.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi135.front.sepia.ceph.com': 'permissive'} 2024-09-12T00:17:41.195 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:17:41.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:41.222 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T00:17:41.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:17:41.261 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:17:41.262 DEBUG:teuthology.orchestra.run.smithi019:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:17:41.301 DEBUG:teuthology.orchestra.run.smithi135:> sudo /usr/sbin/setenforce permissive 2024-09-12T00:17:41.339 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:17:41.348 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:17:41.360 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:17:41.360 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi019.front.sepia.ceph.com,smithi135.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:21:26.370 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi019.front.sepia.ceph.com'), Remote(name='ubuntu@smithi135.front.sepia.ceph.com')] 2024-09-12T00:21:26.372 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T00:21:26.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:21:26.496 DEBUG:teuthology.orchestra.run.smithi019:> true 2024-09-12T00:21:26.577 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi019.front.sepia.ceph.com' 2024-09-12T00:21:26.578 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T00:21:26.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi135.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:21:26.679 DEBUG:teuthology.orchestra.run.smithi135:> true 2024-09-12T00:21:26.757 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi135.front.sepia.ceph.com' 2024-09-12T00:21:26.757 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:21:26.768 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:21:26.769 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:21:26.769 DEBUG:teuthology.orchestra.run.smithi019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:21:26.772 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:21:26.772 DEBUG:teuthology.orchestra.run.smithi135:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:21:26.801 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:21:26.818 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:21:26.828 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-12T00:21:26.843 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-12T00:21:26.844 INFO:teuthology.orchestra.run.smithi019.stderr:sudo: ntpd: command not found 2024-09-12T00:21:26.856 INFO:teuthology.orchestra.run.smithi019.stdout:506 Cannot talk to daemon 2024-09-12T00:21:26.868 INFO:teuthology.orchestra.run.smithi135.stderr:sudo: ntpd: command not found 2024-09-12T00:21:26.871 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:21:26.880 INFO:teuthology.orchestra.run.smithi135.stdout:506 Cannot talk to daemon 2024-09-12T00:21:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:21:26.894 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-12T00:21:26.909 INFO:teuthology.orchestra.run.smithi135.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-12T00:21:26.944 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:21:26.948 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:21:26.948 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-12T00:21:26.948 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:21:26.948 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:21:26.948 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:21:26.948 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:21:26.970 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-12T00:21:26.974 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T00:21:26.974 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-12T00:21:26.974 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:21:26.974 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:21:26.974 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:21:26.975 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T00:21:26.975 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:21:26.984 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:21:26.984 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:21:26.984 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:21:26.984 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:21:26.991 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:21:26.991 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:21:26.991 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-12T00:21:26.992 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:21:26.995 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'tag': None, 'wait_for_package': False} 2024-09-12T00:21:26.995 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:21:27.159 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-12T00:21:27.159 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-12T00:21:27.174 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/ 2024-09-12T00:21:27.174 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4753.gd011c522 2024-09-12T00:21:27.282 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:21:27.282 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:21:27.282 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:21:27.294 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-12T00:21:27.294 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:21:27.294 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-12T00:21:27.310 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T00:21:27.310 DEBUG:teuthology.orchestra.run.smithi019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:21:27.320 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, s3cmd, maven, s3cmd, maven, s3cmd, maven, s3cmd, maven on remote rpm x86_64 2024-09-12T00:21:27.320 DEBUG:teuthology.orchestra.run.smithi135:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/d011c522bb171e70fc5782f1e7a71ce5f37e573f/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-12T00:21:27.378 DEBUG:teuthology.orchestra.run.smithi019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:21:27.385 DEBUG:teuthology.orchestra.run.smithi135:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-12T00:21:27.455 DEBUG:teuthology.orchestra.run.smithi019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:21:27.460 DEBUG:teuthology.orchestra.run.smithi135:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-12T00:21:27.522 INFO:teuthology.orchestra.run.smithi019.stdout:check_obsoletes = 1 2024-09-12T00:21:27.524 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum clean all 2024-09-12T00:21:27.524 INFO:teuthology.orchestra.run.smithi135.stdout:check_obsoletes = 1 2024-09-12T00:21:27.526 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum clean all 2024-09-12T00:21:27.759 INFO:teuthology.orchestra.run.smithi019.stdout:45 files removed 2024-09-12T00:21:27.760 INFO:teuthology.orchestra.run.smithi135.stdout:45 files removed 2024-09-12T00:21:27.788 DEBUG:teuthology.orchestra.run.smithi135:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T00:21:27.788 DEBUG:teuthology.orchestra.run.smithi019:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd s3cmd maven s3cmd maven s3cmd maven s3cmd maven 2024-09-12T00:21:28.358 INFO:teuthology.orchestra.run.smithi135.stdout:ceph packages for x86_64 301 kB/s | 84 kB 00:00 2024-09-12T00:21:28.483 INFO:teuthology.orchestra.run.smithi019.stdout:ceph packages for x86_64 213 kB/s | 84 kB 00:00 2024-09-12T00:21:28.667 INFO:teuthology.orchestra.run.smithi135.stdout:ceph noarch packages 91 kB/s | 24 kB 00:00 2024-09-12T00:21:28.775 INFO:teuthology.orchestra.run.smithi019.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-12T00:21:28.951 INFO:teuthology.orchestra.run.smithi135.stdout:ceph source packages 7.8 kB/s | 1.9 kB 00:00 2024-09-12T00:21:29.059 INFO:teuthology.orchestra.run.smithi019.stdout:ceph source packages 7.9 kB/s | 1.9 kB 00:00 2024-09-12T00:21:29.876 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.2 MB 00:00 2024-09-12T00:21:31.243 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - BaseOS 3.7 MB/s | 8.2 MB 00:02 2024-09-12T00:21:32.985 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - AppStream 31 MB/s | 20 MB 00:00 2024-09-12T00:21:33.202 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - AppStream 9.4 MB/s | 20 MB 00:02 2024-09-12T00:21:37.270 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-12T00:21:38.293 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - CRB 5.8 MB/s | 6.5 MB 00:01 2024-09-12T00:21:38.887 INFO:teuthology.orchestra.run.smithi135.stdout:CentOS Stream 9 - Extras packages 68 kB/s | 19 kB 00:00 2024-09-12T00:21:39.770 INFO:teuthology.orchestra.run.smithi019.stdout:CentOS Stream 9 - Extras packages 97 kB/s | 19 kB 00:00 2024-09-12T00:21:39.808 INFO:teuthology.orchestra.run.smithi135.stdout:Extra Packages for Enterprise Linux 28 MB/s | 23 MB 00:00 2024-09-12T00:21:40.908 INFO:teuthology.orchestra.run.smithi019.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-12T00:21:45.339 INFO:teuthology.orchestra.run.smithi135.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-12T00:21:46.647 INFO:teuthology.orchestra.run.smithi019.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-12T00:21:47.675 INFO:teuthology.orchestra.run.smithi135.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:21:47.676 INFO:teuthology.orchestra.run.smithi135.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:21:47.767 INFO:teuthology.orchestra.run.smithi135.stdout:Dependencies resolved. 2024-09-12T00:21:47.798 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================================== 2024-09-12T00:21:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: Package Arch Version Repository Size 2024-09-12T00:21:47.798 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================================== 2024-09-12T00:21:47.798 INFO:teuthology.orchestra.run.smithi135.stdout:Installing: 2024-09-12T00:21:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-12T00:21:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:21:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-12T00:21:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-12T00:21:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-12T00:21:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-12T00:21:47.798 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:21:47.799 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-12T00:21:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-12T00:21:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-12T00:21:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-12T00:21:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:21:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-12T00:21:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T00:21:47.800 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrading: 2024-09-12T00:21:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-12T00:21:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:21:47.800 INFO:teuthology.orchestra.run.smithi135.stdout:Installing dependencies: 2024-09-12T00:21:47.800 INFO:teuthology.orchestra.run.smithi135.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T00:21:47.801 INFO:teuthology.orchestra.run.smithi135.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T00:21:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T00:21:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T00:21:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:21:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T00:21:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T00:21:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-12T00:21:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-12T00:21:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-12T00:21:47.802 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-12T00:21:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-12T00:21:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-12T00:21:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-12T00:21:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-12T00:21:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T00:21:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T00:21:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T00:21:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T00:21:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T00:21:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T00:21:47.803 INFO:teuthology.orchestra.run.smithi135.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T00:21:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T00:21:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T00:21:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T00:21:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:21:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:21:47.804 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:21:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:21:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T00:21:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T00:21:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T00:21:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T00:21:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:21:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T00:21:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:21:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T00:21:47.805 INFO:teuthology.orchestra.run.smithi135.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T00:21:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T00:21:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T00:21:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T00:21:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T00:21:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T00:21:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T00:21:47.806 INFO:teuthology.orchestra.run.smithi135.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T00:21:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T00:21:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T00:21:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T00:21:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T00:21:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T00:21:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T00:21:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T00:21:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T00:21:47.807 INFO:teuthology.orchestra.run.smithi135.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T00:21:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T00:21:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T00:21:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T00:21:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T00:21:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T00:21:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T00:21:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T00:21:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T00:21:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T00:21:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T00:21:47.808 INFO:teuthology.orchestra.run.smithi135.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T00:21:47.809 INFO:teuthology.orchestra.run.smithi135.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T00:21:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T00:21:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T00:21:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T00:21:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T00:21:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T00:21:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T00:21:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:21:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T00:21:47.810 INFO:teuthology.orchestra.run.smithi135.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:21:47.811 INFO:teuthology.orchestra.run.smithi135.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:21:47.812 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T00:21:47.813 INFO:teuthology.orchestra.run.smithi135.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T00:21:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:21:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:21:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T00:21:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T00:21:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T00:21:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T00:21:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T00:21:47.814 INFO:teuthology.orchestra.run.smithi135.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T00:21:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:21:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T00:21:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T00:21:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T00:21:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T00:21:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T00:21:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T00:21:47.815 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T00:21:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T00:21:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T00:21:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T00:21:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T00:21:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:21:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:21:47.816 INFO:teuthology.orchestra.run.smithi135.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:21:47.817 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:21:47.818 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:21:47.819 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:21:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:21:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:21:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:21:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:21:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:21:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:21:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:21:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:21:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:21:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:21:47.820 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:21:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:21:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:21:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:21:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:21:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:21:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:21:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:21:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:21:47.821 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:21:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:21:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:21:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T00:21:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T00:21:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T00:21:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:21:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T00:21:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:21:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T00:21:47.822 INFO:teuthology.orchestra.run.smithi135.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T00:21:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T00:21:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T00:21:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T00:21:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T00:21:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T00:21:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T00:21:47.823 INFO:teuthology.orchestra.run.smithi135.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout:Installing weak dependencies: 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T00:21:47.824 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction Summary 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout:====================================================================================================== 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout:Install 283 Packages 2024-09-12T00:21:47.825 INFO:teuthology.orchestra.run.smithi135.stdout:Upgrade 2 Packages 2024-09-12T00:21:47.826 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:21:47.826 INFO:teuthology.orchestra.run.smithi135.stdout:Total download size: 327 M 2024-09-12T00:21:47.826 INFO:teuthology.orchestra.run.smithi135.stdout:Downloading Packages: 2024-09-12T00:21:48.649 INFO:teuthology.orchestra.run.smithi135.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 53 kB/s | 6.6 kB 00:00 2024-09-12T00:21:48.857 INFO:teuthology.orchestra.run.smithi135.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 4.2 MB/s | 899 kB 00:00 2024-09-12T00:21:48.958 INFO:teuthology.orchestra.run.smithi135.stdout:(3/285): ceph-immutable-object-cache-19.3.0-475 1.4 MB/s | 145 kB 00:00 2024-09-12T00:21:49.033 INFO:teuthology.orchestra.run.smithi135.stdout:(4/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 11 MB/s | 5.5 MB 00:00 2024-09-12T00:21:49.083 INFO:teuthology.orchestra.run.smithi019.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:21:49.084 INFO:teuthology.orchestra.run.smithi019.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-12T00:21:49.141 INFO:teuthology.orchestra.run.smithi135.stdout:(5/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 14 MB/s | 1.5 MB 00:00 2024-09-12T00:21:49.183 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-12T00:21:49.211 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================================== 2024-09-12T00:21:49.211 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-09-12T00:21:49.211 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================================== 2024-09-12T00:21:49.211 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-12T00:21:49.211 INFO:teuthology.orchestra.run.smithi019.stdout: ceph x86_64 2:19.3.0-4753.gd011c522.el9 ceph 6.6 k 2024-09-12T00:21:49.211 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:21:49.211 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 899 k 2024-09-12T00:21:49.211 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4753.gd011c522.el9 ceph 145 k 2024-09-12T00:21:49.211 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr x86_64 2:19.3.0-4753.gd011c522.el9 ceph 1.5 M 2024-09-12T00:21:49.211 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 154 k 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 14 M 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 7.4 M 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 49 k 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 11 M 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test x86_64 2:19.3.0-4753.gd011c522.el9 ceph 50 M 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 285 k 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 782 k 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 32 k 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 755 k 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel x86_64 2:19.3.0-4753.gd011c522.el9 ceph 126 k 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: maven noarch 1:3.6.3-15.el9 appstream 18 k 2024-09-12T00:21:49.212 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:21:49.213 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados x86_64 2:19.3.0-4753.gd011c522.el9 ceph 322 k 2024-09-12T00:21:49.213 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 306 k 2024-09-12T00:21:49.213 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw x86_64 2:19.3.0-4753.gd011c522.el9 ceph 99 k 2024-09-12T00:21:49.213 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 85 k 2024-09-12T00:21:49.213 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:21:49.213 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 170 k 2024-09-12T00:21:49.213 INFO:teuthology.orchestra.run.smithi019.stdout: s3cmd noarch 2.4.0-1.el9 epel 206 k 2024-09-12T00:21:49.213 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrading: 2024-09-12T00:21:49.213 INFO:teuthology.orchestra.run.smithi019.stdout: librados2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.5 M 2024-09-12T00:21:49.213 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 3.2 M 2024-09-12T00:21:49.213 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-12T00:21:49.214 INFO:teuthology.orchestra.run.smithi019.stdout: ModemManager-glib x86_64 1.20.2-1.el9 baseos 335 k 2024-09-12T00:21:49.214 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-12T00:21:49.214 INFO:teuthology.orchestra.run.smithi019.stdout: adwaita-cursor-theme noarch 40.1.1-3.el9 appstream 650 k 2024-09-12T00:21:49.214 INFO:teuthology.orchestra.run.smithi019.stdout: adwaita-icon-theme noarch 40.1.1-3.el9 appstream 12 M 2024-09-12T00:21:49.214 INFO:teuthology.orchestra.run.smithi019.stdout: alsa-lib x86_64 1.2.12-1.el9 appstream 523 k 2024-09-12T00:21:49.214 INFO:teuthology.orchestra.run.smithi019.stdout: apache-commons-cli noarch 1.4-17.el9 appstream 71 k 2024-09-12T00:21:49.214 INFO:teuthology.orchestra.run.smithi019.stdout: apache-commons-codec noarch 1.15-7.el9 appstream 302 k 2024-09-12T00:21:49.214 INFO:teuthology.orchestra.run.smithi019.stdout: apache-commons-io noarch 1:2.8.0-8.el9 appstream 283 k 2024-09-12T00:21:49.214 INFO:teuthology.orchestra.run.smithi019.stdout: apache-commons-lang3 noarch 3.12.0-6.el9 appstream 559 k 2024-09-12T00:21:49.215 INFO:teuthology.orchestra.run.smithi019.stdout: at-spi2-atk x86_64 2.38.0-4.el9 appstream 87 k 2024-09-12T00:21:49.215 INFO:teuthology.orchestra.run.smithi019.stdout: at-spi2-core x86_64 2.40.3-1.el9 appstream 195 k 2024-09-12T00:21:49.215 INFO:teuthology.orchestra.run.smithi019.stdout: atinject noarch 1.0.3-6.el9 appstream 23 k 2024-09-12T00:21:49.215 INFO:teuthology.orchestra.run.smithi019.stdout: atk x86_64 2.36.0-5.el9 appstream 292 k 2024-09-12T00:21:49.215 INFO:teuthology.orchestra.run.smithi019.stdout: avahi-glib x86_64 0.8-21.el9 appstream 15 k 2024-09-12T00:21:49.215 INFO:teuthology.orchestra.run.smithi019.stdout: bluez-libs x86_64 5.56-6.el9 baseos 85 k 2024-09-12T00:21:49.215 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-12T00:21:49.216 INFO:teuthology.orchestra.run.smithi019.stdout: bubblewrap x86_64 0.4.1-7.el9 baseos 49 k 2024-09-12T00:21:49.216 INFO:teuthology.orchestra.run.smithi019.stdout: cdi-api noarch 2.0.2-6.el9 appstream 53 k 2024-09-12T00:21:49.216 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 22 M 2024-09-12T00:21:49.216 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 34 k 2024-09-12T00:21:49.216 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds x86_64 2:19.3.0-4753.gd011c522.el9 ceph 2.4 M 2024-09-12T00:21:49.216 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 291 k 2024-09-12T00:21:49.216 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon x86_64 2:19.3.0-4753.gd011c522.el9 ceph 4.8 M 2024-09-12T00:21:49.216 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd x86_64 2:19.3.0-4753.gd011c522.el9 ceph 17 M 2024-09-12T00:21:49.216 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4753.gd011c522.el9 ceph-noarch 16 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux x86_64 2:19.3.0-4753.gd011c522.el9 ceph 25 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: colord-libs x86_64 1.4.5-4.el9 appstream 229 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: composefs-libs x86_64 1.0.5-1.el9 appstream 61 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: copy-jdk-configs noarch 4.0-3.el9 appstream 28 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: cups-libs x86_64 1:2.3.3op2-30.el9 baseos 262 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: exempi x86_64 2.6.0-0.2.20211007gite23c213.el9 appstream 525 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: exiv2-libs x86_64 0.27.5-2.el9 appstream 781 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: fdk-aac-free x86_64 2.0.0-8.el9 appstream 325 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: flac-libs x86_64 1.3.3-12.el9 appstream 218 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: flatpak-selinux noarch 1.12.9-1.el9 appstream 22 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: flatpak-session-helper x86_64 1.12.9-1.el9 appstream 73 k 2024-09-12T00:21:49.217 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: gdk-pixbuf2-modules x86_64 2.42.6-4.el9 appstream 89 k 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: geoclue2 x86_64 2.6.0-7.el9 appstream 124 k 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: giflib x86_64 5.2.1-9.el9 appstream 49 k 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: google-guice noarch 4.2.3-9.el9 appstream 473 k 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: graphene x86_64 1.10.6-2.el9 appstream 64 k 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: gsm x86_64 1.0.19-6.el9 appstream 34 k 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: gstreamer1 x86_64 1.22.1-2.el9 appstream 1.4 M 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: gstreamer1-plugins-base x86_64 1.22.1-2.el9 appstream 2.2 M 2024-09-12T00:21:49.218 INFO:teuthology.orchestra.run.smithi019.stdout: gtk-update-icon-cache x86_64 3.24.31-5.el9 appstream 33 k 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: guava noarch 30.1-6.el9 appstream 2.3 M 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: hicolor-icon-theme noarch 0.17-13.el9 appstream 219 k 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: httpcomponents-client noarch 4.5.13-3.el9 appstream 657 k 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: httpcomponents-core noarch 4.4.13-7.el9 appstream 632 k 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: iso-codes noarch 4.6.0-3.el9 appstream 3.5 M 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: jakarta-annotations noarch 1.3.5-13.el9 appstream 45 k 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: jansi x86_64 2.3.3-6.el9 appstream 110 k 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: java-11-openjdk x86_64 1:11.0.20.1.1-2.el9 appstream 413 k 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: java-11-openjdk-headless x86_64 1:11.0.20.1.1-2.el9 appstream 39 M 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: javapackages-filesystem noarch 6.0.0-4.el9 appstream 13 k 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: jbigkit-libs x86_64 2.1-23.el9 appstream 53 k 2024-09-12T00:21:49.219 INFO:teuthology.orchestra.run.smithi019.stdout: jcl-over-slf4j noarch 1.7.30-13.el9 appstream 24 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: jsoup noarch 1.13.1-10.el9 appstream 377 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: jsr-305 noarch 3.0.2-6.el9 appstream 35 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: lcms2 x86_64 2.12-3.el9 appstream 168 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: libX11-xcb x86_64 1.7.0-9.el9 appstream 11 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: libXcomposite x86_64 0.4.5-7.el9 appstream 24 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: libXcursor x86_64 1.2.0-7.el9 appstream 31 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: libXdamage x86_64 1.1.5-7.el9 appstream 23 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: libXfixes x86_64 5.0.3-16.el9 appstream 20 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: libXi x86_64 1.7.10-8.el9 appstream 40 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: libXinerama x86_64 1.1.4-10.el9 appstream 15 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: libXrandr x86_64 1.5.2-8.el9 appstream 28 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: libXtst x86_64 1.2.3-16.el9 appstream 21 k 2024-09-12T00:21:49.220 INFO:teuthology.orchestra.run.smithi019.stdout: libXv x86_64 1.0.11-16.el9 appstream 19 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libXxf86vm x86_64 1.1.4-18.el9 appstream 19 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libasyncns x86_64 0.8-22.el9 appstream 30 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libcanberra x86_64 0.30-27.el9 appstream 86 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite x86_64 2:19.3.0-4753.gd011c522.el9 ceph 161 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libdrm x86_64 2.4.121-1.el9 appstream 161 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libepoxy x86_64 1.5.5-4.el9 appstream 241 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libexif x86_64 0.6.22-6.el9 appstream 435 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libfontenc x86_64 1.1.3-17.el9 appstream 31 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libgexiv2 x86_64 0.12.3-1.el9 appstream 83 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-12T00:21:49.221 INFO:teuthology.orchestra.run.smithi019.stdout: libglvnd x86_64 1:1.3.4-1.el9 appstream 135 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: libglvnd-egl x86_64 1:1.3.4-1.el9 appstream 37 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: libglvnd-glx x86_64 1:1.3.4-1.el9 appstream 142 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: libgsf x86_64 1.14.47-5.el9 appstream 256 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: libgxps x86_64 0.3.2-3.el9 appstream 79 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: libiptcdata x86_64 1.0.5-10.el9 appstream 61 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: libldac x86_64 2.0.2.3-10.el9 appstream 41 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: libnotify x86_64 0.7.9-8.el9 appstream 44 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: libogg x86_64 2:1.3.4-6.el9 appstream 34 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: libosinfo x86_64 1.10.0-1.el9 appstream 319 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: libpciaccess x86_64 0.16-7.el9 baseos 27 k 2024-09-12T00:21:49.222 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 508 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2 x86_64 2:19.3.0-4753.gd011c522.el9 ceph 5.5 M 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: libsbc x86_64 1.4-9.el9 appstream 45 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: libsndfile x86_64 1.0.31-8.el9 appstream 206 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: libtheora x86_64 1:1.1.1-31.el9 appstream 164 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: libtiff x86_64 4.4.0-13.el9 appstream 198 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: libtool-ltdl x86_64 2.4.6-46.el9 appstream 36 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: libtracker-sparql x86_64 3.1.2-3.el9 appstream 324 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-12T00:21:49.223 INFO:teuthology.orchestra.run.smithi019.stdout: libvisual x86_64 1:0.4.0-34.el9 appstream 144 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: libvorbis x86_64 1:1.3.7-5.el9 appstream 193 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: libwayland-client x86_64 1.21.0-1.el9 appstream 33 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: libwayland-cursor x86_64 1.21.0-1.el9 appstream 19 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: libwayland-egl x86_64 1.21.0-1.el9 appstream 13 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: libwayland-server x86_64 1.21.0-1.el9 appstream 42 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: libwebp x86_64 1.2.0-8.el9 appstream 277 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: libxkbcommon x86_64 1.0.3-4.el9 appstream 133 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: libxshmfence x86_64 1.3-10.el9 appstream 13 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: lksctp-tools x86_64 1.0.19-2.el9 baseos 94 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: low-memory-monitor x86_64 2.1-4.el9 appstream 36 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-12T00:21:49.224 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: lua-posix x86_64 35.0-8.el9 appstream 151 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: maven-lib noarch 1:3.6.3-15.el9 appstream 1.5 M 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: maven-openjdk11 noarch 1:3.6.3-15.el9 appstream 9.0 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: maven-resolver noarch 1:1.6.1-10.el9 appstream 517 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: maven-shared-utils noarch 3.3.4-3.el9 appstream 151 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: maven-wagon noarch 3.4.2-7.el9 appstream 112 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-filesystem x86_64 24.1.2-3.el9 appstream 11 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-libEGL x86_64 24.1.2-3.el9 appstream 139 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-libGL x86_64 24.1.2-3.el9 appstream 171 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-libgbm x86_64 24.1.2-3.el9 appstream 36 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-libglapi x86_64 24.1.2-3.el9 appstream 46 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: mkfontscale x86_64 1.2.1-3.el9 appstream 32 k 2024-09-12T00:21:49.225 INFO:teuthology.orchestra.run.smithi019.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: openjpeg2 x86_64 2.4.0-7.el9 appstream 163 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: opus x86_64 1.3.1-10.el9 appstream 200 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: orc x86_64 0.4.31-8.el9 appstream 183 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: osinfo-db noarch 20240701-2.el9 appstream 531 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: osinfo-db-tools x86_64 1.10.0-1.el9 appstream 74 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: ostree-libs x86_64 2024.7-2.el9 appstream 468 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire-jack-audio-connection-kit-libs x86_64 1.0.1-1.el9 appstream 135 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire-libs x86_64 1.0.1-1.el9 appstream 1.9 M 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-cipher noarch 1.7-27.el9 appstream 26 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-classworlds noarch 2.6.0-11.el9 appstream 60 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-containers-component-annotations noarch 2.1.0-10.el9 appstream 18 k 2024-09-12T00:21:49.226 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-interpolation noarch 1.26-11.el9 appstream 80 k 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-sec-dispatcher noarch 1.4-37.el9 appstream 34 k 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-utils noarch 3.3.0-10.el9 appstream 254 k 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: poppler x86_64 21.01.0-21.el9 appstream 1.1 M 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: poppler-data noarch 0.4.9-9.el9 appstream 1.9 M 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: poppler-glib x86_64 21.01.0-21.el9 appstream 152 k 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: publicsuffix-list noarch 20210518-3.el9 appstream 83 k 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: pulseaudio-libs x86_64 15.0-2.el9 appstream 679 k 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-12T00:21:49.227 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse x86_64 2:19.3.0-4753.gd011c522.el9 ceph 45 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common x86_64 2:19.3.0-4753.gd011c522.el9 ceph 143 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-12T00:21:49.228 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-12T00:21:49.229 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-12T00:21:49.229 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-12T00:21:49.229 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-12T00:21:49.229 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-12T00:21:49.229 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-12T00:21:49.229 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-12T00:21:49.229 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-12T00:21:49.229 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-12T00:21:49.229 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-12T00:21:49.230 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-12T00:21:49.231 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: rtkit x86_64 0.11-29.el9 appstream 56 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: sisu noarch 1:0.3.4-10.el9 appstream 510 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: slf4j noarch 1.7.30-13.el9 appstream 69 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: sound-theme-freedesktop noarch 0.8-17.el9 appstream 383 k 2024-09-12T00:21:49.232 INFO:teuthology.orchestra.run.smithi019.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: totem-pl-parser x86_64 3.26.6-2.el9 appstream 152 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: tracker x86_64 3.1.2-3.el9 appstream 555 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: ttmkfdir x86_64 3.0.9-65.el9 appstream 53 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: tzdata-java noarch 2024a-2.el9 appstream 230 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: upower x86_64 0.99.11-11.el9 appstream 173 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: webrtc-audio-processing x86_64 0.3.1-8.el9 appstream 306 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: wireplumber x86_64 0.4.14-1.el9 appstream 96 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: wireplumber-libs x86_64 0.4.14-1.el9 appstream 358 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: xdg-dbus-proxy x86_64 0.1.3-1.el9 appstream 42 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: xdg-desktop-portal x86_64 1.12.6-1.el9 appstream 385 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: xkeyboard-config noarch 2.33-2.el9 appstream 859 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-12T00:21:49.233 INFO:teuthology.orchestra.run.smithi019.stdout: xorg-x11-fonts-Type1 noarch 7.5-33.el9 appstream 505 k 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: dconf x86_64 0.40.0-6.el9 appstream 113 k 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: exiv2 x86_64 0.27.5-2.el9 appstream 980 k 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: flatpak x86_64 1.12.9-1.el9 appstream 1.7 M 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: gtk3 x86_64 3.24.31-5.el9 appstream 4.9 M 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: java-11-openjdk-devel x86_64 1:11.0.20.1.1-2.el9 appstream 3.3 M 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: libcanberra-gtk3 x86_64 0.30-27.el9 appstream 32 k 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-dri-drivers x86_64 24.1.2-3.el9 appstream 8.8 M 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: p11-kit-server x86_64 0.25.3-2.el9 appstream 246 k 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire x86_64 1.0.1-1.el9 appstream 107 k 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire-alsa x86_64 1.0.1-1.el9 appstream 57 k 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire-jack-audio-connection-kit x86_64 1.0.1-1.el9 appstream 9.1 k 2024-09-12T00:21:49.234 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire-pulseaudio x86_64 1.0.1-1.el9 appstream 192 k 2024-09-12T00:21:49.235 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-12T00:21:49.235 INFO:teuthology.orchestra.run.smithi019.stdout: tracker-miners x86_64 3.1.2-4.el9 appstream 944 k 2024-09-12T00:21:49.235 INFO:teuthology.orchestra.run.smithi019.stdout: xdg-desktop-portal-gtk x86_64 1.12.0-3.el9 appstream 134 k 2024-09-12T00:21:49.235 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:21:49.235 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-12T00:21:49.235 INFO:teuthology.orchestra.run.smithi019.stdout:====================================================================================================== 2024-09-12T00:21:49.235 INFO:teuthology.orchestra.run.smithi019.stdout:Install 283 Packages 2024-09-12T00:21:49.235 INFO:teuthology.orchestra.run.smithi019.stdout:Upgrade 2 Packages 2024-09-12T00:21:49.235 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:21:49.236 INFO:teuthology.orchestra.run.smithi135.stdout:(6/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 8.9 MB/s | 2.4 MB 00:00 2024-09-12T00:21:49.236 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 327 M 2024-09-12T00:21:49.236 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-12T00:21:49.467 INFO:teuthology.orchestra.run.smithi135.stdout:(7/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 15 MB/s | 4.8 MB 00:00 2024-09-12T00:21:49.684 INFO:teuthology.orchestra.run.smithi135.stdout:(8/285): ceph-common-19.3.0-4753.gd011c522.el9. 19 MB/s | 22 MB 00:01 2024-09-12T00:21:49.734 INFO:teuthology.orchestra.run.smithi135.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 508 kB/s | 25 kB 00:00 2024-09-12T00:21:50.157 INFO:teuthology.orchestra.run.smithi019.stdout:(1/285): ceph-19.3.0-4753.gd011c522.el9.x86_64. 21 kB/s | 6.6 kB 00:00 2024-09-12T00:21:50.457 INFO:teuthology.orchestra.run.smithi019.stdout:(2/285): ceph-fuse-19.3.0-4753.gd011c522.el9.x8 2.9 MB/s | 899 kB 00:00 2024-09-12T00:21:50.476 INFO:teuthology.orchestra.run.smithi135.stdout:(10/285): ceph-osd-19.3.0-4753.gd011c522.el9.x8 14 MB/s | 17 MB 00:01 2024-09-12T00:21:50.507 INFO:teuthology.orchestra.run.smithi019.stdout:(3/285): ceph-immutable-object-cache-19.3.0-475 2.9 MB/s | 145 kB 00:00 2024-09-12T00:21:50.601 INFO:teuthology.orchestra.run.smithi135.stdout:(11/285): ceph-radosgw-19.3.0-4753.gd011c522.el 9.6 MB/s | 11 MB 00:01 2024-09-12T00:21:50.624 INFO:teuthology.orchestra.run.smithi019.stdout:(4/285): ceph-mds-19.3.0-4753.gd011c522.el9.x86 20 MB/s | 2.4 MB 00:00 2024-09-12T00:21:50.626 INFO:teuthology.orchestra.run.smithi135.stdout:(12/285): libcephfs-devel-19.3.0-4753.gd011c522 211 kB/s | 32 kB 00:00 2024-09-12T00:21:50.685 INFO:teuthology.orchestra.run.smithi135.stdout:(13/285): libcephfs2-19.3.0-4753.gd011c522.el9. 8.9 MB/s | 755 kB 00:00 2024-09-12T00:21:50.708 INFO:teuthology.orchestra.run.smithi019.stdout:(5/285): ceph-mgr-19.3.0-4753.gd011c522.el9.x86 18 MB/s | 1.5 MB 00:00 2024-09-12T00:21:50.710 INFO:teuthology.orchestra.run.smithi135.stdout:(14/285): libcephsqlite-19.3.0-4753.gd011c522.e 1.9 MB/s | 161 kB 00:00 2024-09-12T00:21:50.752 INFO:teuthology.orchestra.run.smithi135.stdout:(15/285): librados-devel-19.3.0-4753.gd011c522. 1.8 MB/s | 126 kB 00:00 2024-09-12T00:21:51.000 INFO:teuthology.orchestra.run.smithi019.stdout:(6/285): ceph-mon-19.3.0-4753.gd011c522.el9.x86 16 MB/s | 4.8 MB 00:00 2024-09-12T00:21:51.145 INFO:teuthology.orchestra.run.smithi135.stdout:(16/285): libradosstriper1-19.3.0-4753.gd011c52 1.1 MB/s | 508 kB 00:00 2024-09-12T00:21:51.244 INFO:teuthology.orchestra.run.smithi135.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 453 kB/s | 45 kB 00:00 2024-09-12T00:21:51.345 INFO:teuthology.orchestra.run.smithi135.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 1.4 MB/s | 143 kB 00:00 2024-09-12T00:21:51.445 INFO:teuthology.orchestra.run.smithi135.stdout:(19/285): python3-cephfs-19.3.0-4753.gd011c522. 1.6 MB/s | 161 kB 00:00 2024-09-12T00:21:51.546 INFO:teuthology.orchestra.run.smithi135.stdout:(20/285): python3-rados-19.3.0-4753.gd011c522.e 3.1 MB/s | 322 kB 00:00 2024-09-12T00:21:51.646 INFO:teuthology.orchestra.run.smithi135.stdout:(21/285): python3-rbd-19.3.0-4753.gd011c522.el9 3.0 MB/s | 306 kB 00:00 2024-09-12T00:21:51.746 INFO:teuthology.orchestra.run.smithi135.stdout:(22/285): python3-rgw-19.3.0-4753.gd011c522.el9 998 kB/s | 99 kB 00:00 2024-09-12T00:21:51.846 INFO:teuthology.orchestra.run.smithi135.stdout:(23/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 852 kB/s | 85 kB 00:00 2024-09-12T00:21:51.947 INFO:teuthology.orchestra.run.smithi135.stdout:(24/285): librgw2-19.3.0-4753.gd011c522.el9.x86 4.6 MB/s | 5.5 MB 00:01 2024-09-12T00:21:52.014 INFO:teuthology.orchestra.run.smithi135.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 2.5 MB/s | 170 kB 00:00 2024-09-12T00:21:52.066 INFO:teuthology.orchestra.run.smithi019.stdout:(7/285): ceph-osd-19.3.0-4753.gd011c522.el9.x86 16 MB/s | 17 MB 00:01 2024-09-12T00:21:52.175 INFO:teuthology.orchestra.run.smithi019.stdout:(8/285): ceph-base-19.3.0-4753.gd011c522.el9.x8 2.4 MB/s | 5.5 MB 00:02 2024-09-12T00:21:52.234 INFO:teuthology.orchestra.run.smithi019.stdout:(9/285): ceph-selinux-19.3.0-4753.gd011c522.el9 430 kB/s | 25 kB 00:00 2024-09-12T00:21:52.434 INFO:teuthology.orchestra.run.smithi019.stdout:(10/285): ceph-common-19.3.0-4753.gd011c522.el9 8.4 MB/s | 22 MB 00:02 2024-09-12T00:21:52.476 INFO:teuthology.orchestra.run.smithi019.stdout:(11/285): libcephfs-devel-19.3.0-4753.gd011c522 769 kB/s | 32 kB 00:00 2024-09-12T00:21:52.514 INFO:teuthology.orchestra.run.smithi135.stdout:(26/285): ceph-test-19.3.0-4753.gd011c522.el9.x 18 MB/s | 50 MB 00:02 2024-09-12T00:21:52.539 INFO:teuthology.orchestra.run.smithi135.stdout:(27/285): ceph-grafana-dashboards-19.3.0-4753.g 65 kB/s | 34 kB 00:00 2024-09-12T00:21:52.565 INFO:teuthology.orchestra.run.smithi135.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 3.0 MB/s | 154 kB 00:00 2024-09-12T00:21:52.618 INFO:teuthology.orchestra.run.smithi019.stdout:(12/285): ceph-radosgw-19.3.0-4753.gd011c522.el 20 MB/s | 11 MB 00:00 2024-09-12T00:21:52.631 INFO:teuthology.orchestra.run.smithi135.stdout:(29/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 4.0 MB/s | 3.2 MB 00:00 2024-09-12T00:21:52.651 INFO:teuthology.orchestra.run.smithi019.stdout:(13/285): libcephfs2-19.3.0-4753.gd011c522.el9. 4.2 MB/s | 755 kB 00:00 2024-09-12T00:21:52.677 INFO:teuthology.orchestra.run.smithi019.stdout:(14/285): libcephsqlite-19.3.0-4753.gd011c522.e 2.7 MB/s | 161 kB 00:00 2024-09-12T00:21:52.719 INFO:teuthology.orchestra.run.smithi019.stdout:(15/285): librados-devel-19.3.0-4753.gd011c522. 1.8 MB/s | 126 kB 00:00 2024-09-12T00:21:52.732 INFO:teuthology.orchestra.run.smithi135.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4753.gd0 2.8 MB/s | 291 kB 00:00 2024-09-12T00:21:52.752 INFO:teuthology.orchestra.run.smithi019.stdout:(16/285): libradosstriper1-19.3.0-4753.gd011c52 6.6 MB/s | 508 kB 00:00 2024-09-12T00:21:52.824 INFO:teuthology.orchestra.run.smithi135.stdout:(31/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 539 kB/s | 49 kB 00:00 2024-09-12T00:21:52.836 INFO:teuthology.orchestra.run.smithi019.stdout:(17/285): python3-ceph-argparse-19.3.0-4753.gd0 542 kB/s | 45 kB 00:00 2024-09-12T00:21:52.899 INFO:teuthology.orchestra.run.smithi135.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4753.gd 220 kB/s | 16 kB 00:00 2024-09-12T00:21:52.928 INFO:teuthology.orchestra.run.smithi019.stdout:(18/285): python3-ceph-common-19.3.0-4753.gd011 1.5 MB/s | 143 kB 00:00 2024-09-12T00:21:52.995 INFO:teuthology.orchestra.run.smithi019.stdout:(19/285): python3-cephfs-19.3.0-4753.gd011c522. 2.4 MB/s | 161 kB 00:00 2024-09-12T00:21:52.999 INFO:teuthology.orchestra.run.smithi135.stdout:(33/285): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-12T00:21:53.024 INFO:teuthology.orchestra.run.smithi135.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 2.2 MB/s | 285 kB 00:00 2024-09-12T00:21:53.066 INFO:teuthology.orchestra.run.smithi135.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 11 MB/s | 782 kB 00:00 2024-09-12T00:21:53.070 INFO:teuthology.orchestra.run.smithi019.stdout:(20/285): librgw2-19.3.0-4753.gd011c522.el9.x86 16 MB/s | 5.5 MB 00:00 2024-09-12T00:21:53.112 INFO:teuthology.orchestra.run.smithi019.stdout:(21/285): python3-rados-19.3.0-4753.gd011c522.e 2.7 MB/s | 322 kB 00:00 2024-09-12T00:21:53.137 INFO:teuthology.orchestra.run.smithi019.stdout:(22/285): python3-rbd-19.3.0-4753.gd011c522.el9 4.5 MB/s | 306 kB 00:00 2024-09-12T00:21:53.162 INFO:teuthology.orchestra.run.smithi019.stdout:(23/285): python3-rgw-19.3.0-4753.gd011c522.el9 1.9 MB/s | 99 kB 00:00 2024-09-12T00:21:53.188 INFO:teuthology.orchestra.run.smithi019.stdout:(24/285): rbd-fuse-19.3.0-4753.gd011c522.el9.x8 1.7 MB/s | 85 kB 00:00 2024-09-12T00:21:53.217 INFO:teuthology.orchestra.run.smithi135.stdout:(36/285): bluez-libs-5.56-6.el9.x86_64.rpm 565 kB/s | 85 kB 00:00 2024-09-12T00:21:53.242 INFO:teuthology.orchestra.run.smithi135.stdout:(37/285): ModemManager-glib-1.20.2-1.el9.x86_64 1.5 MB/s | 335 kB 00:00 2024-09-12T00:21:53.263 INFO:teuthology.orchestra.run.smithi019.stdout:(25/285): rbd-nbd-19.3.0-4753.gd011c522.el9.x86 2.2 MB/s | 170 kB 00:00 2024-09-12T00:21:53.267 INFO:teuthology.orchestra.run.smithi135.stdout:(38/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 986 kB/s | 49 kB 00:00 2024-09-12T00:21:53.317 INFO:teuthology.orchestra.run.smithi135.stdout:(39/285): fuse-2.9.9-16.el9.x86_64.rpm 1.6 MB/s | 80 kB 00:00 2024-09-12T00:21:53.343 INFO:teuthology.orchestra.run.smithi135.stdout:(40/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 2.5 MB/s | 262 kB 00:00 2024-09-12T00:21:53.355 INFO:teuthology.orchestra.run.smithi019.stdout:(26/285): rbd-mirror-19.3.0-4753.gd011c522.el9. 16 MB/s | 3.2 MB 00:00 2024-09-12T00:21:53.372 INFO:teuthology.orchestra.run.smithi019.stdout:(27/285): ceph-grafana-dashboards-19.3.0-4753.g 315 kB/s | 34 kB 00:00 2024-09-12T00:21:53.393 INFO:teuthology.orchestra.run.smithi135.stdout:(41/285): libpciaccess-0.16-7.el9.x86_64.rpm 537 kB/s | 27 kB 00:00 2024-09-12T00:21:53.405 INFO:teuthology.orchestra.run.smithi019.stdout:(28/285): ceph-mgr-cephadm-19.3.0-4753.gd011c52 3.0 MB/s | 154 kB 00:00 2024-09-12T00:21:53.477 INFO:teuthology.orchestra.run.smithi135.stdout:(42/285): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-12T00:21:53.510 INFO:teuthology.orchestra.run.smithi135.stdout:(43/285): libgfortran-11.5.0-2.el9.x86_64.rpm 4.1 MB/s | 801 kB 00:00 2024-09-12T00:21:53.536 INFO:teuthology.orchestra.run.smithi135.stdout:(44/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 1.6 MB/s | 94 kB 00:00 2024-09-12T00:21:53.736 INFO:teuthology.orchestra.run.smithi135.stdout:(45/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-12T00:21:53.797 INFO:teuthology.orchestra.run.smithi135.stdout:(46/285): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-12T00:21:53.837 INFO:teuthology.orchestra.run.smithi135.stdout:(47/285): python3-cryptography-36.0.1-4.el9.x86 4.1 MB/s | 1.2 MB 00:00 2024-09-12T00:21:53.879 INFO:teuthology.orchestra.run.smithi135.stdout:(48/285): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-12T00:21:53.880 INFO:teuthology.orchestra.run.smithi019.stdout:(29/285): ceph-mgr-diskprediction-local-19.3.0- 16 MB/s | 7.4 MB 00:00 2024-09-12T00:21:53.904 INFO:teuthology.orchestra.run.smithi135.stdout:(49/285): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-12T00:21:53.948 INFO:teuthology.orchestra.run.smithi019.stdout:(30/285): ceph-mgr-modules-core-19.3.0-4753.gd0 4.3 MB/s | 291 kB 00:00 2024-09-12T00:21:53.963 INFO:teuthology.orchestra.run.smithi135.stdout:(50/285): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-12T00:21:54.023 INFO:teuthology.orchestra.run.smithi019.stdout:(31/285): ceph-mgr-rook-19.3.0-4753.gd011c522.e 657 kB/s | 49 kB 00:00 2024-09-12T00:21:54.090 INFO:teuthology.orchestra.run.smithi019.stdout:(32/285): ceph-prometheus-alerts-19.3.0-4753.gd 248 kB/s | 16 kB 00:00 2024-09-12T00:21:54.232 INFO:teuthology.orchestra.run.smithi019.stdout:(33/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 16 MB/s | 14 MB 00:00 2024-09-12T00:21:54.246 INFO:teuthology.orchestra.run.smithi135.stdout:(51/285): ceph-mgr-dashboard-19.3.0-4753.gd011c 8.3 MB/s | 14 MB 00:01 2024-09-12T00:21:54.257 INFO:teuthology.orchestra.run.smithi019.stdout:(34/285): ceph-volume-19.3.0-4753.gd011c522.el9 1.7 MB/s | 285 kB 00:00 2024-09-12T00:21:54.299 INFO:teuthology.orchestra.run.smithi019.stdout:(35/285): cephadm-19.3.0-4753.gd011c522.el9.noa 11 MB/s | 782 kB 00:00 2024-09-12T00:21:54.313 INFO:teuthology.orchestra.run.smithi135.stdout:(52/285): adwaita-cursor-theme-40.1.1-3.el9.noa 1.6 MB/s | 650 kB 00:00 2024-09-12T00:21:54.372 INFO:teuthology.orchestra.run.smithi135.stdout:(53/285): apache-commons-cli-1.4-17.el9.noarch. 1.2 MB/s | 71 kB 00:00 2024-09-12T00:21:54.455 INFO:teuthology.orchestra.run.smithi135.stdout:(54/285): apache-commons-codec-1.15-7.el9.noarc 3.5 MB/s | 302 kB 00:00 2024-09-12T00:21:54.514 INFO:teuthology.orchestra.run.smithi135.stdout:(55/285): apache-commons-io-2.8.0-8.el9.noarch. 4.8 MB/s | 283 kB 00:00 2024-09-12T00:21:54.581 INFO:teuthology.orchestra.run.smithi135.stdout:(56/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.5 MB/s | 523 kB 00:00 2024-09-12T00:21:54.606 INFO:teuthology.orchestra.run.smithi135.stdout:(57/285): apache-commons-lang3-3.12.0-6.el9.noa 5.9 MB/s | 559 kB 00:00 2024-09-12T00:21:54.631 INFO:teuthology.orchestra.run.smithi135.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2024-09-12T00:21:54.665 INFO:teuthology.orchestra.run.smithi135.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 3.3 MB/s | 195 kB 00:00 2024-09-12T00:21:54.690 INFO:teuthology.orchestra.run.smithi135.stdout:(60/285): atinject-1.0.3-6.el9.noarch.rpm 395 kB/s | 23 kB 00:00 2024-09-12T00:21:54.741 INFO:teuthology.orchestra.run.smithi135.stdout:(61/285): avahi-glib-0.8-21.el9.x86_64.rpm 299 kB/s | 15 kB 00:00 2024-09-12T00:21:54.791 INFO:teuthology.orchestra.run.smithi135.stdout:(62/285): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 107 kB 00:00 2024-09-12T00:21:54.841 INFO:teuthology.orchestra.run.smithi135.stdout:(63/285): atk-2.36.0-5.el9.x86_64.rpm 1.6 MB/s | 292 kB 00:00 2024-09-12T00:21:54.867 INFO:teuthology.orchestra.run.smithi135.stdout:(64/285): cdi-api-2.0.2-6.el9.noarch.rpm 710 kB/s | 53 kB 00:00 2024-09-12T00:21:54.917 INFO:teuthology.orchestra.run.smithi135.stdout:(65/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T00:21:54.967 INFO:teuthology.orchestra.run.smithi135.stdout:(66/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 565 kB/s | 28 kB 00:00 2024-09-12T00:21:54.993 INFO:teuthology.orchestra.run.smithi135.stdout:(67/285): colord-libs-1.4.5-4.el9.x86_64.rpm 1.5 MB/s | 229 kB 00:00 2024-09-12T00:21:55.034 INFO:teuthology.orchestra.run.smithi135.stdout:(68/285): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 113 kB 00:00 2024-09-12T00:21:55.091 INFO:teuthology.orchestra.run.smithi019.stdout:(36/285): ceph-test-19.3.0-4753.gd011c522.el9.x 18 MB/s | 50 MB 00:02 2024-09-12T00:21:55.168 INFO:teuthology.orchestra.run.smithi135.stdout:(69/285): exiv2-0.27.5-2.el9.x86_64.rpm 7.2 MB/s | 980 kB 00:00 2024-09-12T00:21:55.327 INFO:teuthology.orchestra.run.smithi135.stdout:(70/285): exempi-2.6.0-0.2.20211007gite23c213.e 1.5 MB/s | 525 kB 00:00 2024-09-12T00:21:55.399 INFO:teuthology.orchestra.run.smithi019.stdout:(37/285): bluez-libs-5.56-6.el9.x86_64.rpm 77 kB/s | 85 kB 00:01 2024-09-12T00:21:55.510 INFO:teuthology.orchestra.run.smithi135.stdout:(71/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 2.2 MB/s | 781 kB 00:00 2024-09-12T00:21:55.561 INFO:teuthology.orchestra.run.smithi135.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 1.4 MB/s | 325 kB 00:00 2024-09-12T00:21:55.566 INFO:teuthology.orchestra.run.smithi019.stdout:(38/285): ModemManager-glib-1.20.2-1.el9.x86_64 256 kB/s | 335 kB 00:01 2024-09-12T00:21:55.686 INFO:teuthology.orchestra.run.smithi135.stdout:(73/285): flac-libs-1.3.3-12.el9.x86_64.rpm 1.2 MB/s | 218 kB 00:00 2024-09-12T00:21:55.734 INFO:teuthology.orchestra.run.smithi019.stdout:(39/285): bubblewrap-0.4.1-7.el9.x86_64.rpm 77 kB/s | 49 kB 00:00 2024-09-12T00:21:55.744 INFO:teuthology.orchestra.run.smithi135.stdout:(74/285): flatpak-selinux-1.12.9-1.el9.noarch.r 371 kB/s | 22 kB 00:00 2024-09-12T00:21:55.828 INFO:teuthology.orchestra.run.smithi135.stdout:(75/285): flatpak-session-helper-1.12.9-1.el9.x 874 kB/s | 73 kB 00:00 2024-09-12T00:21:55.878 INFO:teuthology.orchestra.run.smithi135.stdout:(76/285): flexiblas-3.0.4-8.el9.x86_64.rpm 656 kB/s | 33 kB 00:00 2024-09-12T00:21:55.995 INFO:teuthology.orchestra.run.smithi135.stdout:(77/285): flatpak-1.12.9-1.el9.x86_64.rpm 4.0 MB/s | 1.7 MB 00:00 2024-09-12T00:21:56.046 INFO:teuthology.orchestra.run.smithi135.stdout:(78/285): flexiblas-openblas-openmp-3.0.4-8.el9 365 kB/s | 18 kB 00:00 2024-09-12T00:21:56.129 INFO:teuthology.orchestra.run.smithi135.stdout:(79/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.0 MB/s | 89 kB 00:00 2024-09-12T00:21:56.201 INFO:teuthology.orchestra.run.smithi019.stdout:(40/285): fuse-2.9.9-16.el9.x86_64.rpm 126 kB/s | 80 kB 00:00 2024-09-12T00:21:56.230 INFO:teuthology.orchestra.run.smithi135.stdout:(80/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.2 MB/s | 124 kB 00:00 2024-09-12T00:21:56.259 INFO:teuthology.orchestra.run.smithi019.stdout:(41/285): cups-libs-2.3.3op2-30.el9.x86_64.rpm 305 kB/s | 262 kB 00:00 2024-09-12T00:21:56.280 INFO:teuthology.orchestra.run.smithi135.stdout:(81/285): giflib-5.2.1-9.el9.x86_64.rpm 973 kB/s | 49 kB 00:00 2024-09-12T00:21:56.397 INFO:teuthology.orchestra.run.smithi135.stdout:(82/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 5.8 MB/s | 3.0 MB 00:00 2024-09-12T00:21:56.455 INFO:teuthology.orchestra.run.smithi135.stdout:(83/285): graphene-1.10.6-2.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-09-12T00:21:56.514 INFO:teuthology.orchestra.run.smithi135.stdout:(84/285): gsm-1.0.19-6.el9.x86_64.rpm 584 kB/s | 34 kB 00:00 2024-09-12T00:21:56.589 INFO:teuthology.orchestra.run.smithi135.stdout:(85/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 19 MB/s | 1.4 MB 00:00 2024-09-12T00:21:56.609 INFO:teuthology.orchestra.run.smithi019.stdout:(42/285): libgfortran-11.5.0-2.el9.x86_64.rpm 915 kB/s | 801 kB 00:00 2024-09-12T00:21:56.648 INFO:teuthology.orchestra.run.smithi135.stdout:(86/285): google-guice-4.2.3-9.el9.noarch.rpm 1.3 MB/s | 473 kB 00:00 2024-09-12T00:21:56.715 INFO:teuthology.orchestra.run.smithi135.stdout:(87/285): gstreamer1-plugins-base-1.22.1-2.el9. 18 MB/s | 2.2 MB 00:00 2024-09-12T00:21:56.740 INFO:teuthology.orchestra.run.smithi135.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 359 kB/s | 33 kB 00:00 2024-09-12T00:21:56.810 INFO:teuthology.orchestra.run.smithi019.stdout:(43/285): libpciaccess-0.16-7.el9.x86_64.rpm 44 kB/s | 27 kB 00:00 2024-09-12T00:21:56.874 INFO:teuthology.orchestra.run.smithi135.stdout:(89/285): gtk3-3.24.31-5.el9.x86_64.rpm 31 MB/s | 4.9 MB 00:00 2024-09-12T00:21:56.932 INFO:teuthology.orchestra.run.smithi135.stdout:(90/285): hicolor-icon-theme-0.17-13.el9.noarch 3.7 MB/s | 219 kB 00:00 2024-09-12T00:21:57.016 INFO:teuthology.orchestra.run.smithi135.stdout:(91/285): httpcomponents-client-4.5.13-3.el9.no 7.7 MB/s | 657 kB 00:00 2024-09-12T00:21:57.051 INFO:teuthology.orchestra.run.smithi019.stdout:(44/285): libquadmath-11.5.0-2.el9.x86_64.rpm 241 kB/s | 191 kB 00:00 2024-09-12T00:21:57.150 INFO:teuthology.orchestra.run.smithi135.stdout:(92/285): adwaita-icon-theme-40.1.1-3.el9.noarc 3.7 MB/s | 12 MB 00:03 2024-09-12T00:21:57.192 INFO:teuthology.orchestra.run.smithi135.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 3.5 MB/s | 632 kB 00:00 2024-09-12T00:21:57.276 INFO:teuthology.orchestra.run.smithi135.stdout:(94/285): iso-codes-4.6.0-3.el9.noarch.rpm 28 MB/s | 3.5 MB 00:00 2024-09-12T00:21:57.285 INFO:teuthology.orchestra.run.smithi019.stdout:(45/285): lksctp-tools-1.0.19-2.el9.x86_64.rpm 139 kB/s | 94 kB 00:00 2024-09-12T00:21:57.301 INFO:teuthology.orchestra.run.smithi135.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 415 kB/s | 45 kB 00:00 2024-09-12T00:21:57.326 INFO:teuthology.orchestra.run.smithi135.stdout:(96/285): jansi-2.3.3-6.el9.x86_64.rpm 2.1 MB/s | 110 kB 00:00 2024-09-12T00:21:57.360 INFO:teuthology.orchestra.run.smithi135.stdout:(97/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 6.9 MB/s | 413 kB 00:00 2024-09-12T00:21:57.435 INFO:teuthology.orchestra.run.smithi135.stdout:(98/285): java-11-openjdk-devel-11.0.20.1.1-2.e 31 MB/s | 3.3 MB 00:00 2024-09-12T00:21:57.485 INFO:teuthology.orchestra.run.smithi135.stdout:(99/285): javapackages-filesystem-6.0.0-4.el9.n 262 kB/s | 13 kB 00:00 2024-09-12T00:21:57.544 INFO:teuthology.orchestra.run.smithi135.stdout:(100/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 910 kB/s | 53 kB 00:00 2024-09-12T00:21:57.602 INFO:teuthology.orchestra.run.smithi135.stdout:(101/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 412 kB/s | 24 kB 00:00 2024-09-12T00:21:57.660 INFO:teuthology.orchestra.run.smithi019.stdout:(46/285): python3-cffi-1.14.5-5.el9.x86_64.rpm 298 kB/s | 253 kB 00:00 2024-09-12T00:21:57.678 INFO:teuthology.orchestra.run.smithi135.stdout:(102/285): jsoup-1.13.1-10.el9.noarch.rpm 4.9 MB/s | 377 kB 00:00 2024-09-12T00:21:57.736 INFO:teuthology.orchestra.run.smithi135.stdout:(103/285): jsr-305-3.0.2-6.el9.noarch.rpm 606 kB/s | 35 kB 00:00 2024-09-12T00:21:57.795 INFO:teuthology.orchestra.run.smithi135.stdout:(104/285): lcms2-2.12-3.el9.x86_64.rpm 2.8 MB/s | 168 kB 00:00 2024-09-12T00:21:57.854 INFO:teuthology.orchestra.run.smithi135.stdout:(105/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 190 kB/s | 11 kB 00:00 2024-09-12T00:21:57.912 INFO:teuthology.orchestra.run.smithi135.stdout:(106/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 413 kB/s | 24 kB 00:00 2024-09-12T00:21:57.969 INFO:teuthology.orchestra.run.smithi019.stdout:(47/285): python3-ply-3.11-14.el9.noarch.rpm 156 kB/s | 106 kB 00:00 2024-09-12T00:21:57.971 INFO:teuthology.orchestra.run.smithi135.stdout:(107/285): libXcursor-1.2.0-7.el9.x86_64.rpm 527 kB/s | 31 kB 00:00 2024-09-12T00:21:58.011 INFO:teuthology.orchestra.run.smithi019.stdout:(48/285): python3-cryptography-36.0.1-4.el9.x86 1.3 MB/s | 1.2 MB 00:00 2024-09-12T00:21:58.038 INFO:teuthology.orchestra.run.smithi135.stdout:(108/285): libXdamage-1.1.5-7.el9.x86_64.rpm 342 kB/s | 23 kB 00:00 2024-09-12T00:21:58.105 INFO:teuthology.orchestra.run.smithi135.stdout:(109/285): libXfixes-5.0.3-16.el9.x86_64.rpm 297 kB/s | 20 kB 00:00 2024-09-12T00:21:58.419 INFO:teuthology.orchestra.run.smithi019.stdout:(49/285): python3-pycparser-2.20-6.el9.noarch.r 178 kB/s | 135 kB 00:00 2024-09-12T00:21:58.447 INFO:teuthology.orchestra.run.smithi135.stdout:(110/285): java-11-openjdk-headless-11.0.20.1.1 36 MB/s | 39 MB 00:01 2024-09-12T00:21:58.472 INFO:teuthology.orchestra.run.smithi135.stdout:(111/285): libXi-1.7.10-8.el9.x86_64.rpm 108 kB/s | 40 kB 00:00 2024-09-12T00:21:58.506 INFO:teuthology.orchestra.run.smithi135.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 258 kB/s | 15 kB 00:00 2024-09-12T00:21:58.531 INFO:teuthology.orchestra.run.smithi135.stdout:(113/285): libXrandr-1.5.2-8.el9.x86_64.rpm 485 kB/s | 28 kB 00:00 2024-09-12T00:21:58.565 INFO:teuthology.orchestra.run.smithi135.stdout:(114/285): libXtst-1.2.3-16.el9.x86_64.rpm 368 kB/s | 21 kB 00:00 2024-09-12T00:21:58.590 INFO:teuthology.orchestra.run.smithi135.stdout:(115/285): libXv-1.0.11-16.el9.x86_64.rpm 326 kB/s | 19 kB 00:00 2024-09-12T00:21:58.603 INFO:teuthology.orchestra.run.smithi019.stdout:(50/285): adwaita-cursor-theme-40.1.1-3.el9.noa 3.5 MB/s | 650 kB 00:00 2024-09-12T00:21:58.615 INFO:teuthology.orchestra.run.smithi135.stdout:(116/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 373 kB/s | 19 kB 00:00 2024-09-12T00:21:58.649 INFO:teuthology.orchestra.run.smithi135.stdout:(117/285): libasyncns-0.8-22.el9.x86_64.rpm 519 kB/s | 30 kB 00:00 2024-09-12T00:21:58.674 INFO:teuthology.orchestra.run.smithi135.stdout:(118/285): libcanberra-0.30-27.el9.x86_64.rpm 1.4 MB/s | 86 kB 00:00 2024-09-12T00:21:58.720 INFO:teuthology.orchestra.run.smithi019.stdout:(51/285): python3-requests-2.25.1-8.el9.noarch. 167 kB/s | 125 kB 00:00 2024-09-12T00:21:58.724 INFO:teuthology.orchestra.run.smithi135.stdout:(119/285): guava-30.1-6.el9.noarch.rpm 1.2 MB/s | 2.3 MB 00:01 2024-09-12T00:21:58.750 INFO:teuthology.orchestra.run.smithi135.stdout:(120/285): libcanberra-gtk3-0.30-27.el9.x86_64. 317 kB/s | 32 kB 00:00 2024-09-12T00:21:58.775 INFO:teuthology.orchestra.run.smithi135.stdout:(121/285): libdrm-2.4.121-1.el9.x86_64.rpm 1.6 MB/s | 161 kB 00:00 2024-09-12T00:21:58.809 INFO:teuthology.orchestra.run.smithi135.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 7.3 MB/s | 435 kB 00:00 2024-09-12T00:21:58.834 INFO:teuthology.orchestra.run.smithi135.stdout:(123/285): libfontenc-1.1.3-17.el9.x86_64.rpm 530 kB/s | 31 kB 00:00 2024-09-12T00:21:58.876 INFO:teuthology.orchestra.run.smithi135.stdout:(124/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.2 MB/s | 83 kB 00:00 2024-09-12T00:21:58.887 INFO:teuthology.orchestra.run.smithi019.stdout:(52/285): adwaita-icon-theme-40.1.1-3.el9.noarc 42 MB/s | 12 MB 00:00 2024-09-12T00:21:58.901 INFO:teuthology.orchestra.run.smithi135.stdout:(125/285): libglvnd-1.3.4-1.el9.x86_64.rpm 2.0 MB/s | 135 kB 00:00 2024-09-12T00:21:58.912 INFO:teuthology.orchestra.run.smithi019.stdout:(53/285): python3-urllib3-1.26.5-6.el9.noarch.r 238 kB/s | 215 kB 00:00 2024-09-12T00:21:58.926 INFO:teuthology.orchestra.run.smithi135.stdout:(126/285): libepoxy-1.5.5-4.el9.x86_64.rpm 1.2 MB/s | 241 kB 00:00 2024-09-12T00:21:58.952 INFO:teuthology.orchestra.run.smithi135.stdout:(127/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 486 kB/s | 37 kB 00:00 2024-09-12T00:21:58.954 INFO:teuthology.orchestra.run.smithi019.stdout:(54/285): apache-commons-cli-1.4-17.el9.noarch. 1.0 MB/s | 71 kB 00:00 2024-09-12T00:21:58.977 INFO:teuthology.orchestra.run.smithi135.stdout:(128/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 142 kB 00:00 2024-09-12T00:21:59.003 INFO:teuthology.orchestra.run.smithi135.stdout:(129/285): libgxps-0.3.2-3.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-09-12T00:21:59.021 INFO:teuthology.orchestra.run.smithi019.stdout:(55/285): alsa-lib-1.2.12-1.el9.x86_64.rpm 1.7 MB/s | 523 kB 00:00 2024-09-12T00:21:59.027 INFO:teuthology.orchestra.run.smithi135.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.2 MB/s | 61 kB 00:00 2024-09-12T00:21:59.046 INFO:teuthology.orchestra.run.smithi019.stdout:(56/285): apache-commons-codec-1.15-7.el9.noarc 2.2 MB/s | 302 kB 00:00 2024-09-12T00:21:59.061 INFO:teuthology.orchestra.run.smithi135.stdout:(131/285): libldac-2.0.2.3-10.el9.x86_64.rpm 705 kB/s | 41 kB 00:00 2024-09-12T00:21:59.071 INFO:teuthology.orchestra.run.smithi019.stdout:(57/285): apache-commons-io-2.8.0-8.el9.noarch. 2.4 MB/s | 283 kB 00:00 2024-09-12T00:21:59.087 INFO:teuthology.orchestra.run.smithi135.stdout:(132/285): libnotify-0.7.9-8.el9.x86_64.rpm 741 kB/s | 44 kB 00:00 2024-09-12T00:21:59.112 INFO:teuthology.orchestra.run.smithi135.stdout:(133/285): libgsf-1.14.47-5.el9.x86_64.rpm 1.3 MB/s | 256 kB 00:00 2024-09-12T00:21:59.113 INFO:teuthology.orchestra.run.smithi019.stdout:(58/285): at-spi2-atk-2.38.0-4.el9.x86_64.rpm 1.3 MB/s | 87 kB 00:00 2024-09-12T00:21:59.137 INFO:teuthology.orchestra.run.smithi135.stdout:(134/285): libogg-1.3.4-6.el9.x86_64.rpm 443 kB/s | 34 kB 00:00 2024-09-12T00:21:59.147 INFO:teuthology.orchestra.run.smithi019.stdout:(59/285): at-spi2-core-2.40.3-1.el9.x86_64.rpm 2.5 MB/s | 195 kB 00:00 2024-09-12T00:21:59.162 INFO:teuthology.orchestra.run.smithi135.stdout:(135/285): libosinfo-1.10.0-1.el9.x86_64.rpm 4.1 MB/s | 319 kB 00:00 2024-09-12T00:21:59.172 INFO:teuthology.orchestra.run.smithi019.stdout:(60/285): apache-commons-lang3-3.12.0-6.el9.noa 3.6 MB/s | 559 kB 00:00 2024-09-12T00:21:59.188 INFO:teuthology.orchestra.run.smithi135.stdout:(136/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-12T00:21:59.213 INFO:teuthology.orchestra.run.smithi135.stdout:(137/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 599 kB/s | 45 kB 00:00 2024-09-12T00:21:59.238 INFO:teuthology.orchestra.run.smithi135.stdout:(138/285): librdkafka-1.6.1-102.el9.x86_64.rpm 8.6 MB/s | 662 kB 00:00 2024-09-12T00:21:59.247 INFO:teuthology.orchestra.run.smithi019.stdout:(61/285): atk-2.36.0-5.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-12T00:21:59.255 INFO:teuthology.orchestra.run.smithi135.stdout:(139/285): libsbc-1.4-9.el9.x86_64.rpm 667 kB/s | 45 kB 00:00 2024-09-12T00:21:59.273 INFO:teuthology.orchestra.run.smithi019.stdout:(62/285): atinject-1.0.3-6.el9.noarch.rpm 146 kB/s | 23 kB 00:00 2024-09-12T00:21:59.280 INFO:teuthology.orchestra.run.smithi135.stdout:(140/285): libsndfile-1.0.31-8.el9.x86_64.rpm 3.0 MB/s | 206 kB 00:00 2024-09-12T00:21:59.298 INFO:teuthology.orchestra.run.smithi019.stdout:(63/285): avahi-glib-0.8-21.el9.x86_64.rpm 119 kB/s | 15 kB 00:00 2024-09-12T00:21:59.306 INFO:teuthology.orchestra.run.smithi135.stdout:(141/285): libtheora-1.1.1-31.el9.x86_64.rpm 2.4 MB/s | 164 kB 00:00 2024-09-12T00:21:59.332 INFO:teuthology.orchestra.run.smithi135.stdout:(142/285): libtiff-4.4.0-13.el9.x86_64.rpm 2.6 MB/s | 198 kB 00:00 2024-09-12T00:21:59.332 INFO:teuthology.orchestra.run.smithi019.stdout:(64/285): boost-program-options-1.75.0-8.el9.x8 1.2 MB/s | 107 kB 00:00 2024-09-12T00:21:59.348 INFO:teuthology.orchestra.run.smithi135.stdout:(143/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 529 kB/s | 36 kB 00:00 2024-09-12T00:21:59.357 INFO:teuthology.orchestra.run.smithi019.stdout:(65/285): cdi-api-2.0.2-6.el9.noarch.rpm 637 kB/s | 53 kB 00:00 2024-09-12T00:21:59.382 INFO:teuthology.orchestra.run.smithi135.stdout:(144/285): libtracker-sparql-3.1.2-3.el9.x86_64 4.2 MB/s | 324 kB 00:00 2024-09-12T00:21:59.382 INFO:teuthology.orchestra.run.smithi019.stdout:(66/285): colord-libs-1.4.5-4.el9.x86_64.rpm 2.7 MB/s | 229 kB 00:00 2024-09-12T00:21:59.407 INFO:teuthology.orchestra.run.smithi135.stdout:(145/285): libvisual-0.4.0-34.el9.x86_64.rpm 1.9 MB/s | 144 kB 00:00 2024-09-12T00:21:59.416 INFO:teuthology.orchestra.run.smithi019.stdout:(67/285): composefs-libs-1.0.5-1.el9.x86_64.rpm 729 kB/s | 61 kB 00:00 2024-09-12T00:21:59.432 INFO:teuthology.orchestra.run.smithi135.stdout:(146/285): libvorbis-1.3.7-5.el9.x86_64.rpm 2.3 MB/s | 193 kB 00:00 2024-09-12T00:21:59.433 INFO:teuthology.orchestra.run.smithi019.stdout:(68/285): copy-jdk-configs-4.0-3.el9.noarch.rpm 374 kB/s | 28 kB 00:00 2024-09-12T00:21:59.450 INFO:teuthology.orchestra.run.smithi019.stdout:(69/285): dconf-0.40.0-6.el9.x86_64.rpm 1.6 MB/s | 113 kB 00:00 2024-09-12T00:21:59.458 INFO:teuthology.orchestra.run.smithi135.stdout:(147/285): libwayland-client-1.21.0-1.el9.x86_6 442 kB/s | 33 kB 00:00 2024-09-12T00:21:59.492 INFO:teuthology.orchestra.run.smithi135.stdout:(148/285): libwayland-cursor-1.21.0-1.el9.x86_6 229 kB/s | 19 kB 00:00 2024-09-12T00:21:59.508 INFO:teuthology.orchestra.run.smithi019.stdout:(70/285): exempi-2.6.0-0.2.20211007gite23c213.e 5.6 MB/s | 525 kB 00:00 2024-09-12T00:21:59.517 INFO:teuthology.orchestra.run.smithi135.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 152 kB/s | 13 kB 00:00 2024-09-12T00:21:59.542 INFO:teuthology.orchestra.run.smithi135.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 494 kB/s | 42 kB 00:00 2024-09-12T00:21:59.550 INFO:teuthology.orchestra.run.smithi019.stdout:(71/285): exiv2-libs-0.27.5-2.el9.x86_64.rpm 7.6 MB/s | 781 kB 00:00 2024-09-12T00:21:59.567 INFO:teuthology.orchestra.run.smithi135.stdout:(151/285): libwebp-1.2.0-8.el9.x86_64.rpm 3.6 MB/s | 277 kB 00:00 2024-09-12T00:21:59.593 INFO:teuthology.orchestra.run.smithi135.stdout:(152/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.7 MB/s | 133 kB 00:00 2024-09-12T00:21:59.600 INFO:teuthology.orchestra.run.smithi019.stdout:(72/285): fdk-aac-free-2.0.0-8.el9.x86_64.rpm 3.5 MB/s | 325 kB 00:00 2024-09-12T00:21:59.618 INFO:teuthology.orchestra.run.smithi135.stdout:(153/285): libxshmfence-1.3-10.el9.x86_64.rpm 167 kB/s | 13 kB 00:00 2024-09-12T00:21:59.642 INFO:teuthology.orchestra.run.smithi019.stdout:(73/285): exiv2-0.27.5-2.el9.x86_64.rpm 4.6 MB/s | 980 kB 00:00 2024-09-12T00:21:59.643 INFO:teuthology.orchestra.run.smithi135.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 475 kB/s | 36 kB 00:00 2024-09-12T00:21:59.669 INFO:teuthology.orchestra.run.smithi135.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.8 MB/s | 292 kB 00:00 2024-09-12T00:21:59.693 INFO:teuthology.orchestra.run.smithi019.stdout:(74/285): flac-libs-1.3.3-12.el9.x86_64.rpm 1.5 MB/s | 218 kB 00:00 2024-09-12T00:21:59.694 INFO:teuthology.orchestra.run.smithi135.stdout:(156/285): lua-5.4.4-4.el9.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-09-12T00:21:59.728 INFO:teuthology.orchestra.run.smithi135.stdout:(157/285): lua-posix-35.0-8.el9.x86_64.rpm 1.8 MB/s | 151 kB 00:00 2024-09-12T00:21:59.735 INFO:teuthology.orchestra.run.smithi019.stdout:(75/285): flatpak-1.12.9-1.el9.x86_64.rpm 13 MB/s | 1.7 MB 00:00 2024-09-12T00:21:59.753 INFO:teuthology.orchestra.run.smithi135.stdout:(158/285): maven-3.6.3-15.el9.noarch.rpm 211 kB/s | 18 kB 00:00 2024-09-12T00:21:59.760 INFO:teuthology.orchestra.run.smithi019.stdout:(76/285): flatpak-selinux-1.12.9-1.el9.noarch.r 184 kB/s | 22 kB 00:00 2024-09-12T00:21:59.785 INFO:teuthology.orchestra.run.smithi019.stdout:(77/285): flatpak-session-helper-1.12.9-1.el9.x 793 kB/s | 73 kB 00:00 2024-09-12T00:21:59.795 INFO:teuthology.orchestra.run.smithi135.stdout:(159/285): maven-openjdk11-3.6.3-15.el9.noarch. 135 kB/s | 9.0 kB 00:00 2024-09-12T00:21:59.810 INFO:teuthology.orchestra.run.smithi019.stdout:(78/285): flexiblas-3.0.4-8.el9.x86_64.rpm 434 kB/s | 33 kB 00:00 2024-09-12T00:21:59.837 INFO:teuthology.orchestra.run.smithi135.stdout:(160/285): maven-lib-3.6.3-15.el9.noarch.rpm 10 MB/s | 1.5 MB 00:00 2024-09-12T00:21:59.844 INFO:teuthology.orchestra.run.smithi019.stdout:(79/285): flexiblas-openblas-openmp-3.0.4-8.el9 311 kB/s | 18 kB 00:00 2024-09-12T00:21:59.871 INFO:teuthology.orchestra.run.smithi135.stdout:(161/285): maven-resolver-1.6.1-10.el9.noarch.r 4.3 MB/s | 517 kB 00:00 2024-09-12T00:21:59.886 INFO:teuthology.orchestra.run.smithi019.stdout:(80/285): gdk-pixbuf2-modules-2.42.6-4.el9.x86_ 1.2 MB/s | 89 kB 00:00 2024-09-12T00:21:59.896 INFO:teuthology.orchestra.run.smithi135.stdout:(162/285): maven-shared-utils-3.3.4-3.el9.noarc 1.5 MB/s | 151 kB 00:00 2024-09-12T00:21:59.919 INFO:teuthology.orchestra.run.smithi019.stdout:(81/285): geoclue2-2.6.0-7.el9.x86_64.rpm 1.6 MB/s | 124 kB 00:00 2024-09-12T00:21:59.921 INFO:teuthology.orchestra.run.smithi135.stdout:(163/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.3 MB/s | 112 kB 00:00 2024-09-12T00:21:59.961 INFO:teuthology.orchestra.run.smithi019.stdout:(82/285): giflib-5.2.1-9.el9.x86_64.rpm 647 kB/s | 49 kB 00:00 2024-09-12T00:21:59.963 INFO:teuthology.orchestra.run.smithi135.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 168 kB/s | 11 kB 00:00 2024-09-12T00:21:59.988 INFO:teuthology.orchestra.run.smithi135.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 2.0 MB/s | 139 kB 00:00 2024-09-12T00:22:00.020 INFO:teuthology.orchestra.run.smithi019.stdout:(83/285): google-guice-4.2.3-9.el9.noarch.rpm 4.6 MB/s | 473 kB 00:00 2024-09-12T00:22:00.030 INFO:teuthology.orchestra.run.smithi135.stdout:(166/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-12T00:22:00.055 INFO:teuthology.orchestra.run.smithi135.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 541 kB/s | 36 kB 00:00 2024-09-12T00:22:00.070 INFO:teuthology.orchestra.run.smithi019.stdout:(84/285): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.6 MB/s | 3.0 MB 00:00 2024-09-12T00:22:00.081 INFO:teuthology.orchestra.run.smithi135.stdout:(168/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 914 kB/s | 46 kB 00:00 2024-09-12T00:22:00.087 INFO:teuthology.orchestra.run.smithi019.stdout:(85/285): gsm-1.0.19-6.el9.x86_64.rpm 508 kB/s | 34 kB 00:00 2024-09-12T00:22:00.106 INFO:teuthology.orchestra.run.smithi135.stdout:(169/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 641 kB/s | 32 kB 00:00 2024-09-12T00:22:00.113 INFO:teuthology.orchestra.run.smithi019.stdout:(86/285): graphene-1.10.6-2.el9.x86_64.rpm 427 kB/s | 64 kB 00:00 2024-09-12T00:22:00.131 INFO:teuthology.orchestra.run.smithi135.stdout:(170/285): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-12T00:22:00.188 INFO:teuthology.orchestra.run.smithi019.stdout:(87/285): gstreamer1-plugins-base-1.22.1-2.el9. 22 MB/s | 2.2 MB 00:00 2024-09-12T00:22:00.205 INFO:teuthology.orchestra.run.smithi019.stdout:(88/285): gtk-update-icon-cache-3.24.31-5.el9.x 360 kB/s | 33 kB 00:00 2024-09-12T00:22:00.231 INFO:teuthology.orchestra.run.smithi135.stdout:(171/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 24 MB/s | 8.8 MB 00:00 2024-09-12T00:22:00.247 INFO:teuthology.orchestra.run.smithi019.stdout:(89/285): gstreamer1-1.22.1-2.el9.x86_64.rpm 8.1 MB/s | 1.4 MB 00:00 2024-09-12T00:22:00.265 INFO:teuthology.orchestra.run.smithi135.stdout:(172/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.2 MB/s | 163 kB 00:00 2024-09-12T00:22:00.290 INFO:teuthology.orchestra.run.smithi135.stdout:(173/285): opus-1.3.1-10.el9.x86_64.rpm 3.3 MB/s | 200 kB 00:00 2024-09-12T00:22:00.324 INFO:teuthology.orchestra.run.smithi135.stdout:(174/285): orc-0.4.31-8.el9.x86_64.rpm 3.1 MB/s | 183 kB 00:00 2024-09-12T00:22:00.330 INFO:teuthology.orchestra.run.smithi019.stdout:(90/285): gtk3-3.24.31-5.el9.x86_64.rpm 34 MB/s | 4.9 MB 00:00 2024-09-12T00:22:00.356 INFO:teuthology.orchestra.run.smithi019.stdout:(91/285): hicolor-icon-theme-0.17-13.el9.noarch 2.0 MB/s | 219 kB 00:00 2024-09-12T00:22:00.358 INFO:teuthology.orchestra.run.smithi135.stdout:(175/285): osinfo-db-20240701-2.el9.noarch.rpm 7.7 MB/s | 531 kB 00:00 2024-09-12T00:22:00.383 INFO:teuthology.orchestra.run.smithi135.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-09-12T00:22:00.417 INFO:teuthology.orchestra.run.smithi135.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 7.8 MB/s | 468 kB 00:00 2024-09-12T00:22:00.422 INFO:teuthology.orchestra.run.smithi019.stdout:(92/285): guava-30.1-6.el9.noarch.rpm 11 MB/s | 2.3 MB 00:00 2024-09-12T00:22:00.442 INFO:teuthology.orchestra.run.smithi135.stdout:(178/285): p11-kit-server-0.25.3-2.el9.x86_64.r 4.1 MB/s | 246 kB 00:00 2024-09-12T00:22:00.456 INFO:teuthology.orchestra.run.smithi019.stdout:(93/285): httpcomponents-core-4.4.13-7.el9.noar 6.2 MB/s | 632 kB 00:00 2024-09-12T00:22:00.481 INFO:teuthology.orchestra.run.smithi019.stdout:(94/285): httpcomponents-client-4.5.13-3.el9.no 4.3 MB/s | 657 kB 00:00 2024-09-12T00:22:00.517 INFO:teuthology.orchestra.run.smithi135.stdout:(179/285): openblas-openmp-0.3.26-2.el9.x86_64. 12 MB/s | 4.9 MB 00:00 2024-09-12T00:22:00.523 INFO:teuthology.orchestra.run.smithi019.stdout:(95/285): jakarta-annotations-1.3.5-13.el9.noar 673 kB/s | 45 kB 00:00 2024-09-12T00:22:00.542 INFO:teuthology.orchestra.run.smithi135.stdout:(180/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 571 kB/s | 57 kB 00:00 2024-09-12T00:22:00.568 INFO:teuthology.orchestra.run.smithi135.stdout:(181/285): pipewire-1.0.1-1.el9.x86_64.rpm 706 kB/s | 107 kB 00:00 2024-09-12T00:22:00.582 INFO:teuthology.orchestra.run.smithi019.stdout:(96/285): iso-codes-4.6.0-3.el9.noarch.rpm 22 MB/s | 3.5 MB 00:00 2024-09-12T00:22:00.607 INFO:teuthology.orchestra.run.smithi019.stdout:(97/285): jansi-2.3.3-6.el9.x86_64.rpm 874 kB/s | 110 kB 00:00 2024-09-12T00:22:00.610 INFO:teuthology.orchestra.run.smithi135.stdout:(182/285): pipewire-jack-audio-connection-kit-1 99 kB/s | 9.1 kB 00:00 2024-09-12T00:22:00.635 INFO:teuthology.orchestra.run.smithi135.stdout:(183/285): pipewire-jack-audio-connection-kit-l 1.4 MB/s | 135 kB 00:00 2024-09-12T00:22:00.641 INFO:teuthology.orchestra.run.smithi019.stdout:(98/285): java-11-openjdk-11.0.20.1.1-2.el9.x86 3.4 MB/s | 413 kB 00:00 2024-09-12T00:22:00.677 INFO:teuthology.orchestra.run.smithi135.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.8 MB/s | 192 kB 00:00 2024-09-12T00:22:00.702 INFO:teuthology.orchestra.run.smithi135.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 386 kB/s | 26 kB 00:00 2024-09-12T00:22:00.752 INFO:teuthology.orchestra.run.smithi135.stdout:(186/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 10 MB/s | 1.9 MB 00:00 2024-09-12T00:22:00.758 INFO:teuthology.orchestra.run.smithi019.stdout:(99/285): java-11-openjdk-devel-11.0.20.1.1-2.e 19 MB/s | 3.3 MB 00:00 2024-09-12T00:22:00.778 INFO:teuthology.orchestra.run.smithi135.stdout:(187/285): plexus-containers-component-annotati 244 kB/s | 18 kB 00:00 2024-09-12T00:22:00.783 INFO:teuthology.orchestra.run.smithi019.stdout:(100/285): javapackages-filesystem-6.0.0-4.el9. 92 kB/s | 13 kB 00:00 2024-09-12T00:22:00.803 INFO:teuthology.orchestra.run.smithi135.stdout:(188/285): plexus-classworlds-2.6.0-11.el9.noar 477 kB/s | 60 kB 00:00 2024-09-12T00:22:00.825 INFO:teuthology.orchestra.run.smithi019.stdout:(101/285): jbigkit-libs-2.1-23.el9.x86_64.rpm 791 kB/s | 53 kB 00:00 2024-09-12T00:22:00.828 INFO:teuthology.orchestra.run.smithi135.stdout:(189/285): plexus-interpolation-1.26-11.el9.noa 1.0 MB/s | 80 kB 00:00 2024-09-12T00:22:00.850 INFO:teuthology.orchestra.run.smithi019.stdout:(102/285): jcl-over-slf4j-1.7.30-13.el9.noarch. 357 kB/s | 24 kB 00:00 2024-09-12T00:22:00.853 INFO:teuthology.orchestra.run.smithi135.stdout:(190/285): plexus-sec-dispatcher-1.4-37.el9.noa 445 kB/s | 34 kB 00:00 2024-09-12T00:22:00.887 INFO:teuthology.orchestra.run.smithi135.stdout:(191/285): plexus-utils-3.3.0-10.el9.noarch.rpm 3.0 MB/s | 254 kB 00:00 2024-09-12T00:22:00.917 INFO:teuthology.orchestra.run.smithi019.stdout:(103/285): jsoup-1.13.1-10.el9.noarch.rpm 4.0 MB/s | 377 kB 00:00 2024-09-12T00:22:00.929 INFO:teuthology.orchestra.run.smithi135.stdout:(192/285): poppler-21.01.0-21.el9.x86_64.rpm 11 MB/s | 1.1 MB 00:00 2024-09-12T00:22:00.942 INFO:teuthology.orchestra.run.smithi019.stdout:(104/285): jsr-305-3.0.2-6.el9.noarch.rpm 387 kB/s | 35 kB 00:00 2024-09-12T00:22:00.954 INFO:teuthology.orchestra.run.smithi135.stdout:(193/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.2 MB/s | 152 kB 00:00 2024-09-12T00:22:01.001 INFO:teuthology.orchestra.run.smithi019.stdout:(105/285): lcms2-2.12-3.el9.x86_64.rpm 2.0 MB/s | 168 kB 00:00 2024-09-12T00:22:01.005 INFO:teuthology.orchestra.run.smithi135.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 12 MB/s | 1.9 MB 00:00 2024-09-12T00:22:01.026 INFO:teuthology.orchestra.run.smithi019.stdout:(106/285): libX11-xcb-1.7.0-9.el9.x86_64.rpm 133 kB/s | 11 kB 00:00 2024-09-12T00:22:01.030 INFO:teuthology.orchestra.run.smithi135.stdout:(195/285): publicsuffix-list-20210518-3.el9.noa 1.1 MB/s | 83 kB 00:00 2024-09-12T00:22:01.063 INFO:teuthology.orchestra.run.smithi135.stdout:(196/285): protobuf-3.14.0-13.el9.x86_64.rpm 7.5 MB/s | 1.0 MB 00:00 2024-09-12T00:22:01.093 INFO:teuthology.orchestra.run.smithi019.stdout:(107/285): libXcomposite-0.4.5-7.el9.x86_64.rpm 263 kB/s | 24 kB 00:00 2024-09-12T00:22:01.097 INFO:teuthology.orchestra.run.smithi135.stdout:(197/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 7.2 MB/s | 679 kB 00:00 2024-09-12T00:22:01.118 INFO:teuthology.orchestra.run.smithi019.stdout:(108/285): libXcursor-1.2.0-7.el9.x86_64.rpm 334 kB/s | 31 kB 00:00 2024-09-12T00:22:01.122 INFO:teuthology.orchestra.run.smithi135.stdout:(198/285): python3-devel-3.9.19-8.el9.x86_64.rp 4.1 MB/s | 245 kB 00:00 2024-09-12T00:22:01.156 INFO:teuthology.orchestra.run.smithi135.stdout:(199/285): python3-jinja2-2.11.3-6.el9.noarch.r 4.1 MB/s | 248 kB 00:00 2024-09-12T00:22:01.168 INFO:teuthology.orchestra.run.smithi019.stdout:(109/285): libXdamage-1.1.5-7.el9.x86_64.rpm 305 kB/s | 23 kB 00:00 2024-09-12T00:22:01.182 INFO:teuthology.orchestra.run.smithi135.stdout:(200/285): python3-jsonpatch-1.21-16.el9.noarch 436 kB/s | 26 kB 00:00 2024-09-12T00:22:01.194 INFO:teuthology.orchestra.run.smithi019.stdout:(110/285): libXfixes-5.0.3-16.el9.x86_64.rpm 263 kB/s | 20 kB 00:00 2024-09-12T00:22:01.207 INFO:teuthology.orchestra.run.smithi135.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 383 kB/s | 19 kB 00:00 2024-09-12T00:22:01.241 INFO:teuthology.orchestra.run.smithi135.stdout:(202/285): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-12T00:22:01.324 INFO:teuthology.orchestra.run.smithi135.stdout:(203/285): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 6.0 MB 00:00 2024-09-12T00:22:01.349 INFO:teuthology.orchestra.run.smithi135.stdout:(204/285): python3-markupsafe-1.1.1-12.el9.x86_ 244 kB/s | 35 kB 00:00 2024-09-12T00:22:01.383 INFO:teuthology.orchestra.run.smithi135.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-09-12T00:22:01.418 INFO:teuthology.orchestra.run.smithi135.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 3.2 MB/s | 222 kB 00:00 2024-09-12T00:22:01.563 INFO:teuthology.orchestra.run.smithi135.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 430 kB/s | 77 kB 00:00 2024-09-12T00:22:01.578 INFO:teuthology.orchestra.run.smithi019.stdout:(111/285): java-11-openjdk-headless-11.0.20.1.1 40 MB/s | 39 MB 00:00 2024-09-12T00:22:01.603 INFO:teuthology.orchestra.run.smithi019.stdout:(112/285): libXinerama-1.1.4-10.el9.x86_64.rpm 37 kB/s | 15 kB 00:00 2024-09-12T00:22:01.628 INFO:teuthology.orchestra.run.smithi019.stdout:(113/285): libXi-1.7.10-8.el9.x86_64.rpm 86 kB/s | 40 kB 00:00 2024-09-12T00:22:01.653 INFO:teuthology.orchestra.run.smithi019.stdout:(114/285): libXrandr-1.5.2-8.el9.x86_64.rpm 379 kB/s | 28 kB 00:00 2024-09-12T00:22:01.667 INFO:teuthology.orchestra.run.smithi135.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 170 kB/s | 42 kB 00:00 2024-09-12T00:22:01.679 INFO:teuthology.orchestra.run.smithi019.stdout:(115/285): libXtst-1.2.3-16.el9.x86_64.rpm 284 kB/s | 21 kB 00:00 2024-09-12T00:22:01.692 INFO:teuthology.orchestra.run.smithi135.stdout:(209/285): python3-protobuf-3.14.0-13.el9.noarc 2.1 MB/s | 269 kB 00:00 2024-09-12T00:22:01.712 INFO:teuthology.orchestra.run.smithi019.stdout:(116/285): libXv-1.0.11-16.el9.x86_64.rpm 228 kB/s | 19 kB 00:00 2024-09-12T00:22:01.734 INFO:teuthology.orchestra.run.smithi135.stdout:(210/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 2.3 MB/s | 159 kB 00:00 2024-09-12T00:22:01.737 INFO:teuthology.orchestra.run.smithi019.stdout:(117/285): libXxf86vm-1.1.4-18.el9.x86_64.rpm 224 kB/s | 19 kB 00:00 2024-09-12T00:22:01.759 INFO:teuthology.orchestra.run.smithi135.stdout:(211/285): python3-pyasn1-modules-0.4.8-6.el9.n 4.1 MB/s | 279 kB 00:00 2024-09-12T00:22:01.764 INFO:teuthology.orchestra.run.smithi019.stdout:(118/285): libasyncns-0.8-22.el9.x86_64.rpm 364 kB/s | 30 kB 00:00 2024-09-12T00:22:01.776 INFO:teuthology.orchestra.run.smithi135.stdout:(212/285): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-12T00:22:01.805 INFO:teuthology.orchestra.run.smithi019.stdout:(119/285): libcanberra-0.30-27.el9.x86_64.rpm 938 kB/s | 86 kB 00:00 2024-09-12T00:22:01.830 INFO:teuthology.orchestra.run.smithi019.stdout:(120/285): libdrm-2.4.121-1.el9.x86_64.rpm 2.4 MB/s | 161 kB 00:00 2024-09-12T00:22:01.843 INFO:teuthology.orchestra.run.smithi135.stdout:(213/285): python3-numpy-1.20.1-5.el9.x86_64.rp 8.5 MB/s | 5.1 MB 00:00 2024-09-12T00:22:01.855 INFO:teuthology.orchestra.run.smithi019.stdout:(121/285): libcanberra-gtk3-0.30-27.el9.x86_64. 346 kB/s | 32 kB 00:00 2024-09-12T00:22:01.869 INFO:teuthology.orchestra.run.smithi135.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 492 kB/s | 54 kB 00:00 2024-09-12T00:22:01.894 INFO:teuthology.orchestra.run.smithi135.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 830 kB/s | 42 kB 00:00 2024-09-12T00:22:01.905 INFO:teuthology.orchestra.run.smithi019.stdout:(122/285): libexif-0.6.22-6.el9.x86_64.rpm 5.7 MB/s | 435 kB 00:00 2024-09-12T00:22:01.927 INFO:teuthology.orchestra.run.smithi135.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-12T00:22:01.931 INFO:teuthology.orchestra.run.smithi019.stdout:(123/285): libepoxy-1.5.5-4.el9.x86_64.rpm 1.9 MB/s | 241 kB 00:00 2024-09-12T00:22:01.953 INFO:teuthology.orchestra.run.smithi135.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 614 kB/s | 36 kB 00:00 2024-09-12T00:22:01.956 INFO:teuthology.orchestra.run.smithi019.stdout:(124/285): libfontenc-1.1.3-17.el9.x86_64.rpm 308 kB/s | 31 kB 00:00 2024-09-12T00:22:01.978 INFO:teuthology.orchestra.run.smithi135.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 942 kB/s | 47 kB 00:00 2024-09-12T00:22:01.984 INFO:teuthology.orchestra.run.smithi019.stdout:(125/285): libgexiv2-0.12.3-1.el9.x86_64.rpm 1.1 MB/s | 83 kB 00:00 2024-09-12T00:22:02.003 INFO:teuthology.orchestra.run.smithi135.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-09-12T00:22:02.006 INFO:teuthology.orchestra.run.smithi019.stdout:(126/285): libglvnd-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 135 kB 00:00 2024-09-12T00:22:02.032 INFO:teuthology.orchestra.run.smithi019.stdout:(127/285): libglvnd-egl-1.3.4-1.el9.x86_64.rpm 486 kB/s | 37 kB 00:00 2024-09-12T00:22:02.045 INFO:teuthology.orchestra.run.smithi135.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 7.5 MB/s | 510 kB 00:00 2024-09-12T00:22:02.057 INFO:teuthology.orchestra.run.smithi019.stdout:(128/285): libglvnd-glx-1.3.4-1.el9.x86_64.rpm 1.8 MB/s | 142 kB 00:00 2024-09-12T00:22:02.070 INFO:teuthology.orchestra.run.smithi135.stdout:(221/285): slf4j-1.7.30-13.el9.noarch.rpm 1.0 MB/s | 69 kB 00:00 2024-09-12T00:22:02.099 INFO:teuthology.orchestra.run.smithi019.stdout:(129/285): libgsf-1.14.47-5.el9.x86_64.rpm 2.7 MB/s | 256 kB 00:00 2024-09-12T00:22:02.104 INFO:teuthology.orchestra.run.smithi135.stdout:(222/285): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-12T00:22:02.116 INFO:teuthology.orchestra.run.smithi019.stdout:(130/285): libiptcdata-1.0.5-10.el9.x86_64.rpm 1.0 MB/s | 61 kB 00:00 2024-09-12T00:22:02.130 INFO:teuthology.orchestra.run.smithi135.stdout:(223/285): sound-theme-freedesktop-0.8-17.el9.n 6.4 MB/s | 383 kB 00:00 2024-09-12T00:22:02.141 INFO:teuthology.orchestra.run.smithi019.stdout:(131/285): libgxps-0.3.2-3.el9.x86_64.rpm 724 kB/s | 79 kB 00:00 2024-09-12T00:22:02.158 INFO:teuthology.orchestra.run.smithi019.stdout:(132/285): libldac-2.0.2.3-10.el9.x86_64.rpm 704 kB/s | 41 kB 00:00 2024-09-12T00:22:02.163 INFO:teuthology.orchestra.run.smithi135.stdout:(224/285): totem-pl-parser-3.26.6-2.el9.x86_64. 2.5 MB/s | 152 kB 00:00 2024-09-12T00:22:02.192 INFO:teuthology.orchestra.run.smithi019.stdout:(133/285): libnotify-0.7.9-8.el9.x86_64.rpm 575 kB/s | 44 kB 00:00 2024-09-12T00:22:02.197 INFO:teuthology.orchestra.run.smithi135.stdout:(225/285): tracker-3.1.2-3.el9.x86_64.rpm 8.1 MB/s | 555 kB 00:00 2024-09-12T00:22:02.217 INFO:teuthology.orchestra.run.smithi019.stdout:(134/285): libogg-1.3.4-6.el9.x86_64.rpm 443 kB/s | 34 kB 00:00 2024-09-12T00:22:02.239 INFO:teuthology.orchestra.run.smithi135.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 12 MB/s | 944 kB 00:00 2024-09-12T00:22:02.250 INFO:teuthology.orchestra.run.smithi019.stdout:(135/285): libosinfo-1.10.0-1.el9.x86_64.rpm 3.4 MB/s | 319 kB 00:00 2024-09-12T00:22:02.273 INFO:teuthology.orchestra.run.smithi135.stdout:(227/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 705 kB/s | 53 kB 00:00 2024-09-12T00:22:02.276 INFO:teuthology.orchestra.run.smithi019.stdout:(136/285): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-12T00:22:02.298 INFO:teuthology.orchestra.run.smithi135.stdout:(228/285): tzdata-java-2024a-2.el9.noarch.rpm 3.8 MB/s | 230 kB 00:00 2024-09-12T00:22:02.331 INFO:teuthology.orchestra.run.smithi135.stdout:(229/285): upower-0.99.11-11.el9.x86_64.rpm 2.9 MB/s | 173 kB 00:00 2024-09-12T00:22:02.343 INFO:teuthology.orchestra.run.smithi019.stdout:(137/285): librabbitmq-0.11.0-7.el9.x86_64.rpm 359 kB/s | 45 kB 00:00 2024-09-12T00:22:02.357 INFO:teuthology.orchestra.run.smithi135.stdout:(230/285): webrtc-audio-processing-0.3.1-8.el9. 5.1 MB/s | 306 kB 00:00 2024-09-12T00:22:02.368 INFO:teuthology.orchestra.run.smithi019.stdout:(138/285): libsbc-1.4-9.el9.x86_64.rpm 489 kB/s | 45 kB 00:00 2024-09-12T00:22:02.382 INFO:teuthology.orchestra.run.smithi135.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.9 MB/s | 96 kB 00:00 2024-09-12T00:22:02.402 INFO:teuthology.orchestra.run.smithi019.stdout:(139/285): librdkafka-1.6.1-102.el9.x86_64.rpm 4.3 MB/s | 662 kB 00:00 2024-09-12T00:22:02.427 INFO:teuthology.orchestra.run.smithi019.stdout:(140/285): libsndfile-1.0.31-8.el9.x86_64.rpm 2.4 MB/s | 206 kB 00:00 2024-09-12T00:22:02.461 INFO:teuthology.orchestra.run.smithi019.stdout:(141/285): libtheora-1.1.1-31.el9.x86_64.rpm 1.7 MB/s | 164 kB 00:00 2024-09-12T00:22:02.486 INFO:teuthology.orchestra.run.smithi019.stdout:(142/285): libtool-ltdl-2.4.6-46.el9.x86_64.rpm 608 kB/s | 36 kB 00:00 2024-09-12T00:22:02.520 INFO:teuthology.orchestra.run.smithi019.stdout:(143/285): libtiff-4.4.0-13.el9.x86_64.rpm 1.6 MB/s | 198 kB 00:00 2024-09-12T00:22:02.541 INFO:teuthology.orchestra.run.smithi135.stdout:(232/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 21 MB/s | 16 MB 00:00 2024-09-12T00:22:02.544 INFO:teuthology.orchestra.run.smithi019.stdout:(144/285): libtracker-sparql-3.1.2-3.el9.x86_64 3.8 MB/s | 324 kB 00:00 2024-09-12T00:22:02.566 INFO:teuthology.orchestra.run.smithi135.stdout:(233/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 231 kB/s | 42 kB 00:00 2024-09-12T00:22:02.570 INFO:teuthology.orchestra.run.smithi019.stdout:(145/285): libvisual-0.4.0-34.el9.x86_64.rpm 1.7 MB/s | 144 kB 00:00 2024-09-12T00:22:02.591 INFO:teuthology.orchestra.run.smithi135.stdout:(234/285): wireplumber-libs-0.4.14-1.el9.x86_64 1.5 MB/s | 358 kB 00:00 2024-09-12T00:22:02.620 INFO:teuthology.orchestra.run.smithi019.stdout:(146/285): libvorbis-1.3.7-5.el9.x86_64.rpm 1.9 MB/s | 193 kB 00:00 2024-09-12T00:22:02.625 INFO:teuthology.orchestra.run.smithi135.stdout:(235/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 4.5 MB/s | 385 kB 00:00 2024-09-12T00:22:02.645 INFO:teuthology.orchestra.run.smithi019.stdout:(147/285): libwayland-cursor-1.21.0-1.el9.x86_6 258 kB/s | 19 kB 00:00 2024-09-12T00:22:02.650 INFO:teuthology.orchestra.run.smithi135.stdout:(236/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.6 MB/s | 134 kB 00:00 2024-09-12T00:22:02.671 INFO:teuthology.orchestra.run.smithi019.stdout:(148/285): libwayland-client-1.21.0-1.el9.x86_6 265 kB/s | 33 kB 00:00 2024-09-12T00:22:02.684 INFO:teuthology.orchestra.run.smithi135.stdout:(237/285): xkeyboard-config-2.33-2.el9.noarch.r 9.1 MB/s | 859 kB 00:00 2024-09-12T00:22:02.704 INFO:teuthology.orchestra.run.smithi019.stdout:(149/285): libwayland-egl-1.21.0-1.el9.x86_64.r 153 kB/s | 13 kB 00:00 2024-09-12T00:22:02.709 INFO:teuthology.orchestra.run.smithi135.stdout:(238/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 758 kB/s | 64 kB 00:00 2024-09-12T00:22:02.730 INFO:teuthology.orchestra.run.smithi019.stdout:(150/285): libwayland-server-1.21.0-1.el9.x86_6 499 kB/s | 42 kB 00:00 2024-09-12T00:22:02.743 INFO:teuthology.orchestra.run.smithi135.stdout:(239/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.4 MB/s | 505 kB 00:00 2024-09-12T00:22:02.755 INFO:teuthology.orchestra.run.smithi019.stdout:(151/285): libwebp-1.2.0-8.el9.x86_64.rpm 3.2 MB/s | 277 kB 00:00 2024-09-12T00:22:02.780 INFO:teuthology.orchestra.run.smithi019.stdout:(152/285): libxkbcommon-1.0.3-4.el9.x86_64.rpm 1.7 MB/s | 133 kB 00:00 2024-09-12T00:22:02.801 INFO:teuthology.orchestra.run.smithi135.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 9.2 MB/s | 548 kB 00:00 2024-09-12T00:22:02.805 INFO:teuthology.orchestra.run.smithi019.stdout:(153/285): libxshmfence-1.3-10.el9.x86_64.rpm 167 kB/s | 13 kB 00:00 2024-09-12T00:22:02.827 INFO:teuthology.orchestra.run.smithi135.stdout:(241/285): lua-devel-5.4.4-4.el9.x86_64.rpm 157 kB/s | 22 kB 00:00 2024-09-12T00:22:02.830 INFO:teuthology.orchestra.run.smithi019.stdout:(154/285): low-memory-monitor-2.1-4.el9.x86_64. 476 kB/s | 36 kB 00:00 2024-09-12T00:22:02.869 INFO:teuthology.orchestra.run.smithi135.stdout:(242/285): gperftools-libs-2.9.1-2.el9.x86_64.r 4.5 MB/s | 309 kB 00:00 2024-09-12T00:22:02.881 INFO:teuthology.orchestra.run.smithi019.stdout:(155/285): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-09-12T00:22:02.902 INFO:teuthology.orchestra.run.smithi135.stdout:(243/285): grpc-data-1.46.7-10.el9.noarch.rpm 258 kB/s | 19 kB 00:00 2024-09-12T00:22:02.906 INFO:teuthology.orchestra.run.smithi019.stdout:(156/285): lua-posix-35.0-8.el9.x86_64.rpm 2.0 MB/s | 151 kB 00:00 2024-09-12T00:22:02.927 INFO:teuthology.orchestra.run.smithi135.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T00:22:02.931 INFO:teuthology.orchestra.run.smithi019.stdout:(157/285): lua-5.4.4-4.el9.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-09-12T00:22:02.952 INFO:teuthology.orchestra.run.smithi135.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-12T00:22:02.978 INFO:teuthology.orchestra.run.smithi135.stdout:(246/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.1 MB/s | 863 kB 00:00 2024-09-12T00:22:02.990 INFO:teuthology.orchestra.run.smithi019.stdout:(158/285): maven-lib-3.6.3-15.el9.noarch.rpm 18 MB/s | 1.5 MB 00:00 2024-09-12T00:22:03.012 INFO:teuthology.orchestra.run.smithi135.stdout:(247/285): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-12T00:22:03.015 INFO:teuthology.orchestra.run.smithi019.stdout:(159/285): maven-3.6.3-15.el9.noarch.rpm 132 kB/s | 18 kB 00:00 2024-09-12T00:22:03.041 INFO:teuthology.orchestra.run.smithi019.stdout:(160/285): maven-openjdk11-3.6.3-15.el9.noarch. 83 kB/s | 9.0 kB 00:00 2024-09-12T00:22:03.053 INFO:teuthology.orchestra.run.smithi135.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 2.0 MB/s | 151 kB 00:00 2024-09-12T00:22:03.066 INFO:teuthology.orchestra.run.smithi019.stdout:(161/285): maven-resolver-1.6.1-10.el9.noarch.r 6.7 MB/s | 517 kB 00:00 2024-09-12T00:22:03.104 INFO:teuthology.orchestra.run.smithi135.stdout:(249/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 9.1 MB/s | 839 kB 00:00 2024-09-12T00:22:03.125 INFO:teuthology.orchestra.run.smithi019.stdout:(162/285): maven-wagon-3.4.2-7.el9.noarch.rpm 1.3 MB/s | 112 kB 00:00 2024-09-12T00:22:03.137 INFO:teuthology.orchestra.run.smithi135.stdout:(250/285): python3-asyncssh-2.13.2-5.el9.noarch 6.4 MB/s | 548 kB 00:00 2024-09-12T00:22:03.141 INFO:teuthology.orchestra.run.smithi019.stdout:(163/285): maven-shared-utils-3.3.4-3.el9.noarc 1.2 MB/s | 151 kB 00:00 2024-09-12T00:22:03.154 INFO:teuthology.orchestra.run.smithi135.stdout:(251/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 867 kB/s | 43 kB 00:00 2024-09-12T00:22:03.180 INFO:teuthology.orchestra.run.smithi135.stdout:(252/285): python3-cachetools-4.2.4-1.el9.noarc 763 kB/s | 32 kB 00:00 2024-09-12T00:22:03.197 INFO:teuthology.orchestra.run.smithi135.stdout:(253/285): python3-certifi-2023.05.07-4.el9.noa 334 kB/s | 14 kB 00:00 2024-09-12T00:22:03.217 INFO:teuthology.orchestra.run.smithi019.stdout:(164/285): mesa-filesystem-24.1.2-3.el9.x86_64. 122 kB/s | 11 kB 00:00 2024-09-12T00:22:03.234 INFO:teuthology.orchestra.run.smithi019.stdout:(165/285): mesa-libEGL-24.1.2-3.el9.x86_64.rpm 1.5 MB/s | 139 kB 00:00 2024-09-12T00:22:03.289 INFO:teuthology.orchestra.run.smithi135.stdout:(254/285): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-12T00:22:03.314 INFO:teuthology.orchestra.run.smithi135.stdout:(255/285): python3-cheroot-8.6.0-4.el9.noarch.r 1.3 MB/s | 172 kB 00:00 2024-09-12T00:22:03.339 INFO:teuthology.orchestra.run.smithi135.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-12T00:22:03.365 INFO:teuthology.orchestra.run.smithi135.stdout:(257/285): python3-cherrypy-18.6.1-2.el9.noarch 2.1 MB/s | 358 kB 00:00 2024-09-12T00:22:03.390 INFO:teuthology.orchestra.run.smithi135.stdout:(258/285): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-12T00:22:03.393 INFO:teuthology.orchestra.run.smithi019.stdout:(166/285): mesa-dri-drivers-24.1.2-3.el9.x86_64 27 MB/s | 8.8 MB 00:00 2024-09-12T00:22:03.409 INFO:teuthology.orchestra.run.smithi019.stdout:(167/285): mesa-libgbm-24.1.2-3.el9.x86_64.rpm 206 kB/s | 36 kB 00:00 2024-09-12T00:22:03.415 INFO:teuthology.orchestra.run.smithi135.stdout:(259/285): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T00:22:03.435 INFO:teuthology.orchestra.run.smithi019.stdout:(168/285): mesa-libGL-24.1.2-3.el9.x86_64.rpm 781 kB/s | 171 kB 00:00 2024-09-12T00:22:03.440 INFO:teuthology.orchestra.run.smithi135.stdout:(260/285): python3-jaraco-classes-3.2.1-5.el9.n 352 kB/s | 18 kB 00:00 2024-09-12T00:22:03.461 INFO:teuthology.orchestra.run.smithi019.stdout:(169/285): mesa-libglapi-24.1.2-3.el9.x86_64.rp 680 kB/s | 46 kB 00:00 2024-09-12T00:22:03.465 INFO:teuthology.orchestra.run.smithi135.stdout:(261/285): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-09-12T00:22:03.486 INFO:teuthology.orchestra.run.smithi019.stdout:(170/285): mkfontscale-1.2.1-3.el9.x86_64.rpm 423 kB/s | 32 kB 00:00 2024-09-12T00:22:03.511 INFO:teuthology.orchestra.run.smithi019.stdout:(171/285): openblas-0.3.26-2.el9.x86_64.rpm 511 kB/s | 38 kB 00:00 2024-09-12T00:22:03.558 INFO:teuthology.orchestra.run.smithi135.stdout:(262/285): python3-jaraco-functools-3.5.0-2.el9 166 kB/s | 19 kB 00:00 2024-09-12T00:22:03.583 INFO:teuthology.orchestra.run.smithi135.stdout:(263/285): python3-jaraco-text-3.2.0-6.el9.noar 168 kB/s | 20 kB 00:00 2024-09-12T00:22:03.603 INFO:teuthology.orchestra.run.smithi019.stdout:(172/285): openblas-openmp-0.3.26-2.el9.x86_64. 35 MB/s | 4.9 MB 00:00 2024-09-12T00:22:03.664 INFO:teuthology.orchestra.run.smithi019.stdout:(173/285): openjpeg2-2.4.0-7.el9.x86_64.rpm 1.1 MB/s | 163 kB 00:00 2024-09-12T00:22:03.664 INFO:teuthology.orchestra.run.smithi019.stdout:(174/285): opus-1.3.1-10.el9.x86_64.rpm 1.4 MB/s | 200 kB 00:00 2024-09-12T00:22:03.664 INFO:teuthology.orchestra.run.smithi135.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T00:22:03.664 INFO:teuthology.orchestra.run.smithi135.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T00:22:03.664 INFO:teuthology.orchestra.run.smithi135.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T00:22:03.679 INFO:teuthology.orchestra.run.smithi019.stdout:(175/285): orc-0.4.31-8.el9.x86_64.rpm 2.4 MB/s | 183 kB 00:00 2024-09-12T00:22:03.692 INFO:teuthology.orchestra.run.smithi135.stdout:(267/285): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-12T00:22:03.712 INFO:teuthology.orchestra.run.smithi019.stdout:(176/285): osinfo-db-tools-1.10.0-1.el9.x86_64. 1.2 MB/s | 74 kB 00:00 2024-09-12T00:22:03.717 INFO:teuthology.orchestra.run.smithi135.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 662 kB/s | 16 kB 00:00 2024-09-12T00:22:03.746 INFO:teuthology.orchestra.run.smithi019.stdout:(177/285): ostree-libs-2024.7-2.el9.x86_64.rpm 6.9 MB/s | 468 kB 00:00 2024-09-12T00:22:03.759 INFO:teuthology.orchestra.run.smithi135.stdout:(269/285): python3-kubernetes-26.1.0-2.el9.noar 5.1 MB/s | 1.0 MB 00:00 2024-09-12T00:22:03.771 INFO:teuthology.orchestra.run.smithi019.stdout:(178/285): osinfo-db-20240701-2.el9.noarch.rpm 3.6 MB/s | 531 kB 00:00 2024-09-12T00:22:03.785 INFO:teuthology.orchestra.run.smithi135.stdout:(270/285): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-12T00:22:03.797 INFO:teuthology.orchestra.run.smithi019.stdout:(179/285): p11-kit-server-0.25.3-2.el9.x86_64.r 2.9 MB/s | 246 kB 00:00 2024-09-12T00:22:03.810 INFO:teuthology.orchestra.run.smithi135.stdout:(271/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 974 kB/s | 90 kB 00:00 2024-09-12T00:22:03.822 INFO:teuthology.orchestra.run.smithi019.stdout:(180/285): pipewire-1.0.1-1.el9.x86_64.rpm 1.4 MB/s | 107 kB 00:00 2024-09-12T00:22:03.835 INFO:teuthology.orchestra.run.smithi135.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T00:22:03.855 INFO:teuthology.orchestra.run.smithi019.stdout:(181/285): pipewire-jack-audio-connection-kit-1 156 kB/s | 9.1 kB 00:00 2024-09-12T00:22:03.861 INFO:teuthology.orchestra.run.smithi135.stdout:(273/285): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-12T00:22:03.881 INFO:teuthology.orchestra.run.smithi019.stdout:(182/285): pipewire-alsa-1.0.1-1.el9.x86_64.rpm 525 kB/s | 57 kB 00:00 2024-09-12T00:22:03.886 INFO:teuthology.orchestra.run.smithi135.stdout:(274/285): python3-routes-2.5.1-5.el9.noarch.rp 1.8 MB/s | 188 kB 00:00 2024-09-12T00:22:03.906 INFO:teuthology.orchestra.run.smithi019.stdout:(183/285): pipewire-jack-audio-connection-kit-l 1.6 MB/s | 135 kB 00:00 2024-09-12T00:22:03.911 INFO:teuthology.orchestra.run.smithi135.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-12T00:22:03.936 INFO:teuthology.orchestra.run.smithi135.stdout:(276/285): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T00:22:03.948 INFO:teuthology.orchestra.run.smithi019.stdout:(184/285): pipewire-pulseaudio-1.0.1-1.el9.x86_ 2.8 MB/s | 192 kB 00:00 2024-09-12T00:22:03.974 INFO:teuthology.orchestra.run.smithi019.stdout:(185/285): plexus-cipher-1.7-27.el9.noarch.rpm 386 kB/s | 26 kB 00:00 2024-09-12T00:22:03.987 INFO:teuthology.orchestra.run.smithi135.stdout:(277/285): python3-grpcio-1.46.7-10.el9.x86_64. 3.0 MB/s | 2.0 MB 00:00 2024-09-12T00:22:04.012 INFO:teuthology.orchestra.run.smithi135.stdout:(278/285): python3-webob-1.8.8-2.el9.noarch.rpm 1.8 MB/s | 230 kB 00:00 2024-09-12T00:22:04.015 INFO:teuthology.orchestra.run.smithi019.stdout:(186/285): plexus-classworlds-2.6.0-11.el9.noar 900 kB/s | 60 kB 00:00 2024-09-12T00:22:04.037 INFO:teuthology.orchestra.run.smithi135.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-09-12T00:22:04.040 INFO:teuthology.orchestra.run.smithi019.stdout:(187/285): plexus-containers-component-annotati 276 kB/s | 18 kB 00:00 2024-09-12T00:22:04.063 INFO:teuthology.orchestra.run.smithi135.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-12T00:22:04.082 INFO:teuthology.orchestra.run.smithi019.stdout:(188/285): plexus-interpolation-1.26-11.el9.noa 1.2 MB/s | 80 kB 00:00 2024-09-12T00:22:04.088 INFO:teuthology.orchestra.run.smithi135.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T00:22:04.114 INFO:teuthology.orchestra.run.smithi135.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.4 MB/s | 427 kB 00:00 2024-09-12T00:22:04.164 INFO:teuthology.orchestra.run.smithi135.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-12T00:22:04.174 INFO:teuthology.orchestra.run.smithi019.stdout:(189/285): plexus-sec-dispatcher-1.4-37.el9.noa 252 kB/s | 34 kB 00:00 2024-09-12T00:22:04.250 INFO:teuthology.orchestra.run.smithi019.stdout:(190/285): pipewire-libs-1.0.1-1.el9.x86_64.rpm 4.9 MB/s | 1.9 MB 00:00 2024-09-12T00:22:04.283 INFO:teuthology.orchestra.run.smithi019.stdout:(191/285): poppler-21.01.0-21.el9.x86_64.rpm 9.8 MB/s | 1.1 MB 00:00 2024-09-12T00:22:04.350 INFO:teuthology.orchestra.run.smithi019.stdout:(192/285): poppler-glib-21.01.0-21.el9.x86_64.r 2.2 MB/s | 152 kB 00:00 2024-09-12T00:22:04.356 INFO:teuthology.orchestra.run.smithi135.stdout:(284/285): librbd1-19.3.0-4753.gd011c522.el9.x8 13 MB/s | 3.2 MB 00:00 2024-09-12T00:22:04.434 INFO:teuthology.orchestra.run.smithi019.stdout:(193/285): protobuf-3.14.0-13.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2024-09-12T00:22:04.440 INFO:teuthology.orchestra.run.smithi135.stdout:(285/285): librados2-19.3.0-4753.gd011c522.el9. 9.9 MB/s | 3.5 MB 00:00 2024-09-12T00:22:04.446 INFO:teuthology.orchestra.run.smithi135.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:22:04.446 INFO:teuthology.orchestra.run.smithi135.stdout:Total 20 MB/s | 327 MB 00:16 2024-09-12T00:22:04.492 INFO:teuthology.orchestra.run.smithi019.stdout:(194/285): poppler-data-0.4.9-9.el9.noarch.rpm 7.7 MB/s | 1.9 MB 00:00 2024-09-12T00:22:04.609 INFO:teuthology.orchestra.run.smithi019.stdout:(195/285): pulseaudio-libs-15.0-2.el9.x86_64.rp 5.7 MB/s | 679 kB 00:00 2024-09-12T00:22:04.634 INFO:teuthology.orchestra.run.smithi019.stdout:(196/285): publicsuffix-list-20210518-3.el9.noa 413 kB/s | 83 kB 00:00 2024-09-12T00:22:04.702 INFO:teuthology.orchestra.run.smithi019.stdout:(197/285): python3-devel-3.9.19-8.el9.x86_64.rp 3.6 MB/s | 245 kB 00:00 2024-09-12T00:22:04.769 INFO:teuthology.orchestra.run.smithi019.stdout:(198/285): python3-jinja2-2.11.3-6.el9.noarch.r 3.6 MB/s | 248 kB 00:00 2024-09-12T00:22:04.852 INFO:teuthology.orchestra.run.smithi019.stdout:(199/285): python3-jsonpatch-1.21-16.el9.noarch 307 kB/s | 26 kB 00:00 2024-09-12T00:22:04.911 INFO:teuthology.orchestra.run.smithi019.stdout:(200/285): plexus-utils-3.3.0-10.el9.noarch.rpm 307 kB/s | 254 kB 00:00 2024-09-12T00:22:04.936 INFO:teuthology.orchestra.run.smithi019.stdout:(201/285): python3-jsonpointer-2.0-4.el9.noarch 229 kB/s | 19 kB 00:00 2024-09-12T00:22:05.011 INFO:teuthology.orchestra.run.smithi019.stdout:(202/285): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-12T00:22:05.028 INFO:teuthology.orchestra.run.smithi019.stdout:(203/285): python3-markupsafe-1.1.1-12.el9.x86_ 378 kB/s | 35 kB 00:00 2024-09-12T00:22:05.045 INFO:teuthology.orchestra.run.smithi019.stdout:(204/285): python3-mako-1.1.4-6.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-12T00:22:05.087 INFO:teuthology.orchestra.run.smithi019.stdout:(205/285): python3-numpy-f2py-1.20.1-5.el9.x86_ 4.2 MB/s | 250 kB 00:00 2024-09-12T00:22:05.121 INFO:teuthology.orchestra.run.smithi019.stdout:(206/285): python3-oauthlib-3.1.1-5.el9.noarch. 2.9 MB/s | 222 kB 00:00 2024-09-12T00:22:05.146 INFO:teuthology.orchestra.run.smithi019.stdout:(207/285): python3-packaging-20.9-5.el9.noarch. 1.3 MB/s | 77 kB 00:00 2024-09-12T00:22:05.188 INFO:teuthology.orchestra.run.smithi019.stdout:(208/285): python3-prettytable-0.7.2-27.el9.noa 632 kB/s | 42 kB 00:00 2024-09-12T00:22:05.213 INFO:teuthology.orchestra.run.smithi019.stdout:(209/285): python3-protobuf-3.14.0-13.el9.noarc 3.9 MB/s | 269 kB 00:00 2024-09-12T00:22:05.330 INFO:teuthology.orchestra.run.smithi019.stdout:(210/285): python3-numpy-1.20.1-5.el9.x86_64.rp 16 MB/s | 5.1 MB 00:00 2024-09-12T00:22:05.355 INFO:teuthology.orchestra.run.smithi019.stdout:(211/285): python3-pyasn1-0.4.8-6.el9.noarch.rp 950 kB/s | 159 kB 00:00 2024-09-12T00:22:05.397 INFO:teuthology.orchestra.run.smithi019.stdout:(212/285): python3-pyasn1-modules-0.4.8-6.el9.n 1.5 MB/s | 279 kB 00:00 2024-09-12T00:22:05.423 INFO:teuthology.orchestra.run.smithi019.stdout:(213/285): python3-pytz-2021.1-5.el9.noarch.rpm 554 kB/s | 51 kB 00:00 2024-09-12T00:22:05.448 INFO:teuthology.orchestra.run.smithi019.stdout:(214/285): python3-requests-oauthlib-1.3.0-12.e 582 kB/s | 54 kB 00:00 2024-09-12T00:22:05.490 INFO:teuthology.orchestra.run.smithi019.stdout:(215/285): python3-toml-0.10.2-6.el9.noarch.rpm 622 kB/s | 42 kB 00:00 2024-09-12T00:22:05.532 INFO:teuthology.orchestra.run.smithi019.stdout:(216/285): qatlib-24.02.0-1.el9.x86_64.rpm 2.6 MB/s | 221 kB 00:00 2024-09-12T00:22:05.565 INFO:teuthology.orchestra.run.smithi019.stdout:(217/285): qatlib-service-24.02.0-1.el9.x86_64. 477 kB/s | 36 kB 00:00 2024-09-12T00:22:05.599 INFO:teuthology.orchestra.run.smithi019.stdout:(218/285): qatzip-libs-1.2.0-1.el9.x86_64.rpm 710 kB/s | 47 kB 00:00 2024-09-12T00:22:05.666 INFO:teuthology.orchestra.run.smithi019.stdout:(219/285): rtkit-0.11-29.el9.x86_64.rpm 559 kB/s | 56 kB 00:00 2024-09-12T00:22:05.691 INFO:teuthology.orchestra.run.smithi019.stdout:(220/285): sisu-0.3.4-10.el9.noarch.rpm 5.4 MB/s | 510 kB 00:00 2024-09-12T00:22:05.850 INFO:teuthology.orchestra.run.smithi019.stdout:(221/285): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-09-12T00:22:05.875 INFO:teuthology.orchestra.run.smithi019.stdout:(222/285): slf4j-1.7.30-13.el9.noarch.rpm 330 kB/s | 69 kB 00:00 2024-09-12T00:22:05.900 INFO:teuthology.orchestra.run.smithi019.stdout:(223/285): socat-1.7.4.1-6.el9.x86_64.rpm 1.4 MB/s | 304 kB 00:00 2024-09-12T00:22:05.934 INFO:teuthology.orchestra.run.smithi019.stdout:(224/285): sound-theme-freedesktop-0.8-17.el9.n 4.5 MB/s | 383 kB 00:00 2024-09-12T00:22:05.951 INFO:teuthology.orchestra.run.smithi019.stdout:(225/285): totem-pl-parser-3.26.6-2.el9.x86_64. 2.0 MB/s | 152 kB 00:00 2024-09-12T00:22:06.001 INFO:teuthology.orchestra.run.smithi019.stdout:(226/285): tracker-miners-3.1.2-4.el9.x86_64.rp 14 MB/s | 944 kB 00:00 2024-09-12T00:22:06.026 INFO:teuthology.orchestra.run.smithi019.stdout:(227/285): tracker-3.1.2-3.el9.x86_64.rpm 4.3 MB/s | 555 kB 00:00 2024-09-12T00:22:06.060 INFO:teuthology.orchestra.run.smithi019.stdout:(228/285): ttmkfdir-3.0.9-65.el9.x86_64.rpm 487 kB/s | 53 kB 00:00 2024-09-12T00:22:06.085 INFO:teuthology.orchestra.run.smithi019.stdout:(229/285): tzdata-java-2024a-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-12T00:22:06.111 INFO:teuthology.orchestra.run.smithi019.stdout:(230/285): upower-0.99.11-11.el9.x86_64.rpm 2.0 MB/s | 173 kB 00:00 2024-09-12T00:22:06.153 INFO:teuthology.orchestra.run.smithi019.stdout:(231/285): wireplumber-0.4.14-1.el9.x86_64.rpm 1.4 MB/s | 96 kB 00:00 2024-09-12T00:22:06.178 INFO:teuthology.orchestra.run.smithi019.stdout:(232/285): webrtc-audio-processing-0.3.1-8.el9. 2.5 MB/s | 306 kB 00:00 2024-09-12T00:22:06.203 INFO:teuthology.orchestra.run.smithi019.stdout:(233/285): wireplumber-libs-0.4.14-1.el9.x86_64 3.8 MB/s | 358 kB 00:00 2024-09-12T00:22:06.228 INFO:teuthology.orchestra.run.smithi019.stdout:(234/285): xdg-dbus-proxy-0.1.3-1.el9.x86_64.rp 563 kB/s | 42 kB 00:00 2024-09-12T00:22:06.270 INFO:teuthology.orchestra.run.smithi019.stdout:(235/285): xdg-desktop-portal-1.12.6-1.el9.x86_ 4.1 MB/s | 385 kB 00:00 2024-09-12T00:22:06.304 INFO:teuthology.orchestra.run.smithi019.stdout:(236/285): xkeyboard-config-2.33-2.el9.noarch.r 11 MB/s | 859 kB 00:00 2024-09-12T00:22:06.329 INFO:teuthology.orchestra.run.smithi019.stdout:(237/285): xdg-desktop-portal-gtk-1.12.0-3.el9. 1.0 MB/s | 134 kB 00:00 2024-09-12T00:22:06.346 INFO:teuthology.orchestra.run.smithi019.stdout:(238/285): xmlstarlet-1.6.1-20.el9.x86_64.rpm 845 kB/s | 64 kB 00:00 2024-09-12T00:22:06.396 INFO:teuthology.orchestra.run.smithi019.stdout:(239/285): xorg-x11-fonts-Type1-7.5-33.el9.noar 5.4 MB/s | 505 kB 00:00 2024-09-12T00:22:06.446 INFO:teuthology.orchestra.run.smithi019.stdout:(240/285): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-12T00:22:06.463 INFO:teuthology.orchestra.run.smithi019.stdout:(241/285): lua-devel-5.4.4-4.el9.x86_64.rpm 166 kB/s | 22 kB 00:00 2024-09-12T00:22:06.497 INFO:teuthology.orchestra.run.smithi019.stdout:(242/285): gperftools-libs-2.9.1-2.el9.x86_64.r 6.0 MB/s | 309 kB 00:00 2024-09-12T00:22:06.522 INFO:teuthology.orchestra.run.smithi019.stdout:(243/285): grpc-data-1.46.7-10.el9.noarch.rpm 333 kB/s | 19 kB 00:00 2024-09-12T00:22:06.548 INFO:teuthology.orchestra.run.smithi019.stdout:(244/285): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-12T00:22:06.581 INFO:teuthology.orchestra.run.smithi019.stdout:(245/285): liboath-2.6.7-2.el9.x86_64.rpm 1.4 MB/s | 49 kB 00:00 2024-09-12T00:22:06.606 INFO:teuthology.orchestra.run.smithi019.stdout:(246/285): protobuf-compiler-3.14.0-13.el9.x86_ 3.2 MB/s | 863 kB 00:00 2024-09-12T00:22:06.640 INFO:teuthology.orchestra.run.smithi019.stdout:(247/285): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-09-12T00:22:06.699 INFO:teuthology.orchestra.run.smithi019.stdout:(248/285): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-12T00:22:06.741 INFO:teuthology.orchestra.run.smithi019.stdout:(249/285): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-12T00:22:06.766 INFO:teuthology.orchestra.run.smithi019.stdout:(250/285): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-12T00:22:06.791 INFO:teuthology.orchestra.run.smithi019.stdout:(251/285): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-12T00:22:06.816 INFO:teuthology.orchestra.run.smithi019.stdout:(252/285): python3-certifi-2023.05.07-4.el9.noa 567 kB/s | 14 kB 00:00 2024-09-12T00:22:06.842 INFO:teuthology.orchestra.run.smithi019.stdout:(253/285): python3-asyncssh-2.13.2-5.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-09-12T00:22:06.867 INFO:teuthology.orchestra.run.smithi019.stdout:(254/285): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-12T00:22:06.942 INFO:teuthology.orchestra.run.smithi019.stdout:(255/285): libarrow-9.0.0-11.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-09-12T00:22:06.967 INFO:teuthology.orchestra.run.smithi019.stdout:(256/285): python3-google-auth-2.34.0-1.el9.noa 2.1 MB/s | 220 kB 00:00 2024-09-12T00:22:06.993 INFO:teuthology.orchestra.run.smithi019.stdout:(257/285): python3-cherrypy-18.6.1-2.el9.noarch 2.3 MB/s | 358 kB 00:00 2024-09-12T00:22:07.018 INFO:teuthology.orchestra.run.smithi019.stdout:(258/285): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-12T00:22:07.043 INFO:teuthology.orchestra.run.smithi019.stdout:(259/285): python3-jaraco-8.2.1-3.el9.noarch.rp 213 kB/s | 11 kB 00:00 2024-09-12T00:22:07.077 INFO:teuthology.orchestra.run.smithi019.stdout:(260/285): python3-jaraco-classes-3.2.1-5.el9.n 300 kB/s | 18 kB 00:00 2024-09-12T00:22:07.104 INFO:teuthology.orchestra.run.smithi019.stdout:(261/285): python3-jaraco-collections-3.0.0-8.e 393 kB/s | 23 kB 00:00 2024-09-12T00:22:07.128 INFO:teuthology.orchestra.run.smithi019.stdout:(262/285): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-12T00:22:07.153 INFO:teuthology.orchestra.run.smithi019.stdout:(263/285): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-12T00:22:07.178 INFO:teuthology.orchestra.run.smithi019.stdout:(264/285): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-12T00:22:07.203 INFO:teuthology.orchestra.run.smithi019.stdout:(265/285): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-12T00:22:07.229 INFO:teuthology.orchestra.run.smithi019.stdout:(266/285): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-12T00:22:07.262 INFO:teuthology.orchestra.run.smithi019.stdout:(267/285): python3-pecan-1.4.2-3.el9.noarch.rpm 8.1 MB/s | 272 kB 00:00 2024-09-12T00:22:07.288 INFO:teuthology.orchestra.run.smithi019.stdout:(268/285): python3-portend-3.1.0-2.el9.noarch.r 656 kB/s | 16 kB 00:00 2024-09-12T00:22:07.321 INFO:teuthology.orchestra.run.smithi019.stdout:(269/285): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-09-12T00:22:07.346 INFO:teuthology.orchestra.run.smithi019.stdout:(270/285): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.5 MB/s | 90 kB 00:00 2024-09-12T00:22:07.372 INFO:teuthology.orchestra.run.smithi019.stdout:(271/285): python3-repoze-lru-0.7-16.el9.noarch 612 kB/s | 31 kB 00:00 2024-09-12T00:22:07.397 INFO:teuthology.orchestra.run.smithi019.stdout:(272/285): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-12T00:22:07.422 INFO:teuthology.orchestra.run.smithi019.stdout:(273/285): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-12T00:22:07.448 INFO:teuthology.orchestra.run.smithi019.stdout:(274/285): python3-tempora-5.0.0-2.el9.noarch.r 712 kB/s | 36 kB 00:00 2024-09-12T00:22:07.473 INFO:teuthology.orchestra.run.smithi019.stdout:(275/285): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-09-12T00:22:07.498 INFO:teuthology.orchestra.run.smithi019.stdout:(276/285): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-12T00:22:07.523 INFO:teuthology.orchestra.run.smithi019.stdout:(277/285): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-12T00:22:07.565 INFO:teuthology.orchestra.run.smithi019.stdout:(278/285): python3-grpcio-1.46.7-10.el9.x86_64. 3.3 MB/s | 2.0 MB 00:00 2024-09-12T00:22:07.582 INFO:teuthology.orchestra.run.smithi019.stdout:(279/285): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-09-12T00:22:07.608 INFO:teuthology.orchestra.run.smithi019.stdout:(280/285): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-12T00:22:07.633 INFO:teuthology.orchestra.run.smithi019.stdout:(281/285): s3cmd-2.4.0-1.el9.noarch.rpm 4.0 MB/s | 206 kB 00:00 2024-09-12T00:22:07.639 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction check 2024-09-12T00:22:07.658 INFO:teuthology.orchestra.run.smithi019.stdout:(282/285): python3-werkzeug-2.0.3-3.el9.1.noarc 2.6 MB/s | 427 kB 00:00 2024-09-12T00:22:07.717 INFO:teuthology.orchestra.run.smithi019.stdout:(283/285): thrift-0.15.0-2.el9.x86_64.rpm 15 MB/s | 1.6 MB 00:00 2024-09-12T00:22:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction check succeeded. 2024-09-12T00:22:07.824 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction test 2024-09-12T00:22:07.892 INFO:teuthology.orchestra.run.smithi019.stdout:(284/285): librados2-19.3.0-4753.gd011c522.el9. 13 MB/s | 3.5 MB 00:00 2024-09-12T00:22:07.942 INFO:teuthology.orchestra.run.smithi019.stdout:(285/285): librbd1-19.3.0-4753.gd011c522.el9.x8 11 MB/s | 3.2 MB 00:00 2024-09-12T00:22:07.949 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:22:07.949 INFO:teuthology.orchestra.run.smithi019.stdout:Total 17 MB/s | 327 MB 00:18 2024-09-12T00:22:11.058 INFO:teuthology.orchestra.run.smithi135.stdout:Transaction test succeeded. 2024-09-12T00:22:11.058 INFO:teuthology.orchestra.run.smithi135.stdout:Running transaction 2024-09-12T00:22:11.243 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-12T00:22:11.447 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-12T00:22:11.447 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-12T00:22:14.759 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-12T00:22:14.761 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-12T00:22:21.196 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:22:21.358 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:22:21.518 INFO:teuthology.orchestra.run.smithi135.stdout: Preparing : 1/1 2024-09-12T00:22:21.597 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:22:21.678 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:22:21.833 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:22:21.886 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:22:21.937 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:22:21.995 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:22:22.020 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:22:22.074 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:22:22.429 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:22:22.571 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:22:22.694 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:22:22.731 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:22:22.826 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:22:22.860 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:22:22.900 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:22:22.928 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:22:22.962 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:22:22.988 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:22:23.019 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:22:23.053 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:22:23.081 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:22:23.258 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:22:23.403 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:22:23.441 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:22:23.485 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:22:23.514 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:22:23.602 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:22:23.631 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:22:23.695 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:22:23.719 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:22:23.741 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:22:23.768 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:22:23.960 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:22:24.008 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:22:24.124 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:22:24.156 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:22:24.191 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:22:24.266 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:22:24.326 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:22:24.366 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:22:24.409 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:22:24.434 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:22:24.461 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:22:24.489 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:22:24.511 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:22:24.548 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:22:24.580 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:22:24.605 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:22:24.647 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:22:24.679 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:22:24.750 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:22:24.813 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:22:24.860 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:22:24.922 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:22:24.981 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:22:25.014 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:22:25.092 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:22:25.124 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:22:25.168 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:22:25.210 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:22:25.237 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 1/1 2024-09-12T00:22:25.294 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:22:25.425 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 1/1 2024-09-12T00:22:25.441 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:22:25.498 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:22:25.591 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-12T00:22:25.674 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : javapackages-filesystem-6.0.0-4.el9.noarch 1/287 2024-09-12T00:22:25.704 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libogg-2:1.3.4-6.el9.x86_64 2/287 2024-09-12T00:22:25.783 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libXi-1.7.10-8.el9.x86_64 3/287 2024-09-12T00:22:25.828 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : alsa-lib-1.2.12-1.el9.x86_64 4/287 2024-09-12T00:22:25.908 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libvorbis-1:1.3.7-5.el9.x86_64 5/287 2024-09-12T00:22:25.957 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/287 2024-09-12T00:22:25.982 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/287 2024-09-12T00:22:26.029 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/287 2024-09-12T00:22:26.070 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:22:26.170 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:22:26.204 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:22:26.275 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:22:26.310 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:22:26.346 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:22:26.392 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:22:26.425 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/287 2024-09-12T00:22:26.464 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:22:26.511 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:22:26.524 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:22:26.545 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:22:26.580 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:22:26.617 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:22:26.650 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:22:26.691 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:22:26.702 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:22:26.733 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:22:26.734 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:22:26.791 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:22:26.825 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:22:26.828 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:22:26.855 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:22:26.871 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:22:26.894 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libwayland-client-1.21.0-1.el9.x86_64 13/287 2024-09-12T00:22:26.922 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 14/287 2024-09-12T00:22:26.948 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 15/287 2024-09-12T00:22:26.967 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:22:26.974 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libXfixes-5.0.3-16.el9.x86_64 16/287 2024-09-12T00:22:27.006 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : opus-1.3.1-10.el9.x86_64 17/287 2024-09-12T00:22:27.030 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:22:27.032 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-5.4.4-4.el9.x86_64 18/287 2024-09-12T00:22:27.060 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libX11-xcb-1.7.0-9.el9.x86_64 19/287 2024-09-12T00:22:27.111 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:22:27.141 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:22:27.177 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:22:27.202 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lcms2-2.12-3.el9.x86_64 20/287 2024-09-12T00:22:27.225 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:22:27.270 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:22:27.320 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:22:27.339 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gstreamer1-1.22.1-2.el9.x86_64 21/287 2024-09-12T00:22:27.374 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : atk-2.36.0-5.el9.x86_64 22/287 2024-09-12T00:22:27.459 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:22:27.473 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libwayland-cursor-1.21.0-1.el9.x86_64 23/287 2024-09-12T00:22:27.505 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:22:27.547 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:22:27.651 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:22:27.700 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:22:27.705 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:22:27.746 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:22:27.779 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:22:27.803 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:22:27.812 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:22:27.840 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:22:27.889 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:22:27.913 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 25/287 2024-09-12T00:22:27.944 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libXtst-1.2.3-16.el9.x86_64 26/287 2024-09-12T00:22:27.967 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:22:27.994 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 27/287 2024-09-12T00:22:28.016 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:22:28.090 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:22:28.193 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:22:28.229 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 28/287 2024-09-12T00:22:28.303 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:22:28.347 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : re2-1:20211101-20.el9.x86_64 29/287 2024-09-12T00:22:28.349 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:22:28.385 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 30/287 2024-09-12T00:22:28.388 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:22:28.420 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : liboath-2.6.7-2.el9.x86_64 31/287 2024-09-12T00:22:28.426 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:22:28.470 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:22:28.496 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:22:28.498 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 32/287 2024-09-12T00:22:28.511 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:22:28.512 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:22:28.512 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:22:28.547 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 33/287 2024-09-12T00:22:28.587 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-packaging-20.9-5.el9.noarch 34/287 2024-09-12T00:22:28.635 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/287 2024-09-12T00:22:28.662 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/287 2024-09-12T00:22:28.689 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libxshmfence-1.3-10.el9.x86_64 37/287 2024-09-12T00:22:28.701 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:22:28.730 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libwayland-server-1.21.0-1.el9.x86_64 38/287 2024-09-12T00:22:28.756 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libwayland-egl-1.21.0-1.el9.x86_64 39/287 2024-09-12T00:22:28.781 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:22:28.790 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtool-ltdl-2.4.6-46.el9.x86_64 40/287 2024-09-12T00:22:28.817 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libglvnd-1:1.3.4-1.el9.x86_64 41/287 2024-09-12T00:22:28.836 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:22:28.842 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libXcomposite-0.4.5-7.el9.x86_64 42/287 2024-09-12T00:22:28.870 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:22:28.894 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 43/287 2024-09-12T00:22:28.904 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:22:28.923 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:22:28.938 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:22:28.999 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 44/287 2024-09-12T00:22:29.059 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 45/287 2024-09-12T00:22:29.088 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 46/287 2024-09-12T00:22:29.132 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 47/287 2024-09-12T00:22:29.168 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 48/287 2024-09-12T00:22:29.200 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fuse-2.9.9-16.el9.x86_64 49/287 2024-09-12T00:22:29.281 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cups-libs-1:2.3.3op2-30.el9.x86_64 50/287 2024-09-12T00:22:29.319 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 51/287 2024-09-12T00:22:29.363 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 52/287 2024-09-12T00:22:29.386 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:22:29.404 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 53/287 2024-09-12T00:22:29.425 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:22:29.439 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:22:29.439 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:22:29.439 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:22:29.484 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 54/287 2024-09-12T00:22:29.490 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:22:29.524 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:22:29.557 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:22:29.619 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:22:29.631 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 55/287 2024-09-12T00:22:29.650 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:22:29.683 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 56/287 2024-09-12T00:22:29.738 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:22:29.790 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:22:29.820 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:22:29.925 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:22:29.980 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:22:30.266 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rsa-4.9-2.el9.noarch 57/287 2024-09-12T00:22:30.350 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 58/287 2024-09-12T00:22:30.384 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 59/287 2024-09-12T00:22:30.458 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 60/287 2024-09-12T00:22:30.497 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : at-spi2-core-2.40.3-1.el9.x86_64 61/287 2024-09-12T00:22:30.533 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : at-spi2-atk-2.38.0-4.el9.x86_64 62/287 2024-09-12T00:22:30.563 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : colord-libs-1.4.5-4.el9.x86_64 63/287 2024-09-12T00:22:30.639 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 64/287 2024-09-12T00:22:30.681 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : luarocks-3.9.2-5.el9.noarch 65/287 2024-09-12T00:22:30.715 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libXcursor-1.2.0-7.el9.x86_64 66/287 2024-09-12T00:22:30.725 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:22:30.750 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libXdamage-1.1.5-7.el9.x86_64 67/287 2024-09-12T00:22:30.769 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:22:30.789 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 68/287 2024-09-12T00:22:30.802 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:22:30.833 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 69/287 2024-09-12T00:22:30.862 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flac-libs-1.3.3-12.el9.x86_64 70/287 2024-09-12T00:22:30.902 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:22:30.906 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtheora-1:1.1.1-31.el9.x86_64 71/287 2024-09-12T00:22:30.951 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:22:30.963 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:22:30.996 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : exiv2-0.27.5-2.el9.x86_64 73/287 2024-09-12T00:22:31.033 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgexiv2-0.12.3-1.el9.x86_64 74/287 2024-09-12T00:22:31.131 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 75/287 2024-09-12T00:22:31.144 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:22:31.183 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:22:31.192 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 76/287 2024-09-12T00:22:31.227 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:22:31.266 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 77/287 2024-09-12T00:22:31.302 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 78/287 2024-09-12T00:22:31.338 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 79/287 2024-09-12T00:22:31.386 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 80/287 2024-09-12T00:22:31.439 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 81/287 2024-09-12T00:22:31.481 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 82/287 2024-09-12T00:22:31.653 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 83/287 2024-09-12T00:22:31.690 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 84/287 2024-09-12T00:22:31.733 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 85/287 2024-09-12T00:22:31.735 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:22:31.801 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:22:31.841 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 86/287 2024-09-12T00:22:31.845 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:22:31.882 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 87/287 2024-09-12T00:22:31.887 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:22:31.923 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 88/287 2024-09-12T00:22:31.928 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:22:31.955 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 89/287 2024-09-12T00:22:31.980 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 90/287 2024-09-12T00:22:32.069 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 91/287 2024-09-12T00:22:32.114 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:22:32.143 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:22:32.207 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 92/287 2024-09-12T00:22:32.221 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:22:32.241 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 93/287 2024-09-12T00:22:32.460 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 94/287 2024-09-12T00:22:32.500 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xkeyboard-config-2.33-2.el9.noarch 95/287 2024-09-12T00:22:32.532 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libxkbcommon-1.0.3-4.el9.x86_64 96/287 2024-09-12T00:22:32.562 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xdg-dbus-proxy-0.1.3-1.el9.x86_64 97/287 2024-09-12T00:22:32.611 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : webrtc-audio-processing-0.3.1-8.el9.x86_64 98/287 2024-09-12T00:22:32.640 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:22:32.654 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: upower-0.99.11-11.el9.x86_64 99/287 2024-09-12T00:22:32.654 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/graphical.target.wants/upower.service → /usr/lib/systemd/system/upower.service. 2024-09-12T00:22:32.654 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:22:32.844 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : tzdata-java-2024a-2.el9.noarch 100/287 2024-09-12T00:22:32.905 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:22:32.921 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ttmkfdir-3.0.9-65.el9.x86_64 101/287 2024-09-12T00:22:32.972 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : totem-pl-parser-3.26.6-2.el9.x86_64 102/287 2024-09-12T00:22:32.995 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:22:33.021 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: sound-theme-freedesktop-0.8-17.el9.noarch 103/287 2024-09-12T00:22:33.026 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:22:33.047 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 104/287 2024-09-12T00:22:33.464 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:22:33.493 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:22:33.507 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rtkit-0.11-29.el9.x86_64 105/287 2024-09-12T00:22:33.507 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/graphical.target.wants/rtkit-daemon.service → /usr/lib/systemd/system/rtkit-daemon.service. 2024-09-12T00:22:33.507 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:22:33.549 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 106/287 2024-09-12T00:22:33.584 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 107/287 2024-09-12T00:22:33.617 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 108/287 2024-09-12T00:22:33.668 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 109/287 2024-09-12T00:22:33.701 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 110/287 2024-09-12T00:22:33.793 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 111/287 2024-09-12T00:22:33.850 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 112/287 2024-09-12T00:22:33.888 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 113/287 2024-09-12T00:22:33.998 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 114/287 2024-09-12T00:22:34.057 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 115/287 2024-09-12T00:22:34.314 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:22:34.421 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:22:34.475 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:22:34.506 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:22:34.533 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:22:34.563 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:22:34.575 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:22:34.575 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:22:34.575 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:22:34.637 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:22:34.675 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:22:34.703 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:22:34.844 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 116/287 2024-09-12T00:22:34.894 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 117/287 2024-09-12T00:22:34.928 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 118/287 2024-09-12T00:22:35.023 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:22:35.035 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 119/287 2024-09-12T00:22:35.066 INFO:teuthology.orchestra.run.smithi135.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:22:35.082 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 120/287 2024-09-12T00:22:35.174 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:22:35.207 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:22:35.239 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:22:35.268 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:22:35.280 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : publicsuffix-list-20210518-3.el9.noarch 121/287 2024-09-12T00:22:35.318 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : poppler-data-0.4.9-9.el9.noarch 122/287 2024-09-12T00:22:35.332 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:22:35.360 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : p11-kit-server-0.25.3-2.el9.x86_64 123/287 2024-09-12T00:22:35.367 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:22:35.393 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:22:35.432 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:22:35.457 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:22:35.725 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:22:35.768 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:22:35.796 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:22:35.821 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:22:35.847 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:22:35.872 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:22:35.897 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:22:35.922 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : osinfo-db-tools-1.10.0-1.el9.x86_64 124/287 2024-09-12T00:22:35.933 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:22:35.987 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:22:35.994 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : osinfo-db-20240701-2.el9.noarch 125/287 2024-09-12T00:22:36.030 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libosinfo-1.10.0-1.el9.x86_64 126/287 2024-09-12T00:22:36.033 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:22:36.063 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : orc-0.4.31-8.el9.x86_64 127/287 2024-09-12T00:22:36.070 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:22:36.097 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openjpeg2-2.4.0-7.el9.x86_64 128/287 2024-09-12T00:22:36.117 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:22:36.145 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:22:36.289 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-0.3.26-2.el9.x86_64 129/287 2024-09-12T00:22:36.319 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 130/287 2024-09-12T00:22:36.400 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 131/287 2024-09-12T00:22:36.605 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:22:36.745 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:22:36.802 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:22:36.827 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:22:36.855 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:22:36.941 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:22:36.988 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:22:37.020 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:22:37.040 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:22:37.066 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:22:37.092 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:22:37.123 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 132/287 2024-09-12T00:22:37.134 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:22:37.156 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:22:37.239 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 133/287 2024-09-12T00:22:38.598 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 134/287 2024-09-12T00:22:38.697 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 135/287 2024-09-12T00:22:38.757 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : mesa-filesystem-24.1.2-3.el9.x86_64 136/287 2024-09-12T00:22:38.790 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lua-posix-35.0-8.el9.x86_64 137/287 2024-09-12T00:22:38.826 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : copy-jdk-configs-4.0-3.el9.noarch 138/287 2024-09-12T00:22:38.856 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:22:38.868 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: low-memory-monitor-2.1-4.el9.x86_64 139/287 2024-09-12T00:22:38.868 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/basic.target.wants/low-memory-monitor.service → /usr/lib/systemd/system/low-memory-monitor.service. 2024-09-12T00:22:38.868 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:22:38.915 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libwebp-1.2.0-8.el9.x86_64 140/287 2024-09-12T00:22:38.943 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libvisual-1:0.4.0-34.el9.x86_64 141/287 2024-09-12T00:22:38.971 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libsbc-1.4-9.el9.x86_64 142/287 2024-09-12T00:22:39.309 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 143/287 2024-09-12T00:22:39.350 INFO:teuthology.orchestra.run.smithi019.stdout: Upgrading : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:22:39.452 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 144/287 2024-09-12T00:22:39.483 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 145/287 2024-09-12T00:22:39.515 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libnotify-0.7.9-8.el9.x86_64 146/287 2024-09-12T00:22:39.544 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libldac-2.0.2.3-10.el9.x86_64 147/287 2024-09-12T00:22:39.606 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libiptcdata-1.0.5-10.el9.x86_64 148/287 2024-09-12T00:22:39.643 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgsf-1.14.47-5.el9.x86_64 149/287 2024-09-12T00:22:39.668 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libfontenc-1.1.3-17.el9.x86_64 150/287 2024-09-12T00:22:39.713 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : mkfontscale-1.2.1-3.el9.x86_64 151/287 2024-09-12T00:22:39.741 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:22:40.013 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: xorg-x11-fonts-Type1-7.5-33.el9.noarch 152/287 2024-09-12T00:22:40.052 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libexif-0.6.22-6.el9.x86_64 153/287 2024-09-12T00:22:40.080 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libepoxy-1.5.5-4.el9.x86_64 154/287 2024-09-12T00:22:40.105 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libasyncns-0.8-22.el9.x86_64 155/287 2024-09-12T00:22:40.130 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libXxf86vm-1.1.4-18.el9.x86_64 156/287 2024-09-12T00:22:40.156 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libXv-1.0.11-16.el9.x86_64 157/287 2024-09-12T00:22:40.181 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libXrandr-1.5.2-8.el9.x86_64 158/287 2024-09-12T00:22:40.201 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libXinerama-1.1.4-10.el9.x86_64 159/287 2024-09-12T00:22:40.237 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : jbigkit-libs-2.1-23.el9.x86_64 160/287 2024-09-12T00:22:40.277 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtiff-4.4.0-13.el9.x86_64 161/287 2024-09-12T00:22:40.313 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 162/287 2024-09-12T00:22:40.361 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libgxps-0.3.2-3.el9.x86_64 163/287 2024-09-12T00:22:40.396 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : poppler-21.01.0-21.el9.x86_64 164/287 2024-09-12T00:22:40.866 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : poppler-glib-21.01.0-21.el9.x86_64 165/287 2024-09-12T00:22:41.013 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : iso-codes-4.6.0-3.el9.noarch 166/287 2024-09-12T00:22:41.069 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : hicolor-icon-theme-0.17-13.el9.noarch 167/287 2024-09-12T00:22:41.094 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gtk-update-icon-cache-3.24.31-5.el9.x86_64 168/287 2024-09-12T00:22:41.122 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gsm-1.0.19-6.el9.x86_64 169/287 2024-09-12T00:22:41.193 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libsndfile-1.0.31-8.el9.x86_64 170/287 2024-09-12T00:22:41.238 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : pulseaudio-libs-15.0-2.el9.x86_64 171/287 2024-09-12T00:22:41.262 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:22:41.283 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: libcanberra-0.30-27.el9.x86_64 172/287 2024-09-12T00:22:41.316 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : graphene-1.10.6-2.el9.x86_64 173/287 2024-09-12T00:22:41.342 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : giflib-5.2.1-9.el9.x86_64 174/287 2024-09-12T00:22:41.382 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flatpak-session-helper-1.12.9-1.el9.x86_64 175/287 2024-09-12T00:22:41.397 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:22:49.107 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:22:49.155 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:22:49.184 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:22:49.227 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:22:49.266 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:22:49.302 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:22:49.852 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:22:49.882 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:22:49.954 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:22:49.984 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:22:52.334 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:22:52.368 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:22:52.939 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:22:52.978 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:22:53.071 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:22:53.072 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:22:53.072 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:22:53.072 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:22:53.105 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:22:53.393 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: flatpak-selinux-1.12.9-1.el9.noarch 176/287 2024-09-12T00:22:53.440 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : fdk-aac-free-2.0.0-8.el9.x86_64 177/287 2024-09-12T00:22:53.467 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 178/287 2024-09-12T00:22:53.511 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : composefs-libs-1.0.5-1.el9.x86_64 179/287 2024-09-12T00:22:53.567 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ostree-libs-2024.7-2.el9.x86_64 180/287 2024-09-12T00:22:53.603 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 181/287 2024-09-12T00:22:54.138 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 182/287 2024-09-12T00:22:54.174 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:22:54.255 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 183/287 2024-09-12T00:22:54.284 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 184/287 2024-09-12T00:22:56.754 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:22:56.792 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:22:57.388 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 185/287 2024-09-12T00:22:57.437 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:22:57.536 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 186/287 2024-09-12T00:22:57.536 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-12T00:22:57.536 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-12T00:22:57.536 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:22:57.563 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:23:02.733 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:23:02.733 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /sys 2024-09-12T00:23:02.733 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /proc 2024-09-12T00:23:02.733 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /mnt 2024-09-12T00:23:02.733 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /var/tmp 2024-09-12T00:23:02.733 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /home 2024-09-12T00:23:02.734 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /root 2024-09-12T00:23:02.734 INFO:teuthology.orchestra.run.smithi135.stdout:skipping the directory /tmp 2024-09-12T00:23:02.734 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:02.903 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:23:02.919 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:23:02.919 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:02.919 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:23:02.919 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:04.378 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:23:04.406 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:23:04.406 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:04.406 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:23:04.406 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:23:04.406 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:23:04.407 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:04.637 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:23:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:23:04.661 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:04.661 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:23:04.661 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:23:04.661 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:23:04.661 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:05.113 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:23:05.137 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:23:05.138 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:05.138 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:23:05.138 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:23:05.138 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:23:05.138 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:05.239 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:23:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 187/287 2024-09-12T00:23:07.414 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /sys 2024-09-12T00:23:07.414 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /proc 2024-09-12T00:23:07.414 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /mnt 2024-09-12T00:23:07.414 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /var/tmp 2024-09-12T00:23:07.414 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /home 2024-09-12T00:23:07.414 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /root 2024-09-12T00:23:07.414 INFO:teuthology.orchestra.run.smithi019.stdout:skipping the directory /tmp 2024-09-12T00:23:07.414 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:07.586 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:23:07.603 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 188/287 2024-09-12T00:23:07.603 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:07.603 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-12T00:23:07.604 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:08.093 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:23:08.206 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:23:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:23:08.319 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:23:08.511 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:23:08.559 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:23:08.638 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:23:08.726 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:23:08.865 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:23:08.917 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:23:08.952 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:23:09.162 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:23:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 189/287 2024-09-12T00:23:09.191 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:09.191 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-12T00:23:09.191 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:23:09.191 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-12T00:23:09.191 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:09.429 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:23:09.454 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 190/287 2024-09-12T00:23:09.454 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:09.454 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-12T00:23:09.455 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:23:09.455 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-12T00:23:09.455 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:09.810 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:23:09.857 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:23:09.930 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:23:09.955 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 191/287 2024-09-12T00:23:09.955 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:09.955 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-12T00:23:09.955 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:23:09.955 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-12T00:23:09.955 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:10.061 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : avahi-glib-0.8-21.el9.x86_64 192/287 2024-09-12T00:23:10.205 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:23:10.247 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:23:10.278 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:23:10.306 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:23:10.349 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:23:10.386 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:23:10.413 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:23:10.439 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:23:10.465 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:23:10.489 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:23:10.516 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:23:10.550 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:23:10.578 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:23:10.607 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:23:10.635 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:23:10.669 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:23:10.705 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:23:10.736 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:23:10.770 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:23:10.805 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:23:10.850 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:23:10.888 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:23:10.931 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:23:10.984 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:23:11.015 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:23:11.038 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:23:11.091 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:23:11.133 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:23:11.163 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:23:11.191 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:23:11.217 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:23:11.385 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:23:11.417 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:23:11.453 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:23:11.488 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:23:11.521 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:23:11.650 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:23:11.711 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:23:11.780 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:23:11.811 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:23:11.933 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:23:11.982 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:23:12.003 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:23:12.036 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:23:12.059 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:23:12.482 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:23:12.512 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:23:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:23:12.530 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:23:12.530 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:12.772 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:23:12.877 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:23:12.921 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:23:12.957 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:23:12.991 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:23:13.136 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : adwaita-cursor-theme-40.1.1-3.el9.noarch 193/287 2024-09-12T00:23:13.240 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : adwaita-icon-theme-40.1.1-3.el9.noarch 194/287 2024-09-12T00:23:13.297 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-ply-3.11-14.el9.noarch 195/287 2024-09-12T00:23:13.363 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 196/287 2024-09-12T00:23:13.368 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:23:13.395 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:23:13.411 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:23:13.658 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 197/287 2024-09-12T00:23:13.701 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 198/287 2024-09-12T00:23:13.783 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 199/287 2024-09-12T00:23:13.874 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 200/287 2024-09-12T00:23:13.949 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:23:14.017 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 201/287 2024-09-12T00:23:14.032 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:23:14.069 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:23:14.070 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 202/287 2024-09-12T00:23:14.099 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:23:14.112 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 203/287 2024-09-12T00:23:14.303 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:23:14.368 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:23:14.394 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:23:14.416 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:23:14.445 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:23:14.515 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:23:14.556 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:23:14.567 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:23:14.598 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:23:14.614 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:23:14.641 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:23:15.021 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : lksctp-tools-1.0.19-2.el9.x86_64 204/287 2024-09-12T00:23:15.068 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:23:15.083 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:23:15.112 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:23:15.146 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:23:15.213 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:23:15.245 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:23:15.445 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 205/287 2024-09-12T00:23:15.483 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : plexus-utils-3.3.0-10.el9.noarch 206/287 2024-09-12T00:23:15.514 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : slf4j-1.7.30-13.el9.noarch 207/287 2024-09-12T00:23:15.541 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : atinject-1.0.3-6.el9.noarch 208/287 2024-09-12T00:23:15.577 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : apache-commons-io-1:2.8.0-8.el9.noarch 209/287 2024-09-12T00:23:15.613 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : apache-commons-lang3-3.12.0-6.el9.noarch 210/287 2024-09-12T00:23:15.641 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : httpcomponents-core-4.4.13-7.el9.noarch 211/287 2024-09-12T00:23:15.658 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : plexus-cipher-1.7-27.el9.noarch 212/287 2024-09-12T00:23:15.684 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : plexus-classworlds-2.6.0-11.el9.noarch 213/287 2024-09-12T00:23:15.708 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : plexus-containers-component-annotations-2.1.0-10 214/287 2024-09-12T00:23:15.735 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : plexus-sec-dispatcher-1.4-37.el9.noarch 215/287 2024-09-12T00:23:15.760 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : maven-shared-utils-3.3.4-3.el9.noarch 216/287 2024-09-12T00:23:15.787 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cdi-api-2.0.2-6.el9.noarch 217/287 2024-09-12T00:23:15.817 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : sisu-1:0.3.4-10.el9.noarch 218/287 2024-09-12T00:23:15.845 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : jcl-over-slf4j-1.7.30-13.el9.noarch 219/287 2024-09-12T00:23:15.881 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : apache-commons-cli-1.4-17.el9.noarch 220/287 2024-09-12T00:23:15.917 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : apache-commons-codec-1.15-7.el9.noarch 221/287 2024-09-12T00:23:15.947 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : httpcomponents-client-4.5.13-3.el9.noarch 222/287 2024-09-12T00:23:15.982 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : jakarta-annotations-1.3.5-13.el9.noarch 223/287 2024-09-12T00:23:16.016 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : jansi-2.3.3-6.el9.x86_64 224/287 2024-09-12T00:23:16.052 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : jsoup-1.13.1-10.el9.noarch 225/287 2024-09-12T00:23:16.100 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : maven-wagon-3.4.2-7.el9.noarch 226/287 2024-09-12T00:23:16.143 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : maven-resolver-1:1.6.1-10.el9.noarch 227/287 2024-09-12T00:23:16.186 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : jsr-305-3.0.2-6.el9.noarch 228/287 2024-09-12T00:23:16.218 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : guava-30.1-6.el9.noarch 229/287 2024-09-12T00:23:16.249 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : google-guice-4.2.3-9.el9.noarch 230/287 2024-09-12T00:23:16.304 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : plexus-interpolation-1.26-11.el9.noarch 231/287 2024-09-12T00:23:16.334 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : maven-lib-1:3.6.3-15.el9.noarch 232/287 2024-09-12T00:23:16.365 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libpciaccess-0.16-7.el9.x86_64 233/287 2024-09-12T00:23:16.394 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libdrm-2.4.121-1.el9.x86_64 234/287 2024-09-12T00:23:16.419 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libglvnd-egl-1:1.3.4-1.el9.x86_64 235/287 2024-09-12T00:23:16.600 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : mesa-libglapi-24.1.2-3.el9.x86_64 236/287 2024-09-12T00:23:16.628 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : mesa-dri-drivers-24.1.2-3.el9.x86_64 237/287 2024-09-12T00:23:16.655 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : mesa-libgbm-24.1.2-3.el9.x86_64 238/287 2024-09-12T00:23:16.682 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : mesa-libEGL-24.1.2-3.el9.x86_64 239/287 2024-09-12T00:23:16.715 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libglvnd-glx-1:1.3.4-1.el9.x86_64 240/287 2024-09-12T00:23:16.848 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : mesa-libGL-24.1.2-3.el9.x86_64 241/287 2024-09-12T00:23:16.915 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 242/287 2024-09-12T00:23:16.985 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libtracker-sparql-3.1.2-3.el9.x86_64 243/287 2024-09-12T00:23:17.019 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:23:17.139 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: tracker-3.1.2-3.el9.x86_64 244/287 2024-09-12T00:23:17.183 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:23:17.199 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: tracker-miners-3.1.2-4.el9.x86_64 245/287 2024-09-12T00:23:17.228 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bubblewrap-0.4.1-7.el9.x86_64 246/287 2024-09-12T00:23:17.251 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : bluez-libs-5.56-6.el9.x86_64 247/287 2024-09-12T00:23:17.685 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:23:17.722 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:23:17.739 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: pipewire-1.0.1-1.el9.x86_64 248/287 2024-09-12T00:23:17.740 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire.socket → /usr/lib/systemd/user/pipewire.socket. 2024-09-12T00:23:17.740 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:17.983 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : pipewire-libs-1.0.1-1.el9.x86_64 249/287 2024-09-12T00:23:18.054 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : wireplumber-0.4.14-1.el9.x86_64 250/287 2024-09-12T00:23:18.098 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : wireplumber-libs-0.4.14-1.el9.x86_64 251/287 2024-09-12T00:23:18.134 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 252/287 2024-09-12T00:23:18.160 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ModemManager-glib-1.20.2-1.el9.x86_64 253/287 2024-09-12T00:23:18.460 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:23:18.593 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:23:18.626 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:23:18.630 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:23:18.648 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: geoclue2-2.6.0-7.el9.x86_64 254/287 2024-09-12T00:23:19.205 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:23:19.297 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : flatpak-1.12.9-1.el9.x86_64 255/287 2024-09-12T00:23:19.330 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:23:19.360 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: xdg-desktop-portal-1.12.6-1.el9.x86_64 256/287 2024-09-12T00:23:19.571 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcanberra-gtk3-0.30-27.el9.x86_64 257/287 2024-09-12T00:23:19.584 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:23:19.618 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:23:19.639 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gtk3-3.24.31-5.el9.x86_64 258/287 2024-09-12T00:23:19.672 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:23:19.694 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 259/287 2024-09-12T00:23:19.722 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:23:19.732 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:23:19.788 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 260/287 2024-09-12T00:23:19.817 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:23:19.828 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 261/287 2024-09-12T00:23:19.851 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:23:19.873 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: maven-1:3.6.3-15.el9.noarch 262/287 2024-09-12T00:23:19.887 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:23:19.902 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : maven-openjdk11-1:3.6.3-15.el9.noarch 263/287 2024-09-12T00:23:19.928 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:23:19.952 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:23:19.952 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:19.952 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:23:19.952 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:23:19.952 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:23:19.952 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:20.004 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:23:20.016 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:23:20.038 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:23:20.067 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:23:20.115 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:23:20.147 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:23:20.164 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:23:20.164 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:23:20.164 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:20.288 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:23:20.316 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 264/287 2024-09-12T00:23:20.350 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 265/287 2024-09-12T00:23:20.427 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 266/287 2024-09-12T00:23:20.457 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:23:21.123 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:23:21.147 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:23:21.147 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:21.147 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:23:21.147 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:23:21.148 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:23:21.148 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:21.191 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:23:21.214 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:23:21.214 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:21.214 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:23:21.214 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:21.525 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:23:21.548 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:23:21.548 INFO:teuthology.orchestra.run.smithi135.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:21.548 INFO:teuthology.orchestra.run.smithi135.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:23:21.548 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:23:21.549 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:23:21.549 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:23.830 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 267/287 2024-09-12T00:23:23.888 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:23:24.904 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 268/287 2024-09-12T00:23:24.930 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:23:25.052 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 269/287 2024-09-12T00:23:25.225 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 270/287 2024-09-12T00:23:25.257 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:23:25.283 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 271/287 2024-09-12T00:23:25.283 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:25.283 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-12T00:23:25.283 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:23:25.283 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-12T00:23:25.283 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:25.333 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:23:25.345 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 272/287 2024-09-12T00:23:25.367 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 273/287 2024-09-12T00:23:25.397 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 274/287 2024-09-12T00:23:25.446 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : pipewire-alsa-1.0.1-1.el9.x86_64 275/287 2024-09-12T00:23:25.477 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:23:25.494 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: pipewire-pulseaudio-1.0.1-1.el9.x86_64 276/287 2024-09-12T00:23:25.494 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/user/sockets.target.wants/pipewire-pulse.socket → /usr/lib/systemd/user/pipewire-pulse.socket. 2024-09-12T00:23:25.494 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:26.220 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:23:26.261 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:23:26.292 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:23:26.397 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:23:26.460 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:23:26.493 INFO:teuthology.orchestra.run.smithi135.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:23:26.493 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:23:26.511 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:23:26.536 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 277/287 2024-09-12T00:23:26.537 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:26.537 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-12T00:23:26.537 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:23:26.537 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:23:26.537 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:26.584 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:23:26.584 INFO:teuthology.orchestra.run.smithi135.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:23:26.620 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:23:26.644 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4753.gd011c 278/287 2024-09-12T00:23:26.645 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:26.645 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-12T00:23:26.645 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:26.701 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:23:26.727 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:23:26.734 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:23:26.743 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:23:26.753 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:23:26.753 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:23:26.754 INFO:teuthology.orchestra.run.smithi135.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:23:26.754 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:26.811 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:23:26.880 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:23:26.979 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:23:27.004 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 279/287 2024-09-12T00:23:27.004 INFO:teuthology.orchestra.run.smithi019.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-12T00:23:27.004 INFO:teuthology.orchestra.run.smithi019.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-12T00:23:27.004 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:23:27.005 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-12T00:23:27.005 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:32.003 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 280/287 2024-09-12T00:23:32.044 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 281/287 2024-09-12T00:23:32.075 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 282/287 2024-09-12T00:23:32.184 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 283/287 2024-09-12T00:23:32.255 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:23:32.283 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : s3cmd-2.4.0-1.el9.noarch 285/287 2024-09-12T00:23:32.283 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:23:32.376 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 286/287 2024-09-12T00:23:32.376 INFO:teuthology.orchestra.run.smithi019.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:23:32.475 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:23:32.491 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: dconf-0.40.0-6.el9.x86_64 287/287 2024-09-12T00:23:32.498 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: copy-jdk-configs-4.0-3.el9.noarch 287/287 2024-09-12T00:23:32.508 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 287/287 2024-09-12T00:23:32.519 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: wireplumber-0.4.14-1.el9.x86_64 287/287 2024-09-12T00:23:32.519 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/user/pipewire-session-manager.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:23:32.519 INFO:teuthology.orchestra.run.smithi019.stdout:Created symlink /etc/systemd/user/pipewire.service.wants/wireplumber.service → /usr/lib/systemd/user/wireplumber.service. 2024-09-12T00:23:32.519 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:32.581 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:23:32.654 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 287/287 2024-09-12T00:23:37.953 INFO:teuthology.orchestra.run.smithi135.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:23:37.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:23:37.953 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:23:37.954 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:23:37.955 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:23:37.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:23:37.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:23:37.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:23:37.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:23:37.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:23:37.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:23:37.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:23:37.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:23:37.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:23:37.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:23:37.956 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:23:37.957 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:23:37.958 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:23:37.959 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:23:37.960 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:23:37.961 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:23:37.962 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:23:37.963 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:23:37.964 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:23:37.965 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:23:37.966 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:23:37.967 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:23:37.968 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:23:37.969 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:23:37.970 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:23:37.971 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:23:37.972 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:23:37.973 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:23:37.974 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:23:37.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:23:37.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:23:37.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:23:37.975 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:23:41.444 INFO:teuthology.orchestra.run.smithi135.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout:Upgraded: 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout:Installed: 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:23:41.445 INFO:teuthology.orchestra.run.smithi135.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.446 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:41.447 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:23:41.448 INFO:teuthology.orchestra.run.smithi135.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:23:41.449 INFO:teuthology.orchestra.run.smithi135.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:23:41.450 INFO:teuthology.orchestra.run.smithi135.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:23:41.451 INFO:teuthology.orchestra.run.smithi135.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.452 INFO:teuthology.orchestra.run.smithi135.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:23:41.453 INFO:teuthology.orchestra.run.smithi135.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:23:41.454 INFO:teuthology.orchestra.run.smithi135.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:23:41.455 INFO:teuthology.orchestra.run.smithi135.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:23:41.456 INFO:teuthology.orchestra.run.smithi135.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:23:41.456 INFO:teuthology.orchestra.run.smithi135.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:23:41.456 INFO:teuthology.orchestra.run.smithi135.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:23:41.456 INFO:teuthology.orchestra.run.smithi135.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:23:41.456 INFO:teuthology.orchestra.run.smithi135.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:23:41.456 INFO:teuthology.orchestra.run.smithi135.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:23:41.456 INFO:teuthology.orchestra.run.smithi135.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:23:41.456 INFO:teuthology.orchestra.run.smithi135.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:23:41.456 INFO:teuthology.orchestra.run.smithi135.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:23:41.456 INFO:teuthology.orchestra.run.smithi135.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:23:41.456 INFO:teuthology.orchestra.run.smithi135.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:23:41.457 INFO:teuthology.orchestra.run.smithi135.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:23:41.458 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:23:41.459 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:23:41.460 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:23:41.461 INFO:teuthology.orchestra.run.smithi135.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.462 INFO:teuthology.orchestra.run.smithi135.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:23:41.463 INFO:teuthology.orchestra.run.smithi135.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:23:41.464 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:23:41.464 INFO:teuthology.orchestra.run.smithi135.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:23:41.464 INFO:teuthology.orchestra.run.smithi135.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:23:41.464 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.464 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.464 INFO:teuthology.orchestra.run.smithi135.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:41.464 INFO:teuthology.orchestra.run.smithi135.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:23:41.464 INFO:teuthology.orchestra.run.smithi135.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:23:41.464 INFO:teuthology.orchestra.run.smithi135.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:23:41.464 INFO:teuthology.orchestra.run.smithi135.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:23:41.465 INFO:teuthology.orchestra.run.smithi135.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:23:41.466 INFO:teuthology.orchestra.run.smithi135.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:23:41.466 INFO:teuthology.orchestra.run.smithi135.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:23:41.466 INFO:teuthology.orchestra.run.smithi135.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:23:41.466 INFO:teuthology.orchestra.run.smithi135.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:23:41.466 INFO:teuthology.orchestra.run.smithi135.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:23:41.466 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:41.466 INFO:teuthology.orchestra.run.smithi135.stdout:Complete! 2024-09-12T00:23:41.892 DEBUG:teuthology.parallel:result is None 2024-09-12T00:23:42.695 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:23:42.695 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-2:19.3.0-4753.gd011c522.el9.x86_64 1/287 2024-09-12T00:23:42.695 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2/287 2024-09-12T00:23:42.695 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 3/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 4/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4753.gd011c 5/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 6/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 7/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 8/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 9/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 10/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 11/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 12/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_ 13/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 14/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 15/287 2024-09-12T00:23:42.696 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados-devel-2:19.3.0-4753.gd011c522.el9.x86_6 16/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86 17/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 18/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4753.gd011c522.el 19/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ceph-common-2:19.3.0-4753.gd011c522.el9. 20/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_6 21/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 22/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 23/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 24/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 25/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 26/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 27/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4753.gd011c522. 28/287 2024-09-12T00:23:42.697 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noa 29/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.n 30/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4753.gd01 31/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el 32/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 33/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.e 34/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 35/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cephadm-2:19.3.0-4753.gd011c522.el9.noarch 36/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ModemManager-glib-1.20.2-1.el9.x86_64 37/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bluez-libs-5.56-6.el9.x86_64 38/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : bubblewrap-0.4.1-7.el9.x86_64 39/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cups-libs-1:2.3.3op2-30.el9.x86_64 40/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 41/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 42/287 2024-09-12T00:23:42.698 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpciaccess-0.16-7.el9.x86_64 43/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 44/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lksctp-tools-1.0.19-2.el9.x86_64 45/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 46/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 47/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-ply-3.11-14.el9.noarch 48/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 49/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 50/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 51/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : adwaita-cursor-theme-40.1.1-3.el9.noarch 52/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : adwaita-icon-theme-40.1.1-3.el9.noarch 53/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : alsa-lib-1.2.12-1.el9.x86_64 54/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : apache-commons-cli-1.4-17.el9.noarch 55/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : apache-commons-codec-1.15-7.el9.noarch 56/287 2024-09-12T00:23:42.699 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : apache-commons-io-1:2.8.0-8.el9.noarch 57/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : apache-commons-lang3-3.12.0-6.el9.noarch 58/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : at-spi2-atk-2.38.0-4.el9.x86_64 59/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : at-spi2-core-2.40.3-1.el9.x86_64 60/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : atinject-1.0.3-6.el9.noarch 61/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : atk-2.36.0-5.el9.x86_64 62/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : avahi-glib-0.8-21.el9.x86_64 63/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 64/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : cdi-api-2.0.2-6.el9.noarch 65/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : colord-libs-1.4.5-4.el9.x86_64 66/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : composefs-libs-1.0.5-1.el9.x86_64 67/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : copy-jdk-configs-4.0-3.el9.noarch 68/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : dconf-0.40.0-6.el9.x86_64 69/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 70/287 2024-09-12T00:23:42.700 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : exiv2-0.27.5-2.el9.x86_64 71/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : exiv2-libs-0.27.5-2.el9.x86_64 72/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : fdk-aac-free-2.0.0-8.el9.x86_64 73/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flac-libs-1.3.3-12.el9.x86_64 74/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flatpak-1.12.9-1.el9.x86_64 75/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flatpak-selinux-1.12.9-1.el9.noarch 76/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flatpak-session-helper-1.12.9-1.el9.x86_64 77/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 78/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 79/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 80/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 81/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : geoclue2-2.6.0-7.el9.x86_64 82/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : giflib-5.2.1-9.el9.x86_64 83/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : google-guice-4.2.3-9.el9.noarch 84/287 2024-09-12T00:23:42.701 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : graphene-1.10.6-2.el9.x86_64 85/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gsm-1.0.19-6.el9.x86_64 86/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gstreamer1-1.22.1-2.el9.x86_64 87/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gstreamer1-plugins-base-1.22.1-2.el9.x86_64 88/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gtk-update-icon-cache-3.24.31-5.el9.x86_64 89/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gtk3-3.24.31-5.el9.x86_64 90/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : guava-30.1-6.el9.noarch 91/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : hicolor-icon-theme-0.17-13.el9.noarch 92/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : httpcomponents-client-4.5.13-3.el9.noarch 93/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : httpcomponents-core-4.4.13-7.el9.noarch 94/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : iso-codes-4.6.0-3.el9.noarch 95/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jakarta-annotations-1.3.5-13.el9.noarch 96/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jansi-2.3.3-6.el9.x86_64 97/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 98/287 2024-09-12T00:23:42.702 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 99/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86 100/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : javapackages-filesystem-6.0.0-4.el9.noarch 101/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jbigkit-libs-2.1-23.el9.x86_64 102/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jcl-over-slf4j-1.7.30-13.el9.noarch 103/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jsoup-1.13.1-10.el9.noarch 104/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : jsr-305-3.0.2-6.el9.noarch 105/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lcms2-2.12-3.el9.x86_64 106/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libX11-xcb-1.7.0-9.el9.x86_64 107/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libXcomposite-0.4.5-7.el9.x86_64 108/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libXcursor-1.2.0-7.el9.x86_64 109/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libXdamage-1.1.5-7.el9.x86_64 110/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libXfixes-5.0.3-16.el9.x86_64 111/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libXi-1.7.10-8.el9.x86_64 112/287 2024-09-12T00:23:42.703 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libXinerama-1.1.4-10.el9.x86_64 113/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libXrandr-1.5.2-8.el9.x86_64 114/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libXtst-1.2.3-16.el9.x86_64 115/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libXv-1.0.11-16.el9.x86_64 116/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libXxf86vm-1.1.4-18.el9.x86_64 117/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libasyncns-0.8-22.el9.x86_64 118/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcanberra-0.30-27.el9.x86_64 119/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcanberra-gtk3-0.30-27.el9.x86_64 120/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libdrm-2.4.121-1.el9.x86_64 121/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libepoxy-1.5.5-4.el9.x86_64 122/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libexif-0.6.22-6.el9.x86_64 123/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libfontenc-1.1.3-17.el9.x86_64 124/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgexiv2-0.12.3-1.el9.x86_64 125/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libglvnd-1:1.3.4-1.el9.x86_64 126/287 2024-09-12T00:23:42.704 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libglvnd-egl-1:1.3.4-1.el9.x86_64 127/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libglvnd-glx-1:1.3.4-1.el9.x86_64 128/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgsf-1.14.47-5.el9.x86_64 129/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libgxps-0.3.2-3.el9.x86_64 130/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libiptcdata-1.0.5-10.el9.x86_64 131/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libldac-2.0.2.3-10.el9.x86_64 132/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libnotify-0.7.9-8.el9.x86_64 133/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libogg-2:1.3.4-6.el9.x86_64 134/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libosinfo-1.10.0-1.el9.x86_64 135/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 136/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 137/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 138/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libsbc-1.4-9.el9.x86_64 139/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libsndfile-1.0.31-8.el9.x86_64 140/287 2024-09-12T00:23:42.705 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtheora-1:1.1.1-31.el9.x86_64 141/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtiff-4.4.0-13.el9.x86_64 142/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtool-ltdl-2.4.6-46.el9.x86_64 143/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libtracker-sparql-3.1.2-3.el9.x86_64 144/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libvisual-1:0.4.0-34.el9.x86_64 145/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libvorbis-1:1.3.7-5.el9.x86_64 146/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libwayland-client-1.21.0-1.el9.x86_64 147/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libwayland-cursor-1.21.0-1.el9.x86_64 148/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libwayland-egl-1.21.0-1.el9.x86_64 149/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libwayland-server-1.21.0-1.el9.x86_64 150/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libwebp-1.2.0-8.el9.x86_64 151/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libxkbcommon-1.0.3-4.el9.x86_64 152/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libxshmfence-1.3-10.el9.x86_64 153/287 2024-09-12T00:23:42.706 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : low-memory-monitor-2.1-4.el9.x86_64 154/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 155/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-5.4.4-4.el9.x86_64 156/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-posix-35.0-8.el9.x86_64 157/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : maven-1:3.6.3-15.el9.noarch 158/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : maven-lib-1:3.6.3-15.el9.noarch 159/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : maven-openjdk11-1:3.6.3-15.el9.noarch 160/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : maven-resolver-1:1.6.1-10.el9.noarch 161/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : maven-shared-utils-3.3.4-3.el9.noarch 162/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : maven-wagon-3.4.2-7.el9.noarch 163/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : mesa-dri-drivers-24.1.2-3.el9.x86_64 164/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : mesa-filesystem-24.1.2-3.el9.x86_64 165/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : mesa-libEGL-24.1.2-3.el9.x86_64 166/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : mesa-libGL-24.1.2-3.el9.x86_64 167/287 2024-09-12T00:23:42.707 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : mesa-libgbm-24.1.2-3.el9.x86_64 168/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : mesa-libglapi-24.1.2-3.el9.x86_64 169/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : mkfontscale-1.2.1-3.el9.x86_64 170/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 171/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 172/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : openjpeg2-2.4.0-7.el9.x86_64 173/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : opus-1.3.1-10.el9.x86_64 174/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : orc-0.4.31-8.el9.x86_64 175/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : osinfo-db-20240701-2.el9.noarch 176/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : osinfo-db-tools-1.10.0-1.el9.x86_64 177/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ostree-libs-2024.7-2.el9.x86_64 178/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : p11-kit-server-0.25.3-2.el9.x86_64 179/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : pipewire-1.0.1-1.el9.x86_64 180/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : pipewire-alsa-1.0.1-1.el9.x86_64 181/287 2024-09-12T00:23:42.708 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : pipewire-jack-audio-connection-kit-1.0.1-1.el9.x 182/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : pipewire-jack-audio-connection-kit-libs-1.0.1-1. 183/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : pipewire-libs-1.0.1-1.el9.x86_64 184/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : pipewire-pulseaudio-1.0.1-1.el9.x86_64 185/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : plexus-cipher-1.7-27.el9.noarch 186/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : plexus-classworlds-2.6.0-11.el9.noarch 187/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : plexus-containers-component-annotations-2.1.0-10 188/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : plexus-interpolation-1.26-11.el9.noarch 189/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : plexus-sec-dispatcher-1.4-37.el9.noarch 190/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : plexus-utils-3.3.0-10.el9.noarch 191/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : poppler-21.01.0-21.el9.x86_64 192/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : poppler-data-0.4.9-9.el9.noarch 193/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : poppler-glib-21.01.0-21.el9.x86_64 194/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 195/287 2024-09-12T00:23:42.709 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : publicsuffix-list-20210518-3.el9.noarch 196/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : pulseaudio-libs-15.0-2.el9.x86_64 197/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 198/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 199/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 200/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 201/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 202/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 203/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 204/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 205/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 206/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 207/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 208/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 209/287 2024-09-12T00:23:42.710 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 210/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 211/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 212/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 213/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 214/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 215/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 216/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 217/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 218/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 219/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : rtkit-0.11-29.el9.x86_64 220/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : sisu-1:0.3.4-10.el9.noarch 221/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : slf4j-1.7.30-13.el9.noarch 222/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 223/287 2024-09-12T00:23:42.711 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : sound-theme-freedesktop-0.8-17.el9.noarch 224/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : totem-pl-parser-3.26.6-2.el9.x86_64 225/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : tracker-3.1.2-3.el9.x86_64 226/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : tracker-miners-3.1.2-4.el9.x86_64 227/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : ttmkfdir-3.0.9-65.el9.x86_64 228/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : tzdata-java-2024a-2.el9.noarch 229/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : upower-0.99.11-11.el9.x86_64 230/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : webrtc-audio-processing-0.3.1-8.el9.x86_64 231/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : wireplumber-0.4.14-1.el9.x86_64 232/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : wireplumber-libs-0.4.14-1.el9.x86_64 233/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xdg-dbus-proxy-0.1.3-1.el9.x86_64 234/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xdg-desktop-portal-1.12.6-1.el9.x86_64 235/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 236/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xkeyboard-config-2.33-2.el9.noarch 237/287 2024-09-12T00:23:42.712 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 238/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : xorg-x11-fonts-Type1-7.5-33.el9.noarch 239/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 240/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 241/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 242/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 243/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 244/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 245/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 246/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 247/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 248/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 249/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 250/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 251/287 2024-09-12T00:23:42.713 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 252/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 253/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 254/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 255/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 256/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 257/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 258/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 259/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 260/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 261/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 262/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 263/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 264/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 265/287 2024-09-12T00:23:42.714 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 266/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 267/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 268/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 269/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 270/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 271/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 272/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 273/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 274/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 275/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 276/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 277/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 278/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 279/287 2024-09-12T00:23:42.715 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 280/287 2024-09-12T00:23:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : re2-1:20211101-20.el9.x86_64 281/287 2024-09-12T00:23:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : s3cmd-2.4.0-1.el9.noarch 282/287 2024-09-12T00:23:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 283/287 2024-09-12T00:23:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:19.3.0-4753.gd011c522.el9.x86_64 284/287 2024-09-12T00:23:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 285/287 2024-09-12T00:23:42.716 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 286/287 2024-09-12T00:23:46.092 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 287/287 2024-09-12T00:23:46.093 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:46.093 INFO:teuthology.orchestra.run.smithi019.stdout:Upgraded: 2024-09-12T00:23:46.093 INFO:teuthology.orchestra.run.smithi019.stdout: librados2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.093 INFO:teuthology.orchestra.run.smithi019.stdout: librbd1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.093 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-12T00:23:46.093 INFO:teuthology.orchestra.run.smithi019.stdout: ModemManager-glib-1.20.2-1.el9.x86_64 2024-09-12T00:23:46.093 INFO:teuthology.orchestra.run.smithi019.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-12T00:23:46.093 INFO:teuthology.orchestra.run.smithi019.stdout: adwaita-cursor-theme-40.1.1-3.el9.noarch 2024-09-12T00:23:46.094 INFO:teuthology.orchestra.run.smithi019.stdout: adwaita-icon-theme-40.1.1-3.el9.noarch 2024-09-12T00:23:46.094 INFO:teuthology.orchestra.run.smithi019.stdout: alsa-lib-1.2.12-1.el9.x86_64 2024-09-12T00:23:46.094 INFO:teuthology.orchestra.run.smithi019.stdout: apache-commons-cli-1.4-17.el9.noarch 2024-09-12T00:23:46.094 INFO:teuthology.orchestra.run.smithi019.stdout: apache-commons-codec-1.15-7.el9.noarch 2024-09-12T00:23:46.094 INFO:teuthology.orchestra.run.smithi019.stdout: apache-commons-io-1:2.8.0-8.el9.noarch 2024-09-12T00:23:46.094 INFO:teuthology.orchestra.run.smithi019.stdout: apache-commons-lang3-3.12.0-6.el9.noarch 2024-09-12T00:23:46.094 INFO:teuthology.orchestra.run.smithi019.stdout: at-spi2-atk-2.38.0-4.el9.x86_64 2024-09-12T00:23:46.094 INFO:teuthology.orchestra.run.smithi019.stdout: at-spi2-core-2.40.3-1.el9.x86_64 2024-09-12T00:23:46.095 INFO:teuthology.orchestra.run.smithi019.stdout: atinject-1.0.3-6.el9.noarch 2024-09-12T00:23:46.095 INFO:teuthology.orchestra.run.smithi019.stdout: atk-2.36.0-5.el9.x86_64 2024-09-12T00:23:46.095 INFO:teuthology.orchestra.run.smithi019.stdout: avahi-glib-0.8-21.el9.x86_64 2024-09-12T00:23:46.095 INFO:teuthology.orchestra.run.smithi019.stdout: bluez-libs-5.56-6.el9.x86_64 2024-09-12T00:23:46.095 INFO:teuthology.orchestra.run.smithi019.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-12T00:23:46.095 INFO:teuthology.orchestra.run.smithi019.stdout: bubblewrap-0.4.1-7.el9.x86_64 2024-09-12T00:23:46.096 INFO:teuthology.orchestra.run.smithi019.stdout: cdi-api-2.0.2-6.el9.noarch 2024-09-12T00:23:46.096 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.096 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-base-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.096 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.096 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.096 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-grafana-dashboards-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:46.097 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-immutable-object-cache-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.097 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mds-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.097 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.097 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:46.097 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-dashboard-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:46.097 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:46.097 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-modules-core-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:46.098 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mgr-rook-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:46.098 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-mon-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.098 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-osd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.098 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-prometheus-alerts-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:46.098 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-radosgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.098 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-selinux-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.098 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-test-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.098 INFO:teuthology.orchestra.run.smithi019.stdout: ceph-volume-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:46.099 INFO:teuthology.orchestra.run.smithi019.stdout: cephadm-2:19.3.0-4753.gd011c522.el9.noarch 2024-09-12T00:23:46.099 INFO:teuthology.orchestra.run.smithi019.stdout: colord-libs-1.4.5-4.el9.x86_64 2024-09-12T00:23:46.099 INFO:teuthology.orchestra.run.smithi019.stdout: composefs-libs-1.0.5-1.el9.x86_64 2024-09-12T00:23:46.099 INFO:teuthology.orchestra.run.smithi019.stdout: copy-jdk-configs-4.0-3.el9.noarch 2024-09-12T00:23:46.099 INFO:teuthology.orchestra.run.smithi019.stdout: cups-libs-1:2.3.3op2-30.el9.x86_64 2024-09-12T00:23:46.099 INFO:teuthology.orchestra.run.smithi019.stdout: dconf-0.40.0-6.el9.x86_64 2024-09-12T00:23:46.099 INFO:teuthology.orchestra.run.smithi019.stdout: exempi-2.6.0-0.2.20211007gite23c213.el9.x86_64 2024-09-12T00:23:46.099 INFO:teuthology.orchestra.run.smithi019.stdout: exiv2-0.27.5-2.el9.x86_64 2024-09-12T00:23:46.099 INFO:teuthology.orchestra.run.smithi019.stdout: exiv2-libs-0.27.5-2.el9.x86_64 2024-09-12T00:23:46.099 INFO:teuthology.orchestra.run.smithi019.stdout: fdk-aac-free-2.0.0-8.el9.x86_64 2024-09-12T00:23:46.100 INFO:teuthology.orchestra.run.smithi019.stdout: flac-libs-1.3.3-12.el9.x86_64 2024-09-12T00:23:46.100 INFO:teuthology.orchestra.run.smithi019.stdout: flatpak-1.12.9-1.el9.x86_64 2024-09-12T00:23:46.100 INFO:teuthology.orchestra.run.smithi019.stdout: flatpak-selinux-1.12.9-1.el9.noarch 2024-09-12T00:23:46.100 INFO:teuthology.orchestra.run.smithi019.stdout: flatpak-session-helper-1.12.9-1.el9.x86_64 2024-09-12T00:23:46.100 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-12T00:23:46.100 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-12T00:23:46.100 INFO:teuthology.orchestra.run.smithi019.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-12T00:23:46.101 INFO:teuthology.orchestra.run.smithi019.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-12T00:23:46.101 INFO:teuthology.orchestra.run.smithi019.stdout: gdk-pixbuf2-modules-2.42.6-4.el9.x86_64 2024-09-12T00:23:46.101 INFO:teuthology.orchestra.run.smithi019.stdout: geoclue2-2.6.0-7.el9.x86_64 2024-09-12T00:23:46.101 INFO:teuthology.orchestra.run.smithi019.stdout: giflib-5.2.1-9.el9.x86_64 2024-09-12T00:23:46.101 INFO:teuthology.orchestra.run.smithi019.stdout: google-guice-4.2.3-9.el9.noarch 2024-09-12T00:23:46.101 INFO:teuthology.orchestra.run.smithi019.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-09-12T00:23:46.101 INFO:teuthology.orchestra.run.smithi019.stdout: graphene-1.10.6-2.el9.x86_64 2024-09-12T00:23:46.102 INFO:teuthology.orchestra.run.smithi019.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-12T00:23:46.102 INFO:teuthology.orchestra.run.smithi019.stdout: gsm-1.0.19-6.el9.x86_64 2024-09-12T00:23:46.102 INFO:teuthology.orchestra.run.smithi019.stdout: gstreamer1-1.22.1-2.el9.x86_64 2024-09-12T00:23:46.102 INFO:teuthology.orchestra.run.smithi019.stdout: gstreamer1-plugins-base-1.22.1-2.el9.x86_64 2024-09-12T00:23:46.102 INFO:teuthology.orchestra.run.smithi019.stdout: gtk-update-icon-cache-3.24.31-5.el9.x86_64 2024-09-12T00:23:46.102 INFO:teuthology.orchestra.run.smithi019.stdout: gtk3-3.24.31-5.el9.x86_64 2024-09-12T00:23:46.103 INFO:teuthology.orchestra.run.smithi019.stdout: guava-30.1-6.el9.noarch 2024-09-12T00:23:46.103 INFO:teuthology.orchestra.run.smithi019.stdout: hicolor-icon-theme-0.17-13.el9.noarch 2024-09-12T00:23:46.103 INFO:teuthology.orchestra.run.smithi019.stdout: httpcomponents-client-4.5.13-3.el9.noarch 2024-09-12T00:23:46.103 INFO:teuthology.orchestra.run.smithi019.stdout: httpcomponents-core-4.4.13-7.el9.noarch 2024-09-12T00:23:46.103 INFO:teuthology.orchestra.run.smithi019.stdout: iso-codes-4.6.0-3.el9.noarch 2024-09-12T00:23:46.103 INFO:teuthology.orchestra.run.smithi019.stdout: jakarta-annotations-1.3.5-13.el9.noarch 2024-09-12T00:23:46.104 INFO:teuthology.orchestra.run.smithi019.stdout: jansi-2.3.3-6.el9.x86_64 2024-09-12T00:23:46.104 INFO:teuthology.orchestra.run.smithi019.stdout: java-11-openjdk-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:23:46.104 INFO:teuthology.orchestra.run.smithi019.stdout: java-11-openjdk-devel-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:23:46.104 INFO:teuthology.orchestra.run.smithi019.stdout: java-11-openjdk-headless-1:11.0.20.1.1-2.el9.x86_64 2024-09-12T00:23:46.104 INFO:teuthology.orchestra.run.smithi019.stdout: javapackages-filesystem-6.0.0-4.el9.noarch 2024-09-12T00:23:46.104 INFO:teuthology.orchestra.run.smithi019.stdout: jbigkit-libs-2.1-23.el9.x86_64 2024-09-12T00:23:46.105 INFO:teuthology.orchestra.run.smithi019.stdout: jcl-over-slf4j-1.7.30-13.el9.noarch 2024-09-12T00:23:46.105 INFO:teuthology.orchestra.run.smithi019.stdout: jsoup-1.13.1-10.el9.noarch 2024-09-12T00:23:46.105 INFO:teuthology.orchestra.run.smithi019.stdout: jsr-305-3.0.2-6.el9.noarch 2024-09-12T00:23:46.105 INFO:teuthology.orchestra.run.smithi019.stdout: lcms2-2.12-3.el9.x86_64 2024-09-12T00:23:46.105 INFO:teuthology.orchestra.run.smithi019.stdout: libX11-xcb-1.7.0-9.el9.x86_64 2024-09-12T00:23:46.105 INFO:teuthology.orchestra.run.smithi019.stdout: libXcomposite-0.4.5-7.el9.x86_64 2024-09-12T00:23:46.106 INFO:teuthology.orchestra.run.smithi019.stdout: libXcursor-1.2.0-7.el9.x86_64 2024-09-12T00:23:46.106 INFO:teuthology.orchestra.run.smithi019.stdout: libXdamage-1.1.5-7.el9.x86_64 2024-09-12T00:23:46.106 INFO:teuthology.orchestra.run.smithi019.stdout: libXfixes-5.0.3-16.el9.x86_64 2024-09-12T00:23:46.106 INFO:teuthology.orchestra.run.smithi019.stdout: libXi-1.7.10-8.el9.x86_64 2024-09-12T00:23:46.106 INFO:teuthology.orchestra.run.smithi019.stdout: libXinerama-1.1.4-10.el9.x86_64 2024-09-12T00:23:46.106 INFO:teuthology.orchestra.run.smithi019.stdout: libXrandr-1.5.2-8.el9.x86_64 2024-09-12T00:23:46.107 INFO:teuthology.orchestra.run.smithi019.stdout: libXtst-1.2.3-16.el9.x86_64 2024-09-12T00:23:46.107 INFO:teuthology.orchestra.run.smithi019.stdout: libXv-1.0.11-16.el9.x86_64 2024-09-12T00:23:46.107 INFO:teuthology.orchestra.run.smithi019.stdout: libXxf86vm-1.1.4-18.el9.x86_64 2024-09-12T00:23:46.107 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-12T00:23:46.107 INFO:teuthology.orchestra.run.smithi019.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-12T00:23:46.107 INFO:teuthology.orchestra.run.smithi019.stdout: libasyncns-0.8-22.el9.x86_64 2024-09-12T00:23:46.108 INFO:teuthology.orchestra.run.smithi019.stdout: libcanberra-0.30-27.el9.x86_64 2024-09-12T00:23:46.108 INFO:teuthology.orchestra.run.smithi019.stdout: libcanberra-gtk3-0.30-27.el9.x86_64 2024-09-12T00:23:46.108 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.108 INFO:teuthology.orchestra.run.smithi019.stdout: libcephfs2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.109 INFO:teuthology.orchestra.run.smithi019.stdout: libcephsqlite-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.109 INFO:teuthology.orchestra.run.smithi019.stdout: libdrm-2.4.121-1.el9.x86_64 2024-09-12T00:23:46.109 INFO:teuthology.orchestra.run.smithi019.stdout: libepoxy-1.5.5-4.el9.x86_64 2024-09-12T00:23:46.109 INFO:teuthology.orchestra.run.smithi019.stdout: libexif-0.6.22-6.el9.x86_64 2024-09-12T00:23:46.109 INFO:teuthology.orchestra.run.smithi019.stdout: libfontenc-1.1.3-17.el9.x86_64 2024-09-12T00:23:46.110 INFO:teuthology.orchestra.run.smithi019.stdout: libgexiv2-0.12.3-1.el9.x86_64 2024-09-12T00:23:46.110 INFO:teuthology.orchestra.run.smithi019.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-12T00:23:46.110 INFO:teuthology.orchestra.run.smithi019.stdout: libglvnd-1:1.3.4-1.el9.x86_64 2024-09-12T00:23:46.110 INFO:teuthology.orchestra.run.smithi019.stdout: libglvnd-egl-1:1.3.4-1.el9.x86_64 2024-09-12T00:23:46.110 INFO:teuthology.orchestra.run.smithi019.stdout: libglvnd-glx-1:1.3.4-1.el9.x86_64 2024-09-12T00:23:46.111 INFO:teuthology.orchestra.run.smithi019.stdout: libgsf-1.14.47-5.el9.x86_64 2024-09-12T00:23:46.111 INFO:teuthology.orchestra.run.smithi019.stdout: libgxps-0.3.2-3.el9.x86_64 2024-09-12T00:23:46.111 INFO:teuthology.orchestra.run.smithi019.stdout: libiptcdata-1.0.5-10.el9.x86_64 2024-09-12T00:23:46.111 INFO:teuthology.orchestra.run.smithi019.stdout: libldac-2.0.2.3-10.el9.x86_64 2024-09-12T00:23:46.111 INFO:teuthology.orchestra.run.smithi019.stdout: libnotify-0.7.9-8.el9.x86_64 2024-09-12T00:23:46.112 INFO:teuthology.orchestra.run.smithi019.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-12T00:23:46.112 INFO:teuthology.orchestra.run.smithi019.stdout: libogg-2:1.3.4-6.el9.x86_64 2024-09-12T00:23:46.112 INFO:teuthology.orchestra.run.smithi019.stdout: libosinfo-1.10.0-1.el9.x86_64 2024-09-12T00:23:46.112 INFO:teuthology.orchestra.run.smithi019.stdout: libpciaccess-0.16-7.el9.x86_64 2024-09-12T00:23:46.112 INFO:teuthology.orchestra.run.smithi019.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-12T00:23:46.112 INFO:teuthology.orchestra.run.smithi019.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-12T00:23:46.113 INFO:teuthology.orchestra.run.smithi019.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-12T00:23:46.113 INFO:teuthology.orchestra.run.smithi019.stdout: librados-devel-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.113 INFO:teuthology.orchestra.run.smithi019.stdout: libradosstriper1-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.113 INFO:teuthology.orchestra.run.smithi019.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-12T00:23:46.113 INFO:teuthology.orchestra.run.smithi019.stdout: librgw2-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.114 INFO:teuthology.orchestra.run.smithi019.stdout: libsbc-1.4-9.el9.x86_64 2024-09-12T00:23:46.114 INFO:teuthology.orchestra.run.smithi019.stdout: libsndfile-1.0.31-8.el9.x86_64 2024-09-12T00:23:46.114 INFO:teuthology.orchestra.run.smithi019.stdout: libtheora-1:1.1.1-31.el9.x86_64 2024-09-12T00:23:46.114 INFO:teuthology.orchestra.run.smithi019.stdout: libtiff-4.4.0-13.el9.x86_64 2024-09-12T00:23:46.114 INFO:teuthology.orchestra.run.smithi019.stdout: libtool-ltdl-2.4.6-46.el9.x86_64 2024-09-12T00:23:46.114 INFO:teuthology.orchestra.run.smithi019.stdout: libtracker-sparql-3.1.2-3.el9.x86_64 2024-09-12T00:23:46.115 INFO:teuthology.orchestra.run.smithi019.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-12T00:23:46.115 INFO:teuthology.orchestra.run.smithi019.stdout: libvisual-1:0.4.0-34.el9.x86_64 2024-09-12T00:23:46.115 INFO:teuthology.orchestra.run.smithi019.stdout: libvorbis-1:1.3.7-5.el9.x86_64 2024-09-12T00:23:46.115 INFO:teuthology.orchestra.run.smithi019.stdout: libwayland-client-1.21.0-1.el9.x86_64 2024-09-12T00:23:46.115 INFO:teuthology.orchestra.run.smithi019.stdout: libwayland-cursor-1.21.0-1.el9.x86_64 2024-09-12T00:23:46.115 INFO:teuthology.orchestra.run.smithi019.stdout: libwayland-egl-1.21.0-1.el9.x86_64 2024-09-12T00:23:46.116 INFO:teuthology.orchestra.run.smithi019.stdout: libwayland-server-1.21.0-1.el9.x86_64 2024-09-12T00:23:46.116 INFO:teuthology.orchestra.run.smithi019.stdout: libwebp-1.2.0-8.el9.x86_64 2024-09-12T00:23:46.116 INFO:teuthology.orchestra.run.smithi019.stdout: libxkbcommon-1.0.3-4.el9.x86_64 2024-09-12T00:23:46.116 INFO:teuthology.orchestra.run.smithi019.stdout: libxshmfence-1.3-10.el9.x86_64 2024-09-12T00:23:46.116 INFO:teuthology.orchestra.run.smithi019.stdout: lksctp-tools-1.0.19-2.el9.x86_64 2024-09-12T00:23:46.117 INFO:teuthology.orchestra.run.smithi019.stdout: low-memory-monitor-2.1-4.el9.x86_64 2024-09-12T00:23:46.117 INFO:teuthology.orchestra.run.smithi019.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-12T00:23:46.117 INFO:teuthology.orchestra.run.smithi019.stdout: lua-5.4.4-4.el9.x86_64 2024-09-12T00:23:46.117 INFO:teuthology.orchestra.run.smithi019.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-12T00:23:46.117 INFO:teuthology.orchestra.run.smithi019.stdout: lua-posix-35.0-8.el9.x86_64 2024-09-12T00:23:46.117 INFO:teuthology.orchestra.run.smithi019.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-12T00:23:46.118 INFO:teuthology.orchestra.run.smithi019.stdout: maven-1:3.6.3-15.el9.noarch 2024-09-12T00:23:46.118 INFO:teuthology.orchestra.run.smithi019.stdout: maven-lib-1:3.6.3-15.el9.noarch 2024-09-12T00:23:46.118 INFO:teuthology.orchestra.run.smithi019.stdout: maven-openjdk11-1:3.6.3-15.el9.noarch 2024-09-12T00:23:46.118 INFO:teuthology.orchestra.run.smithi019.stdout: maven-resolver-1:1.6.1-10.el9.noarch 2024-09-12T00:23:46.118 INFO:teuthology.orchestra.run.smithi019.stdout: maven-shared-utils-3.3.4-3.el9.noarch 2024-09-12T00:23:46.118 INFO:teuthology.orchestra.run.smithi019.stdout: maven-wagon-3.4.2-7.el9.noarch 2024-09-12T00:23:46.119 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-dri-drivers-24.1.2-3.el9.x86_64 2024-09-12T00:23:46.119 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-filesystem-24.1.2-3.el9.x86_64 2024-09-12T00:23:46.119 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-libEGL-24.1.2-3.el9.x86_64 2024-09-12T00:23:46.119 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-libGL-24.1.2-3.el9.x86_64 2024-09-12T00:23:46.119 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-libgbm-24.1.2-3.el9.x86_64 2024-09-12T00:23:46.119 INFO:teuthology.orchestra.run.smithi019.stdout: mesa-libglapi-24.1.2-3.el9.x86_64 2024-09-12T00:23:46.120 INFO:teuthology.orchestra.run.smithi019.stdout: mkfontscale-1.2.1-3.el9.x86_64 2024-09-12T00:23:46.120 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-12T00:23:46.120 INFO:teuthology.orchestra.run.smithi019.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-12T00:23:46.120 INFO:teuthology.orchestra.run.smithi019.stdout: openjpeg2-2.4.0-7.el9.x86_64 2024-09-12T00:23:46.120 INFO:teuthology.orchestra.run.smithi019.stdout: opus-1.3.1-10.el9.x86_64 2024-09-12T00:23:46.121 INFO:teuthology.orchestra.run.smithi019.stdout: orc-0.4.31-8.el9.x86_64 2024-09-12T00:23:46.121 INFO:teuthology.orchestra.run.smithi019.stdout: osinfo-db-20240701-2.el9.noarch 2024-09-12T00:23:46.121 INFO:teuthology.orchestra.run.smithi019.stdout: osinfo-db-tools-1.10.0-1.el9.x86_64 2024-09-12T00:23:46.121 INFO:teuthology.orchestra.run.smithi019.stdout: ostree-libs-2024.7-2.el9.x86_64 2024-09-12T00:23:46.121 INFO:teuthology.orchestra.run.smithi019.stdout: p11-kit-server-0.25.3-2.el9.x86_64 2024-09-12T00:23:46.121 INFO:teuthology.orchestra.run.smithi019.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-12T00:23:46.122 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire-1.0.1-1.el9.x86_64 2024-09-12T00:23:46.122 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire-alsa-1.0.1-1.el9.x86_64 2024-09-12T00:23:46.122 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire-jack-audio-connection-kit-1.0.1-1.el9.x86_64 2024-09-12T00:23:46.122 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire-jack-audio-connection-kit-libs-1.0.1-1.el9.x86_64 2024-09-12T00:23:46.122 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire-libs-1.0.1-1.el9.x86_64 2024-09-12T00:23:46.122 INFO:teuthology.orchestra.run.smithi019.stdout: pipewire-pulseaudio-1.0.1-1.el9.x86_64 2024-09-12T00:23:46.123 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-cipher-1.7-27.el9.noarch 2024-09-12T00:23:46.123 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-classworlds-2.6.0-11.el9.noarch 2024-09-12T00:23:46.123 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-containers-component-annotations-2.1.0-10.el9.noarch 2024-09-12T00:23:46.123 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-interpolation-1.26-11.el9.noarch 2024-09-12T00:23:46.123 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-sec-dispatcher-1.4-37.el9.noarch 2024-09-12T00:23:46.123 INFO:teuthology.orchestra.run.smithi019.stdout: plexus-utils-3.3.0-10.el9.noarch 2024-09-12T00:23:46.124 INFO:teuthology.orchestra.run.smithi019.stdout: poppler-21.01.0-21.el9.x86_64 2024-09-12T00:23:46.124 INFO:teuthology.orchestra.run.smithi019.stdout: poppler-data-0.4.9-9.el9.noarch 2024-09-12T00:23:46.124 INFO:teuthology.orchestra.run.smithi019.stdout: poppler-glib-21.01.0-21.el9.x86_64 2024-09-12T00:23:46.124 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-12T00:23:46.124 INFO:teuthology.orchestra.run.smithi019.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-12T00:23:46.125 INFO:teuthology.orchestra.run.smithi019.stdout: publicsuffix-list-20210518-3.el9.noarch 2024-09-12T00:23:46.125 INFO:teuthology.orchestra.run.smithi019.stdout: pulseaudio-libs-15.0-2.el9.x86_64 2024-09-12T00:23:46.125 INFO:teuthology.orchestra.run.smithi019.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-12T00:23:46.125 INFO:teuthology.orchestra.run.smithi019.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-12T00:23:46.125 INFO:teuthology.orchestra.run.smithi019.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-12T00:23:46.125 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-12T00:23:46.126 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-argparse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.126 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ceph-common-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.126 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cephfs-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.126 INFO:teuthology.orchestra.run.smithi019.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-12T00:23:46.126 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-12T00:23:46.127 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-12T00:23:46.127 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-12T00:23:46.127 INFO:teuthology.orchestra.run.smithi019.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-12T00:23:46.127 INFO:teuthology.orchestra.run.smithi019.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-12T00:23:46.127 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-12T00:23:46.128 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-12T00:23:46.128 INFO:teuthology.orchestra.run.smithi019.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-12T00:23:46.128 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-12T00:23:46.128 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-12T00:23:46.128 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-12T00:23:46.128 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-12T00:23:46.128 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-12T00:23:46.129 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-12T00:23:46.129 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-12T00:23:46.129 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-12T00:23:46.129 INFO:teuthology.orchestra.run.smithi019.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-12T00:23:46.129 INFO:teuthology.orchestra.run.smithi019.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-12T00:23:46.129 INFO:teuthology.orchestra.run.smithi019.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-12T00:23:46.130 INFO:teuthology.orchestra.run.smithi019.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-12T00:23:46.130 INFO:teuthology.orchestra.run.smithi019.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-12T00:23:46.130 INFO:teuthology.orchestra.run.smithi019.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-12T00:23:46.130 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-12T00:23:46.130 INFO:teuthology.orchestra.run.smithi019.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-12T00:23:46.130 INFO:teuthology.orchestra.run.smithi019.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-12T00:23:46.130 INFO:teuthology.orchestra.run.smithi019.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-ply-3.11-14.el9.noarch 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rados-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.131 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.132 INFO:teuthology.orchestra.run.smithi019.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-12T00:23:46.132 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-12T00:23:46.132 INFO:teuthology.orchestra.run.smithi019.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-12T00:23:46.132 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rgw-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.132 INFO:teuthology.orchestra.run.smithi019.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-12T00:23:46.132 INFO:teuthology.orchestra.run.smithi019.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-12T00:23:46.132 INFO:teuthology.orchestra.run.smithi019.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-12T00:23:46.132 INFO:teuthology.orchestra.run.smithi019.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-12T00:23:46.132 INFO:teuthology.orchestra.run.smithi019.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-fuse-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-mirror-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: rbd-nbd-2:19.3.0-4753.gd011c522.el9.x86_64 2024-09-12T00:23:46.133 INFO:teuthology.orchestra.run.smithi019.stdout: re2-1:20211101-20.el9.x86_64 2024-09-12T00:23:46.134 INFO:teuthology.orchestra.run.smithi019.stdout: rtkit-0.11-29.el9.x86_64 2024-09-12T00:23:46.134 INFO:teuthology.orchestra.run.smithi019.stdout: s3cmd-2.4.0-1.el9.noarch 2024-09-12T00:23:46.134 INFO:teuthology.orchestra.run.smithi019.stdout: sisu-1:0.3.4-10.el9.noarch 2024-09-12T00:23:46.134 INFO:teuthology.orchestra.run.smithi019.stdout: slf4j-1.7.30-13.el9.noarch 2024-09-12T00:23:46.134 INFO:teuthology.orchestra.run.smithi019.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-12T00:23:46.134 INFO:teuthology.orchestra.run.smithi019.stdout: sound-theme-freedesktop-0.8-17.el9.noarch 2024-09-12T00:23:46.134 INFO:teuthology.orchestra.run.smithi019.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-12T00:23:46.134 INFO:teuthology.orchestra.run.smithi019.stdout: totem-pl-parser-3.26.6-2.el9.x86_64 2024-09-12T00:23:46.134 INFO:teuthology.orchestra.run.smithi019.stdout: tracker-3.1.2-3.el9.x86_64 2024-09-12T00:23:46.134 INFO:teuthology.orchestra.run.smithi019.stdout: tracker-miners-3.1.2-4.el9.x86_64 2024-09-12T00:23:46.134 INFO:teuthology.orchestra.run.smithi019.stdout: ttmkfdir-3.0.9-65.el9.x86_64 2024-09-12T00:23:46.135 INFO:teuthology.orchestra.run.smithi019.stdout: tzdata-java-2024a-2.el9.noarch 2024-09-12T00:23:46.135 INFO:teuthology.orchestra.run.smithi019.stdout: upower-0.99.11-11.el9.x86_64 2024-09-12T00:23:46.135 INFO:teuthology.orchestra.run.smithi019.stdout: webrtc-audio-processing-0.3.1-8.el9.x86_64 2024-09-12T00:23:46.135 INFO:teuthology.orchestra.run.smithi019.stdout: wireplumber-0.4.14-1.el9.x86_64 2024-09-12T00:23:46.135 INFO:teuthology.orchestra.run.smithi019.stdout: wireplumber-libs-0.4.14-1.el9.x86_64 2024-09-12T00:23:46.135 INFO:teuthology.orchestra.run.smithi019.stdout: xdg-dbus-proxy-0.1.3-1.el9.x86_64 2024-09-12T00:23:46.135 INFO:teuthology.orchestra.run.smithi019.stdout: xdg-desktop-portal-1.12.6-1.el9.x86_64 2024-09-12T00:23:46.135 INFO:teuthology.orchestra.run.smithi019.stdout: xdg-desktop-portal-gtk-1.12.0-3.el9.x86_64 2024-09-12T00:23:46.135 INFO:teuthology.orchestra.run.smithi019.stdout: xkeyboard-config-2.33-2.el9.noarch 2024-09-12T00:23:46.135 INFO:teuthology.orchestra.run.smithi019.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-12T00:23:46.136 INFO:teuthology.orchestra.run.smithi019.stdout: xorg-x11-fonts-Type1-7.5-33.el9.noarch 2024-09-12T00:23:46.136 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:46.136 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-12T00:23:46.500 DEBUG:teuthology.parallel:result is None 2024-09-12T00:23:46.501 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:23:46.661 DEBUG:teuthology.orchestra.run.smithi019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:23:46.729 INFO:teuthology.orchestra.run.smithi019.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:23:46.729 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:23:46.730 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:23:46.732 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:23:46.886 DEBUG:teuthology.orchestra.run.smithi135:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-12T00:23:46.960 INFO:teuthology.orchestra.run.smithi135.stdout:19.3.0-4753.gd011c522.el9 2024-09-12T00:23:46.960 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753.gd011c522.el9 2024-09-12T00:23:46.960 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753.gd011c522 is installed. 2024-09-12T00:23:46.962 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:23:46.963 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:23:46.963 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:23:47.008 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:23:47.008 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:23:47.053 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:23:47.053 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:23:47.053 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:23:47.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:23:47.175 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:23:47.175 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:23:47.216 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:23:47.295 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:23:47.295 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:23:47.296 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:23:47.336 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:23:47.417 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:23:47.417 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:23:47.459 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:23:47.538 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:23:47.538 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:23:47.538 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:23:47.578 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:23:47.661 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:23:47.662 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:23:47.700 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:23:47.779 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:23:47.872 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:23:47.872 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 777 /var/log/ceph 2024-09-12T00:23:47.875 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 777 /var/log/ceph 2024-09-12T00:23:47.913 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:23:47.914 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:23:47.957 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:23:47.996 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:23:47.996 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:23:48.036 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:23:48.100 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:23:48.100 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:23:48.100 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind}', 'email': None, 'first_in_suite': False, 'job_id': '7901860', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon osd crush smoke test': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'openssl_keys': {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}}, 'rgw': {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}, 'compression type': 'random', 'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi019.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHoKEHhfw8r/gbnjfI7a1eic3Ug1vlI1vqWyDDJIZfswlkfJMmEOlrIUbmGyzDbRVpMvxnnTdB5OhSe3LkTidKw=', 'smithi135.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNfb1jbjg0l38XTh5CYhs8QMCXCxqGN7lz6ahaYmtwXLlMwTeGcP3Bsj1ddSFCs38LnvRXTlG+DsEcoGZNBWdkQ='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:23:48.101 DEBUG:teuthology.orchestra.run.smithi019:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:23:48.117 DEBUG:teuthology.orchestra.run.smithi135:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:23:48.146 DEBUG:teuthology.orchestra.run.smithi019:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:23:48.187 DEBUG:teuthology.orchestra.run.smithi135:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:23:48.226 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:23:48.227 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:23:48.295 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:23:48.295 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_1 2024-09-12T00:23:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:23:48.366 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:23:48.366 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-12T00:23:48.366 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:23:48.366 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:23:48.366 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 00:23:33.643899871 +0000 2024-09-12T00:23:48.367 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 00:21:07.642848092 +0000 2024-09-12T00:23:48.367 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 00:21:07.642848092 +0000 2024-09-12T00:23:48.367 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-12 00:21:07.642848092 +0000 2024-09-12T00:23:48.367 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:23:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T00:23:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T00:23:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000262575 s, 1.9 MB/s 2024-09-12T00:23:48.446 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:23:48.517 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_2 2024-09-12T00:23:48.587 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:23:48.587 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:23:48.587 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-12T00:23:48.587 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:23:48.587 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:23:48.587 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 00:23:33.643899871 +0000 2024-09-12T00:23:48.587 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 00:21:07.984844680 +0000 2024-09-12T00:23:48.588 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 00:21:07.984844680 +0000 2024-09-12T00:23:48.588 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-12 00:21:07.984844680 +0000 2024-09-12T00:23:48.588 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:23:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T00:23:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T00:23:48.665 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000193443 s, 2.6 MB/s 2024-09-12T00:23:48.666 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:23:48.737 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_3 2024-09-12T00:23:48.807 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:23:48.807 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:23:48.807 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T00:23:48.807 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:23:48.808 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:23:48.808 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 00:23:33.644899861 +0000 2024-09-12T00:23:48.808 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 00:21:08.322841308 +0000 2024-09-12T00:23:48.808 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 00:21:08.322841308 +0000 2024-09-12T00:23:48.808 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-12 00:21:08.322841308 +0000 2024-09-12T00:23:48.808 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:23:48.886 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T00:23:48.886 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T00:23:48.886 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.00018292 s, 2.8 MB/s 2024-09-12T00:23:48.887 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:23:48.957 DEBUG:teuthology.orchestra.run.smithi019:> stat /dev/vg_nvme/lv_4 2024-09-12T00:23:49.027 INFO:teuthology.orchestra.run.smithi019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:23:49.028 INFO:teuthology.orchestra.run.smithi019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:23:49.028 INFO:teuthology.orchestra.run.smithi019.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-12T00:23:49.028 INFO:teuthology.orchestra.run.smithi019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:23:49.028 INFO:teuthology.orchestra.run.smithi019.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:23:49.028 INFO:teuthology.orchestra.run.smithi019.stdout:Access: 2024-09-12 00:23:33.644899861 +0000 2024-09-12T00:23:49.028 INFO:teuthology.orchestra.run.smithi019.stdout:Modify: 2024-09-12 00:21:08.641838126 +0000 2024-09-12T00:23:49.028 INFO:teuthology.orchestra.run.smithi019.stdout:Change: 2024-09-12 00:21:08.641838126 +0000 2024-09-12T00:23:49.028 INFO:teuthology.orchestra.run.smithi019.stdout: Birth: 2024-09-12 00:21:08.641838126 +0000 2024-09-12T00:23:49.028 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:23:49.106 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records in 2024-09-12T00:23:49.106 INFO:teuthology.orchestra.run.smithi019.stderr:1+0 records out 2024-09-12T00:23:49.106 INFO:teuthology.orchestra.run.smithi019.stderr:512 bytes copied, 0.000202004 s, 2.5 MB/s 2024-09-12T00:23:49.107 DEBUG:teuthology.orchestra.run.smithi019:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:23:49.178 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:23:49.178 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:23:49.178 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:23:49.213 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:23:49.213 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_1 2024-09-12T00:23:49.286 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:23:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:23:49.287 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-12T00:23:49.287 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:23:49.287 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:23:49.287 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-12 00:23:27.931831867 +0000 2024-09-12T00:23:49.287 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-12 00:21:04.229317252 +0000 2024-09-12T00:23:49.287 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-12 00:21:04.229317252 +0000 2024-09-12T00:23:49.287 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-12 00:21:04.229317252 +0000 2024-09-12T00:23:49.287 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:23:49.365 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T00:23:49.365 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T00:23:49.366 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000195654 s, 2.6 MB/s 2024-09-12T00:23:49.367 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:23:49.438 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_2 2024-09-12T00:23:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:23:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:23:49.509 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-12T00:23:49.509 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:23:49.509 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:23:49.509 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-12 00:23:27.932831845 +0000 2024-09-12T00:23:49.509 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-12 00:21:04.563309903 +0000 2024-09-12T00:23:49.509 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-12 00:21:04.563309903 +0000 2024-09-12T00:23:49.509 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-12 00:21:04.563309903 +0000 2024-09-12T00:23:49.510 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:23:49.586 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T00:23:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T00:23:49.587 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000207811 s, 2.5 MB/s 2024-09-12T00:23:49.588 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:23:49.658 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_3 2024-09-12T00:23:49.726 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:23:49.726 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:23:49.726 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-12T00:23:49.726 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:23:49.727 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:23:49.727 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-12 00:23:27.933831823 +0000 2024-09-12T00:23:49.727 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-12 00:21:04.901302466 +0000 2024-09-12T00:23:49.727 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-12 00:21:04.901302466 +0000 2024-09-12T00:23:49.727 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-12 00:21:04.901302466 +0000 2024-09-12T00:23:49.727 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:23:49.803 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T00:23:49.803 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T00:23:49.803 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000190127 s, 2.7 MB/s 2024-09-12T00:23:49.804 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:23:49.874 DEBUG:teuthology.orchestra.run.smithi135:> stat /dev/vg_nvme/lv_4 2024-09-12T00:23:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:23:49.943 INFO:teuthology.orchestra.run.smithi135.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:23:49.943 INFO:teuthology.orchestra.run.smithi135.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-12T00:23:49.943 INFO:teuthology.orchestra.run.smithi135.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:23:49.944 INFO:teuthology.orchestra.run.smithi135.stdout:Context: system_u:object_r:device_t:s0 2024-09-12T00:23:49.944 INFO:teuthology.orchestra.run.smithi135.stdout:Access: 2024-09-12 00:23:27.933831823 +0000 2024-09-12T00:23:49.944 INFO:teuthology.orchestra.run.smithi135.stdout:Modify: 2024-09-12 00:21:05.244294919 +0000 2024-09-12T00:23:49.944 INFO:teuthology.orchestra.run.smithi135.stdout:Change: 2024-09-12 00:21:05.244294919 +0000 2024-09-12T00:23:49.944 INFO:teuthology.orchestra.run.smithi135.stdout: Birth: 2024-09-12 00:21:05.244294919 +0000 2024-09-12T00:23:49.944 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:23:50.020 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records in 2024-09-12T00:23:50.020 INFO:teuthology.orchestra.run.smithi135.stderr:1+0 records out 2024-09-12T00:23:50.020 INFO:teuthology.orchestra.run.smithi135.stderr:512 bytes copied, 0.000223852 s, 2.3 MB/s 2024-09-12T00:23:50.021 DEBUG:teuthology.orchestra.run.smithi135:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:23:50.090 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:23:50.091 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:23:50.091 INFO:tasks.ceph:Generating config... 2024-09-12T00:23:50.092 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:23:50.092 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:23:50.092 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:23:50.092 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:23:50.092 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:23:50.092 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:23:50.092 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:23:50.092 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:23:50.093 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:23:50.093 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:23:50.093 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:23:50.093 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:23:50.093 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:23:50.093 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:23:50.093 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:23:50.093 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2024-09-12T00:23:50.093 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:23:50.093 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:23:50.093 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:23:50.093 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:23:50.093 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:23:50.093 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:23:50.093 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:23:50.094 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2024-09-12T00:23:50.094 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:23:50.094 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:23:50.094 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:23:50.094 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:23:50.094 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:23:50.094 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:23:50.094 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:23:50.094 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:23:50.094 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:23:50.094 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:23:50.095 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:23:50.095 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:23:50.095 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:23:50.095 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:23:50.095 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:23:50.095 INFO:tasks.ceph:[osd] osd fast shutdown = False 2024-09-12T00:23:50.095 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:23:50.095 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:23:50.095 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:23:50.095 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:23:50.170 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:23:50.173 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:23:50.236 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:23:50.276 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.19'), ('mon.c', '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]'), ('mon.b', '172.21.15.135')] 2024-09-12T00:23:50.277 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],172.21.15.135', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd heartbeat grace': 40, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd fast shutdown': False, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon osd crush smoke test': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:23:50.278 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:23:50.278 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:23:50.346 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.19 --addv c '[v2:172.21.15.19:3301,v1:172.21.15.19:6790]' --add b 172.21.15.135 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:23:50.447 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:50.447 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:50.448 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:23:50.448 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: generated fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:23:50.448 INFO:teuthology.orchestra.run.smithi019.stdout:setting min_mon_release = quincy 2024-09-12T00:23:50.448 INFO:teuthology.orchestra.run.smithi019.stdout:epoch 0 2024-09-12T00:23:50.448 INFO:teuthology.orchestra.run.smithi019.stdout:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:23:50.449 INFO:teuthology.orchestra.run.smithi019.stdout:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:23:50.449 INFO:teuthology.orchestra.run.smithi019.stdout:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:23:50.449 INFO:teuthology.orchestra.run.smithi019.stdout:min_mon_release 17 (quincy) 2024-09-12T00:23:50.449 INFO:teuthology.orchestra.run.smithi019.stdout:election_strategy: 1 2024-09-12T00:23:50.449 INFO:teuthology.orchestra.run.smithi019.stdout:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:23:50.449 INFO:teuthology.orchestra.run.smithi019.stdout:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:23:50.449 INFO:teuthology.orchestra.run.smithi019.stdout:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:23:50.449 INFO:teuthology.orchestra.run.smithi019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:23:50.450 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:23:50.479 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID aacb94df-c940-42c4-9df9-171d09a84719... 2024-09-12T00:23:50.480 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:23:50.522 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:23:50.579 INFO:teuthology.orchestra.run.smithi019.stdout:[global] 2024-09-12T00:23:50.579 INFO:teuthology.orchestra.run.smithi019.stdout: chdir = "" 2024-09-12T00:23:50.579 INFO:teuthology.orchestra.run.smithi019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:23:50.579 INFO:teuthology.orchestra.run.smithi019.stdout: auth supported = cephx 2024-09-12T00:23:50.579 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.579 INFO:teuthology.orchestra.run.smithi019.stdout: filestore xattr use omap = true 2024-09-12T00:23:50.579 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.579 INFO:teuthology.orchestra.run.smithi019.stdout: mon clock drift allowed = 1.000 2024-09-12T00:23:50.579 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: osd crush chooseleaf type = 0 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: auth debug = true 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on old message = true 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: ms die on bug = true 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: mon pg warn max object skew = 0 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:23:50.580 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default size = 2 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow primary affinity = true 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd allow pg remap = true 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on no sortbitwise = false 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: mon warn on too few osds = false 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:23:50.581 INFO:teuthology.orchestra.run.smithi019.stdout: mon_allow_pool_size_one = true 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: osd default data pool replay window = 5 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: mon allow pool delete = true 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: mon cluster log file level = debug 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: debug asserts on shutdown = true 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: mon health detail to clog = false 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],172.21.15.135" 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: mon client directed command retry = 5 2024-09-12T00:23:50.582 INFO:teuthology.orchestra.run.smithi019.stdout: ms inject socket failures = 5000 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: osd heartbeat grace = 40 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: fsid = aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout:[osd] 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: osd journal size = 100 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub load threshold = 5.0 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: osd scrub max interval = 600 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.583 INFO:teuthology.orchestra.run.smithi019.stdout: osd recover clone overlap = true 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: osd recovery max chunk = 1048576 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug shutdown = true 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug op order = true 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug verify stray on activate = true 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug trim objects = true 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: osd open classes on start = true 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug pg log writeout = true 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.584 INFO:teuthology.orchestra.run.smithi019.stdout: osd map max advance = 10 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: journal zero on create = true 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: filestore apply finisher threads = 3 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: bdev debug aio = true 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: osd debug misdirected ops = true 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: bdev async discard = True 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: bdev enable discard = True 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore allocator = bitmap 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore block size = 96636764160 2024-09-12T00:23:50.585 INFO:teuthology.orchestra.run.smithi019.stdout: bluestore fsck on mount = True 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluefs = 1/20 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: debug bluestore = 1/20 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: debug objclass = 20 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: debug osd = 20 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: debug rocksdb = 4/10 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd full ratio = 0.9 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: osd fast shutdown = False 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: osd objectstore = bluestore 2024-09-12T00:23:50.586 INFO:teuthology.orchestra.run.smithi019.stdout: osd shutdown pgref assert = True 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr] 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout: debug mgr = 20 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout: mgr/telemetry/nag = false 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout:[mon] 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout: debug ms = 1 2024-09-12T00:23:50.587 INFO:teuthology.orchestra.run.smithi019.stdout: debug mon = 20 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: debug paxos = 20 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: debug auth = 20 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: mon data avail warn = 5 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: mon mgr mkfs grace = 240 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd reporter subtree level = osd 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd prime pg temp = true 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:23:50.588 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout: # 1m isn't quite enough 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout: mon osd crush smoke test = False 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout:[client] 2024-09-12T00:23:50.589 INFO:teuthology.orchestra.run.smithi019.stdout: rgw cache enabled = true 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable ops log = true 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: rgw enable usage log = true 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: debug rgw = 20 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: debug rgw notification = 20 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: rgw bucket counters cache = True 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: rgw crypt require ssl = False 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: rgw s3 auth use sts = True 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:23:50.590 INFO:teuthology.orchestra.run.smithi019.stdout: rgw torrent flag = True 2024-09-12T00:23:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: rgw user counters cache = True 2024-09-12T00:23:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: setgroup = ceph 2024-09-12T00:23:50.591 INFO:teuthology.orchestra.run.smithi019.stdout: setuser = ceph 2024-09-12T00:23:50.591 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.a] 2024-09-12T00:23:50.591 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.c] 2024-09-12T00:23:50.591 INFO:teuthology.orchestra.run.smithi019.stdout:[mon.b] 2024-09-12T00:23:50.591 INFO:teuthology.orchestra.run.smithi135.stdout:[global] 2024-09-12T00:23:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: chdir = "" 2024-09-12T00:23:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:23:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: auth supported = cephx 2024-09-12T00:23:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: filestore xattr use omap = true 2024-09-12T00:23:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: mon clock drift allowed = 1.000 2024-09-12T00:23:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: osd crush chooseleaf type = 0 2024-09-12T00:23:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: auth debug = true 2024-09-12T00:23:50.592 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on old message = true 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: ms die on bug = true 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: mon pg warn max object skew = 0 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default size = 2 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.593 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow primary affinity = true 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd allow pg remap = true 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on no sortbitwise = false 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: mon warn on too few osds = false 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: mon_allow_pool_size_one = true 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.594 INFO:teuthology.orchestra.run.smithi135.stdout: osd default data pool replay window = 5 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: mon allow pool delete = true 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: mon cluster log file level = debug 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: debug asserts on shutdown = true 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: mon health detail to clog = false 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: mon host = "172.21.15.19,[v2:172.21.15.19:3301,v1:172.21.15.19:6790],172.21.15.135" 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: mon client directed command retry = 5 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: ms inject socket failures = 5000 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: osd heartbeat grace = 40 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:23:50.595 INFO:teuthology.orchestra.run.smithi135.stdout: fsid = aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout:[osd] 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: osd journal size = 100 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub load threshold = 5.0 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: osd scrub max interval = 600 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: osd recover clone overlap = true 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: osd recovery max chunk = 1048576 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug shutdown = true 2024-09-12T00:23:50.596 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug op order = true 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug verify stray on activate = true 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug trim objects = true 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: osd open classes on start = true 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug pg log writeout = true 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: osd map max advance = 10 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: journal zero on create = true 2024-09-12T00:23:50.597 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: filestore apply finisher threads = 3 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: bdev debug aio = true 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: osd debug misdirected ops = true 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: bdev async discard = True 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: bdev enable discard = True 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore allocator = bitmap 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore block size = 96636764160 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: bluestore fsck on mount = True 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluefs = 1/20 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: debug bluestore = 1/20 2024-09-12T00:23:50.598 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: debug objclass = 20 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: debug osd = 20 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: debug rocksdb = 4/10 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd full ratio = 0.9 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: osd fast shutdown = False 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: osd objectstore = bluestore 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: osd shutdown pgref assert = True 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.599 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr] 2024-09-12T00:23:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-12T00:23:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: debug mgr = 20 2024-09-12T00:23:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-09-12T00:23:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-09-12T00:23:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:23:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:23:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: mgr/telemetry/nag = false 2024-09-12T00:23:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.600 INFO:teuthology.orchestra.run.smithi135.stdout:[mon] 2024-09-12T00:23:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: debug ms = 1 2024-09-12T00:23:50.600 INFO:teuthology.orchestra.run.smithi135.stdout: debug mon = 20 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: debug paxos = 20 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: debug auth = 20 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: mon data avail warn = 5 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: mon mgr mkfs grace = 240 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd reporter subtree level = osd 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd prime pg temp = true 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:23:50.601 INFO:teuthology.orchestra.run.smithi135.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: # 1m isn't quite enough 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: mon osd crush smoke test = False 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout:[client] 2024-09-12T00:23:50.602 INFO:teuthology.orchestra.run.smithi135.stdout: rgw cache enabled = true 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable ops log = true 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: rgw enable usage log = true 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: debug rgw = 20 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: debug rgw notification = 20 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: rgw bucket counters cache = True 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: rgw crypt require ssl = False 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:23:50.603 INFO:teuthology.orchestra.run.smithi135.stdout: rgw s3 auth use sts = True 2024-09-12T00:23:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:23:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: rgw torrent flag = True 2024-09-12T00:23:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: rgw user counters cache = True 2024-09-12T00:23:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: setgroup = ceph 2024-09-12T00:23:50.604 INFO:teuthology.orchestra.run.smithi135.stdout: setuser = ceph 2024-09-12T00:23:50.604 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.a] 2024-09-12T00:23:50.604 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.c] 2024-09-12T00:23:50.604 INFO:teuthology.orchestra.run.smithi135.stdout:[mon.b] 2024-09-12T00:23:50.606 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:23:50.606 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:23:50.716 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:23:50.716 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:23:50.717 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:23:50.751 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:23:50.751 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:23:50.821 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:23:50.821 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:23:50.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:23:50.821 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:23:50.912 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:23:50.912 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:23:50.981 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:23:50.981 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:23:50.982 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:23:50.982 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:23:51.032 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:23:51.032 DEBUG:teuthology.orchestra.run.smithi135:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:23:51.102 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:23:51.102 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:23:51.102 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:23:51.169 INFO:teuthology.orchestra.run.smithi019.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:23:51.172 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:23:51.242 INFO:teuthology.orchestra.run.smithi135.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:23:51.244 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:23:51.245 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:23:51.245 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:23:51.302 INFO:teuthology.orchestra.run.smithi019.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:23:51.315 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:23:51.370 INFO:teuthology.orchestra.run.smithi135.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:23:51.383 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:23:51.383 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi019.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi135.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:23:51.384 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:23:51.423 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:23:51.423 INFO:tasks.ceph:role: osd.0 2024-09-12T00:23:51.423 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:23:51.423 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:23:51.510 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:23:51.510 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:23:51.510 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:23:51.510 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:23:51.510 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:23:51.510 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:23:51.510 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:23:51.511 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:23:51.511 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:23:51.511 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:23:52.018 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T00:23:52.020 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T00:23:52.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:23:52.120 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:23:52.170 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:23:52.210 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:23:52.210 INFO:tasks.ceph:role: osd.1 2024-09-12T00:23:52.210 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:23:52.210 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:23:52.297 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:23:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:23:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:23:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:23:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:23:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:23:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:23:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:23:52.298 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:23:52.298 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:23:52.766 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T00:23:52.766 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T00:23:52.767 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:23:52.841 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:23:52.884 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:23:52.969 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:23:52.969 INFO:tasks.ceph:role: osd.2 2024-09-12T00:23:52.969 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:23:52.969 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:23:53.056 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:23:53.057 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:23:53.057 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:23:53.057 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:23:53.057 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:23:53.057 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:23:53.057 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:23:53.057 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:23:53.057 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:23:53.057 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:23:53.602 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T00:23:53.604 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T00:23:53.604 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:23:53.707 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:23:53.753 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:23:53.792 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:23:53.792 INFO:tasks.ceph:role: osd.3 2024-09-12T00:23:53.792 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:23:53.793 DEBUG:teuthology.orchestra.run.smithi019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:23:53.879 INFO:teuthology.orchestra.run.smithi019.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:23:53.880 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:23:53.880 INFO:teuthology.orchestra.run.smithi019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:23:53.880 INFO:teuthology.orchestra.run.smithi019.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:23:53.880 INFO:teuthology.orchestra.run.smithi019.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:23:53.880 INFO:teuthology.orchestra.run.smithi019.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:23:53.881 INFO:teuthology.orchestra.run.smithi019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:23:53.881 INFO:teuthology.orchestra.run.smithi019.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:23:53.881 INFO:teuthology.orchestra.run.smithi019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:23:53.881 INFO:teuthology.orchestra.run.smithi019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:23:54.389 INFO:teuthology.orchestra.run.smithi019.stdout:Discarding blocks...Done. 2024-09-12T00:23:54.392 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi019.front.sepia.ceph.com -o noatime 2024-09-12T00:23:54.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:23:54.519 DEBUG:teuthology.orchestra.run.smithi019:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:23:54.569 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:23:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:23:54.648+0000 7ff900813640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:23:54.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:23:54.649+0000 7ff900813640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:23:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:23:54.649+0000 7ff900813640 -1 bdev(0x563b0284b800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:23:54.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:23:54.649+0000 7ff900813640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:23:58.052 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:23:58.100 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:23:58.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:23:58.167+0000 7fb438ce6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:23:58.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:23:58.167+0000 7fb438ce6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:23:58.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:23:58.167+0000 7fb438ce6640 -1 bdev(0x557e40975800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:23:58.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:23:58.167+0000 7fb438ce6640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:24:01.829 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:24:01.876 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:24:01.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:24:01.942+0000 7f8f28e0f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:24:01.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:24:01.943+0000 7f8f28e0f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:24:01.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:24:01.943+0000 7f8f28e0f640 -1 bdev(0x55726f52f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:24:01.942 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:24:01.943+0000 7f8f28e0f640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:24:04.845 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:24:04.892 DEBUG:teuthology.orchestra.run.smithi019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:24:04.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:24:04.957+0000 7f7dbbe20640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:24:04.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:24:04.958+0000 7f7dbbe20640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:24:04.956 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:24:04.958+0000 7f7dbbe20640 -1 bdev(0x55b303ba9800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:24:04.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:24:04.958+0000 7f7dbbe20640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:24:08.117 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:24:08.164 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:24:08.211 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:24:08.212 INFO:tasks.ceph:role: osd.4 2024-09-12T00:24:08.212 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:24:08.212 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:24:08.261 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:24:08.261 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:24:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:24:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:24:08.262 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:24:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:24:08.262 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:24:08.262 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:24:08.262 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:24:08.262 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:24:08.755 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T00:24:08.758 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T00:24:08.759 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:24:08.855 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:24:08.902 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:24:08.942 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:24:08.942 INFO:tasks.ceph:role: osd.5 2024-09-12T00:24:08.942 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:24:08.942 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:24:09.029 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:24:09.029 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:24:09.030 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:24:09.031 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:24:09.031 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:24:09.031 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:24:09.032 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:24:09.032 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:24:09.032 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:24:09.032 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:24:09.489 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T00:24:09.492 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T00:24:09.493 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:24:09.539 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:24:09.582 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:24:09.660 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:24:09.660 INFO:tasks.ceph:role: osd.6 2024-09-12T00:24:09.660 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:24:09.660 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:24:09.746 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:24:09.746 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:24:09.747 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:24:09.747 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:24:09.747 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:24:09.747 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:24:09.747 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:24:09.747 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:24:09.747 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:24:09.747 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:24:10.233 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T00:24:10.235 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T00:24:10.235 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:24:10.306 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:24:10.349 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:24:10.428 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:24:10.428 INFO:tasks.ceph:role: osd.7 2024-09-12T00:24:10.428 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:24:10.428 DEBUG:teuthology.orchestra.run.smithi135:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:24:10.512 INFO:teuthology.orchestra.run.smithi135.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:24:10.513 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:24:10.513 INFO:teuthology.orchestra.run.smithi135.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:24:10.513 INFO:teuthology.orchestra.run.smithi135.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-12T00:24:10.513 INFO:teuthology.orchestra.run.smithi135.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:24:10.513 INFO:teuthology.orchestra.run.smithi135.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:24:10.513 INFO:teuthology.orchestra.run.smithi135.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:24:10.513 INFO:teuthology.orchestra.run.smithi135.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-12T00:24:10.513 INFO:teuthology.orchestra.run.smithi135.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:24:10.513 INFO:teuthology.orchestra.run.smithi135.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:24:11.029 INFO:teuthology.orchestra.run.smithi135.stdout:Discarding blocks...Done. 2024-09-12T00:24:11.032 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi135.front.sepia.ceph.com -o noatime 2024-09-12T00:24:11.032 DEBUG:teuthology.orchestra.run.smithi135:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:24:11.146 DEBUG:teuthology.orchestra.run.smithi135:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:24:11.196 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:24:11.260 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:11.261+0000 7f62bb20b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:24:11.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:11.263+0000 7f62bb20b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:24:11.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:11.263+0000 7f62bb20b640 -1 bdev(0x557be3587800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:24:11.262 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:11.263+0000 7f62bb20b640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:24:14.182 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:24:14.225 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:24:14.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:14.328+0000 7f9461ae6640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:24:14.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:14.328+0000 7f9461ae6640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:24:14.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:14.329+0000 7f9461ae6640 -1 bdev(0x556e1ba05800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:24:14.327 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:14.329+0000 7f9461ae6640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:24:17.237 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:24:17.279 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:24:17.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:17.383+0000 7f7e082ef640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:24:17.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:17.383+0000 7f7e082ef640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:24:17.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:17.383+0000 7f7e082ef640 -1 bdev(0x55fde9639800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:24:17.382 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:17.383+0000 7f7e082ef640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:24:20.793 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:24:20.832 DEBUG:teuthology.orchestra.run.smithi135:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:24:20.932 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:20.933+0000 7f371a00d640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:24:20.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:20.934+0000 7f371a00d640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:24:20.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:20.934+0000 7f371a00d640 -1 bdev(0x5562c7da7800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:24:20.933 INFO:teuthology.orchestra.run.smithi135.stderr:2024-09-12T00:24:20.934+0000 7f371a00d640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:24:23.839 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:24:23.878 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:24:23.878 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:24:23.878 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:24:23.926 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:24:23.926 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:24:24.011 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:24:24.011 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:24:24.094 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:24:24.094 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:24:24.175 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:24:24.176 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:24:24.255 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:24:24.255 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:24:24.295 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:24:24.295 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:24:24.373 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:24:24.373 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:24:24.452 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:24:24.452 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:24:24.531 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:24:24.532 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:24:24.609 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:24:24.609 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:24:24.640 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:24:24.640 DEBUG:teuthology.orchestra.run.smithi135:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:24:24.679 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:24:24.679 DEBUG:teuthology.orchestra.run.smithi019:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:24:24.682 DEBUG:teuthology.orchestra.run.smithi135:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.y] 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCXNOJmwS1CChAA6jPkG7yE7z6eHfBzu61rxQ== 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.0] 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCaNOJmIxHIJhAAS0ZFsHBZ14ayvkhSZi2ZUQ== 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.1] 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCeNOJmsXcCChAA23V4+KZ7oKV6gAgEEnPiJA== 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.2] 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQChNOJmlcM9OBAAARanSeMlXMS6KLTeVGne9g== 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.3] 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCkNOJmScQhORAAyBreHnuAtYul7zLKDR0tMw== 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout:[mgr.x] 2024-09-12T00:24:24.723 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCXNOJmxdmWDhAAcBYkZL3eCDEJ43GXzmb1zw== 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.4] 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCrNOJmisKnDxAABA1wadJCsn3sv/HCpmT75A== 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.5] 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCuNOJmv2OlExAAvwOo56XI6tYr4A23kf2C1g== 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.6] 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCxNOJmkKHqFhAAPLT48HpUOUPUtzEuWk62UA== 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout:[osd.7] 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQC0NOJm0Ai4NxAAhxXSh1wXnegHRtnACukuSA== 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout:[client.0] 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCXNOJm2KgpEhAA1kzH8NP7Sc68AXkHQxcSqw== 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout:[client.1] 2024-09-12T00:24:24.724 INFO:teuthology.orchestra.run.smithi019.stdout: key = AQCXNOJm3aM4FhAAe4K0s5G46FTVa0RacwISDg== 2024-09-12T00:24:24.757 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.y] 2024-09-12T00:24:24.757 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCXNOJmwS1CChAA6jPkG7yE7z6eHfBzu61rxQ== 2024-09-12T00:24:24.757 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.0] 2024-09-12T00:24:24.757 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCaNOJmIxHIJhAAS0ZFsHBZ14ayvkhSZi2ZUQ== 2024-09-12T00:24:24.757 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.1] 2024-09-12T00:24:24.757 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCeNOJmsXcCChAA23V4+KZ7oKV6gAgEEnPiJA== 2024-09-12T00:24:24.757 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.2] 2024-09-12T00:24:24.757 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQChNOJmlcM9OBAAARanSeMlXMS6KLTeVGne9g== 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.3] 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCkNOJmScQhORAAyBreHnuAtYul7zLKDR0tMw== 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:[mgr.x] 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCXNOJmxdmWDhAAcBYkZL3eCDEJ43GXzmb1zw== 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.4] 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCrNOJmisKnDxAABA1wadJCsn3sv/HCpmT75A== 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.5] 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCuNOJmv2OlExAAvwOo56XI6tYr4A23kf2C1g== 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.6] 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCxNOJmkKHqFhAAPLT48HpUOUPUtzEuWk62UA== 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout:[osd.7] 2024-09-12T00:24:24.758 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQC0NOJm0Ai4NxAAhxXSh1wXnegHRtnACukuSA== 2024-09-12T00:24:24.759 INFO:teuthology.orchestra.run.smithi135.stdout:[client.0] 2024-09-12T00:24:24.759 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCXNOJm2KgpEhAA1kzH8NP7Sc68AXkHQxcSqw== 2024-09-12T00:24:24.759 INFO:teuthology.orchestra.run.smithi135.stdout:[client.1] 2024-09-12T00:24:24.759 INFO:teuthology.orchestra.run.smithi135.stdout: key = AQCXNOJm3aM4FhAAe4K0s5G46FTVa0RacwISDg== 2024-09-12T00:24:24.760 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:24:24.767 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:24:24.865 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:24.867 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:24.933 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:24.936 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.000 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.003 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.069 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.072 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.136 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:24:25.138 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:24:25.203 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.206 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.272 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.338 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.341 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.406 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.408 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:24:25.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:24:25.475 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:24:25.543 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:24:25.545 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:24:25.613 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:24:25.613 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:24:25.653 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:24:25.764 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:24:25.804 DEBUG:teuthology.orchestra.run.smithi019:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:24:25.883 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:24:25.996 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:24:26.036 DEBUG:teuthology.orchestra.run.smithi135:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:24:26.075 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:24:26.184 DEBUG:teuthology.orchestra.run.smithi135:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:24:26.222 DEBUG:teuthology.orchestra.run.smithi019:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:24:26.225 DEBUG:teuthology.orchestra.run.smithi135:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:24:26.292 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:24:26.292 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:24:26.292 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:24:26.295 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:24:26.295 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:24:26.295 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:24:26.297 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:24:26.298 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:24:26.298 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:24:26.335 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:24:26.335 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:24:26.336 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:24:26.336 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:24:26.338 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:24:26.338 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:24:26.339 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:24:26.340 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:24:26.340 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:24:26.341 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:24:26.341 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:24:26.716 INFO:teuthology.orchestra.run.smithi019.stderr:adjusted tunables profile to default 2024-09-12T00:24:26.728 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:24:26.728 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:24:26.728 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:24:26.728 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:24:26.767 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:24:26.768 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:24:26.848 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:24:26.849 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:24:26.928 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:24:26.928 DEBUG:teuthology.orchestra.run.smithi019:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:24:27.009 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:24:27.009 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:24:27.049 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:24:27.049 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:24:27.128 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:24:27.129 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:24:27.211 DEBUG:teuthology.orchestra.run.smithi135:> set -ex 2024-09-12T00:24:27.211 DEBUG:teuthology.orchestra.run.smithi135:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:24:27.292 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 77c13442-d11f-4e3f-868c-505b5cf8df46 0 2024-09-12T00:24:27.526 INFO:teuthology.orchestra.run.smithi135.stdout:0 2024-09-12T00:24:27.538 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new ca603641-3174-4ed3-b0fd-d44e57874366 1 2024-09-12T00:24:27.736 INFO:teuthology.orchestra.run.smithi135.stdout:1 2024-09-12T00:24:27.748 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 8e067835-c65a-4149-926f-e1eb237e089a 2 2024-09-12T00:24:27.945 INFO:teuthology.orchestra.run.smithi135.stdout:2 2024-09-12T00:24:27.956 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 1f0803eb-011d-4af9-867b-dd6dddd1b729 3 2024-09-12T00:24:28.155 INFO:teuthology.orchestra.run.smithi135.stdout:3 2024-09-12T00:24:28.168 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 144aeca4-2bde-407e-8074-3175188171fa 4 2024-09-12T00:24:28.367 INFO:teuthology.orchestra.run.smithi135.stdout:4 2024-09-12T00:24:28.378 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 8fece5b1-bbfa-4083-9c22-d379c92bf125 5 2024-09-12T00:24:28.589 INFO:teuthology.orchestra.run.smithi135.stdout:5 2024-09-12T00:24:28.601 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new d15eb2dc-5b0f-4f9b-9d99-947ffb65caf3 6 2024-09-12T00:24:28.794 INFO:teuthology.orchestra.run.smithi135.stdout:6 2024-09-12T00:24:28.805 DEBUG:teuthology.orchestra.run.smithi135:> sudo ceph --cluster ceph osd new 4c832964-8b83-46ac-9c23-fc3888c2fdab 7 2024-09-12T00:24:29.002 INFO:teuthology.orchestra.run.smithi135.stdout:7 2024-09-12T00:24:29.013 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:24:29.017 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:24:29.020 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:24:29.020 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:24:29.020 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:24:29.023 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:24:29.024 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:24:29.024 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:24:29.027 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:24:29.027 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:24:29.028 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:24:29.030 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:24:29.030 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:24:29.031 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:24:29.033 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:24:29.034 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:24:29.034 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:24:29.037 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:24:29.037 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:24:29.037 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:24:29.040 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:24:29.041 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:24:29.041 DEBUG:teuthology.orchestra.run.smithi135:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:24:29.044 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:24:29.045 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:24:29.269 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:24:29.270 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":10,"fsid":"aacb94df-c940-42c4-9df9-171d09a84719","created":"2024-09-12T00:24:26.611771+0000","modified":"2024-09-12T00:24:28.999488+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:24:28.999488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77c13442-d11f-4e3f-868c-505b5cf8df46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ca603641-3174-4ed3-b0fd-d44e57874366","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e067835-c65a-4149-926f-e1eb237e089a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1f0803eb-011d-4af9-867b-dd6dddd1b729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"144aeca4-2bde-407e-8074-3175188171fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8fece5b1-bbfa-4083-9c22-d379c92bf125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d15eb2dc-5b0f-4f9b-9d99-947ffb65caf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4c832964-8b83-46ac-9c23-fc3888c2fdab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:24:29.280 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:24:29.281 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:24:30.088 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:24:30.245 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:24:30.245+0000 7f27ed264640 -1 Falling back to public interface 2024-09-12T00:24:30.246 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:24:30.246+0000 7f3ae7417640 -1 Falling back to public interface 2024-09-12T00:24:30.246 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:24:30.246+0000 7f3ae5e21640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6804/0: (98) Address already in use 2024-09-12T00:24:30.272 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T00:24:30.273 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":10,"fsid":"aacb94df-c940-42c4-9df9-171d09a84719","created":"2024-09-12T00:24:26.611771+0000","modified":"2024-09-12T00:24:28.999488+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:24:28.999488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77c13442-d11f-4e3f-868c-505b5cf8df46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ca603641-3174-4ed3-b0fd-d44e57874366","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e067835-c65a-4149-926f-e1eb237e089a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1f0803eb-011d-4af9-867b-dd6dddd1b729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"144aeca4-2bde-407e-8074-3175188171fa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"8fece5b1-bbfa-4083-9c22-d379c92bf125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d15eb2dc-5b0f-4f9b-9d99-947ffb65caf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4c832964-8b83-46ac-9c23-fc3888c2fdab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:24:30.274 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:24:30.276+0000 7f0db4c15640 -1 Falling back to public interface 2024-09-12T00:24:30.279 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:24:30.280+0000 7fbf483c3640 -1 Falling back to public interface 2024-09-12T00:24:30.282 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:24:30.283+0000 7fd18ac0d640 -1 Falling back to public interface 2024-09-12T00:24:30.283 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:24:30.502 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:24:30.503+0000 7f9f7d416640 -1 Falling back to public interface 2024-09-12T00:24:30.775 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:24:30.777+0000 7fb9cf958640 -1 Falling back to public interface 2024-09-12T00:24:30.784 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:24:30.785+0000 7ff706611640 -1 Falling back to public interface 2024-09-12T00:24:31.885 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T00:24:31.886+0000 7f2f862c6640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:24:31.885 INFO:tasks.ceph.mgr.x.smithi135.stderr:2024-09-12T00:24:31.886+0000 7f2f862c6640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:24:33.839 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:24:33.841+0000 7fd18ac0d640 -1 osd.4 0 log_to_monitors true 2024-09-12T00:24:34.050 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:24:34.052+0000 7f27ed264640 -1 osd.2 0 log_to_monitors true 2024-09-12T00:24:34.099 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:24:34.101+0000 7f3ae7417640 -1 osd.1 0 log_to_monitors true 2024-09-12T00:24:34.242 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:24:34.243+0000 7f9f7d416640 -1 osd.5 0 log_to_monitors true 2024-09-12T00:24:34.385 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:24:34.386+0000 7fbf483c3640 -1 osd.3 0 log_to_monitors true 2024-09-12T00:24:34.388 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:24:34.390+0000 7f0db4c15640 -1 osd.0 0 log_to_monitors true 2024-09-12T00:24:34.826 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:24:34.828+0000 7fb9cf958640 -1 osd.7 0 log_to_monitors true 2024-09-12T00:24:35.341 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:24:35.343+0000 7ff706611640 -1 osd.6 0 log_to_monitors true 2024-09-12T00:24:35.738 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:24:35.739+0000 7fd186621640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:24:35.747 INFO:tasks.ceph.osd.4.smithi135.stderr:2024-09-12T00:24:35.749+0000 7fd17e440640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:24:37.090 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:24:37.131 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:24:37.132+0000 7f9f795fc640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:24:37.155 INFO:tasks.ceph.osd.5.smithi135.stderr:2024-09-12T00:24:37.157+0000 7f9f70c07640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:24:37.192 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:24:37.193+0000 7fb9cb8ec640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:24:37.204 INFO:tasks.ceph.osd.7.smithi135.stderr:2024-09-12T00:24:37.204+0000 7fb9c370b640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:24:37.580 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T00:24:37.580 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":14,"fsid":"aacb94df-c940-42c4-9df9-171d09a84719","created":"2024-09-12T00:24:26.611771+0000","modified":"2024-09-12T00:24:36.893268+0000","last_up_change":"2024-09-12T00:24:35.889629+0000","last_in_change":"2024-09-12T00:24:28.999488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"77c13442-d11f-4e3f-868c-505b5cf8df46","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"ca603641-3174-4ed3-b0fd-d44e57874366","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8e067835-c65a-4149-926f-e1eb237e089a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"1f0803eb-011d-4af9-867b-dd6dddd1b729","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"144aeca4-2bde-407e-8074-3175188171fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6801","nonce":2991448734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6803","nonce":2991448734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6807","nonce":2991448734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6805","nonce":2991448734}]},"public_addr":"172.21.15.135:6801/2991448734","cluster_addr":"172.21.15.135:6803/2991448734","heartbeat_back_addr":"172.21.15.135:6807/2991448734","heartbeat_front_addr":"172.21.15.135:6805/2991448734","state":["exists","up"]},{"osd":5,"uuid":"8fece5b1-bbfa-4083-9c22-d379c92bf125","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"d15eb2dc-5b0f-4f9b-9d99-947ffb65caf3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"4c832964-8b83-46ac-9c23-fc3888c2fdab","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:34.849335+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:24:37.596 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-12T00:24:37.835 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:24:37.837+0000 7f3ae2e08640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:24:37.853 INFO:tasks.ceph.osd.1.smithi019.stderr:2024-09-12T00:24:37.855+0000 7f3adac27640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:24:37.937 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:24:37.939+0000 7ff702021640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:24:37.947 INFO:tasks.ceph.osd.6.smithi135.stderr:2024-09-12T00:24:37.949+0000 7ff6f9e40640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:24:38.014 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:24:38.016+0000 7fbf44357640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:24:38.020 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:24:38.019+0000 7fbf44357640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:24:38.041 INFO:tasks.ceph.osd.3.smithi019.stderr:2024-09-12T00:24:38.043+0000 7fbf3c176640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:24:38.718 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:24:38.719+0000 7f0db04fc640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:24:38.722 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:24:38.724+0000 7f0db04fc640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:24:38.731 INFO:tasks.ceph.osd.0.smithi019.stderr:2024-09-12T00:24:38.733+0000 7f0da831b640 -1 osd.0 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:24:38.760 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:24:38.762+0000 7f27e91f8640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:24:38.765 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:24:38.767+0000 7f27e91f8640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:24:38.775 INFO:tasks.ceph.osd.2.smithi019.stderr:2024-09-12T00:24:38.777+0000 7f27e1017640 -1 osd.2 15 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:24:44.405 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:24:44.724 INFO:teuthology.misc.health.smithi019.stdout: 2024-09-12T00:24:44.724 INFO:teuthology.misc.health.smithi019.stdout:{"epoch":18,"fsid":"aacb94df-c940-42c4-9df9-171d09a84719","created":"2024-09-12T00:24:26.611771+0000","modified":"2024-09-12T00:24:41.185691+0000","last_up_change":"2024-09-12T00:24:39.174906+0000","last_in_change":"2024-09-12T00:24:28.999488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:24:38.895187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77c13442-d11f-4e3f-868c-505b5cf8df46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6817","nonce":1125148903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6819","nonce":1125148903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6823","nonce":1125148903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6821","nonce":1125148903}]},"public_addr":"172.21.15.19:6817/1125148903","cluster_addr":"172.21.15.19:6819/1125148903","heartbeat_back_addr":"172.21.15.19:6823/1125148903","heartbeat_front_addr":"172.21.15.19:6821/1125148903","state":["exists","up"]},{"osd":1,"uuid":"ca603641-3174-4ed3-b0fd-d44e57874366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6807","nonce":977330370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6811","nonce":977330370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6815","nonce":977330370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6813","nonce":977330370}]},"public_addr":"172.21.15.19:6807/977330370","cluster_addr":"172.21.15.19:6811/977330370","heartbeat_back_addr":"172.21.15.19:6815/977330370","heartbeat_front_addr":"172.21.15.19:6813/977330370","state":["exists","up"]},{"osd":2,"uuid":"8e067835-c65a-4149-926f-e1eb237e089a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6801","nonce":3407245840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6803","nonce":3407245840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6809","nonce":3407245840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6806","nonce":3407245840}]},"public_addr":"172.21.15.19:6801/3407245840","cluster_addr":"172.21.15.19:6803/3407245840","heartbeat_back_addr":"172.21.15.19:6809/3407245840","heartbeat_front_addr":"172.21.15.19:6806/3407245840","state":["exists","up"]},{"osd":3,"uuid":"1f0803eb-011d-4af9-867b-dd6dddd1b729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6825","nonce":737061592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6827","nonce":737061592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6831","nonce":737061592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6829","nonce":737061592}]},"public_addr":"172.21.15.19:6825/737061592","cluster_addr":"172.21.15.19:6827/737061592","heartbeat_back_addr":"172.21.15.19:6831/737061592","heartbeat_front_addr":"172.21.15.19:6829/737061592","state":["exists","up"]},{"osd":4,"uuid":"144aeca4-2bde-407e-8074-3175188171fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6801","nonce":2991448734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6803","nonce":2991448734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6807","nonce":2991448734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6805","nonce":2991448734}]},"public_addr":"172.21.15.135:6801/2991448734","cluster_addr":"172.21.15.135:6803/2991448734","heartbeat_back_addr":"172.21.15.135:6807/2991448734","heartbeat_front_addr":"172.21.15.135:6805/2991448734","state":["exists","up"]},{"osd":5,"uuid":"8fece5b1-bbfa-4083-9c22-d379c92bf125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6809","nonce":43193093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6811","nonce":43193093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6815","nonce":43193093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6813","nonce":43193093}]},"public_addr":"172.21.15.135:6809/43193093","cluster_addr":"172.21.15.135:6811/43193093","heartbeat_back_addr":"172.21.15.135:6815/43193093","heartbeat_front_addr":"172.21.15.135:6813/43193093","state":["exists","up"]},{"osd":6,"uuid":"d15eb2dc-5b0f-4f9b-9d99-947ffb65caf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6825","nonce":1074135986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6827","nonce":1074135986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6831","nonce":1074135986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6829","nonce":1074135986}]},"public_addr":"172.21.15.135:6825/1074135986","cluster_addr":"172.21.15.135:6827/1074135986","heartbeat_back_addr":"172.21.15.135:6831/1074135986","heartbeat_front_addr":"172.21.15.135:6829/1074135986","state":["exists","up"]},{"osd":7,"uuid":"4c832964-8b83-46ac-9c23-fc3888c2fdab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6817","nonce":3292274812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6819","nonce":3292274812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6823","nonce":3292274812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6821","nonce":3292274812}]},"public_addr":"172.21.15.135:6817/3292274812","cluster_addr":"172.21.15.135:6819/3292274812","heartbeat_back_addr":"172.21.15.135:6823/3292274812","heartbeat_front_addr":"172.21.15.135:6821/3292274812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.418615+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.146762+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.091427+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.366242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:34.849335+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.259320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:36.356984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.864014+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:24:44.736 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:24:44.736 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:24:44.737 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:24:45.200 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'rbd' created 2024-09-12T00:24:45.214 DEBUG:teuthology.orchestra.run.smithi019:> rbd --cluster ceph pool init rbd 2024-09-12T00:24:45.275 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:45.275 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:48.228 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:24:48.229 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:24:48.230 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:24:48.557 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:24:48.570 INFO:teuthology.orchestra.run.smithi019.stdout:[{"version":9,"timestamp":"2024-09-12T00:24:38.763419+0000","name":"","changes":[{"name":"osd.2/osd_mclock_max_capacity_iops_ssd","new_value":"5290.615446"}]}] 2024-09-12T00:24:48.570 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:24:48.570 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:24:48.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:24:48.571 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:24:48.935 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:24:48.945 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":5,"flags":0,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6832","nonce":3280264148},{"type":"v1","addr":"172.21.15.135:6833","nonce":3280264148}]},"active_addr":"172.21.15.135:6833/3280264148","active_change":"2024-09-12T00:24:30.875037+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4109,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":4117872595}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3431023192}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":2114361417}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.135:0","nonce":3512884595}]}]} 2024-09-12T00:24:48.951 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:24:48.951 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:24:48.951 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:24:49.267 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:24:49.267 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"aacb94df-c940-42c4-9df9-171d09a84719","created":"2024-09-12T00:24:26.611771+0000","modified":"2024-09-12T00:24:48.214066+0000","last_up_change":"2024-09-12T00:24:39.174906+0000","last_in_change":"2024-09-12T00:24:28.999488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:24:38.895187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:24:45.050522+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77c13442-d11f-4e3f-868c-505b5cf8df46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6817","nonce":1125148903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6819","nonce":1125148903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6823","nonce":1125148903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6821","nonce":1125148903}]},"public_addr":"172.21.15.19:6817/1125148903","cluster_addr":"172.21.15.19:6819/1125148903","heartbeat_back_addr":"172.21.15.19:6823/1125148903","heartbeat_front_addr":"172.21.15.19:6821/1125148903","state":["exists","up"]},{"osd":1,"uuid":"ca603641-3174-4ed3-b0fd-d44e57874366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6807","nonce":977330370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6811","nonce":977330370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6815","nonce":977330370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6813","nonce":977330370}]},"public_addr":"172.21.15.19:6807/977330370","cluster_addr":"172.21.15.19:6811/977330370","heartbeat_back_addr":"172.21.15.19:6815/977330370","heartbeat_front_addr":"172.21.15.19:6813/977330370","state":["exists","up"]},{"osd":2,"uuid":"8e067835-c65a-4149-926f-e1eb237e089a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6801","nonce":3407245840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6803","nonce":3407245840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6809","nonce":3407245840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6806","nonce":3407245840}]},"public_addr":"172.21.15.19:6801/3407245840","cluster_addr":"172.21.15.19:6803/3407245840","heartbeat_back_addr":"172.21.15.19:6809/3407245840","heartbeat_front_addr":"172.21.15.19:6806/3407245840","state":["exists","up"]},{"osd":3,"uuid":"1f0803eb-011d-4af9-867b-dd6dddd1b729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6825","nonce":737061592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6827","nonce":737061592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6831","nonce":737061592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6829","nonce":737061592}]},"public_addr":"172.21.15.19:6825/737061592","cluster_addr":"172.21.15.19:6827/737061592","heartbeat_back_addr":"172.21.15.19:6831/737061592","heartbeat_front_addr":"172.21.15.19:6829/737061592","state":["exists","up"]},{"osd":4,"uuid":"144aeca4-2bde-407e-8074-3175188171fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6801","nonce":2991448734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6803","nonce":2991448734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6807","nonce":2991448734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6805","nonce":2991448734}]},"public_addr":"172.21.15.135:6801/2991448734","cluster_addr":"172.21.15.135:6803/2991448734","heartbeat_back_addr":"172.21.15.135:6807/2991448734","heartbeat_front_addr":"172.21.15.135:6805/2991448734","state":["exists","up"]},{"osd":5,"uuid":"8fece5b1-bbfa-4083-9c22-d379c92bf125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6809","nonce":43193093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6811","nonce":43193093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6815","nonce":43193093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6813","nonce":43193093}]},"public_addr":"172.21.15.135:6809/43193093","cluster_addr":"172.21.15.135:6811/43193093","heartbeat_back_addr":"172.21.15.135:6815/43193093","heartbeat_front_addr":"172.21.15.135:6813/43193093","state":["exists","up"]},{"osd":6,"uuid":"d15eb2dc-5b0f-4f9b-9d99-947ffb65caf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6825","nonce":1074135986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6827","nonce":1074135986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6831","nonce":1074135986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6829","nonce":1074135986}]},"public_addr":"172.21.15.135:6825/1074135986","cluster_addr":"172.21.15.135:6827/1074135986","heartbeat_back_addr":"172.21.15.135:6831/1074135986","heartbeat_front_addr":"172.21.15.135:6829/1074135986","state":["exists","up"]},{"osd":7,"uuid":"4c832964-8b83-46ac-9c23-fc3888c2fdab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6817","nonce":3292274812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6819","nonce":3292274812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6823","nonce":3292274812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6821","nonce":3292274812}]},"public_addr":"172.21.15.135:6817/3292274812","cluster_addr":"172.21.15.135:6819/3292274812","heartbeat_back_addr":"172.21.15.135:6823/3292274812","heartbeat_front_addr":"172.21.15.135:6821/3292274812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.418615+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.146762+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.091427+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.366242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:34.849335+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.259320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:36.356984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.864014+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:24:49.280 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:24:49.281 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:24:49.599 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:24:49.599 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":22,"fsid":"aacb94df-c940-42c4-9df9-171d09a84719","created":"2024-09-12T00:24:26.611771+0000","modified":"2024-09-12T00:24:48.214066+0000","last_up_change":"2024-09-12T00:24:39.174906+0000","last_in_change":"2024-09-12T00:24:28.999488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:24:38.895187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:24:45.050522+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77c13442-d11f-4e3f-868c-505b5cf8df46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6817","nonce":1125148903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6819","nonce":1125148903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6823","nonce":1125148903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6821","nonce":1125148903}]},"public_addr":"172.21.15.19:6817/1125148903","cluster_addr":"172.21.15.19:6819/1125148903","heartbeat_back_addr":"172.21.15.19:6823/1125148903","heartbeat_front_addr":"172.21.15.19:6821/1125148903","state":["exists","up"]},{"osd":1,"uuid":"ca603641-3174-4ed3-b0fd-d44e57874366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6807","nonce":977330370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6811","nonce":977330370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6815","nonce":977330370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6813","nonce":977330370}]},"public_addr":"172.21.15.19:6807/977330370","cluster_addr":"172.21.15.19:6811/977330370","heartbeat_back_addr":"172.21.15.19:6815/977330370","heartbeat_front_addr":"172.21.15.19:6813/977330370","state":["exists","up"]},{"osd":2,"uuid":"8e067835-c65a-4149-926f-e1eb237e089a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6801","nonce":3407245840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6803","nonce":3407245840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6809","nonce":3407245840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6806","nonce":3407245840}]},"public_addr":"172.21.15.19:6801/3407245840","cluster_addr":"172.21.15.19:6803/3407245840","heartbeat_back_addr":"172.21.15.19:6809/3407245840","heartbeat_front_addr":"172.21.15.19:6806/3407245840","state":["exists","up"]},{"osd":3,"uuid":"1f0803eb-011d-4af9-867b-dd6dddd1b729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6825","nonce":737061592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6827","nonce":737061592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6831","nonce":737061592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6829","nonce":737061592}]},"public_addr":"172.21.15.19:6825/737061592","cluster_addr":"172.21.15.19:6827/737061592","heartbeat_back_addr":"172.21.15.19:6831/737061592","heartbeat_front_addr":"172.21.15.19:6829/737061592","state":["exists","up"]},{"osd":4,"uuid":"144aeca4-2bde-407e-8074-3175188171fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6801","nonce":2991448734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6803","nonce":2991448734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6807","nonce":2991448734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6805","nonce":2991448734}]},"public_addr":"172.21.15.135:6801/2991448734","cluster_addr":"172.21.15.135:6803/2991448734","heartbeat_back_addr":"172.21.15.135:6807/2991448734","heartbeat_front_addr":"172.21.15.135:6805/2991448734","state":["exists","up"]},{"osd":5,"uuid":"8fece5b1-bbfa-4083-9c22-d379c92bf125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6809","nonce":43193093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6811","nonce":43193093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6815","nonce":43193093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6813","nonce":43193093}]},"public_addr":"172.21.15.135:6809/43193093","cluster_addr":"172.21.15.135:6811/43193093","heartbeat_back_addr":"172.21.15.135:6815/43193093","heartbeat_front_addr":"172.21.15.135:6813/43193093","state":["exists","up"]},{"osd":6,"uuid":"d15eb2dc-5b0f-4f9b-9d99-947ffb65caf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6825","nonce":1074135986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6827","nonce":1074135986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6831","nonce":1074135986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6829","nonce":1074135986}]},"public_addr":"172.21.15.135:6825/1074135986","cluster_addr":"172.21.15.135:6827/1074135986","heartbeat_back_addr":"172.21.15.135:6831/1074135986","heartbeat_front_addr":"172.21.15.135:6829/1074135986","state":["exists","up"]},{"osd":7,"uuid":"4c832964-8b83-46ac-9c23-fc3888c2fdab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6817","nonce":3292274812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6819","nonce":3292274812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6823","nonce":3292274812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6821","nonce":3292274812}]},"public_addr":"172.21.15.135:6817/3292274812","cluster_addr":"172.21.15.135:6819/3292274812","heartbeat_back_addr":"172.21.15.135:6823/3292274812","heartbeat_front_addr":"172.21.15.135:6821/3292274812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.418615+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.146762+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.091427+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.366242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:34.849335+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.259320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:36.356984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.864014+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:24:49.613 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:24:49.613 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:24:49.613 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:24:49.614 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:24:49.614 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:24:49.615 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:24:49.615 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:24:49.615 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:24:49.861 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-09-12T00:24:49.862 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:24:49.885 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-09-12T00:24:49.886 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:24:49.888 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-09-12T00:24:49.888 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:24:49.889 INFO:teuthology.orchestra.run.smithi019.stdout:68719476742 2024-09-12T00:24:49.889 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:24:49.890 INFO:teuthology.orchestra.run.smithi019.stdout:68719476741 2024-09-12T00:24:49.891 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:24:49.892 INFO:teuthology.orchestra.run.smithi019.stdout:64424509445 2024-09-12T00:24:49.892 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-09-12T00:24:49.893 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:24:49.893 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:24:50.090 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-09-12T00:24:50.091 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:24:50.454 INFO:teuthology.orchestra.run.smithi019.stdout:64424509444 2024-09-12T00:24:50.462 INFO:teuthology.orchestra.run.smithi019.stdout:64424509444 2024-09-12T00:24:50.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.1 2024-09-12T00:24:50.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.6 2024-09-12T00:24:50.496 INFO:teuthology.orchestra.run.smithi019.stdout:55834574853 2024-09-12T00:24:50.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2024-09-12T00:24:50.534 INFO:teuthology.orchestra.run.smithi019.stdout:68719476741 2024-09-12T00:24:50.539 INFO:teuthology.orchestra.run.smithi019.stdout:64424509443 2024-09-12T00:24:50.548 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476741 for osd.2 2024-09-12T00:24:50.552 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-09-12T00:24:50.586 INFO:teuthology.orchestra.run.smithi019.stdout:64424509444 2024-09-12T00:24:50.587 INFO:teuthology.orchestra.run.smithi019.stdout:68719476740 2024-09-12T00:24:50.593 INFO:teuthology.orchestra.run.smithi019.stdout:64424509445 2024-09-12T00:24:50.601 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.7 2024-09-12T00:24:50.602 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476740 for osd.0 2024-09-12T00:24:50.607 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509445 for osd.5 2024-09-12T00:24:51.477 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:24:51.480 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:24:51.516 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:24:51.549 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:24:51.553 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:24:51.602 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:24:51.603 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:24:51.608 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:24:52.065 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-09-12T00:24:52.067 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-09-12T00:24:52.085 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.6 2024-09-12T00:24:52.085 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:52.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.1 2024-09-12T00:24:52.089 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:52.138 INFO:teuthology.orchestra.run.smithi019.stdout:64424509445 2024-09-12T00:24:52.150 INFO:teuthology.orchestra.run.smithi019.stdout:55834574854 2024-09-12T00:24:52.153 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-09-12T00:24:52.153 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:52.156 INFO:teuthology.orchestra.run.smithi019.stdout:64424509446 2024-09-12T00:24:52.170 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.7 2024-09-12T00:24:52.170 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:52.171 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2024-09-12T00:24:52.171 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:52.182 INFO:teuthology.orchestra.run.smithi019.stdout:68719476743 2024-09-12T00:24:52.195 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476742 got 68719476743 for osd.2 2024-09-12T00:24:52.195 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:52.238 INFO:teuthology.orchestra.run.smithi019.stdout:64424509447 2024-09-12T00:24:52.247 INFO:teuthology.orchestra.run.smithi019.stdout:68719476742 2024-09-12T00:24:52.252 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-09-12T00:24:52.252 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:52.260 INFO:tasks.ceph.ceph_manager.ceph:need seq 68719476741 got 68719476742 for osd.0 2024-09-12T00:24:52.260 DEBUG:teuthology.parallel:result is None 2024-09-12T00:24:52.261 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:24:52.261 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:24:52.613 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:24:52.705 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:24:52.706 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T00:24:51.407948+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219128,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755592,"statfs":{"total":773094113280,"available":772869726208,"internally_reserved":0,"allocated":2932736,"data_stored":1779414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.202350"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.218804+0000","last_change":"2024-09-12T00:24:48.218804+0000","last_active":"2024-09-12T00:24:48.218804+0000","last_peered":"2024-09-12T00:24:48.218804+0000","last_clean":"2024-09-12T00:24:48.218804+0000","last_became_active":"2024-09-12T00:24:46.425908+0000","last_became_peered":"2024-09-12T00:24:46.425908+0000","last_unstale":"2024-09-12T00:24:48.218804+0000","last_undegraded":"2024-09-12T00:24:48.218804+0000","last_fullsized":"2024-09-12T00:24:48.218804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:43.693370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085110299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.220756+0000","last_change":"2024-09-12T00:24:48.220966+0000","last_active":"2024-09-12T00:24:48.220756+0000","last_peered":"2024-09-12T00:24:48.220756+0000","last_clean":"2024-09-12T00:24:48.220756+0000","last_became_active":"2024-09-12T00:24:46.426160+0000","last_became_peered":"2024-09-12T00:24:46.426160+0000","last_unstale":"2024-09-12T00:24:48.220756+0000","last_undegraded":"2024-09-12T00:24:48.220756+0000","last_fullsized":"2024-09-12T00:24:48.220756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.751628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.218424+0000","last_change":"2024-09-12T00:24:48.218424+0000","last_active":"2024-09-12T00:24:48.218424+0000","last_peered":"2024-09-12T00:24:48.218424+0000","last_clean":"2024-09-12T00:24:48.218424+0000","last_became_active":"2024-09-12T00:24:46.213839+0000","last_became_peered":"2024-09-12T00:24:46.213839+0000","last_unstale":"2024-09-12T00:24:48.218424+0000","last_undegraded":"2024-09-12T00:24:48.218424+0000","last_fullsized":"2024-09-12T00:24:48.218424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.527991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050495300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.266785+0000","last_change":"2024-09-12T00:24:48.266785+0000","last_active":"2024-09-12T00:24:48.266785+0000","last_peered":"2024-09-12T00:24:48.266785+0000","last_clean":"2024-09-12T00:24:48.266785+0000","last_became_active":"2024-09-12T00:24:46.295839+0000","last_became_peered":"2024-09-12T00:24:46.295839+0000","last_unstale":"2024-09-12T00:24:48.266785+0000","last_undegraded":"2024-09-12T00:24:48.266785+0000","last_fullsized":"2024-09-12T00:24:48.266785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:07.950890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045367200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.225727+0000","last_change":"2024-09-12T00:24:48.218472+0000","last_active":"2024-09-12T00:24:48.225727+0000","last_peered":"2024-09-12T00:24:48.225727+0000","last_clean":"2024-09-12T00:24:48.225727+0000","last_became_active":"2024-09-12T00:24:46.296014+0000","last_became_peered":"2024-09-12T00:24:46.296014+0000","last_unstale":"2024-09-12T00:24:48.225727+0000","last_undegraded":"2024-09-12T00:24:48.225727+0000","last_fullsized":"2024-09-12T00:24:48.225727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:16.575080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055221999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.293366+0000","last_change":"2024-09-12T00:24:48.293366+0000","last_active":"2024-09-12T00:24:48.293366+0000","last_peered":"2024-09-12T00:24:48.293366+0000","last_clean":"2024-09-12T00:24:48.293366+0000","last_became_active":"2024-09-12T00:24:46.219148+0000","last_became_peered":"2024-09-12T00:24:46.219148+0000","last_unstale":"2024-09-12T00:24:48.293366+0000","last_undegraded":"2024-09-12T00:24:48.293366+0000","last_fullsized":"2024-09-12T00:24:48.293366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:43.132714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040735800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.218739+0000","last_change":"2024-09-12T00:24:48.218739+0000","last_active":"2024-09-12T00:24:48.218739+0000","last_peered":"2024-09-12T00:24:48.218739+0000","last_clean":"2024-09-12T00:24:48.218739+0000","last_became_active":"2024-09-12T00:24:46.216398+0000","last_became_peered":"2024-09-12T00:24:46.216398+0000","last_unstale":"2024-09-12T00:24:48.218739+0000","last_undegraded":"2024-09-12T00:24:48.218739+0000","last_fullsized":"2024-09-12T00:24:48.218739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:54.142561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080348300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.219201+0000","last_change":"2024-09-12T00:24:48.219201+0000","last_active":"2024-09-12T00:24:48.219201+0000","last_peered":"2024-09-12T00:24:48.219201+0000","last_clean":"2024-09-12T00:24:48.219201+0000","last_became_active":"2024-09-12T00:24:46.449286+0000","last_became_peered":"2024-09-12T00:24:46.449286+0000","last_unstale":"2024-09-12T00:24:48.219201+0000","last_undegraded":"2024-09-12T00:24:48.219201+0000","last_fullsized":"2024-09-12T00:24:48.219201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:20.504679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001069263,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.217338+0000","last_change":"2024-09-12T00:24:40.256272+0000","last_active":"2024-09-12T00:24:48.217338+0000","last_peered":"2024-09-12T00:24:48.217338+0000","last_clean":"2024-09-12T00:24:48.217338+0000","last_became_active":"2024-09-12T00:24:40.255060+0000","last_became_peered":"2024-09-12T00:24:40.255060+0000","last_unstale":"2024-09-12T00:24:48.217338+0000","last_undegraded":"2024-09-12T00:24:48.217338+0000","last_fullsized":"2024-09-12T00:24:48.217338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:39.174906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:39.174906+0000","last_clean_scrub_stamp":"2024-09-12T00:24:39.174906+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:43.340341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":74830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":74830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":74830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":665198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":665198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":74830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:24:52.707 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:24:53.020 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:24:53.021 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T00:24:53.033 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-12T00:24:52.884890+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219128,"kb_used_data":2864,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755592,"statfs":{"total":773094113280,"available":772869726208,"internally_reserved":0,"allocated":2932736,"data_stored":1779414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001538"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.218804+0000","last_change":"2024-09-12T00:24:48.218804+0000","last_active":"2024-09-12T00:24:48.218804+0000","last_peered":"2024-09-12T00:24:48.218804+0000","last_clean":"2024-09-12T00:24:48.218804+0000","last_became_active":"2024-09-12T00:24:46.425908+0000","last_became_peered":"2024-09-12T00:24:46.425908+0000","last_unstale":"2024-09-12T00:24:48.218804+0000","last_undegraded":"2024-09-12T00:24:48.218804+0000","last_fullsized":"2024-09-12T00:24:48.218804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:43.693370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085110299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.220756+0000","last_change":"2024-09-12T00:24:48.220966+0000","last_active":"2024-09-12T00:24:48.220756+0000","last_peered":"2024-09-12T00:24:48.220756+0000","last_clean":"2024-09-12T00:24:48.220756+0000","last_became_active":"2024-09-12T00:24:46.426160+0000","last_became_peered":"2024-09-12T00:24:46.426160+0000","last_unstale":"2024-09-12T00:24:48.220756+0000","last_undegraded":"2024-09-12T00:24:48.220756+0000","last_fullsized":"2024-09-12T00:24:48.220756+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.751628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.218424+0000","last_change":"2024-09-12T00:24:48.218424+0000","last_active":"2024-09-12T00:24:48.218424+0000","last_peered":"2024-09-12T00:24:48.218424+0000","last_clean":"2024-09-12T00:24:48.218424+0000","last_became_active":"2024-09-12T00:24:46.213839+0000","last_became_peered":"2024-09-12T00:24:46.213839+0000","last_unstale":"2024-09-12T00:24:48.218424+0000","last_undegraded":"2024-09-12T00:24:48.218424+0000","last_fullsized":"2024-09-12T00:24:48.218424+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.527991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050495300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.266785+0000","last_change":"2024-09-12T00:24:48.266785+0000","last_active":"2024-09-12T00:24:48.266785+0000","last_peered":"2024-09-12T00:24:48.266785+0000","last_clean":"2024-09-12T00:24:48.266785+0000","last_became_active":"2024-09-12T00:24:46.295839+0000","last_became_peered":"2024-09-12T00:24:46.295839+0000","last_unstale":"2024-09-12T00:24:48.266785+0000","last_undegraded":"2024-09-12T00:24:48.266785+0000","last_fullsized":"2024-09-12T00:24:48.266785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:07.950890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045367200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.225727+0000","last_change":"2024-09-12T00:24:48.218472+0000","last_active":"2024-09-12T00:24:48.225727+0000","last_peered":"2024-09-12T00:24:48.225727+0000","last_clean":"2024-09-12T00:24:48.225727+0000","last_became_active":"2024-09-12T00:24:46.296014+0000","last_became_peered":"2024-09-12T00:24:46.296014+0000","last_unstale":"2024-09-12T00:24:48.225727+0000","last_undegraded":"2024-09-12T00:24:48.225727+0000","last_fullsized":"2024-09-12T00:24:48.225727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:16.575080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055221999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.293366+0000","last_change":"2024-09-12T00:24:48.293366+0000","last_active":"2024-09-12T00:24:48.293366+0000","last_peered":"2024-09-12T00:24:48.293366+0000","last_clean":"2024-09-12T00:24:48.293366+0000","last_became_active":"2024-09-12T00:24:46.219148+0000","last_became_peered":"2024-09-12T00:24:46.219148+0000","last_unstale":"2024-09-12T00:24:48.293366+0000","last_undegraded":"2024-09-12T00:24:48.293366+0000","last_fullsized":"2024-09-12T00:24:48.293366+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:43.132714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040735800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.218739+0000","last_change":"2024-09-12T00:24:48.218739+0000","last_active":"2024-09-12T00:24:48.218739+0000","last_peered":"2024-09-12T00:24:48.218739+0000","last_clean":"2024-09-12T00:24:48.218739+0000","last_became_active":"2024-09-12T00:24:46.216398+0000","last_became_peered":"2024-09-12T00:24:46.216398+0000","last_unstale":"2024-09-12T00:24:48.218739+0000","last_undegraded":"2024-09-12T00:24:48.218739+0000","last_fullsized":"2024-09-12T00:24:48.218739+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:54.142561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080348300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.219201+0000","last_change":"2024-09-12T00:24:48.219201+0000","last_active":"2024-09-12T00:24:48.219201+0000","last_peered":"2024-09-12T00:24:48.219201+0000","last_clean":"2024-09-12T00:24:48.219201+0000","last_became_active":"2024-09-12T00:24:46.449286+0000","last_became_peered":"2024-09-12T00:24:46.449286+0000","last_unstale":"2024-09-12T00:24:48.219201+0000","last_undegraded":"2024-09-12T00:24:48.219201+0000","last_fullsized":"2024-09-12T00:24:48.219201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:20.504679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001069263,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"18'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:24:48.217338+0000","last_change":"2024-09-12T00:24:40.256272+0000","last_active":"2024-09-12T00:24:48.217338+0000","last_peered":"2024-09-12T00:24:48.217338+0000","last_clean":"2024-09-12T00:24:48.217338+0000","last_became_active":"2024-09-12T00:24:40.255060+0000","last_became_peered":"2024-09-12T00:24:40.255060+0000","last_unstale":"2024-09-12T00:24:48.217338+0000","last_undegraded":"2024-09-12T00:24:48.217338+0000","last_fullsized":"2024-09-12T00:24:48.217338+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:39.174906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:39.174906+0000","last_clean_scrub_stamp":"2024-09-12T00:24:39.174906+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:43.340341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719476743,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":74830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719476742,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":74830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":217088,"data_stored":74830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":811008,"data_stored":665198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":221184,"data_stored":74849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27820,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344020,"statfs":{"total":96636764160,"available":96608276480,"internally_reserved":0,"allocated":811008,"data_stored":665198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574855,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":217088,"data_stored":74830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:24:53.034 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:24:53.034 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:24:53.034 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:24:53.035 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:24:53.387 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:24:53.387 INFO:teuthology.orchestra.run.smithi019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:24:53.400 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:24:53.401 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:24:53.415 DEBUG:teuthology.task:Applying overrides for task openssl_keys: {'rgw.client.0': {'ca': 'root', 'client': 'client.0', 'embed-key': True}, 'root': {'client': 'client.0', 'cn': 'teuthology', 'install': ['client.0'], 'key-type': 'rsa:4096'}} 2024-09-12T00:24:53.416 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:24:53.446 DEBUG:teuthology.orchestra.run.smithi019:> openssl req -x509 -nodes -newkey rsa:4096 -keyout /home/ubuntu/cephtest/ca/root.key -days 365 -out /home/ubuntu/cephtest/ca/root.crt -subj /CN=teuthology 2024-09-12T00:24:53.999 INFO:teuthology.orchestra.run.smithi019.stderr:..+.....+.+......+.....+....+..+...+.........+......+....+...+........................+.....+++++++++++++++++++++++++++++++++++++++++++++*......+++++++++++++++++++++++++++++++++++++++++++++*..+.......+........+...+....+..+....+......+...+...............+..................+..+......+......+.+...+..............+..........+........+.............+..+....+.........+............+.....+...........................+.......+..............+....+..+.+...+.....+....+......+...........+....+..+..........+...+..............+............+.............+..+.+..+...+...+.+......+............+............+.....+...+.+..+...+....+........+............+......+.........+........................................+..+...............+...+...+.......+......+.........+..+..................+...+...+.......+..+................+...........+.+............+.....+.......+...+...+...+..+...+......+...+.+............+............+..+......+...+.+.....+....+.....+........................+...+...+....+...........+......+.+.........+....................................+...+...........+...+...+....+...+......+......+........+.+...............+...........+......+.......+............+......+...+..+...............+....+++++ 2024-09-12T00:24:54.480 INFO:teuthology.orchestra.run.smithi019.stderr:.+++++++++++++++++++++++++++++++++++++++++++++*.+..............+.+...+..+.........+....+..+...+........................+.+.....+.+......+..+.+..+.......+...+.....+..................+....+++++++++++++++++++++++++++++++++++++++++++++*....+.+........+.......+..........................+...........................+.+.............................+......+....+.....+...+....+.....+..................+...+.......+..+....+.....+....+...+..+.............+...+..............+.......+.................................+...+............+............+...+...........+..........+..............+..........+............+...........+.........+.+..+...+....+...........+....+..............+.+.....................+..+...+...+.+......+..+......+....+...........+....+..+....+......+.....+...+.+............+..............+.+...+.....+......+.+...+......+.....+.........+.+...+......+..+..............................+.......+.....+...+....+...+.....+.............+.....+..........+........+..........+.....+......+...+............+......+..................+.+.....+....+.....+.+........+.............+............+...+.....+...+............+.........+......+....+......+...+...........+....+.....+............+....+........................+.....+....+..+......+...................+...+...+.................+......+.+.....+...+...+....+...+...........+............+..........+..................+..+...+.+.........+.........+...+++++ 2024-09-12T00:24:54.505 INFO:teuthology.orchestra.run.smithi019.stderr:----- 2024-09-12T00:24:54.514 DEBUG:teuthology.orchestra.run.smithi019:> sudo cp /home/ubuntu/cephtest/ca/root.crt /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-12T00:24:54.554 DEBUG:teuthology.orchestra.run.smithi019:> sudo update-ca-trust 2024-09-12T00:24:55.683 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -p /home/ubuntu/cephtest/ca 2024-09-12T00:24:55.712 DEBUG:teuthology.orchestra.run.smithi019:> openssl req -nodes -newkey rsa:2048 -keyout /home/ubuntu/cephtest/ca/rgw.client.0.key -out /home/ubuntu/cephtest/ca/rgw.client.0.csr -subj /CN=smithi019.front.sepia.ceph.com 2024-09-12T00:24:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:......+.+...........+.......+...+..+++++++++++++++++++++++++++++++++++++++*.+.+.....+++++++++++++++++++++++++++++++++++++++*..+...+...+...+...............+.+......+........+......+.+............+..+.+.....+...+......................+...+.........+.....+.+......+....................+.+..+.+.....+..........+.....................+.....+.+.....+...............+.........+...+.+......+...+...+.................+......+.......+........+....+............+...........+.......+..+...+.+..+.........+....+..+..........+.....+.........+.+.................+......+.......+.........+...+..+.+...+.....+....+...+...+..+.........+...+.......+...+.....+...+...+.+.....+...................+..+....+........+.............+...+.........+.....+..........+............+...+...+...+..+....+...+..+....+............+............+.....+......+......+....+.....+.........+.......+...+..+......+............+.+......+......+..+......+......+.............+...+..+............+.+.....+.........+....+..+...............+...+.........+.+.....+.+.....+.+..+.............+...++++++ 2024-09-12T00:24:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:..+..+.......+............+...+...+...+.....+.+.....+....+..+++++++++++++++++++++++++++++++++++++++*.....+......+...+......+.+...+...+..............+.........+....+.....+.+......+.........+..+++++++++++++++++++++++++++++++++++++++*.+.........+..+.......+...+........+.+...........+...+..........+..+.........+.........+.+......+..+.......+........+.............+...+.....+....+..+...............+...............+....+..+....+...........+............+.+.....+.....................+...+...+...+.+...+..+......+...+.+......+.................+.+.........+......+............+...+............+........+.......+.................+...+..........+........+....+.....+.+...........+....+.........+.....+...+.......+............+.....+.+..+.+.....+.+.....+......+......................+...+...+.........+..+...+...+...+.........+.+...........+.+........+......+.........+......+......+...+.+..............+.........+.+..+....+........+...+..........+............+..+.+...+............+............+.....+...+...+.+.........+..+............+..........+.....+...+....+....................+...+......+.+......+...+......+...+...+..............+.+...+..+.......+...+..+............+....+......+...++++++ 2024-09-12T00:24:55.896 INFO:teuthology.orchestra.run.smithi019.stderr:----- 2024-09-12T00:24:55.897 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:24:55.897 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:24:55.966 DEBUG:teuthology.orchestra.run.smithi019:> openssl x509 -req -in /home/ubuntu/cephtest/ca/rgw.client.0.csr -CA /home/ubuntu/cephtest/ca/root.crt -CAkey /home/ubuntu/cephtest/ca/root.key -CAcreateserial -out /home/ubuntu/cephtest/ca/rgw.client.0.crt -days 365 -sha256 -extfile /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:24:56.044 INFO:teuthology.orchestra.run.smithi019.stderr:Certificate request self-signature ok 2024-09-12T00:24:56.045 INFO:teuthology.orchestra.run.smithi019.stderr:subject=CN=smithi019.front.sepia.ceph.com 2024-09-12T00:24:56.055 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.csr /home/ubuntu/cephtest/ca/root.srl /home/ubuntu/cephtest/ca/rgw.client.0.ext 2024-09-12T00:24:56.124 DEBUG:teuthology.orchestra.run.smithi019:> openssl verify -CAfile /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:24:56.195 INFO:teuthology.orchestra.run.smithi019.stdout:/home/ubuntu/cephtest/ca/rgw.client.0.crt: OK 2024-09-12T00:24:56.196 DEBUG:teuthology.orchestra.run.smithi019:> cat /home/ubuntu/cephtest/ca/rgw.client.0.key >> /home/ubuntu/cephtest/ca/rgw.client.0.crt 2024-09-12T00:24:56.266 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:24:56.282 DEBUG:tasks.rgw:config is {'client.0': {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2024-09-12T00:24:56.283 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:24:56.283 INFO:tasks.rgw:Creating data pools 2024-09-12T00:24:56.283 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:24:56.283 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-12T00:24:57.436 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T00:24:59.441 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:24:59.459 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:25:00.429 INFO:teuthology.orchestra.run.smithi019.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:25:00.477 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:25:01.446 INFO:teuthology.orchestra.run.smithi019.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:25:01.473 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:25:02.455 INFO:teuthology.orchestra.run.smithi019.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:25:02.486 DEBUG:tasks.rgw:Pools created 2024-09-12T00:25:02.487 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:25:02.487 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:25:02.487 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:25:02.487 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:25:02.604 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:02.604 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:04.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.512+0000 7fa82db92640 0 -- 172.21.15.19:0/1385160412 >> [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] conn(0x7fa704076380 msgr2=0x7fa704078840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:04.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.517+0000 7fa832415800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.518+0000 7fa82db92640 0 -- 172.21.15.19:0/660316909 >> [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] conn(0x7fa6f4076470 msgr2=0x7fa6f4078930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:04.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.519+0000 7fa832415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:04.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.519+0000 7fa832415800 20 realm 2024-09-12T00:25:04.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.519+0000 7fa832415800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.519+0000 7fa832415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:04.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.519+0000 7fa832415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:04.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.519+0000 7fa832415800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.519+0000 7fa832415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:04.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.519+0000 7fa832415800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.520+0000 7fa832415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:04.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.520+0000 7fa832415800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.520+0000 7fa832415800 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:25:04.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.520+0000 7fa832415800 20 searching for the correct realm 2024-09-12T00:25:04.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.533+0000 7fa832415800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:25:04.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.533+0000 7fa832415800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:25:04.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.533+0000 7fa832415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:04.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.533+0000 7fa832415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:04.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.533+0000 7fa832415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:04.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.533+0000 7fa832415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:04.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.533+0000 7fa832415800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.533+0000 7fa832415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:04.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.533+0000 7fa832415800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.536+0000 7fa832415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:04.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.536+0000 7fa832415800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.540+0000 7fa832415800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:25:04.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.540+0000 7fa832415800 20 zone default found 2024-09-12T00:25:04.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.540+0000 7fa832415800 4 Realm: () 2024-09-12T00:25:04.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.540+0000 7fa832415800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:25:04.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.540+0000 7fa832415800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:25:04.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.540+0000 7fa832415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:04.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.540+0000 7fa832415800 20 zonegroup default 2024-09-12T00:25:04.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.540+0000 7fa832415800 20 rados->read ofs=0 len=0 2024-09-12T00:25:04.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.540+0000 7fa832415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:04.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:04.540+0000 7fa832415800 20 rados->read ofs=0 len=0 2024-09-12T00:25:06.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:06.496+0000 7fa832415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:06.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:06.496+0000 7fa832415800 20 rados->read ofs=0 len=0 2024-09-12T00:25:06.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:06.499+0000 7fa832415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:06.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:06.499+0000 7fa832415800 20 started sync module instance, tier type = 2024-09-12T00:25:06.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:06.499+0000 7fa832415800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:25:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.529+0000 7fa832415800 20 add_watcher() i=0 2024-09-12T00:25:08.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.529+0000 7fa832415800 20 add_watcher() i=1 2024-09-12T00:25:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.529+0000 7fa832415800 20 add_watcher() i=2 2024-09-12T00:25:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.529+0000 7fa832415800 20 add_watcher() i=3 2024-09-12T00:25:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.529+0000 7fa832415800 20 add_watcher() i=4 2024-09-12T00:25:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.529+0000 7fa832415800 20 add_watcher() i=5 2024-09-12T00:25:08.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.529+0000 7fa832415800 20 add_watcher() i=6 2024-09-12T00:25:08.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.530+0000 7fa832415800 20 add_watcher() i=7 2024-09-12T00:25:08.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.530+0000 7fa832415800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.531+0000 7fa832415800 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:25:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.531+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:25:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.531+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.531+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:25:08.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.531+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:25:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.531+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.531+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:25:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.531+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:25:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.531+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.532+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:25:08.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.532+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:25:08.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.532+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.532+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:25:08.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.532+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:25:08.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.532+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.533+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.533+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.533+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:25:08.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.534+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.535+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.536+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.536+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.536+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.536+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.536+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.536+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.536+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.536+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.536+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.537+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:25:08.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.538+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.539+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.540+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.540+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.540+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.540+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:25:08.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.540+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.540+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.540+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.540+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.540+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:25:08.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.541+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.542+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.542+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.542+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.542+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.542+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.542+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.542+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.542+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.542+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:25:08.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.543+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:25:08.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.544+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.545+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:25:08.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.545+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.545+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.545+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.545+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.545+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.545+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.545+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.545+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.546+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.547+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.547+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.547+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.547+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.547+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.547+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.547+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:25:08.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.547+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:25:08.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.547+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:25:08.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.548+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.549+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.550+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:25:08.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.551+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:25:08.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.552+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.553+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.553+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.553+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.553+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.553+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:25:08.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.553+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.553+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.553+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.553+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:25:08.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.554+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:25:08.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.555+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.556+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:25:08.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.557+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.558+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.559+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.559+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.559+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.559+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.559+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.559+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.559+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.559+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.559+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.560+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:25:08.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.561+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.562+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:25:08.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.563+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:25:08.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.564+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.565+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.565+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.565+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.565+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.565+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.565+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.565+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:25:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.565+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:25:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.565+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.565+0000 7fa832415800 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:25:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.565+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:25:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.567+0000 7fa832415800 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:25:08.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.574+0000 7fa6db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.574+0000 7fa832415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:08.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:08.574+0000 7fa832415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:11.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.526+0000 7fa832415800 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:25:11.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.526+0000 7fa832415800 5 note: GC not initialized 2024-09-12T00:25:11.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.527+0000 7fa832415800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:11.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.526+0000 7fa6da7fc640 20 reqs_thread_entry: start 2024-09-12T00:25:11.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.527+0000 7fa832415800 20 Filter name: none 2024-09-12T00:25:11.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.527+0000 7fa643fff640 20 reqs_thread_entry: start 2024-09-12T00:25:11.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.555+0000 7fa6db7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:11.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.558+0000 7fa832415800 20 remove_watcher() i=0 2024-09-12T00:25:11.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.558+0000 7fa832415800 2 removed watcher, disabling cache 2024-09-12T00:25:11.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.559+0000 7fa832415800 20 remove_watcher() i=1 2024-09-12T00:25:11.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.561+0000 7fa832415800 20 remove_watcher() i=2 2024-09-12T00:25:11.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.562+0000 7fa832415800 20 remove_watcher() i=3 2024-09-12T00:25:11.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.564+0000 7fa832415800 20 remove_watcher() i=4 2024-09-12T00:25:11.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.566+0000 7fa832415800 20 remove_watcher() i=5 2024-09-12T00:25:11.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.568+0000 7fa832415800 20 remove_watcher() i=6 2024-09-12T00:25:11.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.571+0000 7fa832415800 20 remove_watcher() i=7 2024-09-12T00:25:11.585 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-12T00:25:11.586 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:25:11.586 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:25:11.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:25:11.586 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:25:11.656 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:11.656 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:11.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.685+0000 7f8307322800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:11.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.685+0000 7f8307322800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:11.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.689+0000 7f81c27fc640 20 reqs_thread_entry: start 2024-09-12T00:25:11.706 INFO:teuthology.orchestra.run.smithi019.stdout:{"id":"844f1394-9f73-45bf-8dcb-b3ca2aab8fdc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:25:11.706 DEBUG:tasks.util.rgw: json result: {'id': '844f1394-9f73-45bf-8dcb-b3ca2aab8fdc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:25:11.706 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:25:11.706 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:25:11.707 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:25:11.764 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:11.764 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:11.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.800+0000 7ff56560e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.802+0000 7ff56560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.802+0000 7ff56560e800 20 realm 2024-09-12T00:25:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.802+0000 7ff56560e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.802+0000 7ff56560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.802+0000 7ff56560e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:25:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.802+0000 7ff56560e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.802+0000 7ff56560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:11.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.802+0000 7ff56560e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.803+0000 7ff56560e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.803+0000 7ff56560e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.804+0000 7ff56560e800 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:25:11.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.804+0000 7ff56560e800 20 searching for the correct realm 2024-09-12T00:25:11.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:11.807+0000 7ff560458640 0 -- 172.21.15.19:0/2932550372 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7ff548065040 msgr2=0x7ff54804c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:12.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.013+0000 7ff56145a640 0 -- 172.21.15.19:0/2932550372 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x562565d36450 msgr2=0x562565d38840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:25:12.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.017+0000 7ff56560e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:25:12.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.017+0000 7ff56560e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:25:12.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.017+0000 7ff56560e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:25:12.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.017+0000 7ff56560e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:25:12.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.017+0000 7ff56560e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:25:12.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.017+0000 7ff56560e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:25:12.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.017+0000 7ff56560e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.017+0000 7ff56560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.017+0000 7ff56560e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:25:12.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:25:12.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 20 zone default found 2024-09-12T00:25:12.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 4 Realm: () 2024-09-12T00:25:12.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:25:12.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:25:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:25:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 20 zonegroup default 2024-09-12T00:25:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.018+0000 7ff56560e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.019+0000 7ff56560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.019+0000 7ff56560e800 20 rados->read ofs=0 len=0 2024-09-12T00:25:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.019+0000 7ff56560e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:25:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.019+0000 7ff56560e800 20 started sync module instance, tier type = 2024-09-12T00:25:12.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.019+0000 7ff56560e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:25:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.041+0000 7ff56560e800 20 add_watcher() i=0 2024-09-12T00:25:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.041+0000 7ff56560e800 20 add_watcher() i=1 2024-09-12T00:25:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.041+0000 7ff56560e800 20 add_watcher() i=2 2024-09-12T00:25:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.041+0000 7ff56560e800 20 add_watcher() i=3 2024-09-12T00:25:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.041+0000 7ff56560e800 20 add_watcher() i=4 2024-09-12T00:25:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.041+0000 7ff56560e800 20 add_watcher() i=5 2024-09-12T00:25:12.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.041+0000 7ff56560e800 20 add_watcher() i=6 2024-09-12T00:25:12.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.042+0000 7ff56560e800 20 add_watcher() i=7 2024-09-12T00:25:12.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.042+0000 7ff56560e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:25:12.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.044+0000 7ff4177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:12.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.045+0000 7ff56560e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:12.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.045+0000 7ff56560e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.045+0000 7ff56560e800 5 note: GC not initialized 2024-09-12T00:25:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.045+0000 7ff4167e4640 20 reqs_thread_entry: start 2024-09-12T00:25:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.045+0000 7ff56560e800 20 init_complete bucket index max shards: 11 2024-09-12T00:25:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.045+0000 7ff56560e800 20 Filter name: none 2024-09-12T00:25:12.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.045+0000 7ff40f7fe640 20 reqs_thread_entry: start 2024-09-12T00:25:12.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.056+0000 7ff4177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:25:12.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.058+0000 7ff56560e800 20 remove_watcher() i=0 2024-09-12T00:25:12.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.058+0000 7ff56560e800 2 removed watcher, disabling cache 2024-09-12T00:25:12.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.059+0000 7ff56560e800 20 remove_watcher() i=1 2024-09-12T00:25:12.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.060+0000 7ff56560e800 20 remove_watcher() i=2 2024-09-12T00:25:12.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.062+0000 7ff56560e800 20 remove_watcher() i=3 2024-09-12T00:25:12.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.063+0000 7ff56560e800 20 remove_watcher() i=4 2024-09-12T00:25:12.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.064+0000 7ff56560e800 20 remove_watcher() i=5 2024-09-12T00:25:12.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.065+0000 7ff56560e800 20 remove_watcher() i=6 2024-09-12T00:25:12.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.067+0000 7ff56560e800 20 remove_watcher() i=7 2024-09-12T00:25:12.077 INFO:teuthology.orchestra.run.smithi019.stdout:[] 2024-09-12T00:25:12.077 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:25:12.078 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:25:12.078 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:25:12.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:25:12.078 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:25:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:12.142 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:12.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.170+0000 7f9ad0f35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:12.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.170+0000 7f9ad0f35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:12.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.174+0000 7f998affd640 20 reqs_thread_entry: start 2024-09-12T00:25:12.189 INFO:teuthology.orchestra.run.smithi019.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:25:12.189 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:25:12.190 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:25:12.190 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:25:12.190 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:25:12.255 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:12.256 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.283+0000 7f7d09a40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:12.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.283+0000 7f7d09a40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:12.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.287+0000 7f7b65ffb640 20 reqs_thread_entry: start 2024-09-12T00:25:12.506 INFO:teuthology.orchestra.run.smithi019.stdout:{"id":"844f1394-9f73-45bf-8dcb-b3ca2aab8fdc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:25:12.506 DEBUG:tasks.util.rgw: json result: {'id': '844f1394-9f73-45bf-8dcb-b3ca2aab8fdc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:25:12.506 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:25:12.507 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:25:12.507 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:25:12.507 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:25:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:12.571 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.599+0000 7f059ef20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:12.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.599+0000 7f059ef20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:12.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.603+0000 7f045d7e2640 20 reqs_thread_entry: start 2024-09-12T00:25:12.618 INFO:teuthology.orchestra.run.smithi019.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:25:12.619 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:25:12.619 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:25:12.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:25:12.619 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:25:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:12.685 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:12.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.713+0000 7f1ab7b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:25:12.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.713+0000 7f1ab7b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:25:12.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:25:12.717+0000 7f18f37fe640 20 reqs_thread_entry: start 2024-09-12T00:25:12.733 INFO:teuthology.orchestra.run.smithi019.stdout:{"id":"844f1394-9f73-45bf-8dcb-b3ca2aab8fdc","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:25:12.733 DEBUG:tasks.util.rgw: json result: {'id': '844f1394-9f73-45bf-8dcb-b3ca2aab8fdc', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:25:12.734 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:25:12.734 INFO:tasks.rgw:rgw client.0 config is {'ssl certificate': 'rgw.client.0', 'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2024-09-12T00:25:12.734 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:25:12.734 DEBUG:teuthology.orchestra.run.smithi019:> sudo echo -n https://smithi019.front.sepia.ceph.com:443 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:25:12.775 INFO:teuthology.orchestra.run.smithi019.stdout:https://smithi019.front.sepia.ceph.com:443 2024-09-12T00:25:12.775 DEBUG:teuthology.orchestra.run.smithi019:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:25:12.856 DEBUG:teuthology.orchestra.run.smithi019:> sudo keytool -import -alias smithi019.front.sepia.ceph.com -keystore $(readlink -e $(dirname $(readlink -e $(which keytool)))/../lib/security/cacerts) -file /home/ubuntu/cephtest/ca/rgw.client.0.crt -storepass changeit 2024-09-12T00:25:13.048 INFO:teuthology.orchestra.run.smithi019.stderr:Warning: use -cacerts option to access cacerts keystore 2024-09-12T00:25:13.182 INFO:teuthology.orchestra.run.smithi019.stderr:Certificate was added to keystore 2024-09-12T00:25:13.205 DEBUG:tasks.ceph_manager:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'env', 'OPENSSL_ia32cap=~0x1000000000000000', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--soname-synonyms=somalloc=*tcmalloc*', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--gen-suppressions=all', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--vgdb=yes', '--tool=memcheck', '--max-threads=1024'] 2024-09-12T00:25:13.206 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:25:13.206 DEBUG:teuthology.orchestra.run.smithi019:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term env 'OPENSSL_ia32cap=~0x1000000000000000' valgrind --trace-children=no --child-silent-after-fork=yes '--soname-synonyms=somalloc=*tcmalloc*' --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:25:13.209 INFO:tasks.rgw.client.0:Started 2024-09-12T00:25:13.210 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on https://smithi019.front.sepia.ceph.com:443/ 2024-09-12T00:25:13.210 DEBUG:teuthology.orchestra.run.smithi019:> curl https://smithi019.front.sepia.ceph.com:443/ 2024-09-12T00:25:13.248 INFO:teuthology.orchestra.run.smithi019.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:25:13.248 INFO:teuthology.orchestra.run.smithi019.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:25:13.248 INFO:teuthology.orchestra.run.smithi019.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:25:13.249 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:25:13.249 INFO:teuthology.orchestra.run.smithi019.stderr:curl: (7) Failed to connect to smithi019.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:25:14.250 DEBUG:teuthology.orchestra.run.smithi019:> curl https://smithi019.front.sepia.ceph.com:443/ 2024-09-12T00:25:14.284 INFO:teuthology.orchestra.run.smithi019.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:25:14.284 INFO:teuthology.orchestra.run.smithi019.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:25:14.284 INFO:teuthology.orchestra.run.smithi019.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:25:14.285 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:25:14.285 INFO:teuthology.orchestra.run.smithi019.stderr:curl: (7) Failed to connect to smithi019.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:25:16.287 DEBUG:teuthology.orchestra.run.smithi019:> curl https://smithi019.front.sepia.ceph.com:443/ 2024-09-12T00:25:16.321 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:25:16.322 INFO:teuthology.orchestra.run.smithi019.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:25:16.322 INFO:teuthology.orchestra.run.smithi019.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:25:16.322 INFO:teuthology.orchestra.run.smithi019.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:25:16.322 INFO:teuthology.orchestra.run.smithi019.stderr:curl: (7) Failed to connect to smithi019.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:25:20.323 DEBUG:teuthology.orchestra.run.smithi019:> curl https://smithi019.front.sepia.ceph.com:443/ 2024-09-12T00:25:20.358 INFO:teuthology.orchestra.run.smithi019.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:25:20.358 INFO:teuthology.orchestra.run.smithi019.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:25:20.359 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:25:20.359 INFO:teuthology.orchestra.run.smithi019.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:25:20.359 INFO:teuthology.orchestra.run.smithi019.stderr:curl: (7) Failed to connect to smithi019.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:25:28.361 DEBUG:teuthology.orchestra.run.smithi019:> curl https://smithi019.front.sepia.ceph.com:443/ 2024-09-12T00:25:28.394 INFO:teuthology.orchestra.run.smithi019.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:25:28.395 INFO:teuthology.orchestra.run.smithi019.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:25:28.396 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:25:28.397 INFO:teuthology.orchestra.run.smithi019.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:25:28.397 INFO:teuthology.orchestra.run.smithi019.stderr:curl: (7) Failed to connect to smithi019.front.sepia.ceph.com port 443: Connection refused 2024-09-12T00:25:37.612 INFO:tasks.rgw.client.0.smithi019.stdout:2024-09-12T00:25:37.349+0000 a1be240 -1 ssl_private_key was not found: rgw/cert//default.key 2024-09-12T00:25:44.398 DEBUG:teuthology.orchestra.run.smithi019:> curl https://smithi019.front.sepia.ceph.com:443/ 2024-09-12T00:25:44.439 INFO:teuthology.orchestra.run.smithi019.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:25:44.439 INFO:teuthology.orchestra.run.smithi019.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:25:45.472 INFO:teuthology.orchestra.run.smithi019.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 181 0 --:--:-- 0:00:01 --:--:-- 181 2024-09-12T00:25:45.473 INFO:teuthology.orchestra.run.smithi019.stdout:anonymous 2024-09-12T00:25:45.473 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:25:45.486 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:25:45.487 DEBUG:teuthology.orchestra.run.smithi019:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:25:47.845 DEBUG:teuthology.orchestra.run.smithi019:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:25:48.376 INFO:teuthology.orchestra.run.smithi019.stdout:Collecting tox==3.15.0 2024-09-12T00:25:48.429 INFO:teuthology.orchestra.run.smithi019.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:25:48.592 INFO:teuthology.orchestra.run.smithi019.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:25:48.607 INFO:teuthology.orchestra.run.smithi019.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:25:48.709 INFO:teuthology.orchestra.run.smithi019.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:25:48.724 INFO:teuthology.orchestra.run.smithi019.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:25:48.814 INFO:teuthology.orchestra.run.smithi019.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:25:48.829 INFO:teuthology.orchestra.run.smithi019.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:25:48.903 INFO:teuthology.orchestra.run.smithi019.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:25:48.924 INFO:teuthology.orchestra.run.smithi019.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:25:49.012 INFO:teuthology.orchestra.run.smithi019.stdout:Collecting packaging>=14 2024-09-12T00:25:49.025 INFO:teuthology.orchestra.run.smithi019.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:25:49.101 INFO:teuthology.orchestra.run.smithi019.stdout:Collecting toml>=0.9.4 2024-09-12T00:25:49.116 INFO:teuthology.orchestra.run.smithi019.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:25:49.387 INFO:teuthology.orchestra.run.smithi019.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:25:49.404 INFO:teuthology.orchestra.run.smithi019.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:25:49.678 INFO:teuthology.orchestra.run.smithi019.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:25:49.692 INFO:teuthology.orchestra.run.smithi019.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:25:49.783 INFO:teuthology.orchestra.run.smithi019.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:25:49.799 INFO:teuthology.orchestra.run.smithi019.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:25:49.923 INFO:teuthology.orchestra.run.smithi019.stdout:Installing collected packages: platformdirs, filelock, distlib, virtualenv, toml, six, py, pluggy, packaging, tox 2024-09-12T00:25:50.797 INFO:teuthology.orchestra.run.smithi019.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:25:51.003 INFO:teuthology.orchestra.run.smithi019.stderr:WARNING: You are using pip version 21.3.1; however, version 24.2 is available. 2024-09-12T00:25:51.004 INFO:teuthology.orchestra.run.smithi019.stderr:You should consider upgrading via the '/home/ubuntu/cephtest/tox-venv/bin/python3 -m pip install --upgrade pip' command. 2024-09-12T00:25:51.066 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:25:51.081 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:25:51.082 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:25:51.082 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:25:51.111 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:25:51.112 INFO:teuthology.orchestra.run.smithi019.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:25:51.112 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:25:51.182 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:25:51.182 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:25:51.251 INFO:tasks.workunit:timeout=3h 2024-09-12T00:25:51.251 INFO:tasks.workunit:cleanup=True 2024-09-12T00:25:51.252 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:25:51.321 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:26:37.249 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:26:37.249 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:37.249 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:26:37.249 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:26:37.249 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:37.251 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:26:37.253 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:26:37.328 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:26:37.330 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:26:37.330 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:26:37.941 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:26:38.009 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:26:38.049 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:26:38.051 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:26:38.051 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:26:38.091 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:26:38.094 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:26:38.094 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:26:38.164 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:26:38.165 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:26:38.166 DEBUG:teuthology.orchestra.run.smithi019:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:26:38.238 INFO:tasks.workunit.client.0.smithi019.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:26:38.239 INFO:tasks.workunit.client.0.smithi019.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:26:38.239 INFO:tasks.workunit.client.0.smithi019.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:26:40.638 INFO:tasks.workunit.client.0.smithi019.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:26:40.638 INFO:tasks.workunit.client.0.smithi019.stderr:++ deactivate nondestructive 2024-09-12T00:26:40.638 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T00:26:40.638 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T00:26:40.639 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:26:40.639 INFO:tasks.workunit.client.0.smithi019.stderr:++ hash -r 2024-09-12T00:26:40.639 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T00:26:40.639 INFO:tasks.workunit.client.0.smithi019.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:26:40.639 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:26:40.639 INFO:tasks.workunit.client.0.smithi019.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:26:40.639 INFO:tasks.workunit.client.0.smithi019.stderr:++ export VIRTUAL_ENV 2024-09-12T00:26:40.639 INFO:tasks.workunit.client.0.smithi019.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:26:40.640 INFO:tasks.workunit.client.0.smithi019.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:26:40.640 INFO:tasks.workunit.client.0.smithi019.stderr:++ export PATH 2024-09-12T00:26:40.640 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T00:26:40.640 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -z '' ']' 2024-09-12T00:26:40.640 INFO:tasks.workunit.client.0.smithi019.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:26:40.641 INFO:tasks.workunit.client.0.smithi019.stderr:++ PS1='(rgw) ' 2024-09-12T00:26:40.641 INFO:tasks.workunit.client.0.smithi019.stderr:++ export PS1 2024-09-12T00:26:40.641 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:26:40.641 INFO:tasks.workunit.client.0.smithi019.stderr:++ hash -r 2024-09-12T00:26:40.641 INFO:tasks.workunit.client.0.smithi019.stderr:+ pip install pip --upgrade 2024-09-12T00:26:40.877 INFO:tasks.workunit.client.0.smithi019.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:26:41.076 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting pip 2024-09-12T00:26:41.132 INFO:tasks.workunit.client.0.smithi019.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:26:41.287 INFO:tasks.workunit.client.0.smithi019.stdout:Installing collected packages: pip 2024-09-12T00:26:41.288 INFO:tasks.workunit.client.0.smithi019.stdout: Attempting uninstall: pip 2024-09-12T00:26:41.288 INFO:tasks.workunit.client.0.smithi019.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:26:41.452 INFO:tasks.workunit.client.0.smithi019.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:26:41.458 INFO:tasks.workunit.client.0.smithi019.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:26:42.223 INFO:tasks.workunit.client.0.smithi019.stdout:Successfully installed pip-24.2 2024-09-12T00:26:42.461 INFO:tasks.workunit.client.0.smithi019.stderr:+ pip install boto3 2024-09-12T00:26:43.356 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting boto3 2024-09-12T00:26:43.397 INFO:tasks.workunit.client.0.smithi019.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:26:44.036 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:26:44.049 INFO:tasks.workunit.client.0.smithi019.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:26:44.176 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:26:44.192 INFO:tasks.workunit.client.0.smithi019.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:26:44.316 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:26:44.336 INFO:tasks.workunit.client.0.smithi019.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:26:44.444 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:26:44.460 INFO:tasks.workunit.client.0.smithi019.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:26:44.598 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:26:44.615 INFO:tasks.workunit.client.0.smithi019.stdout: Downloading urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:26:44.858 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:26:44.872 INFO:tasks.workunit.client.0.smithi019.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:26:44.940 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:26:45.027 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:26:45.265 INFO:tasks.workunit.client.0.smithi019.stdout: ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 12.5/12.5 MB 54.9 MB/s eta 0:00:00 2024-09-12T00:26:45.283 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:26:45.338 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:26:45.396 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:26:45.452 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:26:45.504 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:26:45.618 INFO:tasks.workunit.client.0.smithi019.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:26:46.659 INFO:tasks.workunit.client.0.smithi019.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:26:46.777 INFO:tasks.workunit.client.0.smithi019.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:26:46.920 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:26:46.955 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:46.955 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:46.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:46.996+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:46.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:46.998+0000 7f6eed00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:46.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:46.998+0000 7f6eed00e800 20 realm 2024-09-12T00:26:46.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:46.998+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:46.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:46.998+0000 7f6eed00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:46.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:46.998+0000 7f6eed00e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:46.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:46.998+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:46.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:46.998+0000 7f6eed00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:46.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:46.999+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:47.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:46.999+0000 7f6eed00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:47.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:46.999+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:47.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.000+0000 7f6eed00e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:47.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.000+0000 7f6eed00e800 20 searching for the correct realm 2024-09-12T00:26:47.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.203+0000 7f6ee8659640 0 -- 172.21.15.19:0/1441182575 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f6ed807c030 msgr2=0x7f6ed80aa990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:47.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.207+0000 7f6ee8659640 0 -- 172.21.15.19:0/1441182575 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f6ee0038070 msgr2=0x7f6ee0065e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:47.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.415+0000 7f6eed00e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:47.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.415+0000 7f6eed00e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:47.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.415+0000 7f6eed00e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:47.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.415+0000 7f6eed00e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:47.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.415+0000 7f6eed00e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:47.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.415+0000 7f6eed00e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:47.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.415+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:47.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.415+0000 7f6eed00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:47.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.415+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:47.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.415+0000 7f6eed00e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:47.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.415+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:47.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:47.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 20 zone default found 2024-09-12T00:26:47.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 4 Realm: () 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 20 zonegroup default 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.416+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.417+0000 7f6eed00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.417+0000 7f6eed00e800 20 started sync module instance, tier type = 2024-09-12T00:26:47.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.417+0000 7f6eed00e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:47.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.432+0000 7f6eed00e800 20 add_watcher() i=0 2024-09-12T00:26:47.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.432+0000 7f6eed00e800 20 add_watcher() i=1 2024-09-12T00:26:47.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.432+0000 7f6eed00e800 20 add_watcher() i=2 2024-09-12T00:26:47.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.432+0000 7f6eed00e800 20 add_watcher() i=3 2024-09-12T00:26:47.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.432+0000 7f6eed00e800 20 add_watcher() i=4 2024-09-12T00:26:47.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.432+0000 7f6eed00e800 20 add_watcher() i=5 2024-09-12T00:26:47.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.432+0000 7f6eed00e800 20 add_watcher() i=6 2024-09-12T00:26:47.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.434+0000 7f6eed00e800 20 add_watcher() i=7 2024-09-12T00:26:47.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.434+0000 7f6eed00e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:47.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.436+0000 7f6d9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:47.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.436+0000 7f6eed00e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:47.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.436+0000 7f6eed00e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:47.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.436+0000 7f6eed00e800 5 note: GC not initialized 2024-09-12T00:26:47.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.436+0000 7f6d9dfdb640 20 reqs_thread_entry: start 2024-09-12T00:26:47.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:47.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 20 Filter name: none 2024-09-12T00:26:47.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6d0f7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:47.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:26:47.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:47.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:47.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:26:47.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:26:47.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:26:47.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:47.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:47.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:26:47.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.437+0000 7f6eed00e800 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:26:47.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.438+0000 7f6eed00e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:26:47.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.438+0000 7f6eed00e800 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:26:47.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.439+0000 7f6eed00e800 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:26:47.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.439+0000 7f6eed00e800 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:26:47.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.439+0000 7f6eed00e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:26:47.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.439+0000 7f6dbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94056270088272 notifier 4538 bl.length()=593 2024-09-12T00:26:47.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.439+0000 7f6dbf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:26:47.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.439+0000 7f6dbf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:26:47.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.466+0000 7f6eed00e800 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:26:47.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.466+0000 7f6eed00e800 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:26:47.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.466+0000 7f6eed00e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:26:47.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.466+0000 7f6dbf7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 171798691840 cookie 94056270079184 notifier 4538 bl.length()=186 2024-09-12T00:26:47.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.466+0000 7f6dbf7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:26:47.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.466+0000 7f6dbf7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:26:47.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.468+0000 7f6d9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:47.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.471+0000 7f6eed00e800 20 remove_watcher() i=0 2024-09-12T00:26:47.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.471+0000 7f6eed00e800 2 removed watcher, disabling cache 2024-09-12T00:26:47.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.472+0000 7f6eed00e800 20 remove_watcher() i=1 2024-09-12T00:26:47.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.473+0000 7f6eed00e800 20 remove_watcher() i=2 2024-09-12T00:26:47.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.475+0000 7f6eed00e800 20 remove_watcher() i=3 2024-09-12T00:26:47.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.476+0000 7f6eed00e800 20 remove_watcher() i=4 2024-09-12T00:26:47.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.477+0000 7f6eed00e800 20 remove_watcher() i=5 2024-09-12T00:26:47.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.478+0000 7f6eed00e800 20 remove_watcher() i=6 2024-09-12T00:26:47.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:47.480+0000 7f6eed00e800 20 remove_watcher() i=7 2024-09-12T00:26:47.684 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:47.684 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:47.858 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:47.858 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:47.963 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:47.963 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:48.208 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:48.208 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:48.649 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:48.649 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:48.762 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:48.762 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:48.815 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:48.815 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:48.841 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:48.841 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:48.946 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:48.946 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:49.092 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:49.093 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:49.130 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:49.130 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:49.184 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:49.184 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:49.209 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:49.297 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:49.298 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:49.322 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:49.323 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:49.380 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:49.380 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:49.404 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:26:49.404 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:49.405 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:26:49.436 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:49.436 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:49.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.477+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.478+0000 7fdda100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:49.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.478+0000 7fdda100e800 20 realm 2024-09-12T00:26:49.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.478+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.479+0000 7fdda100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:49.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.479+0000 7fdda100e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:49.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.479+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.479+0000 7fdda100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:49.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.479+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.480+0000 7fdda100e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:49.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.480+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:49.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.480+0000 7fdda100e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:49.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.480+0000 7fdda100e800 20 searching for the correct realm 2024-09-12T00:26:49.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:49.482+0000 7fdd9c659640 0 -- 172.21.15.19:0/995088368 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7fdd8c06c040 msgr2=0x7fdd8c08b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:50.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.088+0000 7fdd9ce5a640 0 -- 172.21.15.19:0/995088368 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7fdd8c09d7d0 msgr2=0x7fdd8c09b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:50.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.299+0000 7fdda100e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:50.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.299+0000 7fdda100e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:50.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.299+0000 7fdda100e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:50.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.299+0000 7fdda100e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:50.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.299+0000 7fdda100e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:50.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.299+0000 7fdda100e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:50.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.299+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.299+0000 7fdda100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.299+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:50.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:50.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 20 zone default found 2024-09-12T00:26:50.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 4 Realm: () 2024-09-12T00:26:50.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:50.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:50.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:50.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 20 zonegroup default 2024-09-12T00:26:50.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.300+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.301+0000 7fdda100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.301+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.301+0000 7fdda100e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.301+0000 7fdda100e800 20 started sync module instance, tier type = 2024-09-12T00:26:50.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.301+0000 7fdda100e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:50.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.318+0000 7fdda100e800 20 add_watcher() i=0 2024-09-12T00:26:50.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.318+0000 7fdda100e800 20 add_watcher() i=1 2024-09-12T00:26:50.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.318+0000 7fdda100e800 20 add_watcher() i=2 2024-09-12T00:26:50.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.318+0000 7fdda100e800 20 add_watcher() i=3 2024-09-12T00:26:50.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.318+0000 7fdda100e800 20 add_watcher() i=4 2024-09-12T00:26:50.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.318+0000 7fdda100e800 20 add_watcher() i=5 2024-09-12T00:26:50.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.318+0000 7fdda100e800 20 add_watcher() i=6 2024-09-12T00:26:50.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.321+0000 7fdda100e800 20 add_watcher() i=7 2024-09-12T00:26:50.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.321+0000 7fdda100e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:50.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.323+0000 7fdc52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:50.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.323+0000 7fdda100e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:50.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.323+0000 7fdda100e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:50.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.323+0000 7fdda100e800 5 note: GC not initialized 2024-09-12T00:26:50.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.323+0000 7fdc51fdb640 20 reqs_thread_entry: start 2024-09-12T00:26:50.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.324+0000 7fdda100e800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:50.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.324+0000 7fdda100e800 20 Filter name: none 2024-09-12T00:26:50.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.324+0000 7fdbc37fe640 20 reqs_thread_entry: start 2024-09-12T00:26:50.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.324+0000 7fdda100e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:26:50.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.324+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.325+0000 7fdda100e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:50.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.325+0000 7fdda100e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:26:50.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.325+0000 7fdda100e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:26:50.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.325+0000 7fdda100e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 : miss 2024-09-12T00:26:50.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.325+0000 7fdda100e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.325+0000 7fdda100e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:50.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.325+0000 7fdda100e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 info.flags=0x17 2024-09-12T00:26:50.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.325+0000 7fdda100e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 to cache LRU end 2024-09-12T00:26:50.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.325+0000 7fdda100e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:50.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.325+0000 7fdda100e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:26:50.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.325+0000 7fdda100e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 2024-09-12T00:26:50.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.326+0000 7fdda100e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:50.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.326+0000 7fdda100e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:50.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.327+0000 7fdda100e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:50.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.328+0000 7fdda100e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:50.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.328+0000 7fdda100e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:50.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.329+0000 7fdda100e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:50.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.329+0000 7fdda100e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:50.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.330+0000 7fdda100e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:50.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.331+0000 7fdda100e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:50.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.331+0000 7fdda100e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:50.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.332+0000 7fdda100e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:50.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.342+0000 7fdc52fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:50.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.345+0000 7fdda100e800 20 remove_watcher() i=0 2024-09-12T00:26:50.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.345+0000 7fdda100e800 2 removed watcher, disabling cache 2024-09-12T00:26:50.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.346+0000 7fdda100e800 20 remove_watcher() i=1 2024-09-12T00:26:50.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.349+0000 7fdda100e800 20 remove_watcher() i=2 2024-09-12T00:26:50.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.350+0000 7fdda100e800 20 remove_watcher() i=3 2024-09-12T00:26:50.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.352+0000 7fdda100e800 20 remove_watcher() i=4 2024-09-12T00:26:50.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.353+0000 7fdda100e800 20 remove_watcher() i=5 2024-09-12T00:26:50.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.355+0000 7fdda100e800 20 remove_watcher() i=6 2024-09-12T00:26:50.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.358+0000 7fdda100e800 20 remove_watcher() i=7 2024-09-12T00:26:50.372 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:26:50.404 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:50.404 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:50.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.445+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.447+0000 7f3eb4fab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.447+0000 7f3eb4fab800 20 realm 2024-09-12T00:26:50.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.447+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.448+0000 7f3eb4fab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.448+0000 7f3eb4fab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:50.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.448+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.448+0000 7f3eb4fab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.448+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.650+0000 7f3eb4fab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:50.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.650+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.651+0000 7f3eb4fab800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:50.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.651+0000 7f3eb4fab800 20 searching for the correct realm 2024-09-12T00:26:50.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.655+0000 7f3eabfff640 0 -- 172.21.15.19:0/2779069022 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3e9c013920 msgr2=0x7f3e9c0383d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:50.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.660+0000 7f3eb3296640 0 -- 172.21.15.19:0/2779069022 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5651c5368fc0 msgr2=0x5651c536b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:50.664 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.665+0000 7f3eb4fab800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:50.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.665+0000 7f3eb4fab800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:50.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.665+0000 7f3eb4fab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:50.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.665+0000 7f3eb4fab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:50.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.665+0000 7f3eb4fab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:50.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.665+0000 7f3eb4fab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:50.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.665+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.665+0000 7f3eb4fab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.665+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.665+0000 7f3eb4fab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:50.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.665+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 20 zone default found 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 4 Realm: () 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 20 zonegroup default 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.666+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.667+0000 7f3eb4fab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.667+0000 7f3eb4fab800 20 started sync module instance, tier type = 2024-09-12T00:26:50.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.667+0000 7f3eb4fab800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:50.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.688+0000 7f3eb4fab800 20 add_watcher() i=0 2024-09-12T00:26:50.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.688+0000 7f3eb4fab800 20 add_watcher() i=1 2024-09-12T00:26:50.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.688+0000 7f3eb4fab800 20 add_watcher() i=2 2024-09-12T00:26:50.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.688+0000 7f3eb4fab800 20 add_watcher() i=3 2024-09-12T00:26:50.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.688+0000 7f3eb4fab800 20 add_watcher() i=4 2024-09-12T00:26:50.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.688+0000 7f3eb4fab800 20 add_watcher() i=5 2024-09-12T00:26:50.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.688+0000 7f3eb4fab800 20 add_watcher() i=6 2024-09-12T00:26:50.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.689+0000 7f3eb4fab800 20 add_watcher() i=7 2024-09-12T00:26:50.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.689+0000 7f3eb4fab800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:50.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.691+0000 7f3d697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:50.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.692+0000 7f3eb4fab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:50.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.692+0000 7f3eb4fab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:50.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.692+0000 7f3eb4fab800 5 note: GC not initialized 2024-09-12T00:26:50.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.692+0000 7f3ce3fff640 20 reqs_thread_entry: start 2024-09-12T00:26:50.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.692+0000 7f3eb4fab800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:50.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.692+0000 7f3eb4fab800 20 Filter name: none 2024-09-12T00:26:50.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.692+0000 7f3ce1ffb640 20 reqs_thread_entry: start 2024-09-12T00:26:50.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.692+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.693+0000 7f3eb4fab800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:50.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.693+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.693+0000 7f3eb4fab800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:50.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.693+0000 7f3eb4fab800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:50.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.693+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.694+0000 7f3eb4fab800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:50.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.694+0000 7f3eb4fab800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.694+0000 7f3eb4fab800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:50.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.694+0000 7f3eb4fab800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:50.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.696+0000 7f3d697e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:50.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.699+0000 7f3eb4fab800 20 remove_watcher() i=0 2024-09-12T00:26:50.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.699+0000 7f3eb4fab800 2 removed watcher, disabling cache 2024-09-12T00:26:50.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.700+0000 7f3eb4fab800 20 remove_watcher() i=1 2024-09-12T00:26:50.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.701+0000 7f3eb4fab800 20 remove_watcher() i=2 2024-09-12T00:26:50.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.703+0000 7f3eb4fab800 20 remove_watcher() i=3 2024-09-12T00:26:50.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.704+0000 7f3eb4fab800 20 remove_watcher() i=4 2024-09-12T00:26:50.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.705+0000 7f3eb4fab800 20 remove_watcher() i=5 2024-09-12T00:26:50.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.707+0000 7f3eb4fab800 20 remove_watcher() i=6 2024-09-12T00:26:50.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.709+0000 7f3eb4fab800 20 remove_watcher() i=7 2024-09-12T00:26:50.720 INFO:tasks.workunit.client.0.smithi019.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 90, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:26:50.721 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:26:50.721 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:50.722 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:26:50.756 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:50.756 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:50.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.797+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.799+0000 7f899172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.799+0000 7f899172e800 20 realm 2024-09-12T00:26:50.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.799+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.799+0000 7f899172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.799+0000 7f899172e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:50.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.799+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.799+0000 7f899172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.799+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.800+0000 7f899172e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:50.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.800+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.800+0000 7f899172e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:50.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.800+0000 7f899172e800 20 searching for the correct realm 2024-09-12T00:26:50.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.804+0000 7f898cb63640 0 -- 172.21.15.19:0/639399147 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f8984013370 msgr2=0x7f89840137d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:50.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.808+0000 7f898d364640 0 -- 172.21.15.19:0/639399147 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f89880a5040 msgr2=0x7f898804a3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:50.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.812+0000 7f899172e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:50.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.812+0000 7f899172e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:50.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.812+0000 7f899172e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:50.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.812+0000 7f899172e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:50.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.812+0000 7f899172e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:50.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.812+0000 7f899172e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:50.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.812+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 20 zone default found 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 4 Realm: () 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 20 zonegroup default 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.813+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.814+0000 7f899172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.814+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.815+0000 7f899172e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:50.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.815+0000 7f899172e800 20 started sync module instance, tier type = 2024-09-12T00:26:50.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.815+0000 7f899172e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:50.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.835+0000 7f899172e800 20 add_watcher() i=0 2024-09-12T00:26:50.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.835+0000 7f899172e800 20 add_watcher() i=1 2024-09-12T00:26:50.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.835+0000 7f899172e800 20 add_watcher() i=2 2024-09-12T00:26:50.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.835+0000 7f899172e800 20 add_watcher() i=3 2024-09-12T00:26:50.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.835+0000 7f899172e800 20 add_watcher() i=4 2024-09-12T00:26:50.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.835+0000 7f899172e800 20 add_watcher() i=5 2024-09-12T00:26:50.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.835+0000 7f899172e800 20 add_watcher() i=6 2024-09-12T00:26:50.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.837+0000 7f899172e800 20 add_watcher() i=7 2024-09-12T00:26:50.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.837+0000 7f899172e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:50.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.839+0000 7f88437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:50.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.839+0000 7f899172e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:50.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.839+0000 7f899172e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:50.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.839+0000 7f899172e800 5 note: GC not initialized 2024-09-12T00:26:50.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.840+0000 7f88427e4640 20 reqs_thread_entry: start 2024-09-12T00:26:50.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.840+0000 7f899172e800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:50.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.840+0000 7f899172e800 20 Filter name: none 2024-09-12T00:26:50.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.840+0000 7f87b3fff640 20 reqs_thread_entry: start 2024-09-12T00:26:50.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.840+0000 7f899172e800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:26:50.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.840+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:50.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:26:50.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:26:50.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 : miss 2024-09-12T00:26:50.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 20 rados->read ofs=0 len=0 2024-09-12T00:26:50.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:50.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 info.flags=0x17 2024-09-12T00:26:50.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 to cache LRU end 2024-09-12T00:26:50.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:50.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:26:50.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 2024-09-12T00:26:50.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.841+0000 7f899172e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:50.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.842+0000 7f899172e800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:26:50.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.842+0000 7f899172e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:50.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.842+0000 7f899172e800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:26:50.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.842+0000 7f899172e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:50.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.843+0000 7f899172e800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:26:50.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.843+0000 7f899172e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:50.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.844+0000 7f899172e800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:26:50.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.844+0000 7f899172e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:50.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.844+0000 7f899172e800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:26:50.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.844+0000 7f899172e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:50.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.845+0000 7f899172e800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:26:50.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.845+0000 7f899172e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:50.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.845+0000 7f899172e800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:26:50.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.845+0000 7f899172e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:50.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.846+0000 7f899172e800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:26:50.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.846+0000 7f899172e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:50.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.846+0000 7f899172e800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:26:50.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.846+0000 7f899172e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:50.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.847+0000 7f899172e800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:26:50.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.847+0000 7f899172e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:50.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.848+0000 7f899172e800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:26:50.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.848+0000 7f899172e800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:26:50.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.849+0000 7f88437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:50.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.851+0000 7f899172e800 20 remove_watcher() i=0 2024-09-12T00:26:50.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.851+0000 7f899172e800 2 removed watcher, disabling cache 2024-09-12T00:26:50.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.852+0000 7f899172e800 20 remove_watcher() i=1 2024-09-12T00:26:50.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.853+0000 7f899172e800 20 remove_watcher() i=2 2024-09-12T00:26:50.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.854+0000 7f899172e800 20 remove_watcher() i=3 2024-09-12T00:26:50.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.855+0000 7f899172e800 20 remove_watcher() i=4 2024-09-12T00:26:50.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.856+0000 7f899172e800 20 remove_watcher() i=5 2024-09-12T00:26:50.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.858+0000 7f899172e800 20 remove_watcher() i=6 2024-09-12T00:26:50.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:50.859+0000 7f899172e800 20 remove_watcher() i=7 2024-09-12T00:26:50.871 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:26:51.293 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:26:52.718 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:52.718 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:52.818 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:26:52.819 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:26:52.853 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:52.853 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:52.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.896+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.899+0000 7f9210220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.899+0000 7f9210220800 20 realm 2024-09-12T00:26:52.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.899+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.899+0000 7f9210220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.899+0000 7f9210220800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:52.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.899+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.899+0000 7f9210220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:52.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.899+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.900+0000 7f9210220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:52.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.900+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:52.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.900+0000 7f9210220800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:52.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.900+0000 7f9210220800 20 searching for the correct realm 2024-09-12T00:26:52.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:52.904+0000 7f920d509640 0 -- 172.21.15.19:0/3377384690 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f9204009040 msgr2=0x7f920403b3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:53.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.312+0000 7f920dd0a640 0 -- 172.21.15.19:0/3377384690 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f9208095640 msgr2=0x7f920807b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:53.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.719+0000 7f9210220800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:53.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.719+0000 7f9210220800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:53.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.719+0000 7f9210220800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:53.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.719+0000 7f9210220800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:53.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.719+0000 7f9210220800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:53.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.719+0000 7f9210220800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:53.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.719+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.720+0000 7f9210220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:53.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.720+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.720+0000 7f9210220800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:53.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.720+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:53.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 20 zone default found 2024-09-12T00:26:53.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 4 Realm: () 2024-09-12T00:26:53.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:53.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:53.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:53.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 20 zonegroup default 2024-09-12T00:26:53.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:53.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:53.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.721+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.722+0000 7f9210220800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:53.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.722+0000 7f9210220800 20 started sync module instance, tier type = 2024-09-12T00:26:53.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.722+0000 7f9210220800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:53.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.734+0000 7f9210220800 20 add_watcher() i=0 2024-09-12T00:26:53.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.734+0000 7f9210220800 20 add_watcher() i=1 2024-09-12T00:26:53.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.734+0000 7f9210220800 20 add_watcher() i=2 2024-09-12T00:26:53.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.734+0000 7f9210220800 20 add_watcher() i=3 2024-09-12T00:26:53.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.734+0000 7f9210220800 20 add_watcher() i=4 2024-09-12T00:26:53.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.734+0000 7f9210220800 20 add_watcher() i=5 2024-09-12T00:26:53.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.735+0000 7f9210220800 20 add_watcher() i=6 2024-09-12T00:26:53.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.736+0000 7f9210220800 20 add_watcher() i=7 2024-09-12T00:26:53.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.736+0000 7f9210220800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:53.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.738+0000 7f90bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:53.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.738+0000 7f9210220800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:53.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.738+0000 7f9210220800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:53.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.738+0000 7f9210220800 5 note: GC not initialized 2024-09-12T00:26:53.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.738+0000 7f90be7fc640 20 reqs_thread_entry: start 2024-09-12T00:26:53.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.738+0000 7f9210220800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:53.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.739+0000 7f9210220800 20 Filter name: none 2024-09-12T00:26:53.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.739+0000 7f902ffff640 20 reqs_thread_entry: start 2024-09-12T00:26:53.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.739+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.739+0000 7f9210220800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:53.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.739+0000 7f9210220800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.740+0000 7f9210220800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:53.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.740+0000 7f9210220800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:53.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.740+0000 7f9210220800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:26:53.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.740+0000 7f9210220800 20 INFO: main: starting shard=0 2024-09-12T00:26:53.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.740+0000 7f9210220800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:53.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.740+0000 7f9210220800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:53.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.740+0000 7f9210220800 20 INFO: main: starting shard=1 2024-09-12T00:26:53.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.740+0000 7f9210220800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:53.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.741+0000 7f9210220800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:53.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.741+0000 7f9210220800 20 INFO: main: starting shard=2 2024-09-12T00:26:53.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.741+0000 7f9210220800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:53.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.742+0000 7f9210220800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:53.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.742+0000 7f9210220800 20 INFO: main: starting shard=3 2024-09-12T00:26:53.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.742+0000 7f9210220800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:53.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.742+0000 7f9210220800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:53.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.742+0000 7f9210220800 20 INFO: main: starting shard=4 2024-09-12T00:26:53.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.742+0000 7f9210220800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:53.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.743+0000 7f9210220800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:53.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.743+0000 7f9210220800 20 INFO: main: starting shard=5 2024-09-12T00:26:53.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.743+0000 7f9210220800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:53.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.744+0000 7f9210220800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:53.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.744+0000 7f9210220800 20 INFO: main: starting shard=6 2024-09-12T00:26:53.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.744+0000 7f9210220800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:53.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.744+0000 7f9210220800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:53.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.744+0000 7f9210220800 20 INFO: main: starting shard=7 2024-09-12T00:26:53.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.744+0000 7f9210220800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:53.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.745+0000 7f9210220800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:53.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.745+0000 7f9210220800 20 INFO: main: starting shard=8 2024-09-12T00:26:53.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.745+0000 7f9210220800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:53.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.746+0000 7f9210220800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:26:53.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.746+0000 7f9210220800 20 INFO: main: starting shard=9 2024-09-12T00:26:53.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.746+0000 7f9210220800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:53.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.747+0000 7f9210220800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:53.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.747+0000 7f9210220800 20 INFO: main: starting shard=10 2024-09-12T00:26:53.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.747+0000 7f9210220800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:53.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.747+0000 7f9210220800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:53.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.747+0000 7f9210220800 20 INFO: main: done 2024-09-12T00:26:53.747 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.748+0000 7f90bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:53.750 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.751+0000 7f9210220800 20 remove_watcher() i=0 2024-09-12T00:26:53.750 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.751+0000 7f9210220800 2 removed watcher, disabling cache 2024-09-12T00:26:53.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.752+0000 7f9210220800 20 remove_watcher() i=1 2024-09-12T00:26:53.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.754+0000 7f9210220800 20 remove_watcher() i=2 2024-09-12T00:26:53.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.755+0000 7f9210220800 20 remove_watcher() i=3 2024-09-12T00:26:53.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.757+0000 7f9210220800 20 remove_watcher() i=4 2024-09-12T00:26:53.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.758+0000 7f9210220800 20 remove_watcher() i=5 2024-09-12T00:26:53.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.760+0000 7f9210220800 20 remove_watcher() i=6 2024-09-12T00:26:53.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.761+0000 7f9210220800 20 remove_watcher() i=7 2024-09-12T00:26:53.776 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.777 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:53.803 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.803 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:53.830 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:53.830 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:53.914 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:26:53.915 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:26:53.948 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:53.948 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:53.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.988+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.990+0000 7fda1f813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:53.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.990+0000 7fda1f813800 20 realm 2024-09-12T00:26:53.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.990+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.990+0000 7fda1f813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:53.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.990+0000 7fda1f813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:53.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.990+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.990+0000 7fda1f813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:53.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.990+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.991+0000 7fda1f813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:53.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.991+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:53.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.991+0000 7fda1f813800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:53.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.992+0000 7fda1f813800 20 searching for the correct realm 2024-09-12T00:26:53.994 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.995+0000 7fda1a747640 0 -- 172.21.15.19:0/3512322463 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fda10067a50 msgr2=0x7fda1009ea10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:53.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:53.999+0000 7fda1b749640 0 -- 172.21.15.19:0/3512322463 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x56431d4df520 msgr2=0x56431d4e1930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:54.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.003+0000 7fda1f813800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:54.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.003+0000 7fda1f813800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:54.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.003+0000 7fda1f813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:54.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.003+0000 7fda1f813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:54.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.003+0000 7fda1f813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:54.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.003+0000 7fda1f813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:54.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.003+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:54.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:54.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 20 zone default found 2024-09-12T00:26:54.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 4 Realm: () 2024-09-12T00:26:54.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:54.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:54.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:54.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 20 zonegroup default 2024-09-12T00:26:54.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.004+0000 7fda1f813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.005+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.005+0000 7fda1f813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.005+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.005+0000 7fda1f813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.005+0000 7fda1f813800 20 started sync module instance, tier type = 2024-09-12T00:26:54.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.005+0000 7fda1f813800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:54.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.016+0000 7fda1f813800 20 add_watcher() i=0 2024-09-12T00:26:54.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.016+0000 7fda1f813800 20 add_watcher() i=1 2024-09-12T00:26:54.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.016+0000 7fda1f813800 20 add_watcher() i=2 2024-09-12T00:26:54.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.016+0000 7fda1f813800 20 add_watcher() i=3 2024-09-12T00:26:54.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.016+0000 7fda1f813800 20 add_watcher() i=4 2024-09-12T00:26:54.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.016+0000 7fda1f813800 20 add_watcher() i=5 2024-09-12T00:26:54.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.016+0000 7fda1f813800 20 add_watcher() i=6 2024-09-12T00:26:54.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.017+0000 7fda1f813800 20 add_watcher() i=7 2024-09-12T00:26:54.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.017+0000 7fda1f813800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:54.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.019+0000 7fd8d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:54.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.020+0000 7fda1f813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:54.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.020+0000 7fda1f813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:54.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.020+0000 7fda1f813800 5 note: GC not initialized 2024-09-12T00:26:54.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.020+0000 7fd84bfff640 20 reqs_thread_entry: start 2024-09-12T00:26:54.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.020+0000 7fda1f813800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:54.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.020+0000 7fda1f813800 20 Filter name: none 2024-09-12T00:26:54.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.020+0000 7fd849ffb640 20 reqs_thread_entry: start 2024-09-12T00:26:54.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.020+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.021+0000 7fda1f813800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:54.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.021+0000 7fda1f813800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.021+0000 7fda1f813800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:54.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.021+0000 7fda1f813800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:54.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.021+0000 7fda1f813800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:26:54.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.021+0000 7fda1f813800 20 INFO: main: starting shard=0 2024-09-12T00:26:54.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.021+0000 7fda1f813800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:54.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.022+0000 7fda1f813800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.022+0000 7fda1f813800 20 INFO: main: starting shard=1 2024-09-12T00:26:54.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.022+0000 7fda1f813800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:54.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.022+0000 7fda1f813800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.022+0000 7fda1f813800 20 INFO: main: starting shard=2 2024-09-12T00:26:54.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.022+0000 7fda1f813800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:54.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.023+0000 7fda1f813800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.023+0000 7fda1f813800 20 INFO: main: starting shard=3 2024-09-12T00:26:54.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.023+0000 7fda1f813800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:54.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.023+0000 7fda1f813800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.023+0000 7fda1f813800 20 INFO: main: starting shard=4 2024-09-12T00:26:54.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.023+0000 7fda1f813800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:54.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.024+0000 7fda1f813800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.024+0000 7fda1f813800 20 INFO: main: starting shard=5 2024-09-12T00:26:54.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.024+0000 7fda1f813800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:54.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.024+0000 7fda1f813800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:26:54.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.024+0000 7fda1f813800 20 INFO: main: starting shard=6 2024-09-12T00:26:54.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.024+0000 7fda1f813800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:54.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.025+0000 7fda1f813800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.025+0000 7fda1f813800 20 INFO: main: starting shard=7 2024-09-12T00:26:54.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.025+0000 7fda1f813800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:54.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.025+0000 7fda1f813800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.025+0000 7fda1f813800 20 INFO: main: starting shard=8 2024-09-12T00:26:54.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.025+0000 7fda1f813800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:54.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.026+0000 7fda1f813800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.026+0000 7fda1f813800 20 INFO: main: starting shard=9 2024-09-12T00:26:54.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.026+0000 7fda1f813800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:54.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.026+0000 7fda1f813800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.026+0000 7fda1f813800 20 INFO: main: starting shard=10 2024-09-12T00:26:54.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.026+0000 7fda1f813800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:54.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.027+0000 7fda1f813800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.027+0000 7fda1f813800 20 INFO: main: done 2024-09-12T00:26:54.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.028+0000 7fd8d17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:54.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.030+0000 7fda1f813800 20 remove_watcher() i=0 2024-09-12T00:26:54.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.030+0000 7fda1f813800 2 removed watcher, disabling cache 2024-09-12T00:26:54.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.031+0000 7fda1f813800 20 remove_watcher() i=1 2024-09-12T00:26:54.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.032+0000 7fda1f813800 20 remove_watcher() i=2 2024-09-12T00:26:54.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.033+0000 7fda1f813800 20 remove_watcher() i=3 2024-09-12T00:26:54.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.035+0000 7fda1f813800 20 remove_watcher() i=4 2024-09-12T00:26:54.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.036+0000 7fda1f813800 20 remove_watcher() i=5 2024-09-12T00:26:54.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.037+0000 7fda1f813800 20 remove_watcher() i=6 2024-09-12T00:26:54.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.038+0000 7fda1f813800 20 remove_watcher() i=7 2024-09-12T00:26:54.051 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:54.051 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:54.077 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:54.077 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:54.161 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:26:54.163 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:26:54.194 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:54.195 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:54.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.234+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.236+0000 7fe6da231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.236+0000 7fe6da231800 20 realm 2024-09-12T00:26:54.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.236+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.236+0000 7fe6da231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.236+0000 7fe6da231800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:54.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.236+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.236+0000 7fe6da231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.236+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.237+0000 7fe6da231800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:54.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.237+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.237+0000 7fe6da231800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:54.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.237+0000 7fe6da231800 20 searching for the correct realm 2024-09-12T00:26:54.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.240+0000 7fe6d4d8a640 0 -- 172.21.15.19:0/3672761072 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fe6cc0698d0 msgr2=0x7fe6cc06a8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:54.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.445+0000 7fe6d5d8c640 0 -- 172.21.15.19:0/3672761072 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55577d928de0 msgr2=0x55577d92b1d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.449+0000 7fe6da231800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.449+0000 7fe6da231800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.449+0000 7fe6da231800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.449+0000 7fe6da231800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.449+0000 7fe6da231800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.449+0000 7fe6da231800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.449+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.449+0000 7fe6da231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.449+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 20 zone default found 2024-09-12T00:26:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 4 Realm: () 2024-09-12T00:26:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 20 zonegroup default 2024-09-12T00:26:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.450+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.451+0000 7fe6da231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.451+0000 7fe6da231800 20 started sync module instance, tier type = 2024-09-12T00:26:54.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.451+0000 7fe6da231800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:54.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.475+0000 7fe6da231800 20 add_watcher() i=0 2024-09-12T00:26:54.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.475+0000 7fe6da231800 20 add_watcher() i=1 2024-09-12T00:26:54.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.475+0000 7fe6da231800 20 add_watcher() i=2 2024-09-12T00:26:54.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.475+0000 7fe6da231800 20 add_watcher() i=3 2024-09-12T00:26:54.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.475+0000 7fe6da231800 20 add_watcher() i=4 2024-09-12T00:26:54.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.475+0000 7fe6da231800 20 add_watcher() i=5 2024-09-12T00:26:54.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.475+0000 7fe6da231800 20 add_watcher() i=6 2024-09-12T00:26:54.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.478+0000 7fe6da231800 20 add_watcher() i=7 2024-09-12T00:26:54.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.478+0000 7fe6da231800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:54.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.480+0000 7fe58bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:54.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.480+0000 7fe6da231800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:54.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.480+0000 7fe6da231800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:54.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.480+0000 7fe6da231800 5 note: GC not initialized 2024-09-12T00:26:54.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.481+0000 7fe58afe5640 20 reqs_thread_entry: start 2024-09-12T00:26:54.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.481+0000 7fe6da231800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:54.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.481+0000 7fe6da231800 20 Filter name: none 2024-09-12T00:26:54.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.481+0000 7fe588fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:54.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.481+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.481+0000 7fe6da231800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:54.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.481+0000 7fe6da231800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.482+0000 7fe6da231800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:54.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.482+0000 7fe6da231800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:54.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.482+0000 7fe6da231800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:26:54.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.482+0000 7fe6da231800 20 INFO: main: starting shard=0 2024-09-12T00:26:54.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.482+0000 7fe6da231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:54.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.482+0000 7fe6da231800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.482+0000 7fe6da231800 20 INFO: main: starting shard=1 2024-09-12T00:26:54.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.482+0000 7fe6da231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:54.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.483+0000 7fe6da231800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:26:54.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.483+0000 7fe6da231800 20 INFO: main: starting shard=2 2024-09-12T00:26:54.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.483+0000 7fe6da231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:54.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.483+0000 7fe6da231800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.483+0000 7fe6da231800 20 INFO: main: starting shard=3 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.483+0000 7fe6da231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.483+0000 7fe6da231800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.483+0000 7fe6da231800 20 INFO: main: starting shard=4 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.483+0000 7fe6da231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.484+0000 7fe6da231800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.484+0000 7fe6da231800 20 INFO: main: starting shard=5 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.484+0000 7fe6da231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.484+0000 7fe6da231800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.484+0000 7fe6da231800 20 INFO: main: starting shard=6 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.484+0000 7fe6da231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.485+0000 7fe6da231800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.485+0000 7fe6da231800 20 INFO: main: starting shard=7 2024-09-12T00:26:54.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.485+0000 7fe6da231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:54.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.485+0000 7fe6da231800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.485+0000 7fe6da231800 20 INFO: main: starting shard=8 2024-09-12T00:26:54.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.485+0000 7fe6da231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:54.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.486+0000 7fe6da231800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.486+0000 7fe6da231800 20 INFO: main: starting shard=9 2024-09-12T00:26:54.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.486+0000 7fe6da231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:54.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.486+0000 7fe6da231800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.486+0000 7fe6da231800 20 INFO: main: starting shard=10 2024-09-12T00:26:54.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.486+0000 7fe6da231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:54.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.487+0000 7fe6da231800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:54.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.487+0000 7fe6da231800 20 INFO: main: done 2024-09-12T00:26:54.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.487+0000 7fe58bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:54.489 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.490+0000 7fe6da231800 20 remove_watcher() i=0 2024-09-12T00:26:54.489 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.490+0000 7fe6da231800 2 removed watcher, disabling cache 2024-09-12T00:26:54.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.492+0000 7fe6da231800 20 remove_watcher() i=1 2024-09-12T00:26:54.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.493+0000 7fe6da231800 20 remove_watcher() i=2 2024-09-12T00:26:54.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.494+0000 7fe6da231800 20 remove_watcher() i=3 2024-09-12T00:26:54.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.497+0000 7fe6da231800 20 remove_watcher() i=4 2024-09-12T00:26:54.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.498+0000 7fe6da231800 20 remove_watcher() i=5 2024-09-12T00:26:54.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.499+0000 7fe6da231800 20 remove_watcher() i=6 2024-09-12T00:26:54.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.500+0000 7fe6da231800 20 remove_watcher() i=7 2024-09-12T00:26:54.513 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:54.513 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:54.537 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:54.538 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:54.623 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:26:54.624 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:26:54.657 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:54.657 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:54.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.698+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.700+0000 7f893d517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.700+0000 7f893d517800 20 realm 2024-09-12T00:26:54.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.700+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.700+0000 7f893d517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.700+0000 7f893d517800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:54.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.700+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.700+0000 7f893d517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:54.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.700+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.701+0000 7f893d517800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:54.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.701+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:54.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.701+0000 7f893d517800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:54.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.701+0000 7f893d517800 20 searching for the correct realm 2024-09-12T00:26:54.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.703+0000 7f893b001640 0 -- 172.21.15.19:0/4253308145 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f892c059060 msgr2=0x7f892c0a70b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:54.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:54.908+0000 7f893b001640 0 -- 172.21.15.19:0/4253308145 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x5632e1187650 msgr2=0x7f8934062440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.115+0000 7f893d517800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.115+0000 7f893d517800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.115+0000 7f893d517800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.115+0000 7f893d517800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.115+0000 7f893d517800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.115+0000 7f893d517800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.115+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 20 zone default found 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 4 Realm: () 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 20 zonegroup default 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.116+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.117+0000 7f893d517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.117+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.117+0000 7f893d517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.117+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.117+0000 7f893d517800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:55.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.117+0000 7f893d517800 20 started sync module instance, tier type = 2024-09-12T00:26:55.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.117+0000 7f893d517800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:55.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.140+0000 7f893d517800 20 add_watcher() i=0 2024-09-12T00:26:55.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.140+0000 7f893d517800 20 add_watcher() i=1 2024-09-12T00:26:55.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.140+0000 7f893d517800 20 add_watcher() i=2 2024-09-12T00:26:55.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.140+0000 7f893d517800 20 add_watcher() i=3 2024-09-12T00:26:55.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.140+0000 7f893d517800 20 add_watcher() i=4 2024-09-12T00:26:55.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.140+0000 7f893d517800 20 add_watcher() i=5 2024-09-12T00:26:55.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.140+0000 7f893d517800 20 add_watcher() i=6 2024-09-12T00:26:55.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.142+0000 7f893d517800 20 add_watcher() i=7 2024-09-12T00:26:55.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.142+0000 7f893d517800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:55.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.144+0000 7f87f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:55.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.144+0000 7f893d517800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:55.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.144+0000 7f893d517800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:55.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.144+0000 7f893d517800 5 note: GC not initialized 2024-09-12T00:26:55.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.145+0000 7f876b7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:55.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.145+0000 7f893d517800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:55.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.145+0000 7f893d517800 20 Filter name: none 2024-09-12T00:26:55.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.145+0000 7f87697fa640 20 reqs_thread_entry: start 2024-09-12T00:26:55.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.145+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.145+0000 7f893d517800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:55.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.145+0000 7f893d517800 20 rados->read ofs=0 len=0 2024-09-12T00:26:55.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.146+0000 7f893d517800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:55.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.146+0000 7f893d517800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:55.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.146+0000 7f893d517800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:26:55.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.146+0000 7f893d517800 20 INFO: main: starting shard=0 2024-09-12T00:26:55.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.146+0000 7f893d517800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:55.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.146+0000 7f893d517800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:55.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.146+0000 7f893d517800 20 INFO: main: starting shard=1 2024-09-12T00:26:55.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.146+0000 7f893d517800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:55.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.147+0000 7f893d517800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:55.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.147+0000 7f893d517800 20 INFO: main: starting shard=2 2024-09-12T00:26:55.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.147+0000 7f893d517800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:55.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.147+0000 7f893d517800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:55.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.147+0000 7f893d517800 20 INFO: main: starting shard=3 2024-09-12T00:26:55.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.147+0000 7f893d517800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:55.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.148+0000 7f893d517800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:55.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.148+0000 7f893d517800 20 INFO: main: starting shard=4 2024-09-12T00:26:55.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.148+0000 7f893d517800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:55.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.148+0000 7f893d517800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:55.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.148+0000 7f893d517800 20 INFO: main: starting shard=5 2024-09-12T00:26:55.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.148+0000 7f893d517800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:55.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.149+0000 7f893d517800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:55.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.149+0000 7f893d517800 20 INFO: main: starting shard=6 2024-09-12T00:26:55.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.149+0000 7f893d517800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:55.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.149+0000 7f893d517800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:55.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.149+0000 7f893d517800 20 INFO: main: starting shard=7 2024-09-12T00:26:55.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.149+0000 7f893d517800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:55.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.151+0000 7f893d517800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:55.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.151+0000 7f893d517800 20 INFO: main: starting shard=8 2024-09-12T00:26:55.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.151+0000 7f893d517800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:55.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.151+0000 7f893d517800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:55.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.151+0000 7f893d517800 20 INFO: main: starting shard=9 2024-09-12T00:26:55.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.151+0000 7f893d517800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:55.151 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.152+0000 7f893d517800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:55.151 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.152+0000 7f893d517800 20 INFO: main: starting shard=10 2024-09-12T00:26:55.151 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.152+0000 7f893d517800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:55.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.152+0000 7f893d517800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:26:55.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.152+0000 7f893d517800 20 INFO: main: done 2024-09-12T00:26:55.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.153+0000 7f87f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:55.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.156+0000 7f893d517800 20 remove_watcher() i=0 2024-09-12T00:26:55.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.156+0000 7f893d517800 2 removed watcher, disabling cache 2024-09-12T00:26:55.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.157+0000 7f893d517800 20 remove_watcher() i=1 2024-09-12T00:26:55.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.159+0000 7f893d517800 20 remove_watcher() i=2 2024-09-12T00:26:55.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.160+0000 7f893d517800 20 remove_watcher() i=3 2024-09-12T00:26:55.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.161+0000 7f893d517800 20 remove_watcher() i=4 2024-09-12T00:26:55.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.162+0000 7f893d517800 20 remove_watcher() i=5 2024-09-12T00:26:55.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.163+0000 7f893d517800 20 remove_watcher() i=6 2024-09-12T00:26:55.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:55.164+0000 7f893d517800 20 remove_watcher() i=7 2024-09-12T00:26:55.178 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:55.178 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:55.203 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:26:55.618 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:26:56.036 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:26:56.036 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:56.037 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:26:56.071 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:56.071 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:56.111 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.112+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.113+0000 7fa21a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.113+0000 7fa21a540800 20 realm 2024-09-12T00:26:56.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.113+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.113+0000 7fa21a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.113+0000 7fa21a540800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:56.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.113+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.114+0000 7fa21a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.114+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.114+0000 7fa21a540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:56.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.114+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.115+0000 7fa21a540800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:56.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.115+0000 7fa21a540800 20 searching for the correct realm 2024-09-12T00:26:56.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.118+0000 7fa215abf640 0 -- 172.21.15.19:0/3733139388 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fa20c0b70f0 msgr2=0x7fa20c0862c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:56.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.324+0000 7fa216ac1640 0 -- 172.21.15.19:0/3733139388 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55b9bd6ff600 msgr2=0x55b9bd701a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:56.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.328+0000 7fa21a540800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:56.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.328+0000 7fa21a540800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.328+0000 7fa21a540800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.328+0000 7fa21a540800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.328+0000 7fa21a540800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.328+0000 7fa21a540800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.328+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.328+0000 7fa21a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.328+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.328+0000 7fa21a540800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.328+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 20 zone default found 2024-09-12T00:26:56.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 4 Realm: () 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 20 zonegroup default 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.329+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.330+0000 7fa21a540800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.330+0000 7fa21a540800 20 started sync module instance, tier type = 2024-09-12T00:26:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.330+0000 7fa21a540800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:56.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.342+0000 7fa21a540800 20 add_watcher() i=0 2024-09-12T00:26:56.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.342+0000 7fa21a540800 20 add_watcher() i=1 2024-09-12T00:26:56.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.342+0000 7fa21a540800 20 add_watcher() i=2 2024-09-12T00:26:56.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.342+0000 7fa21a540800 20 add_watcher() i=3 2024-09-12T00:26:56.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.342+0000 7fa21a540800 20 add_watcher() i=4 2024-09-12T00:26:56.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.342+0000 7fa21a540800 20 add_watcher() i=5 2024-09-12T00:26:56.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.342+0000 7fa21a540800 20 add_watcher() i=6 2024-09-12T00:26:56.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.343+0000 7fa21a540800 20 add_watcher() i=7 2024-09-12T00:26:56.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.343+0000 7fa21a540800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:56.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.345+0000 7fa0ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:56.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.345+0000 7fa21a540800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:56.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.345+0000 7fa21a540800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:56.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.345+0000 7fa21a540800 5 note: GC not initialized 2024-09-12T00:26:56.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.345+0000 7fa0477fe640 20 reqs_thread_entry: start 2024-09-12T00:26:56.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.345+0000 7fa21a540800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:56.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.345+0000 7fa21a540800 20 Filter name: none 2024-09-12T00:26:56.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.345+0000 7fa0457fa640 20 reqs_thread_entry: start 2024-09-12T00:26:56.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:26:56.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 : miss 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 info.flags=0x17 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 to cache LRU end 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.346+0000 7fa21a540800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 2024-09-12T00:26:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.347+0000 7fa21a540800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:56.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.347+0000 7fa21a540800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:26:56.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.347+0000 7fa21a540800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:56.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.347+0000 7fa21a540800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:56.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.348+0000 7fa21a540800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:26:56.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.348+0000 7fa21a540800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:56.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.349+0000 7fa21a540800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:26:56.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.349+0000 7fa21a540800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:56.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.349+0000 7fa21a540800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:26:56.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.349+0000 7fa21a540800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:56.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.349+0000 7fa21a540800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:56.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.350+0000 7fa21a540800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:26:56.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.350+0000 7fa21a540800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:56.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.350+0000 7fa21a540800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:26:56.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.350+0000 7fa21a540800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:56.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.351+0000 7fa21a540800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:56.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.351+0000 7fa21a540800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:26:56.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.351+0000 7fa21a540800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:56.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.352+0000 7fa21a540800 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T00:26:56.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.352+0000 7fa21a540800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:26:56.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.352+0000 7fa21a540800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:26:56.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.352+0000 7fa21a540800 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T00:26:56.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.352+0000 7fa21a540800 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:26:56.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.353+0000 7fa0ccfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:56.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.355+0000 7fa21a540800 20 remove_watcher() i=0 2024-09-12T00:26:56.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.355+0000 7fa21a540800 2 removed watcher, disabling cache 2024-09-12T00:26:56.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.356+0000 7fa21a540800 20 remove_watcher() i=1 2024-09-12T00:26:56.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.358+0000 7fa21a540800 20 remove_watcher() i=2 2024-09-12T00:26:56.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.359+0000 7fa21a540800 20 remove_watcher() i=3 2024-09-12T00:26:56.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.361+0000 7fa21a540800 20 remove_watcher() i=4 2024-09-12T00:26:56.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.363+0000 7fa21a540800 20 remove_watcher() i=5 2024-09-12T00:26:56.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.364+0000 7fa21a540800 20 remove_watcher() i=6 2024-09-12T00:26:56.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.367+0000 7fa21a540800 20 remove_watcher() i=7 2024-09-12T00:26:56.377 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: unlinked entries are not listable 2024-09-12T00:26:56.377 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:56.380 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.380 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:56.503 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:26:56.503 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:56.505 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.505 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:56.578 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:56.578 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:56.639 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:26:56.639 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:56.640 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:26:56.676 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:56.676 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:56.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.716+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.718+0000 7fa33d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.718+0000 7fa33d935800 20 realm 2024-09-12T00:26:56.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.718+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.718+0000 7fa33d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.718+0000 7fa33d935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:56.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.718+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.719+0000 7fa33d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.719+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.719+0000 7fa33d935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:56.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.719+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.720+0000 7fa33d935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:56.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.720+0000 7fa33d935800 20 searching for the correct realm 2024-09-12T00:26:56.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.723+0000 7fa330e7c640 0 -- 172.21.15.19:0/3764693909 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fa32407d960 msgr2=0x7fa32406c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:56.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.929+0000 7fa330e7c640 0 -- 172.21.15.19:0/3764693909 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55ce64fed040 msgr2=0x55ce64fef4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:56.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.933+0000 7fa33d935800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:56.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.933+0000 7fa33d935800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:56.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.933+0000 7fa33d935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:56.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.933+0000 7fa33d935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:56.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.933+0000 7fa33d935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:56.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.933+0000 7fa33d935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:56.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.933+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:56.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:56.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 20 zone default found 2024-09-12T00:26:56.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 4 Realm: () 2024-09-12T00:26:56.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:56.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:56.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:56.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 20 zonegroup default 2024-09-12T00:26:56.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.934+0000 7fa33d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.935+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.935+0000 7fa33d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.935+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.935+0000 7fa33d935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:56.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.935+0000 7fa33d935800 20 started sync module instance, tier type = 2024-09-12T00:26:56.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.935+0000 7fa33d935800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.951+0000 7fa33d935800 20 add_watcher() i=0 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.951+0000 7fa33d935800 20 add_watcher() i=1 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.951+0000 7fa33d935800 20 add_watcher() i=2 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.951+0000 7fa33d935800 20 add_watcher() i=3 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.951+0000 7fa33d935800 20 add_watcher() i=4 2024-09-12T00:26:56.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.951+0000 7fa33d935800 20 add_watcher() i=5 2024-09-12T00:26:56.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.951+0000 7fa33d935800 20 add_watcher() i=6 2024-09-12T00:26:56.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.953+0000 7fa33d935800 20 add_watcher() i=7 2024-09-12T00:26:56.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.953+0000 7fa33d935800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:56.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.955+0000 7fa1ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.955+0000 7fa33d935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.955+0000 7fa33d935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:56.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.955+0000 7fa33d935800 5 note: GC not initialized 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.956+0000 7fa1ee7e4640 20 reqs_thread_entry: start 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.956+0000 7fa33d935800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.956+0000 7fa33d935800 20 Filter name: none 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.956+0000 7fa15ffff640 20 reqs_thread_entry: start 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.956+0000 7fa33d935800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:26:56.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.956+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.956+0000 7fa33d935800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.956+0000 7fa33d935800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.956+0000 7fa33d935800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.956+0000 7fa33d935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 : miss 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.956+0000 7fa33d935800 20 rados->read ofs=0 len=0 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.957+0000 7fa33d935800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.957+0000 7fa33d935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 info.flags=0x17 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.957+0000 7fa33d935800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 to cache LRU end 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.957+0000 7fa33d935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.957+0000 7fa33d935800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.957+0000 7fa33d935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.957+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.957+0000 7fa33d935800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:26:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.957+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:56.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.958+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.959+0000 7fa33d935800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.959+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.959+0000 7fa33d935800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.959+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.960+0000 7fa33d935800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.960+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:56.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.960+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:56.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.961+0000 7fa33d935800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:26:56.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.961+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.961+0000 7fa33d935800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.961+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:56.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.962+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.962+0000 7fa33d935800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.962+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.963+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.963+0000 7fa33d935800 20 get_obj_state: octx=0x55ce64d60690 obj=check-bucket:e state=0x55ce650298a8 s->prefetch_data=0 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.963+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 get_obj_state: octx=0x55ce64d88a50 obj=check-bucket:d state=0x55ce65025398 s->prefetch_data=0 2024-09-12T00:26:56.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:56.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 get_obj_state: octx=0x55ce65024fb0 obj=check-bucket:c state=0x55ce65026e68 s->prefetch_data=0 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 get_obj_state: octx=0x55ce6502df20 obj=check-bucket:f state=0x55ce650c2fd8 s->prefetch_data=0 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 get_obj_state: setting s->obj_tag to mhfvwaz0649xmqk8t3dq1t97rrk41ytz 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 get_obj_state_impl: setting s->olh_tag to kx2mxfivlpe8hk7kwekkilwepz91hfsa 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kx2mxfivlpe8hk7kwekkilwepz91hfsa 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 get_obj_state: setting s->obj_tag to 77wnm6k8f80nnplt7z8aady8ne88plbd 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 get_obj_state_impl: setting s->olh_tag to 2v0j3inrruqpt9pkq9yc708h1obm02yl 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2v0j3inrruqpt9pkq9yc708h1obm02yl 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 get_obj_state: setting s->obj_tag to s2yhz4xxs7i1y5jvetsseh29m5yqa3f4 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 get_obj_state_impl: setting s->olh_tag to 0ivetai1ld16fz3c2yvrs3g0zbj16pzv 2024-09-12T00:26:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.964+0000 7fa33d935800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0ivetai1ld16fz3c2yvrs3g0zbj16pzv 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.965+0000 7fa33d935800 20 get_obj_state: setting s->obj_tag to 9xsq6kjp9yciq7u5xo32gq8cygzylhqq 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.965+0000 7fa33d935800 20 get_obj_state_impl: setting s->olh_tag to 765dylb59ka60r1f4q299opufq9s61lt 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.965+0000 7fa33d935800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=765dylb59ka60r1f4q299opufq9s61lt 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.967+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:56.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.967+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.968+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.969+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.969+0000 7fa33d935800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.969+0000 7fa33d935800 20 olh_log_entry: epoch=2 op=3 key=e[vFptR0NeOjt-qE2Lx.FwWWFcTXiGtVA] 2024-09-12T00:26:56.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.969+0000 7fa33d935800 20 get_obj_state: octx=0x55ce64d60690 obj=check-bucket:_:vFptR0NeOjt-qE2Lx.FwWWFcTXiGtVA_e state=0x55ce650dd628 s->prefetch_data=0 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.969+0000 7fa33d935800 10 manifest: total_size = 22 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.969+0000 7fa33d935800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7649679401209203227 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.969+0000 7fa33d935800 20 get_obj_state: octx=0x55ce64d60690 obj=check-bucket:_:vFptR0NeOjt-qE2Lx.FwWWFcTXiGtVA_e state=0x55ce650dd628 s->prefetch_data=0 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.969+0000 7fa33d935800 20 prepare_atomic_modification: state is not atomic. state=0x55ce650dd628 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.969+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:56.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.970+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.970+0000 7fa33d935800 20 olh_log_entry: epoch=3 op=3 key=c[by5rMoz4NXYcfeJ5x4n6OcFVu1vrgsL] 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.970+0000 7fa33d935800 20 get_obj_state: octx=0x55ce65024fb0 obj=check-bucket:_:by5rMoz4NXYcfeJ5x4n6OcFVu1vrgsL_c state=0x55ce650e67b8 s->prefetch_data=0 2024-09-12T00:26:56.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.971+0000 7fa33d935800 10 manifest: total_size = 9 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.971+0000 7fa33d935800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6846970773154349853 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.971+0000 7fa33d935800 20 get_obj_state: octx=0x55ce65024fb0 obj=check-bucket:_:by5rMoz4NXYcfeJ5x4n6OcFVu1vrgsL_c state=0x55ce650e67b8 s->prefetch_data=0 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.971+0000 7fa33d935800 20 prepare_atomic_modification: state is not atomic. state=0x55ce650e67b8 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.971+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:56.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.971+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.972+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.972+0000 7fa33d935800 20 olh_log_entry: epoch=3 op=3 key=d[yD2U5XiOlPwnyop4GmN.6qZDQcS.55Q] 2024-09-12T00:26:56.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.972+0000 7fa33d935800 20 get_obj_state: octx=0x55ce64d88a50 obj=check-bucket:_:yD2U5XiOlPwnyop4GmN.6qZDQcS.55Q_d state=0x55ce650ecd58 s->prefetch_data=0 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.973+0000 7fa33d935800 10 manifest: total_size = 22 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.973+0000 7fa33d935800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13139663248268656302 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.973+0000 7fa33d935800 20 get_obj_state: octx=0x55ce64d88a50 obj=check-bucket:_:yD2U5XiOlPwnyop4GmN.6qZDQcS.55Q_d state=0x55ce650ecd58 s->prefetch_data=0 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.973+0000 7fa33d935800 20 prepare_atomic_modification: state is not atomic. state=0x55ce650ecd58 2024-09-12T00:26:56.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.973+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:56.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.974+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:56.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.974+0000 7fa33d935800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:26:56.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.974+0000 7fa33d935800 20 olh_log_entry: epoch=2 op=3 key=f[COYaKGr38r3so-kEwMblq0KW80Ittif] 2024-09-12T00:26:56.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.974+0000 7fa33d935800 20 get_obj_state: octx=0x55ce6502df20 obj=check-bucket:_:COYaKGr38r3so-kEwMblq0KW80Ittif_f state=0x55ce650f9938 s->prefetch_data=0 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.975+0000 7fa33d935800 20 get_obj_state: octx=0x55ce64d60690 obj=check-bucket:e state=0x55ce650298a8 s->prefetch_data=0 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.975+0000 7fa33d935800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kx2mxfivlpe8hk7kwekkilwepz91hfsa 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.976+0000 7fa33d935800 10 manifest: total_size = 12 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.976+0000 7fa33d935800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17104602354387322409 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.976+0000 7fa33d935800 20 get_obj_state: octx=0x55ce6502df20 obj=check-bucket:_:COYaKGr38r3so-kEwMblq0KW80Ittif_f state=0x55ce650f9938 s->prefetch_data=0 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.976+0000 7fa33d935800 20 prepare_atomic_modification: state is not atomic. state=0x55ce650f9938 2024-09-12T00:26:56.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.976+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.976+0000 7fa21cff9640 20 handle_completion(): completion ok for obj=e[vFptR0NeOjt-qE2Lx.FwWWFcTXiGtVA] 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.977+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.977+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:56.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.977+0000 7fa21cff9640 20 handle_completion(): completion ok for obj=c[by5rMoz4NXYcfeJ5x4n6OcFVu1vrgsL] 2024-09-12T00:26:56.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.978+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:56.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.978+0000 7fa33d935800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.990+0000 7fa21cff9640 20 handle_completion(): completion ok for obj=f[COYaKGr38r3so-kEwMblq0KW80Ittif] 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.990+0000 7fa20bfff640 20 handle_completion(): completion ok for obj=d[yD2U5XiOlPwnyop4GmN.6qZDQcS.55Q] 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.990+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.990+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.990+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.990+0000 7fa33d935800 20 get_obj_state: octx=0x55ce6502df20 obj=check-bucket:f state=0x55ce650c2fd8 s->prefetch_data=0 2024-09-12T00:26:56.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.990+0000 7fa33d935800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=765dylb59ka60r1f4q299opufq9s61lt 2024-09-12T00:26:56.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.992+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:56.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.992+0000 7fa33d935800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.994+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:56.993 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:56.994+0000 7fa33d935800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:26:57.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.005+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.006+0000 7fa33d935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.006+0000 7fa33d935800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:26:57.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.006+0000 7fa33d935800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:26:57.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.007+0000 7fa1ef7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:57.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.009+0000 7fa33d935800 20 remove_watcher() i=0 2024-09-12T00:26:57.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.009+0000 7fa33d935800 2 removed watcher, disabling cache 2024-09-12T00:26:57.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.010+0000 7fa33d935800 20 remove_watcher() i=1 2024-09-12T00:26:57.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.011+0000 7fa33d935800 20 remove_watcher() i=2 2024-09-12T00:26:57.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.012+0000 7fa33d935800 20 remove_watcher() i=3 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.013+0000 7fa33d935800 20 remove_watcher() i=4 2024-09-12T00:26:57.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.014+0000 7fa33d935800 20 remove_watcher() i=5 2024-09-12T00:26:57.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.015+0000 7fa33d935800 20 remove_watcher() i=6 2024-09-12T00:26:57.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.016+0000 7fa33d935800 20 remove_watcher() i=7 2024-09-12T00:26:57.030 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.030 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.051 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:57.073 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.074 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:57.095 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.095 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:57.114 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:26:57.114 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:57.116 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.116 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:57.193 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.193 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:57.216 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.216 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:57.240 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.241 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:57.265 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.266 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:57.289 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:26:57.289 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:57.290 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:26:57.324 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:57.324 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:57.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.364+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.365+0000 7f400e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.365+0000 7f400e525800 20 realm 2024-09-12T00:26:57.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.365+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.366+0000 7f400e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.366+0000 7f400e525800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:57.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.366+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.366+0000 7f400e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.366+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.367+0000 7f400e525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:57.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.367+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.367+0000 7f400e525800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:57.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.367+0000 7f400e525800 20 searching for the correct realm 2024-09-12T00:26:57.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.371+0000 7f4009932640 0 -- 172.21.15.19:0/1906048738 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f400007e920 msgr2=0x7f4000061400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:57.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.375+0000 7f4009932640 0 -- 172.21.15.19:0/1906048738 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5592f98a6430 msgr2=0x5592f98a8890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:57.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.380+0000 7f400e525800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:57.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.380+0000 7f400e525800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:57.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.380+0000 7f400e525800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:57.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.380+0000 7f400e525800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:57.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.380+0000 7f400e525800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:57.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.380+0000 7f400e525800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:57.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.380+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.380+0000 7f400e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.380+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.380+0000 7f400e525800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:57.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.380+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:57.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 20 zone default found 2024-09-12T00:26:57.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 4 Realm: () 2024-09-12T00:26:57.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:57.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:57.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:57.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 20 zonegroup default 2024-09-12T00:26:57.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.381+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.382+0000 7f400e525800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.382+0000 7f400e525800 20 started sync module instance, tier type = 2024-09-12T00:26:57.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.382+0000 7f400e525800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:57.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.392+0000 7f400e525800 20 add_watcher() i=0 2024-09-12T00:26:57.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.392+0000 7f400e525800 20 add_watcher() i=1 2024-09-12T00:26:57.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.392+0000 7f400e525800 20 add_watcher() i=2 2024-09-12T00:26:57.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.392+0000 7f400e525800 20 add_watcher() i=3 2024-09-12T00:26:57.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.392+0000 7f400e525800 20 add_watcher() i=4 2024-09-12T00:26:57.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.393+0000 7f400e525800 20 add_watcher() i=5 2024-09-12T00:26:57.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.393+0000 7f400e525800 20 add_watcher() i=6 2024-09-12T00:26:57.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.393+0000 7f400e525800 20 add_watcher() i=7 2024-09-12T00:26:57.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.393+0000 7f400e525800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:57.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.395+0000 7f3ec0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:57.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.396+0000 7f400e525800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:57.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.396+0000 7f400e525800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:57.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.396+0000 7f400e525800 5 note: GC not initialized 2024-09-12T00:26:57.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.396+0000 7f3e3b7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:57.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.396+0000 7f400e525800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:57.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.396+0000 7f400e525800 20 Filter name: none 2024-09-12T00:26:57.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.396+0000 7f3e397fa640 20 reqs_thread_entry: start 2024-09-12T00:26:57.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.396+0000 7f400e525800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:26:57.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.396+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:57.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:26:57.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:26:57.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 : miss 2024-09-12T00:26:57.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:57.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 info.flags=0x17 2024-09-12T00:26:57.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 to cache LRU end 2024-09-12T00:26:57.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:26:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 2024-09-12T00:26:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.397+0000 7f400e525800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.398+0000 7f400e525800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:26:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.398+0000 7f400e525800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.398+0000 7f400e525800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:26:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.398+0000 7f400e525800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.399+0000 7f400e525800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:26:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.399+0000 7f400e525800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.399+0000 7f400e525800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:26:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.399+0000 7f400e525800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:57.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.399+0000 7f400e525800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:26:57.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.399+0000 7f400e525800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:57.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.400+0000 7f400e525800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:26:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.400+0000 7f400e525800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.400+0000 7f400e525800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:26:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.400+0000 7f400e525800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.401+0000 7f400e525800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:26:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.401+0000 7f400e525800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.402+0000 7f400e525800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:26:57.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.402+0000 7f400e525800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:57.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.402+0000 7f400e525800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:26:57.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.402+0000 7f400e525800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:57.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.403+0000 7f400e525800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:26:57.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.403+0000 7f400e525800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:26:57.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.403+0000 7f3ec0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:57.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.406+0000 7f400e525800 20 remove_watcher() i=0 2024-09-12T00:26:57.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.406+0000 7f400e525800 2 removed watcher, disabling cache 2024-09-12T00:26:57.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.407+0000 7f400e525800 20 remove_watcher() i=1 2024-09-12T00:26:57.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.408+0000 7f400e525800 20 remove_watcher() i=2 2024-09-12T00:26:57.409 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.410+0000 7f400e525800 20 remove_watcher() i=3 2024-09-12T00:26:57.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.413+0000 7f400e525800 20 remove_watcher() i=4 2024-09-12T00:26:57.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.414+0000 7f400e525800 20 remove_watcher() i=5 2024-09-12T00:26:57.414 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.415+0000 7f400e525800 20 remove_watcher() i=6 2024-09-12T00:26:57.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.416+0000 7f400e525800 20 remove_watcher() i=7 2024-09-12T00:26:57.429 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.430 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:57.553 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:26:57.553 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:26:57.604 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:26:57.636 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:57.636 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:57.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.677+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.679+0000 7f4018325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.679+0000 7f4018325800 20 realm 2024-09-12T00:26:57.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.679+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.679+0000 7f4018325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.679+0000 7f4018325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:57.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.679+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.679+0000 7f4018325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.679+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.680+0000 7f4018325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:57.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.680+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.680+0000 7f4018325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:57.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.680+0000 7f4018325800 20 searching for the correct realm 2024-09-12T00:26:57.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.682+0000 7f40147b6640 0 -- 172.21.15.19:0/211165897 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x555de17d5fd0 msgr2=0x555de17d8420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:57.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.686+0000 7f40147b6640 0 -- 172.21.15.19:0/211165897 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7f40040a0b70 msgr2=0x7f400406fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:57.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.893+0000 7f4018325800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:57.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.893+0000 7f4018325800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:57.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.893+0000 7f4018325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:57.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.893+0000 7f4018325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:57.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.893+0000 7f4018325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:57.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.893+0000 7f4018325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:57.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.893+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:57.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:57.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 20 zone default found 2024-09-12T00:26:57.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 4 Realm: () 2024-09-12T00:26:57.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:57.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:57.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:57.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 20 zonegroup default 2024-09-12T00:26:57.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.894+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.895+0000 7f4018325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.895+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.895+0000 7f4018325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.895+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.895+0000 7f4018325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:57.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.895+0000 7f4018325800 20 started sync module instance, tier type = 2024-09-12T00:26:57.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.895+0000 7f4018325800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:57.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.906+0000 7f4018325800 20 add_watcher() i=0 2024-09-12T00:26:57.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.906+0000 7f4018325800 20 add_watcher() i=1 2024-09-12T00:26:57.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.906+0000 7f4018325800 20 add_watcher() i=2 2024-09-12T00:26:57.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.906+0000 7f4018325800 20 add_watcher() i=3 2024-09-12T00:26:57.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.906+0000 7f4018325800 20 add_watcher() i=4 2024-09-12T00:26:57.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.906+0000 7f4018325800 20 add_watcher() i=5 2024-09-12T00:26:57.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.906+0000 7f4018325800 20 add_watcher() i=6 2024-09-12T00:26:57.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.907+0000 7f4018325800 20 add_watcher() i=7 2024-09-12T00:26:57.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.907+0000 7f4018325800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:57.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.909+0000 7f3ec9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:57.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.909+0000 7f4018325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:57.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.909+0000 7f4018325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:57.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.909+0000 7f4018325800 5 note: GC not initialized 2024-09-12T00:26:57.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.909+0000 7f3ec8fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:57.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.909+0000 7f4018325800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:57.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.909+0000 7f4018325800 20 Filter name: none 2024-09-12T00:26:57.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.910+0000 7f3e427fc640 20 reqs_thread_entry: start 2024-09-12T00:26:57.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.910+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.910+0000 7f4018325800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:57.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.910+0000 7f4018325800 20 rados->read ofs=0 len=0 2024-09-12T00:26:57.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.910+0000 7f4018325800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:57.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.910+0000 7f4018325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:57.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.910+0000 7f4018325800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:26:57.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.910+0000 7f4018325800 20 INFO: main: starting shard=0 2024-09-12T00:26:57.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.910+0000 7f4018325800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:57.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.911+0000 7f4018325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:57.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.911+0000 7f4018325800 20 INFO: main: starting shard=1 2024-09-12T00:26:57.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.911+0000 7f4018325800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:57.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.911+0000 7f4018325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:57.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.911+0000 7f4018325800 20 INFO: main: starting shard=2 2024-09-12T00:26:57.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.911+0000 7f4018325800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:57.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.912+0000 7f4018325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:57.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.912+0000 7f4018325800 20 INFO: main: starting shard=3 2024-09-12T00:26:57.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.912+0000 7f4018325800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:57.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.912+0000 7f4018325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:57.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.912+0000 7f4018325800 20 INFO: main: starting shard=4 2024-09-12T00:26:57.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.912+0000 7f4018325800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:57.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.913+0000 7f4018325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:57.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.913+0000 7f4018325800 20 INFO: main: starting shard=5 2024-09-12T00:26:57.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.913+0000 7f4018325800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:57.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.913+0000 7f4018325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:57.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.913+0000 7f4018325800 20 INFO: main: starting shard=6 2024-09-12T00:26:57.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.913+0000 7f4018325800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:57.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.914+0000 7f4018325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:57.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.914+0000 7f4018325800 20 INFO: main: starting shard=7 2024-09-12T00:26:57.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.914+0000 7f4018325800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:57.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.914+0000 7f4018325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:57.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.914+0000 7f4018325800 20 INFO: main: starting shard=8 2024-09-12T00:26:57.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.914+0000 7f4018325800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:57.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.915+0000 7f4018325800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:26:57.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.915+0000 7f4018325800 20 INFO: main: starting shard=9 2024-09-12T00:26:57.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.915+0000 7f4018325800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:57.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.915+0000 7f4018325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:57.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.915+0000 7f4018325800 20 INFO: main: starting shard=10 2024-09-12T00:26:57.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.915+0000 7f4018325800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:57.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.915+0000 7f4018325800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:57.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.915+0000 7f4018325800 20 INFO: main: done 2024-09-12T00:26:57.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.916+0000 7f3ec9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:57.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.919+0000 7f4018325800 20 remove_watcher() i=0 2024-09-12T00:26:57.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.919+0000 7f4018325800 2 removed watcher, disabling cache 2024-09-12T00:26:57.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.920+0000 7f4018325800 20 remove_watcher() i=1 2024-09-12T00:26:57.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.920+0000 7f4018325800 20 remove_watcher() i=2 2024-09-12T00:26:57.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.922+0000 7f4018325800 20 remove_watcher() i=3 2024-09-12T00:26:57.922 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.923+0000 7f4018325800 20 remove_watcher() i=4 2024-09-12T00:26:57.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.924+0000 7f4018325800 20 remove_watcher() i=5 2024-09-12T00:26:57.924 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.925+0000 7f4018325800 20 remove_watcher() i=6 2024-09-12T00:26:57.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:57.926+0000 7f4018325800 20 remove_watcher() i=7 2024-09-12T00:26:57.938 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:26:57.969 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:57.970 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:58.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.009+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.011+0000 7f1a52011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.011+0000 7f1a52011800 20 realm 2024-09-12T00:26:58.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.011+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.011+0000 7f1a52011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.011+0000 7f1a52011800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:58.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.011+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.011+0000 7f1a52011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.011+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.012+0000 7f1a52011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:58.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.012+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.012+0000 7f1a52011800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:58.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.012+0000 7f1a52011800 20 searching for the correct realm 2024-09-12T00:26:58.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.015+0000 7f1a4cf21640 0 -- 172.21.15.19:0/4079827493 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f1a44035c50 msgr2=0x7f1a44030930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:58.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.220+0000 7f1a4cf21640 0 -- 172.21.15.19:0/4079827493 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55ebce364450 msgr2=0x55ebce366870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:58.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.224+0000 7f1a52011800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:58.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.224+0000 7f1a52011800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:58.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.224+0000 7f1a52011800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:58.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.224+0000 7f1a52011800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:58.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.224+0000 7f1a52011800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:58.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.224+0000 7f1a52011800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:58.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.224+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.224+0000 7f1a52011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.224+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:58.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:58.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 20 zone default found 2024-09-12T00:26:58.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 4 Realm: () 2024-09-12T00:26:58.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:58.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:58.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:58.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 20 zonegroup default 2024-09-12T00:26:58.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.225+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.226+0000 7f1a52011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.226+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.226+0000 7f1a52011800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.226+0000 7f1a52011800 20 started sync module instance, tier type = 2024-09-12T00:26:58.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.226+0000 7f1a52011800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:58.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.237+0000 7f1a52011800 20 add_watcher() i=0 2024-09-12T00:26:58.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.237+0000 7f1a52011800 20 add_watcher() i=1 2024-09-12T00:26:58.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.237+0000 7f1a52011800 20 add_watcher() i=2 2024-09-12T00:26:58.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.237+0000 7f1a52011800 20 add_watcher() i=3 2024-09-12T00:26:58.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.237+0000 7f1a52011800 20 add_watcher() i=4 2024-09-12T00:26:58.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.237+0000 7f1a52011800 20 add_watcher() i=5 2024-09-12T00:26:58.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.237+0000 7f1a52011800 20 add_watcher() i=6 2024-09-12T00:26:58.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.238+0000 7f1a52011800 20 add_watcher() i=7 2024-09-12T00:26:58.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.238+0000 7f1a52011800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:58.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.240+0000 7f1903fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:58.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.240+0000 7f1a52011800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:58.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.240+0000 7f1a52011800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:58.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.240+0000 7f1a52011800 5 note: GC not initialized 2024-09-12T00:26:58.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.241+0000 7f1902fe5640 20 reqs_thread_entry: start 2024-09-12T00:26:58.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.241+0000 7f1a52011800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:58.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.241+0000 7f1a52011800 20 Filter name: none 2024-09-12T00:26:58.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.241+0000 7f1900fe1640 20 reqs_thread_entry: start 2024-09-12T00:26:58.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.241+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.241+0000 7f1a52011800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:58.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.241+0000 7f1a52011800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.242+0000 7f1a52011800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:58.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.242+0000 7f1a52011800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:58.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.242+0000 7f1a52011800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:26:58.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.242+0000 7f1a52011800 20 INFO: main: starting shard=0 2024-09-12T00:26:58.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.242+0000 7f1a52011800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:58.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.242+0000 7f1a52011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:58.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.242+0000 7f1a52011800 20 INFO: main: starting shard=1 2024-09-12T00:26:58.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.242+0000 7f1a52011800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:58.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.243+0000 7f1a52011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:58.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.243+0000 7f1a52011800 20 INFO: main: starting shard=2 2024-09-12T00:26:58.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.243+0000 7f1a52011800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:58.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.243+0000 7f1a52011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:58.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.243+0000 7f1a52011800 20 INFO: main: starting shard=3 2024-09-12T00:26:58.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.243+0000 7f1a52011800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:58.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.244+0000 7f1a52011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:58.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.244+0000 7f1a52011800 20 INFO: main: starting shard=4 2024-09-12T00:26:58.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.244+0000 7f1a52011800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:58.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.244+0000 7f1a52011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:58.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.244+0000 7f1a52011800 20 INFO: main: starting shard=5 2024-09-12T00:26:58.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.244+0000 7f1a52011800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:58.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.245+0000 7f1a52011800 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:26:58.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.245+0000 7f1a52011800 20 INFO: main: starting shard=6 2024-09-12T00:26:58.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.245+0000 7f1a52011800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:58.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.245+0000 7f1a52011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:58.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.245+0000 7f1a52011800 20 INFO: main: starting shard=7 2024-09-12T00:26:58.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.245+0000 7f1a52011800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:58.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.246+0000 7f1a52011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:58.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.246+0000 7f1a52011800 20 INFO: main: starting shard=8 2024-09-12T00:26:58.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.246+0000 7f1a52011800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:58.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.246+0000 7f1a52011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:58.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.246+0000 7f1a52011800 20 INFO: main: starting shard=9 2024-09-12T00:26:58.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.246+0000 7f1a52011800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:58.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.246+0000 7f1a52011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:58.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.246+0000 7f1a52011800 20 INFO: main: starting shard=10 2024-09-12T00:26:58.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.246+0000 7f1a52011800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:58.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.247+0000 7f1a52011800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:58.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.247+0000 7f1a52011800 20 INFO: main: done 2024-09-12T00:26:58.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.248+0000 7f1903fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:58.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.250+0000 7f1a52011800 20 remove_watcher() i=0 2024-09-12T00:26:58.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.250+0000 7f1a52011800 2 removed watcher, disabling cache 2024-09-12T00:26:58.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.251+0000 7f1a52011800 20 remove_watcher() i=1 2024-09-12T00:26:58.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.252+0000 7f1a52011800 20 remove_watcher() i=2 2024-09-12T00:26:58.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.253+0000 7f1a52011800 20 remove_watcher() i=3 2024-09-12T00:26:58.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.254+0000 7f1a52011800 20 remove_watcher() i=4 2024-09-12T00:26:58.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.255+0000 7f1a52011800 20 remove_watcher() i=5 2024-09-12T00:26:58.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.256+0000 7f1a52011800 20 remove_watcher() i=6 2024-09-12T00:26:58.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.257+0000 7f1a52011800 20 remove_watcher() i=7 2024-09-12T00:26:58.268 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:26:58.268 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:58.269 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:26:58.301 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:58.301 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:58.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.341+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.342+0000 7f5f02811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.342+0000 7f5f02811800 20 realm 2024-09-12T00:26:58.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.342+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.343+0000 7f5f02811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.343+0000 7f5f02811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:58.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.343+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.343+0000 7f5f02811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.343+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.344+0000 7f5f02811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:58.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.344+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.344+0000 7f5f02811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:58.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.344+0000 7f5f02811800 20 searching for the correct realm 2024-09-12T00:26:58.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.346+0000 7f5efdf92640 0 -- 172.21.15.19:0/848190874 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f5ef0077040 msgr2=0x7f5ef00a30d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:58.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.551+0000 7f5efdf92640 0 -- 172.21.15.19:0/848190874 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f5ef80b3990 msgr2=0x7f5ef80b15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:58.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.757+0000 7f5f02811800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:58.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.757+0000 7f5f02811800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:58.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.757+0000 7f5f02811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:58.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.757+0000 7f5f02811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:58.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.757+0000 7f5f02811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:58.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.757+0000 7f5f02811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:58.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.757+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.757+0000 7f5f02811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.757+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.757+0000 7f5f02811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.757+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 20 zone default found 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 4 Realm: () 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 20 zonegroup default 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.758+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.759+0000 7f5f02811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.759+0000 7f5f02811800 20 started sync module instance, tier type = 2024-09-12T00:26:58.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.759+0000 7f5f02811800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:58.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.768+0000 7f5f02811800 20 add_watcher() i=0 2024-09-12T00:26:58.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.768+0000 7f5f02811800 20 add_watcher() i=1 2024-09-12T00:26:58.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.768+0000 7f5f02811800 20 add_watcher() i=2 2024-09-12T00:26:58.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.768+0000 7f5f02811800 20 add_watcher() i=3 2024-09-12T00:26:58.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.768+0000 7f5f02811800 20 add_watcher() i=4 2024-09-12T00:26:58.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.768+0000 7f5f02811800 20 add_watcher() i=5 2024-09-12T00:26:58.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.768+0000 7f5f02811800 20 add_watcher() i=6 2024-09-12T00:26:58.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.769+0000 7f5f02811800 20 add_watcher() i=7 2024-09-12T00:26:58.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.769+0000 7f5f02811800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:58.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.771+0000 7f5daf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:58.771 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.771+0000 7f5f02811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:58.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.771+0000 7f5f02811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:58.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.771+0000 7f5f02811800 5 note: GC not initialized 2024-09-12T00:26:58.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.772+0000 7f5dae7fc640 20 reqs_thread_entry: start 2024-09-12T00:26:58.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.772+0000 7f5f02811800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:58.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.772+0000 7f5f02811800 20 Filter name: none 2024-09-12T00:26:58.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.772+0000 7f5d1ffff640 20 reqs_thread_entry: start 2024-09-12T00:26:58.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.772+0000 7f5f02811800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:26:58.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.772+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:58.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:26:58.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 : miss 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 info.flags=0x17 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 to cache LRU end 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.773+0000 7f5f02811800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.774+0000 7f5f02811800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.774+0000 7f5f02811800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.774+0000 7f5f02811800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:26:58.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.774+0000 7f5f02811800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:58.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.775+0000 7f5f02811800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:26:58.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.775+0000 7f5f02811800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:58.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.775+0000 7f5f02811800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:26:58.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.775+0000 7f5f02811800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:58.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.776+0000 7f5f02811800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:26:58.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.776+0000 7f5f02811800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:58.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.776+0000 7f5f02811800 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:26:58.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.776+0000 7f5f02811800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:58.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.777+0000 7f5f02811800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:26:58.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.777+0000 7f5f02811800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:58.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.777+0000 7f5f02811800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:26:58.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.777+0000 7f5f02811800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:58.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.778+0000 7f5f02811800 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:26:58.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.778+0000 7f5f02811800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:58.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.778+0000 7f5f02811800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:26:58.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.778+0000 7f5f02811800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:58.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.779+0000 7f5f02811800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:26:58.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.779+0000 7f5f02811800 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:26:58.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.780+0000 7f5daf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:58.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.783+0000 7f5f02811800 20 remove_watcher() i=0 2024-09-12T00:26:58.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.783+0000 7f5f02811800 2 removed watcher, disabling cache 2024-09-12T00:26:58.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.784+0000 7f5f02811800 20 remove_watcher() i=1 2024-09-12T00:26:58.784 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.785+0000 7f5f02811800 20 remove_watcher() i=2 2024-09-12T00:26:58.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.786+0000 7f5f02811800 20 remove_watcher() i=3 2024-09-12T00:26:58.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.787+0000 7f5f02811800 20 remove_watcher() i=4 2024-09-12T00:26:58.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.788+0000 7f5f02811800 20 remove_watcher() i=5 2024-09-12T00:26:58.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.789+0000 7f5f02811800 20 remove_watcher() i=6 2024-09-12T00:26:58.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.790+0000 7f5f02811800 20 remove_watcher() i=7 2024-09-12T00:26:58.801 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:26:58.801 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:26:58.802 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:26:58.836 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:58.836 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:58.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.876+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.877+0000 7f3f1d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.877+0000 7f3f1d12a800 20 realm 2024-09-12T00:26:58.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.877+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.878+0000 7f3f1d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.878+0000 7f3f1d12a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:58.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.878+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.878+0000 7f3f1d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:58.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.878+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.878+0000 7f3f1d12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:58.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.878+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:58.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.879+0000 7f3f1d12a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:58.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.879+0000 7f3f1d12a800 20 searching for the correct realm 2024-09-12T00:26:58.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:58.882+0000 7f3f1864e640 0 -- 172.21.15.19:0/619862179 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3f0c067300 msgr2=0x7f3f0c069040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:59.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.288+0000 7f3f18e4f640 0 -- 172.21.15.19:0/619862179 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f3f10072040 msgr2=0x7f3f1008d950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:59.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.496+0000 7f3f1d12a800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:59.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.496+0000 7f3f1d12a800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:59.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.496+0000 7f3f1d12a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:59.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.496+0000 7f3f1d12a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:59.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.496+0000 7f3f1d12a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:59.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.496+0000 7f3f1d12a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:59.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.496+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.496+0000 7f3f1d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.496+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.497+0000 7f3f1d12a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:59.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.497+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.497+0000 7f3f1d12a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:59.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.497+0000 7f3f1d12a800 20 zone default found 2024-09-12T00:26:59.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.497+0000 7f3f1d12a800 4 Realm: () 2024-09-12T00:26:59.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.497+0000 7f3f1d12a800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:59.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.497+0000 7f3f1d12a800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:59.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.497+0000 7f3f1d12a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:59.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.497+0000 7f3f1d12a800 20 zonegroup default 2024-09-12T00:26:59.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.497+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.498+0000 7f3f1d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.498+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.498+0000 7f3f1d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.498+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.498+0000 7f3f1d12a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.498+0000 7f3f1d12a800 20 started sync module instance, tier type = 2024-09-12T00:26:59.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.498+0000 7f3f1d12a800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:59.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.508+0000 7f3f1d12a800 20 add_watcher() i=0 2024-09-12T00:26:59.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.508+0000 7f3f1d12a800 20 add_watcher() i=1 2024-09-12T00:26:59.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.508+0000 7f3f1d12a800 20 add_watcher() i=2 2024-09-12T00:26:59.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.508+0000 7f3f1d12a800 20 add_watcher() i=3 2024-09-12T00:26:59.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.508+0000 7f3f1d12a800 20 add_watcher() i=4 2024-09-12T00:26:59.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.508+0000 7f3f1d12a800 20 add_watcher() i=5 2024-09-12T00:26:59.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.508+0000 7f3f1d12a800 20 add_watcher() i=6 2024-09-12T00:26:59.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.509+0000 7f3f1d12a800 20 add_watcher() i=7 2024-09-12T00:26:59.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.509+0000 7f3f1d12a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:59.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.511+0000 7f3dcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:59.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.511+0000 7f3f1d12a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:59.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.511+0000 7f3f1d12a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:59.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.511+0000 7f3f1d12a800 5 note: GC not initialized 2024-09-12T00:26:59.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.512+0000 7f3dcdfe3640 20 reqs_thread_entry: start 2024-09-12T00:26:59.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.512+0000 7f3f1d12a800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:59.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.512+0000 7f3f1d12a800 20 Filter name: none 2024-09-12T00:26:59.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.512+0000 7f3d3f7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:59.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.512+0000 7f3f1d12a800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:26:59.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.512+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.512+0000 7f3f1d12a800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:59.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.512+0000 7f3f1d12a800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:26:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.512+0000 7f3f1d12a800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:26:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.512+0000 7f3f1d12a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 : miss 2024-09-12T00:26:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.512+0000 7f3f1d12a800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.513+0000 7f3f1d12a800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.513+0000 7f3f1d12a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 info.flags=0x17 2024-09-12T00:26:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.513+0000 7f3f1d12a800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 to cache LRU end 2024-09-12T00:26:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.513+0000 7f3f1d12a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:26:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.513+0000 7f3f1d12a800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:26:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.513+0000 7f3f1d12a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 2024-09-12T00:26:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.513+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.514+0000 7f3f1d12a800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:26:59.515 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.514+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:59.515 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.514+0000 7f3f1d12a800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:26:59.515 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.514+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:59.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.515+0000 7f3f1d12a800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:26:59.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.515+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:59.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.515+0000 7f3f1d12a800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:26:59.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.515+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:59.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.516+0000 7f3f1d12a800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:26:59.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.516+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:59.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.516+0000 7f3f1d12a800 20 get_obj_state: octx=0x55d9068e9660 obj=check-bucket:d state=0x55d906bb62e8 s->prefetch_data=0 2024-09-12T00:26:59.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.516+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:59.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.516+0000 7f3f1d12a800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:26:59.517 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.516+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:59.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.517+0000 7f3f1d12a800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:26:59.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.517+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.517+0000 7f3f1d12a800 20 get_obj_state: octx=0x55d906911a40 obj=check-bucket:c state=0x55d906bb43d8 s->prefetch_data=0 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.517+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.518+0000 7f3f1d12a800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.518+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.518+0000 7f3f1d12a800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.518+0000 7f3f1d12a800 20 get_obj_state: setting s->obj_tag to 77wnm6k8f80nnplt7z8aady8ne88plbd 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.518+0000 7f3f1d12a800 20 get_obj_state_impl: setting s->olh_tag to 2v0j3inrruqpt9pkq9yc708h1obm02yl 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.518+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.518+0000 7f3f1d12a800 20 get_obj_state: setting s->obj_tag to s2yhz4xxs7i1y5jvetsseh29m5yqa3f4 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.518+0000 7f3f1d12a800 20 get_obj_state_impl: setting s->olh_tag to 0ivetai1ld16fz3c2yvrs3g0zbj16pzv 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.518+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.519+0000 7f3f1d12a800 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:26:59.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.519+0000 7f3f1d12a800 20 olh_log_entry: epoch=4 op=3 key=c[.N3GllHnfly.bi8Uxc0NiiV80ULr6xq] 2024-09-12T00:26:59.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.519+0000 7f3f1d12a800 20 get_obj_state: octx=0x55d906c0dfb0 obj=check-bucket:_:.N3GllHnfly.bi8Uxc0NiiV80ULr6xq_c state=0x55d906c119b8 s->prefetch_data=0 2024-09-12T00:26:59.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.519+0000 7f3f1d12a800 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:26:59.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.519+0000 7f3f1d12a800 20 olh_log_entry: epoch=4 op=3 key=d[zeSR.-ObVDhqxeoBz.qr9L5PLG60HuE] 2024-09-12T00:26:59.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.519+0000 7f3f1d12a800 20 get_obj_state: octx=0x55d906bedfb0 obj=check-bucket:_:zeSR.-ObVDhqxeoBz.qr9L5PLG60HuE_d state=0x55d906c1a538 s->prefetch_data=0 2024-09-12T00:26:59.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.521+0000 7f3f1d12a800 20 get_obj_state: octx=0x55d906c0dfb0 obj=check-bucket:c state=0x55d906c1a508 s->prefetch_data=0 2024-09-12T00:26:59.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.521+0000 7f3f1d12a800 20 get_obj_state: setting s->obj_tag to s2yhz4xxs7i1y5jvetsseh29m5yqa3f4 2024-09-12T00:26:59.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.521+0000 7f3f1d12a800 20 get_obj_state_impl: setting s->olh_tag to 0ivetai1ld16fz3c2yvrs3g0zbj16pzv 2024-09-12T00:26:59.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.521+0000 7f3f1d12a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=0ivetai1ld16fz3c2yvrs3g0zbj16pzv 2024-09-12T00:26:59.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.521+0000 7f3f1d12a800 20 get_obj_state: octx=0x55d906bedfb0 obj=check-bucket:d state=0x55d906c19288 s->prefetch_data=0 2024-09-12T00:26:59.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.522+0000 7f3f1d12a800 20 get_obj_state: setting s->obj_tag to 77wnm6k8f80nnplt7z8aady8ne88plbd 2024-09-12T00:26:59.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.522+0000 7f3f1d12a800 20 get_obj_state_impl: setting s->olh_tag to 2v0j3inrruqpt9pkq9yc708h1obm02yl 2024-09-12T00:26:59.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.522+0000 7f3f1d12a800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2v0j3inrruqpt9pkq9yc708h1obm02yl 2024-09-12T00:26:59.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.526+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:59.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.527+0000 7f3f1d12a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:59.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.528+0000 7f3f1d12a800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:26:59.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.529+0000 7f3f1d12a800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:26:59.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.529+0000 7f3f1d12a800 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:26:59.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.530+0000 7f3dcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:59.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.532+0000 7f3f1d12a800 20 remove_watcher() i=0 2024-09-12T00:26:59.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.532+0000 7f3f1d12a800 2 removed watcher, disabling cache 2024-09-12T00:26:59.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.533+0000 7f3f1d12a800 20 remove_watcher() i=1 2024-09-12T00:26:59.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.534+0000 7f3f1d12a800 20 remove_watcher() i=2 2024-09-12T00:26:59.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.535+0000 7f3f1d12a800 20 remove_watcher() i=3 2024-09-12T00:26:59.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.536+0000 7f3f1d12a800 20 remove_watcher() i=4 2024-09-12T00:26:59.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.537+0000 7f3f1d12a800 20 remove_watcher() i=5 2024-09-12T00:26:59.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.538+0000 7f3f1d12a800 20 remove_watcher() i=6 2024-09-12T00:26:59.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.539+0000 7f3f1d12a800 20 remove_watcher() i=7 2024-09-12T00:26:59.551 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:26:59.582 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:59.582 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:59.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.622+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.624+0000 7fb05ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.624+0000 7fb05ab24800 20 realm 2024-09-12T00:26:59.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.624+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.624+0000 7fb05ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.624+0000 7fb05ab24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:59.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.624+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.624+0000 7fb05ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.624+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.625+0000 7fb05ab24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:59.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.625+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.625+0000 7fb05ab24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:59.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.625+0000 7fb05ab24800 20 searching for the correct realm 2024-09-12T00:26:59.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.629+0000 7fb055fd1640 0 -- 172.21.15.19:0/861129218 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fb040088480 msgr2=0x7fb0400888e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:59.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.834+0000 7fb056fd3640 0 -- 172.21.15.19:0/861129218 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x559568288a10 msgr2=0x55956828ae00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:59.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.838+0000 7fb05ab24800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:59.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.838+0000 7fb05ab24800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:59.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.838+0000 7fb05ab24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:59.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.838+0000 7fb05ab24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:59.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.838+0000 7fb05ab24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:59.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.838+0000 7fb05ab24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:59.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.838+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.839+0000 7fb05ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.839+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.839+0000 7fb05ab24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.839+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.839+0000 7fb05ab24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.839+0000 7fb05ab24800 20 zone default found 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.839+0000 7fb05ab24800 4 Realm: () 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.839+0000 7fb05ab24800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.839+0000 7fb05ab24800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.839+0000 7fb05ab24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.839+0000 7fb05ab24800 20 zonegroup default 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.840+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.840+0000 7fb05ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.840+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.840+0000 7fb05ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.840+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.840+0000 7fb05ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.840+0000 7fb05ab24800 20 started sync module instance, tier type = 2024-09-12T00:26:59.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.840+0000 7fb05ab24800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:59.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.852+0000 7fb05ab24800 20 add_watcher() i=0 2024-09-12T00:26:59.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.852+0000 7fb05ab24800 20 add_watcher() i=1 2024-09-12T00:26:59.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.852+0000 7fb05ab24800 20 add_watcher() i=2 2024-09-12T00:26:59.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.852+0000 7fb05ab24800 20 add_watcher() i=3 2024-09-12T00:26:59.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.852+0000 7fb05ab24800 20 add_watcher() i=4 2024-09-12T00:26:59.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.852+0000 7fb05ab24800 20 add_watcher() i=5 2024-09-12T00:26:59.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.852+0000 7fb05ab24800 20 add_watcher() i=6 2024-09-12T00:26:59.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.853+0000 7fb05ab24800 20 add_watcher() i=7 2024-09-12T00:26:59.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.853+0000 7fb05ab24800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:59.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.855+0000 7faf0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:59.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.855+0000 7fb05ab24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:59.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.855+0000 7fb05ab24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:59.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.855+0000 7fb05ab24800 5 note: GC not initialized 2024-09-12T00:26:59.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.856+0000 7fae877fe640 20 reqs_thread_entry: start 2024-09-12T00:26:59.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.856+0000 7fb05ab24800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:59.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.856+0000 7fb05ab24800 20 Filter name: none 2024-09-12T00:26:59.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.856+0000 7fae857fa640 20 reqs_thread_entry: start 2024-09-12T00:26:59.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.856+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.856+0000 7fb05ab24800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:59.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.856+0000 7fb05ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.857+0000 7fb05ab24800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:59.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.857+0000 7fb05ab24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:59.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.857+0000 7fb05ab24800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:26:59.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.857+0000 7fb05ab24800 20 INFO: main: starting shard=0 2024-09-12T00:26:59.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.857+0000 7fb05ab24800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:59.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.857+0000 7fb05ab24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.857+0000 7fb05ab24800 20 INFO: main: starting shard=1 2024-09-12T00:26:59.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.857+0000 7fb05ab24800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:59.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.858+0000 7fb05ab24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.858+0000 7fb05ab24800 20 INFO: main: starting shard=2 2024-09-12T00:26:59.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.858+0000 7fb05ab24800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:59.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.858+0000 7fb05ab24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.858+0000 7fb05ab24800 20 INFO: main: starting shard=3 2024-09-12T00:26:59.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.858+0000 7fb05ab24800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:59.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.859+0000 7fb05ab24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.859+0000 7fb05ab24800 20 INFO: main: starting shard=4 2024-09-12T00:26:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.859+0000 7fb05ab24800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.859+0000 7fb05ab24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.859+0000 7fb05ab24800 20 INFO: main: starting shard=5 2024-09-12T00:26:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.859+0000 7fb05ab24800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.859+0000 7fb05ab24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.859+0000 7fb05ab24800 20 INFO: main: starting shard=6 2024-09-12T00:26:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.859+0000 7fb05ab24800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.860+0000 7fb05ab24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.860+0000 7fb05ab24800 20 INFO: main: starting shard=7 2024-09-12T00:26:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.860+0000 7fb05ab24800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:59.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.860+0000 7fb05ab24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.860+0000 7fb05ab24800 20 INFO: main: starting shard=8 2024-09-12T00:26:59.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.860+0000 7fb05ab24800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:59.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.861+0000 7fb05ab24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.861+0000 7fb05ab24800 20 INFO: main: starting shard=9 2024-09-12T00:26:59.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.861+0000 7fb05ab24800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:59.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.862+0000 7fb05ab24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.862+0000 7fb05ab24800 20 INFO: main: starting shard=10 2024-09-12T00:26:59.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.862+0000 7fb05ab24800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:59.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.862+0000 7fb05ab24800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.862+0000 7fb05ab24800 20 INFO: main: done 2024-09-12T00:26:59.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.863+0000 7faf0cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:59.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.865+0000 7fb05ab24800 20 remove_watcher() i=0 2024-09-12T00:26:59.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.865+0000 7fb05ab24800 2 removed watcher, disabling cache 2024-09-12T00:26:59.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.866+0000 7fb05ab24800 20 remove_watcher() i=1 2024-09-12T00:26:59.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.867+0000 7fb05ab24800 20 remove_watcher() i=2 2024-09-12T00:26:59.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.868+0000 7fb05ab24800 20 remove_watcher() i=3 2024-09-12T00:26:59.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.869+0000 7fb05ab24800 20 remove_watcher() i=4 2024-09-12T00:26:59.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.870+0000 7fb05ab24800 20 remove_watcher() i=5 2024-09-12T00:26:59.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.872+0000 7fb05ab24800 20 remove_watcher() i=6 2024-09-12T00:26:59.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.873+0000 7fb05ab24800 20 remove_watcher() i=7 2024-09-12T00:26:59.885 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:26:59.916 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:59.916 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:59.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.956+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.958+0000 7f23a6736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.958+0000 7f23a6736800 20 realm 2024-09-12T00:26:59.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.958+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.958+0000 7f23a6736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.958+0000 7f23a6736800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:59.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.958+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.958+0000 7f23a6736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.958+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.959+0000 7f23a6736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:59.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.959+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.959+0000 7f23a6736800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:59.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.959+0000 7f23a6736800 20 searching for the correct realm 2024-09-12T00:26:59.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.963+0000 7f23a1cb6640 0 -- 172.21.15.19:0/1545093899 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f23980b0350 msgr2=0x7f23980c1810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:59.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.966+0000 7f23a24b7640 0 -- 172.21.15.19:0/1545093899 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f239c022070 msgr2=0x7f239c03a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:59.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:26:59.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:26:59.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:59.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:59.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:59.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:59.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 zone default found 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 4 Realm: () 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 zonegroup default 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.971+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.972+0000 7f23a6736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.972+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.972+0000 7f23a6736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.972+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.972+0000 7f23a6736800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:59.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.972+0000 7f23a6736800 20 started sync module instance, tier type = 2024-09-12T00:26:59.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.972+0000 7f23a6736800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:26:59.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.982+0000 7f23a6736800 20 add_watcher() i=0 2024-09-12T00:26:59.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.982+0000 7f23a6736800 20 add_watcher() i=1 2024-09-12T00:26:59.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.982+0000 7f23a6736800 20 add_watcher() i=2 2024-09-12T00:26:59.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.982+0000 7f23a6736800 20 add_watcher() i=3 2024-09-12T00:26:59.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.982+0000 7f23a6736800 20 add_watcher() i=4 2024-09-12T00:26:59.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.983+0000 7f23a6736800 20 add_watcher() i=5 2024-09-12T00:26:59.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.983+0000 7f23a6736800 20 add_watcher() i=6 2024-09-12T00:26:59.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.983+0000 7f23a6736800 20 add_watcher() i=7 2024-09-12T00:26:59.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.983+0000 7f23a6736800 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:59.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.985+0000 7f2258fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:59.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.985+0000 7f23a6736800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:59.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.985+0000 7f23a6736800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:59.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.985+0000 7f23a6736800 5 note: GC not initialized 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.986+0000 7f21d37fe640 20 reqs_thread_entry: start 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.986+0000 7f23a6736800 20 init_complete bucket index max shards: 11 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.986+0000 7f23a6736800 20 Filter name: none 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.986+0000 7f21d17fa640 20 reqs_thread_entry: start 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.986+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.986+0000 7f23a6736800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.986+0000 7f23a6736800 20 rados->read ofs=0 len=0 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.987+0000 7f23a6736800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.987+0000 7f23a6736800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.987+0000 7f23a6736800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.987+0000 7f23a6736800 20 INFO: main: starting shard=0 2024-09-12T00:26:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.987+0000 7f23a6736800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:26:59.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.987+0000 7f23a6736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.987+0000 7f23a6736800 20 INFO: main: starting shard=1 2024-09-12T00:26:59.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.987+0000 7f23a6736800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:26:59.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.988+0000 7f23a6736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.988+0000 7f23a6736800 20 INFO: main: starting shard=2 2024-09-12T00:26:59.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.988+0000 7f23a6736800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:26:59.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.989+0000 7f23a6736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.989+0000 7f23a6736800 20 INFO: main: starting shard=3 2024-09-12T00:26:59.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.989+0000 7f23a6736800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:26:59.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.989+0000 7f23a6736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.989+0000 7f23a6736800 20 INFO: main: starting shard=4 2024-09-12T00:26:59.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.989+0000 7f23a6736800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:26:59.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.989+0000 7f23a6736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.989+0000 7f23a6736800 20 INFO: main: starting shard=5 2024-09-12T00:26:59.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.989+0000 7f23a6736800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:26:59.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.990+0000 7f23a6736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.990+0000 7f23a6736800 20 INFO: main: starting shard=6 2024-09-12T00:26:59.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.990+0000 7f23a6736800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:26:59.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.990+0000 7f23a6736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.990+0000 7f23a6736800 20 INFO: main: starting shard=7 2024-09-12T00:26:59.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.990+0000 7f23a6736800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:26:59.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.991+0000 7f23a6736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.991+0000 7f23a6736800 20 INFO: main: starting shard=8 2024-09-12T00:26:59.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.991+0000 7f23a6736800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:26:59.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.991+0000 7f23a6736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.991+0000 7f23a6736800 20 INFO: main: starting shard=9 2024-09-12T00:26:59.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.991+0000 7f23a6736800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:26:59.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.992+0000 7f23a6736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.992+0000 7f23a6736800 20 INFO: main: starting shard=10 2024-09-12T00:26:59.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.992+0000 7f23a6736800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:26:59.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.992+0000 7f23a6736800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:26:59.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.992+0000 7f23a6736800 20 INFO: main: done 2024-09-12T00:26:59.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.993+0000 7f2258fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:59.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.996+0000 7f23a6736800 20 remove_watcher() i=0 2024-09-12T00:26:59.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.996+0000 7f23a6736800 2 removed watcher, disabling cache 2024-09-12T00:26:59.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.997+0000 7f23a6736800 20 remove_watcher() i=1 2024-09-12T00:26:59.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.998+0000 7f23a6736800 20 remove_watcher() i=2 2024-09-12T00:26:59.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:26:59.999+0000 7f23a6736800 20 remove_watcher() i=3 2024-09-12T00:26:59.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.000+0000 7f23a6736800 20 remove_watcher() i=4 2024-09-12T00:27:00.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.001+0000 7f23a6736800 20 remove_watcher() i=5 2024-09-12T00:27:00.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.002+0000 7f23a6736800 20 remove_watcher() i=6 2024-09-12T00:27:00.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.003+0000 7f23a6736800 20 remove_watcher() i=7 2024-09-12T00:27:00.013 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:27:00.013 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:27:00.015 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:27:00.046 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:00.047 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:00.282 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.283+0000 7f70c0d8c640 0 --2- 172.21.15.19:0/2326720924 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55db29675470 0x55db2966a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:27:00.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.288+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.289+0000 7f70c5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:00.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.289+0000 7f70c5231800 20 realm 2024-09-12T00:27:00.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.289+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.289+0000 7f70c5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:00.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.289+0000 7f70c5231800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:00.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.289+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.289+0000 7f70c5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:00.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.290+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.290+0000 7f70c5231800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:00.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.290+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.291+0000 7f70c5231800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:00.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.291+0000 7f70c5231800 20 searching for the correct realm 2024-09-12T00:27:00.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.293+0000 7f70c058b640 0 -- 172.21.15.19:0/4087334588 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f70b008f020 msgr2=0x7f70b0086a40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:00.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.498+0000 7f70c0d8c640 0 -- 172.21.15.19:0/4087334588 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7f70b000b040 msgr2=0x7f70b0062040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:27:00.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.705+0000 7f70c5231800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:27:00.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.705+0000 7f70c5231800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:27:00.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.705+0000 7f70c5231800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:00.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.705+0000 7f70c5231800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:00.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.705+0000 7f70c5231800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:00.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.705+0000 7f70c5231800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:00.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.705+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.705+0000 7f70c5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:00.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.705+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.706+0000 7f70c5231800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:00.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.706+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.706+0000 7f70c5231800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:00.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.706+0000 7f70c5231800 20 zone default found 2024-09-12T00:27:00.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.706+0000 7f70c5231800 4 Realm: () 2024-09-12T00:27:00.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.706+0000 7f70c5231800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:27:00.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.706+0000 7f70c5231800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:27:00.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.706+0000 7f70c5231800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:00.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.706+0000 7f70c5231800 20 zonegroup default 2024-09-12T00:27:00.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.706+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.706+0000 7f70c5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:00.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.707+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.707+0000 7f70c5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:00.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.707+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.707+0000 7f70c5231800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:00.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.707+0000 7f70c5231800 20 started sync module instance, tier type = 2024-09-12T00:27:00.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.707+0000 7f70c5231800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:27:00.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.717+0000 7f70c5231800 20 add_watcher() i=0 2024-09-12T00:27:00.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.717+0000 7f70c5231800 20 add_watcher() i=1 2024-09-12T00:27:00.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.717+0000 7f70c5231800 20 add_watcher() i=2 2024-09-12T00:27:00.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.717+0000 7f70c5231800 20 add_watcher() i=3 2024-09-12T00:27:00.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.717+0000 7f70c5231800 20 add_watcher() i=4 2024-09-12T00:27:00.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.717+0000 7f70c5231800 20 add_watcher() i=5 2024-09-12T00:27:00.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.717+0000 7f70c5231800 20 add_watcher() i=6 2024-09-12T00:27:00.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.718+0000 7f70c5231800 20 add_watcher() i=7 2024-09-12T00:27:00.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.718+0000 7f70c5231800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:00.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.720+0000 7f6f76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:00.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.721+0000 7f70c5231800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:00.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.721+0000 7f70c5231800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:00.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.721+0000 7f70c5231800 5 note: GC not initialized 2024-09-12T00:27:00.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.721+0000 7f6f75fdb640 20 reqs_thread_entry: start 2024-09-12T00:27:00.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.721+0000 7f70c5231800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:00.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.721+0000 7f70c5231800 20 Filter name: none 2024-09-12T00:27:00.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.721+0000 7f6ee77fe640 20 reqs_thread_entry: start 2024-09-12T00:27:00.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.721+0000 7f70c5231800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:27:00.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.721+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.722+0000 7f70c5231800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:27:00.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.722+0000 7f70c5231800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:27:00.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.722+0000 7f70c5231800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.722+0000 7f70c5231800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 : miss 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.722+0000 7f70c5231800 20 rados->read ofs=0 len=0 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.723+0000 7f70c5231800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.723+0000 7f70c5231800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 info.flags=0x17 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.723+0000 7f70c5231800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 to cache LRU end 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.723+0000 7f70c5231800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.723+0000 7f70c5231800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.723+0000 7f70c5231800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.723+0000 7f70c5231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.723+0000 7f70c5231800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.723+0000 7f70c5231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.724+0000 7f70c5231800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:27:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.724+0000 7f70c5231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:27:00.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.724+0000 7f70c5231800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:27:00.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.724+0000 7f70c5231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:27:00.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.725+0000 7f70c5231800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:27:00.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.725+0000 7f70c5231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:27:00.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.725+0000 7f70c5231800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:27:00.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.725+0000 7f70c5231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:00.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.726+0000 7f70c5231800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:27:00.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.726+0000 7f70c5231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:27:00.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.726+0000 7f70c5231800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:27:00.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.726+0000 7f70c5231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:27:00.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.727+0000 7f70c5231800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:27:00.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.727+0000 7f70c5231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:00.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.727+0000 7f70c5231800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:27:00.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.727+0000 7f70c5231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:27:00.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.728+0000 7f70c5231800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:27:00.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.728+0000 7f70c5231800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:00.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.729+0000 7f70c5231800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:27:00.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.729+0000 7f70c5231800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:27:00.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.730+0000 7f6f76fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:00.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.732+0000 7f70c5231800 20 remove_watcher() i=0 2024-09-12T00:27:00.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.732+0000 7f70c5231800 2 removed watcher, disabling cache 2024-09-12T00:27:00.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.734+0000 7f70c5231800 20 remove_watcher() i=1 2024-09-12T00:27:00.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.735+0000 7f70c5231800 20 remove_watcher() i=2 2024-09-12T00:27:00.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.736+0000 7f70c5231800 20 remove_watcher() i=3 2024-09-12T00:27:00.736 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.737+0000 7f70c5231800 20 remove_watcher() i=4 2024-09-12T00:27:00.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.738+0000 7f70c5231800 20 remove_watcher() i=5 2024-09-12T00:27:00.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.739+0000 7f70c5231800 20 remove_watcher() i=6 2024-09-12T00:27:00.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:00.740+0000 7f70c5231800 20 remove_watcher() i=7 2024-09-12T00:27:00.751 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:27:00.751 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:27:00.754 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:00.754 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:00.778 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:00.778 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:00.802 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:00.802 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:00.876 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:27:00.876 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:27:00.876 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:00.877 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:00.951 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:00.951 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.179 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.180 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.237 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.237 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.265 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.265 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.314 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.314 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.339 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.339 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.392 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.392 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.416 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.416 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.469 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.470 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.493 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.494 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.545 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.545 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.571 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.571 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.625 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:01.626 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:01.651 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:27:02.067 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:27:03.491 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:03.491 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:03.574 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:27:03.575 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:27:03.608 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:03.608 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:03.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.651+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.653+0000 7f38e3121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:03.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.653+0000 7f38e3121800 20 realm 2024-09-12T00:27:03.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.653+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.653+0000 7f38e3121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:03.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.653+0000 7f38e3121800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:03.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.653+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.653+0000 7f38e3121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:03.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.653+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.654+0000 7f38e3121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:03.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.654+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.654+0000 7f38e3121800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:03.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.654+0000 7f38e3121800 20 searching for the correct realm 2024-09-12T00:27:03.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.658+0000 7f38de60b640 0 -- 172.21.15.19:0/3452945771 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f38d401f040 msgr2=0x7f38d40890b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:03.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.863+0000 7f38df60d640 0 -- 172.21.15.19:0/3452945771 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x561f54b6ae60 msgr2=0x561f54b6d2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:03.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.868+0000 7f38e3121800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:27:03.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.868+0000 7f38e3121800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:27:03.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.868+0000 7f38e3121800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:03.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.868+0000 7f38e3121800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:03.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.868+0000 7f38e3121800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:03.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.868+0000 7f38e3121800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:03.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.868+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.868+0000 7f38e3121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:03.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.868+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:03.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:03.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 20 zone default found 2024-09-12T00:27:03.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 4 Realm: () 2024-09-12T00:27:03.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:27:03.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:27:03.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:03.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 20 zonegroup default 2024-09-12T00:27:03.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:03.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.869+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.870+0000 7f38e3121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:03.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.870+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.870+0000 7f38e3121800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:03.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.870+0000 7f38e3121800 20 started sync module instance, tier type = 2024-09-12T00:27:03.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.870+0000 7f38e3121800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:27:03.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.880+0000 7f38e3121800 20 add_watcher() i=0 2024-09-12T00:27:03.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.880+0000 7f38e3121800 20 add_watcher() i=1 2024-09-12T00:27:03.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.880+0000 7f38e3121800 20 add_watcher() i=2 2024-09-12T00:27:03.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.880+0000 7f38e3121800 20 add_watcher() i=3 2024-09-12T00:27:03.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.880+0000 7f38e3121800 20 add_watcher() i=4 2024-09-12T00:27:03.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.880+0000 7f38e3121800 20 add_watcher() i=5 2024-09-12T00:27:03.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.881+0000 7f38e3121800 20 add_watcher() i=6 2024-09-12T00:27:03.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.881+0000 7f38e3121800 20 add_watcher() i=7 2024-09-12T00:27:03.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.881+0000 7f38e3121800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:03.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.883+0000 7f37957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:03.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.883+0000 7f38e3121800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:03.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.883+0000 7f38e3121800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:03.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.883+0000 7f38e3121800 5 note: GC not initialized 2024-09-12T00:27:03.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.883+0000 7f370ffff640 20 reqs_thread_entry: start 2024-09-12T00:27:03.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.883+0000 7f38e3121800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:03.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.883+0000 7f38e3121800 20 Filter name: none 2024-09-12T00:27:03.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.884+0000 7f370dffb640 20 reqs_thread_entry: start 2024-09-12T00:27:03.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.884+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.884+0000 7f38e3121800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:27:03.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.884+0000 7f38e3121800 20 rados->read ofs=0 len=0 2024-09-12T00:27:03.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.884+0000 7f38e3121800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:27:03.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.884+0000 7f38e3121800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:03.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.884+0000 7f38e3121800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:27:03.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.884+0000 7f38e3121800 20 INFO: main: starting shard=0 2024-09-12T00:27:03.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.885+0000 7f38e3121800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:27:03.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.885+0000 7f38e3121800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:03.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.885+0000 7f38e3121800 20 INFO: main: starting shard=1 2024-09-12T00:27:03.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.885+0000 7f38e3121800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:03.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.886+0000 7f38e3121800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:03.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.886+0000 7f38e3121800 20 INFO: main: starting shard=2 2024-09-12T00:27:03.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.886+0000 7f38e3121800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:27:03.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.886+0000 7f38e3121800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:03.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.886+0000 7f38e3121800 20 INFO: main: starting shard=3 2024-09-12T00:27:03.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.886+0000 7f38e3121800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:27:03.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.887+0000 7f38e3121800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:03.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.887+0000 7f38e3121800 20 INFO: main: starting shard=4 2024-09-12T00:27:03.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.887+0000 7f38e3121800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:27:03.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.887+0000 7f38e3121800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:03.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.887+0000 7f38e3121800 20 INFO: main: starting shard=5 2024-09-12T00:27:03.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.887+0000 7f38e3121800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:03.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.887+0000 7f38e3121800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:03.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.887+0000 7f38e3121800 20 INFO: main: starting shard=6 2024-09-12T00:27:03.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.887+0000 7f38e3121800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:27:03.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.888+0000 7f38e3121800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:03.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.888+0000 7f38e3121800 20 INFO: main: starting shard=7 2024-09-12T00:27:03.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.888+0000 7f38e3121800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.889+0000 7f38e3121800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.889+0000 7f38e3121800 20 INFO: main: starting shard=8 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.889+0000 7f38e3121800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.889+0000 7f38e3121800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.889+0000 7f38e3121800 20 INFO: main: starting shard=9 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.889+0000 7f38e3121800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.890+0000 7f38e3121800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.890+0000 7f38e3121800 20 INFO: main: starting shard=10 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.890+0000 7f38e3121800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.890+0000 7f38e3121800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.890+0000 7f38e3121800 20 INFO: main: done 2024-09-12T00:27:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.891+0000 7f37957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:03.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.894+0000 7f38e3121800 20 remove_watcher() i=0 2024-09-12T00:27:03.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.894+0000 7f38e3121800 2 removed watcher, disabling cache 2024-09-12T00:27:03.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.895+0000 7f38e3121800 20 remove_watcher() i=1 2024-09-12T00:27:03.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.896+0000 7f38e3121800 20 remove_watcher() i=2 2024-09-12T00:27:03.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.897+0000 7f38e3121800 20 remove_watcher() i=3 2024-09-12T00:27:03.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.899+0000 7f38e3121800 20 remove_watcher() i=4 2024-09-12T00:27:03.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.900+0000 7f38e3121800 20 remove_watcher() i=5 2024-09-12T00:27:03.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.901+0000 7f38e3121800 20 remove_watcher() i=6 2024-09-12T00:27:03.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:03.902+0000 7f38e3121800 20 remove_watcher() i=7 2024-09-12T00:27:03.915 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:03.916 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:03.941 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:03.941 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:03.968 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:03.969 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:04.050 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:27:04.052 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:27:04.083 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:04.083 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:04.124 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.123+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.125+0000 7f6532a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.125+0000 7f6532a0e800 20 realm 2024-09-12T00:27:04.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.125+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.125+0000 7f6532a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.125+0000 7f6532a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:04.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.125+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.126+0000 7f6532a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.126+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.126+0000 7f6532a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:04.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.126+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.127+0000 7f6532a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:04.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.127+0000 7f6532a0e800 20 searching for the correct realm 2024-09-12T00:27:04.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.130+0000 7f652d858640 0 -- 172.21.15.19:0/1375504306 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f652406d070 msgr2=0x7f65240aa390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:04.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.134+0000 7f652e85a640 0 -- 172.21.15.19:0/1375504306 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55aaffcefb30 msgr2=0x55aaffcf1fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:04.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.138+0000 7f6532a0e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:27:04.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.138+0000 7f6532a0e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:27:04.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.138+0000 7f6532a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:04.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.138+0000 7f6532a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:04.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.138+0000 7f6532a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:04.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.138+0000 7f6532a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:04.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.138+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.138+0000 7f6532a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.138+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:04.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:04.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 20 zone default found 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 4 Realm: () 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 20 zonegroup default 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.139+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.140+0000 7f6532a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.140+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.140+0000 7f6532a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.140+0000 7f6532a0e800 20 started sync module instance, tier type = 2024-09-12T00:27:04.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.140+0000 7f6532a0e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:27:04.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.149+0000 7f6532a0e800 20 add_watcher() i=0 2024-09-12T00:27:04.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.149+0000 7f6532a0e800 20 add_watcher() i=1 2024-09-12T00:27:04.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.149+0000 7f6532a0e800 20 add_watcher() i=2 2024-09-12T00:27:04.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.149+0000 7f6532a0e800 20 add_watcher() i=3 2024-09-12T00:27:04.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.149+0000 7f6532a0e800 20 add_watcher() i=4 2024-09-12T00:27:04.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.149+0000 7f6532a0e800 20 add_watcher() i=5 2024-09-12T00:27:04.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.149+0000 7f6532a0e800 20 add_watcher() i=6 2024-09-12T00:27:04.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.150+0000 7f6532a0e800 20 add_watcher() i=7 2024-09-12T00:27:04.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.150+0000 7f6532a0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:04.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.152+0000 7f63e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:04.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.152+0000 7f6532a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:04.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.152+0000 7f6532a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:04.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.152+0000 7f6532a0e800 5 note: GC not initialized 2024-09-12T00:27:04.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.153+0000 7f635f7fe640 20 reqs_thread_entry: start 2024-09-12T00:27:04.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.153+0000 7f6532a0e800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:04.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.153+0000 7f6532a0e800 20 Filter name: none 2024-09-12T00:27:04.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.153+0000 7f635d7fa640 20 reqs_thread_entry: start 2024-09-12T00:27:04.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.153+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.153+0000 7f6532a0e800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:27:04.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.153+0000 7f6532a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.154+0000 7f6532a0e800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:27:04.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.154+0000 7f6532a0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:04.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.154+0000 7f6532a0e800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:27:04.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.154+0000 7f6532a0e800 20 INFO: main: starting shard=0 2024-09-12T00:27:04.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.154+0000 7f6532a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:27:04.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.154+0000 7f6532a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.154+0000 7f6532a0e800 20 INFO: main: starting shard=1 2024-09-12T00:27:04.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.154+0000 7f6532a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:04.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.155+0000 7f6532a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.155+0000 7f6532a0e800 20 INFO: main: starting shard=2 2024-09-12T00:27:04.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.155+0000 7f6532a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:27:04.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.155+0000 7f6532a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.155+0000 7f6532a0e800 20 INFO: main: starting shard=3 2024-09-12T00:27:04.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.155+0000 7f6532a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:27:04.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.156+0000 7f6532a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.156+0000 7f6532a0e800 20 INFO: main: starting shard=4 2024-09-12T00:27:04.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.156+0000 7f6532a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:27:04.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.156+0000 7f6532a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.156+0000 7f6532a0e800 20 INFO: main: starting shard=5 2024-09-12T00:27:04.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.156+0000 7f6532a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:04.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.157+0000 7f6532a0e800 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:27:04.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.157+0000 7f6532a0e800 20 INFO: main: starting shard=6 2024-09-12T00:27:04.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.157+0000 7f6532a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:27:04.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.157+0000 7f6532a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.157+0000 7f6532a0e800 20 INFO: main: starting shard=7 2024-09-12T00:27:04.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.157+0000 7f6532a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:27:04.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.158+0000 7f6532a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.158+0000 7f6532a0e800 20 INFO: main: starting shard=8 2024-09-12T00:27:04.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.158+0000 7f6532a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:04.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.158+0000 7f6532a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.158+0000 7f6532a0e800 20 INFO: main: starting shard=9 2024-09-12T00:27:04.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.158+0000 7f6532a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:27:04.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.159+0000 7f6532a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.159+0000 7f6532a0e800 20 INFO: main: starting shard=10 2024-09-12T00:27:04.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.159+0000 7f6532a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:04.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.159+0000 7f6532a0e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.159+0000 7f6532a0e800 20 INFO: main: done 2024-09-12T00:27:04.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.160+0000 7f63e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:04.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.163+0000 7f6532a0e800 20 remove_watcher() i=0 2024-09-12T00:27:04.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.163+0000 7f6532a0e800 2 removed watcher, disabling cache 2024-09-12T00:27:04.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.164+0000 7f6532a0e800 20 remove_watcher() i=1 2024-09-12T00:27:04.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.165+0000 7f6532a0e800 20 remove_watcher() i=2 2024-09-12T00:27:04.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.166+0000 7f6532a0e800 20 remove_watcher() i=3 2024-09-12T00:27:04.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.166+0000 7f6532a0e800 20 remove_watcher() i=4 2024-09-12T00:27:04.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.168+0000 7f6532a0e800 20 remove_watcher() i=5 2024-09-12T00:27:04.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.169+0000 7f6532a0e800 20 remove_watcher() i=6 2024-09-12T00:27:04.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.169+0000 7f6532a0e800 20 remove_watcher() i=7 2024-09-12T00:27:04.182 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:04.182 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:04.205 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:04.206 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:04.286 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:27:04.288 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:27:04.319 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:04.319 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:04.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.359+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.362+0000 7f3aeb708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.362+0000 7f3aeb708800 20 realm 2024-09-12T00:27:04.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.362+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.363+0000 7f3aeb708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.363+0000 7f3aeb708800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:04.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.363+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.363+0000 7f3aeb708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.363+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.364+0000 7f3aeb708800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:04.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.364+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.364+0000 7f3aeb708800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:04.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.364+0000 7f3aeb708800 20 searching for the correct realm 2024-09-12T00:27:04.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.368+0000 7f3ae89f1640 0 -- 172.21.15.19:0/2901779631 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3ae0054040 msgr2=0x7f3ae0008420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:04.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.572+0000 7f3ae91f2640 0 -- 172.21.15.19:0/2901779631 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f3ae4029070 msgr2=0x7f3ae40640c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:27:04.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.577+0000 7f3aeb708800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:27:04.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.577+0000 7f3aeb708800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:27:04.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.577+0000 7f3aeb708800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:04.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.577+0000 7f3aeb708800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:04.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.577+0000 7f3aeb708800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:04.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.577+0000 7f3aeb708800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:04.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.577+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.577+0000 7f3aeb708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.577+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.578+0000 7f3aeb708800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:04.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.578+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.578+0000 7f3aeb708800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:04.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.578+0000 7f3aeb708800 20 zone default found 2024-09-12T00:27:04.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.578+0000 7f3aeb708800 4 Realm: () 2024-09-12T00:27:04.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.578+0000 7f3aeb708800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:27:04.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.578+0000 7f3aeb708800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:27:04.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.578+0000 7f3aeb708800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:04.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.578+0000 7f3aeb708800 20 zonegroup default 2024-09-12T00:27:04.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.578+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.579+0000 7f3aeb708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.579+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.579+0000 7f3aeb708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.579+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.580+0000 7f3aeb708800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.580+0000 7f3aeb708800 20 started sync module instance, tier type = 2024-09-12T00:27:04.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.580+0000 7f3aeb708800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:27:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.589+0000 7f3aeb708800 20 add_watcher() i=0 2024-09-12T00:27:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.589+0000 7f3aeb708800 20 add_watcher() i=1 2024-09-12T00:27:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.589+0000 7f3aeb708800 20 add_watcher() i=2 2024-09-12T00:27:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.589+0000 7f3aeb708800 20 add_watcher() i=3 2024-09-12T00:27:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.589+0000 7f3aeb708800 20 add_watcher() i=4 2024-09-12T00:27:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.589+0000 7f3aeb708800 20 add_watcher() i=5 2024-09-12T00:27:04.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.589+0000 7f3aeb708800 20 add_watcher() i=6 2024-09-12T00:27:04.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.590+0000 7f3aeb708800 20 add_watcher() i=7 2024-09-12T00:27:04.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.590+0000 7f3aeb708800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:04.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.592+0000 7f399f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:04.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.593+0000 7f3aeb708800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:04.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.593+0000 7f3aeb708800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:04.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.593+0000 7f3aeb708800 5 note: GC not initialized 2024-09-12T00:27:04.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.593+0000 7f399e7e4640 20 reqs_thread_entry: start 2024-09-12T00:27:04.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.593+0000 7f3aeb708800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:04.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.593+0000 7f3aeb708800 20 Filter name: none 2024-09-12T00:27:04.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.593+0000 7f390ffff640 20 reqs_thread_entry: start 2024-09-12T00:27:04.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.593+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.594+0000 7f3aeb708800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:27:04.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.594+0000 7f3aeb708800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.594+0000 7f3aeb708800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:27:04.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.594+0000 7f3aeb708800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:04.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.594+0000 7f3aeb708800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:27:04.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.594+0000 7f3aeb708800 20 INFO: main: starting shard=0 2024-09-12T00:27:04.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.594+0000 7f3aeb708800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:27:04.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.595+0000 7f3aeb708800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.595+0000 7f3aeb708800 20 INFO: main: starting shard=1 2024-09-12T00:27:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.595+0000 7f3aeb708800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.595+0000 7f3aeb708800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:27:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.595+0000 7f3aeb708800 20 INFO: main: starting shard=2 2024-09-12T00:27:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.595+0000 7f3aeb708800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:27:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.596+0000 7f3aeb708800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.596+0000 7f3aeb708800 20 INFO: main: starting shard=3 2024-09-12T00:27:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.596+0000 7f3aeb708800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:27:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.596+0000 7f3aeb708800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.596+0000 7f3aeb708800 20 INFO: main: starting shard=4 2024-09-12T00:27:04.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.596+0000 7f3aeb708800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:27:04.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.597+0000 7f3aeb708800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.597+0000 7f3aeb708800 20 INFO: main: starting shard=5 2024-09-12T00:27:04.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.597+0000 7f3aeb708800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:04.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.597+0000 7f3aeb708800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.597+0000 7f3aeb708800 20 INFO: main: starting shard=6 2024-09-12T00:27:04.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.597+0000 7f3aeb708800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:27:04.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.598+0000 7f3aeb708800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.598+0000 7f3aeb708800 20 INFO: main: starting shard=7 2024-09-12T00:27:04.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.598+0000 7f3aeb708800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:27:04.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.598+0000 7f3aeb708800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.598+0000 7f3aeb708800 20 INFO: main: starting shard=8 2024-09-12T00:27:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.598+0000 7f3aeb708800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.599+0000 7f3aeb708800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.599+0000 7f3aeb708800 20 INFO: main: starting shard=9 2024-09-12T00:27:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.599+0000 7f3aeb708800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:27:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.599+0000 7f3aeb708800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.599+0000 7f3aeb708800 20 INFO: main: starting shard=10 2024-09-12T00:27:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.599+0000 7f3aeb708800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.600+0000 7f3aeb708800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:04.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.600+0000 7f3aeb708800 20 INFO: main: done 2024-09-12T00:27:04.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.601+0000 7f399f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:04.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.603+0000 7f3aeb708800 20 remove_watcher() i=0 2024-09-12T00:27:04.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.603+0000 7f3aeb708800 2 removed watcher, disabling cache 2024-09-12T00:27:04.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.604+0000 7f3aeb708800 20 remove_watcher() i=1 2024-09-12T00:27:04.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.606+0000 7f3aeb708800 20 remove_watcher() i=2 2024-09-12T00:27:04.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.607+0000 7f3aeb708800 20 remove_watcher() i=3 2024-09-12T00:27:04.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.608+0000 7f3aeb708800 20 remove_watcher() i=4 2024-09-12T00:27:04.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.609+0000 7f3aeb708800 20 remove_watcher() i=5 2024-09-12T00:27:04.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.610+0000 7f3aeb708800 20 remove_watcher() i=6 2024-09-12T00:27:04.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.611+0000 7f3aeb708800 20 remove_watcher() i=7 2024-09-12T00:27:04.624 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:04.624 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:04.647 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:04.647 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:04.733 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:27:04.734 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:27:04.766 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:04.766 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:04.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.806+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.808+0000 7fe06f015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.808+0000 7fe06f015800 20 realm 2024-09-12T00:27:04.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.808+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.808+0000 7fe06f015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.808+0000 7fe06f015800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:04.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.808+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.808+0000 7fe06f015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:04.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.808+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.809+0000 7fe06f015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:04.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.809+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:04.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.810+0000 7fe06f015800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:04.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.810+0000 7fe06f015800 20 searching for the correct realm 2024-09-12T00:27:04.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:04.813+0000 7fe069f91640 0 -- 172.21.15.19:0/2000220709 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fe060084030 msgr2=0x7fe0600a80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:05.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.018+0000 7fe06af93640 0 -- 172.21.15.19:0/2000220709 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x559c61f082c0 msgr2=0x559c61f0a6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:05.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.023+0000 7fe06f015800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:27:05.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.023+0000 7fe06f015800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:27:05.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.023+0000 7fe06f015800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:05.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.023+0000 7fe06f015800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:05.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.023+0000 7fe06f015800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:05.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.023+0000 7fe06f015800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:05.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.023+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.023+0000 7fe06f015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:05.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.023+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.023+0000 7fe06f015800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:05.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.023+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:05.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 20 zone default found 2024-09-12T00:27:05.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 4 Realm: () 2024-09-12T00:27:05.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:27:05.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:27:05.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:05.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 20 zonegroup default 2024-09-12T00:27:05.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:05.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:05.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.024+0000 7fe06f015800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:05.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.025+0000 7fe06f015800 20 started sync module instance, tier type = 2024-09-12T00:27:05.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.025+0000 7fe06f015800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:27:05.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.035+0000 7fe06f015800 20 add_watcher() i=0 2024-09-12T00:27:05.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.035+0000 7fe06f015800 20 add_watcher() i=1 2024-09-12T00:27:05.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.035+0000 7fe06f015800 20 add_watcher() i=2 2024-09-12T00:27:05.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.035+0000 7fe06f015800 20 add_watcher() i=3 2024-09-12T00:27:05.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.035+0000 7fe06f015800 20 add_watcher() i=4 2024-09-12T00:27:05.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.035+0000 7fe06f015800 20 add_watcher() i=5 2024-09-12T00:27:05.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.035+0000 7fe06f015800 20 add_watcher() i=6 2024-09-12T00:27:05.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.036+0000 7fe06f015800 20 add_watcher() i=7 2024-09-12T00:27:05.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.036+0000 7fe06f015800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:05.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.038+0000 7fdf20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:05.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.038+0000 7fe06f015800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:05.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.038+0000 7fe06f015800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:05.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.038+0000 7fe06f015800 5 note: GC not initialized 2024-09-12T00:27:05.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.038+0000 7fde9b7fe640 20 reqs_thread_entry: start 2024-09-12T00:27:05.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.038+0000 7fe06f015800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:05.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.038+0000 7fe06f015800 20 Filter name: none 2024-09-12T00:27:05.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.039+0000 7fde997fa640 20 reqs_thread_entry: start 2024-09-12T00:27:05.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.039+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.039+0000 7fe06f015800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:27:05.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.039+0000 7fe06f015800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.039+0000 7fe06f015800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:27:05.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.039+0000 7fe06f015800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:05.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.039+0000 7fe06f015800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:27:05.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.039+0000 7fe06f015800 20 INFO: main: starting shard=0 2024-09-12T00:27:05.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.039+0000 7fe06f015800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:27:05.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.040+0000 7fe06f015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:05.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.040+0000 7fe06f015800 20 INFO: main: starting shard=1 2024-09-12T00:27:05.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.040+0000 7fe06f015800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:05.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.041+0000 7fe06f015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:05.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.041+0000 7fe06f015800 20 INFO: main: starting shard=2 2024-09-12T00:27:05.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.041+0000 7fe06f015800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:27:05.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.041+0000 7fe06f015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:05.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.041+0000 7fe06f015800 20 INFO: main: starting shard=3 2024-09-12T00:27:05.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.041+0000 7fe06f015800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:27:05.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.042+0000 7fe06f015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:05.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.042+0000 7fe06f015800 20 INFO: main: starting shard=4 2024-09-12T00:27:05.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.042+0000 7fe06f015800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:27:05.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.042+0000 7fe06f015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:05.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.042+0000 7fe06f015800 20 INFO: main: starting shard=5 2024-09-12T00:27:05.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.042+0000 7fe06f015800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:05.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.043+0000 7fe06f015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:05.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.043+0000 7fe06f015800 20 INFO: main: starting shard=6 2024-09-12T00:27:05.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.043+0000 7fe06f015800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:27:05.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.043+0000 7fe06f015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:05.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.043+0000 7fe06f015800 20 INFO: main: starting shard=7 2024-09-12T00:27:05.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.043+0000 7fe06f015800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:27:05.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.044+0000 7fe06f015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:05.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.044+0000 7fe06f015800 20 INFO: main: starting shard=8 2024-09-12T00:27:05.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.044+0000 7fe06f015800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:05.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.044+0000 7fe06f015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:05.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.044+0000 7fe06f015800 20 INFO: main: starting shard=9 2024-09-12T00:27:05.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.044+0000 7fe06f015800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:27:05.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.045+0000 7fe06f015800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:27:05.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.045+0000 7fe06f015800 20 INFO: main: starting shard=10 2024-09-12T00:27:05.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.045+0000 7fe06f015800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:05.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.045+0000 7fe06f015800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:27:05.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.045+0000 7fe06f015800 20 INFO: main: done 2024-09-12T00:27:05.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.046+0000 7fdf20fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:05.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.049+0000 7fe06f015800 20 remove_watcher() i=0 2024-09-12T00:27:05.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.049+0000 7fe06f015800 2 removed watcher, disabling cache 2024-09-12T00:27:05.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.050+0000 7fe06f015800 20 remove_watcher() i=1 2024-09-12T00:27:05.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.051+0000 7fe06f015800 20 remove_watcher() i=2 2024-09-12T00:27:05.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.052+0000 7fe06f015800 20 remove_watcher() i=3 2024-09-12T00:27:05.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.053+0000 7fe06f015800 20 remove_watcher() i=4 2024-09-12T00:27:05.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.055+0000 7fe06f015800 20 remove_watcher() i=5 2024-09-12T00:27:05.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.056+0000 7fe06f015800 20 remove_watcher() i=6 2024-09-12T00:27:05.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.057+0000 7fe06f015800 20 remove_watcher() i=7 2024-09-12T00:27:05.070 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:05.070 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:05.094 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:27:05.504 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:27:05.924 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:27:05.954 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:05.954 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:05.994 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.994+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.995+0000 7fa16f030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:05.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.995+0000 7fa16f030800 20 realm 2024-09-12T00:27:05.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.995+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.996+0000 7fa16f030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:05.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.996+0000 7fa16f030800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:05.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.996+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.996+0000 7fa16f030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:05.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.996+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.997+0000 7fa16f030800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:05.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.997+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:05.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.997+0000 7fa16f030800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:05.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:05.997+0000 7fa16f030800 20 searching for the correct realm 2024-09-12T00:27:06.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.001+0000 7fa169b52640 0 -- 172.21.15.19:0/1868133403 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fa16007aa00 msgr2=0x7fa160047940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:06.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.005+0000 7fa16a353640 0 -- 172.21.15.19:0/1868133403 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fa164055410 msgr2=0x7fa164055850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:27:06.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.009+0000 7fa16f030800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:27:06.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.009+0000 7fa16f030800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:27:06.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.009+0000 7fa16f030800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:06.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.009+0000 7fa16f030800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:06.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.009+0000 7fa16f030800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:06.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.009+0000 7fa16f030800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:06.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.009+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.009+0000 7fa16f030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:06.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:06.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 20 zone default found 2024-09-12T00:27:06.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 4 Realm: () 2024-09-12T00:27:06.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:27:06.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:27:06.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:06.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 20 zonegroup default 2024-09-12T00:27:06.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.010+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.011+0000 7fa16f030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.011+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.011+0000 7fa16f030800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.011+0000 7fa16f030800 20 started sync module instance, tier type = 2024-09-12T00:27:06.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.011+0000 7fa16f030800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:27:06.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.022+0000 7fa16f030800 20 add_watcher() i=0 2024-09-12T00:27:06.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.022+0000 7fa16f030800 20 add_watcher() i=1 2024-09-12T00:27:06.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.022+0000 7fa16f030800 20 add_watcher() i=2 2024-09-12T00:27:06.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.022+0000 7fa16f030800 20 add_watcher() i=3 2024-09-12T00:27:06.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.022+0000 7fa16f030800 20 add_watcher() i=4 2024-09-12T00:27:06.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.022+0000 7fa16f030800 20 add_watcher() i=5 2024-09-12T00:27:06.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.022+0000 7fa16f030800 20 add_watcher() i=6 2024-09-12T00:27:06.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.023+0000 7fa16f030800 20 add_watcher() i=7 2024-09-12T00:27:06.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.023+0000 7fa16f030800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:06.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.025+0000 7fa020fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:06.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.025+0000 7fa16f030800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:06.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.025+0000 7fa16f030800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:06.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.025+0000 7fa16f030800 5 note: GC not initialized 2024-09-12T00:27:06.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.026+0000 7f9f9b7fe640 20 reqs_thread_entry: start 2024-09-12T00:27:06.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.026+0000 7fa16f030800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:06.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.026+0000 7fa16f030800 20 Filter name: none 2024-09-12T00:27:06.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.026+0000 7f9f997fa640 20 reqs_thread_entry: start 2024-09-12T00:27:06.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.026+0000 7fa16f030800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:27:06.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.026+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.026+0000 7fa16f030800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:27:06.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.026+0000 7fa16f030800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:27:06.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.026+0000 7fa16f030800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:27:06.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.026+0000 7fa16f030800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 : miss 2024-09-12T00:27:06.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.026+0000 7fa16f030800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.027+0000 7fa16f030800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:27:06.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.027+0000 7fa16f030800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 info.flags=0x17 2024-09-12T00:27:06.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.027+0000 7fa16f030800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 to cache LRU end 2024-09-12T00:27:06.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.027+0000 7fa16f030800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:06.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.027+0000 7fa16f030800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:27:06.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.027+0000 7fa16f030800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 2024-09-12T00:27:06.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.027+0000 7fa16f030800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:27:06.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.027+0000 7fa16f030800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:06.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.028+0000 7fa16f030800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:27:06.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.029+0000 7fa16f030800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:27:06.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.029+0000 7fa16f030800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:27:06.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.029+0000 7fa16f030800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:06.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.030+0000 7fa16f030800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:27:06.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.031+0000 7fa16f030800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:27:06.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.031+0000 7fa16f030800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:06.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.032+0000 7fa16f030800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:27:06.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.033+0000 7fa16f030800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:06.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.040+0000 7fa020fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:06.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.042+0000 7fa16f030800 20 remove_watcher() i=0 2024-09-12T00:27:06.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.042+0000 7fa16f030800 2 removed watcher, disabling cache 2024-09-12T00:27:06.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.044+0000 7fa16f030800 20 remove_watcher() i=1 2024-09-12T00:27:06.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.045+0000 7fa16f030800 20 remove_watcher() i=2 2024-09-12T00:27:06.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.046+0000 7fa16f030800 20 remove_watcher() i=3 2024-09-12T00:27:06.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.047+0000 7fa16f030800 20 remove_watcher() i=4 2024-09-12T00:27:06.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.048+0000 7fa16f030800 20 remove_watcher() i=5 2024-09-12T00:27:06.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.049+0000 7fa16f030800 20 remove_watcher() i=6 2024-09-12T00:27:06.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.050+0000 7fa16f030800 20 remove_watcher() i=7 2024-09-12T00:27:06.063 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:27:06.098 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:06.098 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:06.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.139+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.140+0000 7f3709717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.140+0000 7f3709717800 20 realm 2024-09-12T00:27:06.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.140+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.141+0000 7f3709717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.141+0000 7f3709717800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:06.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.141+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.141+0000 7f3709717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.141+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.141+0000 7f3709717800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:06.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.141+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.142+0000 7f3709717800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:06.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.142+0000 7f3709717800 20 searching for the correct realm 2024-09-12T00:27:06.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.145+0000 7f3706a00640 0 -- 172.21.15.19:0/4286145768 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f36fc026040 msgr2=0x7f36fc025920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:27:06.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.350+0000 7f3707a02640 0 -- 172.21.15.19:0/4286145768 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x561aa9cdf4d0 msgr2=0x561aa9ce1970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:06.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.355+0000 7f3709717800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:27:06.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.355+0000 7f3709717800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:27:06.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.355+0000 7f3709717800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:06.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.355+0000 7f3709717800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:06.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.355+0000 7f3709717800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:06.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.355+0000 7f3709717800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:06.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.355+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.355+0000 7f3709717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.355+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.355+0000 7f3709717800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.355+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.356+0000 7f3709717800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.356+0000 7f3709717800 20 zone default found 2024-09-12T00:27:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.356+0000 7f3709717800 4 Realm: () 2024-09-12T00:27:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.356+0000 7f3709717800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:27:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.356+0000 7f3709717800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:27:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.356+0000 7f3709717800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.356+0000 7f3709717800 20 zonegroup default 2024-09-12T00:27:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.356+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.356+0000 7f3709717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.356+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.357+0000 7f3709717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.357+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.357+0000 7f3709717800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.357+0000 7f3709717800 20 started sync module instance, tier type = 2024-09-12T00:27:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.357+0000 7f3709717800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:27:06.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.372+0000 7f3709717800 20 add_watcher() i=0 2024-09-12T00:27:06.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.372+0000 7f3709717800 20 add_watcher() i=1 2024-09-12T00:27:06.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.372+0000 7f3709717800 20 add_watcher() i=2 2024-09-12T00:27:06.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.372+0000 7f3709717800 20 add_watcher() i=3 2024-09-12T00:27:06.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.372+0000 7f3709717800 20 add_watcher() i=4 2024-09-12T00:27:06.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.372+0000 7f3709717800 20 add_watcher() i=5 2024-09-12T00:27:06.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.372+0000 7f3709717800 20 add_watcher() i=6 2024-09-12T00:27:06.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.373+0000 7f3709717800 20 add_watcher() i=7 2024-09-12T00:27:06.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.373+0000 7f3709717800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:06.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.375+0000 7f35be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:06.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.376+0000 7f3709717800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:06.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.376+0000 7f3709717800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:06.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.376+0000 7f3709717800 5 note: GC not initialized 2024-09-12T00:27:06.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.376+0000 7f35bd7e2640 20 reqs_thread_entry: start 2024-09-12T00:27:06.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.376+0000 7f3709717800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:06.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.376+0000 7f3709717800 20 Filter name: none 2024-09-12T00:27:06.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.376+0000 7f35b67fc640 20 reqs_thread_entry: start 2024-09-12T00:27:06.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.376+0000 7f3709717800 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:27:06.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.376+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:27:06.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:27:06.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:27:06.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 : miss 2024-09-12T00:27:06.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:27:06.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 info.flags=0x17 2024-09-12T00:27:06.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 to cache LRU end 2024-09-12T00:27:06.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:27:06.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:27:06.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1 2024-09-12T00:27:06.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.377+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.0 2024-09-12T00:27:06.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.378+0000 7f3709717800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:27:06.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.378+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:06.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.378+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.2 2024-09-12T00:27:06.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.379+0000 7f3709717800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.379+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.3 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.380+0000 7f3709717800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.380+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.4 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.380+0000 7f3709717800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.380+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.381+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.6 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.381+0000 7f3709717800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.381+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.7 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.381+0000 7f3709717800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.381+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.382+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.9 2024-09-12T00:27:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.382+0000 7f3709717800 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.383+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.383+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.383+0000 7f3709717800 20 get_obj_state: octx=0x561aa9a54690 obj=check-bucket:e state=0x561aa9d1bcc8 s->prefetch_data=0 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.383+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 get_obj_state: octx=0x561aa9a7ca50 obj=check-bucket:d state=0x561aa9d16e58 s->prefetch_data=0 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 get_obj_state: octx=0x561aa9d22770 obj=check-bucket:c state=0x561aa9d204b8 s->prefetch_data=0 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 get_obj_state: octx=0x561aa9d1a590 obj=check-bucket:f state=0x561aa9db52f8 s->prefetch_data=0 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 get_obj_state: setting s->obj_tag to dwdmvybr9zz0sepddutbvj6j8z41gws7 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 get_obj_state_impl: setting s->olh_tag to nipo3rag7hr3gf6yqex2f8gijcv8rfoy 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nipo3rag7hr3gf6yqex2f8gijcv8rfoy 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 get_obj_state: setting s->obj_tag to hsaomcajk5sc6njdcw9pnzjgcl5qx97z 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 get_obj_state_impl: setting s->olh_tag to l4kp5apr8g7vrm40aw23cun31y9xrdv6 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=l4kp5apr8g7vrm40aw23cun31y9xrdv6 2024-09-12T00:27:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 get_obj_state: setting s->obj_tag to lv4uov4zu81hx3zp4matl3s481rpy8la 2024-09-12T00:27:06.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 get_obj_state_impl: setting s->olh_tag to y4n6q1kg2q937clm9b01j6zavv8b10cg 2024-09-12T00:27:06.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.384+0000 7f3709717800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=y4n6q1kg2q937clm9b01j6zavv8b10cg 2024-09-12T00:27:06.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.385+0000 7f3709717800 20 get_obj_state: setting s->obj_tag to lkqsicixwymbqw007jurp786f2391gzb 2024-09-12T00:27:06.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.385+0000 7f3709717800 20 get_obj_state_impl: setting s->olh_tag to ploutz32e1pqzgue5wj9528x03ootqdd 2024-09-12T00:27:06.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.385+0000 7f3709717800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ploutz32e1pqzgue5wj9528x03ootqdd 2024-09-12T00:27:06.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.389+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:06.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.389+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:06.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.389+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:06.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.390+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:06.390 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.391+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:06.390 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.391+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:06.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 olh_log_entry: epoch=3 op=3 key=d[CRzC9ysOfQ63pfYqUr.MW-C2fasD-E4] 2024-09-12T00:27:06.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 get_obj_state: octx=0x561aa9a7ca50 obj=check-bucket:_:CRzC9ysOfQ63pfYqUr.MW-C2fasD-E4_d state=0x561aa9dc5a68 s->prefetch_data=0 2024-09-12T00:27:06.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:27:06.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 olh_log_entry: epoch=2 op=3 key=e[lTvemL8MsYhCt6yFME-8fzQixo6DiGi] 2024-09-12T00:27:06.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 get_obj_state: octx=0x561aa9a54690 obj=check-bucket:_:lTvemL8MsYhCt6yFME-8fzQixo6DiGi_e state=0x561aa9dd57e8 s->prefetch_data=0 2024-09-12T00:27:06.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 10 manifest: total_size = 12 2024-09-12T00:27:06.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14618759992204249167 2024-09-12T00:27:06.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 get_obj_state: octx=0x561aa9a54690 obj=check-bucket:_:lTvemL8MsYhCt6yFME-8fzQixo6DiGi_e state=0x561aa9dd57e8 s->prefetch_data=0 2024-09-12T00:27:06.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 prepare_atomic_modification: state is not atomic. state=0x561aa9dd57e8 2024-09-12T00:27:06.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:06.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 10 manifest: total_size = 22 2024-09-12T00:27:06.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10425609573487041542 2024-09-12T00:27:06.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 get_obj_state: octx=0x561aa9a7ca50 obj=check-bucket:_:CRzC9ysOfQ63pfYqUr.MW-C2fasD-E4_d state=0x561aa9dc5a68 s->prefetch_data=0 2024-09-12T00:27:06.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 prepare_atomic_modification: state is not atomic. state=0x561aa9dc5a68 2024-09-12T00:27:06.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.392+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:06.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.393+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:06.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.393+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:06.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.393+0000 7f3709717800 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.393+0000 7f3709717800 20 olh_log_entry: epoch=2 op=3 key=f[Ow-mfXMu1xoWYe5aPKtllB7x6VOKh0P] 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.393+0000 7f3709717800 20 get_obj_state: octx=0x561aa9d1a590 obj=check-bucket:_:Ow-mfXMu1xoWYe5aPKtllB7x6VOKh0P_f state=0x561aa9dbd298 s->prefetch_data=0 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.393+0000 7f3709717800 20 olh_log_entry: epoch=3 op=3 key=c[CLHVbeQDgix-mpAjtutrH9uD.N7wSPK] 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.393+0000 7f3709717800 20 get_obj_state: octx=0x561aa9d22770 obj=check-bucket:_:CLHVbeQDgix-mpAjtutrH9uD.N7wSPK_c state=0x561aa9ddf468 s->prefetch_data=0 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.394+0000 7f3709717800 10 manifest: total_size = 9 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.394+0000 7f3709717800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13006775056933700092 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.394+0000 7f3709717800 20 get_obj_state: octx=0x561aa9d22770 obj=check-bucket:_:CLHVbeQDgix-mpAjtutrH9uD.N7wSPK_c state=0x561aa9ddf468 s->prefetch_data=0 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.394+0000 7f3709717800 20 prepare_atomic_modification: state is not atomic. state=0x561aa9ddf468 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.394+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.394+0000 7f3709717800 10 manifest: total_size = 22 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.394+0000 7f3709717800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14477631090005452421 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.394+0000 7f3709717800 20 get_obj_state: octx=0x561aa9d1a590 obj=check-bucket:_:Ow-mfXMu1xoWYe5aPKtllB7x6VOKh0P_f state=0x561aa9dbd298 s->prefetch_data=0 2024-09-12T00:27:06.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.394+0000 7f3709717800 20 prepare_atomic_modification: state is not atomic. state=0x561aa9dbd298 2024-09-12T00:27:06.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.394+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:06.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.398+0000 7f3709717800 20 get_obj_state: octx=0x561aa9a54690 obj=check-bucket:e state=0x561aa9d1bcc8 s->prefetch_data=0 2024-09-12T00:27:06.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.398+0000 7f3709717800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=nipo3rag7hr3gf6yqex2f8gijcv8rfoy 2024-09-12T00:27:06.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.398+0000 7f35eaffd640 20 handle_completion(): completion ok for obj=e[lTvemL8MsYhCt6yFME-8fzQixo6DiGi] 2024-09-12T00:27:06.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.401+0000 7f35eaffd640 20 handle_completion(): completion ok for obj=d[CRzC9ysOfQ63pfYqUr.MW-C2fasD-E4] 2024-09-12T00:27:06.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.404+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:06.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.404+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:06.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.404+0000 7f35ea7fc640 20 handle_completion(): completion ok for obj=f[Ow-mfXMu1xoWYe5aPKtllB7x6VOKh0P] 2024-09-12T00:27:06.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.404+0000 7f3709717800 20 get_obj_state: octx=0x561aa9d1a590 obj=check-bucket:f state=0x561aa9db52f8 s->prefetch_data=0 2024-09-12T00:27:06.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.404+0000 7f3709717800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ploutz32e1pqzgue5wj9528x03ootqdd 2024-09-12T00:27:06.406 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.406+0000 7f35eaffd640 20 handle_completion(): completion ok for obj=c[CLHVbeQDgix-mpAjtutrH9uD.N7wSPK] 2024-09-12T00:27:06.406 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.407+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:06.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.407+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:06.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.407+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.5 2024-09-12T00:27:06.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.407+0000 7f3709717800 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:27:06.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.407+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:06.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.410+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.1 2024-09-12T00:27:06.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.410+0000 7f3709717800 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:27:06.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.410+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.8 2024-09-12T00:27:06.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.410+0000 7f3709717800 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:27:06.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.410+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:06.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.412+0000 7f3709717800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1.10 2024-09-12T00:27:06.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.412+0000 7f3709717800 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:27:06.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.412+0000 7f3709717800 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:27:06.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.413+0000 7f35be7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:06.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.416+0000 7f3709717800 20 remove_watcher() i=0 2024-09-12T00:27:06.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.416+0000 7f3709717800 2 removed watcher, disabling cache 2024-09-12T00:27:06.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.417+0000 7f3709717800 20 remove_watcher() i=1 2024-09-12T00:27:06.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.418+0000 7f3709717800 20 remove_watcher() i=2 2024-09-12T00:27:06.418 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.419+0000 7f3709717800 20 remove_watcher() i=3 2024-09-12T00:27:06.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.420+0000 7f3709717800 20 remove_watcher() i=4 2024-09-12T00:27:06.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.421+0000 7f3709717800 20 remove_watcher() i=5 2024-09-12T00:27:06.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.422+0000 7f3709717800 20 remove_watcher() i=6 2024-09-12T00:27:06.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.423+0000 7f3709717800 20 remove_watcher() i=7 2024-09-12T00:27:06.435 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:06.435 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:06.474 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:06.474 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:06.656 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:27:06.685 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:06.685 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:06.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.725+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.726+0000 7f7537a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.727+0000 7f7537a13800 20 realm 2024-09-12T00:27:06.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.727+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.727+0000 7f7537a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.727+0000 7f7537a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:06.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.727+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.727+0000 7f7537a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.727+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.728+0000 7f7537a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:06.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.728+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.728+0000 7f7537a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:06.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.728+0000 7f7537a13800 20 searching for the correct realm 2024-09-12T00:27:06.731 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.732+0000 7f7532921640 0 -- 172.21.15.19:0/3560960239 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f7528075fc0 msgr2=0x7f752808fc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:27:06.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.736+0000 7f7533923640 0 -- 172.21.15.19:0/3560960239 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x561b37c5a8d0 msgr2=0x561b37c5cd70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:06.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.740+0000 7f7537a13800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:27:06.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.740+0000 7f7537a13800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:27:06.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.740+0000 7f7537a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:06.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.740+0000 7f7537a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:06.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.740+0000 7f7537a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:06.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.740+0000 7f7537a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:06.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.740+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.740+0000 7f7537a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.740+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:06.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:06.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 20 zone default found 2024-09-12T00:27:06.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 4 Realm: () 2024-09-12T00:27:06.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:27:06.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:27:06.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:06.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 20 zonegroup default 2024-09-12T00:27:06.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.741+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.742+0000 7f7537a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.742+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.742+0000 7f7537a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:06.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.742+0000 7f7537a13800 20 started sync module instance, tier type = 2024-09-12T00:27:06.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.742+0000 7f7537a13800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:27:06.750 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.751+0000 7f7537a13800 20 add_watcher() i=0 2024-09-12T00:27:06.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.751+0000 7f7537a13800 20 add_watcher() i=1 2024-09-12T00:27:06.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.751+0000 7f7537a13800 20 add_watcher() i=2 2024-09-12T00:27:06.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.751+0000 7f7537a13800 20 add_watcher() i=3 2024-09-12T00:27:06.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.751+0000 7f7537a13800 20 add_watcher() i=4 2024-09-12T00:27:06.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.751+0000 7f7537a13800 20 add_watcher() i=5 2024-09-12T00:27:06.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.751+0000 7f7537a13800 20 add_watcher() i=6 2024-09-12T00:27:06.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.752+0000 7f7537a13800 20 add_watcher() i=7 2024-09-12T00:27:06.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.752+0000 7f7537a13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:06.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.754+0000 7f73e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:06.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.755+0000 7f7537a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:06.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.755+0000 7f7537a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:06.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.755+0000 7f7537a13800 5 note: GC not initialized 2024-09-12T00:27:06.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.755+0000 7f73e8fe1640 20 reqs_thread_entry: start 2024-09-12T00:27:06.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.755+0000 7f7537a13800 20 init_complete bucket index max shards: 11 2024-09-12T00:27:06.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.755+0000 7f7537a13800 20 Filter name: none 2024-09-12T00:27:06.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.755+0000 7f73627fc640 20 reqs_thread_entry: start 2024-09-12T00:27:06.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.755+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.756+0000 7f7537a13800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:27:06.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.756+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.756+0000 7f7537a13800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:27:06.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.756+0000 7f7537a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:06.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.756+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.757+0000 7f7537a13800 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:27:06.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.757+0000 7f7537a13800 20 rados->read ofs=0 len=0 2024-09-12T00:27:06.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.757+0000 7f7537a13800 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:27:06.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.757+0000 7f7537a13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:27:06.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.759+0000 7f73e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:06.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.761+0000 7f7537a13800 20 remove_watcher() i=0 2024-09-12T00:27:06.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.761+0000 7f7537a13800 2 removed watcher, disabling cache 2024-09-12T00:27:06.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.762+0000 7f7537a13800 20 remove_watcher() i=1 2024-09-12T00:27:06.762 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.763+0000 7f7537a13800 20 remove_watcher() i=2 2024-09-12T00:27:06.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.764+0000 7f7537a13800 20 remove_watcher() i=3 2024-09-12T00:27:06.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.765+0000 7f7537a13800 20 remove_watcher() i=4 2024-09-12T00:27:06.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.766+0000 7f7537a13800 20 remove_watcher() i=5 2024-09-12T00:27:06.766 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.767+0000 7f7537a13800 20 remove_watcher() i=6 2024-09-12T00:27:06.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:27:06.768+0000 7f7537a13800 20 remove_watcher() i=7 2024-09-12T00:27:06.778 INFO:tasks.workunit.client.0.smithi019.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:27:06.778 INFO:tasks.workunit.client.0.smithi019.stderr:Deleting bucket check-bucket 2024-09-12T00:27:06.780 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:06.780 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:06.813 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:27:06.813 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:27:07.027 INFO:tasks.workunit.client.0.smithi019.stderr:Completed bucket check tests 2024-09-12T00:27:07.028 INFO:tasks.workunit.client.0.smithi019.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:27:07.028 INFO:tasks.workunit.client.0.smithi019.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:27:07.028 INFO:tasks.workunit.client.0.smithi019.stdout:connected to https://localhost:443 2024-09-12T00:27:07.098 INFO:tasks.workunit.client.0.smithi019.stderr:+ deactivate 2024-09-12T00:27:07.098 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:27:07.098 INFO:tasks.workunit.client.0.smithi019.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:27:07.098 INFO:tasks.workunit.client.0.smithi019.stderr:+ export PATH 2024-09-12T00:27:07.098 INFO:tasks.workunit.client.0.smithi019.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:27:07.098 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n '' ']' 2024-09-12T00:27:07.099 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:27:07.099 INFO:tasks.workunit.client.0.smithi019.stderr:+ hash -r 2024-09-12T00:27:07.099 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n '' ']' 2024-09-12T00:27:07.099 INFO:tasks.workunit.client.0.smithi019.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:27:07.099 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:27:07.099 INFO:tasks.workunit.client.0.smithi019.stderr:+ unset -f deactivate 2024-09-12T00:27:07.099 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo OK. 2024-09-12T00:27:07.100 INFO:tasks.workunit.client.0.smithi019.stdout:OK. 2024-09-12T00:27:07.100 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:27:07.101 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:27:07.141 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:27:07.141 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:27:07.829 DEBUG:teuthology.parallel:result is None 2024-09-12T00:27:07.830 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:27:07.870 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:27:07.870 DEBUG:teuthology.orchestra.run.smithi019:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:27:07.954 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:27:07.954 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:27:07.965 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:27:07.965 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:27:07.965 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:27:08.024 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:27:08.024 INFO:teuthology.orchestra.run.smithi019.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:27:08.025 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:27:08.095 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:27:08.095 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:27:08.165 INFO:tasks.workunit:timeout=3h 2024-09-12T00:27:08.165 INFO:tasks.workunit:cleanup=True 2024-09-12T00:27:08.165 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:27:08.235 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:27:53.860 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:27:53.861 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:27:53.861 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:27:53.861 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:27:53.861 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:27:53.861 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:27:53.861 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:27:53.861 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:27:53.861 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:27:53.861 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-09-12T00:27:53.862 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:27:53.862 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-09-12T00:27:53.862 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:27:53.862 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-09-12T00:27:53.862 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:27:53.862 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:27:53.862 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:27:53.862 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:27:53.865 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:27:53.934 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:27:53.937 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:27:53.937 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:27:53.987 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:27:54.037 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:27:54.077 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:27:54.079 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:27:54.079 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:27:54.118 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:27:54.122 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:27:54.122 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:27:54.193 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:27:54.194 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:27:54.194 DEBUG:teuthology.orchestra.run.smithi019:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:27:54.277 INFO:tasks.workunit.client.0.smithi019.stdout:Running main() from gmock_main.cc 2024-09-12T00:27:54.277 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:27:54.277 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:27:54.277 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:27:54.277 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:27:55.478 INFO:tasks.workunit.client.0.smithi019.stdout:lock: mylock 2024-09-12T00:27:55.478 INFO:tasks.workunit.client.0.smithi019.stdout: lock_type: exclusive 2024-09-12T00:27:55.478 INFO:tasks.workunit.client.0.smithi019.stdout: tag: 2024-09-12T00:27:55.478 INFO:tasks.workunit.client.0.smithi019.stdout: lockers: 2024-09-12T00:27:55.478 INFO:tasks.workunit.client.0.smithi019.stdout: client.5127 expiration=2024-09-12T00:29:55.473984+0000 addr=v1:172.21.15.19:0/3339815125 cookie= 2024-09-12T00:27:55.485 INFO:tasks.workunit.client.0.smithi019.stdout:lock: mylock 2024-09-12T00:27:55.485 INFO:tasks.workunit.client.0.smithi019.stdout: lock_type: shared 2024-09-12T00:27:55.485 INFO:tasks.workunit.client.0.smithi019.stdout: tag: 2024-09-12T00:27:55.485 INFO:tasks.workunit.client.0.smithi019.stdout: lockers: 2024-09-12T00:27:55.485 INFO:tasks.workunit.client.0.smithi019.stdout: client.4985 expiration=0.000000 addr=v1:172.21.15.19:0/1820418258 cookie= 2024-09-12T00:27:55.485 INFO:tasks.workunit.client.0.smithi019.stdout: client.5127 expiration=2024-09-12T00:29:55.486001+0000 addr=v1:172.21.15.19:0/3339815125 cookie= 2024-09-12T00:27:55.487 INFO:tasks.workunit.client.0.smithi019.stdout:lock: mylock 2024-09-12T00:27:55.487 INFO:tasks.workunit.client.0.smithi019.stdout: lock_type: shared 2024-09-12T00:27:55.487 INFO:tasks.workunit.client.0.smithi019.stdout: tag: 2024-09-12T00:27:55.487 INFO:tasks.workunit.client.0.smithi019.stdout: lockers: 2024-09-12T00:27:55.487 INFO:tasks.workunit.client.0.smithi019.stdout: client.4985 expiration=0.000000 addr=v1:172.21.15.19:0/1820418258 cookie= 2024-09-12T00:27:56.438 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsLock.TestMultiLocking (2161 ms) 2024-09-12T00:27:56.438 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:27:58.715 INFO:tasks.workunit.client.0.smithi019.stdout:lock: mylock 2024-09-12T00:27:58.715 INFO:tasks.workunit.client.0.smithi019.stdout: lock_type: shared 2024-09-12T00:27:58.715 INFO:tasks.workunit.client.0.smithi019.stdout: tag: 2024-09-12T00:27:58.715 INFO:tasks.workunit.client.0.smithi019.stdout: lockers: 2024-09-12T00:27:58.715 INFO:tasks.workunit.client.0.smithi019.stdout: client.5145 expiration=0.000000 addr=v1:172.21.15.19:0/1413852974 cookie= 2024-09-12T00:27:58.717 INFO:tasks.workunit.client.0.smithi019.stdout:lock: mylock 2024-09-12T00:27:58.717 INFO:tasks.workunit.client.0.smithi019.stdout: lock_type: exclusive 2024-09-12T00:27:58.717 INFO:tasks.workunit.client.0.smithi019.stdout: tag: new_tag 2024-09-12T00:27:58.717 INFO:tasks.workunit.client.0.smithi019.stdout: lockers: 2024-09-12T00:27:58.717 INFO:tasks.workunit.client.0.smithi019.stdout: client.4988 expiration=0.000000 addr=v1:172.21.15.19:0/4062184561 cookie= 2024-09-12T00:27:59.476 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsLock.TestMeta (3039 ms) 2024-09-12T00:27:59.477 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:28:01.495 INFO:tasks.workunit.client.0.smithi019.stdout:lock: mylock 2024-09-12T00:28:01.496 INFO:tasks.workunit.client.0.smithi019.stdout: lock_type: exclusive 2024-09-12T00:28:01.496 INFO:tasks.workunit.client.0.smithi019.stdout: tag: 2024-09-12T00:28:01.496 INFO:tasks.workunit.client.0.smithi019.stdout: lockers: 2024-09-12T00:28:01.498 INFO:tasks.workunit.client.0.smithi019.stdout:lock: mylock 2024-09-12T00:28:01.498 INFO:tasks.workunit.client.0.smithi019.stdout: lock_type: shared 2024-09-12T00:28:01.498 INFO:tasks.workunit.client.0.smithi019.stdout: tag: 2024-09-12T00:28:01.498 INFO:tasks.workunit.client.0.smithi019.stdout: lockers: 2024-09-12T00:28:01.498 INFO:tasks.workunit.client.0.smithi019.stdout: client.5151 expiration=0.000000 addr=v1:172.21.15.19:0/3670397608 cookie= 2024-09-12T00:28:01.498 INFO:tasks.workunit.client.0.smithi019.stdout: client.5151 expiration=0.000000 addr=v1:172.21.15.19:0/3670397608 cookie=new cookie 2024-09-12T00:28:02.487 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsLock.TestCookie (3010 ms) 2024-09-12T00:28:02.488 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:28:05.512 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsLock.TestMultipleLocks (3025 ms) 2024-09-12T00:28:05.512 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:28:12.600 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsLock.TestLockDuration (7088 ms) 2024-09-12T00:28:12.600 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:28:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsLock.TestAssertLocked (3030 ms) 2024-09-12T00:28:15.630 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:28:18.634 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsLock.TestSetCookie (3004 ms) 2024-09-12T00:28:18.635 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:28:39.032 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsLock.TestRenew (20398 ms) 2024-09-12T00:28:39.032 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:28:45.118 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6085 ms) 2024-09-12T00:28:45.118 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:28:53.155 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (8036 ms) 2024-09-12T00:28:53.156 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:29:01.196 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8042 ms) 2024-09-12T00:29:01.196 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 11 tests from ClsLock (66918 ms total) 2024-09-12T00:29:01.196 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:29:01.196 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:29:01.196 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 11 tests from 1 test suite ran. (66918 ms total) 2024-09-12T00:29:01.196 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 11 tests. 2024-09-12T00:29:01.199 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:29:01.200 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:29:01.245 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:29:01.246 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:29:01.246 DEBUG:teuthology.orchestra.run.smithi019:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:29:01.293 INFO:tasks.workunit.client.0.smithi019.stdout:Running main() from gmock_main.cc 2024-09-12T00:29:01.293 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:29:01.293 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:29:01.294 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 4 tests from cls_log 2024-09-12T00:29:01.294 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:29:04.221 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_log.test_log_add_same_time (2925 ms) 2024-09-12T00:29:04.221 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:29:07.244 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_log.test_log_add_different_time (3024 ms) 2024-09-12T00:29:07.244 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:29:10.260 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_log.trim_by_time (3017 ms) 2024-09-12T00:29:10.260 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:29:13.275 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_log.trim_by_marker (3015 ms) 2024-09-12T00:29:13.275 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 4 tests from cls_log (11981 ms total) 2024-09-12T00:29:13.275 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:29:13.275 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:29:13.275 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 4 tests from 1 test suite ran. (11981 ms total) 2024-09-12T00:29:13.276 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 4 tests. 2024-09-12T00:29:13.279 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:29:13.279 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:29:13.327 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:29:13.329 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:29:13.329 DEBUG:teuthology.orchestra.run.smithi019:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:29:13.378 INFO:tasks.workunit.client.0.smithi019.stdout:Running main() from gmock_main.cc 2024-09-12T00:29:13.378 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:29:13.378 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:29:13.379 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:29:13.379 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:29:16.332 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_refcount.test_implicit (2954 ms) 2024-09-12T00:29:16.332 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:29:19.363 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3030 ms) 2024-09-12T00:29:19.363 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:29:27.456 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_refcount.test_put_snap (8093 ms) 2024-09-12T00:29:27.457 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:29:30.480 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_refcount.test_explicit (3024 ms) 2024-09-12T00:29:30.481 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:29:33.509 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_refcount.set (3030 ms) 2024-09-12T00:29:33.510 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:29:40.555 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_refcount.test_implicit_ec (7046 ms) 2024-09-12T00:29:40.555 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:29:47.615 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7060 ms) 2024-09-12T00:29:47.615 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:29:59.690 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_refcount.test_put_snap_ec (12075 ms) 2024-09-12T00:29:59.690 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:30:06.739 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_refcount.test_explicit_ec (7049 ms) 2024-09-12T00:30:06.739 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:30:13.768 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_refcount.set_ec (7029 ms) 2024-09-12T00:30:13.769 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 10 tests from cls_refcount (60390 ms total) 2024-09-12T00:30:13.769 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:30:13.769 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:13.769 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 10 tests from 1 test suite ran. (60390 ms total) 2024-09-12T00:30:13.769 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 10 tests. 2024-09-12T00:30:13.771 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:30:13.772 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:30:13.817 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:30:13.818 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:30:13.818 DEBUG:teuthology.orchestra.run.smithi019:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:30:13.867 INFO:tasks.workunit.client.0.smithi019.stdout:Running main() from gmock_main.cc 2024-09-12T00:30:13.867 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:30:13.867 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:30:13.867 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:30:15.792 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:30:15.844 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.index_basic (52 ms) 2024-09-12T00:30:15.844 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:30:15.880 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (36 ms) 2024-09-12T00:30:15.880 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:30:15.920 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.index_remove_object (41 ms) 2024-09-12T00:30:15.921 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:30:17.409 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.index_suggest (1488 ms) 2024-09-12T00:30:17.409 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:30:17.417 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.index_suggest_complete (8 ms) 2024-09-12T00:30:17.417 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:30:17.446 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.index_list (29 ms) 2024-09-12T00:30:17.446 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:30:41.024 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.index_list_delimited (23578 ms) 2024-09-12T00:30:41.025 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:30:41.114 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.bi_list (91 ms) 2024-09-12T00:30:41.115 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:30:41.127 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.gc_set (12 ms) 2024-09-12T00:30:41.127 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:30:41.138 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.gc_list (11 ms) 2024-09-12T00:30:41.138 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:30:48.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.gc_defer (7044 ms) 2024-09-12T00:30:48.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:30:48.275 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.usage_basic (93 ms) 2024-09-12T00:30:48.275 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:30:48.276 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.usage_clear_no_obj (2 ms) 2024-09-12T00:30:48.276 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:30:48.375 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.usage_clear (99 ms) 2024-09-12T00:30:48.375 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:30:48.432 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.bi_log_trim (56 ms) 2024-09-12T00:30:48.432 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:30:48.445 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.index_racing_removes (13 ms) 2024-09-12T00:30:48.445 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:30:48.463 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.reshardlog_list (19 ms) 2024-09-12T00:30:48.464 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:30:48.474 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.reshardlog_num (10 ms) 2024-09-12T00:30:48.474 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:30:48.502 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw.bi_put_entries (28 ms) 2024-09-12T00:30:49.198 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 19 tests from cls_rgw (32710 ms total) 2024-09-12T00:30:49.198 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:30:49.198 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:49.198 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 19 tests from 1 test suite ran. (35331 ms total) 2024-09-12T00:30:49.198 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 19 tests. 2024-09-12T00:30:49.201 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:30:49.202 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:30:49.248 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:30:49.249 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:30:49.250 DEBUG:teuthology.orchestra.run.smithi019:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:30:49.297 INFO:tasks.workunit.client.0.smithi019.stdout:Running main() from gmock_main.cc 2024-09-12T00:30:49.297 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:30:49.297 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:30:49.297 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:30:49.297 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:30:51.209 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw_gc.init (1912 ms) 2024-09-12T00:30:51.209 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:30:51.231 INFO:tasks.workunit.client.0.smithi019.stderr:[ ] list info tag = chain-0 2024-09-12T00:30:51.232 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (23 ms) 2024-09-12T00:30:51.232 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:30:51.240 INFO:tasks.workunit.client.0.smithi019.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:30:51.240 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (9 ms) 2024-09-12T00:30:51.240 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:30:51.253 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (13 ms) 2024-09-12T00:30:51.253 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:30:51.265 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (11 ms) 2024-09-12T00:30:51.265 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:30:51.276 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (11 ms) 2024-09-12T00:30:51.276 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:30:51.283 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (8 ms) 2024-09-12T00:30:51.283 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:30:51.293 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (9 ms) 2024-09-12T00:30:51.293 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:30:52.227 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw_gc.finalize (934 ms) 2024-09-12T00:30:52.228 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 9 tests from cls_rgw_gc (2930 ms total) 2024-09-12T00:30:52.228 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:30:52.228 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:30:52.228 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 9 tests from 1 test suite ran. (2930 ms total) 2024-09-12T00:30:52.228 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 9 tests. 2024-09-12T00:30:52.230 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:30:52.231 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:30:52.278 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:30:52.279 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:30:52.280 DEBUG:teuthology.orchestra.run.smithi019:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:30:52.335 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:52.335 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:52.335 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:30:52.335 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:30:54.241 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:30:54.241 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:30:54.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.261+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=9USAZELIL4UG type=write size=879480 2024-09-12T00:30:54.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.263+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~CJG2AAKWNAF6.0 size=109961 2024-09-12T00:30:54.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.263+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=CJG2AAKWNAF6 tag=4JBTM2RF606O type=write size=1158537 2024-09-12T00:30:54.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.266+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~XL2M04ST5DL0.0 size=312797 2024-09-12T00:30:54.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.266+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=XL2M04ST5DL0 tag=BDS037O3V1XU type=write size=1361373 2024-09-12T00:30:54.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.267+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=2MBYMWCSQYN4 type=del size=2679816 2024-09-12T00:30:54.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.270+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~KFP9H5T3E02C.0 size=1048576 2024-09-12T00:30:54.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.271+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~KFP9H5T3E02C.1 size=246833 2024-09-12T00:30:54.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.271+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=KFP9H5T3E02C tag=64RTKHFQB5XW type=write size=2343985 2024-09-12T00:30:54.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.273+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~0TQOF9Q48KEU.0 size=923331 2024-09-12T00:30:54.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.273+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=0TQOF9Q48KEU tag=2ZK54JUSWIU4 type=write size=1971907 2024-09-12T00:30:54.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.275+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=R7NKJGK781AQ type=del size=2929789 2024-09-12T00:30:54.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.277+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=9A3O470X0A9B type=write size=359682 2024-09-12T00:30:54.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.280+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~VZ4YJZMGMCYD.0 size=844809 2024-09-12T00:30:54.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.280+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=VZ4YJZMGMCYD tag=YI8CLFZNDVHK type=write size=1893385 2024-09-12T00:30:54.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.281+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=DDPPR2I4AETD type=del size=3488834 2024-09-12T00:30:54.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.284+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~23T7DM9JCK2Q.0 size=936936 2024-09-12T00:30:54.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.284+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=23T7DM9JCK2Q tag=C10KQQ2XAJWR type=write size=1985512 2024-09-12T00:30:54.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.286+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=VBG29GV7A25Z type=del size=528439 2024-09-12T00:30:54.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.288+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~ADSZCPUXUITH.0 size=1048576 2024-09-12T00:30:54.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.289+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~ADSZCPUXUITH.1 size=1048576 2024-09-12T00:30:54.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.290+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~ADSZCPUXUITH.2 size=273581 2024-09-12T00:30:54.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.290+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=ADSZCPUXUITH tag=HGIT7PZT4448 type=write size=3419309 2024-09-12T00:30:54.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.293+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~4U32PWEH33MO.0 size=516630 2024-09-12T00:30:54.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.293+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=4U32PWEH33MO tag=YGXC0YMUSZYX type=write size=1565206 2024-09-12T00:30:54.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.296+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~VKUF84IS89UH.0 size=1048576 2024-09-12T00:30:54.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.297+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~VKUF84IS89UH.1 size=1048576 2024-09-12T00:30:54.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.298+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~VKUF84IS89UH.2 size=942992 2024-09-12T00:30:54.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.298+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=VKUF84IS89UH tag=Q79W0WOXJFCW type=write size=4088720 2024-09-12T00:30:54.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.300+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=LG16AUINE2TQ type=del size=2980844 2024-09-12T00:30:54.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.303+0000 7f0362c73780 1 < suggested remove operation key=IIZAWZDLR2QE tag=9USAZELIL4UG type=write 2024-09-12T00:30:54.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.305+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=27ZRJ719AF19 type=del size=3442718 2024-09-12T00:30:54.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.306+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~CJG2AAKWNAF6.0 size=109961 2024-09-12T00:30:54.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.309+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=CJG2AAKWNAF6 tag=4JBTM2RF606O type=write size=1158537 2024-09-12T00:30:54.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.311+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=U6KLCGX8BH0K type=del size=1836044 2024-09-12T00:30:54.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.312+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~XL2M04ST5DL0.0 size=312797 2024-09-12T00:30:54.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.315+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=XL2M04ST5DL0 tag=BDS037O3V1XU type=write size=1361373 2024-09-12T00:30:54.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.318+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~XITSRET8F6MC.0 size=1048576 2024-09-12T00:30:54.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.319+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~XITSRET8F6MC.1 size=1048576 2024-09-12T00:30:54.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.320+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~XITSRET8F6MC.2 size=421807 2024-09-12T00:30:54.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.320+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=XITSRET8F6MC tag=UZJ3F9DXHLFG type=write size=3567535 2024-09-12T00:30:54.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.322+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=2MBYMWCSQYN4 type=del 2024-09-12T00:30:54.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.323+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=QEIBS7O89NP0 type=del size=4065320 2024-09-12T00:30:54.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.325+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~KFP9H5T3E02C.0 size=1048576 2024-09-12T00:30:54.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.326+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~KFP9H5T3E02C.1 size=246833 2024-09-12T00:30:54.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.328+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=KFP9H5T3E02C tag=64RTKHFQB5XW type=write size=2343985 2024-09-12T00:30:54.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.331+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~3RQAB02OPUFW.0 size=1048576 2024-09-12T00:30:54.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.332+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~3RQAB02OPUFW.1 size=389674 2024-09-12T00:30:54.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.332+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=3RQAB02OPUFW tag=11NCZGR10CLR type=write size=2486826 2024-09-12T00:30:54.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.334+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~0TQOF9Q48KEU.0 size=923331 2024-09-12T00:30:54.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.337+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=0TQOF9Q48KEU tag=2ZK54JUSWIU4 type=write size=1971907 2024-09-12T00:30:54.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.338+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=2P0S81WGZYBF type=del size=3545367 2024-09-12T00:30:54.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.339+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=R7NKJGK781AQ type=del 2024-09-12T00:30:54.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.340+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=QUX2UH1RR3RD type=del size=993107 2024-09-12T00:30:54.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.342+0000 7f0362c73780 1 < completed write operation key=YTN99RBTKO39 tag=9A3O470X0A9B type=write size=359682 2024-09-12T00:30:54.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.343+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=VJY6E4FDJ8IJ type=write size=914774 2024-09-12T00:30:54.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.345+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~VZ4YJZMGMCYD.0 size=844809 2024-09-12T00:30:54.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.347+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=VZ4YJZMGMCYD tag=YI8CLFZNDVHK type=write size=1893385 2024-09-12T00:30:54.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.349+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=QUE7C547KU14 type=del size=3504947 2024-09-12T00:30:54.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.352+0000 7f0362c73780 1 < suggested remove operation key=HWSQFSK29S0V tag=DDPPR2I4AETD type=del 2024-09-12T00:30:54.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.353+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=A9JA5HETXZZK type=del size=2508771 2024-09-12T00:30:54.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.356+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~23T7DM9JCK2Q.0 size=936936 2024-09-12T00:30:54.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.359+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=23T7DM9JCK2Q tag=C10KQQ2XAJWR type=write size=1985512 2024-09-12T00:30:54.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.362+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~IB51ULHOV9U1.0 size=1048576 2024-09-12T00:30:54.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.363+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~IB51ULHOV9U1.1 size=1048576 2024-09-12T00:30:54.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.364+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~IB51ULHOV9U1.2 size=150015 2024-09-12T00:30:54.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.364+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=IB51ULHOV9U1 tag=XXBSBXB99NWK type=write size=3295743 2024-09-12T00:30:54.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.366+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=VBG29GV7A25Z type=del 2024-09-12T00:30:54.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.369+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~2FZ6C8YUC7WB.0 size=1048576 2024-09-12T00:30:54.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.370+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~2FZ6C8YUC7WB.1 size=1048576 2024-09-12T00:30:54.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.371+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~2FZ6C8YUC7WB.2 size=684312 2024-09-12T00:30:54.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.371+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=2FZ6C8YUC7WB tag=DCSCZIV59NTN type=write size=3830040 2024-09-12T00:30:54.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.372+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~ADSZCPUXUITH.0 size=1048576 2024-09-12T00:30:54.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.372+0000 7f0362c73780 1 < canceled part key=_multipart_G2HW98G6624O.2~ADSZCPUXUITH.1 size=1048576 2024-09-12T00:30:54.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.372+0000 7f0362c73780 1 < canceled part key=_multipart_G2HW98G6624O.2~ADSZCPUXUITH.2 size=273581 2024-09-12T00:30:54.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.375+0000 7f0362c73780 1 < canceled multipart upload key=G2HW98G6624O upload=ADSZCPUXUITH tag=HGIT7PZT4448 type=write size=3419309 2024-09-12T00:30:54.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.376+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=1V2GTZPB3QE5 type=del size=3540495 2024-09-12T00:30:54.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.377+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~4U32PWEH33MO.0 size=516630 2024-09-12T00:30:54.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.382+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=4U32PWEH33MO tag=YGXC0YMUSZYX type=write size=1565206 2024-09-12T00:30:54.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.384+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~UV8EQYOZHXF4.0 size=1048576 2024-09-12T00:30:54.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.385+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~UV8EQYOZHXF4.1 size=1048576 2024-09-12T00:30:54.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.386+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~UV8EQYOZHXF4.2 size=253772 2024-09-12T00:30:54.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.386+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=UV8EQYOZHXF4 tag=3H61BAM7SO6K type=write size=3399500 2024-09-12T00:30:54.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.388+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~VKUF84IS89UH.0 size=1048576 2024-09-12T00:30:54.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.389+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~VKUF84IS89UH.1 size=1048576 2024-09-12T00:30:54.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.390+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~VKUF84IS89UH.2 size=942992 2024-09-12T00:30:54.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.393+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=VKUF84IS89UH tag=Q79W0WOXJFCW type=write size=4088720 2024-09-12T00:30:54.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.395+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~JXUEFT2OQ72W.0 size=1048576 2024-09-12T00:30:54.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.397+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~JXUEFT2OQ72W.1 size=65128 2024-09-12T00:30:54.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.397+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=JXUEFT2OQ72W tag=UBN9LEX3U4GW type=write size=2162280 2024-09-12T00:30:54.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.398+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=LG16AUINE2TQ type=del 2024-09-12T00:30:54.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.400+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~9X6D01SH8XKX.0 size=1048576 2024-09-12T00:30:54.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.402+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~9X6D01SH8XKX.1 size=842325 2024-09-12T00:30:54.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.402+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=9X6D01SH8XKX tag=D0ANGPCGPFB1 type=write size=2939477 2024-09-12T00:30:54.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.403+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=27ZRJ719AF19 type=del 2024-09-12T00:30:54.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.405+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=DS6FCEKO5KQX type=del size=55239 2024-09-12T00:30:54.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.406+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=U6KLCGX8BH0K type=del 2024-09-12T00:30:54.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.409+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~HQLTQWLG75MB.0 size=1048576 2024-09-12T00:30:54.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.410+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~HQLTQWLG75MB.1 size=1048576 2024-09-12T00:30:54.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.412+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~HQLTQWLG75MB.2 size=687485 2024-09-12T00:30:54.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.412+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=HQLTQWLG75MB tag=CU1E89EWVO06 type=write size=3833213 2024-09-12T00:30:54.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.412+0000 7f0362c73780 1 < canceled part key=_multipart_84T1VJG5SHU4.2~XITSRET8F6MC.0 size=1048576 2024-09-12T00:30:54.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.413+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~XITSRET8F6MC.1 size=1048576 2024-09-12T00:30:54.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.414+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~XITSRET8F6MC.2 size=421807 2024-09-12T00:30:54.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.416+0000 7f0362c73780 1 < canceled multipart upload key=84T1VJG5SHU4 upload=XITSRET8F6MC tag=UZJ3F9DXHLFG type=write size=3567535 2024-09-12T00:30:54.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.418+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=82HQG396QHCG type=del size=3389712 2024-09-12T00:30:54.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.419+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=QEIBS7O89NP0 type=del 2024-09-12T00:30:54.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.422+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~VOW004R8SKZR.0 size=310610 2024-09-12T00:30:54.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.422+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=VOW004R8SKZR tag=KQJVMFUXOLSO type=write size=1359186 2024-09-12T00:30:54.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.423+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~3RQAB02OPUFW.0 size=1048576 2024-09-12T00:30:54.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.425+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~3RQAB02OPUFW.1 size=389674 2024-09-12T00:30:54.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.427+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=3RQAB02OPUFW tag=11NCZGR10CLR type=write size=2486826 2024-09-12T00:30:54.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.430+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~IM0AY08DAAMO.0 size=1048576 2024-09-12T00:30:54.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.431+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~IM0AY08DAAMO.1 size=1048576 2024-09-12T00:30:54.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.432+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~IM0AY08DAAMO.2 size=380178 2024-09-12T00:30:54.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.432+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=IM0AY08DAAMO tag=5XYHBMIEFEY0 type=write size=3525906 2024-09-12T00:30:54.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.433+0000 7f0362c73780 1 < canceled operation key=PLAYMR18X9DZ tag=2P0S81WGZYBF type=del size=3545367 2024-09-12T00:30:54.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.434+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=DG5N16VNVUOE type=del size=2244485 2024-09-12T00:30:54.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.436+0000 7f0362c73780 -1 < failed to complete operation key=HWSQFSK29S0V tag=QUX2UH1RR3RD type=del size=993107: (22) Invalid argument 2024-09-12T00:30:54.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.438+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~NINV8BB3ICGN.0 size=1048576 2024-09-12T00:30:54.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.439+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~NINV8BB3ICGN.1 size=622600 2024-09-12T00:30:54.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.439+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=NINV8BB3ICGN tag=WLK46VCOJRN2 type=write size=2719752 2024-09-12T00:30:54.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.441+0000 7f0362c73780 1 < canceled operation key=EHBOL435W9ZE tag=VJY6E4FDJ8IJ type=write size=914774 2024-09-12T00:30:54.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.442+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=Z8FQCBJOD1UC type=del size=3787842 2024-09-12T00:30:54.442 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.443+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=QUE7C547KU14 type=del 2024-09-12T00:30:54.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.446+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~L7GI1S4KHUZU.0 size=1048576 2024-09-12T00:30:54.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.447+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~L7GI1S4KHUZU.1 size=769359 2024-09-12T00:30:54.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.447+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=L7GI1S4KHUZU tag=9XSVBIH45ZTM type=write size=2866511 2024-09-12T00:30:54.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.449+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=A9JA5HETXZZK type=del 2024-09-12T00:30:54.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.450+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=0KK1CQ74NZJD type=del size=1101930 2024-09-12T00:30:54.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.452+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~IB51ULHOV9U1.0 size=1048576 2024-09-12T00:30:54.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.452+0000 7f0362c73780 1 < canceled part key=_multipart_X4ZML0796M7F.2~IB51ULHOV9U1.1 size=1048576 2024-09-12T00:30:54.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.453+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~IB51ULHOV9U1.2 size=150015 2024-09-12T00:30:54.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.455+0000 7f0362c73780 1 < canceled multipart upload key=X4ZML0796M7F upload=IB51ULHOV9U1 tag=XXBSBXB99NWK type=write size=3295743 2024-09-12T00:30:54.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.456+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=NWNZZJ014OQX type=del size=3462717 2024-09-12T00:30:54.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.458+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~2FZ6C8YUC7WB.0 size=1048576 2024-09-12T00:30:54.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.459+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~2FZ6C8YUC7WB.1 size=1048576 2024-09-12T00:30:54.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.460+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~2FZ6C8YUC7WB.2 size=684312 2024-09-12T00:30:54.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.462+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=2FZ6C8YUC7WB tag=DCSCZIV59NTN type=write size=3830040 2024-09-12T00:30:54.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.465+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~B6KA7A8M9UR1.0 size=1048576 2024-09-12T00:30:54.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.466+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~B6KA7A8M9UR1.1 size=843620 2024-09-12T00:30:54.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.466+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=B6KA7A8M9UR1 tag=FC15BMDS7DD0 type=write size=2940772 2024-09-12T00:30:54.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.468+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=1V2GTZPB3QE5 type=del 2024-09-12T00:30:54.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.469+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=FQ6DZRXJJ6SO type=del size=728370 2024-09-12T00:30:54.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.470+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~UV8EQYOZHXF4.0 size=1048576 2024-09-12T00:30:54.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.472+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~UV8EQYOZHXF4.1 size=1048576 2024-09-12T00:30:54.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.473+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~UV8EQYOZHXF4.2 size=253772 2024-09-12T00:30:54.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.475+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=UV8EQYOZHXF4 tag=3H61BAM7SO6K type=write size=3399500 2024-09-12T00:30:54.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.476+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=RLIWUFOONF5R type=del size=3820256 2024-09-12T00:30:54.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.478+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~JXUEFT2OQ72W.0 size=1048576 2024-09-12T00:30:54.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.479+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~JXUEFT2OQ72W.1 size=65128 2024-09-12T00:30:54.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.481+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=JXUEFT2OQ72W tag=UBN9LEX3U4GW type=write size=2162280 2024-09-12T00:30:54.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.482+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=Q5CBL48J65T5 type=del size=3018095 2024-09-12T00:30:54.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.484+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~9X6D01SH8XKX.0 size=1048576 2024-09-12T00:30:54.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.485+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~9X6D01SH8XKX.1 size=842325 2024-09-12T00:30:54.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.487+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=9X6D01SH8XKX tag=D0ANGPCGPFB1 type=write size=2939477 2024-09-12T00:30:54.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.488+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=JFZK4DYPKGZV type=del size=2136517 2024-09-12T00:30:54.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.490+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=DS6FCEKO5KQX type=del 2024-09-12T00:30:54.489 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.491+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=6MVT4QXLBP3I type=del size=2553628 2024-09-12T00:30:54.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.493+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~HQLTQWLG75MB.0 size=1048576 2024-09-12T00:30:54.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.494+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~HQLTQWLG75MB.1 size=1048576 2024-09-12T00:30:54.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.495+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~HQLTQWLG75MB.2 size=687485 2024-09-12T00:30:54.495 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.497+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=HQLTQWLG75MB tag=CU1E89EWVO06 type=write size=3833213 2024-09-12T00:30:54.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.499+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=9V0LOR7F234C type=del size=4146440 2024-09-12T00:30:54.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.500+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=82HQG396QHCG type=del 2024-09-12T00:30:54.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.501+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=LM0L9KX60T43 type=del size=3805172 2024-09-12T00:30:54.501 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.503+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~VOW004R8SKZR.0 size=310610 2024-09-12T00:30:54.503 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.505+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=VOW004R8SKZR tag=KQJVMFUXOLSO type=write size=1359186 2024-09-12T00:30:54.506 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.508+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~XYBGTE16CHY3.0 size=1048576 2024-09-12T00:30:54.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.509+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~XYBGTE16CHY3.1 size=718984 2024-09-12T00:30:54.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.509+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=XYBGTE16CHY3 tag=TDSAXIBGJ8W3 type=write size=2816136 2024-09-12T00:30:54.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.510+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~IM0AY08DAAMO.0 size=1048576 2024-09-12T00:30:54.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.512+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~IM0AY08DAAMO.1 size=1048576 2024-09-12T00:30:54.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.513+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~IM0AY08DAAMO.2 size=380178 2024-09-12T00:30:54.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.515+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=IM0AY08DAAMO tag=5XYHBMIEFEY0 type=write size=3525906 2024-09-12T00:30:54.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.518+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~NIINJ2ZK390Y.0 size=875907 2024-09-12T00:30:54.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.518+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=NIINJ2ZK390Y tag=60OEW9DPOMVR type=write size=1924483 2024-09-12T00:30:54.517 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.519+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=DG5N16VNVUOE type=del 2024-09-12T00:30:54.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.520+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=PS8D40OC7KWQ type=del size=523348 2024-09-12T00:30:54.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.521+0000 7f0362c73780 1 < canceled part key=_multipart_IIZAWZDLR2QE.2~NINV8BB3ICGN.0 size=1048576 2024-09-12T00:30:54.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.522+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~NINV8BB3ICGN.1 size=622600 2024-09-12T00:30:54.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.524+0000 7f0362c73780 1 < canceled multipart upload key=IIZAWZDLR2QE upload=NINV8BB3ICGN tag=WLK46VCOJRN2 type=write size=2719752 2024-09-12T00:30:54.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.526+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~F1IV6O79RBPN.0 size=1048576 2024-09-12T00:30:54.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.528+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~F1IV6O79RBPN.1 size=796078 2024-09-12T00:30:54.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.528+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=F1IV6O79RBPN tag=DL9ETNKKU663 type=write size=2893230 2024-09-12T00:30:54.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.529+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=Z8FQCBJOD1UC type=del 2024-09-12T00:30:54.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.530+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=R2CIDPEBNU0U type=write size=83904 2024-09-12T00:30:54.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.532+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~L7GI1S4KHUZU.0 size=1048576 2024-09-12T00:30:54.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.533+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~L7GI1S4KHUZU.1 size=769359 2024-09-12T00:30:54.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.535+0000 7f0362c73780 1 < completed multipart upload key=927NCYXX8Z2P upload=L7GI1S4KHUZU tag=9XSVBIH45ZTM type=write size=2866511 2024-09-12T00:30:54.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.539+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~L97IW05WQ78L.0 size=1048576 2024-09-12T00:30:54.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.540+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~L97IW05WQ78L.1 size=934657 2024-09-12T00:30:54.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.540+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=L97IW05WQ78L tag=CLR0M3ZQ6YXH type=write size=3031809 2024-09-12T00:30:54.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.542+0000 7f0362c73780 1 < canceled operation key=KWDEKRO3WICD tag=0KK1CQ74NZJD type=del size=1101930 2024-09-12T00:30:54.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.544+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~BG8WTJ4GPPJC.0 size=1048576 2024-09-12T00:30:54.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.545+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~BG8WTJ4GPPJC.1 size=216016 2024-09-12T00:30:54.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.545+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=BG8WTJ4GPPJC tag=SP1KY60891FZ type=write size=2313168 2024-09-12T00:30:54.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.547+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=NWNZZJ014OQX type=del 2024-09-12T00:30:54.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.548+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=KFR5336Y0R00 type=write size=520586 2024-09-12T00:30:54.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.550+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~B6KA7A8M9UR1.0 size=1048576 2024-09-12T00:30:54.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.550+0000 7f0362c73780 1 < canceled part key=_multipart_CZHT9UQS34JU.2~B6KA7A8M9UR1.1 size=843620 2024-09-12T00:30:54.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.552+0000 7f0362c73780 1 < canceled multipart upload key=CZHT9UQS34JU upload=B6KA7A8M9UR1 tag=FC15BMDS7DD0 type=write size=2940772 2024-09-12T00:30:54.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.555+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~4LC0F5LZJ7NH.0 size=1048576 2024-09-12T00:30:54.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.556+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~4LC0F5LZJ7NH.1 size=1048576 2024-09-12T00:30:54.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.557+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~4LC0F5LZJ7NH.2 size=122564 2024-09-12T00:30:54.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.557+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=4LC0F5LZJ7NH tag=XLRSJPBFRF66 type=write size=3268292 2024-09-12T00:30:54.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.559+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=FQ6DZRXJJ6SO type=del 2024-09-12T00:30:54.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.560+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=QDJST7HHR13O type=del size=1352095 2024-09-12T00:30:54.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.562+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=RLIWUFOONF5R type=del 2024-09-12T00:30:54.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.563+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=IXBC6D60GRCA type=del size=1583138 2024-09-12T00:30:54.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.564+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=Q5CBL48J65T5 type=del 2024-09-12T00:30:54.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.566+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=DFHQZ5CKOTL1 type=write size=185101 2024-09-12T00:30:54.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.569+0000 7f0362c73780 1 < suggested remove operation key=YTN99RBTKO39 tag=JFZK4DYPKGZV type=del 2024-09-12T00:30:54.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.570+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=KLPFBJKQBT60 type=del size=614213 2024-09-12T00:30:54.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.572+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=6MVT4QXLBP3I type=del 2024-09-12T00:30:54.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.574+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~X7O4J4CXFHYP.0 size=407243 2024-09-12T00:30:54.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.574+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=X7O4J4CXFHYP tag=C733XX1H2H83 type=write size=1455819 2024-09-12T00:30:54.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.577+0000 7f0362c73780 1 < suggested remove operation key=X4ZML0796M7F tag=9V0LOR7F234C type=del 2024-09-12T00:30:54.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.579+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=LC5MYFCEMW9E type=write size=763423 2024-09-12T00:30:54.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.582+0000 7f0362c73780 1 < suggested update operation key=6AYDT9X4LC6T tag=LM0L9KX60T43 type=del size=3805172 2024-09-12T00:30:54.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.584+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~22MTQ2KTXYOH.0 size=1048576 2024-09-12T00:30:54.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.585+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~22MTQ2KTXYOH.1 size=1048576 2024-09-12T00:30:54.584 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.586+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~22MTQ2KTXYOH.2 size=1018380 2024-09-12T00:30:54.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.586+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=22MTQ2KTXYOH tag=S4AABFQZL2U3 type=write size=4164108 2024-09-12T00:30:54.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.588+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~XYBGTE16CHY3.0 size=1048576 2024-09-12T00:30:54.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.589+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~XYBGTE16CHY3.1 size=718984 2024-09-12T00:30:54.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.591+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=XYBGTE16CHY3 tag=TDSAXIBGJ8W3 type=write size=2816136 2024-09-12T00:30:54.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.594+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~SAO6SWFXKSAR.0 size=1048576 2024-09-12T00:30:54.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.595+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~SAO6SWFXKSAR.1 size=1048576 2024-09-12T00:30:54.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.596+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~SAO6SWFXKSAR.2 size=954151 2024-09-12T00:30:54.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.596+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=SAO6SWFXKSAR tag=I3PV60Y4EI3N type=write size=4099879 2024-09-12T00:30:54.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.597+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~NIINJ2ZK390Y.0 size=875907 2024-09-12T00:30:54.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.599+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=NIINJ2ZK390Y tag=60OEW9DPOMVR type=write size=1924483 2024-09-12T00:30:54.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.602+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~I465UYEFV4LL.0 size=124131 2024-09-12T00:30:54.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.602+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=I465UYEFV4LL tag=G40VPMSI9XAM type=write size=1172707 2024-09-12T00:30:54.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.604+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=PS8D40OC7KWQ type=del 2024-09-12T00:30:54.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.606+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~5PNOIDC4EG4S.0 size=157130 2024-09-12T00:30:54.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.606+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=5PNOIDC4EG4S tag=ZV5JSNGR629B type=write size=1205706 2024-09-12T00:30:54.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.607+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~F1IV6O79RBPN.0 size=1048576 2024-09-12T00:30:54.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.609+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~F1IV6O79RBPN.1 size=796078 2024-09-12T00:30:54.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.611+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=F1IV6O79RBPN tag=DL9ETNKKU663 type=write size=2893230 2024-09-12T00:30:54.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.613+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=5WBVGN6DZ36V type=del size=2866941 2024-09-12T00:30:54.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.614+0000 7f0362c73780 -1 < failed to complete operation key=YTN99RBTKO39 tag=R2CIDPEBNU0U type=write size=83904: (22) Invalid argument 2024-09-12T00:30:54.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.617+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~UIAEQJ57QE8F.0 size=109455 2024-09-12T00:30:54.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.617+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=UIAEQJ57QE8F tag=Q8ZZW6G8BACO type=write size=1158031 2024-09-12T00:30:54.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.620+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~L97IW05WQ78L.0 size=1048576 2024-09-12T00:30:54.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.621+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~L97IW05WQ78L.1 size=934657 2024-09-12T00:30:54.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.623+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=L97IW05WQ78L tag=CLR0M3ZQ6YXH type=write size=3031809 2024-09-12T00:30:54.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.625+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=J6B0WHZ24IFH type=del size=3862471 2024-09-12T00:30:54.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.625+0000 7f0362c73780 1 < canceled part key=_multipart_I3B48QD9E40S.2~BG8WTJ4GPPJC.0 size=1048576 2024-09-12T00:30:54.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.626+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~BG8WTJ4GPPJC.1 size=216016 2024-09-12T00:30:54.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.628+0000 7f0362c73780 1 < canceled multipart upload key=I3B48QD9E40S upload=BG8WTJ4GPPJC tag=SP1KY60891FZ type=write size=2313168 2024-09-12T00:30:54.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.630+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=UO2D7L8VHYOP type=del size=2394231 2024-09-12T00:30:54.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.633+0000 7f0362c73780 1 < suggested update operation key=XWW3882YBHAJ tag=KFR5336Y0R00 type=write size=520586 2024-09-12T00:30:54.634 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.635+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~F7LQG35ZGR4D.0 size=1048576 2024-09-12T00:30:54.635 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.636+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~F7LQG35ZGR4D.1 size=419723 2024-09-12T00:30:54.635 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.636+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=F7LQG35ZGR4D tag=4NPI942WLO2V type=write size=2516875 2024-09-12T00:30:54.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.638+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~4LC0F5LZJ7NH.0 size=1048576 2024-09-12T00:30:54.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.639+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~4LC0F5LZJ7NH.1 size=1048576 2024-09-12T00:30:54.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.640+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~4LC0F5LZJ7NH.2 size=122564 2024-09-12T00:30:54.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.643+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=4LC0F5LZJ7NH tag=XLRSJPBFRF66 type=write size=3268292 2024-09-12T00:30:54.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.644+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=3SQLBFLC48N6 type=del size=3235699 2024-09-12T00:30:54.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.646+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=QDJST7HHR13O type=del 2024-09-12T00:30:54.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.648+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=S5MTU9AFM9TR type=del size=4074711 2024-09-12T00:30:54.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.649+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=IXBC6D60GRCA type=del 2024-09-12T00:30:54.649 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.651+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=ARCLVO9K88T7 type=del size=3354990 2024-09-12T00:30:54.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.652+0000 7f0362c73780 1 < completed write operation key=EHBOL435W9ZE tag=DFHQZ5CKOTL1 type=write size=185101 2024-09-12T00:30:54.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.654+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=3R20JKGDPDF9 type=del size=2638102 2024-09-12T00:30:54.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.655+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=KLPFBJKQBT60 type=del 2024-09-12T00:30:54.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.656+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=X9T4FRYIIS5L type=del size=4155879 2024-09-12T00:30:54.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.658+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~X7O4J4CXFHYP.0 size=407243 2024-09-12T00:30:54.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.660+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=X7O4J4CXFHYP tag=C733XX1H2H83 type=write size=1455819 2024-09-12T00:30:54.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.663+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~9ZR396ODJF0P.0 size=1048576 2024-09-12T00:30:54.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.664+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~9ZR396ODJF0P.1 size=888062 2024-09-12T00:30:54.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.664+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=9ZR396ODJF0P tag=HCXNEFC3KD2K type=write size=2985214 2024-09-12T00:30:54.663 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.665+0000 7f0362c73780 1 < completed write operation key=G2HW98G6624O tag=LC5MYFCEMW9E type=write size=763423 2024-09-12T00:30:54.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.668+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~TJTLQVE54KUP.0 size=1048576 2024-09-12T00:30:54.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.669+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~TJTLQVE54KUP.1 size=144373 2024-09-12T00:30:54.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.669+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=TJTLQVE54KUP tag=0TN0ERQLHC9J type=write size=2241525 2024-09-12T00:30:54.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.670+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~22MTQ2KTXYOH.0 size=1048576 2024-09-12T00:30:54.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.671+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~22MTQ2KTXYOH.1 size=1048576 2024-09-12T00:30:54.670 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.671+0000 7f0362c73780 1 < canceled part key=_multipart_R4ABY5AY0S1P.2~22MTQ2KTXYOH.2 size=1018380 2024-09-12T00:30:54.673 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.674+0000 7f0362c73780 1 < canceled multipart upload key=R4ABY5AY0S1P upload=22MTQ2KTXYOH tag=S4AABFQZL2U3 type=write size=4164108 2024-09-12T00:30:54.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.676+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=EBBHIW3GO4EK type=del size=1751760 2024-09-12T00:30:54.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.677+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~SAO6SWFXKSAR.0 size=1048576 2024-09-12T00:30:54.677 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.679+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~SAO6SWFXKSAR.1 size=1048576 2024-09-12T00:30:54.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.680+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~SAO6SWFXKSAR.2 size=954151 2024-09-12T00:30:54.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.682+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=SAO6SWFXKSAR tag=I3PV60Y4EI3N type=write size=4099879 2024-09-12T00:30:54.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.683+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=BZZZ8IGVA7EB type=del size=2722613 2024-09-12T00:30:54.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.685+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~I465UYEFV4LL.0 size=124131 2024-09-12T00:30:54.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.687+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=I465UYEFV4LL tag=G40VPMSI9XAM type=write size=1172707 2024-09-12T00:30:54.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.688+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=IBHVGCJ3MM51 type=del size=2633402 2024-09-12T00:30:54.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.689+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~5PNOIDC4EG4S.0 size=157130 2024-09-12T00:30:54.690 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.692+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=5PNOIDC4EG4S tag=ZV5JSNGR629B type=write size=1205706 2024-09-12T00:30:54.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.693+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=5YM7083ZWYU3 type=del size=3994294 2024-09-12T00:30:54.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.696+0000 7f0362c73780 1 < suggested remove operation key=EHBOL435W9ZE tag=5WBVGN6DZ36V type=del 2024-09-12T00:30:54.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.697+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=2FERB50LGTOG type=del size=3644877 2024-09-12T00:30:54.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.698+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~UIAEQJ57QE8F.0 size=109455 2024-09-12T00:30:54.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.701+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=UIAEQJ57QE8F tag=Q8ZZW6G8BACO type=write size=1158031 2024-09-12T00:30:54.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.702+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=4UFN7EXYSPDL type=del size=224680 2024-09-12T00:30:54.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.703+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=J6B0WHZ24IFH type=del 2024-09-12T00:30:54.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.706+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~SGUSRU2DAM76.0 size=835522 2024-09-12T00:30:54.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.706+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=SGUSRU2DAM76 tag=CRQSA5OU12LV type=write size=1884098 2024-09-12T00:30:54.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.707+0000 7f0362c73780 1 < canceled operation key=HWSQFSK29S0V tag=UO2D7L8VHYOP type=del size=2394231 2024-09-12T00:30:54.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.710+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~W0D7O4SE5MHK.0 size=1048576 2024-09-12T00:30:54.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.711+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~W0D7O4SE5MHK.1 size=1048576 2024-09-12T00:30:54.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.712+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~W0D7O4SE5MHK.2 size=482859 2024-09-12T00:30:54.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.712+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=W0D7O4SE5MHK tag=XG9NDG522QPQ type=write size=3628587 2024-09-12T00:30:54.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.713+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~F7LQG35ZGR4D.0 size=1048576 2024-09-12T00:30:54.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.714+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~F7LQG35ZGR4D.1 size=419723 2024-09-12T00:30:54.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.717+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=F7LQG35ZGR4D tag=4NPI942WLO2V type=write size=2516875 2024-09-12T00:30:54.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.718+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=AFACPW8XV5B4 type=write size=907209 2024-09-12T00:30:54.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.721+0000 7f0362c73780 1 < suggested update operation key=2DHHPBYV80O8 tag=3SQLBFLC48N6 type=del size=3235699 2024-09-12T00:30:54.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.722+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=ZOGHXHKHG5E2 type=write size=365605 2024-09-12T00:30:54.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.725+0000 7f0362c73780 1 < suggested update operation key=I3B48QD9E40S tag=S5MTU9AFM9TR type=del size=4074711 2024-09-12T00:30:54.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.727+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~WDVMT1VUNX9T.0 size=1048576 2024-09-12T00:30:54.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.729+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~WDVMT1VUNX9T.1 size=452693 2024-09-12T00:30:54.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.729+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=WDVMT1VUNX9T tag=O1WVURHHHS99 type=write size=2549845 2024-09-12T00:30:54.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.730+0000 7f0362c73780 -1 < failed to complete operation key=I3B48QD9E40S tag=ARCLVO9K88T7 type=del size=3354990: (22) Invalid argument 2024-09-12T00:30:54.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.732+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=PWMBG6PCXV7F type=write size=110473 2024-09-12T00:30:54.731 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.733+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=3R20JKGDPDF9 type=del 2024-09-12T00:30:54.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.735+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=K00CLBKKI697 type=del size=3526367 2024-09-12T00:30:54.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.736+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=X9T4FRYIIS5L type=del 2024-09-12T00:30:54.736 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.738+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=FYR5EMCHBDDS type=del size=2660249 2024-09-12T00:30:54.736 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.738+0000 7f0362c73780 1 < canceled part key=_multipart_44YJP6XPIFT5.2~9ZR396ODJF0P.0 size=1048576 2024-09-12T00:30:54.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.739+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~9ZR396ODJF0P.1 size=888062 2024-09-12T00:30:54.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.741+0000 7f0362c73780 1 < canceled multipart upload key=44YJP6XPIFT5 upload=9ZR396ODJF0P tag=HCXNEFC3KD2K type=write size=2985214 2024-09-12T00:30:54.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.744+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~0OOYK09WTTSK.0 size=546706 2024-09-12T00:30:54.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.744+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=0OOYK09WTTSK tag=MPREGPB2D6IQ type=write size=1595282 2024-09-12T00:30:54.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.745+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~TJTLQVE54KUP.0 size=1048576 2024-09-12T00:30:54.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.746+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~TJTLQVE54KUP.1 size=144373 2024-09-12T00:30:54.747 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.749+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=TJTLQVE54KUP tag=0TN0ERQLHC9J type=write size=2241525 2024-09-12T00:30:54.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.751+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=OKV4NFFFOXLJ type=del size=632210 2024-09-12T00:30:54.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.752+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=EBBHIW3GO4EK type=del 2024-09-12T00:30:54.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.754+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=4E308EV0G8BY type=del size=3381313 2024-09-12T00:30:54.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.755+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=BZZZ8IGVA7EB type=del 2024-09-12T00:30:54.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.758+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~LP5UCVUFY12J.0 size=1048576 2024-09-12T00:30:54.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.759+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~LP5UCVUFY12J.1 size=1048576 2024-09-12T00:30:54.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.760+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~LP5UCVUFY12J.2 size=469424 2024-09-12T00:30:54.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.760+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=LP5UCVUFY12J tag=CREK1LH1O6V2 type=write size=3615152 2024-09-12T00:30:54.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.761+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=IBHVGCJ3MM51 type=del 2024-09-12T00:30:54.762 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.764+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~XZOWUZPTWU1T.0 size=1048576 2024-09-12T00:30:54.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.765+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~XZOWUZPTWU1T.1 size=1048576 2024-09-12T00:30:54.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.766+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~XZOWUZPTWU1T.2 size=999302 2024-09-12T00:30:54.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.766+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=XZOWUZPTWU1T tag=JS8V4SW1GDJ7 type=write size=4145030 2024-09-12T00:30:54.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.769+0000 7f0362c73780 1 < suggested update operation key=KWDEKRO3WICD tag=5YM7083ZWYU3 type=del size=3994294 2024-09-12T00:30:54.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.771+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=REIBE1WTARYY type=del size=3268363 2024-09-12T00:30:54.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.772+0000 7f0362c73780 1 < canceled operation key=G4G6E7KTTZY9 tag=2FERB50LGTOG type=del size=3644877 2024-09-12T00:30:54.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.775+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~URWBE0P35YVO.0 size=875809 2024-09-12T00:30:54.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.775+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=URWBE0P35YVO tag=IDCAG1GSKIWK type=write size=1924385 2024-09-12T00:30:54.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.778+0000 7f0362c73780 1 < suggested update operation key=3XZZX53L26G5 tag=4UFN7EXYSPDL type=del size=224680 2024-09-12T00:30:54.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.780+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~3NBW047DJYCS.0 size=1048576 2024-09-12T00:30:54.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.782+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~3NBW047DJYCS.1 size=1048576 2024-09-12T00:30:54.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.783+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~3NBW047DJYCS.2 size=82344 2024-09-12T00:30:54.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.783+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=3NBW047DJYCS tag=LRGGD0E6EBNS type=write size=3228072 2024-09-12T00:30:54.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.784+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~SGUSRU2DAM76.0 size=835522 2024-09-12T00:30:54.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.787+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=SGUSRU2DAM76 tag=CRQSA5OU12LV type=write size=1884098 2024-09-12T00:30:54.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.789+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~V3UNSEMTE3PO.0 size=1048576 2024-09-12T00:30:54.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.790+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~V3UNSEMTE3PO.1 size=421941 2024-09-12T00:30:54.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.790+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=V3UNSEMTE3PO tag=UDS5N2EF4V3W type=write size=2519093 2024-09-12T00:30:54.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.792+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~W0D7O4SE5MHK.0 size=1048576 2024-09-12T00:30:54.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.793+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~W0D7O4SE5MHK.1 size=1048576 2024-09-12T00:30:54.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.794+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~W0D7O4SE5MHK.2 size=482859 2024-09-12T00:30:54.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.796+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=W0D7O4SE5MHK tag=XG9NDG522QPQ type=write size=3628587 2024-09-12T00:30:54.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.798+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=O2FPXV5J8QK8 type=del size=627438 2024-09-12T00:30:54.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.801+0000 7f0362c73780 1 < suggested remove operation key=6AYDT9X4LC6T tag=AFACPW8XV5B4 type=write 2024-09-12T00:30:54.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.802+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=SWQZ803PAFDZ type=del size=1730643 2024-09-12T00:30:54.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.804+0000 7f0362c73780 1 < completed write operation key=PLAYMR18X9DZ tag=ZOGHXHKHG5E2 type=write size=365605 2024-09-12T00:30:54.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.807+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=ZU3PUT3H4JA6 type=write size=851538 2024-09-12T00:30:54.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.809+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~WDVMT1VUNX9T.0 size=1048576 2024-09-12T00:30:54.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.810+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~WDVMT1VUNX9T.1 size=452693 2024-09-12T00:30:54.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.812+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=WDVMT1VUNX9T tag=O1WVURHHHS99 type=write size=2549845 2024-09-12T00:30:54.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.814+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~0LIT99VIELQE.0 size=1048576 2024-09-12T00:30:54.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.815+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~0LIT99VIELQE.1 size=1048576 2024-09-12T00:30:54.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.816+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~0LIT99VIELQE.2 size=789766 2024-09-12T00:30:54.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.816+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=0LIT99VIELQE tag=PNVA65CEZNOW type=write size=3935494 2024-09-12T00:30:54.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.819+0000 7f0362c73780 1 < suggested update operation key=KWDEKRO3WICD tag=PWMBG6PCXV7F type=write size=110473 2024-09-12T00:30:54.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.821+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~LB4P402GF15F.0 size=630293 2024-09-12T00:30:54.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.821+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=LB4P402GF15F tag=2FO9MVYOTSP2 type=write size=1678869 2024-09-12T00:30:54.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.824+0000 7f0362c73780 1 < suggested remove operation key=WT0185G517YR tag=K00CLBKKI697 type=del 2024-09-12T00:30:54.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.827+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~WJV214JUTTN8.0 size=1048576 2024-09-12T00:30:54.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.828+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~WJV214JUTTN8.1 size=1048576 2024-09-12T00:30:54.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.829+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~WJV214JUTTN8.2 size=851901 2024-09-12T00:30:54.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.829+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=WJV214JUTTN8 tag=3IIW1BW1J3R8 type=write size=3997629 2024-09-12T00:30:54.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.831+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=FYR5EMCHBDDS type=del 2024-09-12T00:30:54.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.832+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=H8S2HU2W7Q63 type=del size=2501065 2024-09-12T00:30:54.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.834+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~0OOYK09WTTSK.0 size=546706 2024-09-12T00:30:54.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.836+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=0OOYK09WTTSK tag=MPREGPB2D6IQ type=write size=1595282 2024-09-12T00:30:54.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.839+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~VNHSFNBOZIUO.0 size=1048576 2024-09-12T00:30:54.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.840+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~VNHSFNBOZIUO.1 size=1048576 2024-09-12T00:30:54.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.841+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~VNHSFNBOZIUO.2 size=557713 2024-09-12T00:30:54.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.842+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=VNHSFNBOZIUO tag=4ISKOVEJJ34Q type=write size=3703441 2024-09-12T00:30:54.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.844+0000 7f0362c73780 1 < canceled operation key=OY30LP7FYXNF tag=OKV4NFFFOXLJ type=del size=632210 2024-09-12T00:30:54.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.845+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=6MLE94W2URC2 type=write size=915863 2024-09-12T00:30:54.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.847+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=4E308EV0G8BY type=del 2024-09-12T00:30:54.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.849+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~H3Y9G1IQCXDP.0 size=1048576 2024-09-12T00:30:54.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.851+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~H3Y9G1IQCXDP.1 size=117229 2024-09-12T00:30:54.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.851+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=H3Y9G1IQCXDP tag=3ZUY2IWR2I2A type=write size=2214381 2024-09-12T00:30:54.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.852+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~LP5UCVUFY12J.0 size=1048576 2024-09-12T00:30:54.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.853+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~LP5UCVUFY12J.1 size=1048576 2024-09-12T00:30:54.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.855+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~LP5UCVUFY12J.2 size=469424 2024-09-12T00:30:54.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.857+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=LP5UCVUFY12J tag=CREK1LH1O6V2 type=write size=3615152 2024-09-12T00:30:54.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.860+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~TSELSBWL5402.0 size=1048576 2024-09-12T00:30:54.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.861+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~TSELSBWL5402.1 size=1048576 2024-09-12T00:30:54.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.862+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~TSELSBWL5402.2 size=923315 2024-09-12T00:30:54.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.862+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=TSELSBWL5402 tag=66I0D9TVZ1H6 type=write size=4069043 2024-09-12T00:30:54.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.863+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~XZOWUZPTWU1T.0 size=1048576 2024-09-12T00:30:54.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.864+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~XZOWUZPTWU1T.1 size=1048576 2024-09-12T00:30:54.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.866+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~XZOWUZPTWU1T.2 size=999302 2024-09-12T00:30:54.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.868+0000 7f0362c73780 1 < completed multipart upload key=927NCYXX8Z2P upload=XZOWUZPTWU1T tag=JS8V4SW1GDJ7 type=write size=4145030 2024-09-12T00:30:54.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.869+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=Q5CYRQ3139DZ type=del size=4160263 2024-09-12T00:30:54.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.871+0000 7f0362c73780 1 < canceled operation key=X4ZML0796M7F tag=REIBE1WTARYY type=del size=3268363 2024-09-12T00:30:54.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.872+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=ES6FFTVD5ZQ8 type=write size=625781 2024-09-12T00:30:54.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.874+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~URWBE0P35YVO.0 size=875809 2024-09-12T00:30:54.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.878+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=URWBE0P35YVO tag=IDCAG1GSKIWK type=write size=1924385 2024-09-12T00:30:54.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.879+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=0O35WHY6HZ6D type=del size=817183 2024-09-12T00:30:54.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.881+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~3NBW047DJYCS.0 size=1048576 2024-09-12T00:30:54.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.882+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~3NBW047DJYCS.1 size=1048576 2024-09-12T00:30:54.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.883+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~3NBW047DJYCS.2 size=82344 2024-09-12T00:30:54.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.885+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=3NBW047DJYCS tag=LRGGD0E6EBNS type=write size=3228072 2024-09-12T00:30:54.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.888+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~RE6ETSYBR59E.0 size=1048576 2024-09-12T00:30:54.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.889+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~RE6ETSYBR59E.1 size=1048576 2024-09-12T00:30:54.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.890+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~RE6ETSYBR59E.2 size=699689 2024-09-12T00:30:54.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.890+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=RE6ETSYBR59E tag=6VGXTMSUDY0B type=write size=3845417 2024-09-12T00:30:54.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.892+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~V3UNSEMTE3PO.0 size=1048576 2024-09-12T00:30:54.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.893+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~V3UNSEMTE3PO.1 size=421941 2024-09-12T00:30:54.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.896+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=V3UNSEMTE3PO tag=UDS5N2EF4V3W type=write size=2519093 2024-09-12T00:30:54.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.899+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~GW7FT9Q3T8TW.0 size=1001314 2024-09-12T00:30:54.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.899+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=GW7FT9Q3T8TW tag=KKPWMSI4TK79 type=write size=2049890 2024-09-12T00:30:54.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.901+0000 7f0362c73780 1 < canceled operation key=XWW3882YBHAJ tag=O2FPXV5J8QK8 type=del size=627438 2024-09-12T00:30:54.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.903+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=EF0339LGHMJS type=del size=3701524 2024-09-12T00:30:54.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.904+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=SWQZ803PAFDZ type=del 2024-09-12T00:30:54.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.906+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=4P1P0OJ47X6U type=del size=1544955 2024-09-12T00:30:54.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.908+0000 7f0362c73780 1 < completed write operation key=G4G6E7KTTZY9 tag=ZU3PUT3H4JA6 type=write size=851538 2024-09-12T00:30:54.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.911+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~QX48FD80FMFK.0 size=1015779 2024-09-12T00:30:54.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.911+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=QX48FD80FMFK tag=WIM3WVLX9L9Q type=write size=2064355 2024-09-12T00:30:54.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.912+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~0LIT99VIELQE.0 size=1048576 2024-09-12T00:30:54.912 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.913+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~0LIT99VIELQE.1 size=1048576 2024-09-12T00:30:54.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.915+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~0LIT99VIELQE.2 size=789766 2024-09-12T00:30:54.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.917+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=0LIT99VIELQE tag=PNVA65CEZNOW type=write size=3935494 2024-09-12T00:30:54.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.918+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=VN05KQRZG20V type=write size=39942 2024-09-12T00:30:54.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.920+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~LB4P402GF15F.0 size=630293 2024-09-12T00:30:54.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.922+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=LB4P402GF15F tag=2FO9MVYOTSP2 type=write size=1678869 2024-09-12T00:30:54.922 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.924+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=3XH37TUJBMZJ type=del size=873131 2024-09-12T00:30:54.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.925+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~WJV214JUTTN8.0 size=1048576 2024-09-12T00:30:54.924 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.926+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~WJV214JUTTN8.1 size=1048576 2024-09-12T00:30:54.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.927+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~WJV214JUTTN8.2 size=851901 2024-09-12T00:30:54.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.930+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=WJV214JUTTN8 tag=3IIW1BW1J3R8 type=write size=3997629 2024-09-12T00:30:54.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.932+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~KEN8931SEASB.0 size=1048576 2024-09-12T00:30:54.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.933+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~KEN8931SEASB.1 size=1048576 2024-09-12T00:30:54.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.934+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~KEN8931SEASB.2 size=516389 2024-09-12T00:30:54.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.934+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=KEN8931SEASB tag=YZP18XAAHL3B type=write size=3662117 2024-09-12T00:30:54.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.936+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=H8S2HU2W7Q63 type=del 2024-09-12T00:30:54.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.938+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=NC2200H6O4P6 type=del size=1829467 2024-09-12T00:30:54.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.939+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~VNHSFNBOZIUO.0 size=1048576 2024-09-12T00:30:54.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.941+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~VNHSFNBOZIUO.1 size=1048576 2024-09-12T00:30:54.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.943+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~VNHSFNBOZIUO.2 size=557713 2024-09-12T00:30:54.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.945+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=VNHSFNBOZIUO tag=4ISKOVEJJ34Q type=write size=3703441 2024-09-12T00:30:54.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.947+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=N7BKQ8F0T36O type=del size=1160655 2024-09-12T00:30:54.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.948+0000 7f0362c73780 1 < completed write operation key=PLAYMR18X9DZ tag=6MLE94W2URC2 type=write size=915863 2024-09-12T00:30:54.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.949+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=6HK7QK03J2MH type=del size=2178358 2024-09-12T00:30:54.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.951+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~H3Y9G1IQCXDP.0 size=1048576 2024-09-12T00:30:54.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.952+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~H3Y9G1IQCXDP.1 size=117229 2024-09-12T00:30:54.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.954+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=H3Y9G1IQCXDP tag=3ZUY2IWR2I2A type=write size=2214381 2024-09-12T00:30:54.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.957+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~MCFQ13O90BQ9.0 size=1048576 2024-09-12T00:30:54.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.959+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~MCFQ13O90BQ9.1 size=1048576 2024-09-12T00:30:54.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.960+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~MCFQ13O90BQ9.2 size=389836 2024-09-12T00:30:54.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.960+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=MCFQ13O90BQ9 tag=ZUKXGY5XFN0U type=write size=3535564 2024-09-12T00:30:54.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.961+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~TSELSBWL5402.0 size=1048576 2024-09-12T00:30:54.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.962+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~TSELSBWL5402.1 size=1048576 2024-09-12T00:30:54.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.963+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~TSELSBWL5402.2 size=923315 2024-09-12T00:30:54.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.966+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=TSELSBWL5402 tag=66I0D9TVZ1H6 type=write size=4069043 2024-09-12T00:30:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.969+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~C8Q1G0J9RWII.0 size=1048576 2024-09-12T00:30:54.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.970+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~C8Q1G0J9RWII.1 size=408881 2024-09-12T00:30:54.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.970+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=C8Q1G0J9RWII tag=JMZP0EI544L5 type=write size=2506033 2024-09-12T00:30:54.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.972+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=Q5CYRQ3139DZ type=del 2024-09-12T00:30:54.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.974+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~2AYZFDS52O0D.0 size=1048576 2024-09-12T00:30:54.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.975+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~2AYZFDS52O0D.1 size=460264 2024-09-12T00:30:54.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.975+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=2AYZFDS52O0D tag=U35XJU7HNI0R type=write size=2557416 2024-09-12T00:30:54.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.977+0000 7f0362c73780 1 < completed write operation key=1UUNRPUKAINC tag=ES6FFTVD5ZQ8 type=write size=625781 2024-09-12T00:30:54.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.978+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=LN98O3M4AISH type=del size=1964795 2024-09-12T00:30:54.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.980+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=0O35WHY6HZ6D type=del 2024-09-12T00:30:54.981 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.982+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~VBAWQU821BZP.0 size=1048576 2024-09-12T00:30:54.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.983+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~VBAWQU821BZP.1 size=1048576 2024-09-12T00:30:54.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.985+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~VBAWQU821BZP.2 size=699210 2024-09-12T00:30:54.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.985+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=VBAWQU821BZP tag=AO70C8UT375D type=write size=3844938 2024-09-12T00:30:54.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.986+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~RE6ETSYBR59E.0 size=1048576 2024-09-12T00:30:54.985 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.987+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~RE6ETSYBR59E.1 size=1048576 2024-09-12T00:30:54.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.988+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~RE6ETSYBR59E.2 size=699689 2024-09-12T00:30:54.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.991+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=RE6ETSYBR59E tag=6VGXTMSUDY0B type=write size=3845417 2024-09-12T00:30:54.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.993+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~4Z342NHPILOW.0 size=1048576 2024-09-12T00:30:54.993 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.995+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~4Z342NHPILOW.1 size=443511 2024-09-12T00:30:54.993 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.995+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=4Z342NHPILOW tag=8OV04YB70WHM type=write size=2540663 2024-09-12T00:30:54.994 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.996+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~GW7FT9Q3T8TW.0 size=1001314 2024-09-12T00:30:54.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:54.998+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=GW7FT9Q3T8TW tag=KKPWMSI4TK79 type=write size=2049890 2024-09-12T00:30:54.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.000+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=RMI9XVGBYAMA type=del size=588831 2024-09-12T00:30:55.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.001+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=EF0339LGHMJS type=del 2024-09-12T00:30:55.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.003+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=TUI8D0U564DH type=del size=159404 2024-09-12T00:30:55.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.004+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=4P1P0OJ47X6U type=del 2024-09-12T00:30:55.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.006+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=54TDC3ODEBAC type=del size=3635623 2024-09-12T00:30:55.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.007+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~QX48FD80FMFK.0 size=1015779 2024-09-12T00:30:55.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.009+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=QX48FD80FMFK tag=WIM3WVLX9L9Q type=write size=2064355 2024-09-12T00:30:55.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.011+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=MBCE36YBOXWI type=del size=3506428 2024-09-12T00:30:55.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.014+0000 7f0362c73780 1 < suggested update operation key=OY30LP7FYXNF tag=VN05KQRZG20V type=write size=39942 2024-09-12T00:30:55.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.015+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=UPOI26V6UN7L type=del size=3546107 2024-09-12T00:30:55.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.017+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=3XH37TUJBMZJ type=del 2024-09-12T00:30:55.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.018+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=0045Q6S4TLDJ type=del size=103647 2024-09-12T00:30:55.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.020+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~KEN8931SEASB.0 size=1048576 2024-09-12T00:30:55.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.021+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~KEN8931SEASB.1 size=1048576 2024-09-12T00:30:55.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.022+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~KEN8931SEASB.2 size=516389 2024-09-12T00:30:55.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.024+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=KEN8931SEASB tag=YZP18XAAHL3B type=write size=3662117 2024-09-12T00:30:55.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.027+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~MDQ95A5T9A69.0 size=1048576 2024-09-12T00:30:55.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.028+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~MDQ95A5T9A69.1 size=191699 2024-09-12T00:30:55.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.028+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=MDQ95A5T9A69 tag=LT0MVOK51FAI type=write size=2288851 2024-09-12T00:30:55.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.029+0000 7f0362c73780 -1 < failed to complete operation key=OY30LP7FYXNF tag=NC2200H6O4P6 type=del size=1829467: (22) Invalid argument 2024-09-12T00:30:55.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.032+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~3ZIIQSVNYWC1.0 size=1048576 2024-09-12T00:30:55.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.033+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~3ZIIQSVNYWC1.1 size=743041 2024-09-12T00:30:55.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.033+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=3ZIIQSVNYWC1 tag=9034ZMCGCUL4 type=write size=2840193 2024-09-12T00:30:55.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.034+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=N7BKQ8F0T36O type=del 2024-09-12T00:30:55.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.036+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=2YN3K81CTNG3 type=del size=2782824 2024-09-12T00:30:55.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.039+0000 7f0362c73780 1 < suggested remove operation key=YTN99RBTKO39 tag=6HK7QK03J2MH type=del 2024-09-12T00:30:55.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.040+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=DNPAN35643BE type=del size=2491515 2024-09-12T00:30:55.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.042+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~MCFQ13O90BQ9.0 size=1048576 2024-09-12T00:30:55.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.043+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~MCFQ13O90BQ9.1 size=1048576 2024-09-12T00:30:55.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.044+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~MCFQ13O90BQ9.2 size=389836 2024-09-12T00:30:55.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.046+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=MCFQ13O90BQ9 tag=ZUKXGY5XFN0U type=write size=3535564 2024-09-12T00:30:55.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.049+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~8B0BU8CH208L.0 size=1048576 2024-09-12T00:30:55.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.050+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~8B0BU8CH208L.1 size=1048576 2024-09-12T00:30:55.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.051+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~8B0BU8CH208L.2 size=770720 2024-09-12T00:30:55.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.051+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=8B0BU8CH208L tag=PP58K8RD07ZR type=write size=3916448 2024-09-12T00:30:55.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.052+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~C8Q1G0J9RWII.0 size=1048576 2024-09-12T00:30:55.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.053+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~C8Q1G0J9RWII.1 size=408881 2024-09-12T00:30:55.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.056+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=C8Q1G0J9RWII tag=JMZP0EI544L5 type=write size=2506033 2024-09-12T00:30:55.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.057+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=8APTHJWKTGYB type=write size=540449 2024-09-12T00:30:55.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.059+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~2AYZFDS52O0D.0 size=1048576 2024-09-12T00:30:55.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.060+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~2AYZFDS52O0D.1 size=460264 2024-09-12T00:30:55.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.062+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=2AYZFDS52O0D tag=U35XJU7HNI0R type=write size=2557416 2024-09-12T00:30:55.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.065+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~7W0ZZZM12S4B.0 size=1048576 2024-09-12T00:30:55.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.066+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~7W0ZZZM12S4B.1 size=1048576 2024-09-12T00:30:55.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.067+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~7W0ZZZM12S4B.2 size=922741 2024-09-12T00:30:55.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.067+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=7W0ZZZM12S4B tag=IP4T8B2PFTQ2 type=write size=4068469 2024-09-12T00:30:55.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.069+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=LN98O3M4AISH type=del 2024-09-12T00:30:55.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.070+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=U729WJXJZJAK type=del size=122250 2024-09-12T00:30:55.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.072+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~VBAWQU821BZP.0 size=1048576 2024-09-12T00:30:55.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.074+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~VBAWQU821BZP.1 size=1048576 2024-09-12T00:30:55.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.075+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~VBAWQU821BZP.2 size=699210 2024-09-12T00:30:55.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.077+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=VBAWQU821BZP tag=AO70C8UT375D type=write size=3844938 2024-09-12T00:30:55.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.079+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=VJ73IJWBZ8GJ type=del size=582675 2024-09-12T00:30:55.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.080+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~4Z342NHPILOW.0 size=1048576 2024-09-12T00:30:55.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.081+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~4Z342NHPILOW.1 size=443511 2024-09-12T00:30:55.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.084+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=4Z342NHPILOW tag=8OV04YB70WHM type=write size=2540663 2024-09-12T00:30:55.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.087+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~E63XPSUSN4I6.0 size=1048576 2024-09-12T00:30:55.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.088+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~E63XPSUSN4I6.1 size=1048576 2024-09-12T00:30:55.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.089+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~E63XPSUSN4I6.2 size=895980 2024-09-12T00:30:55.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.089+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=E63XPSUSN4I6 tag=DZS533SKUYA7 type=write size=4041708 2024-09-12T00:30:55.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.091+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=RMI9XVGBYAMA type=del 2024-09-12T00:30:55.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.092+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=J9B2KTEA4NCL type=write size=767887 2024-09-12T00:30:55.092 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.093+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=TUI8D0U564DH type=del 2024-09-12T00:30:55.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.095+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=1EBRJ833384F type=del size=3897863 2024-09-12T00:30:55.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.096+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=54TDC3ODEBAC type=del 2024-09-12T00:30:55.097 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.099+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~A9NEQE4GBDZV.0 size=1048576 2024-09-12T00:30:55.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.100+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~A9NEQE4GBDZV.1 size=756907 2024-09-12T00:30:55.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.100+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=A9NEQE4GBDZV tag=VLRP0M0ANA4P type=write size=2854059 2024-09-12T00:30:55.102 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.104+0000 7f0362c73780 1 < suggested update operation key=HWSQFSK29S0V tag=MBCE36YBOXWI type=del size=3506428 2024-09-12T00:30:55.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.105+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=32FN6PG5116B type=write size=31352 2024-09-12T00:30:55.105 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.107+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=UPOI26V6UN7L type=del 2024-09-12T00:30:55.108 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.110+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~3S3KQIMGWPZK.0 size=1048576 2024-09-12T00:30:55.109 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.111+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~3S3KQIMGWPZK.1 size=1048576 2024-09-12T00:30:55.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.112+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~3S3KQIMGWPZK.2 size=374746 2024-09-12T00:30:55.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.112+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=3S3KQIMGWPZK tag=DFSTJMZ8ALDP type=write size=3520474 2024-09-12T00:30:55.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.113+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=0045Q6S4TLDJ type=del 2024-09-12T00:30:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.117+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~FPZE4NHPS2RD.0 size=634320 2024-09-12T00:30:55.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.117+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=FPZE4NHPS2RD tag=DWB3AJ75TU87 type=write size=1682896 2024-09-12T00:30:55.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.118+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~MDQ95A5T9A69.0 size=1048576 2024-09-12T00:30:55.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.119+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~MDQ95A5T9A69.1 size=191699 2024-09-12T00:30:55.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.122+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=MDQ95A5T9A69 tag=LT0MVOK51FAI type=write size=2288851 2024-09-12T00:30:55.122 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.123+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=OVGGAFTH5Y86 type=write size=706801 2024-09-12T00:30:55.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.125+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~3ZIIQSVNYWC1.0 size=1048576 2024-09-12T00:30:55.124 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.126+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~3ZIIQSVNYWC1.1 size=743041 2024-09-12T00:30:55.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.128+0000 7f0362c73780 1 < completed multipart upload key=927NCYXX8Z2P upload=3ZIIQSVNYWC1 tag=9034ZMCGCUL4 type=write size=2840193 2024-09-12T00:30:55.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.131+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~UEXK4YP1WS4F.0 size=604770 2024-09-12T00:30:55.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.131+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=UEXK4YP1WS4F tag=PIVFHVBRGEQ2 type=write size=1653346 2024-09-12T00:30:55.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.134+0000 7f0362c73780 1 < suggested update operation key=XWW3882YBHAJ tag=2YN3K81CTNG3 type=del size=2782824 2024-09-12T00:30:55.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.136+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=SA8U6AY6X928 type=del size=366020 2024-09-12T00:30:55.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.137+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=DNPAN35643BE type=del 2024-09-12T00:30:55.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.139+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=YF1D83N4UKDV type=del size=346729 2024-09-12T00:30:55.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.140+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~8B0BU8CH208L.0 size=1048576 2024-09-12T00:30:55.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.143+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~8B0BU8CH208L.1 size=1048576 2024-09-12T00:30:55.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.144+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~8B0BU8CH208L.2 size=770720 2024-09-12T00:30:55.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.146+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=8B0BU8CH208L tag=PP58K8RD07ZR type=write size=3916448 2024-09-12T00:30:55.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.148+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=O3T5CDC9Z0US type=write size=974871 2024-09-12T00:30:55.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.149+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=8APTHJWKTGYB type=write size=540449 2024-09-12T00:30:55.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.151+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=AXUD5Q7LCWF5 type=del size=2909970 2024-09-12T00:30:55.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.152+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~7W0ZZZM12S4B.0 size=1048576 2024-09-12T00:30:55.151 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.153+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~7W0ZZZM12S4B.1 size=1048576 2024-09-12T00:30:55.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.154+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~7W0ZZZM12S4B.2 size=922741 2024-09-12T00:30:55.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.157+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=7W0ZZZM12S4B tag=IP4T8B2PFTQ2 type=write size=4068469 2024-09-12T00:30:55.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.158+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=JMUCZFSAJ4S4 type=del size=969742 2024-09-12T00:30:55.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.161+0000 7f0362c73780 1 < suggested remove operation key=CZHT9UQS34JU tag=U729WJXJZJAK type=del 2024-09-12T00:30:55.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.163+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=92WJ3K8V3OCZ type=del size=1287829 2024-09-12T00:30:55.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.164+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=VJ73IJWBZ8GJ type=del 2024-09-12T00:30:55.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.166+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=GD9S31RX5ZG8 type=del size=2932537 2024-09-12T00:30:55.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.166+0000 7f0362c73780 1 < canceled part key=_multipart_XMMZOX8MH3GT.2~E63XPSUSN4I6.0 size=1048576 2024-09-12T00:30:55.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.167+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~E63XPSUSN4I6.1 size=1048576 2024-09-12T00:30:55.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.169+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~E63XPSUSN4I6.2 size=895980 2024-09-12T00:30:55.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.171+0000 7f0362c73780 1 < canceled multipart upload key=XMMZOX8MH3GT upload=E63XPSUSN4I6 tag=DZS533SKUYA7 type=write size=4041708 2024-09-12T00:30:55.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.172+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=IJ2UUX0IELGC type=write size=999164 2024-09-12T00:30:55.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.174+0000 7f0362c73780 1 < completed write operation key=KWDEKRO3WICD tag=J9B2KTEA4NCL type=write size=767887 2024-09-12T00:30:55.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.175+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=JZQKRCM8GKFL type=del size=1709819 2024-09-12T00:30:55.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.177+0000 7f0362c73780 1 < canceled operation key=OY30LP7FYXNF tag=1EBRJ833384F type=del size=3897863 2024-09-12T00:30:55.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.178+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=1DOXSV2THGEE type=del size=2490996 2024-09-12T00:30:55.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.180+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~A9NEQE4GBDZV.0 size=1048576 2024-09-12T00:30:55.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.181+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~A9NEQE4GBDZV.1 size=756907 2024-09-12T00:30:55.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.183+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=A9NEQE4GBDZV tag=VLRP0M0ANA4P type=write size=2854059 2024-09-12T00:30:55.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.186+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~D0VMRL8LNJ9U.0 size=218254 2024-09-12T00:30:55.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.186+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=D0VMRL8LNJ9U tag=NPN3IMLUSAEM type=write size=1266830 2024-09-12T00:30:55.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.187+0000 7f0362c73780 1 < completed write operation key=X4ZML0796M7F tag=32FN6PG5116B type=write size=31352 2024-09-12T00:30:55.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.190+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~NIPQ668HKQL4.0 size=1048576 2024-09-12T00:30:55.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.191+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~NIPQ668HKQL4.1 size=485418 2024-09-12T00:30:55.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.191+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=NIPQ668HKQL4 tag=B4XH6YE4T2UK type=write size=2582570 2024-09-12T00:30:55.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.192+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~3S3KQIMGWPZK.0 size=1048576 2024-09-12T00:30:55.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.193+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~3S3KQIMGWPZK.1 size=1048576 2024-09-12T00:30:55.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.195+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~3S3KQIMGWPZK.2 size=374746 2024-09-12T00:30:55.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.197+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=3S3KQIMGWPZK tag=DFSTJMZ8ALDP type=write size=3520474 2024-09-12T00:30:55.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.199+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=Z547H91EI4Z2 type=del size=2657268 2024-09-12T00:30:55.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.200+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~FPZE4NHPS2RD.0 size=634320 2024-09-12T00:30:55.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.203+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=FPZE4NHPS2RD tag=DWB3AJ75TU87 type=write size=1682896 2024-09-12T00:30:55.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.205+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~XRHYVE18C62G.0 size=1048576 2024-09-12T00:30:55.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.206+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~XRHYVE18C62G.1 size=1048576 2024-09-12T00:30:55.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.207+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~XRHYVE18C62G.2 size=252977 2024-09-12T00:30:55.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.207+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=XRHYVE18C62G tag=XOQMBZCSY1LP type=write size=3398705 2024-09-12T00:30:55.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.209+0000 7f0362c73780 1 < completed write operation key=X4ZML0796M7F tag=OVGGAFTH5Y86 type=write size=706801 2024-09-12T00:30:55.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.212+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~IQ29CZD4PU4L.0 size=1048576 2024-09-12T00:30:55.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.213+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~IQ29CZD4PU4L.1 size=1048576 2024-09-12T00:30:55.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.214+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~IQ29CZD4PU4L.2 size=914710 2024-09-12T00:30:55.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.214+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=IQ29CZD4PU4L tag=S5UYXPCILIH9 type=write size=4060438 2024-09-12T00:30:55.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.216+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~UEXK4YP1WS4F.0 size=604770 2024-09-12T00:30:55.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.219+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=UEXK4YP1WS4F tag=PIVFHVBRGEQ2 type=write size=1653346 2024-09-12T00:30:55.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.220+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=XF0NE8F60EMJ type=del size=228945 2024-09-12T00:30:55.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.222+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=SA8U6AY6X928 type=del 2024-09-12T00:30:55.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.224+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=GHVTZCIV8LOA type=write size=422464 2024-09-12T00:30:55.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.226+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=YF1D83N4UKDV type=del 2024-09-12T00:30:55.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.228+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~C68Z0DKPM7KS.0 size=539923 2024-09-12T00:30:55.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.228+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=C68Z0DKPM7KS tag=8C26T69AR7S8 type=write size=1588499 2024-09-12T00:30:55.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.230+0000 7f0362c73780 1 < completed write operation key=1MLL1T362X51 tag=O3T5CDC9Z0US type=write size=974871 2024-09-12T00:30:55.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.231+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=OXOR623PZ3ID type=del size=2259678 2024-09-12T00:30:55.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.232+0000 7f0362c73780 1 < canceled operation key=6AYDT9X4LC6T tag=AXUD5Q7LCWF5 type=del size=2909970 2024-09-12T00:30:55.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.234+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=BU5LGAP9UC43 type=del size=3571535 2024-09-12T00:30:55.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.235+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=JMUCZFSAJ4S4 type=del 2024-09-12T00:30:55.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.238+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~T6RT9V1KEF6V.0 size=1048576 2024-09-12T00:30:55.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.239+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~T6RT9V1KEF6V.1 size=1048576 2024-09-12T00:30:55.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.243+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~T6RT9V1KEF6V.2 size=90124 2024-09-12T00:30:55.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.243+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=T6RT9V1KEF6V tag=PAN7G2V0N4PH type=write size=3235852 2024-09-12T00:30:55.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.245+0000 7f0362c73780 1 < canceled operation key=I3B48QD9E40S tag=92WJ3K8V3OCZ type=del size=1287829 2024-09-12T00:30:55.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.246+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=XX7TBE11O5NS type=write size=170721 2024-09-12T00:30:55.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.248+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=GD9S31RX5ZG8 type=del 2024-09-12T00:30:55.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.249+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=TV96VT18LB27 type=del size=2930551 2024-09-12T00:30:55.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.251+0000 7f0362c73780 1 < canceled operation key=WT0185G517YR tag=IJ2UUX0IELGC type=write size=999164 2024-09-12T00:30:55.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.252+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=X61052UX0RKA type=del size=3072157 2024-09-12T00:30:55.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.254+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=JZQKRCM8GKFL type=del 2024-09-12T00:30:55.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.256+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~ZJ3ZUJ19HXHW.0 size=1048576 2024-09-12T00:30:55.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.257+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~ZJ3ZUJ19HXHW.1 size=1048576 2024-09-12T00:30:55.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.259+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~ZJ3ZUJ19HXHW.2 size=79595 2024-09-12T00:30:55.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.259+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=ZJ3ZUJ19HXHW tag=M1TF3KJ6G0UV type=write size=3225323 2024-09-12T00:30:55.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.260+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=1DOXSV2THGEE type=del 2024-09-12T00:30:55.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.263+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~G0FR9DX11JKX.0 size=619679 2024-09-12T00:30:55.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.263+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=G0FR9DX11JKX tag=YZNBO61TK6GI type=write size=1668255 2024-09-12T00:30:55.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.265+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~D0VMRL8LNJ9U.0 size=218254 2024-09-12T00:30:55.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.267+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=D0VMRL8LNJ9U tag=NPN3IMLUSAEM type=write size=1266830 2024-09-12T00:30:55.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.269+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=I0XUWHWCRUA5 type=del size=2985144 2024-09-12T00:30:55.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.270+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~NIPQ668HKQL4.0 size=1048576 2024-09-12T00:30:55.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.272+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~NIPQ668HKQL4.1 size=485418 2024-09-12T00:30:55.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.274+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=NIPQ668HKQL4 tag=B4XH6YE4T2UK type=write size=2582570 2024-09-12T00:30:55.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.277+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~4PL6EPUAB09D.0 size=1048576 2024-09-12T00:30:55.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.278+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~4PL6EPUAB09D.1 size=979839 2024-09-12T00:30:55.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.278+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=4PL6EPUAB09D tag=DSQ7PU6FLHF7 type=write size=3076991 2024-09-12T00:30:55.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.280+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=Z547H91EI4Z2 type=del 2024-09-12T00:30:55.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.281+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=QI8EMBZCIAV2 type=del size=3853658 2024-09-12T00:30:55.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.283+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~XRHYVE18C62G.0 size=1048576 2024-09-12T00:30:55.282 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.284+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~XRHYVE18C62G.1 size=1048576 2024-09-12T00:30:55.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.285+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~XRHYVE18C62G.2 size=252977 2024-09-12T00:30:55.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.287+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=XRHYVE18C62G tag=XOQMBZCSY1LP type=write size=3398705 2024-09-12T00:30:55.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.288+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=1MO2D2UC1CL2 type=del size=3986124 2024-09-12T00:30:55.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.290+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~IQ29CZD4PU4L.0 size=1048576 2024-09-12T00:30:55.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.291+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~IQ29CZD4PU4L.1 size=1048576 2024-09-12T00:30:55.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.292+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~IQ29CZD4PU4L.2 size=914710 2024-09-12T00:30:55.293 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.295+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=IQ29CZD4PU4L tag=S5UYXPCILIH9 type=write size=4060438 2024-09-12T00:30:55.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.296+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=1JAJOEAN3JHS type=del size=1717186 2024-09-12T00:30:55.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.298+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=XF0NE8F60EMJ type=del 2024-09-12T00:30:55.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.301+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~057MTLVL15MZ.0 size=1048576 2024-09-12T00:30:55.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.302+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~057MTLVL15MZ.1 size=1048576 2024-09-12T00:30:55.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.303+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~057MTLVL15MZ.2 size=929371 2024-09-12T00:30:55.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.303+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=057MTLVL15MZ tag=IWFDS1AQI9O1 type=write size=4075099 2024-09-12T00:30:55.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.304+0000 7f0362c73780 1 < completed write operation key=X4ZML0796M7F tag=GHVTZCIV8LOA type=write size=422464 2024-09-12T00:30:55.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.306+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=XZXN9PS4FW7T type=del size=1105325 2024-09-12T00:30:55.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.307+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~C68Z0DKPM7KS.0 size=539923 2024-09-12T00:30:55.308 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.310+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=C68Z0DKPM7KS tag=8C26T69AR7S8 type=write size=1588499 2024-09-12T00:30:55.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.311+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=U0CLJXK504E8 type=del size=2039880 2024-09-12T00:30:55.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.312+0000 7f0362c73780 1 < canceled operation key=6AYDT9X4LC6T tag=OXOR623PZ3ID type=del size=2259678 2024-09-12T00:30:55.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.316+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~VF418DF30SXS.0 size=1048576 2024-09-12T00:30:55.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.317+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~VF418DF30SXS.1 size=1048576 2024-09-12T00:30:55.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.318+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~VF418DF30SXS.2 size=823945 2024-09-12T00:30:55.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.318+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=VF418DF30SXS tag=F3E58DB7EEVE type=write size=3969673 2024-09-12T00:30:55.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.319+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=BU5LGAP9UC43 type=del 2024-09-12T00:30:55.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.320+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=BD3RDK8LL2SF type=del size=3789470 2024-09-12T00:30:55.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.322+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~T6RT9V1KEF6V.0 size=1048576 2024-09-12T00:30:55.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.323+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~T6RT9V1KEF6V.1 size=1048576 2024-09-12T00:30:55.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.324+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~T6RT9V1KEF6V.2 size=90124 2024-09-12T00:30:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.326+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=T6RT9V1KEF6V tag=PAN7G2V0N4PH type=write size=3235852 2024-09-12T00:30:55.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.329+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~FW1AU4LZZYFC.0 size=1048576 2024-09-12T00:30:55.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.330+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~FW1AU4LZZYFC.1 size=1048576 2024-09-12T00:30:55.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.331+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~FW1AU4LZZYFC.2 size=804243 2024-09-12T00:30:55.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.331+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=FW1AU4LZZYFC tag=MCYDFJZ009UH type=write size=3949971 2024-09-12T00:30:55.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.333+0000 7f0362c73780 1 < canceled operation key=XR8L0HL374VC tag=XX7TBE11O5NS type=write size=170721 2024-09-12T00:30:55.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.335+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~VQW23TXXP0B2.0 size=1048576 2024-09-12T00:30:55.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.336+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~VQW23TXXP0B2.1 size=45707 2024-09-12T00:30:55.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.336+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=VQW23TXXP0B2 tag=ICW602QSV40O type=write size=2142859 2024-09-12T00:30:55.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.338+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=TV96VT18LB27 type=del 2024-09-12T00:30:55.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.339+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=S5SADIDX1JDH type=write size=253086 2024-09-12T00:30:55.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.342+0000 7f0362c73780 1 < suggested update operation key=HEN9LUUIDAR5 tag=X61052UX0RKA type=del size=3072157 2024-09-12T00:30:55.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.343+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=M7M45UN6HM3K type=del size=3319983 2024-09-12T00:30:55.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.345+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~ZJ3ZUJ19HXHW.0 size=1048576 2024-09-12T00:30:55.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.346+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~ZJ3ZUJ19HXHW.1 size=1048576 2024-09-12T00:30:55.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.348+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~ZJ3ZUJ19HXHW.2 size=79595 2024-09-12T00:30:55.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.350+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=ZJ3ZUJ19HXHW tag=M1TF3KJ6G0UV type=write size=3225323 2024-09-12T00:30:55.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.351+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=2IDP8T9D3LSQ type=del size=97525 2024-09-12T00:30:55.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.352+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~G0FR9DX11JKX.0 size=619679 2024-09-12T00:30:55.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.355+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=G0FR9DX11JKX tag=YZNBO61TK6GI type=write size=1668255 2024-09-12T00:30:55.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.356+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=WO385CQHCHTM type=del size=1962553 2024-09-12T00:30:55.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.358+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=I0XUWHWCRUA5 type=del 2024-09-12T00:30:55.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.359+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=ZVEBQ3GEU29L type=del size=2401376 2024-09-12T00:30:55.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.361+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~4PL6EPUAB09D.0 size=1048576 2024-09-12T00:30:55.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.362+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~4PL6EPUAB09D.1 size=979839 2024-09-12T00:30:55.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.364+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=4PL6EPUAB09D tag=DSQ7PU6FLHF7 type=write size=3076991 2024-09-12T00:30:55.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.366+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~16JNRENJG1RT.0 size=1048576 2024-09-12T00:30:55.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.368+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~16JNRENJG1RT.1 size=1048576 2024-09-12T00:30:55.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.369+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~16JNRENJG1RT.2 size=511061 2024-09-12T00:30:55.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.369+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=16JNRENJG1RT tag=MPM9JA0JMUCW type=write size=3656789 2024-09-12T00:30:55.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.370+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=QI8EMBZCIAV2 type=del 2024-09-12T00:30:55.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.372+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=WV0MH2Z46HQM type=del size=2303549 2024-09-12T00:30:55.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.374+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=1MO2D2UC1CL2 type=del 2024-09-12T00:30:55.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.375+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=3G4KM99WOYRJ type=del size=3396348 2024-09-12T00:30:55.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.377+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=1JAJOEAN3JHS type=del 2024-09-12T00:30:55.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.380+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~X0Y0D1092CD4.0 size=1048576 2024-09-12T00:30:55.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.381+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~X0Y0D1092CD4.1 size=759763 2024-09-12T00:30:55.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.381+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=X0Y0D1092CD4 tag=GVQBA267PUL8 type=write size=2856915 2024-09-12T00:30:55.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.383+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~057MTLVL15MZ.0 size=1048576 2024-09-12T00:30:55.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.385+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~057MTLVL15MZ.1 size=1048576 2024-09-12T00:30:55.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.387+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~057MTLVL15MZ.2 size=929371 2024-09-12T00:30:55.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.389+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=057MTLVL15MZ tag=IWFDS1AQI9O1 type=write size=4075099 2024-09-12T00:30:55.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.391+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=AKA0PQ39X31J type=del size=1693903 2024-09-12T00:30:55.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.392+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=XZXN9PS4FW7T type=del 2024-09-12T00:30:55.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.396+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~M9RZAKKXLS6D.0 size=1048576 2024-09-12T00:30:55.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.397+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~M9RZAKKXLS6D.1 size=1048576 2024-09-12T00:30:55.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.398+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~M9RZAKKXLS6D.2 size=115792 2024-09-12T00:30:55.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.398+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=M9RZAKKXLS6D tag=XQ0PDBRKPKN3 type=write size=3261520 2024-09-12T00:30:55.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.400+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=U0CLJXK504E8 type=del 2024-09-12T00:30:55.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.403+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~W95OWSHML4HM.0 size=1048576 2024-09-12T00:30:55.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.404+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~W95OWSHML4HM.1 size=1048576 2024-09-12T00:30:55.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.405+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~W95OWSHML4HM.2 size=171096 2024-09-12T00:30:55.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.405+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=W95OWSHML4HM tag=023XB31TKQVS type=write size=3316824 2024-09-12T00:30:55.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.407+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~VF418DF30SXS.0 size=1048576 2024-09-12T00:30:55.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.407+0000 7f0362c73780 1 < canceled part key=_multipart_2DHHPBYV80O8.2~VF418DF30SXS.1 size=1048576 2024-09-12T00:30:55.406 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.408+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~VF418DF30SXS.2 size=823945 2024-09-12T00:30:55.409 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.411+0000 7f0362c73780 1 < canceled multipart upload key=2DHHPBYV80O8 upload=VF418DF30SXS tag=F3E58DB7EEVE type=write size=3969673 2024-09-12T00:30:55.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.412+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=Z9L4X8P6AKYO type=del size=2762865 2024-09-12T00:30:55.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.414+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=BD3RDK8LL2SF type=del 2024-09-12T00:30:55.414 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.416+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=3T2UHU2Z6ZGS type=del size=1965665 2024-09-12T00:30:55.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.418+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~FW1AU4LZZYFC.0 size=1048576 2024-09-12T00:30:55.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.418+0000 7f0362c73780 1 < canceled part key=_multipart_KWDEKRO3WICD.2~FW1AU4LZZYFC.1 size=1048576 2024-09-12T00:30:55.418 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.419+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~FW1AU4LZZYFC.2 size=804243 2024-09-12T00:30:55.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.423+0000 7f0362c73780 1 < canceled multipart upload key=KWDEKRO3WICD upload=FW1AU4LZZYFC tag=MCYDFJZ009UH type=write size=3949971 2024-09-12T00:30:55.424 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.426+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~04GUVIQXPKMY.0 size=1048576 2024-09-12T00:30:55.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.427+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~04GUVIQXPKMY.1 size=1048576 2024-09-12T00:30:55.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.428+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~04GUVIQXPKMY.2 size=802908 2024-09-12T00:30:55.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.428+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=04GUVIQXPKMY tag=TJGCOHIA4DQ3 type=write size=3948636 2024-09-12T00:30:55.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.430+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~VQW23TXXP0B2.0 size=1048576 2024-09-12T00:30:55.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.431+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~VQW23TXXP0B2.1 size=45707 2024-09-12T00:30:55.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.434+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=VQW23TXXP0B2 tag=ICW602QSV40O type=write size=2142859 2024-09-12T00:30:55.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.436+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=0INXXG94P83B type=del size=2775530 2024-09-12T00:30:55.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.439+0000 7f0362c73780 1 < suggested update operation key=6AYDT9X4LC6T tag=S5SADIDX1JDH type=write size=253086 2024-09-12T00:30:55.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.440+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=NNBGVIZKKN3E type=del size=1581454 2024-09-12T00:30:55.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.442+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=M7M45UN6HM3K type=del 2024-09-12T00:30:55.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.444+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~VO1ECKBI5T6K.0 size=1048576 2024-09-12T00:30:55.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.446+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~VO1ECKBI5T6K.1 size=1048576 2024-09-12T00:30:55.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.447+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~VO1ECKBI5T6K.2 size=723316 2024-09-12T00:30:55.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.447+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=VO1ECKBI5T6K tag=JI84XJ2UTT86 type=write size=3869044 2024-09-12T00:30:55.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.448+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=2IDP8T9D3LSQ type=del 2024-09-12T00:30:55.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.451+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~8QEY9JDO2TO3.0 size=1048576 2024-09-12T00:30:55.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.452+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~8QEY9JDO2TO3.1 size=1048576 2024-09-12T00:30:55.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.453+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~8QEY9JDO2TO3.2 size=13960 2024-09-12T00:30:55.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.453+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=8QEY9JDO2TO3 tag=84S1O2PIPVAS type=write size=3159688 2024-09-12T00:30:55.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.455+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=WO385CQHCHTM type=del 2024-09-12T00:30:55.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.457+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~P5V8JQB6QB3L.0 size=584342 2024-09-12T00:30:55.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.457+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=P5V8JQB6QB3L tag=D357CF629XTQ type=write size=1632918 2024-09-12T00:30:55.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.459+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=ZVEBQ3GEU29L type=del 2024-09-12T00:30:55.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.461+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=GVWYLJ7K0DTP type=write size=218351 2024-09-12T00:30:55.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.463+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~16JNRENJG1RT.0 size=1048576 2024-09-12T00:30:55.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.464+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~16JNRENJG1RT.1 size=1048576 2024-09-12T00:30:55.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.465+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~16JNRENJG1RT.2 size=511061 2024-09-12T00:30:55.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.468+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=16JNRENJG1RT tag=MPM9JA0JMUCW type=write size=3656789 2024-09-12T00:30:55.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.469+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=1QHQ9JIU4725 type=del size=1619474 2024-09-12T00:30:55.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.471+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=WV0MH2Z46HQM type=del 2024-09-12T00:30:55.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.474+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~4P93F11BY7IB.0 size=1048576 2024-09-12T00:30:55.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.475+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~4P93F11BY7IB.1 size=995670 2024-09-12T00:30:55.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.475+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=4P93F11BY7IB tag=OLCQZD3L0SDH type=write size=3092822 2024-09-12T00:30:55.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.476+0000 7f0362c73780 1 < canceled operation key=IIZAWZDLR2QE tag=3G4KM99WOYRJ type=del size=3396348 2024-09-12T00:30:55.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.479+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~302CG93JR8CX.0 size=1048576 2024-09-12T00:30:55.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.480+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~302CG93JR8CX.1 size=1048576 2024-09-12T00:30:55.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.481+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~302CG93JR8CX.2 size=814856 2024-09-12T00:30:55.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.481+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=302CG93JR8CX tag=CUABU40K7FIJ type=write size=3960584 2024-09-12T00:30:55.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.483+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~X0Y0D1092CD4.0 size=1048576 2024-09-12T00:30:55.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.484+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~X0Y0D1092CD4.1 size=759763 2024-09-12T00:30:55.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.487+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=X0Y0D1092CD4 tag=GVQBA267PUL8 type=write size=2856915 2024-09-12T00:30:55.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.488+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=BRHLUBL1298F type=del size=3337630 2024-09-12T00:30:55.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.489+0000 7f0362c73780 1 < canceled operation key=2DHHPBYV80O8 tag=AKA0PQ39X31J type=del size=1693903 2024-09-12T00:30:55.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.493+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~QJ5NHUNO38KI.0 size=1048576 2024-09-12T00:30:55.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.496+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~QJ5NHUNO38KI.1 size=866779 2024-09-12T00:30:55.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.496+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=QJ5NHUNO38KI tag=O2UI5LBO06JP type=write size=2963931 2024-09-12T00:30:55.495 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.497+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~M9RZAKKXLS6D.0 size=1048576 2024-09-12T00:30:55.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.498+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~M9RZAKKXLS6D.1 size=1048576 2024-09-12T00:30:55.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.498+0000 7f0362c73780 1 < canceled part key=_multipart_3XZZX53L26G5.2~M9RZAKKXLS6D.2 size=115792 2024-09-12T00:30:55.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.501+0000 7f0362c73780 1 < canceled multipart upload key=3XZZX53L26G5 upload=M9RZAKKXLS6D tag=XQ0PDBRKPKN3 type=write size=3261520 2024-09-12T00:30:55.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.502+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=VOFBZLUICFE6 type=write size=904627 2024-09-12T00:30:55.502 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.503+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~W95OWSHML4HM.0 size=1048576 2024-09-12T00:30:55.503 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.504+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~W95OWSHML4HM.1 size=1048576 2024-09-12T00:30:55.504 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.506+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~W95OWSHML4HM.2 size=171096 2024-09-12T00:30:55.506 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.508+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=W95OWSHML4HM tag=023XB31TKQVS type=write size=3316824 2024-09-12T00:30:55.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.509+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=7HACD0Q4HU2H type=del size=3973745 2024-09-12T00:30:55.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.511+0000 7f0362c73780 1 < canceled operation key=PYCRNXC9ITGF tag=Z9L4X8P6AKYO type=del size=2762865 2024-09-12T00:30:55.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.512+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=CU3013IOA7P6 type=del size=3877874 2024-09-12T00:30:55.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.513+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=3T2UHU2Z6ZGS type=del 2024-09-12T00:30:55.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.516+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~2PUS49XFK4JX.0 size=1048576 2024-09-12T00:30:55.515 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.517+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~2PUS49XFK4JX.1 size=1048576 2024-09-12T00:30:55.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.518+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~2PUS49XFK4JX.2 size=576270 2024-09-12T00:30:55.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.518+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=2PUS49XFK4JX tag=THTB1B0X27J1 type=write size=3721998 2024-09-12T00:30:55.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.519+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~04GUVIQXPKMY.0 size=1048576 2024-09-12T00:30:55.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.520+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~04GUVIQXPKMY.1 size=1048576 2024-09-12T00:30:55.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.521+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~04GUVIQXPKMY.2 size=802908 2024-09-12T00:30:55.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.524+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=04GUVIQXPKMY tag=TJGCOHIA4DQ3 type=write size=3948636 2024-09-12T00:30:55.523 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.525+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=EIBTT9Q9LZWZ type=del size=3647580 2024-09-12T00:30:55.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.526+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=0INXXG94P83B type=del 2024-09-12T00:30:55.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.529+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~LG1OYGO1SCU8.0 size=78824 2024-09-12T00:30:55.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.529+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=LG1OYGO1SCU8 tag=O5KNXOG2QE0F type=write size=1127400 2024-09-12T00:30:55.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.531+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=NNBGVIZKKN3E type=del 2024-09-12T00:30:55.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.532+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=BB8IU5VFP2TW type=del size=1570287 2024-09-12T00:30:55.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.533+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~VO1ECKBI5T6K.0 size=1048576 2024-09-12T00:30:55.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.534+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~VO1ECKBI5T6K.1 size=1048576 2024-09-12T00:30:55.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.535+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~VO1ECKBI5T6K.2 size=723316 2024-09-12T00:30:55.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.538+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=VO1ECKBI5T6K tag=JI84XJ2UTT86 type=write size=3869044 2024-09-12T00:30:55.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.540+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~OL3OJPQV00BP.0 size=1048576 2024-09-12T00:30:55.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.542+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~OL3OJPQV00BP.1 size=215728 2024-09-12T00:30:55.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.542+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=OL3OJPQV00BP tag=8WIHD2WZJ4TL type=write size=2312880 2024-09-12T00:30:55.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.543+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~8QEY9JDO2TO3.0 size=1048576 2024-09-12T00:30:55.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.544+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~8QEY9JDO2TO3.1 size=1048576 2024-09-12T00:30:55.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.545+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~8QEY9JDO2TO3.2 size=13960 2024-09-12T00:30:55.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.548+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=8QEY9JDO2TO3 tag=84S1O2PIPVAS type=write size=3159688 2024-09-12T00:30:55.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.549+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=T76WZBQIK4S2 type=del size=1293595 2024-09-12T00:30:55.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.552+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~P5V8JQB6QB3L.0 size=584342 2024-09-12T00:30:55.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.554+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=P5V8JQB6QB3L tag=D357CF629XTQ type=write size=1632918 2024-09-12T00:30:55.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.557+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~9JG2SBER155X.0 size=1048576 2024-09-12T00:30:55.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.559+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~9JG2SBER155X.1 size=596299 2024-09-12T00:30:55.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.559+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=9JG2SBER155X tag=CN0RRFOED5AD type=write size=2693451 2024-09-12T00:30:55.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.560+0000 7f0362c73780 1 < completed write operation key=1SE6WTQMW6JU tag=GVWYLJ7K0DTP type=write size=218351 2024-09-12T00:30:55.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.562+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=3NY1NPUO0F6H type=del size=3387293 2024-09-12T00:30:55.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.563+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=1QHQ9JIU4725 type=del 2024-09-12T00:30:55.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.565+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=W2TPNS6KEI1Z type=del size=794569 2024-09-12T00:30:55.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.566+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~4P93F11BY7IB.0 size=1048576 2024-09-12T00:30:55.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.566+0000 7f0362c73780 1 < canceled part key=_multipart_X4ZML0796M7F.2~4P93F11BY7IB.1 size=995670 2024-09-12T00:30:55.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.569+0000 7f0362c73780 1 < canceled multipart upload key=X4ZML0796M7F upload=4P93F11BY7IB tag=OLCQZD3L0SDH type=write size=3092822 2024-09-12T00:30:55.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.572+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~P2RVZF3A9E9N.0 size=189690 2024-09-12T00:30:55.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.572+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=P2RVZF3A9E9N tag=EJD60I3Y9APP type=write size=1238266 2024-09-12T00:30:55.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.574+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~302CG93JR8CX.0 size=1048576 2024-09-12T00:30:55.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.575+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~302CG93JR8CX.1 size=1048576 2024-09-12T00:30:55.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.576+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~302CG93JR8CX.2 size=814856 2024-09-12T00:30:55.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.579+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=302CG93JR8CX tag=CUABU40K7FIJ type=write size=3960584 2024-09-12T00:30:55.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.581+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~2KZZPUDENJNQ.0 size=69838 2024-09-12T00:30:55.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.581+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=2KZZPUDENJNQ tag=328I4UYOJMQ4 type=write size=1118414 2024-09-12T00:30:55.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.583+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=BRHLUBL1298F type=del 2024-09-12T00:30:55.584 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.586+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~80MS49MPVRUB.0 size=1048576 2024-09-12T00:30:55.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.587+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~80MS49MPVRUB.1 size=993529 2024-09-12T00:30:55.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.587+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=80MS49MPVRUB tag=DOYH4XX41MA3 type=write size=3090681 2024-09-12T00:30:55.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.588+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~QJ5NHUNO38KI.0 size=1048576 2024-09-12T00:30:55.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.590+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~QJ5NHUNO38KI.1 size=866779 2024-09-12T00:30:55.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.592+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=QJ5NHUNO38KI tag=O2UI5LBO06JP type=write size=2963931 2024-09-12T00:30:55.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.593+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=L0C9TIBKNSBN type=del size=789534 2024-09-12T00:30:55.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.595+0000 7f0362c73780 1 < completed write operation key=44YJP6XPIFT5 tag=VOFBZLUICFE6 type=write size=904627 2024-09-12T00:30:55.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.596+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=ZP615DT4BS9Q type=del size=2654948 2024-09-12T00:30:55.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.598+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=7HACD0Q4HU2H type=del 2024-09-12T00:30:55.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.601+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~73OFFOVLX9PG.0 size=1048576 2024-09-12T00:30:55.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.602+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~73OFFOVLX9PG.1 size=1048576 2024-09-12T00:30:55.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.603+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~73OFFOVLX9PG.2 size=938388 2024-09-12T00:30:55.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.603+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=73OFFOVLX9PG tag=V81J51ILZEJF type=write size=4084116 2024-09-12T00:30:55.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.605+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=CU3013IOA7P6 type=del 2024-09-12T00:30:55.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.606+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=M3N4E0AWG3N5 type=del size=1360839 2024-09-12T00:30:55.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.608+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~2PUS49XFK4JX.0 size=1048576 2024-09-12T00:30:55.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.609+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~2PUS49XFK4JX.1 size=1048576 2024-09-12T00:30:55.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.610+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~2PUS49XFK4JX.2 size=576270 2024-09-12T00:30:55.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.613+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=2PUS49XFK4JX tag=THTB1B0X27J1 type=write size=3721998 2024-09-12T00:30:55.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.614+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=M6MMQLZBBVLJ type=write size=568253 2024-09-12T00:30:55.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.616+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=EIBTT9Q9LZWZ type=del 2024-09-12T00:30:55.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.617+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=PP37JRCC45P6 type=del size=4029266 2024-09-12T00:30:55.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.619+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~LG1OYGO1SCU8.0 size=78824 2024-09-12T00:30:55.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.621+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=LG1OYGO1SCU8 tag=O5KNXOG2QE0F type=write size=1127400 2024-09-12T00:30:55.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.622+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=DWZL2R2GQT3X type=del size=4098366 2024-09-12T00:30:55.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.624+0000 7f0362c73780 1 < completed delete operation key=PLAYMR18X9DZ tag=BB8IU5VFP2TW type=del 2024-09-12T00:30:55.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.625+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=SNVWVU5NU206 type=del size=3848445 2024-09-12T00:30:55.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.627+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~OL3OJPQV00BP.0 size=1048576 2024-09-12T00:30:55.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.629+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~OL3OJPQV00BP.1 size=215728 2024-09-12T00:30:55.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.631+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=OL3OJPQV00BP tag=8WIHD2WZJ4TL type=write size=2312880 2024-09-12T00:30:55.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.633+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~IIEFJ8JXXALP.0 size=481112 2024-09-12T00:30:55.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.633+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=IIEFJ8JXXALP tag=IMGAAWLTS1OH type=write size=1529688 2024-09-12T00:30:55.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.635+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=T76WZBQIK4S2 type=del 2024-09-12T00:30:55.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.637+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~MNJFPVEB10FH.0 size=1026148 2024-09-12T00:30:55.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.637+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=MNJFPVEB10FH tag=IOK59INL5YRO type=write size=2074724 2024-09-12T00:30:55.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.639+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~9JG2SBER155X.0 size=1048576 2024-09-12T00:30:55.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.640+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~9JG2SBER155X.1 size=596299 2024-09-12T00:30:55.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.642+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=9JG2SBER155X tag=CN0RRFOED5AD type=write size=2693451 2024-09-12T00:30:55.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.643+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=QOEQGDXA913O type=del size=544146 2024-09-12T00:30:55.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.646+0000 7f0362c73780 1 < suggested update operation key=VD0LFCNLI1YI tag=3NY1NPUO0F6H type=del size=3387293 2024-09-12T00:30:55.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.649+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~JCR5S0GXAGTO.0 size=1048576 2024-09-12T00:30:55.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.650+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~JCR5S0GXAGTO.1 size=650227 2024-09-12T00:30:55.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.650+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=JCR5S0GXAGTO tag=JP1M707GUM4D type=write size=2747379 2024-09-12T00:30:55.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.651+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=W2TPNS6KEI1Z type=del 2024-09-12T00:30:55.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.654+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~JQPUCDW5L2PD.0 size=1048576 2024-09-12T00:30:55.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.655+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~JQPUCDW5L2PD.1 size=159806 2024-09-12T00:30:55.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.655+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=JQPUCDW5L2PD tag=JJHPCZHLD1UM type=write size=2256958 2024-09-12T00:30:55.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.657+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~P2RVZF3A9E9N.0 size=189690 2024-09-12T00:30:55.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.659+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=P2RVZF3A9E9N tag=EJD60I3Y9APP type=write size=1238266 2024-09-12T00:30:55.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.660+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=U12XYHCKZXPT type=del size=3985366 2024-09-12T00:30:55.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.662+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~2KZZPUDENJNQ.0 size=69838 2024-09-12T00:30:55.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.664+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=2KZZPUDENJNQ tag=328I4UYOJMQ4 type=write size=1118414 2024-09-12T00:30:55.664 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.665+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=V2BX5ED62BFT type=del size=3230585 2024-09-12T00:30:55.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.667+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~80MS49MPVRUB.0 size=1048576 2024-09-12T00:30:55.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.668+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~80MS49MPVRUB.1 size=993529 2024-09-12T00:30:55.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.671+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=80MS49MPVRUB tag=DOYH4XX41MA3 type=write size=3090681 2024-09-12T00:30:55.670 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.672+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=2U6BT1KLULXX type=write size=695507 2024-09-12T00:30:55.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.674+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=L0C9TIBKNSBN type=del 2024-09-12T00:30:55.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.676+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~G0VH7Z23IM4E.0 size=1048576 2024-09-12T00:30:55.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.677+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~G0VH7Z23IM4E.1 size=543051 2024-09-12T00:30:55.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.677+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=G0VH7Z23IM4E tag=DSL8JXZFFMRP type=write size=2640203 2024-09-12T00:30:55.677 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.679+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=ZP615DT4BS9Q type=del 2024-09-12T00:30:55.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.680+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=7DMCHD5DH0RU type=del size=3997187 2024-09-12T00:30:55.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.683+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~73OFFOVLX9PG.0 size=1048576 2024-09-12T00:30:55.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.684+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~73OFFOVLX9PG.1 size=1048576 2024-09-12T00:30:55.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.685+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~73OFFOVLX9PG.2 size=938388 2024-09-12T00:30:55.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.687+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=73OFFOVLX9PG tag=V81J51ILZEJF type=write size=4084116 2024-09-12T00:30:55.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.689+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=3K5NNK5KJI5Z type=write size=606552 2024-09-12T00:30:55.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.690+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=M3N4E0AWG3N5 type=del 2024-09-12T00:30:55.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.693+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~O7O66WPD4U9J.0 size=1048576 2024-09-12T00:30:55.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.694+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~O7O66WPD4U9J.1 size=269979 2024-09-12T00:30:55.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.694+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=O7O66WPD4U9J tag=LEVKKT5DGKXD type=write size=2367131 2024-09-12T00:30:55.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.696+0000 7f0362c73780 1 < completed write operation key=1UUNRPUKAINC tag=M6MMQLZBBVLJ type=write size=568253 2024-09-12T00:30:55.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.698+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~08IMRMTR3KEV.0 size=1048576 2024-09-12T00:30:55.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.700+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~08IMRMTR3KEV.1 size=122922 2024-09-12T00:30:55.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.700+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=08IMRMTR3KEV tag=1I8XALLM0VZK type=write size=2220074 2024-09-12T00:30:55.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.701+0000 7f0362c73780 1 < completed delete operation key=PLAYMR18X9DZ tag=PP37JRCC45P6 type=del 2024-09-12T00:30:55.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.703+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=2JEBLDF640BU type=del size=593062 2024-09-12T00:30:55.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.704+0000 7f0362c73780 -1 < failed to complete operation key=VD0LFCNLI1YI tag=DWZL2R2GQT3X type=del size=4098366: (22) Invalid argument 2024-09-12T00:30:55.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.707+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~QH2WMC7PWR7R.0 size=965085 2024-09-12T00:30:55.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.707+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=QH2WMC7PWR7R tag=27TW8HNVCFCP type=write size=2013661 2024-09-12T00:30:55.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.710+0000 7f0362c73780 1 < suggested update operation key=CZHT9UQS34JU tag=SNVWVU5NU206 type=del size=3848445 2024-09-12T00:30:55.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.711+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=7ROQYQT0PYAI type=del size=460901 2024-09-12T00:30:55.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.712+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~IIEFJ8JXXALP.0 size=481112 2024-09-12T00:30:55.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.714+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=IIEFJ8JXXALP tag=IMGAAWLTS1OH type=write size=1529688 2024-09-12T00:30:55.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.717+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~PW3XMA44KJY8.0 size=41082 2024-09-12T00:30:55.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.717+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=PW3XMA44KJY8 tag=07Q4H7YMDAEZ type=write size=1089658 2024-09-12T00:30:55.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.718+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~MNJFPVEB10FH.0 size=1026148 2024-09-12T00:30:55.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.720+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=MNJFPVEB10FH tag=IOK59INL5YRO type=write size=2074724 2024-09-12T00:30:55.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.723+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~ZXPSHNN0GEVM.0 size=1048576 2024-09-12T00:30:55.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.724+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~ZXPSHNN0GEVM.1 size=292542 2024-09-12T00:30:55.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.724+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=ZXPSHNN0GEVM tag=CVKWAB6VYWXC type=write size=2389694 2024-09-12T00:30:55.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.725+0000 7f0362c73780 -1 < failed to complete operation key=VD0LFCNLI1YI tag=QOEQGDXA913O type=del size=544146: (22) Invalid argument 2024-09-12T00:30:55.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.728+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~F4A08M2LJ10R.0 size=431278 2024-09-12T00:30:55.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.728+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=F4A08M2LJ10R tag=IIQFI9V5R4HM type=write size=1479854 2024-09-12T00:30:55.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.729+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~JCR5S0GXAGTO.0 size=1048576 2024-09-12T00:30:55.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.730+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~JCR5S0GXAGTO.1 size=650227 2024-09-12T00:30:55.731 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.732+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=JCR5S0GXAGTO tag=JP1M707GUM4D type=write size=2747379 2024-09-12T00:30:55.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.735+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~G3DSU9PLLHUA.0 size=1048576 2024-09-12T00:30:55.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.736+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~G3DSU9PLLHUA.1 size=1048576 2024-09-12T00:30:55.736 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.737+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~G3DSU9PLLHUA.2 size=379753 2024-09-12T00:30:55.736 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.737+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=G3DSU9PLLHUA tag=CFIY85SMXXTJ type=write size=3525481 2024-09-12T00:30:55.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.739+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~JQPUCDW5L2PD.0 size=1048576 2024-09-12T00:30:55.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.740+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~JQPUCDW5L2PD.1 size=159806 2024-09-12T00:30:55.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.742+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=JQPUCDW5L2PD tag=JJHPCZHLD1UM type=write size=2256958 2024-09-12T00:30:55.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.743+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=NYC5FM67KEFX type=del size=1077773 2024-09-12T00:30:55.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.745+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=U12XYHCKZXPT type=del 2024-09-12T00:30:55.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.747+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~0T4LMDSKU5OD.0 size=1048576 2024-09-12T00:30:55.747 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.749+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~0T4LMDSKU5OD.1 size=465452 2024-09-12T00:30:55.747 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.749+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=0T4LMDSKU5OD tag=EY22032XXK7D type=write size=2562604 2024-09-12T00:30:55.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.750+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=V2BX5ED62BFT type=del 2024-09-12T00:30:55.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.753+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~4CDKIFIJUYHS.0 size=1048576 2024-09-12T00:30:55.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.754+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~4CDKIFIJUYHS.1 size=1024907 2024-09-12T00:30:55.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.754+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=4CDKIFIJUYHS tag=W29SM0MVXVU8 type=write size=3122059 2024-09-12T00:30:55.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.755+0000 7f0362c73780 1 < completed write operation key=2DHHPBYV80O8 tag=2U6BT1KLULXX type=write size=695507 2024-09-12T00:30:55.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.757+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=WP6N5JV6D9WA type=del size=3398969 2024-09-12T00:30:55.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.759+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~G0VH7Z23IM4E.0 size=1048576 2024-09-12T00:30:55.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.760+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~G0VH7Z23IM4E.1 size=543051 2024-09-12T00:30:55.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.763+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=G0VH7Z23IM4E tag=DSL8JXZFFMRP type=write size=2640203 2024-09-12T00:30:55.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.765+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=UEVAL6D8AQZB type=del size=1006474 2024-09-12T00:30:55.766 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.768+0000 7f0362c73780 1 < suggested update operation key=XR8L0HL374VC tag=7DMCHD5DH0RU type=del size=3997187 2024-09-12T00:30:55.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.769+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=9214TB4P2YDR type=del size=3552815 2024-09-12T00:30:55.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.770+0000 7f0362c73780 1 < completed write operation key=1IPW8SJ6SSU2 tag=3K5NNK5KJI5Z type=write size=606552 2024-09-12T00:30:55.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.772+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=Y1BHXCODXL53 type=del size=3218271 2024-09-12T00:30:55.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.773+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~O7O66WPD4U9J.0 size=1048576 2024-09-12T00:30:55.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.775+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~O7O66WPD4U9J.1 size=269979 2024-09-12T00:30:55.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.777+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=O7O66WPD4U9J tag=LEVKKT5DGKXD type=write size=2367131 2024-09-12T00:30:55.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.781+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~UR0A2UIXG0XT.0 size=287770 2024-09-12T00:30:55.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.781+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=UR0A2UIXG0XT tag=VKALTJSDG4V0 type=write size=1336346 2024-09-12T00:30:55.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.782+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~08IMRMTR3KEV.0 size=1048576 2024-09-12T00:30:55.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.784+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~08IMRMTR3KEV.1 size=122922 2024-09-12T00:30:55.784 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.786+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=08IMRMTR3KEV tag=1I8XALLM0VZK type=write size=2220074 2024-09-12T00:30:55.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.789+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~5NE39V5CJ0M4.0 size=1048576 2024-09-12T00:30:55.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.790+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~5NE39V5CJ0M4.1 size=1048576 2024-09-12T00:30:55.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.791+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~5NE39V5CJ0M4.2 size=371920 2024-09-12T00:30:55.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.791+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=5NE39V5CJ0M4 tag=E07H3JU7X6TT type=write size=3517648 2024-09-12T00:30:55.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.792+0000 7f0362c73780 1 < canceled operation key=1SE6WTQMW6JU tag=2JEBLDF640BU type=del size=593062 2024-09-12T00:30:55.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.794+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=VKCL9D7CCL01 type=del size=598004 2024-09-12T00:30:55.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.795+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~QH2WMC7PWR7R.0 size=965085 2024-09-12T00:30:55.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.798+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=QH2WMC7PWR7R tag=27TW8HNVCFCP type=write size=2013661 2024-09-12T00:30:55.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.800+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~NYPFF16538EL.0 size=1048576 2024-09-12T00:30:55.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.802+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~NYPFF16538EL.1 size=161792 2024-09-12T00:30:55.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.802+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=NYPFF16538EL tag=0T7BCOB5UFZK type=write size=2258944 2024-09-12T00:30:55.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.804+0000 7f0362c73780 1 < suggested update operation key=X4ZML0796M7F tag=7ROQYQT0PYAI type=del size=460901 2024-09-12T00:30:55.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.806+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=TNI6EEFRTH46 type=del size=2736501 2024-09-12T00:30:55.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.806+0000 7f0362c73780 1 < canceled part key=_multipart_XWW3882YBHAJ.2~PW3XMA44KJY8.0 size=41082 2024-09-12T00:30:55.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.808+0000 7f0362c73780 1 < canceled multipart upload key=XWW3882YBHAJ upload=PW3XMA44KJY8 tag=07Q4H7YMDAEZ type=write size=1089658 2024-09-12T00:30:55.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.810+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=E1S88HXJYCIB type=del size=1249380 2024-09-12T00:30:55.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.811+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~ZXPSHNN0GEVM.0 size=1048576 2024-09-12T00:30:55.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.812+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~ZXPSHNN0GEVM.1 size=292542 2024-09-12T00:30:55.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.814+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=ZXPSHNN0GEVM tag=CVKWAB6VYWXC type=write size=2389694 2024-09-12T00:30:55.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.816+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=FA62RNKY0Y3L type=del size=3828218 2024-09-12T00:30:55.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.816+0000 7f0362c73780 1 < canceled part key=_multipart_1IPW8SJ6SSU2.2~F4A08M2LJ10R.0 size=431278 2024-09-12T00:30:55.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.819+0000 7f0362c73780 1 < canceled multipart upload key=1IPW8SJ6SSU2 upload=F4A08M2LJ10R tag=IIQFI9V5R4HM type=write size=1479854 2024-09-12T00:30:55.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.820+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=MMSCPNO4ZS5R type=del size=1931649 2024-09-12T00:30:55.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.822+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~G3DSU9PLLHUA.0 size=1048576 2024-09-12T00:30:55.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.823+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~G3DSU9PLLHUA.1 size=1048576 2024-09-12T00:30:55.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.824+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~G3DSU9PLLHUA.2 size=379753 2024-09-12T00:30:55.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.827+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=G3DSU9PLLHUA tag=CFIY85SMXXTJ type=write size=3525481 2024-09-12T00:30:55.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.829+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=PQOUSMJM0C24 type=del size=2865158 2024-09-12T00:30:55.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.830+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=NYC5FM67KEFX type=del 2024-09-12T00:30:55.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.832+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=NC94M2D0NKIH type=del size=969369 2024-09-12T00:30:55.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.834+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~0T4LMDSKU5OD.0 size=1048576 2024-09-12T00:30:55.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.835+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~0T4LMDSKU5OD.1 size=465452 2024-09-12T00:30:55.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.838+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=0T4LMDSKU5OD tag=EY22032XXK7D type=write size=2562604 2024-09-12T00:30:55.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.841+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~OE4HRM5GVB71.0 size=1048576 2024-09-12T00:30:55.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.842+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~OE4HRM5GVB71.1 size=1048576 2024-09-12T00:30:55.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.843+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~OE4HRM5GVB71.2 size=671201 2024-09-12T00:30:55.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.843+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=OE4HRM5GVB71 tag=CBJRX02ABANH type=write size=3816929 2024-09-12T00:30:55.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.844+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~4CDKIFIJUYHS.0 size=1048576 2024-09-12T00:30:55.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.844+0000 7f0362c73780 1 < canceled part key=_multipart_PLAYMR18X9DZ.2~4CDKIFIJUYHS.1 size=1024907 2024-09-12T00:30:55.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.847+0000 7f0362c73780 1 < canceled multipart upload key=PLAYMR18X9DZ upload=4CDKIFIJUYHS tag=W29SM0MVXVU8 type=write size=3122059 2024-09-12T00:30:55.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.850+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~OPJNHG5PI0PU.0 size=1048576 2024-09-12T00:30:55.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.851+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~OPJNHG5PI0PU.1 size=762233 2024-09-12T00:30:55.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.851+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=OPJNHG5PI0PU tag=YAJ2XG67OJ42 type=write size=2859385 2024-09-12T00:30:55.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.852+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=WP6N5JV6D9WA type=del 2024-09-12T00:30:55.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.854+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=KLWWCKW0AOU2 type=del size=3995752 2024-09-12T00:30:55.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.857+0000 7f0362c73780 1 < suggested update operation key=EHBOL435W9ZE tag=UEVAL6D8AQZB type=del size=1006474 2024-09-12T00:30:55.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.859+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~0YM2NM0SFBDQ.0 size=1048576 2024-09-12T00:30:55.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.860+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~0YM2NM0SFBDQ.1 size=1048576 2024-09-12T00:30:55.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.862+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~0YM2NM0SFBDQ.2 size=348960 2024-09-12T00:30:55.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.862+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=0YM2NM0SFBDQ tag=8M95QK7YDEPX type=write size=3494688 2024-09-12T00:30:55.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.865+0000 7f0362c73780 1 < suggested remove operation key=3XZZX53L26G5 tag=9214TB4P2YDR type=del 2024-09-12T00:30:55.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.868+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~D79ZL9JVRD0I.0 size=1048576 2024-09-12T00:30:55.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.869+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~D79ZL9JVRD0I.1 size=631016 2024-09-12T00:30:55.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.869+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=D79ZL9JVRD0I tag=HHXWVBYU5WMS type=write size=2728168 2024-09-12T00:30:55.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.870+0000 7f0362c73780 -1 < failed to complete operation key=EHBOL435W9ZE tag=Y1BHXCODXL53 type=del size=3218271: (22) Invalid argument 2024-09-12T00:30:55.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.873+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~LP6O1MDN2DLQ.0 size=1048576 2024-09-12T00:30:55.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.875+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~LP6O1MDN2DLQ.1 size=167572 2024-09-12T00:30:55.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.875+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=LP6O1MDN2DLQ tag=UM95Q0N9H2AR type=write size=2264724 2024-09-12T00:30:55.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.876+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~UR0A2UIXG0XT.0 size=287770 2024-09-12T00:30:55.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.879+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=UR0A2UIXG0XT tag=VKALTJSDG4V0 type=write size=1336346 2024-09-12T00:30:55.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.881+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~LT4DLFUFUKTV.0 size=1048576 2024-09-12T00:30:55.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.882+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~LT4DLFUFUKTV.1 size=1048576 2024-09-12T00:30:55.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.883+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~LT4DLFUFUKTV.2 size=29003 2024-09-12T00:30:55.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.883+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=LT4DLFUFUKTV tag=ZKIPL50FAUTI type=write size=3174731 2024-09-12T00:30:55.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.885+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~5NE39V5CJ0M4.0 size=1048576 2024-09-12T00:30:55.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.886+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~5NE39V5CJ0M4.1 size=1048576 2024-09-12T00:30:55.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.888+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~5NE39V5CJ0M4.2 size=371920 2024-09-12T00:30:55.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.890+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=5NE39V5CJ0M4 tag=E07H3JU7X6TT type=write size=3517648 2024-09-12T00:30:55.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.893+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~RT5L8TDQKQ4P.0 size=1048576 2024-09-12T00:30:55.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.894+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~RT5L8TDQKQ4P.1 size=1048576 2024-09-12T00:30:55.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.896+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~RT5L8TDQKQ4P.2 size=903208 2024-09-12T00:30:55.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.896+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=RT5L8TDQKQ4P tag=TLHX4PXWN23K type=write size=4048936 2024-09-12T00:30:55.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.898+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=VKCL9D7CCL01 type=del 2024-09-12T00:30:55.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.900+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~D2VFMTLRLD8H.0 size=1048576 2024-09-12T00:30:55.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.902+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~D2VFMTLRLD8H.1 size=1048576 2024-09-12T00:30:55.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.903+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~D2VFMTLRLD8H.2 size=144481 2024-09-12T00:30:55.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.903+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=D2VFMTLRLD8H tag=36OUQ0LFEO6C type=write size=3290209 2024-09-12T00:30:55.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.904+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~NYPFF16538EL.0 size=1048576 2024-09-12T00:30:55.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.905+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~NYPFF16538EL.1 size=161792 2024-09-12T00:30:55.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.907+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=NYPFF16538EL tag=0T7BCOB5UFZK type=write size=2258944 2024-09-12T00:30:55.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.910+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~K2N80MBXMZ19.0 size=713142 2024-09-12T00:30:55.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.910+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=K2N80MBXMZ19 tag=KFTSNZCT9CW1 type=write size=1761718 2024-09-12T00:30:55.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.912+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=TNI6EEFRTH46 type=del 2024-09-12T00:30:55.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.914+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~QS1FNGYVQQ3J.0 size=829226 2024-09-12T00:30:55.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.914+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=QS1FNGYVQQ3J tag=8ZFVUVHEACBT type=write size=1877802 2024-09-12T00:30:55.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.916+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=E1S88HXJYCIB type=del 2024-09-12T00:30:55.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.917+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=KG4V42K1RQHI type=del size=460545 2024-09-12T00:30:55.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.919+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=FA62RNKY0Y3L type=del 2024-09-12T00:30:55.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.920+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=3HKWBA2VRFEX type=del size=3964432 2024-09-12T00:30:55.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.922+0000 7f0362c73780 -1 < failed to complete operation key=EHBOL435W9ZE tag=MMSCPNO4ZS5R type=del size=1931649: (22) Invalid argument 2024-09-12T00:30:55.922 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.924+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=1IM10C83Z0WJ type=del size=3244025 2024-09-12T00:30:55.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.925+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=PQOUSMJM0C24 type=del 2024-09-12T00:30:55.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.927+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=H9F56EV0Y9LM type=write size=507620 2024-09-12T00:30:55.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.930+0000 7f0362c73780 1 < suggested update operation key=G2HW98G6624O tag=NC94M2D0NKIH type=del size=969369 2024-09-12T00:30:55.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.932+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~SB5WVLY6DZCO.0 size=1048576 2024-09-12T00:30:55.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.933+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~SB5WVLY6DZCO.1 size=978161 2024-09-12T00:30:55.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.934+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=SB5WVLY6DZCO tag=UIO2MV7SAXGF type=write size=3075313 2024-09-12T00:30:55.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.934+0000 7f0362c73780 1 < canceled part key=_multipart_1MLL1T362X51.2~OE4HRM5GVB71.0 size=1048576 2024-09-12T00:30:55.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.935+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~OE4HRM5GVB71.1 size=1048576 2024-09-12T00:30:55.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.936+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~OE4HRM5GVB71.2 size=671201 2024-09-12T00:30:55.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.939+0000 7f0362c73780 1 < canceled multipart upload key=1MLL1T362X51 upload=OE4HRM5GVB71 tag=CBJRX02ABANH type=write size=3816929 2024-09-12T00:30:55.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.940+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=MTUNHG4713W7 type=del size=1874848 2024-09-12T00:30:55.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.941+0000 7f0362c73780 1 < canceled part key=_multipart_G2HW98G6624O.2~OPJNHG5PI0PU.0 size=1048576 2024-09-12T00:30:55.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.942+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~OPJNHG5PI0PU.1 size=762233 2024-09-12T00:30:55.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.944+0000 7f0362c73780 1 < canceled multipart upload key=G2HW98G6624O upload=OPJNHG5PI0PU tag=YAJ2XG67OJ42 type=write size=2859385 2024-09-12T00:30:55.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.947+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~UYKQV8KN9YI5.0 size=567431 2024-09-12T00:30:55.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.947+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=UYKQV8KN9YI5 tag=TI5CIR45OTU6 type=write size=1616007 2024-09-12T00:30:55.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.948+0000 7f0362c73780 -1 < failed to complete operation key=EHBOL435W9ZE tag=KLWWCKW0AOU2 type=del size=3995752: (22) Invalid argument 2024-09-12T00:30:55.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.951+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~FTJ9YKN2K71P.0 size=1048576 2024-09-12T00:30:55.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.952+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~FTJ9YKN2K71P.1 size=6763 2024-09-12T00:30:55.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.952+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=FTJ9YKN2K71P tag=CM4BRHIO6F7P type=write size=2103915 2024-09-12T00:30:55.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.953+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~0YM2NM0SFBDQ.0 size=1048576 2024-09-12T00:30:55.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.954+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~0YM2NM0SFBDQ.1 size=1048576 2024-09-12T00:30:55.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.955+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~0YM2NM0SFBDQ.2 size=348960 2024-09-12T00:30:55.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.958+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=0YM2NM0SFBDQ tag=8M95QK7YDEPX type=write size=3494688 2024-09-12T00:30:55.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.959+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=VT21WSYCVWEA type=del size=3253275 2024-09-12T00:30:55.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.960+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~D79ZL9JVRD0I.0 size=1048576 2024-09-12T00:30:55.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.960+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~D79ZL9JVRD0I.1 size=631016 2024-09-12T00:30:55.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.963+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=D79ZL9JVRD0I tag=HHXWVBYU5WMS type=write size=2728168 2024-09-12T00:30:55.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.964+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=4K8SLRJC3M31 type=del size=42286 2024-09-12T00:30:55.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.965+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~LP6O1MDN2DLQ.0 size=1048576 2024-09-12T00:30:55.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.967+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~LP6O1MDN2DLQ.1 size=167572 2024-09-12T00:30:55.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.969+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=LP6O1MDN2DLQ tag=UM95Q0N9H2AR type=write size=2264724 2024-09-12T00:30:55.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.971+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~QO1NJ0OB2RT3.0 size=690227 2024-09-12T00:30:55.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.971+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=QO1NJ0OB2RT3 tag=QOCH6FCY0ERL type=write size=1738803 2024-09-12T00:30:55.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.973+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~LT4DLFUFUKTV.0 size=1048576 2024-09-12T00:30:55.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.974+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~LT4DLFUFUKTV.1 size=1048576 2024-09-12T00:30:55.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.975+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~LT4DLFUFUKTV.2 size=29003 2024-09-12T00:30:55.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.977+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=LT4DLFUFUKTV tag=ZKIPL50FAUTI type=write size=3174731 2024-09-12T00:30:55.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.980+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~OH7Q0IUKCFAM.0 size=1048576 2024-09-12T00:30:55.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.981+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~OH7Q0IUKCFAM.1 size=1048576 2024-09-12T00:30:55.981 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.982+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~OH7Q0IUKCFAM.2 size=200979 2024-09-12T00:30:55.981 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.982+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=OH7Q0IUKCFAM tag=2NLPGI9ZEEA8 type=write size=3346707 2024-09-12T00:30:55.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.984+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~RT5L8TDQKQ4P.0 size=1048576 2024-09-12T00:30:55.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.985+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~RT5L8TDQKQ4P.1 size=1048576 2024-09-12T00:30:55.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.986+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~RT5L8TDQKQ4P.2 size=903208 2024-09-12T00:30:55.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.989+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=RT5L8TDQKQ4P tag=TLHX4PXWN23K type=write size=4048936 2024-09-12T00:30:55.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.990+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=L921MQN55J78 type=del size=3030650 2024-09-12T00:30:55.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.992+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~D2VFMTLRLD8H.0 size=1048576 2024-09-12T00:30:55.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.993+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~D2VFMTLRLD8H.1 size=1048576 2024-09-12T00:30:55.993 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.994+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~D2VFMTLRLD8H.2 size=144481 2024-09-12T00:30:55.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.997+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=D2VFMTLRLD8H tag=36OUQ0LFEO6C type=write size=3290209 2024-09-12T00:30:55.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:55.998+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=IEOGT4NRKIO3 type=del size=2420423 2024-09-12T00:30:55.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.000+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~K2N80MBXMZ19.0 size=713142 2024-09-12T00:30:56.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.002+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=K2N80MBXMZ19 tag=KFTSNZCT9CW1 type=write size=1761718 2024-09-12T00:30:56.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.005+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~PX1521NEQIRO.0 size=450262 2024-09-12T00:30:56.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.005+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=PX1521NEQIRO tag=BCI0FHS26PJT type=write size=1498838 2024-09-12T00:30:56.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.007+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~QS1FNGYVQQ3J.0 size=829226 2024-09-12T00:30:56.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.009+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=QS1FNGYVQQ3J tag=8ZFVUVHEACBT type=write size=1877802 2024-09-12T00:30:56.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.012+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~3IPP56JD5S5J.0 size=1048576 2024-09-12T00:30:56.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.013+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~3IPP56JD5S5J.1 size=1048576 2024-09-12T00:30:56.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.014+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~3IPP56JD5S5J.2 size=684794 2024-09-12T00:30:56.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.014+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=3IPP56JD5S5J tag=5D065LPOD1VA type=write size=3830522 2024-09-12T00:30:56.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.016+0000 7f0362c73780 -1 < failed to complete operation key=G2HW98G6624O tag=KG4V42K1RQHI type=del size=460545: (22) Invalid argument 2024-09-12T00:30:56.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.017+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=0D70EF2J0CGM type=del size=1028559 2024-09-12T00:30:56.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.019+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=3HKWBA2VRFEX type=del 2024-09-12T00:30:56.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.020+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=5J41UFG1OTB0 type=write size=697038 2024-09-12T00:30:56.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.021+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=1IM10C83Z0WJ type=del 2024-09-12T00:30:56.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.024+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~TKOKG4SU70MQ.0 size=319737 2024-09-12T00:30:56.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.024+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=TKOKG4SU70MQ tag=21UBY743TQ59 type=write size=1368313 2024-09-12T00:30:56.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.028+0000 7f0362c73780 1 < suggested remove operation key=G2HW98G6624O tag=H9F56EV0Y9LM type=write 2024-09-12T00:30:56.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.030+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=0MCZMET8DDOG type=del size=555033 2024-09-12T00:30:56.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.031+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~SB5WVLY6DZCO.0 size=1048576 2024-09-12T00:30:56.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.034+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~SB5WVLY6DZCO.1 size=978161 2024-09-12T00:30:56.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.036+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=SB5WVLY6DZCO tag=UIO2MV7SAXGF type=write size=3075313 2024-09-12T00:30:56.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.038+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~XLXPTP8UK7DS.0 size=171122 2024-09-12T00:30:56.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.038+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=XLXPTP8UK7DS tag=I4ZXO3MDAKYB type=write size=1219698 2024-09-12T00:30:56.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.040+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=MTUNHG4713W7 type=del 2024-09-12T00:30:56.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.041+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=G4I6KF3KU3J3 type=del size=538756 2024-09-12T00:30:56.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.043+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~UYKQV8KN9YI5.0 size=567431 2024-09-12T00:30:56.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.045+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=UYKQV8KN9YI5 tag=TI5CIR45OTU6 type=write size=1616007 2024-09-12T00:30:56.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.047+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=I416CD725H17 type=write size=766366 2024-09-12T00:30:56.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.048+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~FTJ9YKN2K71P.0 size=1048576 2024-09-12T00:30:56.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.048+0000 7f0362c73780 1 < canceled part key=_multipart_1UUNRPUKAINC.2~FTJ9YKN2K71P.1 size=6763 2024-09-12T00:30:56.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.050+0000 7f0362c73780 1 < canceled multipart upload key=1UUNRPUKAINC upload=FTJ9YKN2K71P tag=CM4BRHIO6F7P type=write size=2103915 2024-09-12T00:30:56.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.052+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=LHSE2LW2F73G type=del size=1020756 2024-09-12T00:30:56.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.055+0000 7f0362c73780 1 < suggested remove operation key=OY30LP7FYXNF tag=VT21WSYCVWEA type=del 2024-09-12T00:30:56.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.056+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=9Z9Y5JU5PMVF type=del size=2297359 2024-09-12T00:30:56.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.058+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=4K8SLRJC3M31 type=del 2024-09-12T00:30:56.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.059+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=DMPJ66X7TSCJ type=write size=934115 2024-09-12T00:30:56.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.061+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~QO1NJ0OB2RT3.0 size=690227 2024-09-12T00:30:56.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.063+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=QO1NJ0OB2RT3 tag=QOCH6FCY0ERL type=write size=1738803 2024-09-12T00:30:56.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.064+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=OCRYAXE884EW type=write size=1036100 2024-09-12T00:30:56.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.066+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~OH7Q0IUKCFAM.0 size=1048576 2024-09-12T00:30:56.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.067+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~OH7Q0IUKCFAM.1 size=1048576 2024-09-12T00:30:56.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.068+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~OH7Q0IUKCFAM.2 size=200979 2024-09-12T00:30:56.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.070+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=OH7Q0IUKCFAM tag=2NLPGI9ZEEA8 type=write size=3346707 2024-09-12T00:30:56.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.072+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=KCJ3Y4WOVPLT type=write size=620478 2024-09-12T00:30:56.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.074+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=L921MQN55J78 type=del 2024-09-12T00:30:56.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.076+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=JL613DN7EHGS type=del size=632898 2024-09-12T00:30:56.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.079+0000 7f0362c73780 1 < suggested update operation key=3XZZX53L26G5 tag=IEOGT4NRKIO3 type=del size=2420423 2024-09-12T00:30:56.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.081+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=8DDRA9QHXP7Z type=write size=291347 2024-09-12T00:30:56.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.083+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~PX1521NEQIRO.0 size=450262 2024-09-12T00:30:56.083 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.085+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=PX1521NEQIRO tag=BCI0FHS26PJT type=write size=1498838 2024-09-12T00:30:56.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.087+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=DVQEM56EPHKY type=write size=44696 2024-09-12T00:30:56.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.088+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~3IPP56JD5S5J.0 size=1048576 2024-09-12T00:30:56.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.089+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~3IPP56JD5S5J.1 size=1048576 2024-09-12T00:30:56.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.091+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~3IPP56JD5S5J.2 size=684794 2024-09-12T00:30:56.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.093+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=3IPP56JD5S5J tag=5D065LPOD1VA type=write size=3830522 2024-09-12T00:30:56.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.095+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=X0M2SKBJ83GR type=write size=284645 2024-09-12T00:30:56.094 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.096+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=0D70EF2J0CGM type=del 2024-09-12T00:30:56.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.098+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=GHNMLP96I0PC type=write size=604598 2024-09-12T00:30:56.098 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.099+0000 7f0362c73780 1 < completed write operation key=KWDEKRO3WICD tag=5J41UFG1OTB0 type=write size=697038 2024-09-12T00:30:56.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.101+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=D2QG58ZFV0DF type=del size=2841093 2024-09-12T00:30:56.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.102+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~TKOKG4SU70MQ.0 size=319737 2024-09-12T00:30:56.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.105+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=TKOKG4SU70MQ tag=21UBY743TQ59 type=write size=1368313 2024-09-12T00:30:56.105 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.106+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=XOFFWFFPGNU9 type=write size=195540 2024-09-12T00:30:56.106 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.108+0000 7f0362c73780 1 < canceled operation key=2DHHPBYV80O8 tag=0MCZMET8DDOG type=del size=555033 2024-09-12T00:30:56.109 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.111+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~A0HFJ2O8LP2J.0 size=1048576 2024-09-12T00:30:56.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.112+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~A0HFJ2O8LP2J.1 size=1048576 2024-09-12T00:30:56.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.113+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~A0HFJ2O8LP2J.2 size=754031 2024-09-12T00:30:56.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.114+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=A0HFJ2O8LP2J tag=S4OGD0B18GG8 type=write size=3899759 2024-09-12T00:30:56.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.115+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~XLXPTP8UK7DS.0 size=171122 2024-09-12T00:30:56.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.118+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=XLXPTP8UK7DS tag=I4ZXO3MDAKYB type=write size=1219698 2024-09-12T00:30:56.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.120+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~ONHT6TXKUHGA.0 size=825522 2024-09-12T00:30:56.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.120+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=ONHT6TXKUHGA tag=QSNOM4ADOXYS type=write size=1874098 2024-09-12T00:30:56.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.122+0000 7f0362c73780 1 < canceled operation key=G4G6E7KTTZY9 tag=G4I6KF3KU3J3 type=del size=538756 2024-09-12T00:30:56.122 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.123+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=UPLL3QSV00XE type=del size=3685794 2024-09-12T00:30:56.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.125+0000 7f0362c73780 1 < completed write operation key=1MLL1T362X51 tag=I416CD725H17 type=write size=766366 2024-09-12T00:30:56.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.127+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~AKSCE0CK6LBF.0 size=1048576 2024-09-12T00:30:56.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.128+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~AKSCE0CK6LBF.1 size=356900 2024-09-12T00:30:56.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.128+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=AKSCE0CK6LBF tag=HT35EQROY535 type=write size=2454052 2024-09-12T00:30:56.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.130+0000 7f0362c73780 -1 < failed to complete operation key=3XZZX53L26G5 tag=LHSE2LW2F73G type=del size=1020756: (22) Invalid argument 2024-09-12T00:30:56.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.131+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=6OXS3QUN0QMU type=del size=3066846 2024-09-12T00:30:56.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.134+0000 7f0362c73780 1 < suggested update operation key=KWDEKRO3WICD tag=9Z9Y5JU5PMVF type=del size=2297359 2024-09-12T00:30:56.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.135+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=39EVDZVMLLUF type=del size=3351766 2024-09-12T00:30:56.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.137+0000 7f0362c73780 1 < completed write operation key=VD0LFCNLI1YI tag=DMPJ66X7TSCJ type=write size=934115 2024-09-12T00:30:56.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.140+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~0YGLY1SN1LRY.0 size=1048576 2024-09-12T00:30:56.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.141+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~0YGLY1SN1LRY.1 size=1048576 2024-09-12T00:30:56.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.142+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~0YGLY1SN1LRY.2 size=330793 2024-09-12T00:30:56.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.142+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=0YGLY1SN1LRY tag=1NMXW79BM9EY type=write size=3476521 2024-09-12T00:30:56.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.144+0000 7f0362c73780 1 < completed write operation key=44YJP6XPIFT5 tag=OCRYAXE884EW type=write size=1036100 2024-09-12T00:30:56.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.147+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~7Y3J0EVWIW89.0 size=1048576 2024-09-12T00:30:56.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.148+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~7Y3J0EVWIW89.1 size=1048576 2024-09-12T00:30:56.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.150+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~7Y3J0EVWIW89.2 size=616212 2024-09-12T00:30:56.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.150+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=7Y3J0EVWIW89 tag=DEKML7DI84OT type=write size=3761940 2024-09-12T00:30:56.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.151+0000 7f0362c73780 1 < canceled operation key=HWSQFSK29S0V tag=KCJ3Y4WOVPLT type=write size=620478 2024-09-12T00:30:56.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.153+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~24Q1QVXFDW2K.0 size=1048576 2024-09-12T00:30:56.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.154+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~24Q1QVXFDW2K.1 size=371016 2024-09-12T00:30:56.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.154+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=24Q1QVXFDW2K tag=CVQXBIW90YCB type=write size=2468168 2024-09-12T00:30:56.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.156+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=JL613DN7EHGS type=del 2024-09-12T00:30:56.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.157+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=0EGJYNOMXWWE type=del size=3206439 2024-09-12T00:30:56.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.159+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=8DDRA9QHXP7Z type=write size=291347 2024-09-12T00:30:56.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.160+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=XNERMQH732WK type=del size=1077913 2024-09-12T00:30:56.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.162+0000 7f0362c73780 1 < completed write operation key=I3B48QD9E40S tag=DVQEM56EPHKY type=write size=44696 2024-09-12T00:30:56.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.163+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=H1QSXBY3YXIA type=del size=112284 2024-09-12T00:30:56.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.165+0000 7f0362c73780 1 < canceled operation key=2DHHPBYV80O8 tag=X0M2SKBJ83GR type=write size=284645 2024-09-12T00:30:56.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.167+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~OO00LO3V1XA7.0 size=1048576 2024-09-12T00:30:56.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.169+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~OO00LO3V1XA7.1 size=60397 2024-09-12T00:30:56.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.169+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=OO00LO3V1XA7 tag=Y4S1HJ1DTZ1F type=write size=2157549 2024-09-12T00:30:56.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.171+0000 7f0362c73780 1 < completed write operation key=CZHT9UQS34JU tag=GHNMLP96I0PC type=write size=604598 2024-09-12T00:30:56.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.173+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=O6RU4GOPQIMC type=write size=211034 2024-09-12T00:30:56.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.174+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=D2QG58ZFV0DF type=del 2024-09-12T00:30:56.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.176+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=YD2QIK11P58I type=del size=3104058 2024-09-12T00:30:56.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.177+0000 7f0362c73780 1 < completed write operation key=CZHT9UQS34JU tag=XOFFWFFPGNU9 type=write size=195540 2024-09-12T00:30:56.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.180+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~JI532WLPFMCV.0 size=900770 2024-09-12T00:30:56.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.180+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=JI532WLPFMCV tag=CYCTML0ID490 type=write size=1949346 2024-09-12T00:30:56.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.181+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~A0HFJ2O8LP2J.0 size=1048576 2024-09-12T00:30:56.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.182+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~A0HFJ2O8LP2J.1 size=1048576 2024-09-12T00:30:56.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.184+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~A0HFJ2O8LP2J.2 size=754031 2024-09-12T00:30:56.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.186+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=A0HFJ2O8LP2J tag=S4OGD0B18GG8 type=write size=3899759 2024-09-12T00:30:56.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.189+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~1J049CQ2T8S7.0 size=1048576 2024-09-12T00:30:56.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.190+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~1J049CQ2T8S7.1 size=13550 2024-09-12T00:30:56.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.190+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=1J049CQ2T8S7 tag=ODSY1ND1AYBA type=write size=2110702 2024-09-12T00:30:56.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.191+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~ONHT6TXKUHGA.0 size=825522 2024-09-12T00:30:56.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.194+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=ONHT6TXKUHGA tag=QSNOM4ADOXYS type=write size=1874098 2024-09-12T00:30:56.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.195+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=W3TBXLWBFG5V type=del size=2122352 2024-09-12T00:30:56.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.197+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=UPLL3QSV00XE type=del 2024-09-12T00:30:56.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.198+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=WGN2U5JM0IU6 type=del size=1663176 2024-09-12T00:30:56.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.200+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~AKSCE0CK6LBF.0 size=1048576 2024-09-12T00:30:56.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.201+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~AKSCE0CK6LBF.1 size=356900 2024-09-12T00:30:56.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.203+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=AKSCE0CK6LBF tag=HT35EQROY535 type=write size=2454052 2024-09-12T00:30:56.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.205+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=5KCGN6MPZHEB type=del size=3644552 2024-09-12T00:30:56.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.206+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=6OXS3QUN0QMU type=del 2024-09-12T00:30:56.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.208+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=65BDW91Q9Z1V type=del size=3736865 2024-09-12T00:30:56.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.209+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=39EVDZVMLLUF type=del 2024-09-12T00:30:56.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.210+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=YICKGOJXHT0S type=write size=484291 2024-09-12T00:30:56.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.212+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~0YGLY1SN1LRY.0 size=1048576 2024-09-12T00:30:56.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.212+0000 7f0362c73780 1 < canceled part key=_multipart_XWW3882YBHAJ.2~0YGLY1SN1LRY.1 size=1048576 2024-09-12T00:30:56.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.213+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~0YGLY1SN1LRY.2 size=330793 2024-09-12T00:30:56.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.215+0000 7f0362c73780 1 < canceled multipart upload key=XWW3882YBHAJ upload=0YGLY1SN1LRY tag=1NMXW79BM9EY type=write size=3476521 2024-09-12T00:30:56.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.218+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~F2KNQHWKP569.0 size=644639 2024-09-12T00:30:56.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.218+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=F2KNQHWKP569 tag=NXTCBN2XCBWK type=write size=1693215 2024-09-12T00:30:56.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.219+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~7Y3J0EVWIW89.0 size=1048576 2024-09-12T00:30:56.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.221+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~7Y3J0EVWIW89.1 size=1048576 2024-09-12T00:30:56.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.222+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~7Y3J0EVWIW89.2 size=616212 2024-09-12T00:30:56.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.224+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=7Y3J0EVWIW89 tag=DEKML7DI84OT type=write size=3761940 2024-09-12T00:30:56.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.226+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=22G7EH371BL4 type=del size=3306809 2024-09-12T00:30:56.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.227+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~24Q1QVXFDW2K.0 size=1048576 2024-09-12T00:30:56.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.228+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~24Q1QVXFDW2K.1 size=371016 2024-09-12T00:30:56.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.231+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=24Q1QVXFDW2K tag=CVQXBIW90YCB type=write size=2468168 2024-09-12T00:30:56.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.232+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=WLG4RB04MG1D type=del size=534306 2024-09-12T00:30:56.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.234+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=0EGJYNOMXWWE type=del 2024-09-12T00:30:56.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.236+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~TQWHMDOEBKQJ.0 size=217947 2024-09-12T00:30:56.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.236+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=TQWHMDOEBKQJ tag=PUPB02WRDV3G type=write size=1266523 2024-09-12T00:30:56.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.239+0000 7f0362c73780 1 < suggested update operation key=927NCYXX8Z2P tag=XNERMQH732WK type=del size=1077913 2024-09-12T00:30:56.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.241+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~DVNMFA0HL9JA.0 size=1048576 2024-09-12T00:30:56.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.242+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~DVNMFA0HL9JA.1 size=1048576 2024-09-12T00:30:56.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.243+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~DVNMFA0HL9JA.2 size=597695 2024-09-12T00:30:56.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.243+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=DVNMFA0HL9JA tag=Z135KCW2L26X type=write size=3743423 2024-09-12T00:30:56.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.244+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=H1QSXBY3YXIA type=del 2024-09-12T00:30:56.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.246+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=Q09MBHLFIGPF type=write size=194088 2024-09-12T00:30:56.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.247+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~OO00LO3V1XA7.0 size=1048576 2024-09-12T00:30:56.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.248+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~OO00LO3V1XA7.1 size=60397 2024-09-12T00:30:56.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.250+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=OO00LO3V1XA7 tag=Y4S1HJ1DTZ1F type=write size=2157549 2024-09-12T00:30:56.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.252+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=AX93FWQJ73CC type=del size=3327746 2024-09-12T00:30:56.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.253+0000 7f0362c73780 1 < completed write operation key=X4ZML0796M7F tag=O6RU4GOPQIMC type=write size=211034 2024-09-12T00:30:56.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.255+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=TU2SRV3GX1MW type=del size=797572 2024-09-12T00:30:56.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.256+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=YD2QIK11P58I type=del 2024-09-12T00:30:56.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.259+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~WLGDFAKK9D8M.0 size=735721 2024-09-12T00:30:56.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.259+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=WLGDFAKK9D8M tag=P1FLTQU3ZK3P type=write size=1784297 2024-09-12T00:30:56.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.260+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~JI532WLPFMCV.0 size=900770 2024-09-12T00:30:56.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.263+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=JI532WLPFMCV tag=CYCTML0ID490 type=write size=1949346 2024-09-12T00:30:56.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.264+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=L6BIAIR0PZ19 type=del size=3500516 2024-09-12T00:30:56.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.266+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~1J049CQ2T8S7.0 size=1048576 2024-09-12T00:30:56.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.267+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~1J049CQ2T8S7.1 size=13550 2024-09-12T00:30:56.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.270+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=1J049CQ2T8S7 tag=ODSY1ND1AYBA type=write size=2110702 2024-09-12T00:30:56.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.271+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=WJD9Z6E8YGQ9 type=del size=79772 2024-09-12T00:30:56.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.273+0000 7f0362c73780 1 < canceled operation key=XR8L0HL374VC tag=W3TBXLWBFG5V type=del size=2122352 2024-09-12T00:30:56.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.274+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=NROZM008EMPY type=del size=559717 2024-09-12T00:30:56.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.276+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=WGN2U5JM0IU6 type=del 2024-09-12T00:30:56.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.280+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~N31DBU0VLR4O.0 size=1048576 2024-09-12T00:30:56.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.281+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~N31DBU0VLR4O.1 size=1048576 2024-09-12T00:30:56.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.282+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~N31DBU0VLR4O.2 size=490166 2024-09-12T00:30:56.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.282+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=N31DBU0VLR4O tag=Z1BK5XSI0MK9 type=write size=3635894 2024-09-12T00:30:56.282 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.283+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=5KCGN6MPZHEB type=del 2024-09-12T00:30:56.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.285+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=4MNTNVEWI4XT type=del size=148905 2024-09-12T00:30:56.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.287+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=65BDW91Q9Z1V type=del 2024-09-12T00:30:56.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.290+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~VBSPEA98AUB4.0 size=1048576 2024-09-12T00:30:56.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.291+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~VBSPEA98AUB4.1 size=419651 2024-09-12T00:30:56.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.291+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=VBSPEA98AUB4 tag=0MYUZP4RSXHY type=write size=2516803 2024-09-12T00:30:56.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.292+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=YICKGOJXHT0S type=write size=484291 2024-09-12T00:30:56.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.294+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=OZIOVEOST715 type=del size=2725481 2024-09-12T00:30:56.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.296+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~F2KNQHWKP569.0 size=644639 2024-09-12T00:30:56.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.298+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=F2KNQHWKP569 tag=NXTCBN2XCBWK type=write size=1693215 2024-09-12T00:30:56.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.300+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=5GC1IGKY4XV1 type=del size=2011298 2024-09-12T00:30:56.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.301+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=22G7EH371BL4 type=del 2024-09-12T00:30:56.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.304+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~ZSA2I4ZAAEQJ.0 size=688363 2024-09-12T00:30:56.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.304+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=ZSA2I4ZAAEQJ tag=00VC6NU0L4T3 type=write size=1736939 2024-09-12T00:30:56.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.306+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=WLG4RB04MG1D type=del 2024-09-12T00:30:56.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.309+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~PLSZVCZ8XNXV.0 size=1048576 2024-09-12T00:30:56.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.310+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~PLSZVCZ8XNXV.1 size=787860 2024-09-12T00:30:56.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.310+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=PLSZVCZ8XNXV tag=XO177L21DO3L type=write size=2885012 2024-09-12T00:30:56.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.312+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~TQWHMDOEBKQJ.0 size=217947 2024-09-12T00:30:56.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.315+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=TQWHMDOEBKQJ tag=PUPB02WRDV3G type=write size=1266523 2024-09-12T00:30:56.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.316+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=1LVWY2MLCT8U type=del size=2217443 2024-09-12T00:30:56.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.318+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~DVNMFA0HL9JA.0 size=1048576 2024-09-12T00:30:56.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.320+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~DVNMFA0HL9JA.1 size=1048576 2024-09-12T00:30:56.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.321+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~DVNMFA0HL9JA.2 size=597695 2024-09-12T00:30:56.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.323+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=DVNMFA0HL9JA tag=Z135KCW2L26X type=write size=3743423 2024-09-12T00:30:56.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.325+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=V9Z4GTK2PGCP type=del size=4033925 2024-09-12T00:30:56.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.326+0000 7f0362c73780 1 < completed write operation key=R4ABY5AY0S1P tag=Q09MBHLFIGPF type=write size=194088 2024-09-12T00:30:56.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.327+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=LDO95V1O2J2O type=del size=4039464 2024-09-12T00:30:56.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.329+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=AX93FWQJ73CC type=del 2024-09-12T00:30:56.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.331+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=I251XJP0LYY1 type=write size=449068 2024-09-12T00:30:56.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.332+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=TU2SRV3GX1MW type=del 2024-09-12T00:30:56.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.336+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~1ZBSPFRL6C85.0 size=1048576 2024-09-12T00:30:56.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.337+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~1ZBSPFRL6C85.1 size=1048576 2024-09-12T00:30:56.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.338+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~1ZBSPFRL6C85.2 size=752891 2024-09-12T00:30:56.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.338+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=1ZBSPFRL6C85 tag=T1SBKGPU41EV type=write size=3898619 2024-09-12T00:30:56.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.340+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~WLGDFAKK9D8M.0 size=735721 2024-09-12T00:30:56.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.342+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=WLGDFAKK9D8M tag=P1FLTQU3ZK3P type=write size=1784297 2024-09-12T00:30:56.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.345+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~2TALWOB8Z2LM.0 size=1048576 2024-09-12T00:30:56.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.346+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~2TALWOB8Z2LM.1 size=1048576 2024-09-12T00:30:56.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.347+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~2TALWOB8Z2LM.2 size=171117 2024-09-12T00:30:56.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.347+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=2TALWOB8Z2LM tag=L56H2C5RPVL4 type=write size=3316845 2024-09-12T00:30:56.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.349+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=L6BIAIR0PZ19 type=del 2024-09-12T00:30:56.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.350+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=077VJ5ZJE7SN type=del size=2718947 2024-09-12T00:30:56.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.352+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=WJD9Z6E8YGQ9 type=del 2024-09-12T00:30:56.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.355+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~ZSVIE3RYB53Z.0 size=47437 2024-09-12T00:30:56.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.355+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=ZSVIE3RYB53Z tag=EOONA3EE008H type=write size=1096013 2024-09-12T00:30:56.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.358+0000 7f0362c73780 1 < suggested remove operation key=VD0LFCNLI1YI tag=NROZM008EMPY type=del 2024-09-12T00:30:56.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.359+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=IQT31BBDEZ53 type=write size=814654 2024-09-12T00:30:56.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.360+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~N31DBU0VLR4O.0 size=1048576 2024-09-12T00:30:56.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.361+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~N31DBU0VLR4O.1 size=1048576 2024-09-12T00:30:56.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.362+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~N31DBU0VLR4O.2 size=490166 2024-09-12T00:30:56.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.364+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=N31DBU0VLR4O tag=Z1BK5XSI0MK9 type=write size=3635894 2024-09-12T00:30:56.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.366+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=WT2VYKFF5DHP type=del size=3140755 2024-09-12T00:30:56.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.367+0000 7f0362c73780 1 < completed delete operation key=PLAYMR18X9DZ tag=4MNTNVEWI4XT type=del 2024-09-12T00:30:56.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.369+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=KG5QSU4EAPUD type=del size=1647987 2024-09-12T00:30:56.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.370+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~VBSPEA98AUB4.0 size=1048576 2024-09-12T00:30:56.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.371+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~VBSPEA98AUB4.1 size=419651 2024-09-12T00:30:56.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.374+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=VBSPEA98AUB4 tag=0MYUZP4RSXHY type=write size=2516803 2024-09-12T00:30:56.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.375+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=212P2UNV3F1X type=del size=1612196 2024-09-12T00:30:56.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.377+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=OZIOVEOST715 type=del 2024-09-12T00:30:56.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.378+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=DR3W14CML1HH type=del size=1491505 2024-09-12T00:30:56.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.380+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=5GC1IGKY4XV1 type=del 2024-09-12T00:30:56.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.381+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=JFWSLXLRACHG type=del size=1333367 2024-09-12T00:30:56.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.383+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~ZSA2I4ZAAEQJ.0 size=688363 2024-09-12T00:30:56.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.385+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=ZSA2I4ZAAEQJ tag=00VC6NU0L4T3 type=write size=1736939 2024-09-12T00:30:56.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.388+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~WIBDPZAXRLM5.0 size=1048576 2024-09-12T00:30:56.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.389+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~WIBDPZAXRLM5.1 size=1048576 2024-09-12T00:30:56.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.390+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~WIBDPZAXRLM5.2 size=883388 2024-09-12T00:30:56.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.390+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=WIBDPZAXRLM5 tag=Y5SC2PYOBDC9 type=write size=4029116 2024-09-12T00:30:56.390 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.392+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~PLSZVCZ8XNXV.0 size=1048576 2024-09-12T00:30:56.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.393+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~PLSZVCZ8XNXV.1 size=787860 2024-09-12T00:30:56.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.395+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=PLSZVCZ8XNXV tag=XO177L21DO3L type=write size=2885012 2024-09-12T00:30:56.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.397+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=7K0CRMY525E9 type=del size=1440530 2024-09-12T00:30:56.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.398+0000 7f0362c73780 1 < canceled operation key=Q6M0D2698CUZ tag=1LVWY2MLCT8U type=del size=2217443 2024-09-12T00:30:56.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.400+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=4UQE9JDIGDLZ type=del size=2320418 2024-09-12T00:30:56.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.401+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=V9Z4GTK2PGCP type=del 2024-09-12T00:30:56.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.403+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=NS6VOY7BYHPY type=del size=529335 2024-09-12T00:30:56.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.404+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=LDO95V1O2J2O type=del 2024-09-12T00:30:56.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.406+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=L017ZH1EB2CG type=del size=1719935 2024-09-12T00:30:56.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.407+0000 7f0362c73780 1 < completed write operation key=XWW3882YBHAJ tag=I251XJP0LYY1 type=write size=449068 2024-09-12T00:30:56.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.408+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=I14U874XCRM1 type=del size=1320697 2024-09-12T00:30:56.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.410+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~1ZBSPFRL6C85.0 size=1048576 2024-09-12T00:30:56.409 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.411+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~1ZBSPFRL6C85.1 size=1048576 2024-09-12T00:30:56.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.411+0000 7f0362c73780 1 < canceled part key=_multipart_HEN9LUUIDAR5.2~1ZBSPFRL6C85.2 size=752891 2024-09-12T00:30:56.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.413+0000 7f0362c73780 1 < canceled multipart upload key=HEN9LUUIDAR5 upload=1ZBSPFRL6C85 tag=T1SBKGPU41EV type=write size=3898619 2024-09-12T00:30:56.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.415+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=Y5968QYE1VZ8 type=del size=2016990 2024-09-12T00:30:56.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.417+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~2TALWOB8Z2LM.0 size=1048576 2024-09-12T00:30:56.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.418+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~2TALWOB8Z2LM.1 size=1048576 2024-09-12T00:30:56.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.419+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~2TALWOB8Z2LM.2 size=171117 2024-09-12T00:30:56.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.421+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=2TALWOB8Z2LM tag=L56H2C5RPVL4 type=write size=3316845 2024-09-12T00:30:56.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.424+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~8ADLQ8WQGYT0.0 size=1048576 2024-09-12T00:30:56.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.425+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~8ADLQ8WQGYT0.1 size=477732 2024-09-12T00:30:56.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.425+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=8ADLQ8WQGYT0 tag=ZWD23O0HKE2I type=write size=2574884 2024-09-12T00:30:56.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.427+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=077VJ5ZJE7SN type=del 2024-09-12T00:30:56.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.429+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~7B785L8UXV9E.0 size=1048576 2024-09-12T00:30:56.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.430+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~7B785L8UXV9E.1 size=1048576 2024-09-12T00:30:56.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.431+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~7B785L8UXV9E.2 size=573000 2024-09-12T00:30:56.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.431+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=7B785L8UXV9E tag=7XT9HA7R2TA3 type=write size=3718728 2024-09-12T00:30:56.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.433+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~ZSVIE3RYB53Z.0 size=47437 2024-09-12T00:30:56.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.435+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=ZSVIE3RYB53Z tag=EOONA3EE008H type=write size=1096013 2024-09-12T00:30:56.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.436+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=1L72H8T2V3L7 type=write size=447728 2024-09-12T00:30:56.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.438+0000 7f0362c73780 1 < completed write operation key=I3B48QD9E40S tag=IQT31BBDEZ53 type=write size=814654 2024-09-12T00:30:56.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.440+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~EVB4PIUWEVWS.0 size=225102 2024-09-12T00:30:56.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.440+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=EVB4PIUWEVWS tag=ZWL6C9X2DKJ2 type=write size=1273678 2024-09-12T00:30:56.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.442+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=WT2VYKFF5DHP type=del 2024-09-12T00:30:56.442 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.443+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=KFPVTHIXBVIG type=del size=939891 2024-09-12T00:30:56.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.446+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=KG5QSU4EAPUD type=del 2024-09-12T00:30:56.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.449+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~P4YRKWIEGQHZ.0 size=1048576 2024-09-12T00:30:56.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.450+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~P4YRKWIEGQHZ.1 size=206490 2024-09-12T00:30:56.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.450+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=P4YRKWIEGQHZ tag=6X22Q50BNDVW type=write size=2303642 2024-09-12T00:30:56.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.451+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=212P2UNV3F1X type=del 2024-09-12T00:30:56.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.453+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=DBSIFYWLAY2I type=write size=180900 2024-09-12T00:30:56.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.455+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=DR3W14CML1HH type=del 2024-09-12T00:30:56.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.456+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=YN9VYMKPLJZL type=del size=845563 2024-09-12T00:30:56.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.457+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=JFWSLXLRACHG type=del 2024-09-12T00:30:56.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.459+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=CPA7NBYB1L94 type=del size=3584905 2024-09-12T00:30:56.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.459+0000 7f0362c73780 1 < canceled part key=_multipart_44YJP6XPIFT5.2~WIBDPZAXRLM5.0 size=1048576 2024-09-12T00:30:56.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.460+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~WIBDPZAXRLM5.1 size=1048576 2024-09-12T00:30:56.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.461+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~WIBDPZAXRLM5.2 size=883388 2024-09-12T00:30:56.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.464+0000 7f0362c73780 1 < canceled multipart upload key=44YJP6XPIFT5 upload=WIBDPZAXRLM5 tag=Y5SC2PYOBDC9 type=write size=4029116 2024-09-12T00:30:56.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.465+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=AJCBQM07TN1U type=del size=3919335 2024-09-12T00:30:56.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.467+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=7K0CRMY525E9 type=del 2024-09-12T00:30:56.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.469+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~RRN4OX084XGU.0 size=828009 2024-09-12T00:30:56.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.469+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=RRN4OX084XGU tag=KLSWVCSJXOIZ type=write size=1876585 2024-09-12T00:30:56.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.471+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=4UQE9JDIGDLZ type=del 2024-09-12T00:30:56.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.472+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=75EL8GRWF05K type=del size=4164005 2024-09-12T00:30:56.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.474+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=NS6VOY7BYHPY type=del 2024-09-12T00:30:56.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.476+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~6QL46CYRF9F7.0 size=1048576 2024-09-12T00:30:56.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.477+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~6QL46CYRF9F7.1 size=431811 2024-09-12T00:30:56.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.477+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=6QL46CYRF9F7 tag=2P15VW5K5RV2 type=write size=2528963 2024-09-12T00:30:56.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.479+0000 7f0362c73780 1 < canceled operation key=KWDEKRO3WICD tag=L017ZH1EB2CG type=del size=1719935 2024-09-12T00:30:56.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.480+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=3294WLLULMGZ type=del size=2538261 2024-09-12T00:30:56.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.483+0000 7f0362c73780 1 < suggested remove operation key=VD0LFCNLI1YI tag=I14U874XCRM1 type=del 2024-09-12T00:30:56.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.485+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~1IUSGNOU68XE.0 size=1048576 2024-09-12T00:30:56.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.487+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~1IUSGNOU68XE.1 size=1048576 2024-09-12T00:30:56.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.488+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~1IUSGNOU68XE.2 size=417764 2024-09-12T00:30:56.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.488+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=1IUSGNOU68XE tag=AWO2I01FL48U type=write size=3563492 2024-09-12T00:30:56.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.489+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=Y5968QYE1VZ8 type=del 2024-09-12T00:30:56.489 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.490+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=FJFVAX1H2LFJ type=del size=2804829 2024-09-12T00:30:56.490 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.492+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~8ADLQ8WQGYT0.0 size=1048576 2024-09-12T00:30:56.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.493+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~8ADLQ8WQGYT0.1 size=477732 2024-09-12T00:30:56.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.495+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=8ADLQ8WQGYT0 tag=ZWD23O0HKE2I type=write size=2574884 2024-09-12T00:30:56.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.498+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~TQJYM73SONDB.0 size=842737 2024-09-12T00:30:56.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.498+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=TQJYM73SONDB tag=CPUQTGXH6AK2 type=write size=1891313 2024-09-12T00:30:56.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.499+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~7B785L8UXV9E.0 size=1048576 2024-09-12T00:30:56.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.501+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~7B785L8UXV9E.1 size=1048576 2024-09-12T00:30:56.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.502+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~7B785L8UXV9E.2 size=573000 2024-09-12T00:30:56.502 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.504+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=7B785L8UXV9E tag=7XT9HA7R2TA3 type=write size=3718728 2024-09-12T00:30:56.504 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.505+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=7B0UKE3AXLIX type=write size=258218 2024-09-12T00:30:56.505 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.507+0000 7f0362c73780 1 < completed write operation key=CZHT9UQS34JU tag=1L72H8T2V3L7 type=write size=447728 2024-09-12T00:30:56.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.510+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~1NE7SL1SQJI7.0 size=984850 2024-09-12T00:30:56.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.510+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=1NE7SL1SQJI7 tag=UQW08X8HIO2V type=write size=2033426 2024-09-12T00:30:56.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.511+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~EVB4PIUWEVWS.0 size=225102 2024-09-12T00:30:56.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.513+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=EVB4PIUWEVWS tag=ZWL6C9X2DKJ2 type=write size=1273678 2024-09-12T00:30:56.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.516+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~4W6478VH5HQE.0 size=807388 2024-09-12T00:30:56.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.516+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=4W6478VH5HQE tag=4CZPYWD2TLZJ type=write size=1855964 2024-09-12T00:30:56.515 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.517+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=KFPVTHIXBVIG type=del 2024-09-12T00:30:56.517 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.518+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=C543B5VH801G type=del size=2566264 2024-09-12T00:30:56.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.520+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~P4YRKWIEGQHZ.0 size=1048576 2024-09-12T00:30:56.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.521+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~P4YRKWIEGQHZ.1 size=206490 2024-09-12T00:30:56.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.523+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=P4YRKWIEGQHZ tag=6X22Q50BNDVW type=write size=2303642 2024-09-12T00:30:56.523 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.525+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=G3IGMO51D4KK type=del size=2179257 2024-09-12T00:30:56.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.526+0000 7f0362c73780 1 < completed write operation key=G4G6E7KTTZY9 tag=DBSIFYWLAY2I type=write size=180900 2024-09-12T00:30:56.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.527+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=I2M3EUY70JYB type=del size=3600423 2024-09-12T00:30:56.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.529+0000 7f0362c73780 1 < canceled operation key=X4ZML0796M7F tag=YN9VYMKPLJZL type=del size=845563 2024-09-12T00:30:56.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.530+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=9AZ1D01L00VU type=del size=2753854 2024-09-12T00:30:56.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.531+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=CPA7NBYB1L94 type=del 2024-09-12T00:30:56.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.534+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~GIARZ6GMSI7U.0 size=1048576 2024-09-12T00:30:56.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.535+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~GIARZ6GMSI7U.1 size=730818 2024-09-12T00:30:56.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.535+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=GIARZ6GMSI7U tag=I2AP5W6OAE5H type=write size=2827970 2024-09-12T00:30:56.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.536+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=AJCBQM07TN1U type=del 2024-09-12T00:30:56.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.538+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=3QXN026IFUAQ type=del size=1296074 2024-09-12T00:30:56.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.539+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~RRN4OX084XGU.0 size=828009 2024-09-12T00:30:56.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.541+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=RRN4OX084XGU tag=KLSWVCSJXOIZ type=write size=1876585 2024-09-12T00:30:56.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.544+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~WRY2D0NMQLXD.0 size=931538 2024-09-12T00:30:56.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.544+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=WRY2D0NMQLXD tag=38I3JN370OM4 type=write size=1980114 2024-09-12T00:30:56.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.545+0000 7f0362c73780 1 < canceled operation key=G2HW98G6624O tag=75EL8GRWF05K type=del size=4164005 2024-09-12T00:30:56.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.547+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=V4GKJKC5HG0T type=del size=905943 2024-09-12T00:30:56.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.548+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~6QL46CYRF9F7.0 size=1048576 2024-09-12T00:30:56.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.549+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~6QL46CYRF9F7.1 size=431811 2024-09-12T00:30:56.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.552+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=6QL46CYRF9F7 tag=2P15VW5K5RV2 type=write size=2528963 2024-09-12T00:30:56.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.553+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=45W8EIRA6EEX type=del size=3787981 2024-09-12T00:30:56.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.556+0000 7f0362c73780 1 < suggested update operation key=927NCYXX8Z2P tag=3294WLLULMGZ type=del size=2538261 2024-09-12T00:30:56.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.558+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=WFKVG68Z6WJA type=del size=2741370 2024-09-12T00:30:56.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.559+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~1IUSGNOU68XE.0 size=1048576 2024-09-12T00:30:56.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.559+0000 7f0362c73780 1 < canceled part key=_multipart_CZHT9UQS34JU.2~1IUSGNOU68XE.1 size=1048576 2024-09-12T00:30:56.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.559+0000 7f0362c73780 1 < canceled part key=_multipart_CZHT9UQS34JU.2~1IUSGNOU68XE.2 size=417764 2024-09-12T00:30:56.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.562+0000 7f0362c73780 1 < canceled multipart upload key=CZHT9UQS34JU upload=1IUSGNOU68XE tag=AWO2I01FL48U type=write size=3563492 2024-09-12T00:30:56.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.563+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=ODVKVD64IZO8 type=write size=153114 2024-09-12T00:30:56.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.564+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=FJFVAX1H2LFJ type=del 2024-09-12T00:30:56.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.566+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=VQK661Y3UL44 type=del size=3768502 2024-09-12T00:30:56.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.567+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~TQJYM73SONDB.0 size=842737 2024-09-12T00:30:56.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.569+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=TQJYM73SONDB tag=CPUQTGXH6AK2 type=write size=1891313 2024-09-12T00:30:56.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.573+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~VBC01TBS2X34.0 size=1048576 2024-09-12T00:30:56.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.574+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~VBC01TBS2X34.1 size=1048576 2024-09-12T00:30:56.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.575+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~VBC01TBS2X34.2 size=901194 2024-09-12T00:30:56.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.575+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=VBC01TBS2X34 tag=24NFLRY01I1N type=write size=4046922 2024-09-12T00:30:56.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.577+0000 7f0362c73780 1 < completed write operation key=J5GSZCJW2BP1 tag=7B0UKE3AXLIX type=write size=258218 2024-09-12T00:30:56.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.580+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~LZ0D20O6OTI1.0 size=1048576 2024-09-12T00:30:56.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.583+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~LZ0D20O6OTI1.1 size=1048576 2024-09-12T00:30:56.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.584+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~LZ0D20O6OTI1.2 size=517999 2024-09-12T00:30:56.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.584+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=LZ0D20O6OTI1 tag=4SM9BLTTA68E type=write size=3663727 2024-09-12T00:30:56.584 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.586+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~1NE7SL1SQJI7.0 size=984850 2024-09-12T00:30:56.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.589+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=1NE7SL1SQJI7 tag=UQW08X8HIO2V type=write size=2033426 2024-09-12T00:30:56.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.591+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~SIHP7O452B6C.0 size=1048576 2024-09-12T00:30:56.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.592+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~SIHP7O452B6C.1 size=419907 2024-09-12T00:30:56.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.592+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=SIHP7O452B6C tag=OB1OP56X5RBX type=write size=2517059 2024-09-12T00:30:56.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.594+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~4W6478VH5HQE.0 size=807388 2024-09-12T00:30:56.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.596+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=4W6478VH5HQE tag=4CZPYWD2TLZJ type=write size=1855964 2024-09-12T00:30:56.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.598+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=V3TV3HU14MVY type=del size=1023682 2024-09-12T00:30:56.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.600+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=C543B5VH801G type=del 2024-09-12T00:30:56.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.601+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=3GHINQ5R2BII type=del size=4098914 2024-09-12T00:30:56.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.603+0000 7f0362c73780 1 < completed delete operation key=PLAYMR18X9DZ tag=G3IGMO51D4KK type=del 2024-09-12T00:30:56.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.605+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~A9STVX4H2Y23.0 size=1048576 2024-09-12T00:30:56.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.607+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~A9STVX4H2Y23.1 size=134877 2024-09-12T00:30:56.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.607+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=A9STVX4H2Y23 tag=721ONG12LT8Y type=write size=2232029 2024-09-12T00:30:56.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.608+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=I2M3EUY70JYB type=del 2024-09-12T00:30:56.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.610+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=ONI33DIG6GY4 type=del size=2690364 2024-09-12T00:30:56.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.612+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=9AZ1D01L00VU type=del 2024-09-12T00:30:56.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.613+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=96JNKG4PVOQ0 type=del size=2608633 2024-09-12T00:30:56.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.615+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~GIARZ6GMSI7U.0 size=1048576 2024-09-12T00:30:56.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.616+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~GIARZ6GMSI7U.1 size=730818 2024-09-12T00:30:56.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.619+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=GIARZ6GMSI7U tag=I2AP5W6OAE5H type=write size=2827970 2024-09-12T00:30:56.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.622+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~JVCE7C6MW8Q1.0 size=1048576 2024-09-12T00:30:56.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.623+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~JVCE7C6MW8Q1.1 size=1048576 2024-09-12T00:30:56.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.624+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~JVCE7C6MW8Q1.2 size=515809 2024-09-12T00:30:56.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.624+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=JVCE7C6MW8Q1 tag=W1DO0XGBJT0Y type=write size=3661537 2024-09-12T00:30:56.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.626+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=3QXN026IFUAQ type=del 2024-09-12T00:30:56.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.628+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~EKBOBLRHCMC8.0 size=1048576 2024-09-12T00:30:56.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.629+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~EKBOBLRHCMC8.1 size=1041182 2024-09-12T00:30:56.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.629+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=EKBOBLRHCMC8 tag=JTLY6Q3LALQN type=write size=3138334 2024-09-12T00:30:56.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.629+0000 7f0362c73780 1 < canceled part key=_multipart_I3B48QD9E40S.2~WRY2D0NMQLXD.0 size=931538 2024-09-12T00:30:56.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.632+0000 7f0362c73780 1 < canceled multipart upload key=I3B48QD9E40S upload=WRY2D0NMQLXD tag=38I3JN370OM4 type=write size=1980114 2024-09-12T00:30:56.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.634+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~78VY9MFNVNUH.0 size=1048576 2024-09-12T00:30:56.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.635+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~78VY9MFNVNUH.1 size=424590 2024-09-12T00:30:56.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.635+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=78VY9MFNVNUH tag=1OT2DR03YXU5 type=write size=2521742 2024-09-12T00:30:56.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.638+0000 7f0362c73780 1 < suggested update operation key=6AYDT9X4LC6T tag=V4GKJKC5HG0T type=del size=905943 2024-09-12T00:30:56.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.642+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~EL6YVK39XITC.0 size=1048576 2024-09-12T00:30:56.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.643+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~EL6YVK39XITC.1 size=624402 2024-09-12T00:30:56.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.643+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=EL6YVK39XITC tag=8340NZL2OKHV type=write size=2721554 2024-09-12T00:30:56.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.646+0000 7f0362c73780 1 < suggested remove operation key=XR8L0HL374VC tag=45W8EIRA6EEX type=del 2024-09-12T00:30:56.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.647+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=ZNJKUWUYXV9O type=write size=898127 2024-09-12T00:30:56.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.649+0000 7f0362c73780 -1 < failed to complete operation key=XR8L0HL374VC tag=WFKVG68Z6WJA type=del size=2741370: (22) Invalid argument 2024-09-12T00:30:56.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.650+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=HQCC5HZ86EKU type=write size=497822 2024-09-12T00:30:56.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.652+0000 7f0362c73780 1 < completed write operation key=84T1VJG5SHU4 tag=ODVKVD64IZO8 type=write size=153114 2024-09-12T00:30:56.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.653+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=UW2WV3UZSKTB type=del size=584520 2024-09-12T00:30:56.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.655+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=VQK661Y3UL44 type=del 2024-09-12T00:30:56.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.656+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=IZ4EZ5YGP228 type=del size=1357324 2024-09-12T00:30:56.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.658+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~VBC01TBS2X34.0 size=1048576 2024-09-12T00:30:56.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.659+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~VBC01TBS2X34.1 size=1048576 2024-09-12T00:30:56.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.660+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~VBC01TBS2X34.2 size=901194 2024-09-12T00:30:56.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.663+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=VBC01TBS2X34 tag=24NFLRY01I1N type=write size=4046922 2024-09-12T00:30:56.664 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.665+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~PLF4TAI7B2NW.0 size=1048576 2024-09-12T00:30:56.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.667+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~PLF4TAI7B2NW.1 size=439025 2024-09-12T00:30:56.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.667+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=PLF4TAI7B2NW tag=B30T0KAXP03H type=write size=2536177 2024-09-12T00:30:56.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.668+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~LZ0D20O6OTI1.0 size=1048576 2024-09-12T00:30:56.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.668+0000 7f0362c73780 1 < canceled part key=_multipart_HWSQFSK29S0V.2~LZ0D20O6OTI1.1 size=1048576 2024-09-12T00:30:56.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.670+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~LZ0D20O6OTI1.2 size=517999 2024-09-12T00:30:56.670 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.672+0000 7f0362c73780 1 < canceled multipart upload key=HWSQFSK29S0V upload=LZ0D20O6OTI1 tag=4SM9BLTTA68E type=write size=3663727 2024-09-12T00:30:56.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.673+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=DIPJF14BQ7S2 type=del size=3834599 2024-09-12T00:30:56.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.675+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~SIHP7O452B6C.0 size=1048576 2024-09-12T00:30:56.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.676+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~SIHP7O452B6C.1 size=419907 2024-09-12T00:30:56.677 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.679+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=SIHP7O452B6C tag=OB1OP56X5RBX type=write size=2517059 2024-09-12T00:30:56.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.681+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~BQMEVWSM973K.0 size=1048576 2024-09-12T00:30:56.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.682+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~BQMEVWSM973K.1 size=1048576 2024-09-12T00:30:56.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.683+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~BQMEVWSM973K.2 size=751821 2024-09-12T00:30:56.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.684+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=BQMEVWSM973K tag=DR7SL8NJ33OY type=write size=3897549 2024-09-12T00:30:56.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.685+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=V3TV3HU14MVY type=del 2024-09-12T00:30:56.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.686+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=1S6TD3C3S7X2 type=del size=2821399 2024-09-12T00:30:56.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.688+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=3GHINQ5R2BII type=del 2024-09-12T00:30:56.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.690+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=FV0I5MDFY1SL type=write size=345608 2024-09-12T00:30:56.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.691+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~A9STVX4H2Y23.0 size=1048576 2024-09-12T00:30:56.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.692+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~A9STVX4H2Y23.1 size=134877 2024-09-12T00:30:56.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.695+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=A9STVX4H2Y23 tag=721ONG12LT8Y type=write size=2232029 2024-09-12T00:30:56.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.696+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=S8GD1VFN8MY3 type=del size=2941513 2024-09-12T00:30:56.696 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.698+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=ONI33DIG6GY4 type=del 2024-09-12T00:30:56.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.700+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=CUQZGDJ50SBA type=del size=2629107 2024-09-12T00:30:56.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.701+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=96JNKG4PVOQ0 type=del 2024-09-12T00:30:56.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.703+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=600WDXVO6EJ7 type=del size=1466930 2024-09-12T00:30:56.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.704+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~JVCE7C6MW8Q1.0 size=1048576 2024-09-12T00:30:56.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.705+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~JVCE7C6MW8Q1.1 size=1048576 2024-09-12T00:30:56.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.707+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~JVCE7C6MW8Q1.2 size=515809 2024-09-12T00:30:56.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.709+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=JVCE7C6MW8Q1 tag=W1DO0XGBJT0Y type=write size=3661537 2024-09-12T00:30:56.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.710+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=V100G0F4X652 type=del size=1218081 2024-09-12T00:30:56.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.712+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~EKBOBLRHCMC8.0 size=1048576 2024-09-12T00:30:56.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.713+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~EKBOBLRHCMC8.1 size=1041182 2024-09-12T00:30:56.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.715+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=EKBOBLRHCMC8 tag=JTLY6Q3LALQN type=write size=3138334 2024-09-12T00:30:56.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.717+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=9ZYF01W9H976 type=del size=3380405 2024-09-12T00:30:56.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.719+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~78VY9MFNVNUH.0 size=1048576 2024-09-12T00:30:56.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.720+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~78VY9MFNVNUH.1 size=424590 2024-09-12T00:30:56.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.723+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=78VY9MFNVNUH tag=1OT2DR03YXU5 type=write size=2521742 2024-09-12T00:30:56.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.726+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~WFWJ2VURMQW6.0 size=1048576 2024-09-12T00:30:56.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.727+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~WFWJ2VURMQW6.1 size=1048576 2024-09-12T00:30:56.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.728+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~WFWJ2VURMQW6.2 size=453171 2024-09-12T00:30:56.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.728+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=WFWJ2VURMQW6 tag=HNXJ1D9W2V33 type=write size=3598899 2024-09-12T00:30:56.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.729+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~EL6YVK39XITC.0 size=1048576 2024-09-12T00:30:56.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.730+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~EL6YVK39XITC.1 size=624402 2024-09-12T00:30:56.731 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.733+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=EL6YVK39XITC tag=8340NZL2OKHV type=write size=2721554 2024-09-12T00:30:56.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.735+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=K37HQPA8LLH9 type=del size=2161519 2024-09-12T00:30:56.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.736+0000 7f0362c73780 1 < completed write operation key=1UUNRPUKAINC tag=ZNJKUWUYXV9O type=write size=898127 2024-09-12T00:30:56.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.739+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~SW7F5P7ID65Z.0 size=1048576 2024-09-12T00:30:56.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.741+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~SW7F5P7ID65Z.1 size=434134 2024-09-12T00:30:56.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.741+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=SW7F5P7ID65Z tag=YS5BWDV0Y5ZJ type=write size=2531286 2024-09-12T00:30:56.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.742+0000 7f0362c73780 1 < completed write operation key=1IPW8SJ6SSU2 tag=HQCC5HZ86EKU type=write size=497822 2024-09-12T00:30:56.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.744+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=A1J1YYR8YVYI type=write size=767919 2024-09-12T00:30:56.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.747+0000 7f0362c73780 1 < suggested update operation key=CZHT9UQS34JU tag=UW2WV3UZSKTB type=del size=584520 2024-09-12T00:30:56.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.748+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=0GIG6B4D0F9M type=del size=660145 2024-09-12T00:30:56.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.751+0000 7f0362c73780 1 < suggested update operation key=XWW3882YBHAJ tag=IZ4EZ5YGP228 type=del size=1357324 2024-09-12T00:30:56.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.752+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=3WT46X6305WD type=write size=951090 2024-09-12T00:30:56.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.754+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~PLF4TAI7B2NW.0 size=1048576 2024-09-12T00:30:56.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.755+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~PLF4TAI7B2NW.1 size=439025 2024-09-12T00:30:56.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.758+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=PLF4TAI7B2NW tag=B30T0KAXP03H type=write size=2536177 2024-09-12T00:30:56.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.761+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~MMQGF0JZKIBU.0 size=1048576 2024-09-12T00:30:56.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.762+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~MMQGF0JZKIBU.1 size=964793 2024-09-12T00:30:56.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.762+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=MMQGF0JZKIBU tag=03VC457DZYL5 type=write size=3061945 2024-09-12T00:30:56.762 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.763+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=DIPJF14BQ7S2 type=del 2024-09-12T00:30:56.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.765+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=2HUL30AZNWGY type=del size=2406244 2024-09-12T00:30:56.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.766+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~BQMEVWSM973K.0 size=1048576 2024-09-12T00:30:56.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.766+0000 7f0362c73780 1 < canceled part key=_multipart_6AYDT9X4LC6T.2~BQMEVWSM973K.1 size=1048576 2024-09-12T00:30:56.766 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.768+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~BQMEVWSM973K.2 size=751821 2024-09-12T00:30:56.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.770+0000 7f0362c73780 1 < canceled multipart upload key=6AYDT9X4LC6T upload=BQMEVWSM973K tag=DR7SL8NJ33OY type=write size=3897549 2024-09-12T00:30:56.771 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.772+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=OKOUUH02DOIP type=del size=4124786 2024-09-12T00:30:56.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.775+0000 7f0362c73780 1 < suggested update operation key=YTN99RBTKO39 tag=1S6TD3C3S7X2 type=del size=2821399 2024-09-12T00:30:56.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.776+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=5R9KW8ISP8PW type=write size=313238 2024-09-12T00:30:56.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.778+0000 7f0362c73780 1 < completed write operation key=G2HW98G6624O tag=FV0I5MDFY1SL type=write size=345608 2024-09-12T00:30:56.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.780+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=O2ABVYZ091SS type=del size=768706 2024-09-12T00:30:56.784 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.783+0000 7f0362c73780 1 < suggested remove operation key=XWW3882YBHAJ tag=S8GD1VFN8MY3 type=del 2024-09-12T00:30:56.784 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.785+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=9MQMKNW9DZ82 type=del size=1266788 2024-09-12T00:30:56.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.788+0000 7f0362c73780 1 < suggested remove operation key=2DHHPBYV80O8 tag=CUQZGDJ50SBA type=del 2024-09-12T00:30:56.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.789+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=Z0U3J1VOKMQL type=write size=1035801 2024-09-12T00:30:56.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.791+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=600WDXVO6EJ7 type=del 2024-09-12T00:30:56.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.792+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=8JX8ZJBY53H8 type=del size=1843348 2024-09-12T00:30:56.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.794+0000 7f0362c73780 1 < canceled operation key=KWDEKRO3WICD tag=V100G0F4X652 type=del size=1218081 2024-09-12T00:30:56.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.796+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~98K1KV42535Q.0 size=915025 2024-09-12T00:30:56.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.796+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=98K1KV42535Q tag=QJ4W8O6XVQVU type=write size=1963601 2024-09-12T00:30:56.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.798+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=9ZYF01W9H976 type=del 2024-09-12T00:30:56.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.799+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=L11UKD9Y4709 type=write size=424792 2024-09-12T00:30:56.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.801+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~WFWJ2VURMQW6.0 size=1048576 2024-09-12T00:30:56.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.802+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~WFWJ2VURMQW6.1 size=1048576 2024-09-12T00:30:56.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.803+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~WFWJ2VURMQW6.2 size=453171 2024-09-12T00:30:56.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.805+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=WFWJ2VURMQW6 tag=HNXJ1D9W2V33 type=write size=3598899 2024-09-12T00:30:56.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.807+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=QY8VHJXIMB1B type=del size=408885 2024-09-12T00:30:56.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.810+0000 7f0362c73780 1 < suggested remove operation key=VD0LFCNLI1YI tag=K37HQPA8LLH9 type=del 2024-09-12T00:30:56.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.812+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~4KAWEQLUOLNJ.0 size=722764 2024-09-12T00:30:56.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.812+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=4KAWEQLUOLNJ tag=BKRK2R1MK3UR type=write size=1771340 2024-09-12T00:30:56.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.813+0000 7f0362c73780 1 < canceled part key=_multipart_PYCRNXC9ITGF.2~SW7F5P7ID65Z.0 size=1048576 2024-09-12T00:30:56.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.813+0000 7f0362c73780 1 < canceled part key=_multipart_PYCRNXC9ITGF.2~SW7F5P7ID65Z.1 size=434134 2024-09-12T00:30:56.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.815+0000 7f0362c73780 1 < canceled multipart upload key=PYCRNXC9ITGF upload=SW7F5P7ID65Z tag=YS5BWDV0Y5ZJ type=write size=2531286 2024-09-12T00:30:56.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.816+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=HV3BCKGW0CIG type=del size=2782184 2024-09-12T00:30:56.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.818+0000 7f0362c73780 1 < completed write operation key=IIZAWZDLR2QE tag=A1J1YYR8YVYI type=write size=767919 2024-09-12T00:30:56.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.820+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~4UFDSVHVCFND.0 size=1048576 2024-09-12T00:30:56.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.822+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~4UFDSVHVCFND.1 size=298633 2024-09-12T00:30:56.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.822+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=4UFDSVHVCFND tag=B8Q4A7SUGK4V type=write size=2395785 2024-09-12T00:30:56.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.823+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=0GIG6B4D0F9M type=del 2024-09-12T00:30:56.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.825+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=VLBDHV2OQ6IT type=del size=1329895 2024-09-12T00:30:56.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.826+0000 7f0362c73780 1 < completed write operation key=IIZAWZDLR2QE tag=3WT46X6305WD type=write size=951090 2024-09-12T00:30:56.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.828+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=G3DERQ00VMIN type=write size=975606 2024-09-12T00:30:56.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.829+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~MMQGF0JZKIBU.0 size=1048576 2024-09-12T00:30:56.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.830+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~MMQGF0JZKIBU.1 size=964793 2024-09-12T00:30:56.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.833+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=MMQGF0JZKIBU tag=03VC457DZYL5 type=write size=3061945 2024-09-12T00:30:56.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.835+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~6AQNV867K8IX.0 size=1048576 2024-09-12T00:30:56.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.836+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~6AQNV867K8IX.1 size=1048576 2024-09-12T00:30:56.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.837+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~6AQNV867K8IX.2 size=365225 2024-09-12T00:30:56.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.837+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=6AQNV867K8IX tag=GGSGRWQWXT8B type=write size=3510953 2024-09-12T00:30:56.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.840+0000 7f0362c73780 1 < suggested remove operation key=EHBOL435W9ZE tag=2HUL30AZNWGY type=del 2024-09-12T00:30:56.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.842+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=IRTHMTUVT8NO type=write size=393949 2024-09-12T00:30:56.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.843+0000 7f0362c73780 -1 < failed to complete operation key=2DHHPBYV80O8 tag=OKOUUH02DOIP type=del size=4124786: (22) Invalid argument 2024-09-12T00:30:56.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.845+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=RS8I2E4KJ1IO type=write size=426055 2024-09-12T00:30:56.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.846+0000 7f0362c73780 1 < completed write operation key=PLAYMR18X9DZ tag=5R9KW8ISP8PW type=write size=313238 2024-09-12T00:30:56.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.849+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~FEJ0ZP6X0MET.0 size=724409 2024-09-12T00:30:56.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.849+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=FEJ0ZP6X0MET tag=2BBW9E1ZAIW5 type=write size=1772985 2024-09-12T00:30:56.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.850+0000 7f0362c73780 -1 < failed to complete operation key=XWW3882YBHAJ tag=O2ABVYZ091SS type=del size=768706: (22) Invalid argument 2024-09-12T00:30:56.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.852+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=K3MQGH1665X9 type=del size=1997878 2024-09-12T00:30:56.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.853+0000 7f0362c73780 1 < canceled operation key=X4ZML0796M7F tag=9MQMKNW9DZ82 type=del size=1266788 2024-09-12T00:30:56.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.855+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=WH99T0ARGWGH type=del size=3813443 2024-09-12T00:30:56.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.856+0000 7f0362c73780 1 < canceled operation key=XMMZOX8MH3GT tag=Z0U3J1VOKMQL type=write size=1035801 2024-09-12T00:30:56.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.860+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~16DQRFFPYWV3.0 size=60911 2024-09-12T00:30:56.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.860+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=16DQRFFPYWV3 tag=CTAAEXLYCKVP type=write size=1109487 2024-09-12T00:30:56.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.864+0000 7f0362c73780 1 < suggested update operation key=1MLL1T362X51 tag=8JX8ZJBY53H8 type=del size=1843348 2024-09-12T00:30:56.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.866+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=3KNT7XRA89D6 type=write size=445101 2024-09-12T00:30:56.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.866+0000 7f0362c73780 1 < canceled part key=_multipart_R4ABY5AY0S1P.2~98K1KV42535Q.0 size=915025 2024-09-12T00:30:56.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.869+0000 7f0362c73780 1 < canceled multipart upload key=R4ABY5AY0S1P upload=98K1KV42535Q tag=QJ4W8O6XVQVU type=write size=1963601 2024-09-12T00:30:56.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.871+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=7TA0Q179R61C type=del size=3086024 2024-09-12T00:30:56.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.872+0000 7f0362c73780 1 < completed write operation key=CZHT9UQS34JU tag=L11UKD9Y4709 type=write size=424792 2024-09-12T00:30:56.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.874+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=1EQGNTAE4LSW type=del size=4083021 2024-09-12T00:30:56.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.877+0000 7f0362c73780 1 < suggested update operation key=6AYDT9X4LC6T tag=QY8VHJXIMB1B type=del size=408885 2024-09-12T00:30:56.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.878+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=8O35FEUC6ODP type=del size=430970 2024-09-12T00:30:56.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.880+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~4KAWEQLUOLNJ.0 size=722764 2024-09-12T00:30:56.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.882+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=4KAWEQLUOLNJ tag=BKRK2R1MK3UR type=write size=1771340 2024-09-12T00:30:56.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.885+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~4FX7KZYY6SEX.0 size=547574 2024-09-12T00:30:56.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.885+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=4FX7KZYY6SEX tag=O9UM9FMVZ3LZ type=write size=1596150 2024-09-12T00:30:56.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.887+0000 7f0362c73780 -1 < failed to complete operation key=EHBOL435W9ZE tag=HV3BCKGW0CIG type=del size=2782184: (22) Invalid argument 2024-09-12T00:30:56.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.890+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~P656TOXB8ZJM.0 size=1048576 2024-09-12T00:30:56.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.891+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~P656TOXB8ZJM.1 size=1048576 2024-09-12T00:30:56.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.892+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~P656TOXB8ZJM.2 size=123290 2024-09-12T00:30:56.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.892+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=P656TOXB8ZJM tag=I5KCZXJPOWP2 type=write size=3269018 2024-09-12T00:30:56.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.893+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~4UFDSVHVCFND.0 size=1048576 2024-09-12T00:30:56.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.894+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~4UFDSVHVCFND.1 size=298633 2024-09-12T00:30:56.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.897+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=4UFDSVHVCFND tag=B8Q4A7SUGK4V type=write size=2395785 2024-09-12T00:30:56.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.899+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~O8L8X1WUA5I4.0 size=1048576 2024-09-12T00:30:56.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.900+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~O8L8X1WUA5I4.1 size=1048576 2024-09-12T00:30:56.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.901+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~O8L8X1WUA5I4.2 size=283778 2024-09-12T00:30:56.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.901+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=O8L8X1WUA5I4 tag=6M8EXGE4S7I4 type=write size=3429506 2024-09-12T00:30:56.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.903+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=VLBDHV2OQ6IT type=del 2024-09-12T00:30:56.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.905+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~AGPZF8ZHPFKR.0 size=1048576 2024-09-12T00:30:56.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.906+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~AGPZF8ZHPFKR.1 size=886628 2024-09-12T00:30:56.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.907+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=AGPZF8ZHPFKR tag=G3QSUDF78A04 type=write size=2983780 2024-09-12T00:30:56.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.908+0000 7f0362c73780 1 < completed write operation key=WT0185G517YR tag=G3DERQ00VMIN type=write size=975606 2024-09-12T00:30:56.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.909+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=TGR6T7C1ADSV type=del size=4088514 2024-09-12T00:30:56.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.910+0000 7f0362c73780 1 < canceled part key=_multipart_84T1VJG5SHU4.2~6AQNV867K8IX.0 size=1048576 2024-09-12T00:30:56.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.911+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~6AQNV867K8IX.1 size=1048576 2024-09-12T00:30:56.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.912+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~6AQNV867K8IX.2 size=365225 2024-09-12T00:30:56.912 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.914+0000 7f0362c73780 1 < canceled multipart upload key=84T1VJG5SHU4 upload=6AQNV867K8IX tag=GGSGRWQWXT8B type=write size=3510953 2024-09-12T00:30:56.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.916+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=GV4EARS05U9N type=del size=2527048 2024-09-12T00:30:56.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.917+0000 7f0362c73780 1 < completed write operation key=EHBOL435W9ZE tag=IRTHMTUVT8NO type=write size=393949 2024-09-12T00:30:56.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.920+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~GCMOY19IPLHV.0 size=1048576 2024-09-12T00:30:56.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.922+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~GCMOY19IPLHV.1 size=75233 2024-09-12T00:30:56.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.922+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=GCMOY19IPLHV tag=XB9DV51NW39B type=write size=2172385 2024-09-12T00:30:56.922 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.924+0000 7f0362c73780 1 < completed write operation key=2DHHPBYV80O8 tag=RS8I2E4KJ1IO type=write size=426055 2024-09-12T00:30:56.924 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.925+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=8CFA33EE1Y4D type=del size=2060258 2024-09-12T00:30:56.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.927+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~FEJ0ZP6X0MET.0 size=724409 2024-09-12T00:30:56.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.929+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=FEJ0ZP6X0MET tag=2BBW9E1ZAIW5 type=write size=1772985 2024-09-12T00:30:56.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.932+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~XZB23Z46C8TJ.0 size=1048576 2024-09-12T00:30:56.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.933+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~XZB23Z46C8TJ.1 size=820033 2024-09-12T00:30:56.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.933+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=XZB23Z46C8TJ tag=X3VWG55HT291 type=write size=2917185 2024-09-12T00:30:56.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.934+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=K3MQGH1665X9 type=del 2024-09-12T00:30:56.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.936+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=AUAJ1IZSD2CT type=del size=1794315 2024-09-12T00:30:56.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.937+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=WH99T0ARGWGH type=del 2024-09-12T00:30:56.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.940+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~EKP412TAKQVJ.0 size=636743 2024-09-12T00:30:56.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.940+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=EKP412TAKQVJ tag=FL1GWT53V9CM type=write size=1685319 2024-09-12T00:30:56.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.941+0000 7f0362c73780 1 < canceled part key=_multipart_EHBOL435W9ZE.2~16DQRFFPYWV3.0 size=60911 2024-09-12T00:30:56.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.943+0000 7f0362c73780 1 < canceled multipart upload key=EHBOL435W9ZE upload=16DQRFFPYWV3 tag=CTAAEXLYCKVP type=write size=1109487 2024-09-12T00:30:56.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.945+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=5XSSTKMBMDJB type=del size=1278152 2024-09-12T00:30:56.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.947+0000 7f0362c73780 1 < completed write operation key=XWW3882YBHAJ tag=3KNT7XRA89D6 type=write size=445101 2024-09-12T00:30:56.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.950+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~T0ARZT0UDB3M.0 size=1048576 2024-09-12T00:30:56.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.951+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~T0ARZT0UDB3M.1 size=1048576 2024-09-12T00:30:56.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.952+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~T0ARZT0UDB3M.2 size=450791 2024-09-12T00:30:56.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.952+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=T0ARZT0UDB3M tag=PC1T64MSE2SQ type=write size=3596519 2024-09-12T00:30:56.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.954+0000 7f0362c73780 -1 < failed to complete operation key=6AYDT9X4LC6T tag=7TA0Q179R61C type=del size=3086024: (22) Invalid argument 2024-09-12T00:30:56.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.955+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=MQRK11CS2KVP type=del size=1024606 2024-09-12T00:30:56.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.957+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=1EQGNTAE4LSW type=del 2024-09-12T00:30:56.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.960+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=2Q0D8DNRXYMK type=del size=3937439 2024-09-12T00:30:56.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.961+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=8O35FEUC6ODP type=del 2024-09-12T00:30:56.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.964+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~T3M7KTJKBJL1.0 size=1048576 2024-09-12T00:30:56.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.965+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~T3M7KTJKBJL1.1 size=1048576 2024-09-12T00:30:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.967+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~T3M7KTJKBJL1.2 size=99782 2024-09-12T00:30:56.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.967+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=T3M7KTJKBJL1 tag=WSS17BNHONTV type=write size=3245510 2024-09-12T00:30:56.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.968+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~4FX7KZYY6SEX.0 size=547574 2024-09-12T00:30:56.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.971+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=4FX7KZYY6SEX tag=O9UM9FMVZ3LZ type=write size=1596150 2024-09-12T00:30:56.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.974+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~HEZX00QBBBMJ.0 size=246140 2024-09-12T00:30:56.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.974+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=HEZX00QBBBMJ tag=YM29ACA5TKYV type=write size=1294716 2024-09-12T00:30:56.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.976+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~P656TOXB8ZJM.0 size=1048576 2024-09-12T00:30:56.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.977+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~P656TOXB8ZJM.1 size=1048576 2024-09-12T00:30:56.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.978+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~P656TOXB8ZJM.2 size=123290 2024-09-12T00:30:56.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.981+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=P656TOXB8ZJM tag=I5KCZXJPOWP2 type=write size=3269018 2024-09-12T00:30:56.981 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.983+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=SVJA19RWN5PW type=del size=1965021 2024-09-12T00:30:56.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.984+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~O8L8X1WUA5I4.0 size=1048576 2024-09-12T00:30:56.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.986+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~O8L8X1WUA5I4.1 size=1048576 2024-09-12T00:30:56.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.986+0000 7f0362c73780 1 < canceled part key=_multipart_OY30LP7FYXNF.2~O8L8X1WUA5I4.2 size=283778 2024-09-12T00:30:56.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.988+0000 7f0362c73780 1 < canceled multipart upload key=OY30LP7FYXNF upload=O8L8X1WUA5I4 tag=6M8EXGE4S7I4 type=write size=3429506 2024-09-12T00:30:56.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.991+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~JUIEZ7I20E0X.0 size=1048576 2024-09-12T00:30:56.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.992+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~JUIEZ7I20E0X.1 size=180527 2024-09-12T00:30:56.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.992+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=JUIEZ7I20E0X tag=LHQQQ4JFYWG1 type=write size=2277679 2024-09-12T00:30:56.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.992+0000 7f0362c73780 1 < canceled part key=_multipart_927NCYXX8Z2P.2~AGPZF8ZHPFKR.0 size=1048576 2024-09-12T00:30:56.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.994+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~AGPZF8ZHPFKR.1 size=886628 2024-09-12T00:30:56.994 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.996+0000 7f0362c73780 1 < canceled multipart upload key=927NCYXX8Z2P upload=AGPZF8ZHPFKR tag=G3QSUDF78A04 type=write size=2983780 2024-09-12T00:30:56.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.999+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~KDXO81AFX6PI.0 size=700523 2024-09-12T00:30:56.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:56.999+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=KDXO81AFX6PI tag=ERCLW7ZAVFT0 type=write size=1749099 2024-09-12T00:30:57.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.002+0000 7f0362c73780 1 < suggested update operation key=R4ABY5AY0S1P tag=TGR6T7C1ADSV type=del size=4088514 2024-09-12T00:30:57.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.006+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~HACUGLBZG7TQ.0 size=11270 2024-09-12T00:30:57.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.006+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=HACUGLBZG7TQ tag=A38TJYG1U0JG type=write size=1059846 2024-09-12T00:30:57.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.007+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=GV4EARS05U9N type=del 2024-09-12T00:30:57.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.009+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=YY5FIUA7S11Q type=del size=596410 2024-09-12T00:30:57.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.010+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~GCMOY19IPLHV.0 size=1048576 2024-09-12T00:30:57.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.011+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~GCMOY19IPLHV.1 size=75233 2024-09-12T00:30:57.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.014+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=GCMOY19IPLHV tag=XB9DV51NW39B type=write size=2172385 2024-09-12T00:30:57.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.016+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~K3R1ILHDDDAH.0 size=1048576 2024-09-12T00:30:57.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.018+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~K3R1ILHDDDAH.1 size=1048576 2024-09-12T00:30:57.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.019+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~K3R1ILHDDDAH.2 size=616516 2024-09-12T00:30:57.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.019+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=K3R1ILHDDDAH tag=B1PQBDJVYM50 type=write size=3762244 2024-09-12T00:30:57.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.022+0000 7f0362c73780 1 < suggested remove operation key=2DHHPBYV80O8 tag=8CFA33EE1Y4D type=del 2024-09-12T00:30:57.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.023+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=U01I19MVCAT3 type=del size=3089304 2024-09-12T00:30:57.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.025+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~XZB23Z46C8TJ.0 size=1048576 2024-09-12T00:30:57.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.026+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~XZB23Z46C8TJ.1 size=820033 2024-09-12T00:30:57.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.028+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=XZB23Z46C8TJ tag=X3VWG55HT291 type=write size=2917185 2024-09-12T00:30:57.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.030+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=9YLGNPLXNUWL type=del size=1879535 2024-09-12T00:30:57.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.031+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=AUAJ1IZSD2CT type=del 2024-09-12T00:30:57.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.033+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=6FYNBEFUYRAA type=del size=2297257 2024-09-12T00:30:57.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.034+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~EKP412TAKQVJ.0 size=636743 2024-09-12T00:30:57.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.036+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=EKP412TAKQVJ tag=FL1GWT53V9CM type=write size=1685319 2024-09-12T00:30:57.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.038+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=1UHW284JI2IS type=write size=36077 2024-09-12T00:30:57.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.041+0000 7f0362c73780 1 < suggested remove operation key=44YJP6XPIFT5 tag=5XSSTKMBMDJB type=del 2024-09-12T00:30:57.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.042+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=FS1VVACQ400L type=del size=3297508 2024-09-12T00:30:57.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.044+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~T0ARZT0UDB3M.0 size=1048576 2024-09-12T00:30:57.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.045+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~T0ARZT0UDB3M.1 size=1048576 2024-09-12T00:30:57.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.047+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~T0ARZT0UDB3M.2 size=450791 2024-09-12T00:30:57.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.049+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=T0ARZT0UDB3M tag=PC1T64MSE2SQ type=write size=3596519 2024-09-12T00:30:57.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.051+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~F76Q4OE564H8.0 size=536475 2024-09-12T00:30:57.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.051+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=F76Q4OE564H8 tag=WUFPNYNH8IRN type=write size=1585051 2024-09-12T00:30:57.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.053+0000 7f0362c73780 1 < canceled operation key=I3B48QD9E40S tag=MQRK11CS2KVP type=del size=1024606 2024-09-12T00:30:57.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.054+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=NNVUF6VE63J0 type=write size=247686 2024-09-12T00:30:57.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.056+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=2Q0D8DNRXYMK type=del 2024-09-12T00:30:57.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.058+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~4IK63QQI2Q5W.0 size=1048576 2024-09-12T00:30:57.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.059+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~4IK63QQI2Q5W.1 size=243710 2024-09-12T00:30:57.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.059+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=4IK63QQI2Q5W tag=MYIARZ01WM2G type=write size=2340862 2024-09-12T00:30:57.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.060+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~T3M7KTJKBJL1.0 size=1048576 2024-09-12T00:30:57.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.062+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~T3M7KTJKBJL1.1 size=1048576 2024-09-12T00:30:57.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.063+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~T3M7KTJKBJL1.2 size=99782 2024-09-12T00:30:57.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.065+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=T3M7KTJKBJL1 tag=WSS17BNHONTV type=write size=3245510 2024-09-12T00:30:57.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.066+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=B72TYAKSC77M type=write size=1015881 2024-09-12T00:30:57.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.068+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~HEZX00QBBBMJ.0 size=246140 2024-09-12T00:30:57.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.070+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=HEZX00QBBBMJ tag=YM29ACA5TKYV type=write size=1294716 2024-09-12T00:30:57.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.072+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=KQPXO1TGTCOG type=del size=3949198 2024-09-12T00:30:57.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.073+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=SVJA19RWN5PW type=del 2024-09-12T00:30:57.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.075+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~9CFY7M9IEZBM.0 size=1048576 2024-09-12T00:30:57.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.077+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~9CFY7M9IEZBM.1 size=1048576 2024-09-12T00:30:57.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.078+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~9CFY7M9IEZBM.2 size=274136 2024-09-12T00:30:57.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.078+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=9CFY7M9IEZBM tag=BGQR9FAS95ES type=write size=3419864 2024-09-12T00:30:57.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.080+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~JUIEZ7I20E0X.0 size=1048576 2024-09-12T00:30:57.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.081+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~JUIEZ7I20E0X.1 size=180527 2024-09-12T00:30:57.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.083+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=JUIEZ7I20E0X tag=LHQQQ4JFYWG1 type=write size=2277679 2024-09-12T00:30:57.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.085+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~LSFHKY13CEC6.0 size=1048576 2024-09-12T00:30:57.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.086+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~LSFHKY13CEC6.1 size=1048576 2024-09-12T00:30:57.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.087+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~LSFHKY13CEC6.2 size=947111 2024-09-12T00:30:57.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.087+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=LSFHKY13CEC6 tag=B17I164N5BL2 type=write size=4092839 2024-09-12T00:30:57.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.089+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~KDXO81AFX6PI.0 size=700523 2024-09-12T00:30:57.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.091+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=KDXO81AFX6PI tag=ERCLW7ZAVFT0 type=write size=1749099 2024-09-12T00:30:57.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.093+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=FY121RBZO4OY type=del size=3768152 2024-09-12T00:30:57.092 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.094+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~HACUGLBZG7TQ.0 size=11270 2024-09-12T00:30:57.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.097+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=HACUGLBZG7TQ tag=A38TJYG1U0JG type=write size=1059846 2024-09-12T00:30:57.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.098+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=0G0KYEJQ1MS2 type=del size=73965 2024-09-12T00:30:57.098 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.100+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=YY5FIUA7S11Q type=del 2024-09-12T00:30:57.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.101+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=Q2GIB07C0NOG type=del size=2501869 2024-09-12T00:30:57.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.103+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~K3R1ILHDDDAH.0 size=1048576 2024-09-12T00:30:57.102 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.104+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~K3R1ILHDDDAH.1 size=1048576 2024-09-12T00:30:57.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.105+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~K3R1ILHDDDAH.2 size=616516 2024-09-12T00:30:57.106 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.107+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=K3R1ILHDDDAH tag=B1PQBDJVYM50 type=write size=3762244 2024-09-12T00:30:57.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.109+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=7FJENZSAL6PA type=del size=1241273 2024-09-12T00:30:57.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.112+0000 7f0362c73780 1 < suggested update operation key=IIZAWZDLR2QE tag=U01I19MVCAT3 type=del size=3089304 2024-09-12T00:30:57.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.114+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~L9OD6GRK8TLI.0 size=1048576 2024-09-12T00:30:57.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.115+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~L9OD6GRK8TLI.1 size=1048576 2024-09-12T00:30:57.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.117+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~L9OD6GRK8TLI.2 size=792987 2024-09-12T00:30:57.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.117+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=L9OD6GRK8TLI tag=30P3BUB7FH4I type=write size=3938715 2024-09-12T00:30:57.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.118+0000 7f0362c73780 1 < canceled operation key=X4ZML0796M7F tag=9YLGNPLXNUWL type=del size=1879535 2024-09-12T00:30:57.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.121+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~5U7ZX0JI05ME.0 size=1048576 2024-09-12T00:30:57.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.122+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~5U7ZX0JI05ME.1 size=543487 2024-09-12T00:30:57.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.122+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=5U7ZX0JI05ME tag=WFT63IMIP30T type=write size=2640639 2024-09-12T00:30:57.122 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.124+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=6FYNBEFUYRAA type=del 2024-09-12T00:30:57.124 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.125+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=1WMIVROAJVKY type=write size=930748 2024-09-12T00:30:57.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.127+0000 7f0362c73780 1 < completed write operation key=1IPW8SJ6SSU2 tag=1UHW284JI2IS type=write size=36077 2024-09-12T00:30:57.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.130+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~1BB2AMABS9SL.0 size=1048576 2024-09-12T00:30:57.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.131+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~1BB2AMABS9SL.1 size=94736 2024-09-12T00:30:57.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.131+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=1BB2AMABS9SL tag=N5PQZJY0VW06 type=write size=2191888 2024-09-12T00:30:57.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.132+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=FS1VVACQ400L type=del 2024-09-12T00:30:57.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.134+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=01ZZL9BEEOJ6 type=del size=3533957 2024-09-12T00:30:57.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.135+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~F76Q4OE564H8.0 size=536475 2024-09-12T00:30:57.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.140+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=F76Q4OE564H8 tag=WUFPNYNH8IRN type=write size=1585051 2024-09-12T00:30:57.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.141+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=0H4S3YUJ7X5C type=write size=647209 2024-09-12T00:30:57.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.143+0000 7f0362c73780 1 < completed write operation key=6AYDT9X4LC6T tag=NNVUF6VE63J0 type=write size=247686 2024-09-12T00:30:57.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.144+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=0TP30PQJ9USO type=write size=899798 2024-09-12T00:30:57.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.146+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~4IK63QQI2Q5W.0 size=1048576 2024-09-12T00:30:57.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.147+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~4IK63QQI2Q5W.1 size=243710 2024-09-12T00:30:57.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.149+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=4IK63QQI2Q5W tag=MYIARZ01WM2G type=write size=2340862 2024-09-12T00:30:57.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.150+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=PJC73CK6ZXFO type=write size=944878 2024-09-12T00:30:57.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.151+0000 7f0362c73780 1 < completed write operation key=PLAYMR18X9DZ tag=B72TYAKSC77M type=write size=1015881 2024-09-12T00:30:57.151 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.153+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=LCWRTF3SCAUS type=write size=859613 2024-09-12T00:30:57.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.155+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=KQPXO1TGTCOG type=del 2024-09-12T00:30:57.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.156+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=RIG0TX6OJR7B type=write size=666751 2024-09-12T00:30:57.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.158+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~9CFY7M9IEZBM.0 size=1048576 2024-09-12T00:30:57.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.159+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~9CFY7M9IEZBM.1 size=1048576 2024-09-12T00:30:57.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.160+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~9CFY7M9IEZBM.2 size=274136 2024-09-12T00:30:57.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.163+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=9CFY7M9IEZBM tag=BGQR9FAS95ES type=write size=3419864 2024-09-12T00:30:57.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.164+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=TGVT30AT81CX type=del size=1233505 2024-09-12T00:30:57.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.165+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~LSFHKY13CEC6.0 size=1048576 2024-09-12T00:30:57.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.165+0000 7f0362c73780 1 < canceled part key=_multipart_KWDEKRO3WICD.2~LSFHKY13CEC6.1 size=1048576 2024-09-12T00:30:57.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.167+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~LSFHKY13CEC6.2 size=947111 2024-09-12T00:30:57.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.169+0000 7f0362c73780 1 < canceled multipart upload key=KWDEKRO3WICD upload=LSFHKY13CEC6 tag=B17I164N5BL2 type=write size=4092839 2024-09-12T00:30:57.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.170+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=O6P5Z1GKAH6E type=del size=2821508 2024-09-12T00:30:57.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.171+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=FY121RBZO4OY type=del 2024-09-12T00:30:57.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.174+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~LIL573LLQGGB.0 size=911262 2024-09-12T00:30:57.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.174+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=LIL573LLQGGB tag=ATM7H078ZD1H type=write size=1959838 2024-09-12T00:30:57.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.176+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=0G0KYEJQ1MS2 type=del 2024-09-12T00:30:57.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.177+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=Y1TTDDRPTXZO type=write size=325820 2024-09-12T00:30:57.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.179+0000 7f0362c73780 1 < canceled operation key=EHBOL435W9ZE tag=Q2GIB07C0NOG type=del size=2501869 2024-09-12T00:30:57.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.180+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=FN50K6H2071Q type=del size=3492718 2024-09-12T00:30:57.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.181+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=7FJENZSAL6PA type=del 2024-09-12T00:30:57.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.183+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=RY3SWIQ33IYO type=del size=2269194 2024-09-12T00:30:57.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.184+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~L9OD6GRK8TLI.0 size=1048576 2024-09-12T00:30:57.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.186+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~L9OD6GRK8TLI.1 size=1048576 2024-09-12T00:30:57.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.187+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~L9OD6GRK8TLI.2 size=792987 2024-09-12T00:30:57.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.189+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=L9OD6GRK8TLI tag=30P3BUB7FH4I type=write size=3938715 2024-09-12T00:30:57.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.190+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=3ZVOYW619WF1 type=del size=1004243 2024-09-12T00:30:57.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.192+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~5U7ZX0JI05ME.0 size=1048576 2024-09-12T00:30:57.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.193+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~5U7ZX0JI05ME.1 size=543487 2024-09-12T00:30:57.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.195+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=5U7ZX0JI05ME tag=WFT63IMIP30T type=write size=2640639 2024-09-12T00:30:57.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.197+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=JWC35YNHA4ZN type=write size=281355 2024-09-12T00:30:57.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.200+0000 7f0362c73780 1 < suggested remove operation key=YTN99RBTKO39 tag=1WMIVROAJVKY type=write 2024-09-12T00:30:57.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.202+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=IN367TOBSBUY type=del size=2717555 2024-09-12T00:30:57.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.204+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~1BB2AMABS9SL.0 size=1048576 2024-09-12T00:30:57.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.205+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~1BB2AMABS9SL.1 size=94736 2024-09-12T00:30:57.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.207+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=1BB2AMABS9SL tag=N5PQZJY0VW06 type=write size=2191888 2024-09-12T00:30:57.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.209+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=X0L5GOC7COV8 type=write size=207552 2024-09-12T00:30:57.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.210+0000 7f0362c73780 1 < canceled operation key=1MLL1T362X51 tag=01ZZL9BEEOJ6 type=del size=3533957 2024-09-12T00:30:57.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.212+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=V14T2AL501SV type=write size=864656 2024-09-12T00:30:57.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.214+0000 7f0362c73780 1 < completed write operation key=2DHHPBYV80O8 tag=0H4S3YUJ7X5C type=write size=647209 2024-09-12T00:30:57.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.216+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~VFQNDN326MKZ.0 size=274350 2024-09-12T00:30:57.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.216+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=VFQNDN326MKZ tag=U880GNLDW8I0 type=write size=1322926 2024-09-12T00:30:57.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.218+0000 7f0362c73780 1 < completed write operation key=PYCRNXC9ITGF tag=0TP30PQJ9USO type=write size=899798 2024-09-12T00:30:57.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.221+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~IOGT2DWDNBMT.0 size=1048576 2024-09-12T00:30:57.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.222+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~IOGT2DWDNBMT.1 size=1048576 2024-09-12T00:30:57.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.223+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~IOGT2DWDNBMT.2 size=140794 2024-09-12T00:30:57.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.223+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=IOGT2DWDNBMT tag=ES21Q8J6GW70 type=write size=3286522 2024-09-12T00:30:57.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.225+0000 7f0362c73780 1 < completed write operation key=XR8L0HL374VC tag=PJC73CK6ZXFO type=write size=944878 2024-09-12T00:30:57.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.226+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=XIJQJIFUXPQA type=del size=3675946 2024-09-12T00:30:57.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.229+0000 7f0362c73780 1 < suggested update operation key=927NCYXX8Z2P tag=LCWRTF3SCAUS type=write size=859613 2024-09-12T00:30:57.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.231+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=Z2JNMJ9WNGO1 type=del size=3249255 2024-09-12T00:30:57.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.233+0000 7f0362c73780 -1 < failed to complete operation key=YTN99RBTKO39 tag=RIG0TX6OJR7B type=write size=666751: (22) Invalid argument 2024-09-12T00:30:57.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.234+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=1EY3N788DHQP type=del size=3117760 2024-09-12T00:30:57.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.236+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=TGVT30AT81CX type=del 2024-09-12T00:30:57.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.239+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~1Z9OFVII6BSG.0 size=1048576 2024-09-12T00:30:57.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.240+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~1Z9OFVII6BSG.1 size=726544 2024-09-12T00:30:57.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.240+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=1Z9OFVII6BSG tag=FE68VMAJ6OQ8 type=write size=2823696 2024-09-12T00:30:57.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.241+0000 7f0362c73780 -1 < failed to complete operation key=927NCYXX8Z2P tag=O6P5Z1GKAH6E type=del size=2821508: (22) Invalid argument 2024-09-12T00:30:57.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.243+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=QJQLAUBA0HPP type=del size=1538651 2024-09-12T00:30:57.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.244+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~LIL573LLQGGB.0 size=911262 2024-09-12T00:30:57.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.246+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=LIL573LLQGGB tag=ATM7H078ZD1H type=write size=1959838 2024-09-12T00:30:57.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.249+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~9NLMWCXGHUYZ.0 size=221618 2024-09-12T00:30:57.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.249+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=9NLMWCXGHUYZ tag=P30XZEC8V3OO type=write size=1270194 2024-09-12T00:30:57.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.251+0000 7f0362c73780 1 < completed write operation key=OY30LP7FYXNF tag=Y1TTDDRPTXZO type=write size=325820 2024-09-12T00:30:57.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.252+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=3B9KNV68MT9P type=del size=1816620 2024-09-12T00:30:57.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.255+0000 7f0362c73780 1 < suggested update operation key=6AYDT9X4LC6T tag=FN50K6H2071Q type=del size=3492718 2024-09-12T00:30:57.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.257+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~PL5BLMGKUIEL.0 size=823606 2024-09-12T00:30:57.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.257+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=PL5BLMGKUIEL tag=LC4DUA0XH4WQ type=write size=1872182 2024-09-12T00:30:57.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.259+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=RY3SWIQ33IYO type=del 2024-09-12T00:30:57.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.260+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=SWFE206KVOV0 type=del size=2051646 2024-09-12T00:30:57.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.262+0000 7f0362c73780 1 < canceled operation key=44YJP6XPIFT5 tag=3ZVOYW619WF1 type=del size=1004243 2024-09-12T00:30:57.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.264+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~QYXZIJBWIP3L.0 size=1048576 2024-09-12T00:30:57.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.266+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~QYXZIJBWIP3L.1 size=1048576 2024-09-12T00:30:57.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.267+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~QYXZIJBWIP3L.2 size=893553 2024-09-12T00:30:57.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.267+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=QYXZIJBWIP3L tag=S51110XZAV17 type=write size=4039281 2024-09-12T00:30:57.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.270+0000 7f0362c73780 1 < suggested update operation key=Q6M0D2698CUZ tag=JWC35YNHA4ZN type=write size=281355 2024-09-12T00:30:57.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.271+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=5380G5WAYPAF type=del size=2221744 2024-09-12T00:30:57.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.273+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=IN367TOBSBUY type=del 2024-09-12T00:30:57.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.275+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~Y0GQNQ34UOSY.0 size=1048576 2024-09-12T00:30:57.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.277+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~Y0GQNQ34UOSY.1 size=1048576 2024-09-12T00:30:57.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.279+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~Y0GQNQ34UOSY.2 size=895792 2024-09-12T00:30:57.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.279+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=Y0GQNQ34UOSY tag=ZELBRG6JHA7Q type=write size=4041520 2024-09-12T00:30:57.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.282+0000 7f0362c73780 1 < suggested update operation key=G4G6E7KTTZY9 tag=X0L5GOC7COV8 type=write size=207552 2024-09-12T00:30:57.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.283+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=1B9NTB9E62Y7 type=del size=3140314 2024-09-12T00:30:57.282 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.284+0000 7f0362c73780 1 < completed write operation key=44YJP6XPIFT5 tag=V14T2AL501SV type=write size=864656 2024-09-12T00:30:57.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.286+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=MHGRAKGMK6FG type=write size=153093 2024-09-12T00:30:57.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.287+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~VFQNDN326MKZ.0 size=274350 2024-09-12T00:30:57.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.289+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=VFQNDN326MKZ tag=U880GNLDW8I0 type=write size=1322926 2024-09-12T00:30:57.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.291+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=1K33DAG8QA2F type=del size=1300402 2024-09-12T00:30:57.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.292+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~IOGT2DWDNBMT.0 size=1048576 2024-09-12T00:30:57.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.293+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~IOGT2DWDNBMT.1 size=1048576 2024-09-12T00:30:57.293 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.295+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~IOGT2DWDNBMT.2 size=140794 2024-09-12T00:30:57.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.297+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=IOGT2DWDNBMT tag=ES21Q8J6GW70 type=write size=3286522 2024-09-12T00:30:57.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.298+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=3SA921KJRD5O type=del size=3843878 2024-09-12T00:30:57.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.300+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=XIJQJIFUXPQA type=del 2024-09-12T00:30:57.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.301+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=LCYWQME9CL3T type=del size=2353651 2024-09-12T00:30:57.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.302+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=Z2JNMJ9WNGO1 type=del 2024-09-12T00:30:57.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.305+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~V83RMN5HY5Q0.0 size=1048576 2024-09-12T00:30:57.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.306+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~V83RMN5HY5Q0.1 size=1048576 2024-09-12T00:30:57.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.308+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~V83RMN5HY5Q0.2 size=443311 2024-09-12T00:30:57.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.308+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=V83RMN5HY5Q0 tag=EJTS4G960PEQ type=write size=3589039 2024-09-12T00:30:57.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.309+0000 7f0362c73780 -1 < failed to complete operation key=6AYDT9X4LC6T tag=1EY3N788DHQP type=del size=3117760: (22) Invalid argument 2024-09-12T00:30:57.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.312+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~ZUEK986ODFM7.0 size=1048576 2024-09-12T00:30:57.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.313+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~ZUEK986ODFM7.1 size=1048576 2024-09-12T00:30:57.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.314+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~ZUEK986ODFM7.2 size=657187 2024-09-12T00:30:57.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.314+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=ZUEK986ODFM7 tag=EG9TAMJNO3FQ type=write size=3802915 2024-09-12T00:30:57.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.315+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~1Z9OFVII6BSG.0 size=1048576 2024-09-12T00:30:57.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.317+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~1Z9OFVII6BSG.1 size=726544 2024-09-12T00:30:57.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.319+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=1Z9OFVII6BSG tag=FE68VMAJ6OQ8 type=write size=2823696 2024-09-12T00:30:57.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.322+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~S05JRD8C0316.0 size=315385 2024-09-12T00:30:57.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.322+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=S05JRD8C0316 tag=DHKZT0IYPI2F type=write size=1363961 2024-09-12T00:30:57.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.324+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=QJQLAUBA0HPP type=del 2024-09-12T00:30:57.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.326+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~AUIZXOCBGOP2.0 size=1048576 2024-09-12T00:30:57.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.327+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~AUIZXOCBGOP2.1 size=1048576 2024-09-12T00:30:57.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.329+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~AUIZXOCBGOP2.2 size=511830 2024-09-12T00:30:57.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.329+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=AUIZXOCBGOP2 tag=H1KD33751LZ7 type=write size=3657558 2024-09-12T00:30:57.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.330+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~9NLMWCXGHUYZ.0 size=221618 2024-09-12T00:30:57.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.332+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=9NLMWCXGHUYZ tag=P30XZEC8V3OO type=write size=1270194 2024-09-12T00:30:57.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.334+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=OXZGSHYSGTQE type=del size=971014 2024-09-12T00:30:57.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.335+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=3B9KNV68MT9P type=del 2024-09-12T00:30:57.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.336+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=Q4YYJ8ARY1RN type=del size=3366023 2024-09-12T00:30:57.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.338+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~PL5BLMGKUIEL.0 size=823606 2024-09-12T00:30:57.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.340+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=PL5BLMGKUIEL tag=LC4DUA0XH4WQ type=write size=1872182 2024-09-12T00:30:57.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.343+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~ARGRE1M9S7VO.0 size=5127 2024-09-12T00:30:57.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.343+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=ARGRE1M9S7VO tag=79MF38J52UFJ type=write size=1053703 2024-09-12T00:30:57.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.344+0000 7f0362c73780 1 < canceled operation key=3XZZX53L26G5 tag=SWFE206KVOV0 type=del size=2051646 2024-09-12T00:30:57.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.346+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=GUGS24PN2BVR type=del size=1116324 2024-09-12T00:30:57.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.347+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~QYXZIJBWIP3L.0 size=1048576 2024-09-12T00:30:57.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.349+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~QYXZIJBWIP3L.1 size=1048576 2024-09-12T00:30:57.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.350+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~QYXZIJBWIP3L.2 size=893553 2024-09-12T00:30:57.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.352+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=QYXZIJBWIP3L tag=S51110XZAV17 type=write size=4039281 2024-09-12T00:30:57.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.354+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=MWE4CEOTGK5T type=write size=45454 2024-09-12T00:30:57.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.355+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=5380G5WAYPAF type=del 2024-09-12T00:30:57.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.356+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=T10BBN05WQ2X type=write size=274143 2024-09-12T00:30:57.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.358+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~Y0GQNQ34UOSY.0 size=1048576 2024-09-12T00:30:57.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.359+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~Y0GQNQ34UOSY.1 size=1048576 2024-09-12T00:30:57.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.360+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~Y0GQNQ34UOSY.2 size=895792 2024-09-12T00:30:57.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.362+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=Y0GQNQ34UOSY tag=ZELBRG6JHA7Q type=write size=4041520 2024-09-12T00:30:57.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.565+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=WLFE0IA2XWMP type=del size=1664536 2024-09-12T00:30:57.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.566+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=1B9NTB9E62Y7 type=del 2024-09-12T00:30:57.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.568+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=C0CBLKCVZFM1 type=del size=2589012 2024-09-12T00:30:57.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.571+0000 7f0362c73780 1 < suggested update operation key=VD0LFCNLI1YI tag=MHGRAKGMK6FG type=write size=153093 2024-09-12T00:30:57.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.574+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~AXO1KXPMKAM1.0 size=1048576 2024-09-12T00:30:57.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.575+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~AXO1KXPMKAM1.1 size=399427 2024-09-12T00:30:57.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.575+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=AXO1KXPMKAM1 tag=R0RA54ZF0T86 type=write size=2496579 2024-09-12T00:30:57.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.577+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=1K33DAG8QA2F type=del 2024-09-12T00:30:57.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.580+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~HHSYGXFNZU6C.0 size=1048576 2024-09-12T00:30:57.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.582+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~HHSYGXFNZU6C.1 size=1048576 2024-09-12T00:30:57.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.583+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~HHSYGXFNZU6C.2 size=1032514 2024-09-12T00:30:57.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.583+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=HHSYGXFNZU6C tag=2CP987ZK7FY0 type=write size=4178242 2024-09-12T00:30:57.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.585+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=3SA921KJRD5O type=del 2024-09-12T00:30:57.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.587+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=UWUXKW15ZIDQ type=del size=2511557 2024-09-12T00:30:57.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.589+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=LCYWQME9CL3T type=del 2024-09-12T00:30:57.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.592+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~9GKTG3EMR71W.0 size=1048576 2024-09-12T00:30:57.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.593+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~9GKTG3EMR71W.1 size=1048576 2024-09-12T00:30:57.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.594+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~9GKTG3EMR71W.2 size=257388 2024-09-12T00:30:57.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.594+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=9GKTG3EMR71W tag=AE52ZM8Q869H type=write size=3403116 2024-09-12T00:30:57.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.596+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~V83RMN5HY5Q0.0 size=1048576 2024-09-12T00:30:57.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.597+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~V83RMN5HY5Q0.1 size=1048576 2024-09-12T00:30:57.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.599+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~V83RMN5HY5Q0.2 size=443311 2024-09-12T00:30:57.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.601+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=V83RMN5HY5Q0 tag=EJTS4G960PEQ type=write size=3589039 2024-09-12T00:30:57.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.604+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~EW11WEOHY0TP.0 size=1048576 2024-09-12T00:30:57.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.605+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~EW11WEOHY0TP.1 size=1048576 2024-09-12T00:30:57.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.606+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~EW11WEOHY0TP.2 size=304264 2024-09-12T00:30:57.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.606+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=EW11WEOHY0TP tag=TOG1Y30PKIP4 type=write size=3449992 2024-09-12T00:30:57.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.607+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~ZUEK986ODFM7.0 size=1048576 2024-09-12T00:30:57.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.609+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~ZUEK986ODFM7.1 size=1048576 2024-09-12T00:30:57.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.610+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~ZUEK986ODFM7.2 size=657187 2024-09-12T00:30:57.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.612+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=ZUEK986ODFM7 tag=EG9TAMJNO3FQ type=write size=3802915 2024-09-12T00:30:57.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.614+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=NC3ZFFW4ITPC type=del size=3779063 2024-09-12T00:30:57.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.616+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~S05JRD8C0316.0 size=315385 2024-09-12T00:30:57.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.618+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=S05JRD8C0316 tag=DHKZT0IYPI2F type=write size=1363961 2024-09-12T00:30:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.620+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=NW36VK2MYS0D type=del size=1393021 2024-09-12T00:30:57.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.620+0000 7f0362c73780 1 < canceled part key=_multipart_KWDEKRO3WICD.2~AUIZXOCBGOP2.0 size=1048576 2024-09-12T00:30:57.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.621+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~AUIZXOCBGOP2.1 size=1048576 2024-09-12T00:30:57.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.623+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~AUIZXOCBGOP2.2 size=511830 2024-09-12T00:30:57.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.626+0000 7f0362c73780 1 < canceled multipart upload key=KWDEKRO3WICD upload=AUIZXOCBGOP2 tag=H1KD33751LZ7 type=write size=3657558 2024-09-12T00:30:57.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.627+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=R5ZMJM0SVDVE type=del size=3017123 2024-09-12T00:30:57.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.629+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=OXZGSHYSGTQE type=del 2024-09-12T00:30:57.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.632+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~8ITRX9T1RMT3.0 size=1048576 2024-09-12T00:30:57.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.633+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~8ITRX9T1RMT3.1 size=1048576 2024-09-12T00:30:57.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.635+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~8ITRX9T1RMT3.2 size=696986 2024-09-12T00:30:57.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.635+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=8ITRX9T1RMT3 tag=RTC80L78Q753 type=write size=3842714 2024-09-12T00:30:57.635 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.637+0000 7f0362c73780 1 < canceled operation key=Q6M0D2698CUZ tag=Q4YYJ8ARY1RN type=del size=3366023 2024-09-12T00:30:57.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.638+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=PY7T7Y281BKF type=del size=1021078 2024-09-12T00:30:57.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.640+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~ARGRE1M9S7VO.0 size=5127 2024-09-12T00:30:57.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.643+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=ARGRE1M9S7VO tag=79MF38J52UFJ type=write size=1053703 2024-09-12T00:30:57.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.644+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=DDXF7AQ12OMI type=del size=3305761 2024-09-12T00:30:57.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.646+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=GUGS24PN2BVR type=del 2024-09-12T00:30:57.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.648+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~6ICX4SBUHI5Q.0 size=1048576 2024-09-12T00:30:57.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.649+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~6ICX4SBUHI5Q.1 size=1048576 2024-09-12T00:30:57.649 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.651+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~6ICX4SBUHI5Q.2 size=479039 2024-09-12T00:30:57.649 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.651+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=6ICX4SBUHI5Q tag=MYLDXUM00C5N type=write size=3624767 2024-09-12T00:30:57.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.652+0000 7f0362c73780 1 < completed write operation key=IIZAWZDLR2QE tag=MWE4CEOTGK5T type=write size=45454 2024-09-12T00:30:57.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.655+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~33W3CS1NBD35.0 size=1048576 2024-09-12T00:30:57.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.656+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~33W3CS1NBD35.1 size=1048576 2024-09-12T00:30:57.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.657+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~33W3CS1NBD35.2 size=371061 2024-09-12T00:30:57.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.657+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=33W3CS1NBD35 tag=M338KV0SE9DJ type=write size=3516789 2024-09-12T00:30:57.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.658+0000 7f0362c73780 1 < completed write operation key=HWSQFSK29S0V tag=T10BBN05WQ2X type=write size=274143 2024-09-12T00:30:57.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.660+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=YO7WKC8S7YZZ type=del size=2075563 2024-09-12T00:30:57.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.661+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=WLFE0IA2XWMP type=del 2024-09-12T00:30:57.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.664+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~DLAA7H585LYJ.0 size=181746 2024-09-12T00:30:57.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.664+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=DLAA7H585LYJ tag=32ME5FV4RWL7 type=write size=1230322 2024-09-12T00:30:57.663 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.665+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=C0CBLKCVZFM1 type=del 2024-09-12T00:30:57.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.667+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=59BVGWD1W9FP type=del size=1875631 2024-09-12T00:30:57.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.668+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~AXO1KXPMKAM1.0 size=1048576 2024-09-12T00:30:57.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.669+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~AXO1KXPMKAM1.1 size=399427 2024-09-12T00:30:57.670 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.672+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=AXO1KXPMKAM1 tag=R0RA54ZF0T86 type=write size=2496579 2024-09-12T00:30:57.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.673+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=UWKJ4T90QMZH type=del size=705221 2024-09-12T00:30:57.673 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.675+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~HHSYGXFNZU6C.0 size=1048576 2024-09-12T00:30:57.673 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.675+0000 7f0362c73780 1 < canceled part key=_multipart_6AYDT9X4LC6T.2~HHSYGXFNZU6C.1 size=1048576 2024-09-12T00:30:57.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.676+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~HHSYGXFNZU6C.2 size=1032514 2024-09-12T00:30:57.677 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.679+0000 7f0362c73780 1 < canceled multipart upload key=6AYDT9X4LC6T upload=HHSYGXFNZU6C tag=2CP987ZK7FY0 type=write size=4178242 2024-09-12T00:30:57.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.681+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~I66EYVKWCCAX.0 size=1048576 2024-09-12T00:30:57.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.683+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~I66EYVKWCCAX.1 size=364605 2024-09-12T00:30:57.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.683+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=I66EYVKWCCAX tag=Z1NZZYQKEAJ1 type=write size=2461757 2024-09-12T00:30:57.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.686+0000 7f0362c73780 1 < suggested remove operation key=OY30LP7FYXNF tag=UWUXKW15ZIDQ type=del 2024-09-12T00:30:57.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.687+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=ST8KIGPEAR23 type=write size=370363 2024-09-12T00:30:57.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.689+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~9GKTG3EMR71W.0 size=1048576 2024-09-12T00:30:57.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.689+0000 7f0362c73780 1 < canceled part key=_multipart_R4ABY5AY0S1P.2~9GKTG3EMR71W.1 size=1048576 2024-09-12T00:30:57.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.690+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~9GKTG3EMR71W.2 size=257388 2024-09-12T00:30:57.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.693+0000 7f0362c73780 1 < canceled multipart upload key=R4ABY5AY0S1P upload=9GKTG3EMR71W tag=AE52ZM8Q869H type=write size=3403116 2024-09-12T00:30:57.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.696+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~XKJ2UQPKIQK1.0 size=515244 2024-09-12T00:30:57.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.696+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=XKJ2UQPKIQK1 tag=RA152TXQC8FZ type=write size=1563820 2024-09-12T00:30:57.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.697+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~EW11WEOHY0TP.0 size=1048576 2024-09-12T00:30:57.696 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.698+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~EW11WEOHY0TP.1 size=1048576 2024-09-12T00:30:57.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.699+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~EW11WEOHY0TP.2 size=304264 2024-09-12T00:30:57.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.701+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=EW11WEOHY0TP tag=TOG1Y30PKIP4 type=write size=3449992 2024-09-12T00:30:57.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.704+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~BJWSC9ERDSR6.0 size=625276 2024-09-12T00:30:57.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.704+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=BJWSC9ERDSR6 tag=QE2PWS01HJIH type=write size=1673852 2024-09-12T00:30:57.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.707+0000 7f0362c73780 1 < suggested update operation key=XR8L0HL374VC tag=NC3ZFFW4ITPC type=del size=3779063 2024-09-12T00:30:57.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.709+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=4JPBOZB63AEM type=del size=498019 2024-09-12T00:30:57.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.710+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=NW36VK2MYS0D type=del 2024-09-12T00:30:57.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.712+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=5EU4TYCOSV2U type=del size=4125251 2024-09-12T00:30:57.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.713+0000 7f0362c73780 1 < canceled operation key=EHBOL435W9ZE tag=R5ZMJM0SVDVE type=del size=3017123 2024-09-12T00:30:57.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.715+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=M25FE11D19LV type=del size=2783780 2024-09-12T00:30:57.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.715+0000 7f0362c73780 1 < canceled part key=_multipart_I3B48QD9E40S.2~8ITRX9T1RMT3.0 size=1048576 2024-09-12T00:30:57.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.716+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~8ITRX9T1RMT3.1 size=1048576 2024-09-12T00:30:57.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.717+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~8ITRX9T1RMT3.2 size=696986 2024-09-12T00:30:57.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.720+0000 7f0362c73780 1 < canceled multipart upload key=I3B48QD9E40S upload=8ITRX9T1RMT3 tag=RTC80L78Q753 type=write size=3842714 2024-09-12T00:30:57.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.721+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=HA4JGHRHI0U1 type=del size=477215 2024-09-12T00:30:57.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.723+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=PY7T7Y281BKF type=del 2024-09-12T00:30:57.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.725+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~J2J13A9S64HZ.0 size=1048576 2024-09-12T00:30:57.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.726+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~J2J13A9S64HZ.1 size=1048576 2024-09-12T00:30:57.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.728+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~J2J13A9S64HZ.2 size=934721 2024-09-12T00:30:57.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.728+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=J2J13A9S64HZ tag=ZEQ74XTP7WHV type=write size=4080449 2024-09-12T00:30:57.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.729+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=DDXF7AQ12OMI type=del 2024-09-12T00:30:57.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.732+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~8KA1GT4Y0YGS.0 size=916199 2024-09-12T00:30:57.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.732+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=8KA1GT4Y0YGS tag=2R2ADBWPDY5Z type=write size=1964775 2024-09-12T00:30:57.731 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.733+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~6ICX4SBUHI5Q.0 size=1048576 2024-09-12T00:30:57.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.734+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~6ICX4SBUHI5Q.1 size=1048576 2024-09-12T00:30:57.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.735+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~6ICX4SBUHI5Q.2 size=479039 2024-09-12T00:30:57.736 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.738+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=6ICX4SBUHI5Q tag=MYLDXUM00C5N type=write size=3624767 2024-09-12T00:30:57.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.739+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=ZFK8LLXV8N28 type=del size=2395667 2024-09-12T00:30:57.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.740+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~33W3CS1NBD35.0 size=1048576 2024-09-12T00:30:57.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.741+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~33W3CS1NBD35.1 size=1048576 2024-09-12T00:30:57.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.743+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~33W3CS1NBD35.2 size=371061 2024-09-12T00:30:57.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.745+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=33W3CS1NBD35 tag=M338KV0SE9DJ type=write size=3516789 2024-09-12T00:30:57.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.746+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=YLZ0XXI16THS type=del size=1031988 2024-09-12T00:30:57.747 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.749+0000 7f0362c73780 1 < suggested remove operation key=R4ABY5AY0S1P tag=YO7WKC8S7YZZ type=del 2024-09-12T00:30:57.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.751+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=NYREWX93SZ1L type=del size=2661452 2024-09-12T00:30:57.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.753+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~DLAA7H585LYJ.0 size=181746 2024-09-12T00:30:57.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.755+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=DLAA7H585LYJ tag=32ME5FV4RWL7 type=write size=1230322 2024-09-12T00:30:57.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.757+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~QU13DGZ0173I.0 size=628898 2024-09-12T00:30:57.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.757+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=QU13DGZ0173I tag=2Z182007Q87Q type=write size=1677474 2024-09-12T00:30:57.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.759+0000 7f0362c73780 -1 < failed to complete operation key=R4ABY5AY0S1P tag=59BVGWD1W9FP type=del size=1875631: (22) Invalid argument 2024-09-12T00:30:57.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.761+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~ZM60T841VK58.0 size=1048576 2024-09-12T00:30:57.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.762+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~ZM60T841VK58.1 size=1048576 2024-09-12T00:30:57.762 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.764+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~ZM60T841VK58.2 size=299280 2024-09-12T00:30:57.762 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.764+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=ZM60T841VK58 tag=RAPYCG6ZTXG5 type=write size=3445008 2024-09-12T00:30:57.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.765+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=UWKJ4T90QMZH type=del 2024-09-12T00:30:57.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.767+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=RIHA5JDIMSIU type=del size=2880178 2024-09-12T00:30:57.766 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.768+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~I66EYVKWCCAX.0 size=1048576 2024-09-12T00:30:57.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.769+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~I66EYVKWCCAX.1 size=364605 2024-09-12T00:30:57.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.773+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=I66EYVKWCCAX tag=Z1NZZYQKEAJ1 type=write size=2461757 2024-09-12T00:30:57.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.775+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=PNXR5K247HVB type=del size=1847336 2024-09-12T00:30:57.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.776+0000 7f0362c73780 1 < canceled operation key=1UUNRPUKAINC tag=ST8KIGPEAR23 type=write size=370363 2024-09-12T00:30:57.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.778+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=KXDUE1EY5J78 type=del size=154977 2024-09-12T00:30:57.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.779+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~XKJ2UQPKIQK1.0 size=515244 2024-09-12T00:30:57.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.782+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=XKJ2UQPKIQK1 tag=RA152TXQC8FZ type=write size=1563820 2024-09-12T00:30:57.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.783+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=Z78JBXTRA6DK type=del size=799305 2024-09-12T00:30:57.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.785+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~BJWSC9ERDSR6.0 size=625276 2024-09-12T00:30:57.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.788+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=BJWSC9ERDSR6 tag=QE2PWS01HJIH type=write size=1673852 2024-09-12T00:30:57.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.790+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~86YK3C2HL1YM.0 size=1048576 2024-09-12T00:30:57.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.791+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~86YK3C2HL1YM.1 size=543157 2024-09-12T00:30:57.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.791+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=86YK3C2HL1YM tag=HDPMQWXQCGD1 type=write size=2640309 2024-09-12T00:30:57.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.793+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=4JPBOZB63AEM type=del 2024-09-12T00:30:57.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.794+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=LXHFCAZXSG2N type=del size=1125777 2024-09-12T00:30:57.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.797+0000 7f0362c73780 1 < suggested remove operation key=1UUNRPUKAINC tag=5EU4TYCOSV2U type=del 2024-09-12T00:30:57.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.800+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~1GUMV1SRCKCW.0 size=1048576 2024-09-12T00:30:57.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.801+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~1GUMV1SRCKCW.1 size=462879 2024-09-12T00:30:57.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.801+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=1GUMV1SRCKCW tag=P9WP8KLJ8HS2 type=write size=2560031 2024-09-12T00:30:57.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.804+0000 7f0362c73780 1 < suggested remove operation key=PLAYMR18X9DZ tag=M25FE11D19LV type=del 2024-09-12T00:30:57.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.805+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=3203I1JOVA6H type=del size=3193914 2024-09-12T00:30:57.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.807+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=HA4JGHRHI0U1 type=del 2024-09-12T00:30:57.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.808+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=RKOBCNKOOOKT type=del size=971239 2024-09-12T00:30:57.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.810+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~J2J13A9S64HZ.0 size=1048576 2024-09-12T00:30:57.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.811+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~J2J13A9S64HZ.1 size=1048576 2024-09-12T00:30:57.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.812+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~J2J13A9S64HZ.2 size=934721 2024-09-12T00:30:57.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.815+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=J2J13A9S64HZ tag=ZEQ74XTP7WHV type=write size=4080449 2024-09-12T00:30:57.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.816+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=VHEKN8VVV511 type=del size=4175010 2024-09-12T00:30:57.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.816+0000 7f0362c73780 1 < canceled part key=_multipart_VD0LFCNLI1YI.2~8KA1GT4Y0YGS.0 size=916199 2024-09-12T00:30:57.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.818+0000 7f0362c73780 1 < canceled multipart upload key=VD0LFCNLI1YI upload=8KA1GT4Y0YGS tag=2R2ADBWPDY5Z type=write size=1964775 2024-09-12T00:30:57.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.820+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=X1JPJ1QPQDO9 type=write size=666488 2024-09-12T00:30:57.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.821+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=ZFK8LLXV8N28 type=del 2024-09-12T00:30:57.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.824+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~01E1KHY30C5Q.0 size=1048576 2024-09-12T00:30:57.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.825+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~01E1KHY30C5Q.1 size=1048576 2024-09-12T00:30:57.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.826+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~01E1KHY30C5Q.2 size=188582 2024-09-12T00:30:57.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.826+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=01E1KHY30C5Q tag=R3R2UIVT2N2W type=write size=3334310 2024-09-12T00:30:57.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.827+0000 7f0362c73780 -1 < failed to complete operation key=1UUNRPUKAINC tag=YLZ0XXI16THS type=del size=1031988: (22) Invalid argument 2024-09-12T00:30:57.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.829+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=HP1TTKQ18CNQ type=del size=208943 2024-09-12T00:30:57.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.830+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=NYREWX93SZ1L type=del 2024-09-12T00:30:57.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.833+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~21M54FX1ODNB.0 size=1048576 2024-09-12T00:30:57.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.834+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~21M54FX1ODNB.1 size=1048576 2024-09-12T00:30:57.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.835+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~21M54FX1ODNB.2 size=319496 2024-09-12T00:30:57.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.835+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=21M54FX1ODNB tag=O51R60XK8R47 type=write size=3465224 2024-09-12T00:30:57.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.837+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~QU13DGZ0173I.0 size=628898 2024-09-12T00:30:57.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.839+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=QU13DGZ0173I tag=2Z182007Q87Q type=write size=1677474 2024-09-12T00:30:57.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.841+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~NX2KE5OWNU4Z.0 size=1048576 2024-09-12T00:30:57.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.842+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~NX2KE5OWNU4Z.1 size=370004 2024-09-12T00:30:57.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.842+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=NX2KE5OWNU4Z tag=EU2JJE11KP0B type=write size=2467156 2024-09-12T00:30:57.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.844+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~ZM60T841VK58.0 size=1048576 2024-09-12T00:30:57.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.845+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~ZM60T841VK58.1 size=1048576 2024-09-12T00:30:57.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.846+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~ZM60T841VK58.2 size=299280 2024-09-12T00:30:57.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.848+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=ZM60T841VK58 tag=RAPYCG6ZTXG5 type=write size=3445008 2024-09-12T00:30:57.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.850+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=NXOZ62KQP80Q type=del size=1721272 2024-09-12T00:30:57.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.851+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=RIHA5JDIMSIU type=del 2024-09-12T00:30:57.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.853+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=UBCSNZ84O329 type=del size=164917 2024-09-12T00:30:57.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.854+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=PNXR5K247HVB type=del 2024-09-12T00:30:57.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.857+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~YHTVLIK5PCXO.0 size=1048576 2024-09-12T00:30:57.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.858+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~YHTVLIK5PCXO.1 size=1048576 2024-09-12T00:30:57.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.859+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~YHTVLIK5PCXO.2 size=524060 2024-09-12T00:30:57.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.859+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=YHTVLIK5PCXO tag=L5JNOVRV2453 type=write size=3669788 2024-09-12T00:30:57.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.861+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=KXDUE1EY5J78 type=del 2024-09-12T00:30:57.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.862+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=HWGOL5VI2DO4 type=del size=2229138 2024-09-12T00:30:57.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.864+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=Z78JBXTRA6DK type=del 2024-09-12T00:30:57.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.866+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=IRFG31KKSGZR type=del size=4026367 2024-09-12T00:30:57.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.868+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~86YK3C2HL1YM.0 size=1048576 2024-09-12T00:30:57.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.869+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~86YK3C2HL1YM.1 size=543157 2024-09-12T00:30:57.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.871+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=86YK3C2HL1YM tag=HDPMQWXQCGD1 type=write size=2640309 2024-09-12T00:30:57.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.873+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=O72152KNZBVD type=del size=159907 2024-09-12T00:30:57.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.874+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=LXHFCAZXSG2N type=del 2024-09-12T00:30:57.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.877+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~XAHPF4O0OYC0.0 size=1046090 2024-09-12T00:30:57.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.877+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=XAHPF4O0OYC0 tag=3ZBOVPWX1TYZ type=write size=2094666 2024-09-12T00:30:57.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.878+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~1GUMV1SRCKCW.0 size=1048576 2024-09-12T00:30:57.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.879+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~1GUMV1SRCKCW.1 size=462879 2024-09-12T00:30:57.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.882+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=1GUMV1SRCKCW tag=P9WP8KLJ8HS2 type=write size=2560031 2024-09-12T00:30:57.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.883+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=4MAPYNGOVF42 type=del size=1309419 2024-09-12T00:30:57.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.885+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=3203I1JOVA6H type=del 2024-09-12T00:30:57.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.887+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=YLZDWDYIA9QO type=del size=2431731 2024-09-12T00:30:57.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.890+0000 7f0362c73780 1 < suggested update operation key=1SE6WTQMW6JU tag=RKOBCNKOOOKT type=del size=971239 2024-09-12T00:30:57.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.892+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=36I4LPOP70Z6 type=del size=2532529 2024-09-12T00:30:57.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.894+0000 7f0362c73780 1 < suggested remove operation key=EHBOL435W9ZE tag=VHEKN8VVV511 type=del 2024-09-12T00:30:57.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.896+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=IQXU0AI0VABV type=del size=1499339 2024-09-12T00:30:57.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.899+0000 7f0362c73780 1 < suggested remove operation key=X4ZML0796M7F tag=X1JPJ1QPQDO9 type=write 2024-09-12T00:30:57.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.900+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=SR6MJ427SEVM type=del size=1135350 2024-09-12T00:30:57.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.902+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~01E1KHY30C5Q.0 size=1048576 2024-09-12T00:30:57.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.902+0000 7f0362c73780 1 < canceled part key=_multipart_KWDEKRO3WICD.2~01E1KHY30C5Q.1 size=1048576 2024-09-12T00:30:57.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.903+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~01E1KHY30C5Q.2 size=188582 2024-09-12T00:30:57.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.907+0000 7f0362c73780 1 < canceled multipart upload key=KWDEKRO3WICD upload=01E1KHY30C5Q tag=R3R2UIVT2N2W type=write size=3334310 2024-09-12T00:30:57.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.910+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~8OB3L2QVD01I.0 size=1048576 2024-09-12T00:30:57.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.911+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~8OB3L2QVD01I.1 size=1011127 2024-09-12T00:30:57.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.911+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=8OB3L2QVD01I tag=TSHK62UWL44Y type=write size=3108279 2024-09-12T00:30:57.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.913+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=HP1TTKQ18CNQ type=del 2024-09-12T00:30:57.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.915+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=4VHU19XW37JW type=write size=513020 2024-09-12T00:30:57.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.916+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~21M54FX1ODNB.0 size=1048576 2024-09-12T00:30:57.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.917+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~21M54FX1ODNB.1 size=1048576 2024-09-12T00:30:57.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.919+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~21M54FX1ODNB.2 size=319496 2024-09-12T00:30:57.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.921+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=21M54FX1ODNB tag=O51R60XK8R47 type=write size=3465224 2024-09-12T00:30:57.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.922+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=RFZD0B0KVOFF type=del size=2028866 2024-09-12T00:30:57.922 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.924+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~NX2KE5OWNU4Z.0 size=1048576 2024-09-12T00:30:57.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.925+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~NX2KE5OWNU4Z.1 size=370004 2024-09-12T00:30:57.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.927+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=NX2KE5OWNU4Z tag=EU2JJE11KP0B type=write size=2467156 2024-09-12T00:30:57.926 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.928+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=5NYF9O381VFC type=write size=61104 2024-09-12T00:30:57.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.930+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=NXOZ62KQP80Q type=del 2024-09-12T00:30:57.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.932+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~Q3S0LMISWDFV.0 size=1048576 2024-09-12T00:30:57.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.933+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~Q3S0LMISWDFV.1 size=1048576 2024-09-12T00:30:57.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.934+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~Q3S0LMISWDFV.2 size=130280 2024-09-12T00:30:57.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.934+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=Q3S0LMISWDFV tag=7X3XX1ZPPWHJ type=write size=3276008 2024-09-12T00:30:57.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.936+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=UBCSNZ84O329 type=del 2024-09-12T00:30:57.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.937+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=K0IXSFYRUXNY type=del size=4087005 2024-09-12T00:30:57.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.938+0000 7f0362c73780 1 < canceled part key=_multipart_YTN99RBTKO39.2~YHTVLIK5PCXO.0 size=1048576 2024-09-12T00:30:57.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.939+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~YHTVLIK5PCXO.1 size=1048576 2024-09-12T00:30:57.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.940+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~YHTVLIK5PCXO.2 size=524060 2024-09-12T00:30:57.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.942+0000 7f0362c73780 1 < canceled multipart upload key=YTN99RBTKO39 upload=YHTVLIK5PCXO tag=L5JNOVRV2453 type=write size=3669788 2024-09-12T00:30:57.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.944+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=6KIQXUN895JO type=del size=2600784 2024-09-12T00:30:57.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.947+0000 7f0362c73780 1 < suggested remove operation key=XMMZOX8MH3GT tag=HWGOL5VI2DO4 type=del 2024-09-12T00:30:57.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.948+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=V17UFRF7D6UP type=del size=2607448 2024-09-12T00:30:57.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.949+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=IRFG31KKSGZR type=del 2024-09-12T00:30:57.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.951+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=IPMF741BTJ2J type=del size=2901138 2024-09-12T00:30:57.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.952+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=O72152KNZBVD type=del 2024-09-12T00:30:57.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.954+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=HDPQEX3C09YC type=del size=1009227 2024-09-12T00:30:57.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.955+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~XAHPF4O0OYC0.0 size=1046090 2024-09-12T00:30:57.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.957+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=XAHPF4O0OYC0 tag=3ZBOVPWX1TYZ type=write size=2094666 2024-09-12T00:30:57.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.960+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~SAI6GODW1AH9.0 size=1015629 2024-09-12T00:30:57.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.960+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=SAI6GODW1AH9 tag=FK8VF3UF3LV7 type=write size=2064205 2024-09-12T00:30:57.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.962+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=4MAPYNGOVF42 type=del 2024-09-12T00:30:57.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.963+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=ZNGN66IEWBNU type=del size=3262890 2024-09-12T00:30:57.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.966+0000 7f0362c73780 1 < suggested update operation key=Q6M0D2698CUZ tag=YLZDWDYIA9QO type=del size=2431731 2024-09-12T00:30:57.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.967+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=CPE8IMQFEOQR type=del size=2696189 2024-09-12T00:30:57.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.969+0000 7f0362c73780 -1 < failed to complete operation key=Q6M0D2698CUZ tag=36I4LPOP70Z6 type=del size=2532529: (22) Invalid argument 2024-09-12T00:30:57.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.970+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=MXSKPR8M9TXV type=del size=450580 2024-09-12T00:30:57.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.972+0000 7f0362c73780 -1 < failed to complete operation key=XMMZOX8MH3GT tag=IQXU0AI0VABV type=del size=1499339: (22) Invalid argument 2024-09-12T00:30:57.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.974+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~DOYPYBKWZUJ0.0 size=202327 2024-09-12T00:30:57.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.974+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=DOYPYBKWZUJ0 tag=RY7FL08U0FZR type=write size=1250903 2024-09-12T00:30:57.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.976+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=SR6MJ427SEVM type=del 2024-09-12T00:30:57.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.979+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~3SC0CJK30IJA.0 size=961581 2024-09-12T00:30:57.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.979+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=3SC0CJK30IJA tag=R64FNCQG3KA7 type=write size=2010157 2024-09-12T00:30:57.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.980+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~8OB3L2QVD01I.0 size=1048576 2024-09-12T00:30:57.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.981+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~8OB3L2QVD01I.1 size=1011127 2024-09-12T00:30:57.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.984+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=8OB3L2QVD01I tag=TSHK62UWL44Y type=write size=3108279 2024-09-12T00:30:57.985 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.987+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~QJDFH1ZLJ18M.0 size=1048576 2024-09-12T00:30:57.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.988+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~QJDFH1ZLJ18M.1 size=1048576 2024-09-12T00:30:57.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.990+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~QJDFH1ZLJ18M.2 size=680629 2024-09-12T00:30:57.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.990+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=QJDFH1ZLJ18M tag=9QPCGZ122VKI type=write size=3826357 2024-09-12T00:30:57.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.991+0000 7f0362c73780 1 < completed write operation key=G4G6E7KTTZY9 tag=4VHU19XW37JW type=write size=513020 2024-09-12T00:30:57.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.993+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=1Y1ZK6EL4A2E type=del size=1718846 2024-09-12T00:30:57.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.997+0000 7f0362c73780 1 < suggested update operation key=G4G6E7KTTZY9 tag=RFZD0B0KVOFF type=del size=2028866 2024-09-12T00:30:57.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:57.999+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=BT3CTAYD0P48 type=del size=3084654 2024-09-12T00:30:57.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.001+0000 7f0362c73780 1 < completed write operation key=OY30LP7FYXNF tag=5NYF9O381VFC type=write size=61104 2024-09-12T00:30:58.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.004+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~EAZ1D2ODNNKA.0 size=1048576 2024-09-12T00:30:58.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.005+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~EAZ1D2ODNNKA.1 size=1048576 2024-09-12T00:30:58.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.006+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~EAZ1D2ODNNKA.2 size=199695 2024-09-12T00:30:58.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.006+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=EAZ1D2ODNNKA tag=9EMMFF09ZH8A type=write size=3345423 2024-09-12T00:30:58.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.008+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~Q3S0LMISWDFV.0 size=1048576 2024-09-12T00:30:58.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.009+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~Q3S0LMISWDFV.1 size=1048576 2024-09-12T00:30:58.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.010+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~Q3S0LMISWDFV.2 size=130280 2024-09-12T00:30:58.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.013+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=Q3S0LMISWDFV tag=7X3XX1ZPPWHJ type=write size=3276008 2024-09-12T00:30:58.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.016+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~W8TSWRAF3SC4.0 size=968721 2024-09-12T00:30:58.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.016+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=W8TSWRAF3SC4 tag=DJ2IMSFTBFIZ type=write size=2017297 2024-09-12T00:30:58.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.017+0000 7f0362c73780 -1 < failed to complete operation key=Q6M0D2698CUZ tag=K0IXSFYRUXNY type=del size=4087005: (22) Invalid argument 2024-09-12T00:30:58.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.019+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=JFTG81A3W4YT type=del size=2505270 2024-09-12T00:30:58.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.022+0000 7f0362c73780 1 < suggested remove operation key=PLAYMR18X9DZ tag=6KIQXUN895JO type=del 2024-09-12T00:30:58.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.023+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=YOI6Y8WKFSPX type=write size=942893 2024-09-12T00:30:58.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.025+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=V17UFRF7D6UP type=del 2024-09-12T00:30:58.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.026+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=Y7UWL2692AYH type=del size=2809466 2024-09-12T00:30:58.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.028+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=IPMF741BTJ2J type=del 2024-09-12T00:30:58.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.031+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~MC97WJJRWH4E.0 size=1048576 2024-09-12T00:30:58.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.032+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~MC97WJJRWH4E.1 size=1048576 2024-09-12T00:30:58.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.034+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~MC97WJJRWH4E.2 size=139174 2024-09-12T00:30:58.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.034+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=MC97WJJRWH4E tag=9CBRN8QAINDM type=write size=3284902 2024-09-12T00:30:58.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.037+0000 7f0362c73780 1 < suggested remove operation key=YTN99RBTKO39 tag=HDPQEX3C09YC type=del 2024-09-12T00:30:58.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.038+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=ZU9Q9H1GU8GW type=del size=3422962 2024-09-12T00:30:58.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.040+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~SAI6GODW1AH9.0 size=1015629 2024-09-12T00:30:58.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.042+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=SAI6GODW1AH9 tag=FK8VF3UF3LV7 type=write size=2064205 2024-09-12T00:30:58.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.045+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~D6HKD0D2779I.0 size=180361 2024-09-12T00:30:58.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.045+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=D6HKD0D2779I tag=831QFIE0CBRD type=write size=1228937 2024-09-12T00:30:58.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.047+0000 7f0362c73780 -1 < failed to complete operation key=Q6M0D2698CUZ tag=ZNGN66IEWBNU type=del size=3262890: (22) Invalid argument 2024-09-12T00:30:58.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.049+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=5UUGC8VQLW5K type=del size=143157 2024-09-12T00:30:58.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.050+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=CPE8IMQFEOQR type=del 2024-09-12T00:30:58.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.052+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=XR206D13YQDN type=del size=2663869 2024-09-12T00:30:58.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.053+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=MXSKPR8M9TXV type=del 2024-09-12T00:30:58.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.056+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~RC998NN871FM.0 size=516620 2024-09-12T00:30:58.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.056+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=RC998NN871FM tag=XMHDD147FRVP type=write size=1565196 2024-09-12T00:30:58.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.058+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~DOYPYBKWZUJ0.0 size=202327 2024-09-12T00:30:58.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.060+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=DOYPYBKWZUJ0 tag=RY7FL08U0FZR type=write size=1250903 2024-09-12T00:30:58.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.062+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=YQBU4N6K3A3A type=del size=3354027 2024-09-12T00:30:58.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.064+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~3SC0CJK30IJA.0 size=961581 2024-09-12T00:30:58.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.066+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=3SC0CJK30IJA tag=R64FNCQG3KA7 type=write size=2010157 2024-09-12T00:30:58.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.068+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=DVUPCS8BF8N8 type=del size=2313133 2024-09-12T00:30:58.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.070+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~QJDFH1ZLJ18M.0 size=1048576 2024-09-12T00:30:58.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.071+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~QJDFH1ZLJ18M.1 size=1048576 2024-09-12T00:30:58.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.072+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~QJDFH1ZLJ18M.2 size=680629 2024-09-12T00:30:58.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.075+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=QJDFH1ZLJ18M tag=9QPCGZ122VKI type=write size=3826357 2024-09-12T00:30:58.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.076+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=KTYLXSCC4HV0 type=del size=3014121 2024-09-12T00:30:58.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.080+0000 7f0362c73780 1 < suggested remove operation key=J5GSZCJW2BP1 tag=1Y1ZK6EL4A2E type=del 2024-09-12T00:30:58.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.081+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=PBKW2O2VD3OJ type=del size=2571998 2024-09-12T00:30:58.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.084+0000 7f0362c73780 1 < suggested update operation key=1SE6WTQMW6JU tag=BT3CTAYD0P48 type=del size=3084654 2024-09-12T00:30:58.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.086+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~9EWW2DZKBGJ7.0 size=1048576 2024-09-12T00:30:58.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.088+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~9EWW2DZKBGJ7.1 size=1048576 2024-09-12T00:30:58.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.089+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~9EWW2DZKBGJ7.2 size=78828 2024-09-12T00:30:58.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.089+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=9EWW2DZKBGJ7 tag=NM9115HQDK9V type=write size=3224556 2024-09-12T00:30:58.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.090+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~EAZ1D2ODNNKA.0 size=1048576 2024-09-12T00:30:58.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.091+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~EAZ1D2ODNNKA.1 size=1048576 2024-09-12T00:30:58.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.092+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~EAZ1D2ODNNKA.2 size=199695 2024-09-12T00:30:58.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.095+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=EAZ1D2ODNNKA tag=9EMMFF09ZH8A type=write size=3345423 2024-09-12T00:30:58.094 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.096+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=HJVQA4GBP3T3 type=del size=2030169 2024-09-12T00:30:58.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.098+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~W8TSWRAF3SC4.0 size=968721 2024-09-12T00:30:58.098 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.100+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=W8TSWRAF3SC4 tag=DJ2IMSFTBFIZ type=write size=2017297 2024-09-12T00:30:58.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.102+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=JB0DYBLKH0ET type=write size=235685 2024-09-12T00:30:58.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.103+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=JFTG81A3W4YT type=del 2024-09-12T00:30:58.104 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.106+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~GCTPTGQJQ1WV.0 size=491043 2024-09-12T00:30:58.104 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.106+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=GCTPTGQJQ1WV tag=CCR0K51Y5OGW type=write size=1539619 2024-09-12T00:30:58.106 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.107+0000 7f0362c73780 1 < completed write operation key=G4G6E7KTTZY9 tag=YOI6Y8WKFSPX type=write size=942893 2024-09-12T00:30:58.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.109+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=N2PCOEKJQAI8 type=del size=3332382 2024-09-12T00:30:58.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.112+0000 7f0362c73780 1 < suggested update operation key=KWDEKRO3WICD tag=Y7UWL2692AYH type=del size=2809466 2024-09-12T00:30:58.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.115+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~P5T2318PN283.0 size=312066 2024-09-12T00:30:58.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.115+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=P5T2318PN283 tag=DRBIXTN78TZB type=write size=1360642 2024-09-12T00:30:58.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.117+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~MC97WJJRWH4E.0 size=1048576 2024-09-12T00:30:58.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.118+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~MC97WJJRWH4E.1 size=1048576 2024-09-12T00:30:58.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.120+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~MC97WJJRWH4E.2 size=139174 2024-09-12T00:30:58.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.123+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=MC97WJJRWH4E tag=9CBRN8QAINDM type=write size=3284902 2024-09-12T00:30:58.124 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.126+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~BIVEPROJRHN2.0 size=1048576 2024-09-12T00:30:58.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.127+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~BIVEPROJRHN2.1 size=6381 2024-09-12T00:30:58.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.127+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=BIVEPROJRHN2 tag=O0OEL7AI5HF6 type=write size=2103533 2024-09-12T00:30:58.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.129+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=ZU9Q9H1GU8GW type=del 2024-09-12T00:30:58.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.130+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=UUOO68RHW6FF type=del size=2540822 2024-09-12T00:30:58.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.132+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~D6HKD0D2779I.0 size=180361 2024-09-12T00:30:58.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.135+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=D6HKD0D2779I tag=831QFIE0CBRD type=write size=1228937 2024-09-12T00:30:58.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.137+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=G499SHZ79GFJ type=del size=1631568 2024-09-12T00:30:58.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.139+0000 7f0362c73780 1 < canceled operation key=XMMZOX8MH3GT tag=5UUGC8VQLW5K type=del size=143157 2024-09-12T00:30:58.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.142+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~C3ZUSZJW6Q1C.0 size=828513 2024-09-12T00:30:58.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.142+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=C3ZUSZJW6Q1C tag=1B1MY38FH025 type=write size=1877089 2024-09-12T00:30:58.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.144+0000 7f0362c73780 -1 < failed to complete operation key=KWDEKRO3WICD tag=XR206D13YQDN type=del size=2663869: (22) Invalid argument 2024-09-12T00:30:58.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.147+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~W6J3GDVIOK03.0 size=1048576 2024-09-12T00:30:58.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.148+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~W6J3GDVIOK03.1 size=1048576 2024-09-12T00:30:58.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.149+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~W6J3GDVIOK03.2 size=847344 2024-09-12T00:30:58.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.149+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=W6J3GDVIOK03 tag=IWQYMH1PVFK6 type=write size=3993072 2024-09-12T00:30:58.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.151+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~RC998NN871FM.0 size=516620 2024-09-12T00:30:58.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.153+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=RC998NN871FM tag=XMHDD147FRVP type=write size=1565196 2024-09-12T00:30:58.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.155+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=PMPL0BRZJ7R1 type=del size=3140446 2024-09-12T00:30:58.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.156+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=YQBU4N6K3A3A type=del 2024-09-12T00:30:58.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.160+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~N3EYKG4NCZBI.0 size=1048576 2024-09-12T00:30:58.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.161+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~N3EYKG4NCZBI.1 size=60851 2024-09-12T00:30:58.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.161+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=N3EYKG4NCZBI tag=DGADWUT2QTGD type=write size=2158003 2024-09-12T00:30:58.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.163+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=DVUPCS8BF8N8 type=del 2024-09-12T00:30:58.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.164+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=NHK88GRUWXE2 type=write size=761532 2024-09-12T00:30:58.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.166+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=KTYLXSCC4HV0 type=del 2024-09-12T00:30:58.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.169+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~M0BY92K14NCE.0 size=1048576 2024-09-12T00:30:58.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.170+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~M0BY92K14NCE.1 size=1048576 2024-09-12T00:30:58.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.171+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~M0BY92K14NCE.2 size=10369 2024-09-12T00:30:58.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.171+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=M0BY92K14NCE tag=VWPRT91D5SD3 type=write size=3156097 2024-09-12T00:30:58.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.173+0000 7f0362c73780 1 < canceled operation key=XR8L0HL374VC tag=PBKW2O2VD3OJ type=del size=2571998 2024-09-12T00:30:58.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.175+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=VU6R1HB6GRBN type=del size=180160 2024-09-12T00:30:58.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.177+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~9EWW2DZKBGJ7.0 size=1048576 2024-09-12T00:30:58.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.178+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~9EWW2DZKBGJ7.1 size=1048576 2024-09-12T00:30:58.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.179+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~9EWW2DZKBGJ7.2 size=78828 2024-09-12T00:30:58.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.182+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=9EWW2DZKBGJ7 tag=NM9115HQDK9V type=write size=3224556 2024-09-12T00:30:58.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.183+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=57K2ERTQ7S4M type=del size=2861227 2024-09-12T00:30:58.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.185+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=HJVQA4GBP3T3 type=del 2024-09-12T00:30:58.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.187+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~FI9P8T6EHXC9.0 size=421990 2024-09-12T00:30:58.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.187+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=FI9P8T6EHXC9 tag=NTCWVF0BH6SC type=write size=1470566 2024-09-12T00:30:58.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.190+0000 7f0362c73780 1 < suggested update operation key=1MLL1T362X51 tag=JB0DYBLKH0ET type=write size=235685 2024-09-12T00:30:58.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.192+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=SVGN2SW1NQDJ type=write size=300752 2024-09-12T00:30:58.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.193+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~GCTPTGQJQ1WV.0 size=491043 2024-09-12T00:30:58.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.195+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=GCTPTGQJQ1WV tag=CCR0K51Y5OGW type=write size=1539619 2024-09-12T00:30:58.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.197+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=2WAPSUUI6B1S type=del size=259704 2024-09-12T00:30:58.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.198+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=N2PCOEKJQAI8 type=del 2024-09-12T00:30:58.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.201+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~JPAOC027EMRV.0 size=1048576 2024-09-12T00:30:58.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.202+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~JPAOC027EMRV.1 size=978990 2024-09-12T00:30:58.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.202+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=JPAOC027EMRV tag=1MN80ZBOBU40 type=write size=3076142 2024-09-12T00:30:58.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.204+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~P5T2318PN283.0 size=312066 2024-09-12T00:30:58.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.206+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=P5T2318PN283 tag=DRBIXTN78TZB type=write size=1360642 2024-09-12T00:30:58.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.209+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~HF2WVNVCOHF0.0 size=1048576 2024-09-12T00:30:58.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.210+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~HF2WVNVCOHF0.1 size=1048576 2024-09-12T00:30:58.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.211+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~HF2WVNVCOHF0.2 size=554374 2024-09-12T00:30:58.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.211+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=HF2WVNVCOHF0 tag=HJB058887F5R type=write size=3700102 2024-09-12T00:30:58.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.213+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~BIVEPROJRHN2.0 size=1048576 2024-09-12T00:30:58.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.214+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~BIVEPROJRHN2.1 size=6381 2024-09-12T00:30:58.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.217+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=BIVEPROJRHN2 tag=O0OEL7AI5HF6 type=write size=2103533 2024-09-12T00:30:58.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.218+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=JD23BZAPPXCH type=del size=230924 2024-09-12T00:30:58.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.220+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=UUOO68RHW6FF type=del 2024-09-12T00:30:58.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.222+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~TUS3634IIIOQ.0 size=1048576 2024-09-12T00:30:58.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.224+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~TUS3634IIIOQ.1 size=1048576 2024-09-12T00:30:58.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.225+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~TUS3634IIIOQ.2 size=369046 2024-09-12T00:30:58.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.225+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=TUS3634IIIOQ tag=DG6BXEGBVZ20 type=write size=3514774 2024-09-12T00:30:58.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.226+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=G499SHZ79GFJ type=del 2024-09-12T00:30:58.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.229+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~KT99IGUTOS94.0 size=1048576 2024-09-12T00:30:58.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.230+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~KT99IGUTOS94.1 size=1048576 2024-09-12T00:30:58.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.233+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~KT99IGUTOS94.2 size=467908 2024-09-12T00:30:58.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.233+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=KT99IGUTOS94 tag=WDZ4Q4K7KWTJ type=write size=3613636 2024-09-12T00:30:58.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.234+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~C3ZUSZJW6Q1C.0 size=828513 2024-09-12T00:30:58.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.237+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=C3ZUSZJW6Q1C tag=1B1MY38FH025 type=write size=1877089 2024-09-12T00:30:58.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.240+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~67Q4CQK3ZADD.0 size=1048576 2024-09-12T00:30:58.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.241+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~67Q4CQK3ZADD.1 size=1048576 2024-09-12T00:30:58.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.242+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~67Q4CQK3ZADD.2 size=175995 2024-09-12T00:30:58.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.242+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=67Q4CQK3ZADD tag=A4PDRR3HZMYN type=write size=3321723 2024-09-12T00:30:58.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.244+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~W6J3GDVIOK03.0 size=1048576 2024-09-12T00:30:58.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.245+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~W6J3GDVIOK03.1 size=1048576 2024-09-12T00:30:58.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.246+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~W6J3GDVIOK03.2 size=847344 2024-09-12T00:30:58.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.248+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=W6J3GDVIOK03 tag=IWQYMH1PVFK6 type=write size=3993072 2024-09-12T00:30:58.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.250+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=1YOMA2J9SQJJ type=del size=2548417 2024-09-12T00:30:58.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.252+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=PMPL0BRZJ7R1 type=del 2024-09-12T00:30:58.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.254+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~DXPILY8ZCEQU.0 size=350912 2024-09-12T00:30:58.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.254+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=DXPILY8ZCEQU tag=ZYSKG2HS3LS8 type=write size=1399488 2024-09-12T00:30:58.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.256+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~N3EYKG4NCZBI.0 size=1048576 2024-09-12T00:30:58.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.257+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~N3EYKG4NCZBI.1 size=60851 2024-09-12T00:30:58.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.260+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=N3EYKG4NCZBI tag=DGADWUT2QTGD type=write size=2158003 2024-09-12T00:30:58.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.261+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=48J2CVA3C676 type=del size=4115157 2024-09-12T00:30:58.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.263+0000 7f0362c73780 1 < completed write operation key=I3B48QD9E40S tag=NHK88GRUWXE2 type=write size=761532 2024-09-12T00:30:58.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.265+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=QB9TLVJMJT6R type=del size=739518 2024-09-12T00:30:58.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.266+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~M0BY92K14NCE.0 size=1048576 2024-09-12T00:30:58.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.266+0000 7f0362c73780 1 < canceled part key=_multipart_XWW3882YBHAJ.2~M0BY92K14NCE.1 size=1048576 2024-09-12T00:30:58.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.268+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~M0BY92K14NCE.2 size=10369 2024-09-12T00:30:58.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.270+0000 7f0362c73780 1 < canceled multipart upload key=XWW3882YBHAJ upload=M0BY92K14NCE tag=VWPRT91D5SD3 type=write size=3156097 2024-09-12T00:30:58.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.272+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=2MQ2SD5T7GX2 type=del size=1738302 2024-09-12T00:30:58.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.274+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=VU6R1HB6GRBN type=del 2024-09-12T00:30:58.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.276+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=1RKFSMP8RU3O type=write size=28223 2024-09-12T00:30:58.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.277+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=57K2ERTQ7S4M type=del 2024-09-12T00:30:58.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.279+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=LJN5L1Q1DLS9 type=del size=2774982 2024-09-12T00:30:58.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.281+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~FI9P8T6EHXC9.0 size=421990 2024-09-12T00:30:58.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.283+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=FI9P8T6EHXC9 tag=NTCWVF0BH6SC type=write size=1470566 2024-09-12T00:30:58.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.284+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=P2520U5Q7OLD type=del size=199725 2024-09-12T00:30:58.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.286+0000 7f0362c73780 1 < completed write operation key=KWDEKRO3WICD tag=SVGN2SW1NQDJ type=write size=300752 2024-09-12T00:30:58.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.289+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~PJKNHY2TKV93.0 size=97136 2024-09-12T00:30:58.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.289+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=PJKNHY2TKV93 tag=JJ7RD8LVC6HR type=write size=1145712 2024-09-12T00:30:58.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.290+0000 7f0362c73780 1 < canceled operation key=XMMZOX8MH3GT tag=2WAPSUUI6B1S type=del size=259704 2024-09-12T00:30:58.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.292+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=3WVHAKYGSFB2 type=del size=3436514 2024-09-12T00:30:58.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.293+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~JPAOC027EMRV.0 size=1048576 2024-09-12T00:30:58.293 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.295+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~JPAOC027EMRV.1 size=978990 2024-09-12T00:30:58.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.297+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=JPAOC027EMRV tag=1MN80ZBOBU40 type=write size=3076142 2024-09-12T00:30:58.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.298+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=FU9ULU42O5IA type=write size=377585 2024-09-12T00:30:58.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.299+0000 7f0362c73780 1 < canceled part key=_multipart_CZHT9UQS34JU.2~HF2WVNVCOHF0.0 size=1048576 2024-09-12T00:30:58.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.299+0000 7f0362c73780 1 < canceled part key=_multipart_CZHT9UQS34JU.2~HF2WVNVCOHF0.1 size=1048576 2024-09-12T00:30:58.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.300+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~HF2WVNVCOHF0.2 size=554374 2024-09-12T00:30:58.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.302+0000 7f0362c73780 1 < canceled multipart upload key=CZHT9UQS34JU upload=HF2WVNVCOHF0 tag=HJB058887F5R type=write size=3700102 2024-09-12T00:30:58.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.306+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~GQMKQ0M5TC0J.0 size=144137 2024-09-12T00:30:58.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.306+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=GQMKQ0M5TC0J tag=UHZ7COQ7RXWT type=write size=1192713 2024-09-12T00:30:58.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.307+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=JD23BZAPPXCH type=del 2024-09-12T00:30:58.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.309+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=V4FXL0MATYD6 type=del size=3287633 2024-09-12T00:30:58.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.310+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~TUS3634IIIOQ.0 size=1048576 2024-09-12T00:30:58.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.312+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~TUS3634IIIOQ.1 size=1048576 2024-09-12T00:30:58.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.313+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~TUS3634IIIOQ.2 size=369046 2024-09-12T00:30:58.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.316+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=TUS3634IIIOQ tag=DG6BXEGBVZ20 type=write size=3514774 2024-09-12T00:30:58.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.320+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~BJDOB93GC31F.0 size=1048576 2024-09-12T00:30:58.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.321+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~BJDOB93GC31F.1 size=1048576 2024-09-12T00:30:58.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.323+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~BJDOB93GC31F.2 size=119009 2024-09-12T00:30:58.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.323+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=BJDOB93GC31F tag=JHX3VE2LNQJI type=write size=3264737 2024-09-12T00:30:58.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.324+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~KT99IGUTOS94.0 size=1048576 2024-09-12T00:30:58.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.325+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~KT99IGUTOS94.1 size=1048576 2024-09-12T00:30:58.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.326+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~KT99IGUTOS94.2 size=467908 2024-09-12T00:30:58.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.329+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=KT99IGUTOS94 tag=WDZ4Q4K7KWTJ type=write size=3613636 2024-09-12T00:30:58.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.330+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=Q1IOP37DYDRQ type=del size=3340910 2024-09-12T00:30:58.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.331+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~67Q4CQK3ZADD.0 size=1048576 2024-09-12T00:30:58.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.333+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~67Q4CQK3ZADD.1 size=1048576 2024-09-12T00:30:58.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.334+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~67Q4CQK3ZADD.2 size=175995 2024-09-12T00:30:58.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.336+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=67Q4CQK3ZADD tag=A4PDRR3HZMYN type=write size=3321723 2024-09-12T00:30:58.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.338+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=HKAA6IF2EMBV type=del size=3666826 2024-09-12T00:30:58.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.339+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=1YOMA2J9SQJJ type=del 2024-09-12T00:30:58.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.341+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=0XX6P9B7T5Z2 type=del size=3665815 2024-09-12T00:30:58.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.342+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~DXPILY8ZCEQU.0 size=350912 2024-09-12T00:30:58.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.344+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=DXPILY8ZCEQU tag=ZYSKG2HS3LS8 type=write size=1399488 2024-09-12T00:30:58.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.346+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=YUED239EDSQF type=del size=3238859 2024-09-12T00:30:58.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.347+0000 7f0362c73780 1 < canceled operation key=927NCYXX8Z2P tag=48J2CVA3C676 type=del size=4115157 2024-09-12T00:30:58.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.349+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=WKCFIFW87AY8 type=del size=691748 2024-09-12T00:30:58.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.350+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=QB9TLVJMJT6R type=del 2024-09-12T00:30:58.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.352+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=2JFYHHN5GYXH type=del size=333523 2024-09-12T00:30:58.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.353+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=2MQ2SD5T7GX2 type=del 2024-09-12T00:30:58.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.355+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=D2H489LYF4ZG type=del size=3594807 2024-09-12T00:30:58.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.356+0000 7f0362c73780 1 < completed write operation key=HEN9LUUIDAR5 tag=1RKFSMP8RU3O type=write size=28223 2024-09-12T00:30:58.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.359+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~QG1FL2IDOGAZ.0 size=199898 2024-09-12T00:30:58.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.359+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=QG1FL2IDOGAZ tag=3B3FVWL9AWKP type=write size=1248474 2024-09-12T00:30:58.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.360+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=LJN5L1Q1DLS9 type=del 2024-09-12T00:30:58.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.362+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=EWIH3VA80JPC type=del size=2245893 2024-09-12T00:30:58.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.363+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=P2520U5Q7OLD type=del 2024-09-12T00:30:58.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.365+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=400SK5GKNO6J type=del size=3079115 2024-09-12T00:30:58.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.366+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~PJKNHY2TKV93.0 size=97136 2024-09-12T00:30:58.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.369+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=PJKNHY2TKV93 tag=JJ7RD8LVC6HR type=write size=1145712 2024-09-12T00:30:58.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.370+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=37MDRQQXGST7 type=del size=204624 2024-09-12T00:30:58.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.372+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=3WVHAKYGSFB2 type=del 2024-09-12T00:30:58.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.373+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=OZJSXH7X0UC7 type=del size=2834513 2024-09-12T00:30:58.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.375+0000 7f0362c73780 1 < completed write operation key=84T1VJG5SHU4 tag=FU9ULU42O5IA type=write size=377585 2024-09-12T00:30:58.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.377+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~I0SFIV6GD5IE.0 size=1048576 2024-09-12T00:30:58.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.378+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~I0SFIV6GD5IE.1 size=1048576 2024-09-12T00:30:58.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.380+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~I0SFIV6GD5IE.2 size=586528 2024-09-12T00:30:58.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.380+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=I0SFIV6GD5IE tag=FN9O0ABATAIA type=write size=3732256 2024-09-12T00:30:58.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.381+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~GQMKQ0M5TC0J.0 size=144137 2024-09-12T00:30:58.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.384+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=GQMKQ0M5TC0J tag=UHZ7COQ7RXWT type=write size=1192713 2024-09-12T00:30:58.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.385+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=XP55S3UPVTAH type=del size=2821873 2024-09-12T00:30:58.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.387+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=V4FXL0MATYD6 type=del 2024-09-12T00:30:58.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.389+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~GMSXB1G2KYHI.0 size=1048576 2024-09-12T00:30:58.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.390+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~GMSXB1G2KYHI.1 size=214590 2024-09-12T00:30:58.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.390+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=GMSXB1G2KYHI tag=WWHGB8INYKBY type=write size=2311742 2024-09-12T00:30:58.390 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.392+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~BJDOB93GC31F.0 size=1048576 2024-09-12T00:30:58.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.393+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~BJDOB93GC31F.1 size=1048576 2024-09-12T00:30:58.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.394+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~BJDOB93GC31F.2 size=119009 2024-09-12T00:30:58.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.396+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=BJDOB93GC31F tag=JHX3VE2LNQJI type=write size=3264737 2024-09-12T00:30:58.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.399+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~IKMPDDZ92YYS.0 size=1048576 2024-09-12T00:30:58.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.400+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~IKMPDDZ92YYS.1 size=1048576 2024-09-12T00:30:58.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.401+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~IKMPDDZ92YYS.2 size=36971 2024-09-12T00:30:58.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.401+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=IKMPDDZ92YYS tag=LPPTHMWJ7ZKO type=write size=3182699 2024-09-12T00:30:58.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.403+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=Q1IOP37DYDRQ type=del 2024-09-12T00:30:58.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.406+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~2ANTWL9AQPNZ.0 size=1048576 2024-09-12T00:30:58.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.407+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~2ANTWL9AQPNZ.1 size=884718 2024-09-12T00:30:58.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.407+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=2ANTWL9AQPNZ tag=5L2J07458Z5N type=write size=2981870 2024-09-12T00:30:58.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.408+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=HKAA6IF2EMBV type=del 2024-09-12T00:30:58.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.410+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=ET9PA4ETSBK9 type=del size=3759970 2024-09-12T00:30:58.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.413+0000 7f0362c73780 1 < suggested update operation key=1UUNRPUKAINC tag=0XX6P9B7T5Z2 type=del size=3665815 2024-09-12T00:30:58.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.415+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=OSIL05VK1JZR type=del size=3177679 2024-09-12T00:30:58.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.416+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=YUED239EDSQF type=del 2024-09-12T00:30:58.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.418+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=RNKSR36TWLMP type=del size=1891507 2024-09-12T00:30:58.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.420+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=WKCFIFW87AY8 type=del 2024-09-12T00:30:58.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.423+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~L0UBWO51E35Z.0 size=249922 2024-09-12T00:30:58.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.423+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=L0UBWO51E35Z tag=2YCGUFB6D39X type=write size=1298498 2024-09-12T00:30:58.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.425+0000 7f0362c73780 1 < canceled operation key=XR8L0HL374VC tag=2JFYHHN5GYXH type=del size=333523 2024-09-12T00:30:58.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.428+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~6EYX7I6SA9RZ.0 size=115279 2024-09-12T00:30:58.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.428+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=6EYX7I6SA9RZ tag=SIY71M18GTQJ type=write size=1163855 2024-09-12T00:30:58.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.429+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=D2H489LYF4ZG type=del 2024-09-12T00:30:58.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.431+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=UFRFSDE55JU8 type=del size=1748584 2024-09-12T00:30:58.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.431+0000 7f0362c73780 1 < canceled part key=_multipart_KWDEKRO3WICD.2~QG1FL2IDOGAZ.0 size=199898 2024-09-12T00:30:58.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.434+0000 7f0362c73780 1 < canceled multipart upload key=KWDEKRO3WICD upload=QG1FL2IDOGAZ tag=3B3FVWL9AWKP type=write size=1248474 2024-09-12T00:30:58.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.435+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=2G7T89THX7A5 type=del size=3676938 2024-09-12T00:30:58.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.437+0000 7f0362c73780 1 < canceled operation key=1SE6WTQMW6JU tag=EWIH3VA80JPC type=del size=2245893 2024-09-12T00:30:58.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.438+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=FOMG7LFU1C42 type=del size=976070 2024-09-12T00:30:58.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.440+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=400SK5GKNO6J type=del 2024-09-12T00:30:58.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.441+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=88NM86BPI5RX type=del size=678892 2024-09-12T00:30:58.441 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.443+0000 7f0362c73780 1 < canceled operation key=X4ZML0796M7F tag=37MDRQQXGST7 type=del size=204624 2024-09-12T00:30:58.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.446+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~N0N0VRNIRSH1.0 size=280273 2024-09-12T00:30:58.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.446+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=N0N0VRNIRSH1 tag=NLFEPR0X589G type=write size=1328849 2024-09-12T00:30:58.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.447+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=OZJSXH7X0UC7 type=del 2024-09-12T00:30:58.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.449+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=50G2GMJ932O0 type=write size=822654 2024-09-12T00:30:58.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.449+0000 7f0362c73780 1 < canceled part key=_multipart_1IPW8SJ6SSU2.2~I0SFIV6GD5IE.0 size=1048576 2024-09-12T00:30:58.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.450+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~I0SFIV6GD5IE.1 size=1048576 2024-09-12T00:30:58.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.451+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~I0SFIV6GD5IE.2 size=586528 2024-09-12T00:30:58.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.454+0000 7f0362c73780 1 < canceled multipart upload key=1IPW8SJ6SSU2 upload=I0SFIV6GD5IE tag=FN9O0ABATAIA type=write size=3732256 2024-09-12T00:30:58.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.455+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=CR9G93GF6XUO type=del size=673175 2024-09-12T00:30:58.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.460+0000 7f0362c73780 1 < suggested remove operation key=PLAYMR18X9DZ tag=XP55S3UPVTAH type=del 2024-09-12T00:30:58.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.463+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~XQQB01YA1UHF.0 size=407503 2024-09-12T00:30:58.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.463+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=XQQB01YA1UHF tag=VGAV188Y5OL1 type=write size=1456079 2024-09-12T00:30:58.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.464+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~GMSXB1G2KYHI.0 size=1048576 2024-09-12T00:30:58.464 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.465+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~GMSXB1G2KYHI.1 size=214590 2024-09-12T00:30:58.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.468+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=GMSXB1G2KYHI tag=WWHGB8INYKBY type=write size=2311742 2024-09-12T00:30:58.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.470+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~AQZ4RTXGH6CY.0 size=1048576 2024-09-12T00:30:58.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.472+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~AQZ4RTXGH6CY.1 size=1048576 2024-09-12T00:30:58.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.473+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~AQZ4RTXGH6CY.2 size=492741 2024-09-12T00:30:58.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.473+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=AQZ4RTXGH6CY tag=P81BD6Y2QE9P type=write size=3638469 2024-09-12T00:30:58.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.474+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~IKMPDDZ92YYS.0 size=1048576 2024-09-12T00:30:58.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.475+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~IKMPDDZ92YYS.1 size=1048576 2024-09-12T00:30:58.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.476+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~IKMPDDZ92YYS.2 size=36971 2024-09-12T00:30:58.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.479+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=IKMPDDZ92YYS tag=LPPTHMWJ7ZKO type=write size=3182699 2024-09-12T00:30:58.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.480+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=YL9ELQL0ZIB9 type=del size=2768562 2024-09-12T00:30:58.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.482+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~2ANTWL9AQPNZ.0 size=1048576 2024-09-12T00:30:58.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.483+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~2ANTWL9AQPNZ.1 size=884718 2024-09-12T00:30:58.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.485+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=2ANTWL9AQPNZ tag=5L2J07458Z5N type=write size=2981870 2024-09-12T00:30:58.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.487+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=QE72DIIYWOJE type=del size=2484246 2024-09-12T00:30:58.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.490+0000 7f0362c73780 1 < suggested update operation key=XWW3882YBHAJ tag=ET9PA4ETSBK9 type=del size=3759970 2024-09-12T00:30:58.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.492+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~V33ZVYRICOSV.0 size=1048576 2024-09-12T00:30:58.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.493+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~V33ZVYRICOSV.1 size=931687 2024-09-12T00:30:58.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.493+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=V33ZVYRICOSV tag=RFHMQ1TP6HSH type=write size=3028839 2024-09-12T00:30:58.495 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.497+0000 7f0362c73780 1 < suggested update operation key=I3B48QD9E40S tag=OSIL05VK1JZR type=del size=3177679 2024-09-12T00:30:58.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.498+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=9RN34UMQHJKU type=del size=145633 2024-09-12T00:30:58.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.499+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=RNKSR36TWLMP type=del 2024-09-12T00:30:58.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.501+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=U47U3X7E7TA4 type=del size=1643312 2024-09-12T00:30:58.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.501+0000 7f0362c73780 1 < canceled part key=_multipart_1IPW8SJ6SSU2.2~L0UBWO51E35Z.0 size=249922 2024-09-12T00:30:58.502 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.503+0000 7f0362c73780 1 < canceled multipart upload key=1IPW8SJ6SSU2 upload=L0UBWO51E35Z tag=2YCGUFB6D39X type=write size=1298498 2024-09-12T00:30:58.503 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.505+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=PN0JZH6LAY87 type=del size=1080660 2024-09-12T00:30:58.504 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.506+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~6EYX7I6SA9RZ.0 size=115279 2024-09-12T00:30:58.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.509+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=6EYX7I6SA9RZ tag=SIY71M18GTQJ type=write size=1163855 2024-09-12T00:30:58.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.510+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=4P8CL7WV4UU2 type=write size=625915 2024-09-12T00:30:58.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.513+0000 7f0362c73780 1 < suggested remove operation key=XMMZOX8MH3GT tag=UFRFSDE55JU8 type=del 2024-09-12T00:30:58.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.514+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=YF3TVPW6XXRB type=del size=2398339 2024-09-12T00:30:58.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.516+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=2G7T89THX7A5 type=del 2024-09-12T00:30:58.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.518+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~2QRSZTY964ME.0 size=1048576 2024-09-12T00:30:58.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.519+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~2QRSZTY964ME.1 size=845149 2024-09-12T00:30:58.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.519+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=2QRSZTY964ME tag=AICRNM3L6GTL type=write size=2942301 2024-09-12T00:30:58.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.521+0000 7f0362c73780 1 < canceled operation key=3XZZX53L26G5 tag=FOMG7LFU1C42 type=del size=976070 2024-09-12T00:30:58.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.522+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=SZO4T18JW4E5 type=del size=3928879 2024-09-12T00:30:58.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.523+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=88NM86BPI5RX type=del 2024-09-12T00:30:58.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.526+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~52FL6B6OKHR6.0 size=484297 2024-09-12T00:30:58.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.526+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=52FL6B6OKHR6 tag=K26164XC2AGZ type=write size=1532873 2024-09-12T00:30:58.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.527+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~N0N0VRNIRSH1.0 size=280273 2024-09-12T00:30:58.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.529+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=N0N0VRNIRSH1 tag=NLFEPR0X589G type=write size=1328849 2024-09-12T00:30:58.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.531+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=UCOE14XATYUI type=del size=4095553 2024-09-12T00:30:58.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.534+0000 7f0362c73780 1 < suggested remove operation key=XR8L0HL374VC tag=50G2GMJ932O0 type=write 2024-09-12T00:30:58.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.535+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=T670SY3QWG2Q type=del size=2737915 2024-09-12T00:30:58.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.536+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=CR9G93GF6XUO type=del 2024-09-12T00:30:58.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.538+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=IFWO6H4WQ7KM type=del size=2858302 2024-09-12T00:30:58.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.539+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~XQQB01YA1UHF.0 size=407503 2024-09-12T00:30:58.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.542+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=XQQB01YA1UHF tag=VGAV188Y5OL1 type=write size=1456079 2024-09-12T00:30:58.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.543+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=59L9MCOC0EY9 type=del size=1414604 2024-09-12T00:30:58.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.544+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~AQZ4RTXGH6CY.0 size=1048576 2024-09-12T00:30:58.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.546+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~AQZ4RTXGH6CY.1 size=1048576 2024-09-12T00:30:58.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.547+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~AQZ4RTXGH6CY.2 size=492741 2024-09-12T00:30:58.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.549+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=AQZ4RTXGH6CY tag=P81BD6Y2QE9P type=write size=3638469 2024-09-12T00:30:58.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.551+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=11ILCXHHBUSR type=del size=782471 2024-09-12T00:30:58.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.552+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=YL9ELQL0ZIB9 type=del 2024-09-12T00:30:58.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.553+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=WM4X1UD7G705 type=del size=1913683 2024-09-12T00:30:58.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.555+0000 7f0362c73780 1 < completed delete operation key=PLAYMR18X9DZ tag=QE72DIIYWOJE type=del 2024-09-12T00:30:58.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.557+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~PSXLI7Z2JNR2.0 size=1048576 2024-09-12T00:30:58.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.558+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~PSXLI7Z2JNR2.1 size=502845 2024-09-12T00:30:58.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.558+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=PSXLI7Z2JNR2 tag=0C4PRI1XUXTQ type=write size=2599997 2024-09-12T00:30:58.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.559+0000 7f0362c73780 1 < canceled part key=_multipart_PLAYMR18X9DZ.2~V33ZVYRICOSV.0 size=1048576 2024-09-12T00:30:58.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.560+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~V33ZVYRICOSV.1 size=931687 2024-09-12T00:30:58.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.562+0000 7f0362c73780 1 < canceled multipart upload key=PLAYMR18X9DZ upload=V33ZVYRICOSV tag=RFHMQ1TP6HSH type=write size=3028839 2024-09-12T00:30:58.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.564+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=PBMQ04AQT9RL type=del size=2959497 2024-09-12T00:30:58.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.566+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=9RN34UMQHJKU type=del 2024-09-12T00:30:58.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.567+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=H5U7PVVHC6KP type=del size=3088300 2024-09-12T00:30:58.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.569+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=U47U3X7E7TA4 type=del 2024-09-12T00:30:58.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.572+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~WHGY1GS65OWV.0 size=1048576 2024-09-12T00:30:58.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.573+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~WHGY1GS65OWV.1 size=1048576 2024-09-12T00:30:58.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.574+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~WHGY1GS65OWV.2 size=451221 2024-09-12T00:30:58.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.574+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=WHGY1GS65OWV tag=TGSRVZZGIB2Q type=write size=3596949 2024-09-12T00:30:58.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.577+0000 7f0362c73780 1 < suggested update operation key=6AYDT9X4LC6T tag=PN0JZH6LAY87 type=del size=1080660 2024-09-12T00:30:58.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.579+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=2E90OKV1E72Z type=del size=611245 2024-09-12T00:30:58.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.581+0000 7f0362c73780 1 < completed write operation key=PLAYMR18X9DZ tag=4P8CL7WV4UU2 type=write size=625915 2024-09-12T00:30:58.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.583+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~YM468PF550S7.0 size=438529 2024-09-12T00:30:58.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.583+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=YM468PF550S7 tag=QQFRQ9OF4RBR type=write size=1487105 2024-09-12T00:30:58.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.585+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=YF3TVPW6XXRB type=del 2024-09-12T00:30:58.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.588+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~TDUOUJ112OST.0 size=1048576 2024-09-12T00:30:58.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.589+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~TDUOUJ112OST.1 size=1048576 2024-09-12T00:30:58.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.590+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~TDUOUJ112OST.2 size=139644 2024-09-12T00:30:58.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.590+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=TDUOUJ112OST tag=4SNPX29NQ6JF type=write size=3285372 2024-09-12T00:30:58.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.592+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~2QRSZTY964ME.0 size=1048576 2024-09-12T00:30:58.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.593+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~2QRSZTY964ME.1 size=845149 2024-09-12T00:30:58.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.596+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=2QRSZTY964ME tag=AICRNM3L6GTL type=write size=2942301 2024-09-12T00:30:58.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.597+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=RSS9XRJMCJMM type=write size=46316 2024-09-12T00:30:58.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.600+0000 7f0362c73780 1 < suggested remove operation key=Q6M0D2698CUZ tag=SZO4T18JW4E5 type=del 2024-09-12T00:30:58.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.603+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~47Z50FZRIQXU.0 size=1019456 2024-09-12T00:30:58.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.603+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=47Z50FZRIQXU tag=XYK27JHA1LVB type=write size=2068032 2024-09-12T00:30:58.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.604+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~52FL6B6OKHR6.0 size=484297 2024-09-12T00:30:58.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.606+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=52FL6B6OKHR6 tag=K26164XC2AGZ type=write size=1532873 2024-09-12T00:30:58.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.609+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~QHQQDKXV2FUF.0 size=1048576 2024-09-12T00:30:58.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.610+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~QHQQDKXV2FUF.1 size=731485 2024-09-12T00:30:58.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.610+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=QHQQDKXV2FUF tag=O4JXKO355CXA type=write size=2828637 2024-09-12T00:30:58.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.611+0000 7f0362c73780 -1 < failed to complete operation key=6AYDT9X4LC6T tag=UCOE14XATYUI type=del size=4095553: (22) Invalid argument 2024-09-12T00:30:58.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.612+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=D6V14OZDY88N type=del size=2125587 2024-09-12T00:30:58.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.614+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=T670SY3QWG2Q type=del 2024-09-12T00:30:58.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.617+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~1N6UQG2ZBPCX.0 size=1048576 2024-09-12T00:30:58.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.618+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~1N6UQG2ZBPCX.1 size=504121 2024-09-12T00:30:58.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.618+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=1N6UQG2ZBPCX tag=MWTW1NYE4NG7 type=write size=2601273 2024-09-12T00:30:58.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.619+0000 7f0362c73780 -1 < no bi entry to suggest for operation key=Q6M0D2698CUZ tag=IFWO6H4WQ7KM type=del size=2858302: (2) No such file or directory 2024-09-12T00:30:58.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.620+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=R5YBW2A3YHZX type=write size=774569 2024-09-12T00:30:58.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.622+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=59L9MCOC0EY9 type=del 2024-09-12T00:30:58.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.623+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=860AEKZ1K955 type=del size=1385028 2024-09-12T00:30:58.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.626+0000 7f0362c73780 1 < suggested update operation key=PYCRNXC9ITGF tag=11ILCXHHBUSR type=del size=782471 2024-09-12T00:30:58.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.629+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~1APIIA3F662K.0 size=126088 2024-09-12T00:30:58.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.629+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=1APIIA3F662K tag=DYGNCKL98LYW type=write size=1174664 2024-09-12T00:30:58.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.631+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=WM4X1UD7G705 type=del 2024-09-12T00:30:58.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.634+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~S03VHOCMKJ87.0 size=1048576 2024-09-12T00:30:58.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.635+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~S03VHOCMKJ87.1 size=1048576 2024-09-12T00:30:58.634 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.636+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~S03VHOCMKJ87.2 size=388003 2024-09-12T00:30:58.634 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.636+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=S03VHOCMKJ87 tag=2DRBFN71PYY6 type=write size=3533731 2024-09-12T00:30:58.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.638+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~PSXLI7Z2JNR2.0 size=1048576 2024-09-12T00:30:58.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.639+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~PSXLI7Z2JNR2.1 size=502845 2024-09-12T00:30:58.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.641+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=PSXLI7Z2JNR2 tag=0C4PRI1XUXTQ type=write size=2599997 2024-09-12T00:30:58.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.642+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=TBF7WXQZ2QY3 type=del size=1223045 2024-09-12T00:30:58.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.646+0000 7f0362c73780 1 < suggested remove operation key=927NCYXX8Z2P tag=PBMQ04AQT9RL type=del 2024-09-12T00:30:58.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.647+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=VTF95D3PCYF1 type=del size=1226991 2024-09-12T00:30:58.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.649+0000 7f0362c73780 1 < canceled operation key=J5GSZCJW2BP1 tag=H5U7PVVHC6KP type=del size=3088300 2024-09-12T00:30:58.649 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.650+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=F6LLMUK3NYT6 type=del size=394387 2024-09-12T00:30:58.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.652+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~WHGY1GS65OWV.0 size=1048576 2024-09-12T00:30:58.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.652+0000 7f0362c73780 1 < canceled part key=_multipart_1UUNRPUKAINC.2~WHGY1GS65OWV.1 size=1048576 2024-09-12T00:30:58.651 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.653+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~WHGY1GS65OWV.2 size=451221 2024-09-12T00:30:58.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.655+0000 7f0362c73780 1 < canceled multipart upload key=1UUNRPUKAINC upload=WHGY1GS65OWV tag=TGSRVZZGIB2Q type=write size=3596949 2024-09-12T00:30:58.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.657+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=8T7D9TUXINIU type=del size=529647 2024-09-12T00:30:58.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.660+0000 7f0362c73780 1 < suggested remove operation key=J5GSZCJW2BP1 tag=2E90OKV1E72Z type=del 2024-09-12T00:30:58.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.661+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=P0JOMC9TZ1KQ type=del size=1007866 2024-09-12T00:30:58.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.663+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~YM468PF550S7.0 size=438529 2024-09-12T00:30:58.664 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.665+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=YM468PF550S7 tag=QQFRQ9OF4RBR type=write size=1487105 2024-09-12T00:30:58.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.667+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=8Q0RWQ0H5WU5 type=write size=256880 2024-09-12T00:30:58.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.669+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~TDUOUJ112OST.0 size=1048576 2024-09-12T00:30:58.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.670+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~TDUOUJ112OST.1 size=1048576 2024-09-12T00:30:58.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.671+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~TDUOUJ112OST.2 size=139644 2024-09-12T00:30:58.671 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.673+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=TDUOUJ112OST tag=4SNPX29NQ6JF type=write size=3285372 2024-09-12T00:30:58.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.676+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~II8EDPTKX5TE.0 size=1048576 2024-09-12T00:30:58.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.677+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~II8EDPTKX5TE.1 size=744906 2024-09-12T00:30:58.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.677+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=II8EDPTKX5TE tag=QUP72245PAU7 type=write size=2842058 2024-09-12T00:30:58.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.680+0000 7f0362c73780 1 < suggested update operation key=HEN9LUUIDAR5 tag=RSS9XRJMCJMM type=write size=46316 2024-09-12T00:30:58.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.683+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~VIZ62EIR2GXR.0 size=1048576 2024-09-12T00:30:58.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.684+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~VIZ62EIR2GXR.1 size=1048576 2024-09-12T00:30:58.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.685+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~VIZ62EIR2GXR.2 size=446656 2024-09-12T00:30:58.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.685+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=VIZ62EIR2GXR tag=LUR9ZXJXSB5Z type=write size=3592384 2024-09-12T00:30:58.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.687+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~47Z50FZRIQXU.0 size=1019456 2024-09-12T00:30:58.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.690+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=47Z50FZRIQXU tag=XYK27JHA1LVB type=write size=2068032 2024-09-12T00:30:58.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.693+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~OXUJPLCRDIG9.0 size=1048576 2024-09-12T00:30:58.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.694+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~OXUJPLCRDIG9.1 size=540759 2024-09-12T00:30:58.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.694+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=OXUJPLCRDIG9 tag=342X13MA12BX type=write size=2637911 2024-09-12T00:30:58.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.696+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~QHQQDKXV2FUF.0 size=1048576 2024-09-12T00:30:58.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.697+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~QHQQDKXV2FUF.1 size=731485 2024-09-12T00:30:58.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.700+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=QHQQDKXV2FUF tag=O4JXKO355CXA type=write size=2828637 2024-09-12T00:30:58.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.702+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=1TDU8KT7JVFQ type=write size=420281 2024-09-12T00:30:58.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.703+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=D6V14OZDY88N type=del 2024-09-12T00:30:58.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.705+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=JQ1OY9FJFWEB type=del size=2108957 2024-09-12T00:30:58.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.707+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~1N6UQG2ZBPCX.0 size=1048576 2024-09-12T00:30:58.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.708+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~1N6UQG2ZBPCX.1 size=504121 2024-09-12T00:30:58.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.711+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=1N6UQG2ZBPCX tag=MWTW1NYE4NG7 type=write size=2601273 2024-09-12T00:30:58.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.713+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=MBR5XGCT1LZ7 type=write size=437662 2024-09-12T00:30:58.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.714+0000 7f0362c73780 1 < completed write operation key=EHBOL435W9ZE tag=R5YBW2A3YHZX type=write size=774569 2024-09-12T00:30:58.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.716+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=N862O3SFJANF type=del size=3959728 2024-09-12T00:30:58.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.718+0000 7f0362c73780 1 < canceled operation key=XR8L0HL374VC tag=860AEKZ1K955 type=del size=1385028 2024-09-12T00:30:58.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.721+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~PTYDFNP0EX42.0 size=1048576 2024-09-12T00:30:58.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.722+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~PTYDFNP0EX42.1 size=1048576 2024-09-12T00:30:58.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.723+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~PTYDFNP0EX42.2 size=76826 2024-09-12T00:30:58.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.723+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=PTYDFNP0EX42 tag=GXVRRIUZ462J type=write size=3222554 2024-09-12T00:30:58.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.725+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~1APIIA3F662K.0 size=126088 2024-09-12T00:30:58.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.727+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=1APIIA3F662K tag=DYGNCKL98LYW type=write size=1174664 2024-09-12T00:30:58.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.729+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~G33H6XQ411P5.0 size=1048576 2024-09-12T00:30:58.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.731+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~G33H6XQ411P5.1 size=1048576 2024-09-12T00:30:58.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.732+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~G33H6XQ411P5.2 size=432506 2024-09-12T00:30:58.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.732+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=G33H6XQ411P5 tag=9XOYCP27IPHI type=write size=3578234 2024-09-12T00:30:58.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.733+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~S03VHOCMKJ87.0 size=1048576 2024-09-12T00:30:58.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.733+0000 7f0362c73780 1 < canceled part key=_multipart_WT0185G517YR.2~S03VHOCMKJ87.1 size=1048576 2024-09-12T00:30:58.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.733+0000 7f0362c73780 1 < canceled part key=_multipart_WT0185G517YR.2~S03VHOCMKJ87.2 size=388003 2024-09-12T00:30:58.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.737+0000 7f0362c73780 1 < canceled multipart upload key=WT0185G517YR upload=S03VHOCMKJ87 tag=2DRBFN71PYY6 type=write size=3533731 2024-09-12T00:30:58.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.739+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=SCFKJW50RJNJ type=del size=1591360 2024-09-12T00:30:58.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.739+0000 7f0362c73780 -1 < no bi entry to suggest for operation key=J5GSZCJW2BP1 tag=TBF7WXQZ2QY3 type=del size=1223045: (2) No such file or directory 2024-09-12T00:30:58.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.742+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~XYHTD05WXR0N.0 size=1048576 2024-09-12T00:30:58.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.743+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~XYHTD05WXR0N.1 size=1048576 2024-09-12T00:30:58.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.744+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~XYHTD05WXR0N.2 size=873587 2024-09-12T00:30:58.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.744+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=XYHTD05WXR0N tag=H867W0YSAQLJ type=write size=4019315 2024-09-12T00:30:58.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.745+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=VTF95D3PCYF1 type=del 2024-09-12T00:30:58.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.747+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=AWULSCH6BG1O type=del size=1237287 2024-09-12T00:30:58.748 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.750+0000 7f0362c73780 1 < suggested remove operation key=YTN99RBTKO39 tag=F6LLMUK3NYT6 type=del 2024-09-12T00:30:58.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.751+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=N47H3EZPJKML type=write size=737643 2024-09-12T00:30:58.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.753+0000 7f0362c73780 1 < canceled operation key=KWDEKRO3WICD tag=8T7D9TUXINIU type=del size=529647 2024-09-12T00:30:58.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.754+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=739BSKKPGWZ0 type=del size=1663085 2024-09-12T00:30:58.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.757+0000 7f0362c73780 1 < suggested update operation key=EHBOL435W9ZE tag=P0JOMC9TZ1KQ type=del size=1007866 2024-09-12T00:30:58.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.758+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=VMZUDRRIW5KN type=del size=2380802 2024-09-12T00:30:58.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.760+0000 7f0362c73780 1 < completed write operation key=WT0185G517YR tag=8Q0RWQ0H5WU5 type=write size=256880 2024-09-12T00:30:58.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.763+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~QOSWDAKNIFD8.0 size=1048576 2024-09-12T00:30:58.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.764+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~QOSWDAKNIFD8.1 size=314154 2024-09-12T00:30:58.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.764+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=QOSWDAKNIFD8 tag=PK7015IPJMV9 type=write size=2411306 2024-09-12T00:30:58.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.766+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~II8EDPTKX5TE.0 size=1048576 2024-09-12T00:30:58.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.767+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~II8EDPTKX5TE.1 size=744906 2024-09-12T00:30:58.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.770+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=II8EDPTKX5TE tag=QUP72245PAU7 type=write size=2842058 2024-09-12T00:30:58.771 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.772+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~RWMXFNCDTXQ3.0 size=972524 2024-09-12T00:30:58.771 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.772+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=RWMXFNCDTXQ3 tag=QSTH0F3B100Q type=write size=2021100 2024-09-12T00:30:58.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.774+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~VIZ62EIR2GXR.0 size=1048576 2024-09-12T00:30:58.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.774+0000 7f0362c73780 1 < canceled part key=_multipart_1IPW8SJ6SSU2.2~VIZ62EIR2GXR.1 size=1048576 2024-09-12T00:30:58.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.775+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~VIZ62EIR2GXR.2 size=446656 2024-09-12T00:30:58.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.778+0000 7f0362c73780 1 < canceled multipart upload key=1IPW8SJ6SSU2 upload=VIZ62EIR2GXR tag=LUR9ZXJXSB5Z type=write size=3592384 2024-09-12T00:30:58.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.781+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~NUURN8N8L1HP.0 size=585219 2024-09-12T00:30:58.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.781+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=NUURN8N8L1HP tag=V7U4HDFDO0ZT type=write size=1633795 2024-09-12T00:30:58.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.782+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~OXUJPLCRDIG9.0 size=1048576 2024-09-12T00:30:58.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.783+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~OXUJPLCRDIG9.1 size=540759 2024-09-12T00:30:58.784 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.786+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=OXUJPLCRDIG9 tag=342X13MA12BX type=write size=2637911 2024-09-12T00:30:58.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.787+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=XHV04P12M41A type=write size=1037368 2024-09-12T00:30:58.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.788+0000 7f0362c73780 -1 < failed to complete operation key=EHBOL435W9ZE tag=1TDU8KT7JVFQ type=write size=420281: (22) Invalid argument 2024-09-12T00:30:58.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.790+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=XLCEREMP8EY0 type=write size=431158 2024-09-12T00:30:58.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.791+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=JQ1OY9FJFWEB type=del 2024-09-12T00:30:58.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.794+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~VUHY7WGAOHVS.0 size=226510 2024-09-12T00:30:58.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.794+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=VUHY7WGAOHVS tag=C6K6HBRQR8IH type=write size=1275086 2024-09-12T00:30:58.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.796+0000 7f0362c73780 1 < completed write operation key=PYCRNXC9ITGF tag=MBR5XGCT1LZ7 type=write size=437662 2024-09-12T00:30:58.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.798+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~9NQAVEGP19TP.0 size=1048576 2024-09-12T00:30:58.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.799+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~9NQAVEGP19TP.1 size=1048576 2024-09-12T00:30:58.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.800+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~9NQAVEGP19TP.2 size=808055 2024-09-12T00:30:58.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.800+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=9NQAVEGP19TP tag=B4RPNBOIR7Y0 type=write size=3953783 2024-09-12T00:30:58.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.803+0000 7f0362c73780 1 < suggested remove operation key=1UUNRPUKAINC tag=N862O3SFJANF type=del 2024-09-12T00:30:58.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.806+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~1NBWK26GVV6J.0 size=1048576 2024-09-12T00:30:58.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.807+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~1NBWK26GVV6J.1 size=1048576 2024-09-12T00:30:58.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.808+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~1NBWK26GVV6J.2 size=853719 2024-09-12T00:30:58.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.808+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=1NBWK26GVV6J tag=3523SQT3TEXJ type=write size=3999447 2024-09-12T00:30:58.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.809+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~PTYDFNP0EX42.0 size=1048576 2024-09-12T00:30:58.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.810+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~PTYDFNP0EX42.1 size=1048576 2024-09-12T00:30:58.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.812+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~PTYDFNP0EX42.2 size=76826 2024-09-12T00:30:58.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.814+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=PTYDFNP0EX42 tag=GXVRRIUZ462J type=write size=3222554 2024-09-12T00:30:58.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.815+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=7FC4MEK16LFD type=del size=978280 2024-09-12T00:30:58.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.817+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~G33H6XQ411P5.0 size=1048576 2024-09-12T00:30:58.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.818+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~G33H6XQ411P5.1 size=1048576 2024-09-12T00:30:58.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.819+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~G33H6XQ411P5.2 size=432506 2024-09-12T00:30:58.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.821+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=G33H6XQ411P5 tag=9XOYCP27IPHI type=write size=3578234 2024-09-12T00:30:58.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.822+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=ZIA010BGNHOJ type=del size=2115776 2024-09-12T00:30:58.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.824+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=SCFKJW50RJNJ type=del 2024-09-12T00:30:58.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.825+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=AUATQQDYLTC7 type=write size=611473 2024-09-12T00:30:58.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.826+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~XYHTD05WXR0N.0 size=1048576 2024-09-12T00:30:58.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.828+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~XYHTD05WXR0N.1 size=1048576 2024-09-12T00:30:58.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.828+0000 7f0362c73780 1 < canceled part key=_multipart_1MLL1T362X51.2~XYHTD05WXR0N.2 size=873587 2024-09-12T00:30:58.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.830+0000 7f0362c73780 1 < canceled multipart upload key=1MLL1T362X51 upload=XYHTD05WXR0N tag=H867W0YSAQLJ type=write size=4019315 2024-09-12T00:30:58.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.832+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~ZAFBHKKXHL5Y.0 size=1048576 2024-09-12T00:30:58.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.834+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~ZAFBHKKXHL5Y.1 size=161996 2024-09-12T00:30:58.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.834+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=ZAFBHKKXHL5Y tag=IBV41EEM16HL type=write size=2259148 2024-09-12T00:30:58.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.835+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=AWULSCH6BG1O type=del 2024-09-12T00:30:58.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.837+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=QFYVCUL2JH3B type=del size=198325 2024-09-12T00:30:58.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.839+0000 7f0362c73780 1 < suggested update operation key=X4ZML0796M7F tag=N47H3EZPJKML type=write size=737643 2024-09-12T00:30:58.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.842+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~6MTXB3NKL5TV.0 size=935216 2024-09-12T00:30:58.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.842+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=6MTXB3NKL5TV tag=R0KBACBG37U7 type=write size=1983792 2024-09-12T00:30:58.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.843+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=739BSKKPGWZ0 type=del 2024-09-12T00:30:58.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.845+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=YQCNZ1KN5Q52 type=write size=612128 2024-09-12T00:30:58.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.846+0000 7f0362c73780 1 < canceled operation key=IIZAWZDLR2QE tag=VMZUDRRIW5KN type=del size=2380802 2024-09-12T00:30:58.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.849+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~CCP28LP3CQY6.0 size=1048576 2024-09-12T00:30:58.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.850+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~CCP28LP3CQY6.1 size=1048576 2024-09-12T00:30:58.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.851+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~CCP28LP3CQY6.2 size=202493 2024-09-12T00:30:58.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.851+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=CCP28LP3CQY6 tag=7T3ULCL3WL1I type=write size=3348221 2024-09-12T00:30:58.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.852+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~QOSWDAKNIFD8.0 size=1048576 2024-09-12T00:30:58.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.854+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~QOSWDAKNIFD8.1 size=314154 2024-09-12T00:30:58.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.856+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=QOSWDAKNIFD8 tag=PK7015IPJMV9 type=write size=2411306 2024-09-12T00:30:58.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.859+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~J2T28IZ5C299.0 size=822015 2024-09-12T00:30:58.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.859+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=J2T28IZ5C299 tag=HDT1F9U3AN7Z type=write size=1870591 2024-09-12T00:30:58.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.860+0000 7f0362c73780 1 < canceled part key=_multipart_CZHT9UQS34JU.2~RWMXFNCDTXQ3.0 size=972524 2024-09-12T00:30:58.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.862+0000 7f0362c73780 1 < canceled multipart upload key=CZHT9UQS34JU upload=RWMXFNCDTXQ3 tag=QSTH0F3B100Q type=write size=2021100 2024-09-12T00:30:58.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.863+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=EPD1FM8I5RPC type=del size=119267 2024-09-12T00:30:58.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.865+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~NUURN8N8L1HP.0 size=585219 2024-09-12T00:30:58.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.867+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=NUURN8N8L1HP tag=V7U4HDFDO0ZT type=write size=1633795 2024-09-12T00:30:58.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.871+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~3FBTLQ3XE0MO.0 size=1048576 2024-09-12T00:30:58.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.872+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~3FBTLQ3XE0MO.1 size=1048576 2024-09-12T00:30:58.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.873+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~3FBTLQ3XE0MO.2 size=573976 2024-09-12T00:30:58.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.873+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=3FBTLQ3XE0MO tag=25EYQL3H24S6 type=write size=3719704 2024-09-12T00:30:58.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.876+0000 7f0362c73780 1 < suggested update operation key=HWSQFSK29S0V tag=XHV04P12M41A type=write size=1037368 2024-09-12T00:30:58.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.879+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~KWD6QEWR2FG6.0 size=1048576 2024-09-12T00:30:58.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.880+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~KWD6QEWR2FG6.1 size=1048576 2024-09-12T00:30:58.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.881+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~KWD6QEWR2FG6.2 size=337965 2024-09-12T00:30:58.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.881+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=KWD6QEWR2FG6 tag=9MS4WT0UU0RK type=write size=3483693 2024-09-12T00:30:58.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.884+0000 7f0362c73780 1 < suggested remove operation key=PYCRNXC9ITGF tag=XLCEREMP8EY0 type=write 2024-09-12T00:30:58.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.886+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~TUCHQHK5XQJM.0 size=1048576 2024-09-12T00:30:58.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.888+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~TUCHQHK5XQJM.1 size=510899 2024-09-12T00:30:58.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.888+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=TUCHQHK5XQJM tag=UOFPP898L3C5 type=write size=2608051 2024-09-12T00:30:58.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.889+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~VUHY7WGAOHVS.0 size=226510 2024-09-12T00:30:58.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.891+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=VUHY7WGAOHVS tag=C6K6HBRQR8IH type=write size=1275086 2024-09-12T00:30:58.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.893+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=OPELW8UMIK5G type=write size=810537 2024-09-12T00:30:58.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.895+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~9NQAVEGP19TP.0 size=1048576 2024-09-12T00:30:58.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.896+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~9NQAVEGP19TP.1 size=1048576 2024-09-12T00:30:58.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.897+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~9NQAVEGP19TP.2 size=808055 2024-09-12T00:30:58.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.899+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=9NQAVEGP19TP tag=B4RPNBOIR7Y0 type=write size=3953783 2024-09-12T00:30:58.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.901+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=1BE05ORKGGVO type=del size=4146300 2024-09-12T00:30:58.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.902+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~1NBWK26GVV6J.0 size=1048576 2024-09-12T00:30:58.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.903+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~1NBWK26GVV6J.1 size=1048576 2024-09-12T00:30:58.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.905+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~1NBWK26GVV6J.2 size=853719 2024-09-12T00:30:58.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.907+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=1NBWK26GVV6J tag=3523SQT3TEXJ type=write size=3999447 2024-09-12T00:30:58.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.908+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=NSIFDZ140WZU type=del size=1399405 2024-09-12T00:30:58.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.910+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=7FC4MEK16LFD type=del 2024-09-12T00:30:58.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.911+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=M1U3W784OOL3 type=write size=790252 2024-09-12T00:30:58.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.913+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=ZIA010BGNHOJ type=del 2024-09-12T00:30:58.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.915+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~1IEG0HX3DBTU.0 size=555793 2024-09-12T00:30:58.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.915+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=1IEG0HX3DBTU tag=6RR9HRQHNTTT type=write size=1604369 2024-09-12T00:30:58.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.917+0000 7f0362c73780 1 < completed write operation key=1IPW8SJ6SSU2 tag=AUATQQDYLTC7 type=write size=611473 2024-09-12T00:30:58.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.918+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=ULTNDNTPKLLV type=del size=3735927 2024-09-12T00:30:58.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.919+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~ZAFBHKKXHL5Y.0 size=1048576 2024-09-12T00:30:58.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.921+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~ZAFBHKKXHL5Y.1 size=161996 2024-09-12T00:30:58.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.923+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=ZAFBHKKXHL5Y tag=IBV41EEM16HL type=write size=2259148 2024-09-12T00:30:58.924 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.925+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~AMXMY7018HAW.0 size=1048576 2024-09-12T00:30:58.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.927+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~AMXMY7018HAW.1 size=1048576 2024-09-12T00:30:58.926 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.928+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~AMXMY7018HAW.2 size=1031265 2024-09-12T00:30:58.926 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.928+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=AMXMY7018HAW tag=P089E1WYB1EY type=write size=4176993 2024-09-12T00:30:58.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.929+0000 7f0362c73780 -1 < failed to complete operation key=HWSQFSK29S0V tag=QFYVCUL2JH3B type=del size=198325: (22) Invalid argument 2024-09-12T00:30:58.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.932+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~8K33TFFWZ0SZ.0 size=1048576 2024-09-12T00:30:58.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.934+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~8K33TFFWZ0SZ.1 size=1001921 2024-09-12T00:30:58.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.934+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=8K33TFFWZ0SZ tag=SI1IFPWC29E3 type=write size=3099073 2024-09-12T00:30:58.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.934+0000 7f0362c73780 1 < canceled part key=_multipart_R4ABY5AY0S1P.2~6MTXB3NKL5TV.0 size=935216 2024-09-12T00:30:58.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.937+0000 7f0362c73780 1 < canceled multipart upload key=R4ABY5AY0S1P upload=6MTXB3NKL5TV tag=R0KBACBG37U7 type=write size=1983792 2024-09-12T00:30:58.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.938+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=MD3NY27BY24U type=del size=810611 2024-09-12T00:30:58.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.940+0000 7f0362c73780 1 < completed write operation key=KWDEKRO3WICD tag=YQCNZ1KN5Q52 type=write size=612128 2024-09-12T00:30:58.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.943+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~YYA6EXKZPO3N.0 size=1048576 2024-09-12T00:30:58.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.944+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~YYA6EXKZPO3N.1 size=1048576 2024-09-12T00:30:58.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.945+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~YYA6EXKZPO3N.2 size=480600 2024-09-12T00:30:58.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.945+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=YYA6EXKZPO3N tag=AYRDVENH9W6B type=write size=3626328 2024-09-12T00:30:58.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.947+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~CCP28LP3CQY6.0 size=1048576 2024-09-12T00:30:58.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.948+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~CCP28LP3CQY6.1 size=1048576 2024-09-12T00:30:58.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.949+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~CCP28LP3CQY6.2 size=202493 2024-09-12T00:30:58.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.951+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=CCP28LP3CQY6 tag=7T3ULCL3WL1I type=write size=3348221 2024-09-12T00:30:58.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.953+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~IC0MA8GYZ61T.0 size=1048576 2024-09-12T00:30:58.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.954+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~IC0MA8GYZ61T.1 size=473892 2024-09-12T00:30:58.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.954+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=IC0MA8GYZ61T tag=Y0SJPTARU5OJ type=write size=2571044 2024-09-12T00:30:58.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.956+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~J2T28IZ5C299.0 size=822015 2024-09-12T00:30:58.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.958+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=J2T28IZ5C299 tag=HDT1F9U3AN7Z type=write size=1870591 2024-09-12T00:30:58.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.962+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~L6PPQ6M5VIWQ.0 size=1048576 2024-09-12T00:30:58.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.963+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~L6PPQ6M5VIWQ.1 size=1048576 2024-09-12T00:30:58.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.965+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~L6PPQ6M5VIWQ.2 size=367784 2024-09-12T00:30:58.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.965+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=L6PPQ6M5VIWQ tag=QN0UGL13TAYP type=write size=3513512 2024-09-12T00:30:58.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.966+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=EPD1FM8I5RPC type=del 2024-09-12T00:30:58.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.968+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=B1JEJ2TVVECH type=del size=437693 2024-09-12T00:30:58.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.969+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~3FBTLQ3XE0MO.0 size=1048576 2024-09-12T00:30:58.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.970+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~3FBTLQ3XE0MO.1 size=1048576 2024-09-12T00:30:58.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.971+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~3FBTLQ3XE0MO.2 size=573976 2024-09-12T00:30:58.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.974+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=3FBTLQ3XE0MO tag=25EYQL3H24S6 type=write size=3719704 2024-09-12T00:30:58.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.977+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~92QNC09MZR9Y.0 size=1048576 2024-09-12T00:30:58.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.978+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~92QNC09MZR9Y.1 size=340394 2024-09-12T00:30:58.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.978+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=92QNC09MZR9Y tag=1J73Q3LQ0TD9 type=write size=2437546 2024-09-12T00:30:58.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.979+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~KWD6QEWR2FG6.0 size=1048576 2024-09-12T00:30:58.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.981+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~KWD6QEWR2FG6.1 size=1048576 2024-09-12T00:30:58.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.982+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~KWD6QEWR2FG6.2 size=337965 2024-09-12T00:30:58.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.984+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=KWD6QEWR2FG6 tag=9MS4WT0UU0RK type=write size=3483693 2024-09-12T00:30:58.985 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.987+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~5N7X1TUQX47V.0 size=1048576 2024-09-12T00:30:58.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.988+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~5N7X1TUQX47V.1 size=1048576 2024-09-12T00:30:58.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.989+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~5N7X1TUQX47V.2 size=276860 2024-09-12T00:30:58.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.989+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=5N7X1TUQX47V tag=JGJMI44ESOCV type=write size=3422588 2024-09-12T00:30:58.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.991+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~TUCHQHK5XQJM.0 size=1048576 2024-09-12T00:30:58.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.992+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~TUCHQHK5XQJM.1 size=510899 2024-09-12T00:30:58.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.994+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=TUCHQHK5XQJM tag=UOFPP898L3C5 type=write size=2608051 2024-09-12T00:30:58.994 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.996+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=CPRTO9XCGVOK type=del size=3651481 2024-09-12T00:30:58.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:58.999+0000 7f0362c73780 1 < suggested remove operation key=927NCYXX8Z2P tag=OPELW8UMIK5G type=write 2024-09-12T00:30:58.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.000+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=UR9I7VXY14EF type=del size=3751830 2024-09-12T00:30:59.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.003+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=1BE05ORKGGVO type=del 2024-09-12T00:30:59.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.005+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=LK23YEAGZWPP type=del size=4099040 2024-09-12T00:30:59.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.008+0000 7f0362c73780 1 < suggested update operation key=44YJP6XPIFT5 tag=NSIFDZ140WZU type=del size=1399405 2024-09-12T00:30:59.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.009+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=QUZ5RWDOH6ZV type=del size=1952600 2024-09-12T00:30:59.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.011+0000 7f0362c73780 1 < completed write operation key=PYCRNXC9ITGF tag=M1U3W784OOL3 type=write size=790252 2024-09-12T00:30:59.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.014+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~K9OJNDCOWWZ1.0 size=693020 2024-09-12T00:30:59.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.014+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=K9OJNDCOWWZ1 tag=1JRX7RVF2QTC type=write size=1741596 2024-09-12T00:30:59.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.015+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~1IEG0HX3DBTU.0 size=555793 2024-09-12T00:30:59.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.018+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=1IEG0HX3DBTU tag=6RR9HRQHNTTT type=write size=1604369 2024-09-12T00:30:59.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.020+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=OHOBVL6V8CCX type=del size=4104721 2024-09-12T00:30:59.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.021+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=ULTNDNTPKLLV type=del 2024-09-12T00:30:59.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.023+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=6740IWDLSNDY type=write size=409826 2024-09-12T00:30:59.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.023+0000 7f0362c73780 1 < canceled part key=_multipart_84T1VJG5SHU4.2~AMXMY7018HAW.0 size=1048576 2024-09-12T00:30:59.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.023+0000 7f0362c73780 1 < canceled part key=_multipart_84T1VJG5SHU4.2~AMXMY7018HAW.1 size=1048576 2024-09-12T00:30:59.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.024+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~AMXMY7018HAW.2 size=1031265 2024-09-12T00:30:59.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.026+0000 7f0362c73780 1 < canceled multipart upload key=84T1VJG5SHU4 upload=AMXMY7018HAW tag=P089E1WYB1EY type=write size=4176993 2024-09-12T00:30:59.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.028+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=2353LI8KSXSU type=del size=3772033 2024-09-12T00:30:59.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.029+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~8K33TFFWZ0SZ.0 size=1048576 2024-09-12T00:30:59.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.031+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~8K33TFFWZ0SZ.1 size=1001921 2024-09-12T00:30:59.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.033+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=8K33TFFWZ0SZ tag=SI1IFPWC29E3 type=write size=3099073 2024-09-12T00:30:59.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.035+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~HO7646DB8607.0 size=1048576 2024-09-12T00:30:59.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.037+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~HO7646DB8607.1 size=340846 2024-09-12T00:30:59.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.037+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=HO7646DB8607 tag=T13SHYFW4B5Q type=write size=2437998 2024-09-12T00:30:59.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.039+0000 7f0362c73780 1 < suggested remove operation key=HWSQFSK29S0V tag=MD3NY27BY24U type=del 2024-09-12T00:30:59.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.042+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~IB3MSY4HT3CJ.0 size=129631 2024-09-12T00:30:59.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.042+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=IB3MSY4HT3CJ tag=AC4S6YEP0G2I type=write size=1178207 2024-09-12T00:30:59.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.044+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~YYA6EXKZPO3N.0 size=1048576 2024-09-12T00:30:59.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.045+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~YYA6EXKZPO3N.1 size=1048576 2024-09-12T00:30:59.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.046+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~YYA6EXKZPO3N.2 size=480600 2024-09-12T00:30:59.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.048+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=YYA6EXKZPO3N tag=AYRDVENH9W6B type=write size=3626328 2024-09-12T00:30:59.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.051+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~39ANZS3VBFV3.0 size=237758 2024-09-12T00:30:59.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.051+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=39ANZS3VBFV3 tag=BDACP0MEFAFO type=write size=1286334 2024-09-12T00:30:59.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.052+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~IC0MA8GYZ61T.0 size=1048576 2024-09-12T00:30:59.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.054+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~IC0MA8GYZ61T.1 size=473892 2024-09-12T00:30:59.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.056+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=IC0MA8GYZ61T tag=Y0SJPTARU5OJ type=write size=2571044 2024-09-12T00:30:59.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.057+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=E6M9783ZR7C5 type=write size=616089 2024-09-12T00:30:59.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.059+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~L6PPQ6M5VIWQ.0 size=1048576 2024-09-12T00:30:59.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.060+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~L6PPQ6M5VIWQ.1 size=1048576 2024-09-12T00:30:59.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.061+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~L6PPQ6M5VIWQ.2 size=367784 2024-09-12T00:30:59.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.063+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=L6PPQ6M5VIWQ tag=QN0UGL13TAYP type=write size=3513512 2024-09-12T00:30:59.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.065+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~UFLX1W03C3C8.0 size=636013 2024-09-12T00:30:59.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.065+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=UFLX1W03C3C8 tag=2BLJPKOMR377 type=write size=1684589 2024-09-12T00:30:59.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.069+0000 7f0362c73780 1 < suggested update operation key=Q6M0D2698CUZ tag=B1JEJ2TVVECH type=del size=437693 2024-09-12T00:30:59.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.070+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=KOOLTOFBZ5VW type=del size=2372052 2024-09-12T00:30:59.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.072+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~92QNC09MZR9Y.0 size=1048576 2024-09-12T00:30:59.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.073+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~92QNC09MZR9Y.1 size=340394 2024-09-12T00:30:59.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.075+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=92QNC09MZR9Y tag=1J73Q3LQ0TD9 type=write size=2437546 2024-09-12T00:30:59.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.077+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=9CJRSNTFLYOP type=del size=1192077 2024-09-12T00:30:59.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.079+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~5N7X1TUQX47V.0 size=1048576 2024-09-12T00:30:59.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.080+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~5N7X1TUQX47V.1 size=1048576 2024-09-12T00:30:59.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.082+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~5N7X1TUQX47V.2 size=276860 2024-09-12T00:30:59.083 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.085+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=5N7X1TUQX47V tag=JGJMI44ESOCV type=write size=3422588 2024-09-12T00:30:59.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.086+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=7MJZHWCX70KZ type=del size=830315 2024-09-12T00:30:59.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.088+0000 7f0362c73780 1 < completed delete operation key=PLAYMR18X9DZ tag=CPRTO9XCGVOK type=del 2024-09-12T00:30:59.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.091+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~KOM8ZQ5Q15ZO.0 size=1048576 2024-09-12T00:30:59.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.092+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~KOM8ZQ5Q15ZO.1 size=1048576 2024-09-12T00:30:59.092 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.093+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~KOM8ZQ5Q15ZO.2 size=499089 2024-09-12T00:30:59.092 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.093+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=KOM8ZQ5Q15ZO tag=8Q1PE25FVO3L type=write size=3644817 2024-09-12T00:30:59.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.095+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=UR9I7VXY14EF type=del 2024-09-12T00:30:59.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.096+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=Q8CV0IXBF8GG type=del size=3308203 2024-09-12T00:30:59.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.098+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=LK23YEAGZWPP type=del 2024-09-12T00:30:59.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.100+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~TYLF06YKBDZ1.0 size=661153 2024-09-12T00:30:59.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.100+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=TYLF06YKBDZ1 tag=RGVCRPEBQF0Y type=write size=1709729 2024-09-12T00:30:59.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.102+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=QUZ5RWDOH6ZV type=del 2024-09-12T00:30:59.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.104+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~BKLDRUF8XMFQ.0 size=193328 2024-09-12T00:30:59.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.104+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=BKLDRUF8XMFQ tag=1Y3G4HKDFL5Y type=write size=1241904 2024-09-12T00:30:59.105 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.106+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~K9OJNDCOWWZ1.0 size=693020 2024-09-12T00:30:59.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.109+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=K9OJNDCOWWZ1 tag=1JRX7RVF2QTC type=write size=1741596 2024-09-12T00:30:59.109 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.110+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=A9HOBC32VD4S type=del size=3428378 2024-09-12T00:30:59.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.112+0000 7f0362c73780 1 < canceled operation key=CZHT9UQS34JU tag=OHOBVL6V8CCX type=del size=4104721 2024-09-12T00:30:59.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.113+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=HIWSXJ98V7CO type=del size=2271870 2024-09-12T00:30:59.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.115+0000 7f0362c73780 1 < completed write operation key=XMMZOX8MH3GT tag=6740IWDLSNDY type=write size=409826 2024-09-12T00:30:59.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.117+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~320L1YZ91PBW.0 size=1048576 2024-09-12T00:30:59.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.118+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~320L1YZ91PBW.1 size=927640 2024-09-12T00:30:59.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.118+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=320L1YZ91PBW tag=CBOOOJS8GBOM type=write size=3024792 2024-09-12T00:30:59.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.120+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=2353LI8KSXSU type=del 2024-09-12T00:30:59.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.122+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=PDB8QT8ARYDQ type=del size=4168656 2024-09-12T00:30:59.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.123+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~HO7646DB8607.0 size=1048576 2024-09-12T00:30:59.122 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.124+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~HO7646DB8607.1 size=340846 2024-09-12T00:30:59.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.126+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=HO7646DB8607 tag=T13SHYFW4B5Q type=write size=2437998 2024-09-12T00:30:59.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.128+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=63HXHYCQ20RM type=del size=3942884 2024-09-12T00:30:59.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.129+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~IB3MSY4HT3CJ.0 size=129631 2024-09-12T00:30:59.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.131+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=IB3MSY4HT3CJ tag=AC4S6YEP0G2I type=write size=1178207 2024-09-12T00:30:59.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.134+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~8AEAABMT5EQH.0 size=1048576 2024-09-12T00:30:59.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.135+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~8AEAABMT5EQH.1 size=639706 2024-09-12T00:30:59.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.135+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=8AEAABMT5EQH tag=6LRAMV8TB1W3 type=write size=2736858 2024-09-12T00:30:59.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.136+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~39ANZS3VBFV3.0 size=237758 2024-09-12T00:30:59.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.140+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=39ANZS3VBFV3 tag=BDACP0MEFAFO type=write size=1286334 2024-09-12T00:30:59.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.141+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=3SHNCI4OSY9N type=del size=2393264 2024-09-12T00:30:59.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.143+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=E6M9783ZR7C5 type=write size=616089 2024-09-12T00:30:59.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.144+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=D953ZDRE2W72 type=write size=246739 2024-09-12T00:30:59.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.146+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~UFLX1W03C3C8.0 size=636013 2024-09-12T00:30:59.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.148+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=UFLX1W03C3C8 tag=2BLJPKOMR377 type=write size=1684589 2024-09-12T00:30:59.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.149+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=TVHA28OIJTU9 type=del size=2992570 2024-09-12T00:30:59.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.152+0000 7f0362c73780 1 < suggested update operation key=1MLL1T362X51 tag=KOOLTOFBZ5VW type=del size=2372052 2024-09-12T00:30:59.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.154+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~3PGLRCN5SD03.0 size=1048576 2024-09-12T00:30:59.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.155+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~3PGLRCN5SD03.1 size=1048576 2024-09-12T00:30:59.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.156+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~3PGLRCN5SD03.2 size=152006 2024-09-12T00:30:59.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.156+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=3PGLRCN5SD03 tag=2AX09ANXB6RJ type=write size=3297734 2024-09-12T00:30:59.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.157+0000 7f0362c73780 -1 < failed to complete operation key=1MLL1T362X51 tag=9CJRSNTFLYOP type=del size=1192077: (22) Invalid argument 2024-09-12T00:30:59.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.159+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=LH3WJ4JDEX31 type=del size=1172275 2024-09-12T00:30:59.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.161+0000 7f0362c73780 1 < suggested remove operation key=Q6M0D2698CUZ tag=7MJZHWCX70KZ type=del 2024-09-12T00:30:59.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.163+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=Z6YPHHP9QYI4 type=write size=604450 2024-09-12T00:30:59.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.164+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~KOM8ZQ5Q15ZO.0 size=1048576 2024-09-12T00:30:59.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.165+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~KOM8ZQ5Q15ZO.1 size=1048576 2024-09-12T00:30:59.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.167+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~KOM8ZQ5Q15ZO.2 size=499089 2024-09-12T00:30:59.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.169+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=KOM8ZQ5Q15ZO tag=8Q1PE25FVO3L type=write size=3644817 2024-09-12T00:30:59.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.170+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=64J7BXMGEPPO type=del size=3173083 2024-09-12T00:30:59.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.172+0000 7f0362c73780 1 < canceled operation key=CZHT9UQS34JU tag=Q8CV0IXBF8GG type=del size=3308203 2024-09-12T00:30:59.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.173+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=FWGWXQDPJOJM type=del size=4075642 2024-09-12T00:30:59.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.175+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~TYLF06YKBDZ1.0 size=661153 2024-09-12T00:30:59.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.177+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=TYLF06YKBDZ1 tag=RGVCRPEBQF0Y type=write size=1709729 2024-09-12T00:30:59.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.179+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~FO9V4F6UYSHI.0 size=1048576 2024-09-12T00:30:59.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.181+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~FO9V4F6UYSHI.1 size=200667 2024-09-12T00:30:59.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.181+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=FO9V4F6UYSHI tag=HRQ70U40P0YT type=write size=2297819 2024-09-12T00:30:59.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.182+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~BKLDRUF8XMFQ.0 size=193328 2024-09-12T00:30:59.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.184+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=BKLDRUF8XMFQ tag=1Y3G4HKDFL5Y type=write size=1241904 2024-09-12T00:30:59.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.186+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=EZ8QO4VOY4LO type=del size=1405925 2024-09-12T00:30:59.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.187+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=A9HOBC32VD4S type=del 2024-09-12T00:30:59.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.189+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=F4NG9Q7RJQB9 type=del size=1315793 2024-09-12T00:30:59.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.192+0000 7f0362c73780 1 < suggested remove operation key=I3B48QD9E40S tag=HIWSXJ98V7CO type=del 2024-09-12T00:30:59.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.194+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=Z2F6G3BCVU13 type=del size=3942226 2024-09-12T00:30:59.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.194+0000 7f0362c73780 1 < canceled part key=_multipart_2DHHPBYV80O8.2~320L1YZ91PBW.0 size=1048576 2024-09-12T00:30:59.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.195+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~320L1YZ91PBW.1 size=927640 2024-09-12T00:30:59.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.198+0000 7f0362c73780 1 < canceled multipart upload key=2DHHPBYV80O8 upload=320L1YZ91PBW tag=CBOOOJS8GBOM type=write size=3024792 2024-09-12T00:30:59.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.200+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~0JPVNF45Y3BT.0 size=1048576 2024-09-12T00:30:59.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.202+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~0JPVNF45Y3BT.1 size=1048576 2024-09-12T00:30:59.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.203+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~0JPVNF45Y3BT.2 size=476476 2024-09-12T00:30:59.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.203+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=0JPVNF45Y3BT tag=FWKDOUJJH7QI type=write size=3622204 2024-09-12T00:30:59.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.206+0000 7f0362c73780 1 < suggested update operation key=G2HW98G6624O tag=PDB8QT8ARYDQ type=del size=4168656 2024-09-12T00:30:59.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.208+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~T1291XVC0EYX.0 size=1048576 2024-09-12T00:30:59.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.209+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~T1291XVC0EYX.1 size=1048576 2024-09-12T00:30:59.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.211+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~T1291XVC0EYX.2 size=489558 2024-09-12T00:30:59.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.211+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=T1291XVC0EYX tag=E8FE72C902DZ type=write size=3635286 2024-09-12T00:30:59.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.212+0000 7f0362c73780 -1 < failed to complete operation key=I3B48QD9E40S tag=63HXHYCQ20RM type=del size=3942884: (22) Invalid argument 2024-09-12T00:30:59.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.214+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=425UPQVO0X38 type=del size=772175 2024-09-12T00:30:59.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.215+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~8AEAABMT5EQH.0 size=1048576 2024-09-12T00:30:59.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.217+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~8AEAABMT5EQH.1 size=639706 2024-09-12T00:30:59.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.219+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=8AEAABMT5EQH tag=6LRAMV8TB1W3 type=write size=2736858 2024-09-12T00:30:59.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.222+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~XDC55SL58GIK.0 size=1048576 2024-09-12T00:30:59.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.223+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~XDC55SL58GIK.1 size=1048576 2024-09-12T00:30:59.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.224+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~XDC55SL58GIK.2 size=70761 2024-09-12T00:30:59.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.224+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=XDC55SL58GIK tag=4PQIWXKV89RP type=write size=3216489 2024-09-12T00:30:59.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.225+0000 7f0362c73780 -1 < failed to complete operation key=I3B48QD9E40S tag=3SHNCI4OSY9N type=del size=2393264: (22) Invalid argument 2024-09-12T00:30:59.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.227+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=UYFXA41GSXC2 type=del size=229476 2024-09-12T00:30:59.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.229+0000 7f0362c73780 1 < completed write operation key=X4ZML0796M7F tag=D953ZDRE2W72 type=write size=246739 2024-09-12T00:30:59.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.232+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~SGCDDJ23X1TA.0 size=1048576 2024-09-12T00:30:59.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.233+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~SGCDDJ23X1TA.1 size=158398 2024-09-12T00:30:59.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.233+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=SGCDDJ23X1TA tag=UQJ0GNERVQHC type=write size=2255550 2024-09-12T00:30:59.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.235+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=TVHA28OIJTU9 type=del 2024-09-12T00:30:59.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.236+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=GBKB504GIN5E type=write size=370273 2024-09-12T00:30:59.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.238+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~3PGLRCN5SD03.0 size=1048576 2024-09-12T00:30:59.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.239+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~3PGLRCN5SD03.1 size=1048576 2024-09-12T00:30:59.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.240+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~3PGLRCN5SD03.2 size=152006 2024-09-12T00:30:59.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.243+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=3PGLRCN5SD03 tag=2AX09ANXB6RJ type=write size=3297734 2024-09-12T00:30:59.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.245+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~776S9LI5P1ES.0 size=1048576 2024-09-12T00:30:59.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.246+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~776S9LI5P1ES.1 size=809159 2024-09-12T00:30:59.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.246+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=776S9LI5P1ES tag=FYRXS2WTQDD4 type=write size=2906311 2024-09-12T00:30:59.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.248+0000 7f0362c73780 1 < suggested update operation key=PLAYMR18X9DZ tag=LH3WJ4JDEX31 type=del size=1172275 2024-09-12T00:30:59.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.250+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=KA6YW3VZC3NP type=write size=534533 2024-09-12T00:30:59.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.251+0000 7f0362c73780 1 < completed write operation key=84T1VJG5SHU4 tag=Z6YPHHP9QYI4 type=write size=604450 2024-09-12T00:30:59.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.253+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=ADDRFU2CYBPP type=del size=3708898 2024-09-12T00:30:59.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.254+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=64J7BXMGEPPO type=del 2024-09-12T00:30:59.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.256+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=RVV4TKQCZMBF type=del size=3242085 2024-09-12T00:30:59.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.257+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=FWGWXQDPJOJM type=del 2024-09-12T00:30:59.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.260+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~3OASBPA471AU.0 size=422537 2024-09-12T00:30:59.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.260+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=3OASBPA471AU tag=CJMBL9N6TEQP type=write size=1471113 2024-09-12T00:30:59.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.261+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~FO9V4F6UYSHI.0 size=1048576 2024-09-12T00:30:59.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.262+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~FO9V4F6UYSHI.1 size=200667 2024-09-12T00:30:59.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.265+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=FO9V4F6UYSHI tag=HRQ70U40P0YT type=write size=2297819 2024-09-12T00:30:59.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.267+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~7JB36M4M4TF7.0 size=1048576 2024-09-12T00:30:59.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.268+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~7JB36M4M4TF7.1 size=839018 2024-09-12T00:30:59.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.269+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=7JB36M4M4TF7 tag=77B5902GEY83 type=write size=2936170 2024-09-12T00:30:59.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.270+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=EZ8QO4VOY4LO type=del 2024-09-12T00:30:59.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.274+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~XF83RMZBPZHH.0 size=710227 2024-09-12T00:30:59.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.274+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=XF83RMZBPZHH tag=JB2756FD3OJM type=write size=1758803 2024-09-12T00:30:59.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.275+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=F4NG9Q7RJQB9 type=del 2024-09-12T00:30:59.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.277+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=TWHT5OZZUOAP type=del size=3947867 2024-09-12T00:30:59.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.279+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=Z2F6G3BCVU13 type=del 2024-09-12T00:30:59.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.280+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=3MZRIR78HNTX type=del size=1774594 2024-09-12T00:30:59.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.280+0000 7f0362c73780 1 < canceled part key=_multipart_927NCYXX8Z2P.2~0JPVNF45Y3BT.0 size=1048576 2024-09-12T00:30:59.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.282+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~0JPVNF45Y3BT.1 size=1048576 2024-09-12T00:30:59.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.283+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~0JPVNF45Y3BT.2 size=476476 2024-09-12T00:30:59.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.285+0000 7f0362c73780 1 < canceled multipart upload key=927NCYXX8Z2P upload=0JPVNF45Y3BT tag=FWKDOUJJH7QI type=write size=3622204 2024-09-12T00:30:59.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.288+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~9WS94F95WQQV.0 size=976480 2024-09-12T00:30:59.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.288+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=9WS94F95WQQV tag=8U09V8IB9X6W type=write size=2025056 2024-09-12T00:30:59.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.289+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~T1291XVC0EYX.0 size=1048576 2024-09-12T00:30:59.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.291+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~T1291XVC0EYX.1 size=1048576 2024-09-12T00:30:59.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.292+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~T1291XVC0EYX.2 size=489558 2024-09-12T00:30:59.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.294+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=T1291XVC0EYX tag=E8FE72C902DZ type=write size=3635286 2024-09-12T00:30:59.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.296+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=H7YXB8PKYKEQ type=del size=2152503 2024-09-12T00:30:59.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.297+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=425UPQVO0X38 type=del 2024-09-12T00:30:59.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.299+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=JS7YPC6X0DH6 type=del size=506086 2024-09-12T00:30:59.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.300+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~XDC55SL58GIK.0 size=1048576 2024-09-12T00:30:59.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.301+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~XDC55SL58GIK.1 size=1048576 2024-09-12T00:30:59.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.303+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~XDC55SL58GIK.2 size=70761 2024-09-12T00:30:59.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.305+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=XDC55SL58GIK tag=4PQIWXKV89RP type=write size=3216489 2024-09-12T00:30:59.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.306+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=OF4T3JT4EE8E type=del size=2765512 2024-09-12T00:30:59.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.308+0000 7f0362c73780 1 < canceled operation key=XR8L0HL374VC tag=UYFXA41GSXC2 type=del size=229476 2024-09-12T00:30:59.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.309+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=1CGSH4UJLNHP type=write size=116829 2024-09-12T00:30:59.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.311+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~SGCDDJ23X1TA.0 size=1048576 2024-09-12T00:30:59.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.312+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~SGCDDJ23X1TA.1 size=158398 2024-09-12T00:30:59.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.314+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=SGCDDJ23X1TA tag=UQJ0GNERVQHC type=write size=2255550 2024-09-12T00:30:59.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.317+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~8Z2F1Z0RSMB0.0 size=1048576 2024-09-12T00:30:59.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.318+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~8Z2F1Z0RSMB0.1 size=1048576 2024-09-12T00:30:59.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.319+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~8Z2F1Z0RSMB0.2 size=227518 2024-09-12T00:30:59.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.319+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=8Z2F1Z0RSMB0 tag=6XQ2HJAN4N6M type=write size=3373246 2024-09-12T00:30:59.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.321+0000 7f0362c73780 1 < completed write operation key=84T1VJG5SHU4 tag=GBKB504GIN5E type=write size=370273 2024-09-12T00:30:59.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.322+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=WWZKUPN0MZS1 type=del size=1862899 2024-09-12T00:30:59.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.324+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~776S9LI5P1ES.0 size=1048576 2024-09-12T00:30:59.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.325+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~776S9LI5P1ES.1 size=809159 2024-09-12T00:30:59.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.327+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=776S9LI5P1ES tag=FYRXS2WTQDD4 type=write size=2906311 2024-09-12T00:30:59.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.330+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~B70QXO36YOTG.0 size=1048576 2024-09-12T00:30:59.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.331+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~B70QXO36YOTG.1 size=1048576 2024-09-12T00:30:59.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.332+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~B70QXO36YOTG.2 size=19080 2024-09-12T00:30:59.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.332+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=B70QXO36YOTG tag=DZDA66FB6TD3 type=write size=3164808 2024-09-12T00:30:59.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.334+0000 7f0362c73780 1 < completed write operation key=EHBOL435W9ZE tag=KA6YW3VZC3NP type=write size=534533 2024-09-12T00:30:59.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.335+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=F0PVKTIJTXGK type=del size=1796101 2024-09-12T00:30:59.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.337+0000 7f0362c73780 1 < canceled operation key=OY30LP7FYXNF tag=ADDRFU2CYBPP type=del size=3708898 2024-09-12T00:30:59.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.338+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=13BIR55JEBZY type=del size=3507483 2024-09-12T00:30:59.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.340+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=RVV4TKQCZMBF type=del 2024-09-12T00:30:59.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.342+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~PEKWLH2CSEQ1.0 size=1048576 2024-09-12T00:30:59.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.343+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~PEKWLH2CSEQ1.1 size=92706 2024-09-12T00:30:59.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.343+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=PEKWLH2CSEQ1 tag=H5UUDC5MET2B type=write size=2189858 2024-09-12T00:30:59.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.345+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~3OASBPA471AU.0 size=422537 2024-09-12T00:30:59.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.347+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=3OASBPA471AU tag=CJMBL9N6TEQP type=write size=1471113 2024-09-12T00:30:59.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.349+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=2D2LKNBM9ACR type=del size=2587182 2024-09-12T00:30:59.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.350+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~7JB36M4M4TF7.0 size=1048576 2024-09-12T00:30:59.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.351+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~7JB36M4M4TF7.1 size=839018 2024-09-12T00:30:59.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.354+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=7JB36M4M4TF7 tag=77B5902GEY83 type=write size=2936170 2024-09-12T00:30:59.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.355+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=FFF3D8JHPYWM type=del size=549883 2024-09-12T00:30:59.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.357+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~XF83RMZBPZHH.0 size=710227 2024-09-12T00:30:59.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.359+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=XF83RMZBPZHH tag=JB2756FD3OJM type=write size=1758803 2024-09-12T00:30:59.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.360+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=LLDJHGJ2R9VL type=write size=1003723 2024-09-12T00:30:59.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.363+0000 7f0362c73780 1 < suggested update operation key=PYCRNXC9ITGF tag=TWHT5OZZUOAP type=del size=3947867 2024-09-12T00:30:59.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.366+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~OO9NAGNMXFF5.0 size=1048576 2024-09-12T00:30:59.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.367+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~OO9NAGNMXFF5.1 size=57703 2024-09-12T00:30:59.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.367+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=OO9NAGNMXFF5 tag=DGI8Y7WP6DCX type=write size=2154855 2024-09-12T00:30:59.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.368+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=3MZRIR78HNTX type=del 2024-09-12T00:30:59.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.370+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=2907AKKLQSGZ type=del size=2626919 2024-09-12T00:30:59.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.371+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~9WS94F95WQQV.0 size=976480 2024-09-12T00:30:59.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.373+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=9WS94F95WQQV tag=8U09V8IB9X6W type=write size=2025056 2024-09-12T00:30:59.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.375+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=K7YNS42643QD type=write size=54526 2024-09-12T00:30:59.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.376+0000 7f0362c73780 1 < canceled operation key=927NCYXX8Z2P tag=H7YXB8PKYKEQ type=del size=2152503 2024-09-12T00:30:59.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.378+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=BX2UWQL4XFKT type=del size=3131275 2024-09-12T00:30:59.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.379+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=JS7YPC6X0DH6 type=del 2024-09-12T00:30:59.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.381+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=R4BP3UWSBZA2 type=del size=3551613 2024-09-12T00:30:59.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.382+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=OF4T3JT4EE8E type=del 2024-09-12T00:30:59.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.384+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=BXGBXWQC0KA8 type=del size=1760554 2024-09-12T00:30:59.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.385+0000 7f0362c73780 1 < completed write operation key=XMMZOX8MH3GT tag=1CGSH4UJLNHP type=write size=116829 2024-09-12T00:30:59.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.387+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=KP9JUA0ANFRG type=del size=2694413 2024-09-12T00:30:59.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.388+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~8Z2F1Z0RSMB0.0 size=1048576 2024-09-12T00:30:59.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.390+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~8Z2F1Z0RSMB0.1 size=1048576 2024-09-12T00:30:59.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.391+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~8Z2F1Z0RSMB0.2 size=227518 2024-09-12T00:30:59.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.393+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=8Z2F1Z0RSMB0 tag=6XQ2HJAN4N6M type=write size=3373246 2024-09-12T00:30:59.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.394+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=2QVM38HHDGI7 type=write size=426002 2024-09-12T00:30:59.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.396+0000 7f0362c73780 -1 < failed to complete operation key=PYCRNXC9ITGF tag=WWZKUPN0MZS1 type=del size=1862899: (22) Invalid argument 2024-09-12T00:30:59.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.398+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~IQMCSJF97JHD.0 size=896755 2024-09-12T00:30:59.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.398+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=IQMCSJF97JHD tag=54T8T20DJH3V type=write size=1945331 2024-09-12T00:30:59.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.399+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~B70QXO36YOTG.0 size=1048576 2024-09-12T00:30:59.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.401+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~B70QXO36YOTG.1 size=1048576 2024-09-12T00:30:59.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.402+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~B70QXO36YOTG.2 size=19080 2024-09-12T00:30:59.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.404+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=B70QXO36YOTG tag=DZDA66FB6TD3 type=write size=3164808 2024-09-12T00:30:59.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.408+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~FP0KT86X5AJ8.0 size=1048576 2024-09-12T00:30:59.409 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.411+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~FP0KT86X5AJ8.1 size=1048576 2024-09-12T00:30:59.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.412+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~FP0KT86X5AJ8.2 size=225137 2024-09-12T00:30:59.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.412+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=FP0KT86X5AJ8 tag=O0470QP54EKW type=write size=3370865 2024-09-12T00:30:59.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.414+0000 7f0362c73780 1 < canceled operation key=1MLL1T362X51 tag=F0PVKTIJTXGK type=del size=1796101 2024-09-12T00:30:59.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.415+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=PF76OBZWWWAT type=del size=37169 2024-09-12T00:30:59.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.417+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=13BIR55JEBZY type=del 2024-09-12T00:30:59.418 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.419+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~OXK87N7T8Y2T.0 size=1048576 2024-09-12T00:30:59.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.420+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~OXK87N7T8Y2T.1 size=938162 2024-09-12T00:30:59.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.420+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=OXK87N7T8Y2T tag=GHZCTXQ92390 type=write size=3035314 2024-09-12T00:30:59.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.421+0000 7f0362c73780 1 < canceled part key=_multipart_1UUNRPUKAINC.2~PEKWLH2CSEQ1.0 size=1048576 2024-09-12T00:30:59.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.422+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~PEKWLH2CSEQ1.1 size=92706 2024-09-12T00:30:59.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.425+0000 7f0362c73780 1 < canceled multipart upload key=1UUNRPUKAINC upload=PEKWLH2CSEQ1 tag=H5UUDC5MET2B type=write size=2189858 2024-09-12T00:30:59.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.426+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=0U6FYJJNLUB3 type=del size=4083324 2024-09-12T00:30:59.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.428+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=2D2LKNBM9ACR type=del 2024-09-12T00:30:59.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.429+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=KGMMMCWZUOTT type=write size=724723 2024-09-12T00:30:59.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.430+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=FFF3D8JHPYWM type=del 2024-09-12T00:30:59.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.432+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=CBY90MHOFT6L type=del size=970687 2024-09-12T00:30:59.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.433+0000 7f0362c73780 1 < canceled operation key=927NCYXX8Z2P tag=LLDJHGJ2R9VL type=write size=1003723 2024-09-12T00:30:59.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.435+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=S8GWN452TRWI type=write size=552568 2024-09-12T00:30:59.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.436+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~OO9NAGNMXFF5.0 size=1048576 2024-09-12T00:30:59.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.437+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~OO9NAGNMXFF5.1 size=57703 2024-09-12T00:30:59.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.439+0000 7f0362c73780 1 < completed multipart upload key=927NCYXX8Z2P upload=OO9NAGNMXFF5 tag=DGI8Y7WP6DCX type=write size=2154855 2024-09-12T00:30:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.440+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=B33HXQVC2JAL type=del size=2711968 2024-09-12T00:30:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.442+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=2907AKKLQSGZ type=del 2024-09-12T00:30:59.441 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.443+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=N5O62R8E52GV type=del size=2379587 2024-09-12T00:30:59.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.445+0000 7f0362c73780 1 < completed write operation key=WT0185G517YR tag=K7YNS42643QD type=write size=54526 2024-09-12T00:30:59.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.446+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=O1OOA954LAS3 type=del size=3190350 2024-09-12T00:30:59.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.447+0000 7f0362c73780 1 < canceled operation key=44YJP6XPIFT5 tag=BX2UWQL4XFKT type=del size=3131275 2024-09-12T00:30:59.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.450+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~J41TH7BLRNUM.0 size=1048576 2024-09-12T00:30:59.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.451+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~J41TH7BLRNUM.1 size=438001 2024-09-12T00:30:59.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.451+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=J41TH7BLRNUM tag=DBE396T0F8WI type=write size=2535153 2024-09-12T00:30:59.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.452+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=R4BP3UWSBZA2 type=del 2024-09-12T00:30:59.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.455+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~45SZXGIXMX52.0 size=1048576 2024-09-12T00:30:59.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.456+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~45SZXGIXMX52.1 size=1048576 2024-09-12T00:30:59.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.457+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~45SZXGIXMX52.2 size=907983 2024-09-12T00:30:59.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.457+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=45SZXGIXMX52 tag=7CJVXWDBXC2Y type=write size=4053711 2024-09-12T00:30:59.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.458+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=BXGBXWQC0KA8 type=del 2024-09-12T00:30:59.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.460+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=XTX4GKFGI2E2 type=del size=977753 2024-09-12T00:30:59.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.461+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=KP9JUA0ANFRG type=del 2024-09-12T00:30:59.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.463+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=F53FOEZWIL5J type=del size=1475209 2024-09-12T00:30:59.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.465+0000 7f0362c73780 1 < completed write operation key=J5GSZCJW2BP1 tag=2QVM38HHDGI7 type=write size=426002 2024-09-12T00:30:59.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.467+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~NSFUJH8ESLGC.0 size=1048576 2024-09-12T00:30:59.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.469+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~NSFUJH8ESLGC.1 size=1048576 2024-09-12T00:30:59.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.470+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~NSFUJH8ESLGC.2 size=637551 2024-09-12T00:30:59.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.470+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=NSFUJH8ESLGC tag=RE6ON0PCQIOP type=write size=3783279 2024-09-12T00:30:59.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.471+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~IQMCSJF97JHD.0 size=896755 2024-09-12T00:30:59.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.474+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=IQMCSJF97JHD tag=54T8T20DJH3V type=write size=1945331 2024-09-12T00:30:59.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.476+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~DV2FHNXYO2DO.0 size=1048576 2024-09-12T00:30:59.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.478+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~DV2FHNXYO2DO.1 size=1048576 2024-09-12T00:30:59.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.479+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~DV2FHNXYO2DO.2 size=786397 2024-09-12T00:30:59.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.479+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=DV2FHNXYO2DO tag=BUAC9RNF7M63 type=write size=3932125 2024-09-12T00:30:59.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.480+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~FP0KT86X5AJ8.0 size=1048576 2024-09-12T00:30:59.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.481+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~FP0KT86X5AJ8.1 size=1048576 2024-09-12T00:30:59.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.483+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~FP0KT86X5AJ8.2 size=225137 2024-09-12T00:30:59.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.485+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=FP0KT86X5AJ8 tag=O0470QP54EKW type=write size=3370865 2024-09-12T00:30:59.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.488+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~UMDQ1F6Q8Y35.0 size=833688 2024-09-12T00:30:59.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.488+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=UMDQ1F6Q8Y35 tag=GBUSMXMUAYUR type=write size=1882264 2024-09-12T00:30:59.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.490+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=PF76OBZWWWAT type=del 2024-09-12T00:30:59.490 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.492+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=DMDF3JS1RFWZ type=del size=2960919 2024-09-12T00:30:59.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.494+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~OXK87N7T8Y2T.0 size=1048576 2024-09-12T00:30:59.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.495+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~OXK87N7T8Y2T.1 size=938162 2024-09-12T00:30:59.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.498+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=OXK87N7T8Y2T tag=GHZCTXQ92390 type=write size=3035314 2024-09-12T00:30:59.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.500+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~SP6E7FOZC3DX.0 size=1048576 2024-09-12T00:30:59.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.501+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~SP6E7FOZC3DX.1 size=1027036 2024-09-12T00:30:59.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.501+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=SP6E7FOZC3DX tag=GKRMWYYYGFBN type=write size=3124188 2024-09-12T00:30:59.501 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.503+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=0U6FYJJNLUB3 type=del 2024-09-12T00:30:59.503 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.504+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=06FGZPNV2597 type=del size=3889992 2024-09-12T00:30:59.506 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.507+0000 7f0362c73780 1 < suggested update operation key=EHBOL435W9ZE tag=KGMMMCWZUOTT type=write size=724723 2024-09-12T00:30:59.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.510+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~UTSEN2BDSJ6J.0 size=1048576 2024-09-12T00:30:59.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.511+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~UTSEN2BDSJ6J.1 size=366214 2024-09-12T00:30:59.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.511+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=UTSEN2BDSJ6J tag=EX92OUK6Z1O5 type=write size=2463366 2024-09-12T00:30:59.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.512+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=CBY90MHOFT6L type=del 2024-09-12T00:30:59.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.514+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=C1WVA7T16QCH type=write size=764490 2024-09-12T00:30:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.515+0000 7f0362c73780 1 < completed write operation key=HWSQFSK29S0V tag=S8GWN452TRWI type=write size=552568 2024-09-12T00:30:59.515 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.517+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=CN9IKWYR6NYQ type=del size=2263125 2024-09-12T00:30:59.517 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.518+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=B33HXQVC2JAL type=del 2024-09-12T00:30:59.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.521+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~YGXUOVWJU6FH.0 size=1048576 2024-09-12T00:30:59.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.522+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~YGXUOVWJU6FH.1 size=1048576 2024-09-12T00:30:59.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.523+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~YGXUOVWJU6FH.2 size=534409 2024-09-12T00:30:59.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.523+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=YGXUOVWJU6FH tag=6ZA820E0KZAS type=write size=3680137 2024-09-12T00:30:59.523 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.525+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=N5O62R8E52GV type=del 2024-09-12T00:30:59.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.526+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=CBEBORCGFG2T type=del size=2188171 2024-09-12T00:30:59.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.528+0000 7f0362c73780 1 < canceled operation key=PYCRNXC9ITGF tag=O1OOA954LAS3 type=del size=3190350 2024-09-12T00:30:59.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.530+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~VU3GHS2AODLF.0 size=1048576 2024-09-12T00:30:59.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.532+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~VU3GHS2AODLF.1 size=1048576 2024-09-12T00:30:59.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.533+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~VU3GHS2AODLF.2 size=892658 2024-09-12T00:30:59.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.533+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=VU3GHS2AODLF tag=7E7MRVV2V1O5 type=write size=4038386 2024-09-12T00:30:59.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.534+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~J41TH7BLRNUM.0 size=1048576 2024-09-12T00:30:59.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.535+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~J41TH7BLRNUM.1 size=438001 2024-09-12T00:30:59.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.538+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=J41TH7BLRNUM tag=DBE396T0F8WI type=write size=2535153 2024-09-12T00:30:59.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.540+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~LV1BWV9CCA3J.0 size=1048576 2024-09-12T00:30:59.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.541+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~LV1BWV9CCA3J.1 size=682748 2024-09-12T00:30:59.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.541+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=LV1BWV9CCA3J tag=1A8IW96W5BY0 type=write size=2779900 2024-09-12T00:30:59.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.543+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~45SZXGIXMX52.0 size=1048576 2024-09-12T00:30:59.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.545+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~45SZXGIXMX52.1 size=1048576 2024-09-12T00:30:59.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.546+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~45SZXGIXMX52.2 size=907983 2024-09-12T00:30:59.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.549+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=45SZXGIXMX52 tag=7CJVXWDBXC2Y type=write size=4053711 2024-09-12T00:30:59.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.550+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=FE297WWIATNH type=write size=855710 2024-09-12T00:30:59.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.553+0000 7f0362c73780 1 < suggested remove operation key=I3B48QD9E40S tag=XTX4GKFGI2E2 type=del 2024-09-12T00:30:59.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.555+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~2917S78MYDO3.0 size=1048576 2024-09-12T00:30:59.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.557+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~2917S78MYDO3.1 size=1048576 2024-09-12T00:30:59.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.558+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~2917S78MYDO3.2 size=381646 2024-09-12T00:30:59.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.558+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=2917S78MYDO3 tag=A35KYPYD3SZA type=write size=3527374 2024-09-12T00:30:59.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.559+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=F53FOEZWIL5J type=del 2024-09-12T00:30:59.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.560+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=67332FE1U892 type=del size=2862088 2024-09-12T00:30:59.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.562+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~NSFUJH8ESLGC.0 size=1048576 2024-09-12T00:30:59.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.563+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~NSFUJH8ESLGC.1 size=1048576 2024-09-12T00:30:59.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.564+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~NSFUJH8ESLGC.2 size=637551 2024-09-12T00:30:59.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.566+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=NSFUJH8ESLGC tag=RE6ON0PCQIOP type=write size=3783279 2024-09-12T00:30:59.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.569+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~YYA9WTUMXMYI.0 size=849097 2024-09-12T00:30:59.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.569+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=YYA9WTUMXMYI tag=OLWH38WUCDA4 type=write size=1897673 2024-09-12T00:30:59.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.570+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~DV2FHNXYO2DO.0 size=1048576 2024-09-12T00:30:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.572+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~DV2FHNXYO2DO.1 size=1048576 2024-09-12T00:30:59.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.573+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~DV2FHNXYO2DO.2 size=786397 2024-09-12T00:30:59.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.576+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=DV2FHNXYO2DO tag=BUAC9RNF7M63 type=write size=3932125 2024-09-12T00:30:59.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.578+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=O0IHTYUWZGJE type=del size=462062 2024-09-12T00:30:59.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.580+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~UMDQ1F6Q8Y35.0 size=833688 2024-09-12T00:30:59.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.583+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=UMDQ1F6Q8Y35 tag=GBUSMXMUAYUR type=write size=1882264 2024-09-12T00:30:59.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.585+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~NKP19RDJJ5T7.0 size=1048576 2024-09-12T00:30:59.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.586+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~NKP19RDJJ5T7.1 size=834868 2024-09-12T00:30:59.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.586+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=NKP19RDJJ5T7 tag=LVFC88ZBFJ50 type=write size=2932020 2024-09-12T00:30:59.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.588+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=DMDF3JS1RFWZ type=del 2024-09-12T00:30:59.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.591+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~3ENT3XI5QHIO.0 size=1048576 2024-09-12T00:30:59.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.592+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~3ENT3XI5QHIO.1 size=843435 2024-09-12T00:30:59.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.592+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=3ENT3XI5QHIO tag=CCTDVFOWK7RN type=write size=2940587 2024-09-12T00:30:59.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.593+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~SP6E7FOZC3DX.0 size=1048576 2024-09-12T00:30:59.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.594+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~SP6E7FOZC3DX.1 size=1027036 2024-09-12T00:30:59.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.597+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=SP6E7FOZC3DX tag=GKRMWYYYGFBN type=write size=3124188 2024-09-12T00:30:59.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.600+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=4DAFKV84LDUY type=del size=116902 2024-09-12T00:30:59.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.601+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=06FGZPNV2597 type=del 2024-09-12T00:30:59.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.604+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~6CSRVF9YJ8SI.0 size=1048576 2024-09-12T00:30:59.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.605+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~6CSRVF9YJ8SI.1 size=1048576 2024-09-12T00:30:59.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.606+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~6CSRVF9YJ8SI.2 size=725785 2024-09-12T00:30:59.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.606+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=6CSRVF9YJ8SI tag=EY0GKO1OFUQF type=write size=3871513 2024-09-12T00:30:59.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.608+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~UTSEN2BDSJ6J.0 size=1048576 2024-09-12T00:30:59.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.609+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~UTSEN2BDSJ6J.1 size=366214 2024-09-12T00:30:59.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.612+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=UTSEN2BDSJ6J tag=EX92OUK6Z1O5 type=write size=2463366 2024-09-12T00:30:59.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.615+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~IFHBT6ALE7IA.0 size=1048576 2024-09-12T00:30:59.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.616+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~IFHBT6ALE7IA.1 size=872596 2024-09-12T00:30:59.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.616+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=IFHBT6ALE7IA tag=3A9ZNG7LYJYX type=write size=2969748 2024-09-12T00:30:59.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.618+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=C1WVA7T16QCH type=write size=764490 2024-09-12T00:30:59.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.620+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~D8Q27MQ7E19Q.0 size=1048576 2024-09-12T00:30:59.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.621+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~D8Q27MQ7E19Q.1 size=1048576 2024-09-12T00:30:59.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.623+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~D8Q27MQ7E19Q.2 size=485167 2024-09-12T00:30:59.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.623+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=D8Q27MQ7E19Q tag=LP54SZK8DTCA type=write size=3630895 2024-09-12T00:30:59.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.624+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=CN9IKWYR6NYQ type=del 2024-09-12T00:30:59.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.625+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=83X8LWVZQ7BF type=del size=2511273 2024-09-12T00:30:59.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.627+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~YGXUOVWJU6FH.0 size=1048576 2024-09-12T00:30:59.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.628+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~YGXUOVWJU6FH.1 size=1048576 2024-09-12T00:30:59.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.629+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~YGXUOVWJU6FH.2 size=534409 2024-09-12T00:30:59.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.632+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=YGXUOVWJU6FH tag=6ZA820E0KZAS type=write size=3680137 2024-09-12T00:30:59.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.634+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=HWT82NTF3UQG type=del size=1022577 2024-09-12T00:30:59.634 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.635+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=CBEBORCGFG2T type=del 2024-09-12T00:30:59.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.638+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~NUHMSYT9MUDT.0 size=1048576 2024-09-12T00:30:59.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.639+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~NUHMSYT9MUDT.1 size=200383 2024-09-12T00:30:59.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.639+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=NUHMSYT9MUDT tag=J7Z3MTBJNG7A type=write size=2297535 2024-09-12T00:30:59.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.641+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~VU3GHS2AODLF.0 size=1048576 2024-09-12T00:30:59.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.642+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~VU3GHS2AODLF.1 size=1048576 2024-09-12T00:30:59.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.643+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~VU3GHS2AODLF.2 size=892658 2024-09-12T00:30:59.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.646+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=VU3GHS2AODLF tag=7E7MRVV2V1O5 type=write size=4038386 2024-09-12T00:30:59.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.647+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=BZ7GG6QQGGHG type=del size=2347742 2024-09-12T00:30:59.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.649+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~LV1BWV9CCA3J.0 size=1048576 2024-09-12T00:30:59.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.650+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~LV1BWV9CCA3J.1 size=682748 2024-09-12T00:30:59.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.652+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=LV1BWV9CCA3J tag=1A8IW96W5BY0 type=write size=2779900 2024-09-12T00:30:59.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.655+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~JIGG8CE9WQXI.0 size=1048576 2024-09-12T00:30:59.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.656+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~JIGG8CE9WQXI.1 size=571653 2024-09-12T00:30:59.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.656+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=JIGG8CE9WQXI tag=ZJBASINMR2GZ type=write size=2668805 2024-09-12T00:30:59.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.659+0000 7f0362c73780 1 < suggested remove operation key=1SE6WTQMW6JU tag=FE297WWIATNH type=write 2024-09-12T00:30:59.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.660+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=LYIYIXZ70VT9 type=del size=628755 2024-09-12T00:30:59.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.661+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~2917S78MYDO3.0 size=1048576 2024-09-12T00:30:59.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.663+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~2917S78MYDO3.1 size=1048576 2024-09-12T00:30:59.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.664+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~2917S78MYDO3.2 size=381646 2024-09-12T00:30:59.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.666+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=2917S78MYDO3 tag=A35KYPYD3SZA type=write size=3527374 2024-09-12T00:30:59.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.668+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=WGZ8VFOFOYAV type=del size=3540807 2024-09-12T00:30:59.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.669+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=67332FE1U892 type=del 2024-09-12T00:30:59.670 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.672+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~T3VWBUFR1J33.0 size=1048576 2024-09-12T00:30:59.671 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.673+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~T3VWBUFR1J33.1 size=1048576 2024-09-12T00:30:59.673 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.674+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~T3VWBUFR1J33.2 size=330688 2024-09-12T00:30:59.673 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.674+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=T3VWBUFR1J33 tag=U9IHC33R5GLS type=write size=3476416 2024-09-12T00:30:59.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.676+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~YYA9WTUMXMYI.0 size=849097 2024-09-12T00:30:59.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.678+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=YYA9WTUMXMYI tag=OLWH38WUCDA4 type=write size=1897673 2024-09-12T00:30:59.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.681+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=H3BI3H9L3NOI type=write size=223642 2024-09-12T00:30:59.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.682+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=O0IHTYUWZGJE type=del 2024-09-12T00:30:59.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.684+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=WIUH5WDO0QMR type=del size=2357375 2024-09-12T00:30:59.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.685+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~NKP19RDJJ5T7.0 size=1048576 2024-09-12T00:30:59.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.686+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~NKP19RDJJ5T7.1 size=834868 2024-09-12T00:30:59.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.689+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=NKP19RDJJ5T7 tag=LVFC88ZBFJ50 type=write size=2932020 2024-09-12T00:30:59.690 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.691+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~3KGTEGUJWYK6.0 size=97027 2024-09-12T00:30:59.690 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.691+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=3KGTEGUJWYK6 tag=XS6Q7OWGJCPO type=write size=1145603 2024-09-12T00:30:59.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.693+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~3ENT3XI5QHIO.0 size=1048576 2024-09-12T00:30:59.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.694+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~3ENT3XI5QHIO.1 size=843435 2024-09-12T00:30:59.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.696+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=3ENT3XI5QHIO tag=CCTDVFOWK7RN type=write size=2940587 2024-09-12T00:30:59.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.699+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~91ML7GGK0R6P.0 size=1048576 2024-09-12T00:30:59.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.700+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~91ML7GGK0R6P.1 size=10313 2024-09-12T00:30:59.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.700+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=91ML7GGK0R6P tag=UOTX36TIQFD0 type=write size=2107465 2024-09-12T00:30:59.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.702+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=4DAFKV84LDUY type=del 2024-09-12T00:30:59.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.705+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~CA7TH9N5B6E5.0 size=839146 2024-09-12T00:30:59.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.705+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=CA7TH9N5B6E5 tag=ZWRJEI9CMH3P type=write size=1887722 2024-09-12T00:30:59.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.706+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~6CSRVF9YJ8SI.0 size=1048576 2024-09-12T00:30:59.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.706+0000 7f0362c73780 1 < canceled part key=_multipart_R4ABY5AY0S1P.2~6CSRVF9YJ8SI.1 size=1048576 2024-09-12T00:30:59.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.707+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~6CSRVF9YJ8SI.2 size=725785 2024-09-12T00:30:59.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.710+0000 7f0362c73780 1 < canceled multipart upload key=R4ABY5AY0S1P upload=6CSRVF9YJ8SI tag=EY0GKO1OFUQF type=write size=3871513 2024-09-12T00:30:59.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.713+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~M6LYNTEOIN7E.0 size=1048576 2024-09-12T00:30:59.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.714+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~M6LYNTEOIN7E.1 size=1048576 2024-09-12T00:30:59.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.715+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~M6LYNTEOIN7E.2 size=114313 2024-09-12T00:30:59.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.715+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=M6LYNTEOIN7E tag=145ZN8JCYF6U type=write size=3260041 2024-09-12T00:30:59.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.717+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~IFHBT6ALE7IA.0 size=1048576 2024-09-12T00:30:59.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.718+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~IFHBT6ALE7IA.1 size=872596 2024-09-12T00:30:59.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.720+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=IFHBT6ALE7IA tag=3A9ZNG7LYJYX type=write size=2969748 2024-09-12T00:30:59.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.722+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=SPEY2335C9IK type=del size=690408 2024-09-12T00:30:59.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.723+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~D8Q27MQ7E19Q.0 size=1048576 2024-09-12T00:30:59.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.724+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~D8Q27MQ7E19Q.1 size=1048576 2024-09-12T00:30:59.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.726+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~D8Q27MQ7E19Q.2 size=485167 2024-09-12T00:30:59.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.728+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=D8Q27MQ7E19Q tag=LP54SZK8DTCA type=write size=3630895 2024-09-12T00:30:59.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.731+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~WBKLXC3I3D7R.0 size=1048576 2024-09-12T00:30:59.731 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.732+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~WBKLXC3I3D7R.1 size=1048576 2024-09-12T00:30:59.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.733+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~WBKLXC3I3D7R.2 size=202107 2024-09-12T00:30:59.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.733+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=WBKLXC3I3D7R tag=5DDVHBQKEWJX type=write size=3347835 2024-09-12T00:30:59.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.735+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=83X8LWVZQ7BF type=del 2024-09-12T00:30:59.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.736+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=AF1MCS3BXX0J type=del size=1766593 2024-09-12T00:30:59.736 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.738+0000 7f0362c73780 1 < canceled operation key=Q6M0D2698CUZ tag=HWT82NTF3UQG type=del size=1022577 2024-09-12T00:30:59.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.739+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=Q2F0AVQ801UC type=write size=637414 2024-09-12T00:30:59.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.741+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~NUHMSYT9MUDT.0 size=1048576 2024-09-12T00:30:59.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.742+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~NUHMSYT9MUDT.1 size=200383 2024-09-12T00:30:59.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.745+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=NUHMSYT9MUDT tag=J7Z3MTBJNG7A type=write size=2297535 2024-09-12T00:30:59.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.746+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=7K3MO2YP6X3R type=del size=3780387 2024-09-12T00:30:59.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.748+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=BZ7GG6QQGGHG type=del 2024-09-12T00:30:59.748 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.749+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=853UNC859TRW type=del size=3141072 2024-09-12T00:30:59.748 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.750+0000 7f0362c73780 1 < canceled part key=_multipart_PLAYMR18X9DZ.2~JIGG8CE9WQXI.0 size=1048576 2024-09-12T00:30:59.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.751+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~JIGG8CE9WQXI.1 size=571653 2024-09-12T00:30:59.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.753+0000 7f0362c73780 1 < canceled multipart upload key=PLAYMR18X9DZ upload=JIGG8CE9WQXI tag=ZJBASINMR2GZ type=write size=2668805 2024-09-12T00:30:59.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.755+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~DVY73C85B5T2.0 size=1048576 2024-09-12T00:30:59.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.756+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~DVY73C85B5T2.1 size=1048576 2024-09-12T00:30:59.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.758+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~DVY73C85B5T2.2 size=1031949 2024-09-12T00:30:59.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.758+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=DVY73C85B5T2 tag=TM34UH1UWDA9 type=write size=4177677 2024-09-12T00:30:59.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.759+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=LYIYIXZ70VT9 type=del 2024-09-12T00:30:59.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.762+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~E8BY1UC75RW1.0 size=1048576 2024-09-12T00:30:59.762 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.763+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~E8BY1UC75RW1.1 size=692842 2024-09-12T00:30:59.762 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.763+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=E8BY1UC75RW1 tag=X2GIQ82EOMPH type=write size=2789994 2024-09-12T00:30:59.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.765+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=WGZ8VFOFOYAV type=del 2024-09-12T00:30:59.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.766+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=0GJ7QN7O4ZMC type=del size=630743 2024-09-12T00:30:59.766 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.768+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~T3VWBUFR1J33.0 size=1048576 2024-09-12T00:30:59.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.769+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~T3VWBUFR1J33.1 size=1048576 2024-09-12T00:30:59.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.770+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~T3VWBUFR1J33.2 size=330688 2024-09-12T00:30:59.771 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.772+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=T3VWBUFR1J33 tag=U9IHC33R5GLS type=write size=3476416 2024-09-12T00:30:59.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.775+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~EJJ4PUB2AVPW.0 size=1048576 2024-09-12T00:30:59.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.776+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~EJJ4PUB2AVPW.1 size=15070 2024-09-12T00:30:59.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.776+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=EJJ4PUB2AVPW tag=QGPNB89SONWT type=write size=2112222 2024-09-12T00:30:59.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.778+0000 7f0362c73780 1 < completed write operation key=OY30LP7FYXNF tag=H3BI3H9L3NOI type=write size=223642 2024-09-12T00:30:59.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.779+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=YUUB9RKN14SY type=del size=74809 2024-09-12T00:30:59.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.782+0000 7f0362c73780 1 < suggested update operation key=J5GSZCJW2BP1 tag=WIUH5WDO0QMR type=del size=2357375 2024-09-12T00:30:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.783+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=KNDX3LAOY6X5 type=del size=1861060 2024-09-12T00:30:59.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.785+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~3KGTEGUJWYK6.0 size=97027 2024-09-12T00:30:59.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.788+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=3KGTEGUJWYK6 tag=XS6Q7OWGJCPO type=write size=1145603 2024-09-12T00:30:59.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.789+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=VGSOCPN8Z7IJ type=del size=3499392 2024-09-12T00:30:59.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.790+0000 7f0362c73780 1 < canceled part key=_multipart_J5GSZCJW2BP1.2~91ML7GGK0R6P.0 size=1048576 2024-09-12T00:30:59.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.791+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~91ML7GGK0R6P.1 size=10313 2024-09-12T00:30:59.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.794+0000 7f0362c73780 1 < canceled multipart upload key=J5GSZCJW2BP1 upload=91ML7GGK0R6P tag=UOTX36TIQFD0 type=write size=2107465 2024-09-12T00:30:59.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.795+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=Y0HULP1PDGQV type=del size=2084595 2024-09-12T00:30:59.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.797+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~CA7TH9N5B6E5.0 size=839146 2024-09-12T00:30:59.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.799+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=CA7TH9N5B6E5 tag=ZWRJEI9CMH3P type=write size=1887722 2024-09-12T00:30:59.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.801+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=6XBDYLK84AVS type=del size=1701550 2024-09-12T00:30:59.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.802+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~M6LYNTEOIN7E.0 size=1048576 2024-09-12T00:30:59.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.802+0000 7f0362c73780 1 < canceled part key=_multipart_OY30LP7FYXNF.2~M6LYNTEOIN7E.1 size=1048576 2024-09-12T00:30:59.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.803+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~M6LYNTEOIN7E.2 size=114313 2024-09-12T00:30:59.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.806+0000 7f0362c73780 1 < canceled multipart upload key=OY30LP7FYXNF upload=M6LYNTEOIN7E tag=145ZN8JCYF6U type=write size=3260041 2024-09-12T00:30:59.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.808+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~3CVGN82810Z8.0 size=1048576 2024-09-12T00:30:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.810+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~3CVGN82810Z8.1 size=1048576 2024-09-12T00:30:59.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.811+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~3CVGN82810Z8.2 size=19913 2024-09-12T00:30:59.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.811+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=3CVGN82810Z8 tag=TCJ8KW22DXBU type=write size=3165641 2024-09-12T00:30:59.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.814+0000 7f0362c73780 1 < suggested remove operation key=KWDEKRO3WICD tag=SPEY2335C9IK type=del 2024-09-12T00:30:59.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.817+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=GPIFF75HM9ZO type=del size=2778548 2024-09-12T00:30:59.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.818+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~WBKLXC3I3D7R.0 size=1048576 2024-09-12T00:30:59.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.818+0000 7f0362c73780 1 < canceled part key=_multipart_HEN9LUUIDAR5.2~WBKLXC3I3D7R.1 size=1048576 2024-09-12T00:30:59.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.819+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~WBKLXC3I3D7R.2 size=202107 2024-09-12T00:30:59.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.822+0000 7f0362c73780 1 < canceled multipart upload key=HEN9LUUIDAR5 upload=WBKLXC3I3D7R tag=5DDVHBQKEWJX type=write size=3347835 2024-09-12T00:30:59.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.823+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=ATSFP7DQSSC5 type=write size=993289 2024-09-12T00:30:59.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.825+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=AF1MCS3BXX0J type=del 2024-09-12T00:30:59.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.826+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=LD1HC79MJTKX type=del size=1814825 2024-09-12T00:30:59.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.827+0000 7f0362c73780 1 < completed write operation key=I3B48QD9E40S tag=Q2F0AVQ801UC type=write size=637414 2024-09-12T00:30:59.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.830+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~XOIBKFS7G8HN.0 size=320894 2024-09-12T00:30:59.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.830+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=XOIBKFS7G8HN tag=IGW5OS8F2UBU type=write size=1369470 2024-09-12T00:30:59.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.832+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=7K3MO2YP6X3R type=del 2024-09-12T00:30:59.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.833+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=KZC0OCEJ9XQZ type=del size=1832590 2024-09-12T00:30:59.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.835+0000 7f0362c73780 1 < canceled operation key=HEN9LUUIDAR5 tag=853UNC859TRW type=del size=3141072 2024-09-12T00:30:59.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.837+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=LRVWSTVF72S1 type=write size=337936 2024-09-12T00:30:59.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.838+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~DVY73C85B5T2.0 size=1048576 2024-09-12T00:30:59.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.840+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~DVY73C85B5T2.1 size=1048576 2024-09-12T00:30:59.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.840+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~DVY73C85B5T2.2 size=1031949 2024-09-12T00:30:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.842+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=DVY73C85B5T2 tag=TM34UH1UWDA9 type=write size=4177677 2024-09-12T00:30:59.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.843+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=5WOXFQYY4480 type=write size=192138 2024-09-12T00:30:59.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.845+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~E8BY1UC75RW1.0 size=1048576 2024-09-12T00:30:59.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.846+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~E8BY1UC75RW1.1 size=692842 2024-09-12T00:30:59.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.848+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=E8BY1UC75RW1 tag=X2GIQ82EOMPH type=write size=2789994 2024-09-12T00:30:59.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.851+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~Q1MHEFKJJRCB.0 size=1048576 2024-09-12T00:30:59.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.852+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~Q1MHEFKJJRCB.1 size=838331 2024-09-12T00:30:59.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.852+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=Q1MHEFKJJRCB tag=UA3BXX4H804V type=write size=2935483 2024-09-12T00:30:59.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.853+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=0GJ7QN7O4ZMC type=del 2024-09-12T00:30:59.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.855+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=NQHFQFCKQPZN type=del size=3494465 2024-09-12T00:30:59.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.856+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~EJJ4PUB2AVPW.0 size=1048576 2024-09-12T00:30:59.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.857+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~EJJ4PUB2AVPW.1 size=15070 2024-09-12T00:30:59.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.860+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=EJJ4PUB2AVPW tag=QGPNB89SONWT type=write size=2112222 2024-09-12T00:30:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.862+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~IC024LSL2T16.0 size=73311 2024-09-12T00:30:59.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.862+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=IC024LSL2T16 tag=HWFOPKHJRP24 type=write size=1121887 2024-09-12T00:30:59.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.864+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=YUUB9RKN14SY type=del 2024-09-12T00:30:59.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.865+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=GYHAFY95YHZ2 type=del size=1630014 2024-09-12T00:30:59.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.866+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=KNDX3LAOY6X5 type=del 2024-09-12T00:30:59.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.868+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=XG80ZGB6LHER type=del size=2630490 2024-09-12T00:30:59.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.870+0000 7f0362c73780 1 < canceled operation key=WT0185G517YR tag=VGSOCPN8Z7IJ type=del size=3499392 2024-09-12T00:30:59.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.872+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~GZCXM3L8AKCS.0 size=1048576 2024-09-12T00:30:59.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.873+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~GZCXM3L8AKCS.1 size=1048576 2024-09-12T00:30:59.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.874+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~GZCXM3L8AKCS.2 size=986705 2024-09-12T00:30:59.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.874+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=GZCXM3L8AKCS tag=YCT1WP4LANCC type=write size=4132433 2024-09-12T00:30:59.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.876+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=Y0HULP1PDGQV type=del 2024-09-12T00:30:59.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.877+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=MJFX4C04MFCS type=del size=1069437 2024-09-12T00:30:59.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.879+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=6XBDYLK84AVS type=del 2024-09-12T00:30:59.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.881+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~NG7YSBF89K41.0 size=262717 2024-09-12T00:30:59.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.881+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=NG7YSBF89K41 tag=30AUNW87HHLO type=write size=1311293 2024-09-12T00:30:59.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.883+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~3CVGN82810Z8.0 size=1048576 2024-09-12T00:30:59.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.884+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~3CVGN82810Z8.1 size=1048576 2024-09-12T00:30:59.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.885+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~3CVGN82810Z8.2 size=19913 2024-09-12T00:30:59.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.888+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=3CVGN82810Z8 tag=TCJ8KW22DXBU type=write size=3165641 2024-09-12T00:30:59.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.889+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=W32CLQX9ILCX type=del size=2762024 2024-09-12T00:30:59.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.891+0000 7f0362c73780 1 < canceled operation key=1IPW8SJ6SSU2 tag=GPIFF75HM9ZO type=del size=2778548 2024-09-12T00:30:59.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.892+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=863WWUGXKQNO type=del size=1557425 2024-09-12T00:30:59.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.894+0000 7f0362c73780 1 < completed write operation key=1IPW8SJ6SSU2 tag=ATSFP7DQSSC5 type=write size=993289 2024-09-12T00:30:59.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.896+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=IP1OY8VEN94L type=del size=1093302 2024-09-12T00:30:59.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.898+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=LD1HC79MJTKX type=del 2024-09-12T00:30:59.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.900+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~8CMQ7LXQEVAU.0 size=847915 2024-09-12T00:30:59.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.900+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=8CMQ7LXQEVAU tag=WMD5JA1JS18C type=write size=1896491 2024-09-12T00:30:59.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.902+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~XOIBKFS7G8HN.0 size=320894 2024-09-12T00:30:59.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.905+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=XOIBKFS7G8HN tag=IGW5OS8F2UBU type=write size=1369470 2024-09-12T00:30:59.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.907+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~T465Z6TE2055.0 size=841537 2024-09-12T00:30:59.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.907+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=T465Z6TE2055 tag=K2T2CZAD2VGH type=write size=1890113 2024-09-12T00:30:59.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.909+0000 7f0362c73780 1 < canceled operation key=1IPW8SJ6SSU2 tag=KZC0OCEJ9XQZ type=del size=1832590 2024-09-12T00:30:59.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.911+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~C4UAHOAQAU2E.0 size=432206 2024-09-12T00:30:59.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.911+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=C4UAHOAQAU2E tag=F0TSFYCR21O9 type=write size=1480782 2024-09-12T00:30:59.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.913+0000 7f0362c73780 1 < canceled operation key=WT0185G517YR tag=LRVWSTVF72S1 type=write size=337936 2024-09-12T00:30:59.912 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.914+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=7WUDOY4T906W type=write size=422258 2024-09-12T00:30:59.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.916+0000 7f0362c73780 1 < completed write operation key=927NCYXX8Z2P tag=5WOXFQYY4480 type=write size=192138 2024-09-12T00:30:59.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.918+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~W3WS4882SJ0F.0 size=1048576 2024-09-12T00:30:59.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.919+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~W3WS4882SJ0F.1 size=1048576 2024-09-12T00:30:59.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.921+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~W3WS4882SJ0F.2 size=643739 2024-09-12T00:30:59.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.921+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=W3WS4882SJ0F tag=20961K8GME1L type=write size=3789467 2024-09-12T00:30:59.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.922+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~Q1MHEFKJJRCB.0 size=1048576 2024-09-12T00:30:59.922 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.923+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~Q1MHEFKJJRCB.1 size=838331 2024-09-12T00:30:59.924 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.926+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=Q1MHEFKJJRCB tag=UA3BXX4H804V type=write size=2935483 2024-09-12T00:30:59.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.927+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=0N7EUD6DGCB2 type=del size=3402446 2024-09-12T00:30:59.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.928+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=NQHFQFCKQPZN type=del 2024-09-12T00:30:59.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.931+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~UF8V5TTSHIJV.0 size=193435 2024-09-12T00:30:59.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.931+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=UF8V5TTSHIJV tag=6HANCYGOSSGZ type=write size=1242011 2024-09-12T00:30:59.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.932+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~IC024LSL2T16.0 size=73311 2024-09-12T00:30:59.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.935+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=IC024LSL2T16 tag=HWFOPKHJRP24 type=write size=1121887 2024-09-12T00:30:59.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.936+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=4CAL283MH6CI type=del size=2622085 2024-09-12T00:30:59.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.938+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=GYHAFY95YHZ2 type=del 2024-09-12T00:30:59.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.939+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=8XK5HZB31U57 type=del size=2959668 2024-09-12T00:30:59.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.941+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=XG80ZGB6LHER type=del 2024-09-12T00:30:59.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.944+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~FLHBJNGAO2XF.0 size=927802 2024-09-12T00:30:59.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.944+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=FLHBJNGAO2XF tag=D8ANARCVG2KG type=write size=1976378 2024-09-12T00:30:59.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.944+0000 7f0362c73780 1 < canceled part key=_multipart_XWW3882YBHAJ.2~GZCXM3L8AKCS.0 size=1048576 2024-09-12T00:30:59.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.945+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~GZCXM3L8AKCS.1 size=1048576 2024-09-12T00:30:59.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.946+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~GZCXM3L8AKCS.2 size=986705 2024-09-12T00:30:59.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.949+0000 7f0362c73780 1 < canceled multipart upload key=XWW3882YBHAJ upload=GZCXM3L8AKCS tag=YCT1WP4LANCC type=write size=4132433 2024-09-12T00:30:59.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.950+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=3GDI6CR0CD11 type=write size=335598 2024-09-12T00:30:59.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.954+0000 7f0362c73780 1 < suggested update operation key=PLAYMR18X9DZ tag=MJFX4C04MFCS type=del size=1069437 2024-09-12T00:30:59.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.957+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~4G6NJWQXQIGP.0 size=1048576 2024-09-12T00:30:59.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.958+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~4G6NJWQXQIGP.1 size=1048576 2024-09-12T00:30:59.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.959+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~4G6NJWQXQIGP.2 size=415389 2024-09-12T00:30:59.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.959+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=4G6NJWQXQIGP tag=7JO6IT9WU9Y9 type=write size=3561117 2024-09-12T00:30:59.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.960+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~NG7YSBF89K41.0 size=262717 2024-09-12T00:30:59.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.963+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=NG7YSBF89K41 tag=30AUNW87HHLO type=write size=1311293 2024-09-12T00:30:59.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.966+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~ZY07JXT3221P.0 size=1048576 2024-09-12T00:30:59.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.967+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~ZY07JXT3221P.1 size=604897 2024-09-12T00:30:59.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.967+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=ZY07JXT3221P tag=SH4O01EXKRDF type=write size=2702049 2024-09-12T00:30:59.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.971+0000 7f0362c73780 1 < suggested remove operation key=PYCRNXC9ITGF tag=W32CLQX9ILCX type=del 2024-09-12T00:30:59.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.972+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=2ER1PNGPOR2X type=del size=1304239 2024-09-12T00:30:59.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.974+0000 7f0362c73780 1 < canceled operation key=KWDEKRO3WICD tag=863WWUGXKQNO type=del size=1557425 2024-09-12T00:30:59.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.976+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=6C1BFP8HFS5Z type=del size=3079005 2024-09-12T00:30:59.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.977+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=IP1OY8VEN94L type=del 2024-09-12T00:30:59.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.980+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~6PPVHYW4WVEE.0 size=1048576 2024-09-12T00:30:59.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.981+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~6PPVHYW4WVEE.1 size=1039371 2024-09-12T00:30:59.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.981+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=6PPVHYW4WVEE tag=6Q3Y9LK95NE5 type=write size=3136523 2024-09-12T00:30:59.981 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.983+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~8CMQ7LXQEVAU.0 size=847915 2024-09-12T00:30:59.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.985+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=8CMQ7LXQEVAU tag=WMD5JA1JS18C type=write size=1896491 2024-09-12T00:30:59.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.988+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~HPHAUSR8EJNE.0 size=976442 2024-09-12T00:30:59.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.988+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=HPHAUSR8EJNE tag=3OE6DYJFPD83 type=write size=2025018 2024-09-12T00:30:59.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.989+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~T465Z6TE2055.0 size=841537 2024-09-12T00:30:59.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.991+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=T465Z6TE2055 tag=K2T2CZAD2VGH type=write size=1890113 2024-09-12T00:30:59.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.993+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=B8VBFY8T8LYM type=del size=3563873 2024-09-12T00:30:59.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.994+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~C4UAHOAQAU2E.0 size=432206 2024-09-12T00:30:59.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.996+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=C4UAHOAQAU2E tag=F0TSFYCR21O9 type=write size=1480782 2024-09-12T00:30:59.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.998+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=VCD9UK11UIOF type=del size=376267 2024-09-12T00:30:59.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:30:59.999+0000 7f0362c73780 1 < completed write operation key=XMMZOX8MH3GT tag=7WUDOY4T906W type=write size=422258 2024-09-12T00:30:59.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.001+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=79M5IW08AAOE type=del size=730076 2024-09-12T00:31:00.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.002+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~W3WS4882SJ0F.0 size=1048576 2024-09-12T00:31:00.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.003+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~W3WS4882SJ0F.1 size=1048576 2024-09-12T00:31:00.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.003+0000 7f0362c73780 1 < canceled part key=_multipart_2DHHPBYV80O8.2~W3WS4882SJ0F.2 size=643739 2024-09-12T00:31:00.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.005+0000 7f0362c73780 1 < canceled multipart upload key=2DHHPBYV80O8 upload=W3WS4882SJ0F tag=20961K8GME1L type=write size=3789467 2024-09-12T00:31:00.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.007+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=FUG7D0YWI008 type=del size=2308334 2024-09-12T00:31:00.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.008+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=0N7EUD6DGCB2 type=del 2024-09-12T00:31:00.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.010+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~88EH7EENGHUM.0 size=1048576 2024-09-12T00:31:00.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.012+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~88EH7EENGHUM.1 size=1048576 2024-09-12T00:31:00.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.013+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~88EH7EENGHUM.2 size=473678 2024-09-12T00:31:00.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.013+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=88EH7EENGHUM tag=2Q0B3LQHQE6X type=write size=3619406 2024-09-12T00:31:00.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.014+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~UF8V5TTSHIJV.0 size=193435 2024-09-12T00:31:00.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.016+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=UF8V5TTSHIJV tag=6HANCYGOSSGZ type=write size=1242011 2024-09-12T00:31:00.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.019+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~1SPHOODHNAOU.0 size=1048576 2024-09-12T00:31:00.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.020+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~1SPHOODHNAOU.1 size=1048576 2024-09-12T00:31:00.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.021+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~1SPHOODHNAOU.2 size=601500 2024-09-12T00:31:00.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.021+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=1SPHOODHNAOU tag=ULUJVJAXQEJ0 type=write size=3747228 2024-09-12T00:31:00.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.022+0000 7f0362c73780 -1 < no bi entry to suggest for operation key=PYCRNXC9ITGF tag=4CAL283MH6CI type=del size=2622085: (2) No such file or directory 2024-09-12T00:31:00.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.023+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=TZKP8XCWY54C type=write size=483558 2024-09-12T00:31:00.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.024+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=8XK5HZB31U57 type=del 2024-09-12T00:31:00.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.026+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=2VVJWX8J0378 type=del size=3082096 2024-09-12T00:31:00.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.027+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~FLHBJNGAO2XF.0 size=927802 2024-09-12T00:31:00.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.029+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=FLHBJNGAO2XF tag=D8ANARCVG2KG type=write size=1976378 2024-09-12T00:31:00.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.030+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=11GZOT0UVPLY type=del size=1346173 2024-09-12T00:31:00.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.032+0000 7f0362c73780 1 < completed write operation key=VD0LFCNLI1YI tag=3GDI6CR0CD11 type=write size=335598 2024-09-12T00:31:00.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.034+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~M3ERD4Y3GK4S.0 size=1048576 2024-09-12T00:31:00.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.036+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~M3ERD4Y3GK4S.1 size=1030810 2024-09-12T00:31:00.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.036+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=M3ERD4Y3GK4S tag=UYZLPOIHUIBG type=write size=3127962 2024-09-12T00:31:00.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.037+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~4G6NJWQXQIGP.0 size=1048576 2024-09-12T00:31:00.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.038+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~4G6NJWQXQIGP.1 size=1048576 2024-09-12T00:31:00.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.039+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~4G6NJWQXQIGP.2 size=415389 2024-09-12T00:31:00.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.041+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=4G6NJWQXQIGP tag=7JO6IT9WU9Y9 type=write size=3561117 2024-09-12T00:31:00.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.043+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=AZHJW4SEPNLG type=del size=3555209 2024-09-12T00:31:00.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.044+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~ZY07JXT3221P.0 size=1048576 2024-09-12T00:31:00.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.046+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~ZY07JXT3221P.1 size=604897 2024-09-12T00:31:00.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.048+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=ZY07JXT3221P tag=SH4O01EXKRDF type=write size=2702049 2024-09-12T00:31:00.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.049+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=IFORIV83S4IC type=del size=1451555 2024-09-12T00:31:00.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.052+0000 7f0362c73780 1 < suggested update operation key=HWSQFSK29S0V tag=2ER1PNGPOR2X type=del size=1304239 2024-09-12T00:31:00.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.053+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=ZBA2G6OPYW9K type=del size=3427459 2024-09-12T00:31:00.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.055+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=6C1BFP8HFS5Z type=del 2024-09-12T00:31:00.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.057+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~7M3U07OD0XH0.0 size=1048576 2024-09-12T00:31:00.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.058+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~7M3U07OD0XH0.1 size=1048576 2024-09-12T00:31:00.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.059+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~7M3U07OD0XH0.2 size=497364 2024-09-12T00:31:00.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.060+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=7M3U07OD0XH0 tag=HIXQFIUOFCOD type=write size=3643092 2024-09-12T00:31:00.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.061+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~6PPVHYW4WVEE.0 size=1048576 2024-09-12T00:31:00.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.062+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~6PPVHYW4WVEE.1 size=1039371 2024-09-12T00:31:00.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.064+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=6PPVHYW4WVEE tag=6Q3Y9LK95NE5 type=write size=3136523 2024-09-12T00:31:00.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.067+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~8ZGJLOMDJX07.0 size=1048576 2024-09-12T00:31:00.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.068+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~8ZGJLOMDJX07.1 size=1048576 2024-09-12T00:31:00.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.069+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~8ZGJLOMDJX07.2 size=420116 2024-09-12T00:31:00.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.069+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=8ZGJLOMDJX07 tag=IF1L3L0LDD2C type=write size=3565844 2024-09-12T00:31:00.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.070+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~HPHAUSR8EJNE.0 size=976442 2024-09-12T00:31:00.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.073+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=HPHAUSR8EJNE tag=3OE6DYJFPD83 type=write size=2025018 2024-09-12T00:31:00.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.075+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=PS9CN5PWWVK9 type=del size=1386291 2024-09-12T00:31:00.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.078+0000 7f0362c73780 1 < suggested update operation key=KWDEKRO3WICD tag=B8VBFY8T8LYM type=del size=3563873 2024-09-12T00:31:00.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.080+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~TA0KOCJ3T9N5.0 size=751220 2024-09-12T00:31:00.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.080+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=TA0KOCJ3T9N5 tag=NSJFSEDD6856 type=write size=1799796 2024-09-12T00:31:00.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.082+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=VCD9UK11UIOF type=del 2024-09-12T00:31:00.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.083+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=6HUJ079ZJTWM type=del size=2422623 2024-09-12T00:31:00.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.086+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=79M5IW08AAOE type=del 2024-09-12T00:31:00.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.087+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=F0XVXDJCNMOL type=write size=890289 2024-09-12T00:31:00.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.089+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=FUG7D0YWI008 type=del 2024-09-12T00:31:00.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.090+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=BWMMATSCYXFJ type=del size=1011948 2024-09-12T00:31:00.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.090+0000 7f0362c73780 1 < canceled part key=_multipart_2DHHPBYV80O8.2~88EH7EENGHUM.0 size=1048576 2024-09-12T00:31:00.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.092+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~88EH7EENGHUM.1 size=1048576 2024-09-12T00:31:00.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.092+0000 7f0362c73780 1 < canceled part key=_multipart_2DHHPBYV80O8.2~88EH7EENGHUM.2 size=473678 2024-09-12T00:31:00.092 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.094+0000 7f0362c73780 1 < canceled multipart upload key=2DHHPBYV80O8 upload=88EH7EENGHUM tag=2Q0B3LQHQE6X type=write size=3619406 2024-09-12T00:31:00.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.096+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~PU9AQW4IKI66.0 size=307998 2024-09-12T00:31:00.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.096+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=PU9AQW4IKI66 tag=NHF44MYY9IC5 type=write size=1356574 2024-09-12T00:31:00.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.098+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~1SPHOODHNAOU.0 size=1048576 2024-09-12T00:31:00.097 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.099+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~1SPHOODHNAOU.1 size=1048576 2024-09-12T00:31:00.098 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.100+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~1SPHOODHNAOU.2 size=601500 2024-09-12T00:31:00.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.102+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=1SPHOODHNAOU tag=ULUJVJAXQEJ0 type=write size=3747228 2024-09-12T00:31:00.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.105+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~6SIMH263LS2D.0 size=420514 2024-09-12T00:31:00.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.105+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=6SIMH263LS2D tag=T34AH079YIGM type=write size=1469090 2024-09-12T00:31:00.106 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.108+0000 7f0362c73780 1 < suggested remove operation key=OY30LP7FYXNF tag=TZKP8XCWY54C type=write 2024-09-12T00:31:00.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.109+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=JKTLIOLM5Z9S type=del size=533138 2024-09-12T00:31:00.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.112+0000 7f0362c73780 1 < suggested update operation key=Q6M0D2698CUZ tag=2VVJWX8J0378 type=del size=3082096 2024-09-12T00:31:00.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.115+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~CQS0323OZO2F.0 size=1048576 2024-09-12T00:31:00.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.116+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~CQS0323OZO2F.1 size=873305 2024-09-12T00:31:00.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.116+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=CQS0323OZO2F tag=EOM3JMHG92PH type=write size=2970457 2024-09-12T00:31:00.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.118+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=11GZOT0UVPLY type=del 2024-09-12T00:31:00.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.119+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=TS3IHX5YWVHU type=del size=4085587 2024-09-12T00:31:00.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.121+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~M3ERD4Y3GK4S.0 size=1048576 2024-09-12T00:31:00.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.121+0000 7f0362c73780 1 < canceled part key=_multipart_1SE6WTQMW6JU.2~M3ERD4Y3GK4S.1 size=1030810 2024-09-12T00:31:00.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.123+0000 7f0362c73780 1 < canceled multipart upload key=1SE6WTQMW6JU upload=M3ERD4Y3GK4S tag=UYZLPOIHUIBG type=write size=3127962 2024-09-12T00:31:00.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.124+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=BQJSFOS9KF6K type=del size=2690250 2024-09-12T00:31:00.124 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.126+0000 7f0362c73780 1 < canceled operation key=2DHHPBYV80O8 tag=AZHJW4SEPNLG type=del size=3555209 2024-09-12T00:31:00.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.127+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=G0JMZMC5VS33 type=write size=393717 2024-09-12T00:31:00.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.129+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=IFORIV83S4IC type=del 2024-09-12T00:31:00.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.130+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=CRLS8I75IEHT type=write size=636758 2024-09-12T00:31:00.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.132+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=ZBA2G6OPYW9K type=del 2024-09-12T00:31:00.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.133+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=A8QYLS49G3G7 type=del size=743715 2024-09-12T00:31:00.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.135+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~7M3U07OD0XH0.0 size=1048576 2024-09-12T00:31:00.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.136+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~7M3U07OD0XH0.1 size=1048576 2024-09-12T00:31:00.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.137+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~7M3U07OD0XH0.2 size=497364 2024-09-12T00:31:00.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.139+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=7M3U07OD0XH0 tag=HIXQFIUOFCOD type=write size=3643092 2024-09-12T00:31:00.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.142+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~1SMHANOS60HS.0 size=1048576 2024-09-12T00:31:00.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.143+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~1SMHANOS60HS.1 size=1048576 2024-09-12T00:31:00.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.144+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~1SMHANOS60HS.2 size=973421 2024-09-12T00:31:00.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.144+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=1SMHANOS60HS tag=P3XE6Z4H24E0 type=write size=4119149 2024-09-12T00:31:00.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.146+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~8ZGJLOMDJX07.0 size=1048576 2024-09-12T00:31:00.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.147+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~8ZGJLOMDJX07.1 size=1048576 2024-09-12T00:31:00.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.148+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~8ZGJLOMDJX07.2 size=420116 2024-09-12T00:31:00.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.150+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=8ZGJLOMDJX07 tag=IF1L3L0LDD2C type=write size=3565844 2024-09-12T00:31:00.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.152+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=NUJT4MUF5RDE type=del size=3443566 2024-09-12T00:31:00.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.154+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=PS9CN5PWWVK9 type=del 2024-09-12T00:31:00.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.155+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=T0MPJ7UHRAUK type=del size=2517072 2024-09-12T00:31:00.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.157+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~TA0KOCJ3T9N5.0 size=751220 2024-09-12T00:31:00.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.160+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=TA0KOCJ3T9N5 tag=NSJFSEDD6856 type=write size=1799796 2024-09-12T00:31:00.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.162+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~AD0RSOM2FHYN.0 size=1048576 2024-09-12T00:31:00.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.163+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~AD0RSOM2FHYN.1 size=822481 2024-09-12T00:31:00.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.163+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=AD0RSOM2FHYN tag=R3KDI47PW5B3 type=write size=2919633 2024-09-12T00:31:00.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.165+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=6HUJ079ZJTWM type=del 2024-09-12T00:31:00.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.166+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=LOY98LBCGFNN type=del size=2708772 2024-09-12T00:31:00.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.169+0000 7f0362c73780 1 < suggested update operation key=J5GSZCJW2BP1 tag=F0XVXDJCNMOL type=write size=890289 2024-09-12T00:31:00.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.171+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=NKL27MR2GTQ9 type=write size=937409 2024-09-12T00:31:00.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.172+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=BWMMATSCYXFJ type=del 2024-09-12T00:31:00.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.175+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~71PNCFJ5673V.0 size=526616 2024-09-12T00:31:00.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.175+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=71PNCFJ5673V tag=RE4G39H2HL36 type=write size=1575192 2024-09-12T00:31:00.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.176+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~PU9AQW4IKI66.0 size=307998 2024-09-12T00:31:00.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.179+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=PU9AQW4IKI66 tag=NHF44MYY9IC5 type=write size=1356574 2024-09-12T00:31:00.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.181+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~950E3AO9OGPV.0 size=1048576 2024-09-12T00:31:00.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.183+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~950E3AO9OGPV.1 size=1048576 2024-09-12T00:31:00.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.184+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~950E3AO9OGPV.2 size=559128 2024-09-12T00:31:00.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.184+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=950E3AO9OGPV tag=LC0APVTZ3OG0 type=write size=3704856 2024-09-12T00:31:00.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.185+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~6SIMH263LS2D.0 size=420514 2024-09-12T00:31:00.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.188+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=6SIMH263LS2D tag=T34AH079YIGM type=write size=1469090 2024-09-12T00:31:00.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.190+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~J8HAGVIG2ZUU.0 size=1048576 2024-09-12T00:31:00.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.192+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~J8HAGVIG2ZUU.1 size=837119 2024-09-12T00:31:00.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.192+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=J8HAGVIG2ZUU tag=D5W7E9A5F7YG type=write size=2934271 2024-09-12T00:31:00.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.193+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=JKTLIOLM5Z9S type=del 2024-09-12T00:31:00.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.195+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=UQO3YHNXXYTZ type=del size=3949540 2024-09-12T00:31:00.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.197+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~CQS0323OZO2F.0 size=1048576 2024-09-12T00:31:00.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.198+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~CQS0323OZO2F.1 size=873305 2024-09-12T00:31:00.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.200+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=CQS0323OZO2F tag=EOM3JMHG92PH type=write size=2970457 2024-09-12T00:31:00.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.202+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=5XZBOGEF9S1Z type=write size=307545 2024-09-12T00:31:00.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.203+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=TS3IHX5YWVHU type=del 2024-09-12T00:31:00.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.206+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~ICKQ3OTD0FGG.0 size=852996 2024-09-12T00:31:00.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.206+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=ICKQ3OTD0FGG tag=JT72D8ORPRO0 type=write size=1901572 2024-09-12T00:31:00.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.207+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=BQJSFOS9KF6K type=del 2024-09-12T00:31:00.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.210+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~MTSG7MYW9SQG.0 size=1048576 2024-09-12T00:31:00.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.211+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~MTSG7MYW9SQG.1 size=833828 2024-09-12T00:31:00.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.211+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=MTSG7MYW9SQG tag=H9FV7D8KC732 type=write size=2930980 2024-09-12T00:31:00.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.212+0000 7f0362c73780 1 < completed write operation key=I3B48QD9E40S tag=G0JMZMC5VS33 type=write size=393717 2024-09-12T00:31:00.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.214+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=E7K4EATVS334 type=write size=717559 2024-09-12T00:31:00.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.215+0000 7f0362c73780 -1 < failed to complete operation key=J5GSZCJW2BP1 tag=CRLS8I75IEHT type=write size=636758: (22) Invalid argument 2024-09-12T00:31:00.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.218+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~ZVCP94CC2QHI.0 size=979114 2024-09-12T00:31:00.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.218+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=ZVCP94CC2QHI tag=0KM4MWRST393 type=write size=2027690 2024-09-12T00:31:00.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.222+0000 7f0362c73780 1 < suggested remove operation key=44YJP6XPIFT5 tag=A8QYLS49G3G7 type=del 2024-09-12T00:31:00.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.223+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=6Y7CJ1HAQEO5 type=del size=1304428 2024-09-12T00:31:00.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.225+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~1SMHANOS60HS.0 size=1048576 2024-09-12T00:31:00.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.225+0000 7f0362c73780 1 < canceled part key=_multipart_PYCRNXC9ITGF.2~1SMHANOS60HS.1 size=1048576 2024-09-12T00:31:00.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.226+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~1SMHANOS60HS.2 size=973421 2024-09-12T00:31:00.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.229+0000 7f0362c73780 1 < canceled multipart upload key=PYCRNXC9ITGF upload=1SMHANOS60HS tag=P3XE6Z4H24E0 type=write size=4119149 2024-09-12T00:31:00.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.230+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=Q4P9S8PEWJOD type=del size=2260613 2024-09-12T00:31:00.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.232+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=NUJT4MUF5RDE type=del 2024-09-12T00:31:00.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.235+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~AFD9K38HJ5YD.0 size=1048576 2024-09-12T00:31:00.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.236+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~AFD9K38HJ5YD.1 size=1048576 2024-09-12T00:31:00.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.237+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~AFD9K38HJ5YD.2 size=275092 2024-09-12T00:31:00.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.237+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=AFD9K38HJ5YD tag=0M7WNC95ZW3R type=write size=3420820 2024-09-12T00:31:00.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.238+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=T0MPJ7UHRAUK type=del 2024-09-12T00:31:00.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.240+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=83EZTQRCZ8D7 type=del size=1714263 2024-09-12T00:31:00.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.241+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~AD0RSOM2FHYN.0 size=1048576 2024-09-12T00:31:00.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.242+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~AD0RSOM2FHYN.1 size=822481 2024-09-12T00:31:00.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.245+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=AD0RSOM2FHYN tag=R3KDI47PW5B3 type=write size=2919633 2024-09-12T00:31:00.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.246+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=AG37TR89LNFI type=del size=4168835 2024-09-12T00:31:00.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.248+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=LOY98LBCGFNN type=del 2024-09-12T00:31:00.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.249+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=92IM3U66BVVG type=del size=93798 2024-09-12T00:31:00.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.252+0000 7f0362c73780 1 < suggested update operation key=X4ZML0796M7F tag=NKL27MR2GTQ9 type=write size=937409 2024-09-12T00:31:00.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.253+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=A6V3KML0DH8E type=del size=2074758 2024-09-12T00:31:00.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.255+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~71PNCFJ5673V.0 size=526616 2024-09-12T00:31:00.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.257+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=71PNCFJ5673V tag=RE4G39H2HL36 type=write size=1575192 2024-09-12T00:31:00.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.258+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=UC4QB63OSSTR type=del size=745687 2024-09-12T00:31:00.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.260+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~950E3AO9OGPV.0 size=1048576 2024-09-12T00:31:00.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.261+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~950E3AO9OGPV.1 size=1048576 2024-09-12T00:31:00.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.262+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~950E3AO9OGPV.2 size=559128 2024-09-12T00:31:00.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.264+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=950E3AO9OGPV tag=LC0APVTZ3OG0 type=write size=3704856 2024-09-12T00:31:00.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.267+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~DYTR7SSXKBUV.0 size=331656 2024-09-12T00:31:00.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.267+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=DYTR7SSXKBUV tag=V9ZGW1SQ82MC type=write size=1380232 2024-09-12T00:31:00.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.268+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~J8HAGVIG2ZUU.0 size=1048576 2024-09-12T00:31:00.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.269+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~J8HAGVIG2ZUU.1 size=837119 2024-09-12T00:31:00.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.272+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=J8HAGVIG2ZUU tag=D5W7E9A5F7YG type=write size=2934271 2024-09-12T00:31:00.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.274+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=0LZN3MF2F7Y2 type=write size=802058 2024-09-12T00:31:00.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.275+0000 7f0362c73780 -1 < failed to complete operation key=44YJP6XPIFT5 tag=UQO3YHNXXYTZ type=del size=3949540: (22) Invalid argument 2024-09-12T00:31:00.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.277+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=Z9U9NNB18MGK type=del size=864127 2024-09-12T00:31:00.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.278+0000 7f0362c73780 1 < completed write operation key=J5GSZCJW2BP1 tag=5XZBOGEF9S1Z type=write size=307545 2024-09-12T00:31:00.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.280+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=9H4AK2NP16Y4 type=del size=2705243 2024-09-12T00:31:00.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.281+0000 7f0362c73780 1 < canceled part key=_multipart_CZHT9UQS34JU.2~ICKQ3OTD0FGG.0 size=852996 2024-09-12T00:31:00.282 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.283+0000 7f0362c73780 1 < canceled multipart upload key=CZHT9UQS34JU upload=ICKQ3OTD0FGG tag=JT72D8ORPRO0 type=write size=1901572 2024-09-12T00:31:00.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.285+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=MX88CYSU0IOW type=del size=3807255 2024-09-12T00:31:00.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.287+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~MTSG7MYW9SQG.0 size=1048576 2024-09-12T00:31:00.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.288+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~MTSG7MYW9SQG.1 size=833828 2024-09-12T00:31:00.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.290+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=MTSG7MYW9SQG tag=H9FV7D8KC732 type=write size=2930980 2024-09-12T00:31:00.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.292+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=CKHL5PKKNRFH type=write size=209049 2024-09-12T00:31:00.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.294+0000 7f0362c73780 1 < canceled operation key=927NCYXX8Z2P tag=E7K4EATVS334 type=write size=717559 2024-09-12T00:31:00.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.295+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=BGGM18QHTT4R type=write size=759471 2024-09-12T00:31:00.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.297+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~ZVCP94CC2QHI.0 size=979114 2024-09-12T00:31:00.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.299+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=ZVCP94CC2QHI tag=0KM4MWRST393 type=write size=2027690 2024-09-12T00:31:00.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.302+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~PHFZJ1PH7C2B.0 size=1048576 2024-09-12T00:31:00.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.303+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~PHFZJ1PH7C2B.1 size=1048576 2024-09-12T00:31:00.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.304+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~PHFZJ1PH7C2B.2 size=159986 2024-09-12T00:31:00.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.304+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=PHFZJ1PH7C2B tag=105BROM87XUF type=write size=3305714 2024-09-12T00:31:00.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.305+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=6Y7CJ1HAQEO5 type=del 2024-09-12T00:31:00.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.308+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~N1Z6RKZY6OG9.0 size=1048576 2024-09-12T00:31:00.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.309+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~N1Z6RKZY6OG9.1 size=1048094 2024-09-12T00:31:00.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.309+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=N1Z6RKZY6OG9 tag=HIBMEWF89N1V type=write size=3145246 2024-09-12T00:31:00.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.310+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=Q4P9S8PEWJOD type=del 2024-09-12T00:31:00.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.312+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=YTBEN1YPRBB9 type=del size=3923057 2024-09-12T00:31:00.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.313+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~AFD9K38HJ5YD.0 size=1048576 2024-09-12T00:31:00.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.315+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~AFD9K38HJ5YD.1 size=1048576 2024-09-12T00:31:00.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.316+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~AFD9K38HJ5YD.2 size=275092 2024-09-12T00:31:00.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.318+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=AFD9K38HJ5YD tag=0M7WNC95ZW3R type=write size=3420820 2024-09-12T00:31:00.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.320+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=J0SXWPUXYAOW type=write size=674963 2024-09-12T00:31:00.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.321+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=83EZTQRCZ8D7 type=del 2024-09-12T00:31:00.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.323+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=2EZ1GBTRKE5K type=del size=2882510 2024-09-12T00:31:00.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.324+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=AG37TR89LNFI type=del 2024-09-12T00:31:00.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.325+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=2Z1E7J3CC0TA type=del size=2352315 2024-09-12T00:31:00.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.327+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=92IM3U66BVVG type=del 2024-09-12T00:31:00.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.328+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=XPE5C9HD0CNV type=write size=801856 2024-09-12T00:31:00.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.330+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=A6V3KML0DH8E type=del 2024-09-12T00:31:00.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.332+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~L092Y07UEH92.0 size=1048576 2024-09-12T00:31:00.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.333+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~L092Y07UEH92.1 size=1048576 2024-09-12T00:31:00.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.335+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~L092Y07UEH92.2 size=711769 2024-09-12T00:31:00.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.335+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=L092Y07UEH92 tag=718FLBGS37IN type=write size=3857497 2024-09-12T00:31:00.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.337+0000 7f0362c73780 1 < suggested update operation key=84T1VJG5SHU4 tag=UC4QB63OSSTR type=del size=745687 2024-09-12T00:31:00.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.340+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~792O4SQAQS97.0 size=1048576 2024-09-12T00:31:00.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.341+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~792O4SQAQS97.1 size=943531 2024-09-12T00:31:00.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.341+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=792O4SQAQS97 tag=TEG4612WEC18 type=write size=3040683 2024-09-12T00:31:00.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.343+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~DYTR7SSXKBUV.0 size=331656 2024-09-12T00:31:00.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.345+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=DYTR7SSXKBUV tag=V9ZGW1SQ82MC type=write size=1380232 2024-09-12T00:31:00.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.348+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~V29GDQ92ADEY.0 size=952632 2024-09-12T00:31:00.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.348+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=V29GDQ92ADEY tag=3L53KV6F7EQ5 type=write size=2001208 2024-09-12T00:31:00.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.349+0000 7f0362c73780 1 < completed write operation key=PYCRNXC9ITGF tag=0LZN3MF2F7Y2 type=write size=802058 2024-09-12T00:31:00.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.350+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=FHKO2SGC230G type=write size=1024340 2024-09-12T00:31:00.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.352+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=Z9U9NNB18MGK type=del 2024-09-12T00:31:00.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.354+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=GZC56GSDTDTA type=del size=3569256 2024-09-12T00:31:00.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.356+0000 7f0362c73780 1 < completed delete operation key=PLAYMR18X9DZ tag=9H4AK2NP16Y4 type=del 2024-09-12T00:31:00.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.357+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=G09QQ1T43VI1 type=del size=1894743 2024-09-12T00:31:00.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.360+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=MX88CYSU0IOW type=del 2024-09-12T00:31:00.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.363+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~IXVZS2G3UNCM.0 size=816380 2024-09-12T00:31:00.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.363+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=IXVZS2G3UNCM tag=WPK6MKX539YT type=write size=1864956 2024-09-12T00:31:00.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.365+0000 7f0362c73780 1 < completed write operation key=PLAYMR18X9DZ tag=CKHL5PKKNRFH type=write size=209049 2024-09-12T00:31:00.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.368+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~7KR4X1RJ1HWG.0 size=1048576 2024-09-12T00:31:00.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.369+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~7KR4X1RJ1HWG.1 size=1048576 2024-09-12T00:31:00.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.370+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~7KR4X1RJ1HWG.2 size=697685 2024-09-12T00:31:00.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.370+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=7KR4X1RJ1HWG tag=X2IV54G7MWY3 type=write size=3843413 2024-09-12T00:31:00.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.371+0000 7f0362c73780 1 < completed write operation key=PLAYMR18X9DZ tag=BGGM18QHTT4R type=write size=759471 2024-09-12T00:31:00.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.374+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~GUA3JTX3CFT7.0 size=1048576 2024-09-12T00:31:00.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.375+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~GUA3JTX3CFT7.1 size=1041686 2024-09-12T00:31:00.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.375+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=GUA3JTX3CFT7 tag=P2BTW8IL8A5J type=write size=3138838 2024-09-12T00:31:00.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.376+0000 7f0362c73780 1 < canceled part key=_multipart_6AYDT9X4LC6T.2~PHFZJ1PH7C2B.0 size=1048576 2024-09-12T00:31:00.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.377+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~PHFZJ1PH7C2B.1 size=1048576 2024-09-12T00:31:00.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.378+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~PHFZJ1PH7C2B.2 size=159986 2024-09-12T00:31:00.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.380+0000 7f0362c73780 1 < canceled multipart upload key=6AYDT9X4LC6T upload=PHFZJ1PH7C2B tag=105BROM87XUF type=write size=3305714 2024-09-12T00:31:00.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.383+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~OZKX7WM1ZES6.0 size=267804 2024-09-12T00:31:00.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.383+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=OZKX7WM1ZES6 tag=C3QF984MXZWC type=write size=1316380 2024-09-12T00:31:00.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.385+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~N1Z6RKZY6OG9.0 size=1048576 2024-09-12T00:31:00.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.385+0000 7f0362c73780 1 < canceled part key=_multipart_CZHT9UQS34JU.2~N1Z6RKZY6OG9.1 size=1048094 2024-09-12T00:31:00.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.387+0000 7f0362c73780 1 < canceled multipart upload key=CZHT9UQS34JU upload=N1Z6RKZY6OG9 tag=HIBMEWF89N1V type=write size=3145246 2024-09-12T00:31:00.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.389+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~9EK3PJ5NCFNP.0 size=553639 2024-09-12T00:31:00.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.389+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=9EK3PJ5NCFNP tag=HXJIOYZU5TP5 type=write size=1602215 2024-09-12T00:31:00.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.391+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=YTBEN1YPRBB9 type=del 2024-09-12T00:31:00.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.393+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=10OGQL3RQEUC type=del size=3651583 2024-09-12T00:31:00.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.394+0000 7f0362c73780 1 < completed write operation key=XR8L0HL374VC tag=J0SXWPUXYAOW type=write size=674963 2024-09-12T00:31:00.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.395+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=197521P2LUMX type=del size=2340921 2024-09-12T00:31:00.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.397+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=2EZ1GBTRKE5K type=del 2024-09-12T00:31:00.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.398+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=GQ33HRMMUBY1 type=del size=2245714 2024-09-12T00:31:00.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.401+0000 7f0362c73780 1 < suggested remove operation key=R4ABY5AY0S1P tag=2Z1E7J3CC0TA type=del 2024-09-12T00:31:00.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.404+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~93QXCCQXVGZ8.0 size=1048576 2024-09-12T00:31:00.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.405+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~93QXCCQXVGZ8.1 size=389133 2024-09-12T00:31:00.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.405+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=93QXCCQXVGZ8 tag=8LW4WIRT55RV type=write size=2486285 2024-09-12T00:31:00.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.407+0000 7f0362c73780 1 < completed write operation key=1UUNRPUKAINC tag=XPE5C9HD0CNV type=write size=801856 2024-09-12T00:31:00.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.408+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=LAJ2OTGH2KP5 type=write size=343286 2024-09-12T00:31:00.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.410+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~L092Y07UEH92.0 size=1048576 2024-09-12T00:31:00.409 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.411+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~L092Y07UEH92.1 size=1048576 2024-09-12T00:31:00.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.412+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~L092Y07UEH92.2 size=711769 2024-09-12T00:31:00.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.414+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=L092Y07UEH92 tag=718FLBGS37IN type=write size=3857497 2024-09-12T00:31:00.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.415+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=NOO2TQKGY7FI type=del size=3256509 2024-09-12T00:31:00.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.417+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~792O4SQAQS97.0 size=1048576 2024-09-12T00:31:00.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.418+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~792O4SQAQS97.1 size=943531 2024-09-12T00:31:00.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.420+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=792O4SQAQS97 tag=TEG4612WEC18 type=write size=3040683 2024-09-12T00:31:00.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.423+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~RRTZAE25ES3C.0 size=1048576 2024-09-12T00:31:00.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.424+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~RRTZAE25ES3C.1 size=757936 2024-09-12T00:31:00.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.424+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=RRTZAE25ES3C tag=TU876VB03QYB type=write size=2855088 2024-09-12T00:31:00.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.425+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~V29GDQ92ADEY.0 size=952632 2024-09-12T00:31:00.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.427+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=V29GDQ92ADEY tag=3L53KV6F7EQ5 type=write size=2001208 2024-09-12T00:31:00.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.430+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~N2WSMDRPFX26.0 size=54582 2024-09-12T00:31:00.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.430+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=N2WSMDRPFX26 tag=AV8C9NV12CY0 type=write size=1103158 2024-09-12T00:31:00.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.432+0000 7f0362c73780 1 < completed write operation key=X4ZML0796M7F tag=FHKO2SGC230G type=write size=1024340 2024-09-12T00:31:00.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.433+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=I144IQT2LOL0 type=del size=3279431 2024-09-12T00:31:00.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.435+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=GZC56GSDTDTA type=del 2024-09-12T00:31:00.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.436+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=4XZ0DFCBVCGC type=del size=2283001 2024-09-12T00:31:00.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.437+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=G09QQ1T43VI1 type=del 2024-09-12T00:31:00.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.439+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=WY5KFT3GYMY5 type=del size=1112450 2024-09-12T00:31:00.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.440+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~IXVZS2G3UNCM.0 size=816380 2024-09-12T00:31:00.441 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.443+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=IXVZS2G3UNCM tag=WPK6MKX539YT type=write size=1864956 2024-09-12T00:31:00.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.444+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=EGXPYK30HMF7 type=del size=3664164 2024-09-12T00:31:00.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.446+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~7KR4X1RJ1HWG.0 size=1048576 2024-09-12T00:31:00.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.447+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~7KR4X1RJ1HWG.1 size=1048576 2024-09-12T00:31:00.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.448+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~7KR4X1RJ1HWG.2 size=697685 2024-09-12T00:31:00.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.451+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=7KR4X1RJ1HWG tag=X2IV54G7MWY3 type=write size=3843413 2024-09-12T00:31:00.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.452+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=HWL4201RTAUE type=del size=2573867 2024-09-12T00:31:00.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.454+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~GUA3JTX3CFT7.0 size=1048576 2024-09-12T00:31:00.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.455+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~GUA3JTX3CFT7.1 size=1041686 2024-09-12T00:31:00.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.457+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=GUA3JTX3CFT7 tag=P2BTW8IL8A5J type=write size=3138838 2024-09-12T00:31:00.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.459+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=OTQVQWRCDDFU type=write size=511953 2024-09-12T00:31:00.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.460+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~OZKX7WM1ZES6.0 size=267804 2024-09-12T00:31:00.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.464+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=OZKX7WM1ZES6 tag=C3QF984MXZWC type=write size=1316380 2024-09-12T00:31:00.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.467+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~UI39T3JVE2II.0 size=200951 2024-09-12T00:31:00.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.467+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=UI39T3JVE2II tag=LXBJ24YHNMEL type=write size=1249527 2024-09-12T00:31:00.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.468+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~9EK3PJ5NCFNP.0 size=553639 2024-09-12T00:31:00.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.471+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=9EK3PJ5NCFNP tag=HXJIOYZU5TP5 type=write size=1602215 2024-09-12T00:31:00.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.472+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=8XHWM4QNW5ON type=del size=3244812 2024-09-12T00:31:00.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.474+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=10OGQL3RQEUC type=del 2024-09-12T00:31:00.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.475+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=27T1PQAWUO2E type=write size=886666 2024-09-12T00:31:00.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.477+0000 7f0362c73780 1 < canceled operation key=6AYDT9X4LC6T tag=197521P2LUMX type=del size=2340921 2024-09-12T00:31:00.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.478+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=J64ZWRR51NFK type=del size=523844 2024-09-12T00:31:00.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.480+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=GQ33HRMMUBY1 type=del 2024-09-12T00:31:00.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.481+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=ZTGBROY36MR1 type=write size=298906 2024-09-12T00:31:00.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.483+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~93QXCCQXVGZ8.0 size=1048576 2024-09-12T00:31:00.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.484+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~93QXCCQXVGZ8.1 size=389133 2024-09-12T00:31:00.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.486+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=93QXCCQXVGZ8 tag=8LW4WIRT55RV type=write size=2486285 2024-09-12T00:31:00.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.488+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=LSUBFKFV718U type=del size=3081477 2024-09-12T00:31:00.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.489+0000 7f0362c73780 1 < completed write operation key=1MLL1T362X51 tag=LAJ2OTGH2KP5 type=write size=343286 2024-09-12T00:31:00.489 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.491+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=63P0J5IU1EZY type=del size=3880271 2024-09-12T00:31:00.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.494+0000 7f0362c73780 1 < suggested remove operation key=I3B48QD9E40S tag=NOO2TQKGY7FI type=del 2024-09-12T00:31:00.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.498+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~H46VMJQEWY0Z.0 size=1048576 2024-09-12T00:31:00.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.499+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~H46VMJQEWY0Z.1 size=728120 2024-09-12T00:31:00.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.499+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=H46VMJQEWY0Z tag=2R5I5A797625 type=write size=2825272 2024-09-12T00:31:00.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.499+0000 7f0362c73780 1 < canceled part key=_multipart_3XZZX53L26G5.2~RRTZAE25ES3C.0 size=1048576 2024-09-12T00:31:00.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.500+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~RRTZAE25ES3C.1 size=757936 2024-09-12T00:31:00.501 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.503+0000 7f0362c73780 1 < canceled multipart upload key=3XZZX53L26G5 upload=RRTZAE25ES3C tag=TU876VB03QYB type=write size=2855088 2024-09-12T00:31:00.502 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.504+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=K0B238B7FJ5K type=write size=693837 2024-09-12T00:31:00.504 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.505+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~N2WSMDRPFX26.0 size=54582 2024-09-12T00:31:00.506 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.508+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=N2WSMDRPFX26 tag=AV8C9NV12CY0 type=write size=1103158 2024-09-12T00:31:00.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.509+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=SRK1DEH38XCS type=del size=268302 2024-09-12T00:31:00.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.510+0000 7f0362c73780 -1 < failed to complete operation key=I3B48QD9E40S tag=I144IQT2LOL0 type=del size=3279431: (22) Invalid argument 2024-09-12T00:31:00.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.512+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=VKJYFUGL6994 type=del size=805303 2024-09-12T00:31:00.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.513+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=4XZ0DFCBVCGC type=del 2024-09-12T00:31:00.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.515+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=ZOC27QN3241N type=del size=1031859 2024-09-12T00:31:00.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.516+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=WY5KFT3GYMY5 type=del 2024-09-12T00:31:00.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.517+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=0RKZG1JB4FIO type=del size=3107052 2024-09-12T00:31:00.517 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.519+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=EGXPYK30HMF7 type=del 2024-09-12T00:31:00.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.521+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~7V37B8NEC3YM.0 size=1048576 2024-09-12T00:31:00.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.522+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~7V37B8NEC3YM.1 size=526667 2024-09-12T00:31:00.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.522+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=7V37B8NEC3YM tag=UMQWZIUNEHJY type=write size=2623819 2024-09-12T00:31:00.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.524+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=HWL4201RTAUE type=del 2024-09-12T00:31:00.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.526+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=SPLO3VYPYFWZ type=write size=793441 2024-09-12T00:31:00.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.528+0000 7f0362c73780 1 < suggested update operation key=44YJP6XPIFT5 tag=OTQVQWRCDDFU type=write size=511953 2024-09-12T00:31:00.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.530+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=9HTYC1NV16KU type=del size=1883021 2024-09-12T00:31:00.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.531+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~UI39T3JVE2II.0 size=200951 2024-09-12T00:31:00.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.534+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=UI39T3JVE2II tag=LXBJ24YHNMEL type=write size=1249527 2024-09-12T00:31:00.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.536+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~XBQH5KZ0L9M1.0 size=547434 2024-09-12T00:31:00.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.536+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=XBQH5KZ0L9M1 tag=XZD7Q3X9DZC3 type=write size=1596010 2024-09-12T00:31:00.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.538+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=8XHWM4QNW5ON type=del 2024-09-12T00:31:00.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.539+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=ZT7T3TUGKHW5 type=del size=3727951 2024-09-12T00:31:00.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.541+0000 7f0362c73780 1 < canceled operation key=1SE6WTQMW6JU tag=27T1PQAWUO2E type=write size=886666 2024-09-12T00:31:00.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.542+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=8DTASPBLS973 type=del size=1380469 2024-09-12T00:31:00.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.544+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=J64ZWRR51NFK type=del 2024-09-12T00:31:00.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.547+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~3WVNEOPPNIL0.0 size=685845 2024-09-12T00:31:00.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.547+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=3WVNEOPPNIL0 tag=1DQZG48YTGVS type=write size=1734421 2024-09-12T00:31:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.548+0000 7f0362c73780 1 < completed write operation key=6AYDT9X4LC6T tag=ZTGBROY36MR1 type=write size=298906 2024-09-12T00:31:00.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.550+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=UQJKM9EK2FQD type=del size=2418776 2024-09-12T00:31:00.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.551+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=LSUBFKFV718U type=del 2024-09-12T00:31:00.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.553+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=WY5DZHZFTF3C type=write size=62773 2024-09-12T00:31:00.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.554+0000 7f0362c73780 1 < canceled operation key=G2HW98G6624O tag=63P0J5IU1EZY type=del size=3880271 2024-09-12T00:31:00.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.556+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=8DY4MVF1H7TY type=write size=137314 2024-09-12T00:31:00.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.557+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~H46VMJQEWY0Z.0 size=1048576 2024-09-12T00:31:00.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.558+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~H46VMJQEWY0Z.1 size=728120 2024-09-12T00:31:00.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.561+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=H46VMJQEWY0Z tag=2R5I5A797625 type=write size=2825272 2024-09-12T00:31:00.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.562+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=SE58A1VMJD2M type=write size=810898 2024-09-12T00:31:00.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.564+0000 7f0362c73780 1 < canceled operation key=1IPW8SJ6SSU2 tag=K0B238B7FJ5K type=write size=693837 2024-09-12T00:31:00.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.565+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=MI7MPT6RAMGP type=del size=1497172 2024-09-12T00:31:00.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.566+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=SRK1DEH38XCS type=del 2024-09-12T00:31:00.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.569+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~MQH7AIU8A1UT.0 size=187828 2024-09-12T00:31:00.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.569+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=MQH7AIU8A1UT tag=JN8QFRNFR2TE type=write size=1236404 2024-09-12T00:31:00.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.570+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=VKJYFUGL6994 type=del 2024-09-12T00:31:00.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.572+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=ZOH7E6G8OPIB type=write size=236727 2024-09-12T00:31:00.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.573+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=ZOC27QN3241N type=del 2024-09-12T00:31:00.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.575+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=5AG932KTTBLC type=del size=1443362 2024-09-12T00:31:00.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.577+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=0RKZG1JB4FIO type=del 2024-09-12T00:31:00.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.578+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=6XFC8DBG6XOY type=del size=882008 2024-09-12T00:31:00.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.580+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~7V37B8NEC3YM.0 size=1048576 2024-09-12T00:31:00.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.581+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~7V37B8NEC3YM.1 size=526667 2024-09-12T00:31:00.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.583+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=7V37B8NEC3YM tag=UMQWZIUNEHJY type=write size=2623819 2024-09-12T00:31:00.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.586+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~1D7YGI1TS3EA.0 size=1048576 2024-09-12T00:31:00.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.587+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~1D7YGI1TS3EA.1 size=1048576 2024-09-12T00:31:00.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.589+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~1D7YGI1TS3EA.2 size=491240 2024-09-12T00:31:00.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.589+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=1D7YGI1TS3EA tag=L4DIGHAYQPM8 type=write size=3636968 2024-09-12T00:31:00.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.591+0000 7f0362c73780 1 < suggested remove operation key=KWDEKRO3WICD tag=SPLO3VYPYFWZ type=write 2024-09-12T00:31:00.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.593+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=P4ZTRY81UQC4 type=del size=2064011 2024-09-12T00:31:00.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.594+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=9HTYC1NV16KU type=del 2024-09-12T00:31:00.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.595+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=0N2ABX5KWJLW type=write size=284998 2024-09-12T00:31:00.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.597+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~XBQH5KZ0L9M1.0 size=547434 2024-09-12T00:31:00.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.599+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=XBQH5KZ0L9M1 tag=XZD7Q3X9DZC3 type=write size=1596010 2024-09-12T00:31:00.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.600+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=MKQZM2GAHIFS type=del size=710286 2024-09-12T00:31:00.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.601+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=ZT7T3TUGKHW5 type=del 2024-09-12T00:31:00.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.603+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=WZSRPW4OSM9Y type=del size=807322 2024-09-12T00:31:00.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.605+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=8DTASPBLS973 type=del 2024-09-12T00:31:00.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.606+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=0LZVBNVC9VOS type=del size=1011267 2024-09-12T00:31:00.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.607+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~3WVNEOPPNIL0.0 size=685845 2024-09-12T00:31:00.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.610+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=3WVNEOPPNIL0 tag=1DQZG48YTGVS type=write size=1734421 2024-09-12T00:31:00.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.611+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=8XUH6CHSKCMA type=del size=1315960 2024-09-12T00:31:00.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.613+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=UQJKM9EK2FQD type=del 2024-09-12T00:31:00.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.615+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~EL0V1IBXKV59.0 size=1048576 2024-09-12T00:31:00.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.616+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~EL0V1IBXKV59.1 size=923417 2024-09-12T00:31:00.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.616+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=EL0V1IBXKV59 tag=ZG73320R7VP4 type=write size=3020569 2024-09-12T00:31:00.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.618+0000 7f0362c73780 1 < canceled operation key=XR8L0HL374VC tag=WY5DZHZFTF3C type=write size=62773 2024-09-12T00:31:00.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.619+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=YUAVPSTUM51X type=del size=2900817 2024-09-12T00:31:00.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.622+0000 7f0362c73780 1 < suggested update operation key=44YJP6XPIFT5 tag=8DY4MVF1H7TY type=write size=137314 2024-09-12T00:31:00.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.625+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~B2IBXII4KTDB.0 size=1048576 2024-09-12T00:31:00.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.626+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~B2IBXII4KTDB.1 size=1048576 2024-09-12T00:31:00.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.629+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~B2IBXII4KTDB.2 size=682041 2024-09-12T00:31:00.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.629+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=B2IBXII4KTDB tag=2UJAUJZ6SLNT type=write size=3827769 2024-09-12T00:31:00.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.632+0000 7f0362c73780 1 < suggested remove operation key=84T1VJG5SHU4 tag=SE58A1VMJD2M type=write 2024-09-12T00:31:00.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.633+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=ZW38UMRZTMB0 type=del size=2075730 2024-09-12T00:31:00.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.635+0000 7f0362c73780 -1 < failed to complete operation key=44YJP6XPIFT5 tag=MI7MPT6RAMGP type=del size=1497172: (22) Invalid argument 2024-09-12T00:31:00.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.639+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~JS2B94FJ4BVW.0 size=1048576 2024-09-12T00:31:00.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.640+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~JS2B94FJ4BVW.1 size=1048576 2024-09-12T00:31:00.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.641+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~JS2B94FJ4BVW.2 size=736225 2024-09-12T00:31:00.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.641+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=JS2B94FJ4BVW tag=T0XGGTMHYOSZ type=write size=3881953 2024-09-12T00:31:00.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.642+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~MQH7AIU8A1UT.0 size=187828 2024-09-12T00:31:00.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.645+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=MQH7AIU8A1UT tag=JN8QFRNFR2TE type=write size=1236404 2024-09-12T00:31:00.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.647+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~1NFB65HWXWNI.0 size=1048576 2024-09-12T00:31:00.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.648+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~1NFB65HWXWNI.1 size=248306 2024-09-12T00:31:00.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.648+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=1NFB65HWXWNI tag=4H332QBS6AFX type=write size=2345458 2024-09-12T00:31:00.649 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.651+0000 7f0362c73780 1 < suggested update operation key=PYCRNXC9ITGF tag=ZOH7E6G8OPIB type=write size=236727 2024-09-12T00:31:00.651 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.652+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=FXDCINVWOGK8 type=del size=2245990 2024-09-12T00:31:00.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.654+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=5AG932KTTBLC type=del 2024-09-12T00:31:00.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.655+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=2PDZTBERC8P7 type=del size=3650284 2024-09-12T00:31:00.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.657+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=6XFC8DBG6XOY type=del 2024-09-12T00:31:00.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.659+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=8IA6FAPEF3Z1 type=del size=401998 2024-09-12T00:31:00.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.660+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~1D7YGI1TS3EA.0 size=1048576 2024-09-12T00:31:00.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.662+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~1D7YGI1TS3EA.1 size=1048576 2024-09-12T00:31:00.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.663+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~1D7YGI1TS3EA.2 size=491240 2024-09-12T00:31:00.663 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.665+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=1D7YGI1TS3EA tag=L4DIGHAYQPM8 type=write size=3636968 2024-09-12T00:31:00.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.667+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=P6NL0HKIJNVG type=write size=341294 2024-09-12T00:31:00.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.668+0000 7f0362c73780 -1 < failed to complete operation key=84T1VJG5SHU4 tag=P4ZTRY81UQC4 type=del size=2064011: (22) Invalid argument 2024-09-12T00:31:00.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.670+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=TY3AD28DHXQJ type=del size=1654985 2024-09-12T00:31:00.670 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.672+0000 7f0362c73780 1 < completed write operation key=Q6M0D2698CUZ tag=0N2ABX5KWJLW type=write size=284998 2024-09-12T00:31:00.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.673+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=XI62J6USTI9H type=del size=2879672 2024-09-12T00:31:00.673 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.674+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=MKQZM2GAHIFS type=del 2024-09-12T00:31:00.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.676+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=9PCBQFYDTZXV type=del size=3392093 2024-09-12T00:31:00.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.677+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=WZSRPW4OSM9Y type=del 2024-09-12T00:31:00.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.680+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~5FXL1HHVPHSE.0 size=1048576 2024-09-12T00:31:00.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.681+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~5FXL1HHVPHSE.1 size=929968 2024-09-12T00:31:00.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.681+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=5FXL1HHVPHSE tag=UVTZUW19HQYX type=write size=3027120 2024-09-12T00:31:00.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.684+0000 7f0362c73780 1 < suggested remove operation key=HEN9LUUIDAR5 tag=0LZVBNVC9VOS type=del 2024-09-12T00:31:00.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.685+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=3U6NOSTPZNGB type=del size=1546874 2024-09-12T00:31:00.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.687+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=8XUH6CHSKCMA type=del 2024-09-12T00:31:00.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.689+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~0JU9OUG588QD.0 size=172844 2024-09-12T00:31:00.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.689+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=0JU9OUG588QD tag=NC21XD43B8N7 type=write size=1221420 2024-09-12T00:31:00.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.691+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~EL0V1IBXKV59.0 size=1048576 2024-09-12T00:31:00.690 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.692+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~EL0V1IBXKV59.1 size=923417 2024-09-12T00:31:00.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.694+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=EL0V1IBXKV59 tag=ZG73320R7VP4 type=write size=3020569 2024-09-12T00:31:00.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.695+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=NCFRQ4XI8M5G type=del size=144065 2024-09-12T00:31:00.696 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.698+0000 7f0362c73780 1 < suggested update operation key=R4ABY5AY0S1P tag=YUAVPSTUM51X type=del size=2900817 2024-09-12T00:31:00.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.699+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=6CBKMURWTDW3 type=del size=2600309 2024-09-12T00:31:00.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.701+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~B2IBXII4KTDB.0 size=1048576 2024-09-12T00:31:00.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.702+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~B2IBXII4KTDB.1 size=1048576 2024-09-12T00:31:00.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.703+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~B2IBXII4KTDB.2 size=682041 2024-09-12T00:31:00.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.705+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=B2IBXII4KTDB tag=2UJAUJZ6SLNT type=write size=3827769 2024-09-12T00:31:00.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.706+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=E4PYCZO9MAQO type=del size=2702135 2024-09-12T00:31:00.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.708+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=ZW38UMRZTMB0 type=del 2024-09-12T00:31:00.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.709+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=5ZGR2KFFURT1 type=del size=378604 2024-09-12T00:31:00.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.710+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~JS2B94FJ4BVW.0 size=1048576 2024-09-12T00:31:00.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.712+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~JS2B94FJ4BVW.1 size=1048576 2024-09-12T00:31:00.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.713+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~JS2B94FJ4BVW.2 size=736225 2024-09-12T00:31:00.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.715+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=JS2B94FJ4BVW tag=T0XGGTMHYOSZ type=write size=3881953 2024-09-12T00:31:00.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.717+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=4QL6LAU7B6QT type=write size=795941 2024-09-12T00:31:00.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.718+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~1NFB65HWXWNI.0 size=1048576 2024-09-12T00:31:00.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.719+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~1NFB65HWXWNI.1 size=248306 2024-09-12T00:31:00.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.722+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=1NFB65HWXWNI tag=4H332QBS6AFX type=write size=2345458 2024-09-12T00:31:00.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.724+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~CU8GLXP3XLBS.0 size=1048576 2024-09-12T00:31:00.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.725+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~CU8GLXP3XLBS.1 size=1042364 2024-09-12T00:31:00.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.725+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=CU8GLXP3XLBS tag=JSRF51G2LZ35 type=write size=3139516 2024-09-12T00:31:00.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.726+0000 7f0362c73780 -1 < failed to complete operation key=R4ABY5AY0S1P tag=FXDCINVWOGK8 type=del size=2245990: (22) Invalid argument 2024-09-12T00:31:00.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.727+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=OCDGH12KT447 type=del size=3955974 2024-09-12T00:31:00.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.729+0000 7f0362c73780 1 < canceled operation key=OY30LP7FYXNF tag=2PDZTBERC8P7 type=del size=3650284 2024-09-12T00:31:00.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.731+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=0VE7VW94EYXC type=del size=314157 2024-09-12T00:31:00.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.732+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=8IA6FAPEF3Z1 type=del 2024-09-12T00:31:00.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.735+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~5VSMZ8SK5H3U.0 size=597880 2024-09-12T00:31:00.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.735+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=5VSMZ8SK5H3U tag=7S71RXW3MOZD type=write size=1646456 2024-09-12T00:31:00.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.736+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=P6NL0HKIJNVG type=write size=341294 2024-09-12T00:31:00.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.739+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~9ZUX33C3B4R6.0 size=1048576 2024-09-12T00:31:00.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.740+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~9ZUX33C3B4R6.1 size=256379 2024-09-12T00:31:00.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.740+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=9ZUX33C3B4R6 tag=ETOT5J0WXU42 type=write size=2353531 2024-09-12T00:31:00.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.741+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=TY3AD28DHXQJ type=del 2024-09-12T00:31:00.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.743+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=PSXEJ0G2ZRA3 type=del size=3282471 2024-09-12T00:31:00.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.744+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=XI62J6USTI9H type=del 2024-09-12T00:31:00.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.745+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=XGX85L0E6TNT type=write size=331204 2024-09-12T00:31:00.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.747+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=9PCBQFYDTZXV type=del 2024-09-12T00:31:00.748 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.749+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~CSW6ZAWGO2WJ.0 size=1048576 2024-09-12T00:31:00.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.751+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~CSW6ZAWGO2WJ.1 size=1048576 2024-09-12T00:31:00.750 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.752+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~CSW6ZAWGO2WJ.2 size=766780 2024-09-12T00:31:00.750 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.752+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=CSW6ZAWGO2WJ tag=MSENZXCO7QXY type=write size=3912508 2024-09-12T00:31:00.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.753+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~5FXL1HHVPHSE.0 size=1048576 2024-09-12T00:31:00.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.754+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~5FXL1HHVPHSE.1 size=929968 2024-09-12T00:31:00.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.757+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=5FXL1HHVPHSE tag=UVTZUW19HQYX type=write size=3027120 2024-09-12T00:31:00.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.760+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~NRPXQUMO1T87.0 size=1048576 2024-09-12T00:31:00.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.762+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~NRPXQUMO1T87.1 size=763866 2024-09-12T00:31:00.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.762+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=NRPXQUMO1T87 tag=CZDYBJLSAVYI type=write size=2861018 2024-09-12T00:31:00.762 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.763+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=3U6NOSTPZNGB type=del 2024-09-12T00:31:00.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.765+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=QD5YMXK99C3W type=write size=775656 2024-09-12T00:31:00.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.765+0000 7f0362c73780 1 < canceled part key=_multipart_HEN9LUUIDAR5.2~0JU9OUG588QD.0 size=172844 2024-09-12T00:31:00.766 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.768+0000 7f0362c73780 1 < canceled multipart upload key=HEN9LUUIDAR5 upload=0JU9OUG588QD tag=NC21XD43B8N7 type=write size=1221420 2024-09-12T00:31:00.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.772+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~1X0WJG0P3LB8.0 size=891781 2024-09-12T00:31:00.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.772+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=1X0WJG0P3LB8 tag=FJ0B3F94EOIL type=write size=1940357 2024-09-12T00:31:00.771 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.773+0000 7f0362c73780 1 < canceled operation key=IIZAWZDLR2QE tag=NCFRQ4XI8M5G type=del size=144065 2024-09-12T00:31:00.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.775+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=SZV5CU0QX9M8 type=del size=1959270 2024-09-12T00:31:00.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.776+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=6CBKMURWTDW3 type=del 2024-09-12T00:31:00.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.779+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~1JA7FLVJKQVM.0 size=1048576 2024-09-12T00:31:00.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.780+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~1JA7FLVJKQVM.1 size=167181 2024-09-12T00:31:00.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.780+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=1JA7FLVJKQVM tag=9TNVZL2Y7H81 type=write size=2264333 2024-09-12T00:31:00.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.781+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=E4PYCZO9MAQO type=del 2024-09-12T00:31:00.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.783+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=OFH0W7Q3F51W type=del size=3253599 2024-09-12T00:31:00.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.784+0000 7f0362c73780 1 < canceled operation key=PLAYMR18X9DZ tag=5ZGR2KFFURT1 type=del size=378604 2024-09-12T00:31:00.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.787+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~1PXW1F88U2BD.0 size=1048576 2024-09-12T00:31:00.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.788+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~1PXW1F88U2BD.1 size=885304 2024-09-12T00:31:00.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.788+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=1PXW1F88U2BD tag=D6ZZVRXUEF0N type=write size=2982456 2024-09-12T00:31:00.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.790+0000 7f0362c73780 1 < completed write operation key=84T1VJG5SHU4 tag=4QL6LAU7B6QT type=write size=795941 2024-09-12T00:31:00.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.791+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=M2WA433QIX9S type=del size=3828471 2024-09-12T00:31:00.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.793+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~CU8GLXP3XLBS.0 size=1048576 2024-09-12T00:31:00.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.794+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~CU8GLXP3XLBS.1 size=1042364 2024-09-12T00:31:00.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.796+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=CU8GLXP3XLBS tag=JSRF51G2LZ35 type=write size=3139516 2024-09-12T00:31:00.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.797+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=DPVP2KBC57OZ type=write size=309001 2024-09-12T00:31:00.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.799+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=OCDGH12KT447 type=del 2024-09-12T00:31:00.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.800+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=JH6NPTLM5EKJ type=del size=3830768 2024-09-12T00:31:00.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.803+0000 7f0362c73780 1 < suggested remove operation key=R4ABY5AY0S1P tag=0VE7VW94EYXC type=del 2024-09-12T00:31:00.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.805+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=THUKIA9J4GWM type=del size=1175648 2024-09-12T00:31:00.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.806+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~5VSMZ8SK5H3U.0 size=597880 2024-09-12T00:31:00.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.809+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=5VSMZ8SK5H3U tag=7S71RXW3MOZD type=write size=1646456 2024-09-12T00:31:00.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.811+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~R1YIO88AVSH3.0 size=1048576 2024-09-12T00:31:00.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.812+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~R1YIO88AVSH3.1 size=1048576 2024-09-12T00:31:00.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.813+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~R1YIO88AVSH3.2 size=137222 2024-09-12T00:31:00.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.813+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=R1YIO88AVSH3 tag=Y97HGP9NW1MO type=write size=3282950 2024-09-12T00:31:00.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.815+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~9ZUX33C3B4R6.0 size=1048576 2024-09-12T00:31:00.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.816+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~9ZUX33C3B4R6.1 size=256379 2024-09-12T00:31:00.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.818+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=9ZUX33C3B4R6 tag=ETOT5J0WXU42 type=write size=2353531 2024-09-12T00:31:00.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.820+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=KRSQD1Y6D0ER type=del size=1479392 2024-09-12T00:31:00.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.822+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=PSXEJ0G2ZRA3 type=del 2024-09-12T00:31:00.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.823+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=N8HUMCDXLCX8 type=del size=1804464 2024-09-12T00:31:00.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.825+0000 7f0362c73780 1 < completed write operation key=KWDEKRO3WICD tag=XGX85L0E6TNT type=write size=331204 2024-09-12T00:31:00.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.826+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=ITYDCQTVTBC9 type=del size=664771 2024-09-12T00:31:00.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.828+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~CSW6ZAWGO2WJ.0 size=1048576 2024-09-12T00:31:00.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.829+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~CSW6ZAWGO2WJ.1 size=1048576 2024-09-12T00:31:00.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.830+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~CSW6ZAWGO2WJ.2 size=766780 2024-09-12T00:31:00.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.833+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=CSW6ZAWGO2WJ tag=MSENZXCO7QXY type=write size=3912508 2024-09-12T00:31:00.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.835+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=OBQ19BGAM1Z3 type=write size=96631 2024-09-12T00:31:00.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.836+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~NRPXQUMO1T87.0 size=1048576 2024-09-12T00:31:00.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.837+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~NRPXQUMO1T87.1 size=763866 2024-09-12T00:31:00.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.839+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=NRPXQUMO1T87 tag=CZDYBJLSAVYI type=write size=2861018 2024-09-12T00:31:00.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.841+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=QOYW6TQ20VJS type=del size=121283 2024-09-12T00:31:00.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.842+0000 7f0362c73780 1 < canceled operation key=927NCYXX8Z2P tag=QD5YMXK99C3W type=write size=775656 2024-09-12T00:31:00.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.844+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=S6POSS15VQSI type=del size=70293 2024-09-12T00:31:00.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.846+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~1X0WJG0P3LB8.0 size=891781 2024-09-12T00:31:00.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.848+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=1X0WJG0P3LB8 tag=FJ0B3F94EOIL type=write size=1940357 2024-09-12T00:31:00.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.849+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=Q73Z7XOIG1QP type=write size=218301 2024-09-12T00:31:00.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.851+0000 7f0362c73780 1 < canceled operation key=G2HW98G6624O tag=SZV5CU0QX9M8 type=del size=1959270 2024-09-12T00:31:00.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.852+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=ZAT3FM13XGL3 type=del size=707910 2024-09-12T00:31:00.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.854+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~1JA7FLVJKQVM.0 size=1048576 2024-09-12T00:31:00.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.855+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~1JA7FLVJKQVM.1 size=167181 2024-09-12T00:31:00.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.857+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=1JA7FLVJKQVM tag=9TNVZL2Y7H81 type=write size=2264333 2024-09-12T00:31:00.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.859+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=8Z4LBV15S21I type=del size=446902 2024-09-12T00:31:00.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.861+0000 7f0362c73780 1 < suggested remove operation key=IIZAWZDLR2QE tag=OFH0W7Q3F51W type=del 2024-09-12T00:31:00.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.864+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~ZZ09I0JJTAFP.0 size=1048576 2024-09-12T00:31:00.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.865+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~ZZ09I0JJTAFP.1 size=1048576 2024-09-12T00:31:00.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.866+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~ZZ09I0JJTAFP.2 size=961592 2024-09-12T00:31:00.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.866+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=ZZ09I0JJTAFP tag=CV8GTEHX5Q9Q type=write size=4107320 2024-09-12T00:31:00.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.868+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~1PXW1F88U2BD.0 size=1048576 2024-09-12T00:31:00.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.870+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~1PXW1F88U2BD.1 size=885304 2024-09-12T00:31:00.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.872+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=1PXW1F88U2BD tag=D6ZZVRXUEF0N type=write size=2982456 2024-09-12T00:31:00.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.874+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~DASI508BPZ26.0 size=1048576 2024-09-12T00:31:00.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.876+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~DASI508BPZ26.1 size=696945 2024-09-12T00:31:00.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.876+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=DASI508BPZ26 tag=HFQI8E6XEXQJ type=write size=2794097 2024-09-12T00:31:00.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.877+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=M2WA433QIX9S type=del 2024-09-12T00:31:00.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.879+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=Z2F5JCRW0EFJ type=del size=3257984 2024-09-12T00:31:00.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.880+0000 7f0362c73780 -1 < failed to complete operation key=R4ABY5AY0S1P tag=DPVP2KBC57OZ type=write size=309001: (22) Invalid argument 2024-09-12T00:31:00.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.881+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=DVWJK349S287 type=del size=2496426 2024-09-12T00:31:00.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.883+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=JH6NPTLM5EKJ type=del 2024-09-12T00:31:00.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.885+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=ER2TMUZZSXGZ type=write size=464229 2024-09-12T00:31:00.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.886+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=THUKIA9J4GWM type=del 2024-09-12T00:31:00.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.889+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~1KFBYDCW6K9I.0 size=142478 2024-09-12T00:31:00.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.889+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=1KFBYDCW6K9I tag=A0Q1MY4E8OQJ type=write size=1191054 2024-09-12T00:31:00.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.891+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~R1YIO88AVSH3.0 size=1048576 2024-09-12T00:31:00.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.893+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~R1YIO88AVSH3.1 size=1048576 2024-09-12T00:31:00.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.894+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~R1YIO88AVSH3.2 size=137222 2024-09-12T00:31:00.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.897+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=R1YIO88AVSH3 tag=Y97HGP9NW1MO type=write size=3282950 2024-09-12T00:31:00.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.898+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=NZPS99QK3ODO type=del size=1777938 2024-09-12T00:31:00.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.900+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=KRSQD1Y6D0ER type=del 2024-09-12T00:31:00.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.901+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=66VW46VAZ2BK type=del size=775737 2024-09-12T00:31:00.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.903+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=N8HUMCDXLCX8 type=del 2024-09-12T00:31:00.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.904+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=HC6P9CLAMIHW type=del size=2329729 2024-09-12T00:31:00.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.907+0000 7f0362c73780 1 < suggested remove operation key=XMMZOX8MH3GT tag=ITYDCQTVTBC9 type=del 2024-09-12T00:31:00.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.912+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~CA76AG1M7KNU.0 size=1048576 2024-09-12T00:31:00.912 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.914+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~CA76AG1M7KNU.1 size=370701 2024-09-12T00:31:00.912 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.914+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=CA76AG1M7KNU tag=JC091KBTVIDQ type=write size=2467853 2024-09-12T00:31:00.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.915+0000 7f0362c73780 1 < completed write operation key=XWW3882YBHAJ tag=OBQ19BGAM1Z3 type=write size=96631 2024-09-12T00:31:00.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.918+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~NLYSYMJAU31X.0 size=1048576 2024-09-12T00:31:00.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.919+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~NLYSYMJAU31X.1 size=1048576 2024-09-12T00:31:00.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.920+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~NLYSYMJAU31X.2 size=966974 2024-09-12T00:31:00.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.920+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=NLYSYMJAU31X tag=2AW6A5CEIU23 type=write size=4112702 2024-09-12T00:31:00.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.922+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=QOYW6TQ20VJS type=del 2024-09-12T00:31:00.922 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.924+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=2BFV55IPIDJ6 type=write size=940495 2024-09-12T00:31:00.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.927+0000 7f0362c73780 1 < suggested remove operation key=X4ZML0796M7F tag=S6POSS15VQSI type=del 2024-09-12T00:31:00.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.928+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=8YHD6Q4681DG type=del size=696257 2024-09-12T00:31:00.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.930+0000 7f0362c73780 1 < completed write operation key=1SE6WTQMW6JU tag=Q73Z7XOIG1QP type=write size=218301 2024-09-12T00:31:00.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.931+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=F7VOD8V3DTEU type=del size=4162378 2024-09-12T00:31:00.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.933+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=ZAT3FM13XGL3 type=del 2024-09-12T00:31:00.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.934+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=LUG3X527HRGQ type=write size=701001 2024-09-12T00:31:00.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.936+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=8Z4LBV15S21I type=del 2024-09-12T00:31:00.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.938+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=SHAQY1GU3QY5 type=write size=8144 2024-09-12T00:31:00.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.939+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~ZZ09I0JJTAFP.0 size=1048576 2024-09-12T00:31:00.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.940+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~ZZ09I0JJTAFP.1 size=1048576 2024-09-12T00:31:00.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.942+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~ZZ09I0JJTAFP.2 size=961592 2024-09-12T00:31:00.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.944+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=ZZ09I0JJTAFP tag=CV8GTEHX5Q9Q type=write size=4107320 2024-09-12T00:31:00.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.946+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=5HEXLS879TVA type=del size=2815195 2024-09-12T00:31:00.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.947+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~DASI508BPZ26.0 size=1048576 2024-09-12T00:31:00.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.950+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~DASI508BPZ26.1 size=696945 2024-09-12T00:31:00.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.953+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=DASI508BPZ26 tag=HFQI8E6XEXQJ type=write size=2794097 2024-09-12T00:31:00.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.956+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~WRIK50K232L4.0 size=1048576 2024-09-12T00:31:00.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.957+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~WRIK50K232L4.1 size=1048576 2024-09-12T00:31:00.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.958+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~WRIK50K232L4.2 size=635787 2024-09-12T00:31:00.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.958+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=WRIK50K232L4 tag=NOEO8AJVB0NB type=write size=3781515 2024-09-12T00:31:00.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.960+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=Z2F5JCRW0EFJ type=del 2024-09-12T00:31:00.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.962+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~TJRKMVX22UQ9.0 size=1048576 2024-09-12T00:31:00.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.964+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~TJRKMVX22UQ9.1 size=809047 2024-09-12T00:31:00.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.964+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=TJRKMVX22UQ9 tag=841ZRIT1M3VI type=write size=2906199 2024-09-12T00:31:00.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.965+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=DVWJK349S287 type=del 2024-09-12T00:31:00.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.966+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=N139US9RZXDI type=write size=1013957 2024-09-12T00:31:00.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.968+0000 7f0362c73780 1 < canceled operation key=KWDEKRO3WICD tag=ER2TMUZZSXGZ type=write size=464229 2024-09-12T00:31:00.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.969+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=1710KRIKEFM7 type=del size=1277370 2024-09-12T00:31:00.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.971+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~1KFBYDCW6K9I.0 size=142478 2024-09-12T00:31:00.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.973+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=1KFBYDCW6K9I tag=A0Q1MY4E8OQJ type=write size=1191054 2024-09-12T00:31:00.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.974+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=CYOBYP1VETK9 type=del size=754144 2024-09-12T00:31:00.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.976+0000 7f0362c73780 1 < canceled operation key=I3B48QD9E40S tag=NZPS99QK3ODO type=del size=1777938 2024-09-12T00:31:00.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.979+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~GM6N8UZXZM33.0 size=1048576 2024-09-12T00:31:00.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.980+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~GM6N8UZXZM33.1 size=771744 2024-09-12T00:31:00.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.980+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=GM6N8UZXZM33 tag=PZFPM7Z1RHSZ type=write size=2868896 2024-09-12T00:31:00.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.982+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=66VW46VAZ2BK type=del 2024-09-12T00:31:00.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.984+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=RKAY3PKGYE92 type=write size=120715 2024-09-12T00:31:00.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.985+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=HC6P9CLAMIHW type=del 2024-09-12T00:31:00.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.988+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~6IWJ1IZIB3HM.0 size=1048576 2024-09-12T00:31:00.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.989+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~6IWJ1IZIB3HM.1 size=988210 2024-09-12T00:31:00.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.989+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=6IWJ1IZIB3HM tag=LIKOH2SCIJT8 type=write size=3085362 2024-09-12T00:31:00.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.991+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~CA76AG1M7KNU.0 size=1048576 2024-09-12T00:31:00.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.992+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~CA76AG1M7KNU.1 size=370701 2024-09-12T00:31:00.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.994+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=CA76AG1M7KNU tag=JC091KBTVIDQ type=write size=2467853 2024-09-12T00:31:00.994 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.996+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=EGH64R8JD53K type=del size=1312485 2024-09-12T00:31:00.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.997+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~NLYSYMJAU31X.0 size=1048576 2024-09-12T00:31:00.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:00.998+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~NLYSYMJAU31X.1 size=1048576 2024-09-12T00:31:00.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.000+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~NLYSYMJAU31X.2 size=966974 2024-09-12T00:31:01.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.002+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=NLYSYMJAU31X tag=2AW6A5CEIU23 type=write size=4112702 2024-09-12T00:31:01.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.004+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=IPO7QXSQ8OQW type=del size=868174 2024-09-12T00:31:01.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.005+0000 7f0362c73780 1 < canceled operation key=HEN9LUUIDAR5 tag=2BFV55IPIDJ6 type=write size=940495 2024-09-12T00:31:01.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.007+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=7K7AH61H43DM type=del size=3142317 2024-09-12T00:31:01.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.009+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=8YHD6Q4681DG type=del 2024-09-12T00:31:01.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.011+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=N1DQVQE2X4ML type=del size=452118 2024-09-12T00:31:01.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.014+0000 7f0362c73780 1 < suggested update operation key=HEN9LUUIDAR5 tag=F7VOD8V3DTEU type=del size=4162378 2024-09-12T00:31:01.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.016+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=A5KPMF7A6SHU type=del size=824979 2024-09-12T00:31:01.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.017+0000 7f0362c73780 1 < completed write operation key=927NCYXX8Z2P tag=LUG3X527HRGQ type=write size=701001 2024-09-12T00:31:01.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.020+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~VNL8A13BHPEI.0 size=1048576 2024-09-12T00:31:01.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.021+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~VNL8A13BHPEI.1 size=1048576 2024-09-12T00:31:01.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.023+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~VNL8A13BHPEI.2 size=696454 2024-09-12T00:31:01.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.023+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=VNL8A13BHPEI tag=G2AJ8H20WZ4G type=write size=3842182 2024-09-12T00:31:01.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.024+0000 7f0362c73780 1 < completed write operation key=1UUNRPUKAINC tag=SHAQY1GU3QY5 type=write size=8144 2024-09-12T00:31:01.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.026+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=QC1043ITWYOD type=del size=1650806 2024-09-12T00:31:01.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.028+0000 7f0362c73780 1 < canceled operation key=KWDEKRO3WICD tag=5HEXLS879TVA type=del size=2815195 2024-09-12T00:31:01.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.029+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=1UFKG33H171L type=del size=2421216 2024-09-12T00:31:01.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.031+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~WRIK50K232L4.0 size=1048576 2024-09-12T00:31:01.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.033+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~WRIK50K232L4.1 size=1048576 2024-09-12T00:31:01.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.034+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~WRIK50K232L4.2 size=635787 2024-09-12T00:31:01.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.036+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=WRIK50K232L4 tag=NOEO8AJVB0NB type=write size=3781515 2024-09-12T00:31:01.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.039+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~U9WICJFZDXOB.0 size=1048576 2024-09-12T00:31:01.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.040+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~U9WICJFZDXOB.1 size=1048576 2024-09-12T00:31:01.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.042+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~U9WICJFZDXOB.2 size=1041598 2024-09-12T00:31:01.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.042+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=U9WICJFZDXOB tag=J6BZ3WNEWC6U type=write size=4187326 2024-09-12T00:31:01.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.043+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~TJRKMVX22UQ9.0 size=1048576 2024-09-12T00:31:01.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.045+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~TJRKMVX22UQ9.1 size=809047 2024-09-12T00:31:01.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.047+0000 7f0362c73780 1 < completed multipart upload key=927NCYXX8Z2P upload=TJRKMVX22UQ9 tag=841ZRIT1M3VI type=write size=2906199 2024-09-12T00:31:01.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.049+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=1WP71E9AZVHL type=write size=238538 2024-09-12T00:31:01.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.050+0000 7f0362c73780 1 < completed write operation key=HWSQFSK29S0V tag=N139US9RZXDI type=write size=1013957 2024-09-12T00:31:01.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.052+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=C78N7B1ECAGV type=write size=12603 2024-09-12T00:31:01.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.054+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=1710KRIKEFM7 type=del 2024-09-12T00:31:01.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.056+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=EB39RKGM76XJ type=del size=1389263 2024-09-12T00:31:01.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.057+0000 7f0362c73780 1 < canceled operation key=1IPW8SJ6SSU2 tag=CYOBYP1VETK9 type=del size=754144 2024-09-12T00:31:01.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.060+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=BCBJV1B7RM7D type=del size=188059 2024-09-12T00:31:01.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.061+0000 7f0362c73780 1 < canceled part key=_multipart_CZHT9UQS34JU.2~GM6N8UZXZM33.0 size=1048576 2024-09-12T00:31:01.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.062+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~GM6N8UZXZM33.1 size=771744 2024-09-12T00:31:01.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.064+0000 7f0362c73780 1 < canceled multipart upload key=CZHT9UQS34JU upload=GM6N8UZXZM33 tag=PZFPM7Z1RHSZ type=write size=2868896 2024-09-12T00:31:01.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.067+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~OK71IL0UY8YR.0 size=1048576 2024-09-12T00:31:01.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.068+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~OK71IL0UY8YR.1 size=1048576 2024-09-12T00:31:01.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.069+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~OK71IL0UY8YR.2 size=935092 2024-09-12T00:31:01.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.069+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=OK71IL0UY8YR tag=LJFPDBH2F9F7 type=write size=4080820 2024-09-12T00:31:01.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.071+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=RKAY3PKGYE92 type=write size=120715 2024-09-12T00:31:01.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.073+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~6Z7607KH07NY.0 size=1048576 2024-09-12T00:31:01.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.074+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~6Z7607KH07NY.1 size=1048576 2024-09-12T00:31:01.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.076+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~6Z7607KH07NY.2 size=67069 2024-09-12T00:31:01.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.076+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=6Z7607KH07NY tag=H0EPJC6ZEB5A type=write size=3212797 2024-09-12T00:31:01.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.077+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~6IWJ1IZIB3HM.0 size=1048576 2024-09-12T00:31:01.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.078+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~6IWJ1IZIB3HM.1 size=988210 2024-09-12T00:31:01.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.081+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=6IWJ1IZIB3HM tag=LIKOH2SCIJT8 type=write size=3085362 2024-09-12T00:31:01.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.082+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=FQDB6TKXBQTM type=del size=257358 2024-09-12T00:31:01.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.085+0000 7f0362c73780 1 < suggested remove operation key=XWW3882YBHAJ tag=EGH64R8JD53K type=del 2024-09-12T00:31:01.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.088+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~NA3KP5FSJ0ZO.0 size=1048576 2024-09-12T00:31:01.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.089+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~NA3KP5FSJ0ZO.1 size=894736 2024-09-12T00:31:01.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.089+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=NA3KP5FSJ0ZO tag=G5ZMVNQVLPS9 type=write size=2991888 2024-09-12T00:31:01.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.090+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=IPO7QXSQ8OQW type=del 2024-09-12T00:31:01.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.092+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=I98ASR9RV3S5 type=del size=1499405 2024-09-12T00:31:01.092 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.093+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=7K7AH61H43DM type=del 2024-09-12T00:31:01.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.095+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=LHHC9MG1NV5H type=del size=2607266 2024-09-12T00:31:01.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.098+0000 7f0362c73780 1 < suggested update operation key=Q6M0D2698CUZ tag=N1DQVQE2X4ML type=del size=452118 2024-09-12T00:31:01.097 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.099+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=UNSZ3Y340VAH type=write size=608936 2024-09-12T00:31:01.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.100+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=A5KPMF7A6SHU type=del 2024-09-12T00:31:01.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.102+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=L8HLA4AVAD9M type=del size=3741084 2024-09-12T00:31:01.102 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.103+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~VNL8A13BHPEI.0 size=1048576 2024-09-12T00:31:01.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.104+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~VNL8A13BHPEI.1 size=1048576 2024-09-12T00:31:01.104 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.106+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~VNL8A13BHPEI.2 size=696454 2024-09-12T00:31:01.106 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.108+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=VNL8A13BHPEI tag=G2AJ8H20WZ4G type=write size=3842182 2024-09-12T00:31:01.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.109+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=4I9DQV2MRKO4 type=del size=3469585 2024-09-12T00:31:01.109 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.111+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=QC1043ITWYOD type=del 2024-09-12T00:31:01.111 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.113+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~V2WVTH9VRQOV.0 size=1048576 2024-09-12T00:31:01.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.114+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~V2WVTH9VRQOV.1 size=1048576 2024-09-12T00:31:01.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.115+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~V2WVTH9VRQOV.2 size=647982 2024-09-12T00:31:01.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.115+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=V2WVTH9VRQOV tag=S61P1E8VUHBT type=write size=3793710 2024-09-12T00:31:01.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.117+0000 7f0362c73780 1 < canceled operation key=1SE6WTQMW6JU tag=1UFKG33H171L type=del size=2421216 2024-09-12T00:31:01.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.118+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=ZXVLCT81NK3F type=del size=1597979 2024-09-12T00:31:01.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.120+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~U9WICJFZDXOB.0 size=1048576 2024-09-12T00:31:01.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.121+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~U9WICJFZDXOB.1 size=1048576 2024-09-12T00:31:01.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.122+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~U9WICJFZDXOB.2 size=1041598 2024-09-12T00:31:01.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.125+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=U9WICJFZDXOB tag=J6BZ3WNEWC6U type=write size=4187326 2024-09-12T00:31:01.124 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.126+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=6UIQ9OJVCCNY type=del size=717698 2024-09-12T00:31:01.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.129+0000 7f0362c73780 1 < suggested remove operation key=G4G6E7KTTZY9 tag=1WP71E9AZVHL type=write 2024-09-12T00:31:01.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.131+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=6W4KI0OGI7BE type=write size=893827 2024-09-12T00:31:01.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.132+0000 7f0362c73780 1 < completed write operation key=1UUNRPUKAINC tag=C78N7B1ECAGV type=write size=12603 2024-09-12T00:31:01.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.134+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=INW690BGZRBL type=del size=2603135 2024-09-12T00:31:01.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.135+0000 7f0362c73780 1 < completed delete operation key=PLAYMR18X9DZ tag=EB39RKGM76XJ type=del 2024-09-12T00:31:01.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.138+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~E9FHS6AZFLLV.0 size=1041411 2024-09-12T00:31:01.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.138+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=E9FHS6AZFLLV tag=1F87GXELMXT0 type=write size=2089987 2024-09-12T00:31:01.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.139+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=BCBJV1B7RM7D type=del 2024-09-12T00:31:01.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.142+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~DCAOTB2SQ6SS.0 size=1048576 2024-09-12T00:31:01.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.143+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~DCAOTB2SQ6SS.1 size=1048576 2024-09-12T00:31:01.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.144+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~DCAOTB2SQ6SS.2 size=426710 2024-09-12T00:31:01.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.144+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=DCAOTB2SQ6SS tag=DVFF7MQQL0ZL type=write size=3572438 2024-09-12T00:31:01.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.145+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~OK71IL0UY8YR.0 size=1048576 2024-09-12T00:31:01.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.145+0000 7f0362c73780 1 < canceled part key=_multipart_G2HW98G6624O.2~OK71IL0UY8YR.1 size=1048576 2024-09-12T00:31:01.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.146+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~OK71IL0UY8YR.2 size=935092 2024-09-12T00:31:01.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.149+0000 7f0362c73780 1 < canceled multipart upload key=G2HW98G6624O upload=OK71IL0UY8YR tag=LJFPDBH2F9F7 type=write size=4080820 2024-09-12T00:31:01.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.151+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~I1KR8RPTJZBO.0 size=1048576 2024-09-12T00:31:01.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.152+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~I1KR8RPTJZBO.1 size=1048576 2024-09-12T00:31:01.151 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.153+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~I1KR8RPTJZBO.2 size=352265 2024-09-12T00:31:01.151 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.153+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=I1KR8RPTJZBO tag=N5D1F73ZEDO6 type=write size=3497993 2024-09-12T00:31:01.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.155+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~6Z7607KH07NY.0 size=1048576 2024-09-12T00:31:01.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.156+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~6Z7607KH07NY.1 size=1048576 2024-09-12T00:31:01.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.157+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~6Z7607KH07NY.2 size=67069 2024-09-12T00:31:01.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.159+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=6Z7607KH07NY tag=H0EPJC6ZEB5A type=write size=3212797 2024-09-12T00:31:01.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.161+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=PTUJWTL3O7T6 type=del size=3116572 2024-09-12T00:31:01.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.162+0000 7f0362c73780 1 < canceled operation key=3XZZX53L26G5 tag=FQDB6TKXBQTM type=del size=257358 2024-09-12T00:31:01.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.165+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~Z2BFD9J4182L.0 size=1048576 2024-09-12T00:31:01.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.166+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~Z2BFD9J4182L.1 size=1048576 2024-09-12T00:31:01.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.167+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~Z2BFD9J4182L.2 size=409668 2024-09-12T00:31:01.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.167+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=Z2BFD9J4182L tag=67JYRBT4J4VO type=write size=3555396 2024-09-12T00:31:01.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.168+0000 7f0362c73780 1 < canceled part key=_multipart_WT0185G517YR.2~NA3KP5FSJ0ZO.0 size=1048576 2024-09-12T00:31:01.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.169+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~NA3KP5FSJ0ZO.1 size=894736 2024-09-12T00:31:01.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.172+0000 7f0362c73780 1 < canceled multipart upload key=WT0185G517YR upload=NA3KP5FSJ0ZO tag=G5ZMVNQVLPS9 type=write size=2991888 2024-09-12T00:31:01.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.173+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=M6XG7HKOL9OX type=write size=311907 2024-09-12T00:31:01.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.175+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=I98ASR9RV3S5 type=del 2024-09-12T00:31:01.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.176+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=DT2BB86ELPM0 type=del size=1847764 2024-09-12T00:31:01.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.178+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=LHHC9MG1NV5H type=del 2024-09-12T00:31:01.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.179+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=CONHRTJRYPYX type=del size=3099611 2024-09-12T00:31:01.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.182+0000 7f0362c73780 1 < suggested update operation key=1IPW8SJ6SSU2 tag=UNSZ3Y340VAH type=write size=608936 2024-09-12T00:31:01.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.185+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~D66PAC9M7HOA.0 size=1048576 2024-09-12T00:31:01.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.186+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~D66PAC9M7HOA.1 size=1048576 2024-09-12T00:31:01.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.187+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~D66PAC9M7HOA.2 size=941207 2024-09-12T00:31:01.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.187+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=D66PAC9M7HOA tag=6QZ6X4EGA76O type=write size=4086935 2024-09-12T00:31:01.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.189+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=L8HLA4AVAD9M type=del 2024-09-12T00:31:01.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.190+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=UBC4XSZ5ISU3 type=del size=3972616 2024-09-12T00:31:01.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.192+0000 7f0362c73780 -1 < failed to complete operation key=1IPW8SJ6SSU2 tag=4I9DQV2MRKO4 type=del size=3469585: (22) Invalid argument 2024-09-12T00:31:01.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.194+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=4HAF4ODHYAAS type=del size=1300422 2024-09-12T00:31:01.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.196+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~V2WVTH9VRQOV.0 size=1048576 2024-09-12T00:31:01.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.197+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~V2WVTH9VRQOV.1 size=1048576 2024-09-12T00:31:01.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.198+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~V2WVTH9VRQOV.2 size=647982 2024-09-12T00:31:01.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.201+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=V2WVTH9VRQOV tag=S61P1E8VUHBT type=write size=3793710 2024-09-12T00:31:01.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.202+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=9W7UHKK2J4B3 type=del size=2942681 2024-09-12T00:31:01.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.204+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=ZXVLCT81NK3F type=del 2024-09-12T00:31:01.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.207+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~S4PJ1AJLH525.0 size=1048576 2024-09-12T00:31:01.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.208+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~S4PJ1AJLH525.1 size=1048576 2024-09-12T00:31:01.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.209+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~S4PJ1AJLH525.2 size=212272 2024-09-12T00:31:01.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.209+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=S4PJ1AJLH525 tag=2A7XMO848XWV type=write size=3358000 2024-09-12T00:31:01.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.211+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=6UIQ9OJVCCNY type=del 2024-09-12T00:31:01.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.212+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=XYJAAS14AVCT type=del size=3208766 2024-09-12T00:31:01.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.214+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=6W4KI0OGI7BE type=write size=893827 2024-09-12T00:31:01.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.216+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=WSSUZX6S14B5 type=del size=1112625 2024-09-12T00:31:01.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.217+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=INW690BGZRBL type=del 2024-09-12T00:31:01.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.219+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=RDKQLK9HMM0A type=del size=176912 2024-09-12T00:31:01.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.220+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~E9FHS6AZFLLV.0 size=1041411 2024-09-12T00:31:01.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.223+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=E9FHS6AZFLLV tag=1F87GXELMXT0 type=write size=2089987 2024-09-12T00:31:01.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.226+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~FZ71Y5U3E314.0 size=1048576 2024-09-12T00:31:01.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.227+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~FZ71Y5U3E314.1 size=1048576 2024-09-12T00:31:01.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.228+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~FZ71Y5U3E314.2 size=329398 2024-09-12T00:31:01.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.228+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=FZ71Y5U3E314 tag=85IXKBWHZSM6 type=write size=3475126 2024-09-12T00:31:01.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.229+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~DCAOTB2SQ6SS.0 size=1048576 2024-09-12T00:31:01.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.231+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~DCAOTB2SQ6SS.1 size=1048576 2024-09-12T00:31:01.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.232+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~DCAOTB2SQ6SS.2 size=426710 2024-09-12T00:31:01.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.235+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=DCAOTB2SQ6SS tag=DVFF7MQQL0ZL type=write size=3572438 2024-09-12T00:31:01.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.237+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~2FEAVLZKZTMB.0 size=1048576 2024-09-12T00:31:01.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.238+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~2FEAVLZKZTMB.1 size=1048576 2024-09-12T00:31:01.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.240+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~2FEAVLZKZTMB.2 size=59614 2024-09-12T00:31:01.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.240+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=2FEAVLZKZTMB tag=EMHUWKEFDY8P type=write size=3205342 2024-09-12T00:31:01.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.240+0000 7f0362c73780 1 < canceled part key=_multipart_J5GSZCJW2BP1.2~I1KR8RPTJZBO.0 size=1048576 2024-09-12T00:31:01.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.241+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~I1KR8RPTJZBO.1 size=1048576 2024-09-12T00:31:01.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.243+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~I1KR8RPTJZBO.2 size=352265 2024-09-12T00:31:01.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.245+0000 7f0362c73780 1 < canceled multipart upload key=J5GSZCJW2BP1 upload=I1KR8RPTJZBO tag=N5D1F73ZEDO6 type=write size=3497993 2024-09-12T00:31:01.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.246+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=98JE4QWZWMSG type=del size=2942789 2024-09-12T00:31:01.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.248+0000 7f0362c73780 -1 < failed to complete operation key=1IPW8SJ6SSU2 tag=PTUJWTL3O7T6 type=del size=3116572: (22) Invalid argument 2024-09-12T00:31:01.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.249+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=SUIR6GDOTI0H type=del size=222597 2024-09-12T00:31:01.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.250+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~Z2BFD9J4182L.0 size=1048576 2024-09-12T00:31:01.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.251+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~Z2BFD9J4182L.1 size=1048576 2024-09-12T00:31:01.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.253+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~Z2BFD9J4182L.2 size=409668 2024-09-12T00:31:01.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.255+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=Z2BFD9J4182L tag=67JYRBT4J4VO type=write size=3555396 2024-09-12T00:31:01.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.258+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~NC87IQTC6ASA.0 size=1048576 2024-09-12T00:31:01.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.259+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~NC87IQTC6ASA.1 size=1048576 2024-09-12T00:31:01.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.260+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~NC87IQTC6ASA.2 size=6826 2024-09-12T00:31:01.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.260+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=NC87IQTC6ASA tag=9BE2G7EY8HFM type=write size=3152554 2024-09-12T00:31:01.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.261+0000 7f0362c73780 1 < completed write operation key=44YJP6XPIFT5 tag=M6XG7HKOL9OX type=write size=311907 2024-09-12T00:31:01.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.264+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~CLNBHG0P0QP6.0 size=91724 2024-09-12T00:31:01.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.264+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=CLNBHG0P0QP6 tag=PWZT4KLS726J type=write size=1140300 2024-09-12T00:31:01.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.265+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=DT2BB86ELPM0 type=del 2024-09-12T00:31:01.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.267+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=92BLG1TV20DW type=del size=401680 2024-09-12T00:31:01.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.269+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=CONHRTJRYPYX type=del 2024-09-12T00:31:01.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.271+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~644M61G6EWVB.0 size=706391 2024-09-12T00:31:01.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.271+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=644M61G6EWVB tag=KHB14GC4N5WK type=write size=1754967 2024-09-12T00:31:01.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.273+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~D66PAC9M7HOA.0 size=1048576 2024-09-12T00:31:01.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.274+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~D66PAC9M7HOA.1 size=1048576 2024-09-12T00:31:01.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.275+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~D66PAC9M7HOA.2 size=941207 2024-09-12T00:31:01.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.278+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=D66PAC9M7HOA tag=6QZ6X4EGA76O type=write size=4086935 2024-09-12T00:31:01.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.280+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~YMUTKVIRUL0I.0 size=1036722 2024-09-12T00:31:01.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.280+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=YMUTKVIRUL0I tag=22B06YLWGT4H type=write size=2085298 2024-09-12T00:31:01.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.282+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=UBC4XSZ5ISU3 type=del 2024-09-12T00:31:01.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.285+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~J2VBOUK4UJM8.0 size=1048576 2024-09-12T00:31:01.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.286+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~J2VBOUK4UJM8.1 size=1048576 2024-09-12T00:31:01.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.287+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~J2VBOUK4UJM8.2 size=293569 2024-09-12T00:31:01.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.287+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=J2VBOUK4UJM8 tag=73EOMKBDZ9QI type=write size=3439297 2024-09-12T00:31:01.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.289+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=4HAF4ODHYAAS type=del 2024-09-12T00:31:01.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.291+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~STKKMAILYPBW.0 size=1048576 2024-09-12T00:31:01.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.294+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~STKKMAILYPBW.1 size=641819 2024-09-12T00:31:01.293 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.294+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=STKKMAILYPBW tag=D5AFRYXBIY32 type=write size=2738971 2024-09-12T00:31:01.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.296+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=9W7UHKK2J4B3 type=del 2024-09-12T00:31:01.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.297+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=AMQRF5L4QWV3 type=del size=1254294 2024-09-12T00:31:01.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.299+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~S4PJ1AJLH525.0 size=1048576 2024-09-12T00:31:01.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.300+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~S4PJ1AJLH525.1 size=1048576 2024-09-12T00:31:01.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.301+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~S4PJ1AJLH525.2 size=212272 2024-09-12T00:31:01.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.304+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=S4PJ1AJLH525 tag=2A7XMO848XWV type=write size=3358000 2024-09-12T00:31:01.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.305+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=5BR6GHG2D3W8 type=del size=3319530 2024-09-12T00:31:01.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.307+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=XYJAAS14AVCT type=del 2024-09-12T00:31:01.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.308+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=KUIDVOU0W7PL type=del size=2221749 2024-09-12T00:31:01.308 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.310+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=WSSUZX6S14B5 type=del 2024-09-12T00:31:01.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.311+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=ZE7O5QJAMDL7 type=del size=2343084 2024-09-12T00:31:01.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.313+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=RDKQLK9HMM0A type=del 2024-09-12T00:31:01.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.316+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~UGCUFM5FI7M4.0 size=279590 2024-09-12T00:31:01.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.316+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=UGCUFM5FI7M4 tag=CGL73UMICLKT type=write size=1328166 2024-09-12T00:31:01.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.317+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~FZ71Y5U3E314.0 size=1048576 2024-09-12T00:31:01.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.319+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~FZ71Y5U3E314.1 size=1048576 2024-09-12T00:31:01.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.319+0000 7f0362c73780 1 < canceled part key=_multipart_1MLL1T362X51.2~FZ71Y5U3E314.2 size=329398 2024-09-12T00:31:01.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.321+0000 7f0362c73780 1 < canceled multipart upload key=1MLL1T362X51 upload=FZ71Y5U3E314 tag=85IXKBWHZSM6 type=write size=3475126 2024-09-12T00:31:01.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.322+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=1DEET3WHBEV8 type=del size=979776 2024-09-12T00:31:01.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.324+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~2FEAVLZKZTMB.0 size=1048576 2024-09-12T00:31:01.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.325+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~2FEAVLZKZTMB.1 size=1048576 2024-09-12T00:31:01.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.326+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~2FEAVLZKZTMB.2 size=59614 2024-09-12T00:31:01.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.328+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=2FEAVLZKZTMB tag=EMHUWKEFDY8P type=write size=3205342 2024-09-12T00:31:01.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.330+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=5WCES6KSQXYF type=del size=501193 2024-09-12T00:31:01.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.333+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=98JE4QWZWMSG type=del 2024-09-12T00:31:01.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.335+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~1RWEZXKDFXUM.0 size=782480 2024-09-12T00:31:01.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.335+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=1RWEZXKDFXUM tag=Z9SN39WQSPR1 type=write size=1831056 2024-09-12T00:31:01.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.337+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=SUIR6GDOTI0H type=del 2024-09-12T00:31:01.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.340+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~QCDCVHL7BEAH.0 size=923066 2024-09-12T00:31:01.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.340+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=QCDCVHL7BEAH tag=93SQ2TPJFGTE type=write size=1971642 2024-09-12T00:31:01.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.341+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~NC87IQTC6ASA.0 size=1048576 2024-09-12T00:31:01.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.341+0000 7f0362c73780 1 < canceled part key=_multipart_PLAYMR18X9DZ.2~NC87IQTC6ASA.1 size=1048576 2024-09-12T00:31:01.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.342+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~NC87IQTC6ASA.2 size=6826 2024-09-12T00:31:01.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.344+0000 7f0362c73780 1 < canceled multipart upload key=PLAYMR18X9DZ upload=NC87IQTC6ASA tag=9BE2G7EY8HFM type=write size=3152554 2024-09-12T00:31:01.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.347+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~2RO7A8RM4AIV.0 size=1048576 2024-09-12T00:31:01.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.348+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~2RO7A8RM4AIV.1 size=572143 2024-09-12T00:31:01.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.348+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=2RO7A8RM4AIV tag=4UZ0UEB0VNOH type=write size=2669295 2024-09-12T00:31:01.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.350+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~CLNBHG0P0QP6.0 size=91724 2024-09-12T00:31:01.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.352+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=CLNBHG0P0QP6 tag=PWZT4KLS726J type=write size=1140300 2024-09-12T00:31:01.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.355+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~KPK9Q94XXW9Q.0 size=608801 2024-09-12T00:31:01.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.355+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=KPK9Q94XXW9Q tag=GO1CQ5DRFN9H type=write size=1657377 2024-09-12T00:31:01.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.356+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=92BLG1TV20DW type=del 2024-09-12T00:31:01.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.358+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=E8MFJBLLQODT type=del size=1570045 2024-09-12T00:31:01.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.359+0000 7f0362c73780 1 < canceled part key=_multipart_VD0LFCNLI1YI.2~644M61G6EWVB.0 size=706391 2024-09-12T00:31:01.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.361+0000 7f0362c73780 1 < canceled multipart upload key=VD0LFCNLI1YI upload=644M61G6EWVB tag=KHB14GC4N5WK type=write size=1754967 2024-09-12T00:31:01.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.362+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=2HZF8LVZSQIM type=del size=2923910 2024-09-12T00:31:01.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.364+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~YMUTKVIRUL0I.0 size=1036722 2024-09-12T00:31:01.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.366+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=YMUTKVIRUL0I tag=22B06YLWGT4H type=write size=2085298 2024-09-12T00:31:01.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.367+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=28V7A4ATMCD8 type=del size=1437309 2024-09-12T00:31:01.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.369+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~J2VBOUK4UJM8.0 size=1048576 2024-09-12T00:31:01.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.370+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~J2VBOUK4UJM8.1 size=1048576 2024-09-12T00:31:01.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.371+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~J2VBOUK4UJM8.2 size=293569 2024-09-12T00:31:01.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.374+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=J2VBOUK4UJM8 tag=73EOMKBDZ9QI type=write size=3439297 2024-09-12T00:31:01.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.376+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=9C4XSRQ0QH2B type=del size=1267834 2024-09-12T00:31:01.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.378+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~STKKMAILYPBW.0 size=1048576 2024-09-12T00:31:01.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.379+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~STKKMAILYPBW.1 size=641819 2024-09-12T00:31:01.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.381+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=STKKMAILYPBW tag=D5AFRYXBIY32 type=write size=2738971 2024-09-12T00:31:01.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.383+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=EIJTOO6E2E92 type=del size=2824593 2024-09-12T00:31:01.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.384+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=AMQRF5L4QWV3 type=del 2024-09-12T00:31:01.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.387+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~506QGNK0KK5W.0 size=1048576 2024-09-12T00:31:01.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.388+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~506QGNK0KK5W.1 size=847329 2024-09-12T00:31:01.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.388+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=506QGNK0KK5W tag=VZV3VSDKJ7GS type=write size=2944481 2024-09-12T00:31:01.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.390+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=5BR6GHG2D3W8 type=del 2024-09-12T00:31:01.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.391+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=83HK3E7S7LLS type=del size=1175682 2024-09-12T00:31:01.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.393+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=KUIDVOU0W7PL type=del 2024-09-12T00:31:01.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.394+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=Y6BXNCY5FKO7 type=del size=3728132 2024-09-12T00:31:01.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.396+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=ZE7O5QJAMDL7 type=del 2024-09-12T00:31:01.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.397+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=ZLZOMUMIJLTJ type=del size=2967753 2024-09-12T00:31:01.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.398+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~UGCUFM5FI7M4.0 size=279590 2024-09-12T00:31:01.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.401+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=UGCUFM5FI7M4 tag=CGL73UMICLKT type=write size=1328166 2024-09-12T00:31:01.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.403+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=IOR6O904D97S type=write size=139016 2024-09-12T00:31:01.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.404+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=1DEET3WHBEV8 type=del 2024-09-12T00:31:01.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.406+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=PIGK9DNG3AY5 type=write size=31435 2024-09-12T00:31:01.406 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.407+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=5WCES6KSQXYF type=del 2024-09-12T00:31:01.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.409+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=R656QJBU1S14 type=del size=1646606 2024-09-12T00:31:01.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.410+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~1RWEZXKDFXUM.0 size=782480 2024-09-12T00:31:01.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.413+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=1RWEZXKDFXUM tag=Z9SN39WQSPR1 type=write size=1831056 2024-09-12T00:31:01.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.414+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=ICFKQNJEFBVG type=del size=3926733 2024-09-12T00:31:01.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.414+0000 7f0362c73780 1 < canceled part key=_multipart_PLAYMR18X9DZ.2~QCDCVHL7BEAH.0 size=923066 2024-09-12T00:31:01.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.417+0000 7f0362c73780 1 < canceled multipart upload key=PLAYMR18X9DZ upload=QCDCVHL7BEAH tag=93SQ2TPJFGTE type=write size=1971642 2024-09-12T00:31:01.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.418+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=YQ30Y9Y7UU4Q type=del size=2020678 2024-09-12T00:31:01.418 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.420+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~2RO7A8RM4AIV.0 size=1048576 2024-09-12T00:31:01.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.421+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~2RO7A8RM4AIV.1 size=572143 2024-09-12T00:31:01.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.424+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=2RO7A8RM4AIV tag=4UZ0UEB0VNOH type=write size=2669295 2024-09-12T00:31:01.424 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.426+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=WAQCN4VQO2E2 type=del size=3432547 2024-09-12T00:31:01.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.427+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~KPK9Q94XXW9Q.0 size=608801 2024-09-12T00:31:01.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.430+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=KPK9Q94XXW9Q tag=GO1CQ5DRFN9H type=write size=1657377 2024-09-12T00:31:01.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.432+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=J83U1381MPM6 type=del size=1355437 2024-09-12T00:31:01.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.434+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=E8MFJBLLQODT type=del 2024-09-12T00:31:01.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.435+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=D03R7SFUQ0XN type=del size=608114 2024-09-12T00:31:01.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.437+0000 7f0362c73780 1 < canceled operation key=R4ABY5AY0S1P tag=2HZF8LVZSQIM type=del size=2923910 2024-09-12T00:31:01.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.439+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=WB70EJUDPALW type=write size=122728 2024-09-12T00:31:01.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.440+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=28V7A4ATMCD8 type=del 2024-09-12T00:31:01.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.442+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=SNNCLWO9LN0U type=write size=556764 2024-09-12T00:31:01.442 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.443+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=9C4XSRQ0QH2B type=del 2024-09-12T00:31:01.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.446+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~0FJ5EBC3H7YJ.0 size=1048576 2024-09-12T00:31:01.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.448+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~0FJ5EBC3H7YJ.1 size=1048576 2024-09-12T00:31:01.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.449+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~0FJ5EBC3H7YJ.2 size=765189 2024-09-12T00:31:01.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.449+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=0FJ5EBC3H7YJ tag=TH2YBZI00MKF type=write size=3910917 2024-09-12T00:31:01.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.450+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=EIJTOO6E2E92 type=del 2024-09-12T00:31:01.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.452+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=NQ0D9CRX597N type=del size=3605686 2024-09-12T00:31:01.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.453+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~506QGNK0KK5W.0 size=1048576 2024-09-12T00:31:01.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.454+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~506QGNK0KK5W.1 size=847329 2024-09-12T00:31:01.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.457+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=506QGNK0KK5W tag=VZV3VSDKJ7GS type=write size=2944481 2024-09-12T00:31:01.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.460+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~O3J0C7VQQ9GR.0 size=399751 2024-09-12T00:31:01.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.460+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=O3J0C7VQQ9GR tag=O0CGPREPP3YV type=write size=1448327 2024-09-12T00:31:01.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.462+0000 7f0362c73780 1 < suggested remove operation key=R4ABY5AY0S1P tag=83HK3E7S7LLS type=del 2024-09-12T00:31:01.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.465+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~9TO6XEN17UEY.0 size=637016 2024-09-12T00:31:01.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.465+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=9TO6XEN17UEY tag=D629RSFYW1HF type=write size=1685592 2024-09-12T00:31:01.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.468+0000 7f0362c73780 1 < suggested update operation key=XR8L0HL374VC tag=Y6BXNCY5FKO7 type=del size=3728132 2024-09-12T00:31:01.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.469+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=3A20ELTAHX48 type=write size=908436 2024-09-12T00:31:01.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.471+0000 7f0362c73780 1 < canceled operation key=YTN99RBTKO39 tag=ZLZOMUMIJLTJ type=del size=2967753 2024-09-12T00:31:01.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.474+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~X57B7MGLUHD8.0 size=1048576 2024-09-12T00:31:01.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.475+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~X57B7MGLUHD8.1 size=1048576 2024-09-12T00:31:01.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.476+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~X57B7MGLUHD8.2 size=290325 2024-09-12T00:31:01.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.476+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=X57B7MGLUHD8 tag=QQEQRNAR7QA4 type=write size=3436053 2024-09-12T00:31:01.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.478+0000 7f0362c73780 1 < completed write operation key=HEN9LUUIDAR5 tag=IOR6O904D97S type=write size=139016 2024-09-12T00:31:01.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.479+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=U0VGPHKEOYWA type=write size=50416 2024-09-12T00:31:01.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.481+0000 7f0362c73780 1 < completed write operation key=EHBOL435W9ZE tag=PIGK9DNG3AY5 type=write size=31435 2024-09-12T00:31:01.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.483+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~FRJG0SBOYKVP.0 size=1048576 2024-09-12T00:31:01.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.484+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~FRJG0SBOYKVP.1 size=1048576 2024-09-12T00:31:01.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.485+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~FRJG0SBOYKVP.2 size=992599 2024-09-12T00:31:01.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.485+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=FRJG0SBOYKVP tag=D1IZRGM7PBSB type=write size=4138327 2024-09-12T00:31:01.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.487+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=R656QJBU1S14 type=del 2024-09-12T00:31:01.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.489+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=3PMEKSVD2466 type=del size=952035 2024-09-12T00:31:01.489 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.491+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=ICFKQNJEFBVG type=del 2024-09-12T00:31:01.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.494+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~32O20784X0Z5.0 size=1048576 2024-09-12T00:31:01.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.495+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~32O20784X0Z5.1 size=1048576 2024-09-12T00:31:01.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.496+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~32O20784X0Z5.2 size=177119 2024-09-12T00:31:01.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.496+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=32O20784X0Z5 tag=DMYP6UJ5WGJK type=write size=3322847 2024-09-12T00:31:01.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.498+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=YQ30Y9Y7UU4Q type=del 2024-09-12T00:31:01.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.499+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=07M1R46T03D2 type=del size=3221321 2024-09-12T00:31:01.501 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.501+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=WAQCN4VQO2E2 type=del 2024-09-12T00:31:01.501 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.503+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=KBJUYSFHRV0M type=del size=1441329 2024-09-12T00:31:01.504 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.506+0000 7f0362c73780 1 < suggested remove operation key=2DHHPBYV80O8 tag=J83U1381MPM6 type=del 2024-09-12T00:31:01.506 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.507+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=LTZY2UKYA3XY type=write size=197260 2024-09-12T00:31:01.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.509+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=D03R7SFUQ0XN type=del 2024-09-12T00:31:01.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.510+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=QK9K7RR01EHO type=del size=3586865 2024-09-12T00:31:01.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.512+0000 7f0362c73780 1 < completed write operation key=I3B48QD9E40S tag=WB70EJUDPALW type=write size=122728 2024-09-12T00:31:01.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.514+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~2MHNM5QJLN9N.0 size=1048576 2024-09-12T00:31:01.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.515+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~2MHNM5QJLN9N.1 size=1048576 2024-09-12T00:31:01.515 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.517+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~2MHNM5QJLN9N.2 size=169859 2024-09-12T00:31:01.515 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.517+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=2MHNM5QJLN9N tag=YPHLE5RTAM4X type=write size=3315587 2024-09-12T00:31:01.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.518+0000 7f0362c73780 1 < completed write operation key=XWW3882YBHAJ tag=SNNCLWO9LN0U type=write size=556764 2024-09-12T00:31:01.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.521+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~7ANOFMWA4P08.0 size=1048576 2024-09-12T00:31:01.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.522+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~7ANOFMWA4P08.1 size=223746 2024-09-12T00:31:01.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.522+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=7ANOFMWA4P08 tag=X0N2VVPR1F23 type=write size=2320898 2024-09-12T00:31:01.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.523+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~0FJ5EBC3H7YJ.0 size=1048576 2024-09-12T00:31:01.523 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.524+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~0FJ5EBC3H7YJ.1 size=1048576 2024-09-12T00:31:01.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.526+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~0FJ5EBC3H7YJ.2 size=765189 2024-09-12T00:31:01.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.528+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=0FJ5EBC3H7YJ tag=TH2YBZI00MKF type=write size=3910917 2024-09-12T00:31:01.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.530+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=TUIN3976GKZJ type=del size=2034776 2024-09-12T00:31:01.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.532+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=NQ0D9CRX597N type=del 2024-09-12T00:31:01.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.534+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=WX9N7O0KBHIO type=del size=11406 2024-09-12T00:31:01.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.535+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~O3J0C7VQQ9GR.0 size=399751 2024-09-12T00:31:01.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.538+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=O3J0C7VQQ9GR tag=O0CGPREPP3YV type=write size=1448327 2024-09-12T00:31:01.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.541+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~8AA0HRGJX6SB.0 size=562179 2024-09-12T00:31:01.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.541+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=8AA0HRGJX6SB tag=5A8B70LG7PFW type=write size=1610755 2024-09-12T00:31:01.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.543+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~9TO6XEN17UEY.0 size=637016 2024-09-12T00:31:01.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.545+0000 7f0362c73780 1 < completed multipart upload key=927NCYXX8Z2P upload=9TO6XEN17UEY tag=D629RSFYW1HF type=write size=1685592 2024-09-12T00:31:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.548+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~6O7OND1Z0LY3.0 size=461287 2024-09-12T00:31:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.548+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=6O7OND1Z0LY3 tag=V3SGJVT0YB0O type=write size=1509863 2024-09-12T00:31:01.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.550+0000 7f0362c73780 1 < completed write operation key=1SE6WTQMW6JU tag=3A20ELTAHX48 type=write size=908436 2024-09-12T00:31:01.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.552+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~UMAMWC4M8CF6.0 size=1048576 2024-09-12T00:31:01.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.554+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~UMAMWC4M8CF6.1 size=369737 2024-09-12T00:31:01.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.554+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=UMAMWC4M8CF6 tag=VC8RVXTVL7NB type=write size=2466889 2024-09-12T00:31:01.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.555+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~X57B7MGLUHD8.0 size=1048576 2024-09-12T00:31:01.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.556+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~X57B7MGLUHD8.1 size=1048576 2024-09-12T00:31:01.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.556+0000 7f0362c73780 1 < canceled part key=_multipart_EHBOL435W9ZE.2~X57B7MGLUHD8.2 size=290325 2024-09-12T00:31:01.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.559+0000 7f0362c73780 1 < canceled multipart upload key=EHBOL435W9ZE upload=X57B7MGLUHD8 tag=QQEQRNAR7QA4 type=write size=3436053 2024-09-12T00:31:01.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.562+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~335TI47A0PKH.0 size=1048576 2024-09-12T00:31:01.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.563+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~335TI47A0PKH.1 size=285699 2024-09-12T00:31:01.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.563+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=335TI47A0PKH tag=ZWZH46YGYO0F type=write size=2382851 2024-09-12T00:31:01.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.564+0000 7f0362c73780 1 < completed write operation key=X4ZML0796M7F tag=U0VGPHKEOYWA type=write size=50416 2024-09-12T00:31:01.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.567+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~JKZ3UYSAACHT.0 size=1048576 2024-09-12T00:31:01.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.568+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~JKZ3UYSAACHT.1 size=645367 2024-09-12T00:31:01.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.568+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=JKZ3UYSAACHT tag=NY5RMRLWX1HM type=write size=2742519 2024-09-12T00:31:01.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.569+0000 7f0362c73780 1 < canceled part key=_multipart_J5GSZCJW2BP1.2~FRJG0SBOYKVP.0 size=1048576 2024-09-12T00:31:01.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.570+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~FRJG0SBOYKVP.1 size=1048576 2024-09-12T00:31:01.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.571+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~FRJG0SBOYKVP.2 size=992599 2024-09-12T00:31:01.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.573+0000 7f0362c73780 1 < canceled multipart upload key=J5GSZCJW2BP1 upload=FRJG0SBOYKVP tag=D1IZRGM7PBSB type=write size=4138327 2024-09-12T00:31:01.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.576+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~TJJKG0RV5OYV.0 size=1048576 2024-09-12T00:31:01.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.578+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~TJJKG0RV5OYV.1 size=1044490 2024-09-12T00:31:01.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.578+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=TJJKG0RV5OYV tag=WWIO3MTMJHFC type=write size=3141642 2024-09-12T00:31:01.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.581+0000 7f0362c73780 1 < suggested remove operation key=1SE6WTQMW6JU tag=3PMEKSVD2466 type=del 2024-09-12T00:31:01.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.582+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=KG5UKSZFVT3A type=write size=987764 2024-09-12T00:31:01.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.584+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~32O20784X0Z5.0 size=1048576 2024-09-12T00:31:01.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.585+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~32O20784X0Z5.1 size=1048576 2024-09-12T00:31:01.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.585+0000 7f0362c73780 1 < canceled part key=_multipart_CZHT9UQS34JU.2~32O20784X0Z5.2 size=177119 2024-09-12T00:31:01.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.587+0000 7f0362c73780 1 < canceled multipart upload key=CZHT9UQS34JU upload=32O20784X0Z5 tag=DMYP6UJ5WGJK type=write size=3322847 2024-09-12T00:31:01.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.589+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=SR9R09HOCQS9 type=del size=2473024 2024-09-12T00:31:01.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.592+0000 7f0362c73780 1 < suggested remove operation key=927NCYXX8Z2P tag=07M1R46T03D2 type=del 2024-09-12T00:31:01.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.594+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=TDNFQKBBJUXB type=del size=3432539 2024-09-12T00:31:01.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.595+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=KBJUYSFHRV0M type=del 2024-09-12T00:31:01.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.597+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=NS6EOYMI1IPX type=del size=3511545 2024-09-12T00:31:01.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.599+0000 7f0362c73780 1 < completed write operation key=84T1VJG5SHU4 tag=LTZY2UKYA3XY type=write size=197260 2024-09-12T00:31:01.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.601+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~G7NLBZ7TMEDO.0 size=1048576 2024-09-12T00:31:01.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.603+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~G7NLBZ7TMEDO.1 size=1048576 2024-09-12T00:31:01.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.604+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~G7NLBZ7TMEDO.2 size=166380 2024-09-12T00:31:01.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.604+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=G7NLBZ7TMEDO tag=FS78J685ZBCM type=write size=3312108 2024-09-12T00:31:01.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.605+0000 7f0362c73780 1 < canceled operation key=VD0LFCNLI1YI tag=QK9K7RR01EHO type=del size=3586865 2024-09-12T00:31:01.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.608+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~6V68SQB0KIAF.0 size=91279 2024-09-12T00:31:01.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.608+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=6V68SQB0KIAF tag=I5IMIQSCUBOG type=write size=1139855 2024-09-12T00:31:01.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.610+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~2MHNM5QJLN9N.0 size=1048576 2024-09-12T00:31:01.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.611+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~2MHNM5QJLN9N.1 size=1048576 2024-09-12T00:31:01.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.612+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~2MHNM5QJLN9N.2 size=169859 2024-09-12T00:31:01.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.616+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=2MHNM5QJLN9N tag=YPHLE5RTAM4X type=write size=3315587 2024-09-12T00:31:01.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.619+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~G1EA0F58ACGD.0 size=1048576 2024-09-12T00:31:01.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.621+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~G1EA0F58ACGD.1 size=1048576 2024-09-12T00:31:01.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.622+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~G1EA0F58ACGD.2 size=272289 2024-09-12T00:31:01.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.622+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=G1EA0F58ACGD tag=Q76OUS7L20H0 type=write size=3418017 2024-09-12T00:31:01.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.624+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~7ANOFMWA4P08.0 size=1048576 2024-09-12T00:31:01.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.625+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~7ANOFMWA4P08.1 size=223746 2024-09-12T00:31:01.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.627+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=7ANOFMWA4P08 tag=X0N2VVPR1F23 type=write size=2320898 2024-09-12T00:31:01.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.628+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=XTS0P1XSBIWO type=del size=2429521 2024-09-12T00:31:01.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.629+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=TUIN3976GKZJ type=del 2024-09-12T00:31:01.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.631+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=EU6KRR4C6UUO type=del size=2059656 2024-09-12T00:31:01.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.634+0000 7f0362c73780 1 < suggested update operation key=XR8L0HL374VC tag=WX9N7O0KBHIO type=del size=11406 2024-09-12T00:31:01.634 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.635+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=YYKFOLABIXKW type=del size=4156861 2024-09-12T00:31:01.635 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.637+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~8AA0HRGJX6SB.0 size=562179 2024-09-12T00:31:01.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.639+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=8AA0HRGJX6SB tag=5A8B70LG7PFW type=write size=1610755 2024-09-12T00:31:01.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.642+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~7PRIRB5C2IGY.0 size=122154 2024-09-12T00:31:01.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.642+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=7PRIRB5C2IGY tag=8A79SUD6N0VY type=write size=1170730 2024-09-12T00:31:01.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.642+0000 7f0362c73780 1 < canceled part key=_multipart_WT0185G517YR.2~6O7OND1Z0LY3.0 size=461287 2024-09-12T00:31:01.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.644+0000 7f0362c73780 1 < canceled multipart upload key=WT0185G517YR upload=6O7OND1Z0LY3 tag=V3SGJVT0YB0O type=write size=1509863 2024-09-12T00:31:01.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.647+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~WVYU1LIRJNWC.0 size=1048576 2024-09-12T00:31:01.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.648+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~WVYU1LIRJNWC.1 size=14738 2024-09-12T00:31:01.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.648+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=WVYU1LIRJNWC tag=MWCFJRX7XGEO type=write size=2111890 2024-09-12T00:31:01.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.649+0000 7f0362c73780 1 < canceled part key=_multipart_J5GSZCJW2BP1.2~UMAMWC4M8CF6.0 size=1048576 2024-09-12T00:31:01.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.650+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~UMAMWC4M8CF6.1 size=369737 2024-09-12T00:31:01.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.652+0000 7f0362c73780 1 < canceled multipart upload key=J5GSZCJW2BP1 upload=UMAMWC4M8CF6 tag=VC8RVXTVL7NB type=write size=2466889 2024-09-12T00:31:01.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.654+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~TH8W0VFN3UNB.0 size=1048576 2024-09-12T00:31:01.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.655+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~TH8W0VFN3UNB.1 size=1048576 2024-09-12T00:31:01.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.657+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~TH8W0VFN3UNB.2 size=816699 2024-09-12T00:31:01.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.657+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=TH8W0VFN3UNB tag=AJO9ONRMJLD4 type=write size=3962427 2024-09-12T00:31:01.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.658+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~335TI47A0PKH.0 size=1048576 2024-09-12T00:31:01.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.659+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~335TI47A0PKH.1 size=285699 2024-09-12T00:31:01.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.661+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=335TI47A0PKH tag=ZWZH46YGYO0F type=write size=2382851 2024-09-12T00:31:01.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.662+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=RM7OYI2FYGWP type=write size=210220 2024-09-12T00:31:01.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.664+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~JKZ3UYSAACHT.0 size=1048576 2024-09-12T00:31:01.663 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.665+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~JKZ3UYSAACHT.1 size=645367 2024-09-12T00:31:01.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.667+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=JKZ3UYSAACHT tag=NY5RMRLWX1HM type=write size=2742519 2024-09-12T00:31:01.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.668+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=5RZ7EFSIDM9X type=write size=939029 2024-09-12T00:31:01.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.670+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~TJJKG0RV5OYV.0 size=1048576 2024-09-12T00:31:01.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.670+0000 7f0362c73780 1 < canceled part key=_multipart_84T1VJG5SHU4.2~TJJKG0RV5OYV.1 size=1044490 2024-09-12T00:31:01.670 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.672+0000 7f0362c73780 1 < canceled multipart upload key=84T1VJG5SHU4 upload=TJJKG0RV5OYV tag=WWIO3MTMJHFC type=write size=3141642 2024-09-12T00:31:01.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.673+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=05TJUN9S3OY3 type=write size=884468 2024-09-12T00:31:01.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.676+0000 7f0362c73780 1 < suggested remove operation key=IIZAWZDLR2QE tag=KG5UKSZFVT3A type=write 2024-09-12T00:31:01.677 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.679+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~MZZL3GWQCHST.0 size=1048576 2024-09-12T00:31:01.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.680+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~MZZL3GWQCHST.1 size=345290 2024-09-12T00:31:01.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.680+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=MZZL3GWQCHST tag=PAMZGI9Q7F4A type=write size=2442442 2024-09-12T00:31:01.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.681+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=SR9R09HOCQS9 type=del 2024-09-12T00:31:01.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.683+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~XOOEUM4QL96O.0 size=1048576 2024-09-12T00:31:01.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.684+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~XOOEUM4QL96O.1 size=1032436 2024-09-12T00:31:01.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.684+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=XOOEUM4QL96O tag=WHVQEGMU4V9X type=write size=3129588 2024-09-12T00:31:01.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.686+0000 7f0362c73780 1 < canceled operation key=I3B48QD9E40S tag=TDNFQKBBJUXB type=del size=3432539 2024-09-12T00:31:01.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.687+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=GRBGW901ACT3 type=del size=294962 2024-09-12T00:31:01.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.689+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=NS6EOYMI1IPX type=del 2024-09-12T00:31:01.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.691+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~M4HMWK1Q5IPP.0 size=182312 2024-09-12T00:31:01.690 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.691+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=M4HMWK1Q5IPP tag=3AKYJTFR8KGW type=write size=1230888 2024-09-12T00:31:01.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.693+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~G7NLBZ7TMEDO.0 size=1048576 2024-09-12T00:31:01.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.694+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~G7NLBZ7TMEDO.1 size=1048576 2024-09-12T00:31:01.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.695+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~G7NLBZ7TMEDO.2 size=166380 2024-09-12T00:31:01.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.697+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=G7NLBZ7TMEDO tag=FS78J685ZBCM type=write size=3312108 2024-09-12T00:31:01.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.698+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=3O56E3MJ2PB5 type=write size=830377 2024-09-12T00:31:01.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.700+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~6V68SQB0KIAF.0 size=91279 2024-09-12T00:31:01.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.702+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=6V68SQB0KIAF tag=I5IMIQSCUBOG type=write size=1139855 2024-09-12T00:31:01.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.703+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=GX89SGPOOQAH type=del size=2468615 2024-09-12T00:31:01.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.704+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~G1EA0F58ACGD.0 size=1048576 2024-09-12T00:31:01.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.706+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~G1EA0F58ACGD.1 size=1048576 2024-09-12T00:31:01.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.707+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~G1EA0F58ACGD.2 size=272289 2024-09-12T00:31:01.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.709+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=G1EA0F58ACGD tag=Q76OUS7L20H0 type=write size=3418017 2024-09-12T00:31:01.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.710+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=B7OMSNTJS5CK type=write size=665837 2024-09-12T00:31:01.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.711+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=XTS0P1XSBIWO type=del 2024-09-12T00:31:01.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.713+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=WM84D8I0POMA type=del size=469576 2024-09-12T00:31:01.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.714+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=EU6KRR4C6UUO type=del 2024-09-12T00:31:01.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.716+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=0V00P3Y8NT1U type=write size=946439 2024-09-12T00:31:01.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.717+0000 7f0362c73780 1 < canceled operation key=1MLL1T362X51 tag=YYKFOLABIXKW type=del size=4156861 2024-09-12T00:31:01.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.718+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=A8GEJLQ8P04U type=del size=3928196 2024-09-12T00:31:01.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.720+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~7PRIRB5C2IGY.0 size=122154 2024-09-12T00:31:01.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.722+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=7PRIRB5C2IGY tag=8A79SUD6N0VY type=write size=1170730 2024-09-12T00:31:01.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.725+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~HWB7B6WHVN90.0 size=1048576 2024-09-12T00:31:01.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.726+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~HWB7B6WHVN90.1 size=1048576 2024-09-12T00:31:01.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.727+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~HWB7B6WHVN90.2 size=439851 2024-09-12T00:31:01.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.727+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=HWB7B6WHVN90 tag=UZIBE3ESTD5H type=write size=3585579 2024-09-12T00:31:01.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.728+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~WVYU1LIRJNWC.0 size=1048576 2024-09-12T00:31:01.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.729+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~WVYU1LIRJNWC.1 size=14738 2024-09-12T00:31:01.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.732+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=WVYU1LIRJNWC tag=MWCFJRX7XGEO type=write size=2111890 2024-09-12T00:31:01.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.734+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~H4GBY82HKS1L.0 size=1048576 2024-09-12T00:31:01.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.735+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~H4GBY82HKS1L.1 size=1048576 2024-09-12T00:31:01.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.736+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~H4GBY82HKS1L.2 size=331337 2024-09-12T00:31:01.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.736+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=H4GBY82HKS1L tag=FSTVCEQV5LA2 type=write size=3477065 2024-09-12T00:31:01.736 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.738+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~TH8W0VFN3UNB.0 size=1048576 2024-09-12T00:31:01.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.739+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~TH8W0VFN3UNB.1 size=1048576 2024-09-12T00:31:01.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.740+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~TH8W0VFN3UNB.2 size=816699 2024-09-12T00:31:01.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.743+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=TH8W0VFN3UNB tag=AJO9ONRMJLD4 type=write size=3962427 2024-09-12T00:31:01.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.744+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=1HVZWWA625P7 type=write size=903043 2024-09-12T00:31:01.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.746+0000 7f0362c73780 1 < completed write operation key=2DHHPBYV80O8 tag=RM7OYI2FYGWP type=write size=210220 2024-09-12T00:31:01.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.747+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=TNII7HJN0J75 type=del size=3450871 2024-09-12T00:31:01.747 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.749+0000 7f0362c73780 1 < completed write operation key=XWW3882YBHAJ tag=5RZ7EFSIDM9X type=write size=939029 2024-09-12T00:31:01.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.750+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=OBSHLLRXCYNY type=del size=2147493 2024-09-12T00:31:01.750 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.752+0000 7f0362c73780 1 < completed write operation key=HWSQFSK29S0V tag=05TJUN9S3OY3 type=write size=884468 2024-09-12T00:31:01.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.754+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~IZ6DVXE4PDK9.0 size=1048576 2024-09-12T00:31:01.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.756+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~IZ6DVXE4PDK9.1 size=53659 2024-09-12T00:31:01.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.756+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=IZ6DVXE4PDK9 tag=A3ZHHLI2THZX type=write size=2150811 2024-09-12T00:31:01.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.757+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~MZZL3GWQCHST.0 size=1048576 2024-09-12T00:31:01.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.758+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~MZZL3GWQCHST.1 size=345290 2024-09-12T00:31:01.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.761+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=MZZL3GWQCHST tag=PAMZGI9Q7F4A type=write size=2442442 2024-09-12T00:31:01.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.763+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~VL9U4FUH38JU.0 size=1048576 2024-09-12T00:31:01.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.764+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~VL9U4FUH38JU.1 size=1048576 2024-09-12T00:31:01.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.766+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~VL9U4FUH38JU.2 size=1000063 2024-09-12T00:31:01.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.766+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=VL9U4FUH38JU tag=7FY1HBKSM558 type=write size=4145791 2024-09-12T00:31:01.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.767+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~XOOEUM4QL96O.0 size=1048576 2024-09-12T00:31:01.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.768+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~XOOEUM4QL96O.1 size=1032436 2024-09-12T00:31:01.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.771+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=XOOEUM4QL96O tag=WHVQEGMU4V9X type=write size=3129588 2024-09-12T00:31:01.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.772+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=CEWOT8ZX5KZ3 type=write size=601338 2024-09-12T00:31:01.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.774+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=GRBGW901ACT3 type=del 2024-09-12T00:31:01.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.775+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=WIY742CD8Q83 type=del size=1235082 2024-09-12T00:31:01.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.777+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~M4HMWK1Q5IPP.0 size=182312 2024-09-12T00:31:01.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.779+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=M4HMWK1Q5IPP tag=3AKYJTFR8KGW type=write size=1230888 2024-09-12T00:31:01.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.781+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=ETJM2EFVWKUC type=del size=2075718 2024-09-12T00:31:01.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.783+0000 7f0362c73780 1 < completed write operation key=YTN99RBTKO39 tag=3O56E3MJ2PB5 type=write size=830377 2024-09-12T00:31:01.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.784+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=UZ6P52LV4U6J type=del size=2527227 2024-09-12T00:31:01.784 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.786+0000 7f0362c73780 1 < canceled operation key=XWW3882YBHAJ tag=GX89SGPOOQAH type=del size=2468615 2024-09-12T00:31:01.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.789+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~X8B3CZHDPFQM.0 size=1048576 2024-09-12T00:31:01.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.790+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~X8B3CZHDPFQM.1 size=326411 2024-09-12T00:31:01.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.790+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=X8B3CZHDPFQM tag=9KI4GJBKW9QG type=write size=2423563 2024-09-12T00:31:01.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.791+0000 7f0362c73780 1 < completed write operation key=CZHT9UQS34JU tag=B7OMSNTJS5CK type=write size=665837 2024-09-12T00:31:01.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.794+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~9P32DDNBYPI3.0 size=1048576 2024-09-12T00:31:01.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.795+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~9P32DDNBYPI3.1 size=768964 2024-09-12T00:31:01.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.795+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=9P32DDNBYPI3 tag=BQBU0JWKW5QA type=write size=2866116 2024-09-12T00:31:01.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.796+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=WM84D8I0POMA type=del 2024-09-12T00:31:01.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.798+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=PLOI3RFHKG6E type=del size=3368344 2024-09-12T00:31:01.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.799+0000 7f0362c73780 1 < completed write operation key=44YJP6XPIFT5 tag=0V00P3Y8NT1U type=write size=946439 2024-09-12T00:31:01.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.801+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=ML1RKO56PX64 type=del size=909518 2024-09-12T00:31:01.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.802+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=A8GEJLQ8P04U type=del 2024-09-12T00:31:01.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.805+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~4I44KJ52YG2P.0 size=1048576 2024-09-12T00:31:01.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.806+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~4I44KJ52YG2P.1 size=406735 2024-09-12T00:31:01.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.806+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=4I44KJ52YG2P tag=IGCUXQ0FCJKM type=write size=2503887 2024-09-12T00:31:01.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.808+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~HWB7B6WHVN90.0 size=1048576 2024-09-12T00:31:01.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.808+0000 7f0362c73780 1 < canceled part key=_multipart_PYCRNXC9ITGF.2~HWB7B6WHVN90.1 size=1048576 2024-09-12T00:31:01.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.809+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~HWB7B6WHVN90.2 size=439851 2024-09-12T00:31:01.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.812+0000 7f0362c73780 1 < canceled multipart upload key=PYCRNXC9ITGF upload=HWB7B6WHVN90 tag=UZIBE3ESTD5H type=write size=3585579 2024-09-12T00:31:01.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.814+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=TKYVRDPOG4MU type=write size=736383 2024-09-12T00:31:01.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.815+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~H4GBY82HKS1L.0 size=1048576 2024-09-12T00:31:01.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.816+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~H4GBY82HKS1L.1 size=1048576 2024-09-12T00:31:01.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.818+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~H4GBY82HKS1L.2 size=331337 2024-09-12T00:31:01.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.820+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=H4GBY82HKS1L tag=FSTVCEQV5LA2 type=write size=3477065 2024-09-12T00:31:01.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.822+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=2G5YE7M5HY1U type=del size=2176614 2024-09-12T00:31:01.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.824+0000 7f0362c73780 1 < completed write operation key=VD0LFCNLI1YI tag=1HVZWWA625P7 type=write size=903043 2024-09-12T00:31:01.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.826+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~UGCRHN9TKEM5.0 size=1048576 2024-09-12T00:31:01.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.827+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~UGCRHN9TKEM5.1 size=1048576 2024-09-12T00:31:01.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.828+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~UGCRHN9TKEM5.2 size=473356 2024-09-12T00:31:01.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.828+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=UGCRHN9TKEM5 tag=UO7J789I97S7 type=write size=3619084 2024-09-12T00:31:01.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.830+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=TNII7HJN0J75 type=del 2024-09-12T00:31:01.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.831+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=7769896QHPK1 type=write size=621594 2024-09-12T00:31:01.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.833+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=OBSHLLRXCYNY type=del 2024-09-12T00:31:01.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.834+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=75Z6H5TVYLXC type=del size=1380269 2024-09-12T00:31:01.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.835+0000 7f0362c73780 1 < canceled part key=_multipart_G2HW98G6624O.2~IZ6DVXE4PDK9.0 size=1048576 2024-09-12T00:31:01.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.836+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~IZ6DVXE4PDK9.1 size=53659 2024-09-12T00:31:01.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.838+0000 7f0362c73780 1 < canceled multipart upload key=G2HW98G6624O upload=IZ6DVXE4PDK9 tag=A3ZHHLI2THZX type=write size=2150811 2024-09-12T00:31:01.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.839+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=59R9WNG4YUQY type=del size=923332 2024-09-12T00:31:01.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.841+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~VL9U4FUH38JU.0 size=1048576 2024-09-12T00:31:01.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.842+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~VL9U4FUH38JU.1 size=1048576 2024-09-12T00:31:01.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.843+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~VL9U4FUH38JU.2 size=1000063 2024-09-12T00:31:01.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.845+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=VL9U4FUH38JU tag=7FY1HBKSM558 type=write size=4145791 2024-09-12T00:31:01.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.848+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~CHSX9N5QYKHP.0 size=1048576 2024-09-12T00:31:01.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.849+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~CHSX9N5QYKHP.1 size=914160 2024-09-12T00:31:01.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.849+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=CHSX9N5QYKHP tag=YAOSTHAVSSUY type=write size=3011312 2024-09-12T00:31:01.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.850+0000 7f0362c73780 1 < canceled operation key=WT0185G517YR tag=CEWOT8ZX5KZ3 type=write size=601338 2024-09-12T00:31:01.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.851+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=Q4T6BJDHZ8MQ type=del size=2184070 2024-09-12T00:31:01.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.853+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=WIY742CD8Q83 type=del 2024-09-12T00:31:01.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.855+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~BSOXYQORZF42.0 size=907725 2024-09-12T00:31:01.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.855+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=BSOXYQORZF42 tag=IKOOOU0Z17WO type=write size=1956301 2024-09-12T00:31:01.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.857+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=ETJM2EFVWKUC type=del 2024-09-12T00:31:01.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.858+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=721ZEF6287XO type=del size=392229 2024-09-12T00:31:01.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.860+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=UZ6P52LV4U6J type=del 2024-09-12T00:31:01.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.861+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=H235V332981M type=del size=3497194 2024-09-12T00:31:01.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.863+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~X8B3CZHDPFQM.0 size=1048576 2024-09-12T00:31:01.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.864+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~X8B3CZHDPFQM.1 size=326411 2024-09-12T00:31:01.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.866+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=X8B3CZHDPFQM tag=9KI4GJBKW9QG type=write size=2423563 2024-09-12T00:31:01.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.869+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~J0QZUASHEY1W.0 size=210951 2024-09-12T00:31:01.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.869+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=J0QZUASHEY1W tag=TKJ0UVTK4CO9 type=write size=1259527 2024-09-12T00:31:01.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.870+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~9P32DDNBYPI3.0 size=1048576 2024-09-12T00:31:01.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.871+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~9P32DDNBYPI3.1 size=768964 2024-09-12T00:31:01.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.873+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=9P32DDNBYPI3 tag=BQBU0JWKW5QA type=write size=2866116 2024-09-12T00:31:01.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.877+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~RVJXAYXOUQZN.0 size=1048576 2024-09-12T00:31:01.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.878+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~RVJXAYXOUQZN.1 size=1048576 2024-09-12T00:31:01.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.880+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~RVJXAYXOUQZN.2 size=671186 2024-09-12T00:31:01.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.880+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=RVJXAYXOUQZN tag=D44OD9VALB13 type=write size=3816914 2024-09-12T00:31:01.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.881+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=PLOI3RFHKG6E type=del 2024-09-12T00:31:01.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.883+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=B73WEDCFJ1WV type=del size=3078581 2024-09-12T00:31:01.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.884+0000 7f0362c73780 1 < canceled operation key=44YJP6XPIFT5 tag=ML1RKO56PX64 type=del size=909518 2024-09-12T00:31:01.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.887+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~EFOE4IIJJTN4.0 size=1048576 2024-09-12T00:31:01.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.888+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~EFOE4IIJJTN4.1 size=1048576 2024-09-12T00:31:01.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.889+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~EFOE4IIJJTN4.2 size=796894 2024-09-12T00:31:01.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.889+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=EFOE4IIJJTN4 tag=OYVTL9E7335U type=write size=3942622 2024-09-12T00:31:01.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.891+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~4I44KJ52YG2P.0 size=1048576 2024-09-12T00:31:01.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.892+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~4I44KJ52YG2P.1 size=406735 2024-09-12T00:31:01.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.894+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=4I44KJ52YG2P tag=IGCUXQ0FCJKM type=write size=2503887 2024-09-12T00:31:01.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.897+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~0HZU0T7BOGV6.0 size=1048576 2024-09-12T00:31:01.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.898+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~0HZU0T7BOGV6.1 size=1048576 2024-09-12T00:31:01.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.900+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~0HZU0T7BOGV6.2 size=74874 2024-09-12T00:31:01.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.900+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=0HZU0T7BOGV6 tag=S9OKKVMRCUDU type=write size=3220602 2024-09-12T00:31:01.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.901+0000 7f0362c73780 1 < canceled operation key=PYCRNXC9ITGF tag=TKYVRDPOG4MU type=write size=736383 2024-09-12T00:31:01.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.903+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=3PGUL2684F7Q type=del size=3157013 2024-09-12T00:31:01.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.905+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=2G5YE7M5HY1U type=del 2024-09-12T00:31:01.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.906+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=J5F9Y00Y0RL0 type=del size=1725495 2024-09-12T00:31:01.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.908+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~UGCRHN9TKEM5.0 size=1048576 2024-09-12T00:31:01.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.909+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~UGCRHN9TKEM5.1 size=1048576 2024-09-12T00:31:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.910+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~UGCRHN9TKEM5.2 size=473356 2024-09-12T00:31:01.912 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.912+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=UGCRHN9TKEM5 tag=UO7J789I97S7 type=write size=3619084 2024-09-12T00:31:01.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.915+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~35DF06FZW8G3.0 size=1048576 2024-09-12T00:31:01.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.916+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~35DF06FZW8G3.1 size=839544 2024-09-12T00:31:01.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.916+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=35DF06FZW8G3 tag=67C2J5AUJ0YL type=write size=2936696 2024-09-12T00:31:01.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.918+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=7769896QHPK1 type=write size=621594 2024-09-12T00:31:01.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.919+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=0MDB1AY1FXUB type=del size=486612 2024-09-12T00:31:01.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.921+0000 7f0362c73780 1 < canceled operation key=1UUNRPUKAINC tag=75Z6H5TVYLXC type=del size=1380269 2024-09-12T00:31:01.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.922+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=M33V4BVJ50P7 type=del size=1619830 2024-09-12T00:31:01.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.925+0000 7f0362c73780 1 < suggested update operation key=PYCRNXC9ITGF tag=59R9WNG4YUQY type=del size=923332 2024-09-12T00:31:01.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.927+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=MR3JMKIUVBM2 type=del size=445646 2024-09-12T00:31:01.926 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.928+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~CHSX9N5QYKHP.0 size=1048576 2024-09-12T00:31:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.929+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~CHSX9N5QYKHP.1 size=914160 2024-09-12T00:31:01.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.932+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=CHSX9N5QYKHP tag=YAOSTHAVSSUY type=write size=3011312 2024-09-12T00:31:01.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.935+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~NEJTMRTABIXT.0 size=1048576 2024-09-12T00:31:01.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.936+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~NEJTMRTABIXT.1 size=305227 2024-09-12T00:31:01.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.936+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=NEJTMRTABIXT tag=RCKON789MBSV type=write size=2402379 2024-09-12T00:31:01.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.937+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=Q4T6BJDHZ8MQ type=del 2024-09-12T00:31:01.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.940+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~1EIETP5MLLLG.0 size=1048576 2024-09-12T00:31:01.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.941+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~1EIETP5MLLLG.1 size=695804 2024-09-12T00:31:01.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.941+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=1EIETP5MLLLG tag=S21WXQ9WFPNN type=write size=2792956 2024-09-12T00:31:01.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.943+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~BSOXYQORZF42.0 size=907725 2024-09-12T00:31:01.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.945+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=BSOXYQORZF42 tag=IKOOOU0Z17WO type=write size=1956301 2024-09-12T00:31:01.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.946+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=BK65BKVNXQLF type=del size=3368555 2024-09-12T00:31:01.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.948+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=721ZEF6287XO type=del 2024-09-12T00:31:01.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.949+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=MZ13R0D0V2VN type=del size=2157443 2024-09-12T00:31:01.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.952+0000 7f0362c73780 1 < suggested remove operation key=R4ABY5AY0S1P tag=H235V332981M type=del 2024-09-12T00:31:01.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.954+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~4QT46PQHW9NI.0 size=1048576 2024-09-12T00:31:01.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.956+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~4QT46PQHW9NI.1 size=539923 2024-09-12T00:31:01.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.956+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=4QT46PQHW9NI tag=BWX6G26UIXE9 type=write size=2637075 2024-09-12T00:31:01.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.957+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~J0QZUASHEY1W.0 size=210951 2024-09-12T00:31:01.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.959+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=J0QZUASHEY1W tag=TKJ0UVTK4CO9 type=write size=1259527 2024-09-12T00:31:01.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.961+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=U8GKKV42KMT6 type=write size=253550 2024-09-12T00:31:01.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.961+0000 7f0362c73780 1 < canceled part key=_multipart_44YJP6XPIFT5.2~RVJXAYXOUQZN.0 size=1048576 2024-09-12T00:31:01.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.962+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~RVJXAYXOUQZN.1 size=1048576 2024-09-12T00:31:01.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.963+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~RVJXAYXOUQZN.2 size=671186 2024-09-12T00:31:01.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.966+0000 7f0362c73780 1 < canceled multipart upload key=44YJP6XPIFT5 upload=RVJXAYXOUQZN tag=D44OD9VALB13 type=write size=3816914 2024-09-12T00:31:01.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.968+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~5OIIH9GFHF5S.0 size=252417 2024-09-12T00:31:01.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.968+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=5OIIH9GFHF5S tag=RA84BXZJB8GZ type=write size=1300993 2024-09-12T00:31:01.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.969+0000 7f0362c73780 1 < canceled operation key=OY30LP7FYXNF tag=B73WEDCFJ1WV type=del size=3078581 2024-09-12T00:31:01.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.971+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=CUFDP34N1RNN type=del size=972002 2024-09-12T00:31:01.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.972+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~EFOE4IIJJTN4.0 size=1048576 2024-09-12T00:31:01.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.973+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~EFOE4IIJJTN4.1 size=1048576 2024-09-12T00:31:01.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.973+0000 7f0362c73780 1 < canceled part key=_multipart_I3B48QD9E40S.2~EFOE4IIJJTN4.2 size=796894 2024-09-12T00:31:01.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.976+0000 7f0362c73780 1 < canceled multipart upload key=I3B48QD9E40S upload=EFOE4IIJJTN4 tag=OYVTL9E7335U type=write size=3942622 2024-09-12T00:31:01.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.977+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=L666IGUMC5D5 type=write size=369823 2024-09-12T00:31:01.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.977+0000 7f0362c73780 1 < canceled part key=_multipart_XWW3882YBHAJ.2~0HZU0T7BOGV6.0 size=1048576 2024-09-12T00:31:01.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.978+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~0HZU0T7BOGV6.1 size=1048576 2024-09-12T00:31:01.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.980+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~0HZU0T7BOGV6.2 size=74874 2024-09-12T00:31:01.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.982+0000 7f0362c73780 1 < canceled multipart upload key=XWW3882YBHAJ upload=0HZU0T7BOGV6 tag=S9OKKVMRCUDU type=write size=3220602 2024-09-12T00:31:01.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.984+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~A052SIC9MVP6.0 size=1048576 2024-09-12T00:31:01.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.985+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~A052SIC9MVP6.1 size=1022294 2024-09-12T00:31:01.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.985+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=A052SIC9MVP6 tag=4HZYS0AGE1X4 type=write size=3119446 2024-09-12T00:31:01.985 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.987+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=3PGUL2684F7Q type=del 2024-09-12T00:31:01.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.988+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=HJ126NJ7W354 type=del size=1997785 2024-09-12T00:31:01.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.990+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=J5F9Y00Y0RL0 type=del 2024-09-12T00:31:01.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.991+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=3CCUOMQXE11Y type=del size=2131286 2024-09-12T00:31:01.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.993+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~35DF06FZW8G3.0 size=1048576 2024-09-12T00:31:01.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.994+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~35DF06FZW8G3.1 size=839544 2024-09-12T00:31:01.994 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.996+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=35DF06FZW8G3 tag=67C2J5AUJ0YL type=write size=2936696 2024-09-12T00:31:01.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:01.999+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~KCX62HT2D7U2.0 size=1048576 2024-09-12T00:31:01.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.000+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~KCX62HT2D7U2.1 size=1048576 2024-09-12T00:31:02.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.001+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~KCX62HT2D7U2.2 size=241460 2024-09-12T00:31:02.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.001+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=KCX62HT2D7U2 tag=H5YVDIQ4ZFGG type=write size=3387188 2024-09-12T00:31:02.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.004+0000 7f0362c73780 1 < suggested remove operation key=927NCYXX8Z2P tag=0MDB1AY1FXUB type=del 2024-09-12T00:31:02.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.006+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=WE3C8U7SC3J8 type=del size=1548746 2024-09-12T00:31:02.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.008+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=M33V4BVJ50P7 type=del 2024-09-12T00:31:02.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.011+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~8FJEIS0KQI6K.0 size=1048576 2024-09-12T00:31:02.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.012+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~8FJEIS0KQI6K.1 size=1048576 2024-09-12T00:31:02.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.014+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~8FJEIS0KQI6K.2 size=1025548 2024-09-12T00:31:02.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.014+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=8FJEIS0KQI6K tag=7354WIXDTK3B type=write size=4171276 2024-09-12T00:31:02.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.015+0000 7f0362c73780 1 < canceled operation key=6AYDT9X4LC6T tag=MR3JMKIUVBM2 type=del size=445646 2024-09-12T00:31:02.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.017+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=M4IXJKOTTN2Y type=del size=2053889 2024-09-12T00:31:02.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.017+0000 7f0362c73780 1 < canceled part key=_multipart_G2HW98G6624O.2~NEJTMRTABIXT.0 size=1048576 2024-09-12T00:31:02.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.018+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~NEJTMRTABIXT.1 size=305227 2024-09-12T00:31:02.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.020+0000 7f0362c73780 1 < canceled multipart upload key=G2HW98G6624O upload=NEJTMRTABIXT tag=RCKON789MBSV type=write size=2402379 2024-09-12T00:31:02.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.022+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=2KWRQDL7XQM3 type=del size=921559 2024-09-12T00:31:02.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.024+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~1EIETP5MLLLG.0 size=1048576 2024-09-12T00:31:02.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.025+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~1EIETP5MLLLG.1 size=695804 2024-09-12T00:31:02.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.027+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=1EIETP5MLLLG tag=S21WXQ9WFPNN type=write size=2792956 2024-09-12T00:31:02.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.029+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=VU5QCHMNDO5C type=del size=2318581 2024-09-12T00:31:02.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.030+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=BK65BKVNXQLF type=del 2024-09-12T00:31:02.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.032+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=8YYAXBZWR368 type=del size=53896 2024-09-12T00:31:02.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.033+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=MZ13R0D0V2VN type=del 2024-09-12T00:31:02.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.035+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=HMQBK6GDFDT3 type=del size=3745329 2024-09-12T00:31:02.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.036+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~4QT46PQHW9NI.0 size=1048576 2024-09-12T00:31:02.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.037+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~4QT46PQHW9NI.1 size=539923 2024-09-12T00:31:02.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.040+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=4QT46PQHW9NI tag=BWX6G26UIXE9 type=write size=2637075 2024-09-12T00:31:02.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.041+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=4O9I4H8VJ9G2 type=del size=4102432 2024-09-12T00:31:02.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.043+0000 7f0362c73780 1 < completed write operation key=YTN99RBTKO39 tag=U8GKKV42KMT6 type=write size=253550 2024-09-12T00:31:02.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.044+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=UNYRTY089MDE type=del size=761773 2024-09-12T00:31:02.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.046+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~5OIIH9GFHF5S.0 size=252417 2024-09-12T00:31:02.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.048+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=5OIIH9GFHF5S tag=RA84BXZJB8GZ type=write size=1300993 2024-09-12T00:31:02.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.051+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~YKVQ3ZN2AX6O.0 size=769081 2024-09-12T00:31:02.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.051+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=YKVQ3ZN2AX6O tag=IPJ89F3RBR3G type=write size=1817657 2024-09-12T00:31:02.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.052+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=CUFDP34N1RNN type=del 2024-09-12T00:31:02.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.054+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=3L0S4KOVT3CC type=del size=3696062 2024-09-12T00:31:02.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.055+0000 7f0362c73780 1 < completed write operation key=VD0LFCNLI1YI tag=L666IGUMC5D5 type=write size=369823 2024-09-12T00:31:02.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.057+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=32ARTY3PTUNF type=del size=405931 2024-09-12T00:31:02.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.058+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~A052SIC9MVP6.0 size=1048576 2024-09-12T00:31:02.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.059+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~A052SIC9MVP6.1 size=1022294 2024-09-12T00:31:02.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.062+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=A052SIC9MVP6 tag=4HZYS0AGE1X4 type=write size=3119446 2024-09-12T00:31:02.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.064+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~SBLPVZAI83ZH.0 size=1048576 2024-09-12T00:31:02.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.065+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~SBLPVZAI83ZH.1 size=1048576 2024-09-12T00:31:02.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.067+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~SBLPVZAI83ZH.2 size=570051 2024-09-12T00:31:02.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.067+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=SBLPVZAI83ZH tag=036MP6KDEUA8 type=write size=3715779 2024-09-12T00:31:02.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.068+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=HJ126NJ7W354 type=del 2024-09-12T00:31:02.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.070+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=YRVMGK5V6G6F type=del size=528558 2024-09-12T00:31:02.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.072+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=3CCUOMQXE11Y type=del 2024-09-12T00:31:02.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.074+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~Q7J34PPFJGKU.0 size=680607 2024-09-12T00:31:02.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.074+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=Q7J34PPFJGKU tag=SXMJZ39NF6XH type=write size=1729183 2024-09-12T00:31:02.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.076+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~KCX62HT2D7U2.0 size=1048576 2024-09-12T00:31:02.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.077+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~KCX62HT2D7U2.1 size=1048576 2024-09-12T00:31:02.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.078+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~KCX62HT2D7U2.2 size=241460 2024-09-12T00:31:02.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.080+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=KCX62HT2D7U2 tag=H5YVDIQ4ZFGG type=write size=3387188 2024-09-12T00:31:02.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.082+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=3GBHTWXGBC3R type=write size=998065 2024-09-12T00:31:02.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.083+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=WE3C8U7SC3J8 type=del 2024-09-12T00:31:02.083 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.084+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=UI6RYSQXUAIO type=del size=2420376 2024-09-12T00:31:02.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.086+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~8FJEIS0KQI6K.0 size=1048576 2024-09-12T00:31:02.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.087+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~8FJEIS0KQI6K.1 size=1048576 2024-09-12T00:31:02.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.088+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~8FJEIS0KQI6K.2 size=1025548 2024-09-12T00:31:02.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.090+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=8FJEIS0KQI6K tag=7354WIXDTK3B type=write size=4171276 2024-09-12T00:31:02.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.092+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=9O2JWF34SSVZ type=write size=602337 2024-09-12T00:31:02.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.093+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=M4IXJKOTTN2Y type=del 2024-09-12T00:31:02.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.095+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=WZE6H4KUUY84 type=write size=970454 2024-09-12T00:31:02.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.097+0000 7f0362c73780 1 < suggested update operation key=Q6M0D2698CUZ tag=2KWRQDL7XQM3 type=del size=921559 2024-09-12T00:31:02.097 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.099+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=3B0JB33I2E7K type=write size=463911 2024-09-12T00:31:02.098 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.100+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=VU5QCHMNDO5C type=del 2024-09-12T00:31:02.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.102+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=CT9POYD8ZMHH type=del size=1220848 2024-09-12T00:31:02.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.103+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=8YYAXBZWR368 type=del 2024-09-12T00:31:02.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.104+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=BCGW0VXANXYH type=del size=3790531 2024-09-12T00:31:02.104 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.106+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=HMQBK6GDFDT3 type=del 2024-09-12T00:31:02.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.109+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~HPF3IIXSC0PF.0 size=1008557 2024-09-12T00:31:02.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.109+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=HPF3IIXSC0PF tag=XB6GLYMK9UXM type=write size=2057133 2024-09-12T00:31:02.108 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.110+0000 7f0362c73780 1 < canceled operation key=I3B48QD9E40S tag=4O9I4H8VJ9G2 type=del size=4102432 2024-09-12T00:31:02.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.112+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=RGNTRR6X3R0K type=del size=499315 2024-09-12T00:31:02.111 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.113+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=UNYRTY089MDE type=del 2024-09-12T00:31:02.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.115+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=98OS3JQGI12B type=del size=288135 2024-09-12T00:31:02.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.116+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~YKVQ3ZN2AX6O.0 size=769081 2024-09-12T00:31:02.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.119+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=YKVQ3ZN2AX6O tag=IPJ89F3RBR3G type=write size=1817657 2024-09-12T00:31:02.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.121+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~9B0RPYU67F26.0 size=1048576 2024-09-12T00:31:02.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.123+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~9B0RPYU67F26.1 size=873629 2024-09-12T00:31:02.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.123+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=9B0RPYU67F26 tag=HYYTY2ROXXZ5 type=write size=2970781 2024-09-12T00:31:02.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.125+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=3L0S4KOVT3CC type=del 2024-09-12T00:31:02.124 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.126+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=O6MOIEBK45ML type=del size=2768809 2024-09-12T00:31:02.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.129+0000 7f0362c73780 1 < suggested remove operation key=YTN99RBTKO39 tag=32ARTY3PTUNF type=del 2024-09-12T00:31:02.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.130+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=2TOZXI54L0AA type=del size=1368697 2024-09-12T00:31:02.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.132+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~SBLPVZAI83ZH.0 size=1048576 2024-09-12T00:31:02.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.133+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~SBLPVZAI83ZH.1 size=1048576 2024-09-12T00:31:02.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.134+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~SBLPVZAI83ZH.2 size=570051 2024-09-12T00:31:02.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.136+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=SBLPVZAI83ZH tag=036MP6KDEUA8 type=write size=3715779 2024-09-12T00:31:02.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.138+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=PRG32HTT0X0Z type=del size=1796443 2024-09-12T00:31:02.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.139+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=YRVMGK5V6G6F type=del 2024-09-12T00:31:02.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.141+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=F2IPEHR8A60P type=del size=3211123 2024-09-12T00:31:02.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.142+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~Q7J34PPFJGKU.0 size=680607 2024-09-12T00:31:02.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.145+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=Q7J34PPFJGKU tag=SXMJZ39NF6XH type=write size=1729183 2024-09-12T00:31:02.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.146+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=CIPYN82SK3WA type=del size=4081904 2024-09-12T00:31:02.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.148+0000 7f0362c73780 1 < completed write operation key=CZHT9UQS34JU tag=3GBHTWXGBC3R type=write size=998065 2024-09-12T00:31:02.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.150+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=9VZO5GJL4A0S type=del size=2899517 2024-09-12T00:31:02.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.151+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=UI6RYSQXUAIO type=del 2024-09-12T00:31:02.151 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.153+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=A9HCZQOZ3HRM type=write size=175205 2024-09-12T00:31:02.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.154+0000 7f0362c73780 1 < completed write operation key=6AYDT9X4LC6T tag=9O2JWF34SSVZ type=write size=602337 2024-09-12T00:31:02.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.156+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=RDJOJKCDNQ5U type=del size=3672421 2024-09-12T00:31:02.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.157+0000 7f0362c73780 -1 < failed to complete operation key=YTN99RBTKO39 tag=WZE6H4KUUY84 type=write size=970454: (22) Invalid argument 2024-09-12T00:31:02.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.160+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~A1OV2Q9GSEE8.0 size=773606 2024-09-12T00:31:02.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.160+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=A1OV2Q9GSEE8 tag=RQL96328Y0WW type=write size=1822182 2024-09-12T00:31:02.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.161+0000 7f0362c73780 1 < completed write operation key=CZHT9UQS34JU tag=3B0JB33I2E7K type=write size=463911 2024-09-12T00:31:02.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.164+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~VBHNBL1QAGQF.0 size=727717 2024-09-12T00:31:02.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.164+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=VBHNBL1QAGQF tag=O88R8Z3JJAQY type=write size=1776293 2024-09-12T00:31:02.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.165+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=CT9POYD8ZMHH type=del 2024-09-12T00:31:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.167+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=5UQ2MFU3FSH8 type=del size=2385488 2024-09-12T00:31:02.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.170+0000 7f0362c73780 1 < suggested remove operation key=XR8L0HL374VC tag=BCGW0VXANXYH type=del 2024-09-12T00:31:02.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.172+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~8GI2NG2RE8NO.0 size=1048576 2024-09-12T00:31:02.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.174+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~8GI2NG2RE8NO.1 size=427646 2024-09-12T00:31:02.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.174+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=8GI2NG2RE8NO tag=3E6NKE6QY6HH type=write size=2524798 2024-09-12T00:31:02.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.175+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~HPF3IIXSC0PF.0 size=1008557 2024-09-12T00:31:02.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.177+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=HPF3IIXSC0PF tag=XB6GLYMK9UXM type=write size=2057133 2024-09-12T00:31:02.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.178+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=JDL1PSRAK94G type=del size=797686 2024-09-12T00:31:02.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.181+0000 7f0362c73780 1 < suggested update operation key=VD0LFCNLI1YI tag=RGNTRR6X3R0K type=del size=499315 2024-09-12T00:31:02.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.183+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=U0GN1BQI22WS type=del size=879153 2024-09-12T00:31:02.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.184+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=98OS3JQGI12B type=del 2024-09-12T00:31:02.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.187+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~O3CT3HVZQBS3.0 size=1019409 2024-09-12T00:31:02.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.187+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=O3CT3HVZQBS3 tag=OF4O5J970SSY type=write size=2067985 2024-09-12T00:31:02.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.188+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~9B0RPYU67F26.0 size=1048576 2024-09-12T00:31:02.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.189+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~9B0RPYU67F26.1 size=873629 2024-09-12T00:31:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.192+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=9B0RPYU67F26 tag=HYYTY2ROXXZ5 type=write size=2970781 2024-09-12T00:31:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.193+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=3N95IT9LJO8D type=del size=2006791 2024-09-12T00:31:02.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.195+0000 7f0362c73780 -1 < failed to complete operation key=XR8L0HL374VC tag=O6MOIEBK45ML type=del size=2768809: (22) Invalid argument 2024-09-12T00:31:02.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.197+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~03UW36T45XQ4.0 size=628441 2024-09-12T00:31:02.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.197+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=03UW36T45XQ4 tag=3W5F8F2T9Q60 type=write size=1677017 2024-09-12T00:31:02.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.199+0000 7f0362c73780 1 < completed delete operation key=PLAYMR18X9DZ tag=2TOZXI54L0AA type=del 2024-09-12T00:31:02.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.200+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=PK3B7Y8SDVUQ type=del size=1259044 2024-09-12T00:31:02.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.203+0000 7f0362c73780 1 < suggested remove operation key=1MLL1T362X51 tag=PRG32HTT0X0Z type=del 2024-09-12T00:31:02.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.205+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~4YLUQKO1IU4W.0 size=1048576 2024-09-12T00:31:02.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.206+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~4YLUQKO1IU4W.1 size=1048576 2024-09-12T00:31:02.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.208+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~4YLUQKO1IU4W.2 size=533691 2024-09-12T00:31:02.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.208+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=4YLUQKO1IU4W tag=AZ84Z0MXE6AX type=write size=3679419 2024-09-12T00:31:02.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.209+0000 7f0362c73780 1 < canceled operation key=84T1VJG5SHU4 tag=F2IPEHR8A60P type=del size=3211123 2024-09-12T00:31:02.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.210+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=2JA7E3HFBDSJ type=write size=240605 2024-09-12T00:31:02.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.213+0000 7f0362c73780 1 < suggested remove operation key=84T1VJG5SHU4 tag=CIPYN82SK3WA type=del 2024-09-12T00:31:02.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.215+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~A5AS9WMDR010.0 size=1048576 2024-09-12T00:31:02.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.216+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~A5AS9WMDR010.1 size=942876 2024-09-12T00:31:02.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.216+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=A5AS9WMDR010 tag=KTK4TEN0ZJN9 type=write size=3040028 2024-09-12T00:31:02.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.218+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=9VZO5GJL4A0S type=del 2024-09-12T00:31:02.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.220+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~EW1TQUWVLDXY.0 size=1048576 2024-09-12T00:31:02.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.222+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~EW1TQUWVLDXY.1 size=553150 2024-09-12T00:31:02.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.222+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=EW1TQUWVLDXY tag=MBVNU5OVICR6 type=write size=2650302 2024-09-12T00:31:02.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.224+0000 7f0362c73780 1 < suggested remove operation key=HEN9LUUIDAR5 tag=A9HCZQOZ3HRM type=write 2024-09-12T00:31:02.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.226+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=0BY8C06W8PYC type=del size=2817157 2024-09-12T00:31:02.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.227+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=RDJOJKCDNQ5U type=del 2024-09-12T00:31:02.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.230+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~XV89HGOL1MF3.0 size=767882 2024-09-12T00:31:02.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.230+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=XV89HGOL1MF3 tag=T00QDR7Y0RDR type=write size=1816458 2024-09-12T00:31:02.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.231+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~A1OV2Q9GSEE8.0 size=773606 2024-09-12T00:31:02.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.233+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=A1OV2Q9GSEE8 tag=RQL96328Y0WW type=write size=1822182 2024-09-12T00:31:02.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.235+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=S98QJQ03XJQJ type=del size=2928994 2024-09-12T00:31:02.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.237+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~VBHNBL1QAGQF.0 size=727717 2024-09-12T00:31:02.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.239+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=VBHNBL1QAGQF tag=O88R8Z3JJAQY type=write size=1776293 2024-09-12T00:31:02.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.241+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~7IGCD0N74WA1.0 size=1048576 2024-09-12T00:31:02.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.242+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~7IGCD0N74WA1.1 size=528483 2024-09-12T00:31:02.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.242+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=7IGCD0N74WA1 tag=GYJ3K141CGVM type=write size=2625635 2024-09-12T00:31:02.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.244+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=5UQ2MFU3FSH8 type=del 2024-09-12T00:31:02.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.246+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~NWEYXHAGD91P.0 size=496694 2024-09-12T00:31:02.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.246+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=NWEYXHAGD91P tag=O101FNM1QP2Q type=write size=1545270 2024-09-12T00:31:02.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.248+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~8GI2NG2RE8NO.0 size=1048576 2024-09-12T00:31:02.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.248+0000 7f0362c73780 1 < canceled part key=_multipart_OY30LP7FYXNF.2~8GI2NG2RE8NO.1 size=427646 2024-09-12T00:31:02.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.250+0000 7f0362c73780 1 < canceled multipart upload key=OY30LP7FYXNF upload=8GI2NG2RE8NO tag=3E6NKE6QY6HH type=write size=2524798 2024-09-12T00:31:02.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.251+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=DYUGG3U50XO8 type=del size=2999115 2024-09-12T00:31:02.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.256+0000 7f0362c73780 1 < suggested remove operation key=EHBOL435W9ZE tag=JDL1PSRAK94G type=del 2024-09-12T00:31:02.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.258+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~D54YNZVRVTUS.0 size=1048576 2024-09-12T00:31:02.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.259+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~D54YNZVRVTUS.1 size=1048576 2024-09-12T00:31:02.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.261+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~D54YNZVRVTUS.2 size=370655 2024-09-12T00:31:02.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.261+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=D54YNZVRVTUS tag=ZZ72ZO59KOJ7 type=write size=3516383 2024-09-12T00:31:02.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.262+0000 7f0362c73780 -1 < failed to complete operation key=HEN9LUUIDAR5 tag=U0GN1BQI22WS type=del size=879153: (22) Invalid argument 2024-09-12T00:31:02.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.264+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=QVSZ3VI2LVE1 type=write size=873949 2024-09-12T00:31:02.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.265+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~O3CT3HVZQBS3.0 size=1019409 2024-09-12T00:31:02.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.267+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=O3CT3HVZQBS3 tag=OF4O5J970SSY type=write size=2067985 2024-09-12T00:31:02.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.270+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~M9RON36JYAAU.0 size=1048576 2024-09-12T00:31:02.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.271+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~M9RON36JYAAU.1 size=149768 2024-09-12T00:31:02.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.271+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=M9RON36JYAAU tag=74VERYN7NPG4 type=write size=2246920 2024-09-12T00:31:02.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.273+0000 7f0362c73780 1 < canceled operation key=R4ABY5AY0S1P tag=3N95IT9LJO8D type=del size=2006791 2024-09-12T00:31:02.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.274+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=4A4P1MXO3BWH type=del size=2205754 2024-09-12T00:31:02.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.276+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~03UW36T45XQ4.0 size=628441 2024-09-12T00:31:02.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.278+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=03UW36T45XQ4 tag=3W5F8F2T9Q60 type=write size=1677017 2024-09-12T00:31:02.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.280+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~O6VU4AGYTOFV.0 size=1048576 2024-09-12T00:31:02.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.283+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~O6VU4AGYTOFV.1 size=892528 2024-09-12T00:31:02.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.283+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=O6VU4AGYTOFV tag=RQJ7OURDY4CQ type=write size=2989680 2024-09-12T00:31:02.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.284+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=PK3B7Y8SDVUQ type=del 2024-09-12T00:31:02.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.286+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=12IXG6UB34OW type=del size=2338545 2024-09-12T00:31:02.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.287+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~4YLUQKO1IU4W.0 size=1048576 2024-09-12T00:31:02.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.288+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~4YLUQKO1IU4W.1 size=1048576 2024-09-12T00:31:02.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.288+0000 7f0362c73780 1 < canceled part key=_multipart_PYCRNXC9ITGF.2~4YLUQKO1IU4W.2 size=533691 2024-09-12T00:31:02.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.291+0000 7f0362c73780 1 < canceled multipart upload key=PYCRNXC9ITGF upload=4YLUQKO1IU4W tag=AZ84Z0MXE6AX type=write size=3679419 2024-09-12T00:31:02.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.294+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~S715ZIUHVKLE.0 size=293640 2024-09-12T00:31:02.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.294+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=S715ZIUHVKLE tag=ZBOHTQXP6E6O type=write size=1342216 2024-09-12T00:31:02.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.295+0000 7f0362c73780 1 < completed write operation key=KWDEKRO3WICD tag=2JA7E3HFBDSJ type=write size=240605 2024-09-12T00:31:02.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.297+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=NY13SRC0XMZT type=del size=4099743 2024-09-12T00:31:02.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.299+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~A5AS9WMDR010.0 size=1048576 2024-09-12T00:31:02.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.300+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~A5AS9WMDR010.1 size=942876 2024-09-12T00:31:02.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.303+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=A5AS9WMDR010 tag=KTK4TEN0ZJN9 type=write size=3040028 2024-09-12T00:31:02.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.305+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=CXTKU2OT674N type=del size=2103464 2024-09-12T00:31:02.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.307+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~EW1TQUWVLDXY.0 size=1048576 2024-09-12T00:31:02.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.308+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~EW1TQUWVLDXY.1 size=553150 2024-09-12T00:31:02.308 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.310+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=EW1TQUWVLDXY tag=MBVNU5OVICR6 type=write size=2650302 2024-09-12T00:31:02.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.313+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~PDLV5EREWT50.0 size=1048576 2024-09-12T00:31:02.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.314+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~PDLV5EREWT50.1 size=229533 2024-09-12T00:31:02.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.314+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=PDLV5EREWT50 tag=HOEJI8MZ9F6H type=write size=2326685 2024-09-12T00:31:02.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.315+0000 7f0362c73780 1 < canceled operation key=HWSQFSK29S0V tag=0BY8C06W8PYC type=del size=2817157 2024-09-12T00:31:02.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.317+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=35RPZ223GBQE type=del size=153747 2024-09-12T00:31:02.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.319+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~XV89HGOL1MF3.0 size=767882 2024-09-12T00:31:02.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.322+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=XV89HGOL1MF3 tag=T00QDR7Y0RDR type=write size=1816458 2024-09-12T00:31:02.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.323+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=UN33JR903PUQ type=del size=1661996 2024-09-12T00:31:02.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.325+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=S98QJQ03XJQJ type=del 2024-09-12T00:31:02.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.328+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~TLZ6UW928CKZ.0 size=1048576 2024-09-12T00:31:02.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.329+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~TLZ6UW928CKZ.1 size=1048576 2024-09-12T00:31:02.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.330+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~TLZ6UW928CKZ.2 size=459770 2024-09-12T00:31:02.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.330+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=TLZ6UW928CKZ tag=X189L1A75VAY type=write size=3605498 2024-09-12T00:31:02.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.331+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~7IGCD0N74WA1.0 size=1048576 2024-09-12T00:31:02.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.332+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~7IGCD0N74WA1.1 size=528483 2024-09-12T00:31:02.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.335+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=7IGCD0N74WA1 tag=GYJ3K141CGVM type=write size=2625635 2024-09-12T00:31:02.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.337+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~PP5KUHOZ80KD.0 size=1048576 2024-09-12T00:31:02.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.339+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~PP5KUHOZ80KD.1 size=510970 2024-09-12T00:31:02.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.339+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=PP5KUHOZ80KD tag=K6JVTZJQ91RS type=write size=2608122 2024-09-12T00:31:02.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.340+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~NWEYXHAGD91P.0 size=496694 2024-09-12T00:31:02.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.342+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=NWEYXHAGD91P tag=O101FNM1QP2Q type=write size=1545270 2024-09-12T00:31:02.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.344+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=VDRNMF7BFJZ4 type=write size=120451 2024-09-12T00:31:02.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.346+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=DYUGG3U50XO8 type=del 2024-09-12T00:31:02.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.347+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=FL65RM9ESI6Y type=del size=2479244 2024-09-12T00:31:02.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.349+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~D54YNZVRVTUS.0 size=1048576 2024-09-12T00:31:02.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.349+0000 7f0362c73780 1 < canceled part key=_multipart_XWW3882YBHAJ.2~D54YNZVRVTUS.1 size=1048576 2024-09-12T00:31:02.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.350+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~D54YNZVRVTUS.2 size=370655 2024-09-12T00:31:02.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.352+0000 7f0362c73780 1 < canceled multipart upload key=XWW3882YBHAJ upload=D54YNZVRVTUS tag=ZZ72ZO59KOJ7 type=write size=3516383 2024-09-12T00:31:02.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.353+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=CMWQDOO9831G type=del size=1381766 2024-09-12T00:31:02.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.355+0000 7f0362c73780 1 < canceled operation key=OY30LP7FYXNF tag=QVSZ3VI2LVE1 type=write size=873949 2024-09-12T00:31:02.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.356+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=C1874EB3EV1C type=del size=2866674 2024-09-12T00:31:02.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.358+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~M9RON36JYAAU.0 size=1048576 2024-09-12T00:31:02.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.359+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~M9RON36JYAAU.1 size=149768 2024-09-12T00:31:02.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.361+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=M9RON36JYAAU tag=74VERYN7NPG4 type=write size=2246920 2024-09-12T00:31:02.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.363+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=P0I4TBXMN789 type=del size=2060672 2024-09-12T00:31:02.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.365+0000 7f0362c73780 1 < suggested update operation key=EHBOL435W9ZE tag=4A4P1MXO3BWH type=del size=2205754 2024-09-12T00:31:02.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.367+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=XZCLFIIAFD5R type=del size=672292 2024-09-12T00:31:02.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.368+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~O6VU4AGYTOFV.0 size=1048576 2024-09-12T00:31:02.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.370+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~O6VU4AGYTOFV.1 size=892528 2024-09-12T00:31:02.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.372+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=O6VU4AGYTOFV tag=RQJ7OURDY4CQ type=write size=2989680 2024-09-12T00:31:02.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.375+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~FXDAW3TOT8O4.0 size=315123 2024-09-12T00:31:02.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.375+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=FXDAW3TOT8O4 tag=CA3UNKD7EFD3 type=write size=1363699 2024-09-12T00:31:02.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.376+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=12IXG6UB34OW type=del 2024-09-12T00:31:02.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.378+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=NX5N65MZDUT9 type=del size=2286033 2024-09-12T00:31:02.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.379+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~S715ZIUHVKLE.0 size=293640 2024-09-12T00:31:02.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.382+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=S715ZIUHVKLE tag=ZBOHTQXP6E6O type=write size=1342216 2024-09-12T00:31:02.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.384+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~VEI30DAA8XKN.0 size=1048576 2024-09-12T00:31:02.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.385+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~VEI30DAA8XKN.1 size=1048576 2024-09-12T00:31:02.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.386+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~VEI30DAA8XKN.2 size=60669 2024-09-12T00:31:02.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.386+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=VEI30DAA8XKN tag=7IC6MRZEO7KE type=write size=3206397 2024-09-12T00:31:02.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.389+0000 7f0362c73780 1 < suggested remove operation key=2DHHPBYV80O8 tag=NY13SRC0XMZT type=del 2024-09-12T00:31:02.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.391+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=CIQLRKL68XWL type=del size=2944672 2024-09-12T00:31:02.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.393+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=CXTKU2OT674N type=del 2024-09-12T00:31:02.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.395+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~LIY4XFRGZJ1V.0 size=1048576 2024-09-12T00:31:02.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.396+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~LIY4XFRGZJ1V.1 size=77338 2024-09-12T00:31:02.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.396+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=LIY4XFRGZJ1V tag=42I9PC5KISSW type=write size=2174490 2024-09-12T00:31:02.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.398+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~PDLV5EREWT50.0 size=1048576 2024-09-12T00:31:02.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.399+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~PDLV5EREWT50.1 size=229533 2024-09-12T00:31:02.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.401+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=PDLV5EREWT50 tag=HOEJI8MZ9F6H type=write size=2326685 2024-09-12T00:31:02.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.404+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~9YDNKVR0X803.0 size=1048576 2024-09-12T00:31:02.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.405+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~9YDNKVR0X803.1 size=191555 2024-09-12T00:31:02.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.405+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=9YDNKVR0X803 tag=VIJ1YKTLFQX9 type=write size=2288707 2024-09-12T00:31:02.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.407+0000 7f0362c73780 1 < suggested update operation key=G4G6E7KTTZY9 tag=35RPZ223GBQE type=del size=153747 2024-09-12T00:31:02.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.409+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=P4JM8HBSO55O type=del size=800944 2024-09-12T00:31:02.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.411+0000 7f0362c73780 1 < suggested update operation key=G4G6E7KTTZY9 tag=UN33JR903PUQ type=del size=1661996 2024-09-12T00:31:02.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.414+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~HWUSPT9BDX3D.0 size=1048576 2024-09-12T00:31:02.414 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.415+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~HWUSPT9BDX3D.1 size=1048576 2024-09-12T00:31:02.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.416+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~HWUSPT9BDX3D.2 size=743890 2024-09-12T00:31:02.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.416+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=HWUSPT9BDX3D tag=DMY5WDVAI8S9 type=write size=3889618 2024-09-12T00:31:02.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.419+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~TLZ6UW928CKZ.0 size=1048576 2024-09-12T00:31:02.418 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.420+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~TLZ6UW928CKZ.1 size=1048576 2024-09-12T00:31:02.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.421+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~TLZ6UW928CKZ.2 size=459770 2024-09-12T00:31:02.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.423+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=TLZ6UW928CKZ tag=X189L1A75VAY type=write size=3605498 2024-09-12T00:31:02.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.425+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=PWBZ50ZC0JI9 type=del size=1954188 2024-09-12T00:31:02.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.426+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~PP5KUHOZ80KD.0 size=1048576 2024-09-12T00:31:02.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.427+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~PP5KUHOZ80KD.1 size=510970 2024-09-12T00:31:02.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.430+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=PP5KUHOZ80KD tag=K6JVTZJQ91RS type=write size=2608122 2024-09-12T00:31:02.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.431+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=SL897RMR6RNL type=write size=155442 2024-09-12T00:31:02.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.433+0000 7f0362c73780 1 < completed write operation key=J5GSZCJW2BP1 tag=VDRNMF7BFJZ4 type=write size=120451 2024-09-12T00:31:02.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.436+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~AG8VZAL1OA3V.0 size=733263 2024-09-12T00:31:02.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.436+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=AG8VZAL1OA3V tag=ORRKKWZNGYYH type=write size=1781839 2024-09-12T00:31:02.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.437+0000 7f0362c73780 1 < canceled operation key=1IPW8SJ6SSU2 tag=FL65RM9ESI6Y type=del size=2479244 2024-09-12T00:31:02.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.439+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=C30TLG7LUTW2 type=del size=2984785 2024-09-12T00:31:02.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.440+0000 7f0362c73780 1 < completed delete operation key=PLAYMR18X9DZ tag=CMWQDOO9831G type=del 2024-09-12T00:31:02.441 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.443+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~DILJ722E7Q6Q.0 size=423556 2024-09-12T00:31:02.441 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.443+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=DILJ722E7Q6Q tag=TNYAPQ2FP3XP type=write size=1472132 2024-09-12T00:31:02.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.444+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=C1874EB3EV1C type=del 2024-09-12T00:31:02.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.446+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=TYXBFD32F1K3 type=del size=1097721 2024-09-12T00:31:02.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.447+0000 7f0362c73780 1 < canceled operation key=44YJP6XPIFT5 tag=P0I4TBXMN789 type=del size=2060672 2024-09-12T00:31:02.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.450+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~A2JL6IURFNXH.0 size=399545 2024-09-12T00:31:02.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.450+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=A2JL6IURFNXH tag=HXM22EFT6TXX type=write size=1448121 2024-09-12T00:31:02.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.451+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=XZCLFIIAFD5R type=del 2024-09-12T00:31:02.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.453+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=FWATI79D3VYT type=write size=159405 2024-09-12T00:31:02.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.454+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~FXDAW3TOT8O4.0 size=315123 2024-09-12T00:31:02.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.456+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=FXDAW3TOT8O4 tag=CA3UNKD7EFD3 type=write size=1363699 2024-09-12T00:31:02.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.458+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=D0I4XQ93ESPL type=del size=1370418 2024-09-12T00:31:02.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.460+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=NX5N65MZDUT9 type=del 2024-09-12T00:31:02.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.462+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~EHD4OMOIOXZY.0 size=1048576 2024-09-12T00:31:02.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.463+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~EHD4OMOIOXZY.1 size=1048576 2024-09-12T00:31:02.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.464+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~EHD4OMOIOXZY.2 size=881397 2024-09-12T00:31:02.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.464+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=EHD4OMOIOXZY tag=4UZ9WXGVPMRT type=write size=4027125 2024-09-12T00:31:02.464 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.466+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~VEI30DAA8XKN.0 size=1048576 2024-09-12T00:31:02.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.467+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~VEI30DAA8XKN.1 size=1048576 2024-09-12T00:31:02.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.467+0000 7f0362c73780 1 < canceled part key=_multipart_1UUNRPUKAINC.2~VEI30DAA8XKN.2 size=60669 2024-09-12T00:31:02.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.469+0000 7f0362c73780 1 < canceled multipart upload key=1UUNRPUKAINC upload=VEI30DAA8XKN tag=7IC6MRZEO7KE type=write size=3206397 2024-09-12T00:31:02.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.472+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~M0TI4BXLZYKN.0 size=1048576 2024-09-12T00:31:02.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.473+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~M0TI4BXLZYKN.1 size=1048576 2024-09-12T00:31:02.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.474+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~M0TI4BXLZYKN.2 size=40647 2024-09-12T00:31:02.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.474+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=M0TI4BXLZYKN tag=B0H2TY9UMNYC type=write size=3186375 2024-09-12T00:31:02.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.477+0000 7f0362c73780 1 < suggested update operation key=XMMZOX8MH3GT tag=CIQLRKL68XWL type=del size=2944672 2024-09-12T00:31:02.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.479+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~I3BVIYQU4WO9.0 size=1048576 2024-09-12T00:31:02.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.480+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~I3BVIYQU4WO9.1 size=1048576 2024-09-12T00:31:02.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.481+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~I3BVIYQU4WO9.2 size=93891 2024-09-12T00:31:02.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.481+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=I3BVIYQU4WO9 tag=OL3C3GOULYAQ type=write size=3239619 2024-09-12T00:31:02.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.483+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~LIY4XFRGZJ1V.0 size=1048576 2024-09-12T00:31:02.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.484+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~LIY4XFRGZJ1V.1 size=77338 2024-09-12T00:31:02.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.486+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=LIY4XFRGZJ1V tag=42I9PC5KISSW type=write size=2174490 2024-09-12T00:31:02.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.487+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=C13YP4UVVXVG type=del size=6828 2024-09-12T00:31:02.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.489+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~9YDNKVR0X803.0 size=1048576 2024-09-12T00:31:02.489 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.491+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~9YDNKVR0X803.1 size=191555 2024-09-12T00:31:02.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.493+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=9YDNKVR0X803 tag=VIJ1YKTLFQX9 type=write size=2288707 2024-09-12T00:31:02.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.495+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=TDV6UVM8J6DH type=del size=3337753 2024-09-12T00:31:02.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.496+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=P4JM8HBSO55O type=del 2024-09-12T00:31:02.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.497+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=OQDEKF1RCN89 type=del size=2878696 2024-09-12T00:31:02.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.499+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~HWUSPT9BDX3D.0 size=1048576 2024-09-12T00:31:02.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.500+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~HWUSPT9BDX3D.1 size=1048576 2024-09-12T00:31:02.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.501+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~HWUSPT9BDX3D.2 size=743890 2024-09-12T00:31:02.502 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.504+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=HWUSPT9BDX3D tag=DMY5WDVAI8S9 type=write size=3889618 2024-09-12T00:31:02.503 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.505+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=SUZM5JFYO4DJ type=del size=937689 2024-09-12T00:31:02.505 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.506+0000 7f0362c73780 1 < canceled operation key=XWW3882YBHAJ tag=PWBZ50ZC0JI9 type=del size=1954188 2024-09-12T00:31:02.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.509+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~9PUCF15EHFHO.0 size=1048576 2024-09-12T00:31:02.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.510+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~9PUCF15EHFHO.1 size=705429 2024-09-12T00:31:02.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.510+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=9PUCF15EHFHO tag=Z33MPA5LVJQ8 type=write size=2802581 2024-09-12T00:31:02.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.513+0000 7f0362c73780 1 < suggested remove operation key=VD0LFCNLI1YI tag=SL897RMR6RNL type=write 2024-09-12T00:31:02.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.515+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~0L6W1MSGDQJ4.0 size=1048576 2024-09-12T00:31:02.515 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.517+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~0L6W1MSGDQJ4.1 size=1048576 2024-09-12T00:31:02.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.518+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~0L6W1MSGDQJ4.2 size=268487 2024-09-12T00:31:02.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.518+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=0L6W1MSGDQJ4 tag=EO21PHMZFVD2 type=write size=3414215 2024-09-12T00:31:02.517 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.519+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~AG8VZAL1OA3V.0 size=733263 2024-09-12T00:31:02.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.521+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=AG8VZAL1OA3V tag=ORRKKWZNGYYH type=write size=1781839 2024-09-12T00:31:02.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.523+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=5LUIS6OYWXLC type=del size=2597574 2024-09-12T00:31:02.523 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.524+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=C30TLG7LUTW2 type=del 2024-09-12T00:31:02.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.526+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=G1AR2R7MQP3R type=write size=491885 2024-09-12T00:31:02.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.528+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~DILJ722E7Q6Q.0 size=423556 2024-09-12T00:31:02.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.530+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=DILJ722E7Q6Q tag=TNYAPQ2FP3XP type=write size=1472132 2024-09-12T00:31:02.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.531+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=C9PFM16BCTA8 type=del size=2462999 2024-09-12T00:31:02.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.534+0000 7f0362c73780 1 < suggested remove operation key=1SE6WTQMW6JU tag=TYXBFD32F1K3 type=del 2024-09-12T00:31:02.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.536+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=3CO2I7I112DC type=del size=49320 2024-09-12T00:31:02.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.537+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~A2JL6IURFNXH.0 size=399545 2024-09-12T00:31:02.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.540+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=A2JL6IURFNXH tag=HXM22EFT6TXX type=write size=1448121 2024-09-12T00:31:02.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.542+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~SVQQQS3QLNKR.0 size=1048576 2024-09-12T00:31:02.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.543+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~SVQQQS3QLNKR.1 size=1048576 2024-09-12T00:31:02.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.545+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~SVQQQS3QLNKR.2 size=586273 2024-09-12T00:31:02.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.545+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=SVQQQS3QLNKR tag=LOG007799NAB type=write size=3732001 2024-09-12T00:31:02.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.547+0000 7f0362c73780 1 < suggested remove operation key=927NCYXX8Z2P tag=FWATI79D3VYT type=write 2024-09-12T00:31:02.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.549+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=DZIGTUC6MB89 type=write size=448969 2024-09-12T00:31:02.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.552+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=D0I4XQ93ESPL type=del 2024-09-12T00:31:02.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.553+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=JAZ40HJW9CQB type=write size=942810 2024-09-12T00:31:02.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.555+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~EHD4OMOIOXZY.0 size=1048576 2024-09-12T00:31:02.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.556+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~EHD4OMOIOXZY.1 size=1048576 2024-09-12T00:31:02.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.557+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~EHD4OMOIOXZY.2 size=881397 2024-09-12T00:31:02.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.560+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=EHD4OMOIOXZY tag=4UZ9WXGVPMRT type=write size=4027125 2024-09-12T00:31:02.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.561+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=1TVAN9ATRVWL type=del size=51343 2024-09-12T00:31:02.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.563+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~M0TI4BXLZYKN.0 size=1048576 2024-09-12T00:31:02.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.564+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~M0TI4BXLZYKN.1 size=1048576 2024-09-12T00:31:02.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.564+0000 7f0362c73780 1 < canceled part key=_multipart_1MLL1T362X51.2~M0TI4BXLZYKN.2 size=40647 2024-09-12T00:31:02.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.567+0000 7f0362c73780 1 < canceled multipart upload key=1MLL1T362X51 upload=M0TI4BXLZYKN tag=B0H2TY9UMNYC type=write size=3186375 2024-09-12T00:31:02.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.569+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~035D49VJ72UL.0 size=1048576 2024-09-12T00:31:02.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.570+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~035D49VJ72UL.1 size=501948 2024-09-12T00:31:02.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.570+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=035D49VJ72UL tag=1BMVGS5CB45C type=write size=2599100 2024-09-12T00:31:02.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.572+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~I3BVIYQU4WO9.0 size=1048576 2024-09-12T00:31:02.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.573+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~I3BVIYQU4WO9.1 size=1048576 2024-09-12T00:31:02.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.573+0000 7f0362c73780 1 < canceled part key=_multipart_X4ZML0796M7F.2~I3BVIYQU4WO9.2 size=93891 2024-09-12T00:31:02.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.576+0000 7f0362c73780 1 < canceled multipart upload key=X4ZML0796M7F upload=I3BVIYQU4WO9 tag=OL3C3GOULYAQ type=write size=3239619 2024-09-12T00:31:02.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.579+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~CSA6EJJUJQIF.0 size=1048576 2024-09-12T00:31:02.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.580+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~CSA6EJJUJQIF.1 size=1048576 2024-09-12T00:31:02.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.581+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~CSA6EJJUJQIF.2 size=263342 2024-09-12T00:31:02.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.581+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=CSA6EJJUJQIF tag=D4G337Q2SNX8 type=write size=3409070 2024-09-12T00:31:02.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.582+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=C13YP4UVVXVG type=del 2024-09-12T00:31:02.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.585+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~EHJ7D1W3O59P.0 size=1048576 2024-09-12T00:31:02.584 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.586+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~EHJ7D1W3O59P.1 size=710000 2024-09-12T00:31:02.584 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.586+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=EHJ7D1W3O59P tag=UKUXDM1W6IPG type=write size=2807152 2024-09-12T00:31:02.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.588+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=TDV6UVM8J6DH type=del 2024-09-12T00:31:02.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.590+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=92UIC3C86067 type=del size=3514091 2024-09-12T00:31:02.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.591+0000 7f0362c73780 -1 < failed to complete operation key=927NCYXX8Z2P tag=OQDEKF1RCN89 type=del size=2878696: (22) Invalid argument 2024-09-12T00:31:02.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.594+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~42XP2QJ8MM7I.0 size=1048576 2024-09-12T00:31:02.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.595+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~42XP2QJ8MM7I.1 size=341484 2024-09-12T00:31:02.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.595+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=42XP2QJ8MM7I tag=LM30IVDX5QY2 type=write size=2438636 2024-09-12T00:31:02.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.596+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=SUZM5JFYO4DJ type=del 2024-09-12T00:31:02.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.599+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~N5NI2OMUJOD3.0 size=1048576 2024-09-12T00:31:02.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.600+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~N5NI2OMUJOD3.1 size=739036 2024-09-12T00:31:02.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.600+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=N5NI2OMUJOD3 tag=DNZSIP9Z5V3S type=write size=2836188 2024-09-12T00:31:02.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.602+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~9PUCF15EHFHO.0 size=1048576 2024-09-12T00:31:02.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.603+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~9PUCF15EHFHO.1 size=705429 2024-09-12T00:31:02.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.605+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=9PUCF15EHFHO tag=Z33MPA5LVJQ8 type=write size=2802581 2024-09-12T00:31:02.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.607+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=BS7CV1ZD7HLE type=del size=2457698 2024-09-12T00:31:02.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.607+0000 7f0362c73780 1 < canceled part key=_multipart_I3B48QD9E40S.2~0L6W1MSGDQJ4.0 size=1048576 2024-09-12T00:31:02.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.608+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~0L6W1MSGDQJ4.1 size=1048576 2024-09-12T00:31:02.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.610+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~0L6W1MSGDQJ4.2 size=268487 2024-09-12T00:31:02.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.612+0000 7f0362c73780 1 < canceled multipart upload key=I3B48QD9E40S upload=0L6W1MSGDQJ4 tag=EO21PHMZFVD2 type=write size=3414215 2024-09-12T00:31:02.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.615+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~6K0CJW2HNYZL.0 size=1048576 2024-09-12T00:31:02.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.616+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~6K0CJW2HNYZL.1 size=89854 2024-09-12T00:31:02.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.616+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=6K0CJW2HNYZL tag=LGZSTKE59AD4 type=write size=2187006 2024-09-12T00:31:02.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.617+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=5LUIS6OYWXLC type=del 2024-09-12T00:31:02.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.619+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=EH0UHFUOF2EJ type=del size=960220 2024-09-12T00:31:02.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.622+0000 7f0362c73780 1 < suggested update operation key=PYCRNXC9ITGF tag=G1AR2R7MQP3R type=write size=491885 2024-09-12T00:31:02.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.623+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=4NW19NQ5UGFS type=del size=3975762 2024-09-12T00:31:02.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.627+0000 7f0362c73780 1 < suggested update operation key=R4ABY5AY0S1P tag=C9PFM16BCTA8 type=del size=2462999 2024-09-12T00:31:02.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.630+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~60BGM8X90OK9.0 size=773578 2024-09-12T00:31:02.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.630+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=60BGM8X90OK9 tag=0LTESZBQRN5S type=write size=1822154 2024-09-12T00:31:02.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.633+0000 7f0362c73780 1 < suggested remove operation key=J5GSZCJW2BP1 tag=3CO2I7I112DC type=del 2024-09-12T00:31:02.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.634+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=6X27S2AWYX1C type=del size=707267 2024-09-12T00:31:02.634 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.636+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~SVQQQS3QLNKR.0 size=1048576 2024-09-12T00:31:02.634 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.636+0000 7f0362c73780 1 < canceled part key=_multipart_I3B48QD9E40S.2~SVQQQS3QLNKR.1 size=1048576 2024-09-12T00:31:02.635 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.637+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~SVQQQS3QLNKR.2 size=586273 2024-09-12T00:31:02.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.640+0000 7f0362c73780 1 < canceled multipart upload key=I3B48QD9E40S upload=SVQQQS3QLNKR tag=LOG007799NAB type=write size=3732001 2024-09-12T00:31:02.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.641+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=33K60JOKUI2L type=del size=1761654 2024-09-12T00:31:02.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.643+0000 7f0362c73780 1 < completed write operation key=HEN9LUUIDAR5 tag=DZIGTUC6MB89 type=write size=448969 2024-09-12T00:31:02.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.646+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~6AGD53FUHAW1.0 size=943140 2024-09-12T00:31:02.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.646+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=6AGD53FUHAW1 tag=XQKK5TJ1UOF8 type=write size=1991716 2024-09-12T00:31:02.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.647+0000 7f0362c73780 1 < completed write operation key=HEN9LUUIDAR5 tag=JAZ40HJW9CQB type=write size=942810 2024-09-12T00:31:02.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.649+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=YP1GXSWCGKUP type=del size=550763 2024-09-12T00:31:02.649 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.651+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=1TVAN9ATRVWL type=del 2024-09-12T00:31:02.651 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.652+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=XXEQ5C03SSZO type=write size=506256 2024-09-12T00:31:02.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.654+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~035D49VJ72UL.0 size=1048576 2024-09-12T00:31:02.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.654+0000 7f0362c73780 1 < canceled part key=_multipart_1IPW8SJ6SSU2.2~035D49VJ72UL.1 size=501948 2024-09-12T00:31:02.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.656+0000 7f0362c73780 1 < canceled multipart upload key=1IPW8SJ6SSU2 upload=035D49VJ72UL tag=1BMVGS5CB45C type=write size=2599100 2024-09-12T00:31:02.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.660+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~UY2UM8SACNGI.0 size=1048576 2024-09-12T00:31:02.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.661+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~UY2UM8SACNGI.1 size=1048576 2024-09-12T00:31:02.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.662+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~UY2UM8SACNGI.2 size=254611 2024-09-12T00:31:02.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.662+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=UY2UM8SACNGI tag=T1XN3KRAWVG2 type=write size=3400339 2024-09-12T00:31:02.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.664+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~CSA6EJJUJQIF.0 size=1048576 2024-09-12T00:31:02.663 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.665+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~CSA6EJJUJQIF.1 size=1048576 2024-09-12T00:31:02.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.667+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~CSA6EJJUJQIF.2 size=263342 2024-09-12T00:31:02.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.669+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=CSA6EJJUJQIF tag=D4G337Q2SNX8 type=write size=3409070 2024-09-12T00:31:02.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.671+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=SKKB5EUJ7UH4 type=write size=728945 2024-09-12T00:31:02.671 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.673+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~EHJ7D1W3O59P.0 size=1048576 2024-09-12T00:31:02.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.674+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~EHJ7D1W3O59P.1 size=710000 2024-09-12T00:31:02.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.676+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=EHJ7D1W3O59P tag=UKUXDM1W6IPG type=write size=2807152 2024-09-12T00:31:02.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.678+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=UTYJSZ30KTFV type=del size=3500662 2024-09-12T00:31:02.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.681+0000 7f0362c73780 1 < suggested update operation key=1MLL1T362X51 tag=92UIC3C86067 type=del size=3514091 2024-09-12T00:31:02.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.682+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=QDR336XDFO8M type=del size=4192715 2024-09-12T00:31:02.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.684+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~42XP2QJ8MM7I.0 size=1048576 2024-09-12T00:31:02.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.685+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~42XP2QJ8MM7I.1 size=341484 2024-09-12T00:31:02.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.687+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=42XP2QJ8MM7I tag=LM30IVDX5QY2 type=write size=2438636 2024-09-12T00:31:02.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.690+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~K5C4KOROZBB2.0 size=1048576 2024-09-12T00:31:02.690 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.692+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~K5C4KOROZBB2.1 size=761570 2024-09-12T00:31:02.690 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.692+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=K5C4KOROZBB2 tag=Y0DX31ONHQ0Q type=write size=2858722 2024-09-12T00:31:02.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.693+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~N5NI2OMUJOD3.0 size=1048576 2024-09-12T00:31:02.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.695+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~N5NI2OMUJOD3.1 size=739036 2024-09-12T00:31:02.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.697+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=N5NI2OMUJOD3 tag=DNZSIP9Z5V3S type=write size=2836188 2024-09-12T00:31:02.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.699+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~R111XOJ3GT4J.0 size=153151 2024-09-12T00:31:02.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.699+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=R111XOJ3GT4J tag=6QH8B3CNJEGA type=write size=1201727 2024-09-12T00:31:02.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.701+0000 7f0362c73780 1 < canceled operation key=KWDEKRO3WICD tag=BS7CV1ZD7HLE type=del size=2457698 2024-09-12T00:31:02.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.703+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~93IVZJ0UZIIW.0 size=673285 2024-09-12T00:31:02.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.703+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=93IVZJ0UZIIW tag=3NB0PEI50YTW type=write size=1721861 2024-09-12T00:31:02.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.705+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~6K0CJW2HNYZL.0 size=1048576 2024-09-12T00:31:02.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.706+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~6K0CJW2HNYZL.1 size=89854 2024-09-12T00:31:02.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.708+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=6K0CJW2HNYZL tag=LGZSTKE59AD4 type=write size=2187006 2024-09-12T00:31:02.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.711+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~GV5A3B6VVO1W.0 size=1048576 2024-09-12T00:31:02.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.712+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~GV5A3B6VVO1W.1 size=998390 2024-09-12T00:31:02.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.712+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=GV5A3B6VVO1W tag=G88W7PEOQAC3 type=write size=3095542 2024-09-12T00:31:02.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.713+0000 7f0362c73780 -1 < failed to complete operation key=1MLL1T362X51 tag=EH0UHFUOF2EJ type=del size=960220: (22) Invalid argument 2024-09-12T00:31:02.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.716+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~YN8X7NHFN4XC.0 size=1048576 2024-09-12T00:31:02.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.717+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~YN8X7NHFN4XC.1 size=1048576 2024-09-12T00:31:02.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.718+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~YN8X7NHFN4XC.2 size=618797 2024-09-12T00:31:02.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.718+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=YN8X7NHFN4XC tag=H2EMUHPGB5OV type=write size=3764525 2024-09-12T00:31:02.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.720+0000 7f0362c73780 -1 < failed to complete operation key=1MLL1T362X51 tag=4NW19NQ5UGFS type=del size=3975762: (22) Invalid argument 2024-09-12T00:31:02.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.722+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~RAN0IZYXRW1I.0 size=1048576 2024-09-12T00:31:02.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.724+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~RAN0IZYXRW1I.1 size=1048576 2024-09-12T00:31:02.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.725+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~RAN0IZYXRW1I.2 size=828978 2024-09-12T00:31:02.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.725+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=RAN0IZYXRW1I tag=CSW9Q07JOU8I type=write size=3974706 2024-09-12T00:31:02.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.726+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~60BGM8X90OK9.0 size=773578 2024-09-12T00:31:02.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.728+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=60BGM8X90OK9 tag=0LTESZBQRN5S type=write size=1822154 2024-09-12T00:31:02.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.730+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=BHLCZGRGO7WZ type=del size=1560619 2024-09-12T00:31:02.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.731+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=6X27S2AWYX1C type=del 2024-09-12T00:31:02.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.735+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~RIYS3LKE03GA.0 size=552424 2024-09-12T00:31:02.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.735+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=RIYS3LKE03GA tag=8ZQZF3UX3WFI type=write size=1601000 2024-09-12T00:31:02.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.736+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=33K60JOKUI2L type=del 2024-09-12T00:31:02.736 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.737+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=IL1BKMCMXQ3T type=write size=797363 2024-09-12T00:31:02.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.739+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~6AGD53FUHAW1.0 size=943140 2024-09-12T00:31:02.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.741+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=6AGD53FUHAW1 tag=XQKK5TJ1UOF8 type=write size=1991716 2024-09-12T00:31:02.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.742+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=YDKCHOJ1N797 type=del size=1378923 2024-09-12T00:31:02.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.744+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=YP1GXSWCGKUP type=del 2024-09-12T00:31:02.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.745+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=OLS1QK1WG5CW type=write size=617320 2024-09-12T00:31:02.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.747+0000 7f0362c73780 1 < completed write operation key=PLAYMR18X9DZ tag=XXEQ5C03SSZO type=write size=506256 2024-09-12T00:31:02.748 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.749+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~433AJZWXS0X3.0 size=258676 2024-09-12T00:31:02.748 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.749+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=433AJZWXS0X3 tag=3DT3FSWSS3RO type=write size=1307252 2024-09-12T00:31:02.748 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.750+0000 7f0362c73780 1 < canceled part key=_multipart_XMMZOX8MH3GT.2~UY2UM8SACNGI.0 size=1048576 2024-09-12T00:31:02.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.751+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~UY2UM8SACNGI.1 size=1048576 2024-09-12T00:31:02.750 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.752+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~UY2UM8SACNGI.2 size=254611 2024-09-12T00:31:02.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.754+0000 7f0362c73780 1 < canceled multipart upload key=XMMZOX8MH3GT upload=UY2UM8SACNGI tag=T1XN3KRAWVG2 type=write size=3400339 2024-09-12T00:31:02.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.756+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=O22JK41NCNUV type=del size=68419 2024-09-12T00:31:02.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.757+0000 7f0362c73780 1 < completed write operation key=Q6M0D2698CUZ tag=SKKB5EUJ7UH4 type=write size=728945 2024-09-12T00:31:02.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.759+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=2VQIJ136PT57 type=del size=1876514 2024-09-12T00:31:02.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.760+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=UTYJSZ30KTFV type=del 2024-09-12T00:31:02.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.761+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=WLL0UOFG4Z8J type=del size=2305245 2024-09-12T00:31:02.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.763+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=QDR336XDFO8M type=del 2024-09-12T00:31:02.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.766+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~K4HQGOQL2CPL.0 size=200445 2024-09-12T00:31:02.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.766+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=K4HQGOQL2CPL tag=PGDXA38IQ1Y2 type=write size=1249021 2024-09-12T00:31:02.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.767+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~K5C4KOROZBB2.0 size=1048576 2024-09-12T00:31:02.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.768+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~K5C4KOROZBB2.1 size=761570 2024-09-12T00:31:02.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.771+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=K5C4KOROZBB2 tag=Y0DX31ONHQ0Q type=write size=2858722 2024-09-12T00:31:02.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.773+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~9DBWW7CD6IPI.0 size=3070 2024-09-12T00:31:02.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.773+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=9DBWW7CD6IPI tag=T24NTWV68GFO type=write size=1051646 2024-09-12T00:31:02.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.775+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~R111XOJ3GT4J.0 size=153151 2024-09-12T00:31:02.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.777+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=R111XOJ3GT4J tag=6QH8B3CNJEGA type=write size=1201727 2024-09-12T00:31:02.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.779+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=9U5WY6JV119P type=del size=3057240 2024-09-12T00:31:02.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.780+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~93IVZJ0UZIIW.0 size=673285 2024-09-12T00:31:02.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.783+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=93IVZJ0UZIIW tag=3NB0PEI50YTW type=write size=1721861 2024-09-12T00:31:02.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.784+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=AVSM2DCRIWYC type=write size=890870 2024-09-12T00:31:02.784 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.786+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~GV5A3B6VVO1W.0 size=1048576 2024-09-12T00:31:02.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.787+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~GV5A3B6VVO1W.1 size=998390 2024-09-12T00:31:02.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.789+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=GV5A3B6VVO1W tag=G88W7PEOQAC3 type=write size=3095542 2024-09-12T00:31:02.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.792+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~0USOCJREEM76.0 size=176694 2024-09-12T00:31:02.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.792+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=0USOCJREEM76 tag=SSGESPMRBBCT type=write size=1225270 2024-09-12T00:31:02.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.793+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~YN8X7NHFN4XC.0 size=1048576 2024-09-12T00:31:02.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.795+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~YN8X7NHFN4XC.1 size=1048576 2024-09-12T00:31:02.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.796+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~YN8X7NHFN4XC.2 size=618797 2024-09-12T00:31:02.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.799+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=YN8X7NHFN4XC tag=H2EMUHPGB5OV type=write size=3764525 2024-09-12T00:31:02.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.801+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~IYRS5JD891UV.0 size=898261 2024-09-12T00:31:02.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.801+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=IYRS5JD891UV tag=88JEA8Q0K4MO type=write size=1946837 2024-09-12T00:31:02.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.803+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~RAN0IZYXRW1I.0 size=1048576 2024-09-12T00:31:02.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.804+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~RAN0IZYXRW1I.1 size=1048576 2024-09-12T00:31:02.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.805+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~RAN0IZYXRW1I.2 size=828978 2024-09-12T00:31:02.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.807+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=RAN0IZYXRW1I tag=CSW9Q07JOU8I type=write size=3974706 2024-09-12T00:31:02.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.809+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=HJWQKYHKTEDD type=write size=933165 2024-09-12T00:31:02.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.810+0000 7f0362c73780 1 < completed delete operation key=XWW3882YBHAJ tag=BHLCZGRGO7WZ type=del 2024-09-12T00:31:02.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.812+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=A33EKOSVVP9S type=del size=2898584 2024-09-12T00:31:02.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.813+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~RIYS3LKE03GA.0 size=552424 2024-09-12T00:31:02.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.815+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=RIYS3LKE03GA tag=8ZQZF3UX3WFI type=write size=1601000 2024-09-12T00:31:02.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.818+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~7LWFJ201F6PL.0 size=1048576 2024-09-12T00:31:02.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.819+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~7LWFJ201F6PL.1 size=831181 2024-09-12T00:31:02.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.819+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=7LWFJ201F6PL tag=2S97P8FVPYCB type=write size=2928333 2024-09-12T00:31:02.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.823+0000 7f0362c73780 1 < suggested remove operation key=G4G6E7KTTZY9 tag=IL1BKMCMXQ3T type=write 2024-09-12T00:31:02.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.828+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~90XL9O2QI98C.0 size=1048576 2024-09-12T00:31:02.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.829+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~90XL9O2QI98C.1 size=595088 2024-09-12T00:31:02.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.829+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=90XL9O2QI98C tag=V85AFWORKPLK type=write size=2692240 2024-09-12T00:31:02.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.831+0000 7f0362c73780 1 < canceled operation key=6AYDT9X4LC6T tag=YDKCHOJ1N797 type=del size=1378923 2024-09-12T00:31:02.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.832+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=FL0SFNEETULW type=write size=156990 2024-09-12T00:31:02.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.834+0000 7f0362c73780 1 < completed write operation key=R4ABY5AY0S1P tag=OLS1QK1WG5CW type=write size=617320 2024-09-12T00:31:02.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.836+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~JZHZJ5VR91TJ.0 size=1048576 2024-09-12T00:31:02.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.837+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~JZHZJ5VR91TJ.1 size=1048576 2024-09-12T00:31:02.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.839+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~JZHZJ5VR91TJ.2 size=781583 2024-09-12T00:31:02.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.839+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=JZHZJ5VR91TJ tag=L8LUG0FLMKEC type=write size=3927311 2024-09-12T00:31:02.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.840+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~433AJZWXS0X3.0 size=258676 2024-09-12T00:31:02.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.842+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=433AJZWXS0X3 tag=3DT3FSWSS3RO type=write size=1307252 2024-09-12T00:31:02.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.844+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=I4TWK6JI79OU type=write size=881912 2024-09-12T00:31:02.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.845+0000 7f0362c73780 1 < canceled operation key=XMMZOX8MH3GT tag=O22JK41NCNUV type=del size=68419 2024-09-12T00:31:02.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.846+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=LOZHPQCRZCLX type=write size=556733 2024-09-12T00:31:02.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.848+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=2VQIJ136PT57 type=del 2024-09-12T00:31:02.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.849+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=IA8ZB1GOA3Y9 type=del size=415474 2024-09-12T00:31:02.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.851+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=WLL0UOFG4Z8J type=del 2024-09-12T00:31:02.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.852+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=13OCXOKVDGJY type=del size=2721714 2024-09-12T00:31:02.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.854+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~K4HQGOQL2CPL.0 size=200445 2024-09-12T00:31:02.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.856+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=K4HQGOQL2CPL tag=PGDXA38IQ1Y2 type=write size=1249021 2024-09-12T00:31:02.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.857+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=F5BYD3K6EEBZ type=del size=3366932 2024-09-12T00:31:02.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.859+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~9DBWW7CD6IPI.0 size=3070 2024-09-12T00:31:02.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.861+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=9DBWW7CD6IPI tag=T24NTWV68GFO type=write size=1051646 2024-09-12T00:31:02.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.863+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=PM8TWKMB1T47 type=del size=4063983 2024-09-12T00:31:02.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.864+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=9U5WY6JV119P type=del 2024-09-12T00:31:02.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.867+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~IY645D0IO8WV.0 size=1048576 2024-09-12T00:31:02.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.868+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~IY645D0IO8WV.1 size=842763 2024-09-12T00:31:02.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.868+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=IY645D0IO8WV tag=DY8C90EYWDNO type=write size=2939915 2024-09-12T00:31:02.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.870+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=AVSM2DCRIWYC type=write size=890870 2024-09-12T00:31:02.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.872+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~R7ML3PW1UDHZ.0 size=1048576 2024-09-12T00:31:02.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.873+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~R7ML3PW1UDHZ.1 size=472043 2024-09-12T00:31:02.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.873+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=R7ML3PW1UDHZ tag=0Z9D93GO2LI1 type=write size=2569195 2024-09-12T00:31:02.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.875+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~0USOCJREEM76.0 size=176694 2024-09-12T00:31:02.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.877+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=0USOCJREEM76 tag=SSGESPMRBBCT type=write size=1225270 2024-09-12T00:31:02.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.880+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~WGDV1UUBPDHW.0 size=1048576 2024-09-12T00:31:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.881+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~WGDV1UUBPDHW.1 size=1048576 2024-09-12T00:31:02.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.882+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~WGDV1UUBPDHW.2 size=467067 2024-09-12T00:31:02.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.882+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=WGDV1UUBPDHW tag=YC4C0Y5V1WMU type=write size=3612795 2024-09-12T00:31:02.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.884+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~IYRS5JD891UV.0 size=898261 2024-09-12T00:31:02.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.886+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=IYRS5JD891UV tag=88JEA8Q0K4MO type=write size=1946837 2024-09-12T00:31:02.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.887+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=8JYZHE8ME4HG type=del size=2406175 2024-09-12T00:31:02.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.889+0000 7f0362c73780 1 < completed write operation key=KWDEKRO3WICD tag=HJWQKYHKTEDD type=write size=933165 2024-09-12T00:31:02.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.890+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=N1AOZMS2K1OE type=write size=988352 2024-09-12T00:31:02.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.892+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=A33EKOSVVP9S type=del 2024-09-12T00:31:02.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.894+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~HEVATWFTCC1F.0 size=1048576 2024-09-12T00:31:02.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.895+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~HEVATWFTCC1F.1 size=1048576 2024-09-12T00:31:02.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.897+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~HEVATWFTCC1F.2 size=39117 2024-09-12T00:31:02.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.897+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=HEVATWFTCC1F tag=75RN1UB2FCQ0 type=write size=3184845 2024-09-12T00:31:02.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.897+0000 7f0362c73780 1 < canceled part key=_multipart_HWSQFSK29S0V.2~7LWFJ201F6PL.0 size=1048576 2024-09-12T00:31:02.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.898+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~7LWFJ201F6PL.1 size=831181 2024-09-12T00:31:02.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.901+0000 7f0362c73780 1 < canceled multipart upload key=HWSQFSK29S0V upload=7LWFJ201F6PL tag=2S97P8FVPYCB type=write size=2928333 2024-09-12T00:31:02.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.903+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~D5Q1AC1RAMWH.0 size=664703 2024-09-12T00:31:02.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.903+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=D5Q1AC1RAMWH tag=3QTBRISF3W97 type=write size=1713279 2024-09-12T00:31:02.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.904+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~90XL9O2QI98C.0 size=1048576 2024-09-12T00:31:02.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.905+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~90XL9O2QI98C.1 size=595088 2024-09-12T00:31:02.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.908+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=90XL9O2QI98C tag=V85AFWORKPLK type=write size=2692240 2024-09-12T00:31:02.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.909+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=ZZDE46P3OVY8 type=write size=66507 2024-09-12T00:31:02.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.911+0000 7f0362c73780 1 < completed write operation key=1IPW8SJ6SSU2 tag=FL0SFNEETULW type=write size=156990 2024-09-12T00:31:02.912 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.913+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~6GC6I2IDAD0S.0 size=1048576 2024-09-12T00:31:02.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.915+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~6GC6I2IDAD0S.1 size=1048576 2024-09-12T00:31:02.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.916+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~6GC6I2IDAD0S.2 size=280089 2024-09-12T00:31:02.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.916+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=6GC6I2IDAD0S tag=BZ12QKKZZDV1 type=write size=3425817 2024-09-12T00:31:02.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.917+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~JZHZJ5VR91TJ.0 size=1048576 2024-09-12T00:31:02.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.918+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~JZHZJ5VR91TJ.1 size=1048576 2024-09-12T00:31:02.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.920+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~JZHZJ5VR91TJ.2 size=781583 2024-09-12T00:31:02.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.922+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=JZHZJ5VR91TJ tag=L8LUG0FLMKEC type=write size=3927311 2024-09-12T00:31:02.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.924+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~I65A03MQEH7Q.0 size=1048576 2024-09-12T00:31:02.924 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.926+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~I65A03MQEH7Q.1 size=301865 2024-09-12T00:31:02.924 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.926+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=I65A03MQEH7Q tag=2UXPV3V106IZ type=write size=2399017 2024-09-12T00:31:02.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.927+0000 7f0362c73780 1 < completed write operation key=PYCRNXC9ITGF tag=I4TWK6JI79OU type=write size=881912 2024-09-12T00:31:02.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.929+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=LHQWDD1Z8UD7 type=del size=3828279 2024-09-12T00:31:02.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.930+0000 7f0362c73780 1 < completed write operation key=G4G6E7KTTZY9 tag=LOZHPQCRZCLX type=write size=556733 2024-09-12T00:31:02.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.932+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=XE5592LFMK94 type=del size=3342140 2024-09-12T00:31:02.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.935+0000 7f0362c73780 1 < suggested update operation key=G4G6E7KTTZY9 tag=IA8ZB1GOA3Y9 type=del size=415474 2024-09-12T00:31:02.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.936+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=PRHZND8FWOSC type=del size=2414279 2024-09-12T00:31:02.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.938+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=13OCXOKVDGJY type=del 2024-09-12T00:31:02.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.940+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~7SYVBSXQXH00.0 size=167436 2024-09-12T00:31:02.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.940+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=7SYVBSXQXH00 tag=70IDX4ATRBSV type=write size=1216012 2024-09-12T00:31:02.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.943+0000 7f0362c73780 1 < suggested update operation key=Q6M0D2698CUZ tag=F5BYD3K6EEBZ type=del size=3366932 2024-09-12T00:31:02.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.945+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=OGRVIITO4M2U type=del size=1820195 2024-09-12T00:31:02.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.946+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=PM8TWKMB1T47 type=del 2024-09-12T00:31:02.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.948+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=3VUWX249Q0U2 type=del size=3268988 2024-09-12T00:31:02.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.949+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~IY645D0IO8WV.0 size=1048576 2024-09-12T00:31:02.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.951+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~IY645D0IO8WV.1 size=842763 2024-09-12T00:31:02.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.953+0000 7f0362c73780 1 < completed multipart upload key=927NCYXX8Z2P upload=IY645D0IO8WV tag=DY8C90EYWDNO type=write size=2939915 2024-09-12T00:31:02.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.955+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=7URWI23G43O6 type=del size=3989677 2024-09-12T00:31:02.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.956+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~R7ML3PW1UDHZ.0 size=1048576 2024-09-12T00:31:02.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.958+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~R7ML3PW1UDHZ.1 size=472043 2024-09-12T00:31:02.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.961+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=R7ML3PW1UDHZ tag=0Z9D93GO2LI1 type=write size=2569195 2024-09-12T00:31:02.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.962+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=5OVE0VMYT7HN type=write size=641156 2024-09-12T00:31:02.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.964+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~WGDV1UUBPDHW.0 size=1048576 2024-09-12T00:31:02.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.965+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~WGDV1UUBPDHW.1 size=1048576 2024-09-12T00:31:02.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.966+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~WGDV1UUBPDHW.2 size=467067 2024-09-12T00:31:02.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.969+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=WGDV1UUBPDHW tag=YC4C0Y5V1WMU type=write size=3612795 2024-09-12T00:31:02.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.971+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~KBXQL3S0S791.0 size=1048576 2024-09-12T00:31:02.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.972+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~KBXQL3S0S791.1 size=688255 2024-09-12T00:31:02.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.972+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=KBXQL3S0S791 tag=M8US61KKXIGS type=write size=2785407 2024-09-12T00:31:02.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.974+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=8JYZHE8ME4HG type=del 2024-09-12T00:31:02.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.977+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~6KB4HT5Q7G4O.0 size=181407 2024-09-12T00:31:02.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.977+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=6KB4HT5Q7G4O tag=5C3D0AB24OKT type=write size=1229983 2024-09-12T00:31:02.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.979+0000 7f0362c73780 1 < canceled operation key=PLAYMR18X9DZ tag=N1AOZMS2K1OE type=write size=988352 2024-09-12T00:31:02.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.980+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=3A1CTT2VAEIS type=del size=1372666 2024-09-12T00:31:02.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.982+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~HEVATWFTCC1F.0 size=1048576 2024-09-12T00:31:02.981 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.983+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~HEVATWFTCC1F.1 size=1048576 2024-09-12T00:31:02.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.984+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~HEVATWFTCC1F.2 size=39117 2024-09-12T00:31:02.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.986+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=HEVATWFTCC1F tag=75RN1UB2FCQ0 type=write size=3184845 2024-09-12T00:31:02.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.987+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=JFIYUX1Y1PYK type=write size=19193 2024-09-12T00:31:02.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.989+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~D5Q1AC1RAMWH.0 size=664703 2024-09-12T00:31:02.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.991+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=D5Q1AC1RAMWH tag=3QTBRISF3W97 type=write size=1713279 2024-09-12T00:31:02.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.992+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=OK58UVS6HFRT type=del size=487847 2024-09-12T00:31:02.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.994+0000 7f0362c73780 1 < canceled operation key=PLAYMR18X9DZ tag=ZZDE46P3OVY8 type=write size=66507 2024-09-12T00:31:02.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.996+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~0IUP07W08Z5V.0 size=1048576 2024-09-12T00:31:02.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.997+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~0IUP07W08Z5V.1 size=1048576 2024-09-12T00:31:02.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.999+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~0IUP07W08Z5V.2 size=848428 2024-09-12T00:31:02.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:02.999+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=0IUP07W08Z5V tag=HQPV17LS5I74 type=write size=3994156 2024-09-12T00:31:02.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.000+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~6GC6I2IDAD0S.0 size=1048576 2024-09-12T00:31:03.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.002+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~6GC6I2IDAD0S.1 size=1048576 2024-09-12T00:31:03.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.003+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~6GC6I2IDAD0S.2 size=280089 2024-09-12T00:31:03.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.005+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=6GC6I2IDAD0S tag=BZ12QKKZZDV1 type=write size=3425817 2024-09-12T00:31:03.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.007+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=N068AE2YJHJ1 type=del size=3210611 2024-09-12T00:31:03.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.008+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~I65A03MQEH7Q.0 size=1048576 2024-09-12T00:31:03.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.009+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~I65A03MQEH7Q.1 size=301865 2024-09-12T00:31:03.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.011+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=I65A03MQEH7Q tag=2UXPV3V106IZ type=write size=2399017 2024-09-12T00:31:03.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.013+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=Q1OO8YL2DC2C type=del size=2417415 2024-09-12T00:31:03.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.015+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=LHQWDD1Z8UD7 type=del 2024-09-12T00:31:03.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.018+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~K84P6W533I5V.0 size=1048576 2024-09-12T00:31:03.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.019+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~K84P6W533I5V.1 size=1048576 2024-09-12T00:31:03.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.020+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~K84P6W533I5V.2 size=260979 2024-09-12T00:31:03.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.020+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=K84P6W533I5V tag=4LNXKNR9GM5W type=write size=3406707 2024-09-12T00:31:03.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.022+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=XE5592LFMK94 type=del 2024-09-12T00:31:03.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.023+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=ZP9OI1EIPNE2 type=del size=1879925 2024-09-12T00:31:03.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.025+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=PRHZND8FWOSC type=del 2024-09-12T00:31:03.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.028+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~QX330HAERU6T.0 size=1048576 2024-09-12T00:31:03.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.029+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~QX330HAERU6T.1 size=776519 2024-09-12T00:31:03.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.029+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=QX330HAERU6T tag=B53FRZBM7DNT type=write size=2873671 2024-09-12T00:31:03.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.031+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~7SYVBSXQXH00.0 size=167436 2024-09-12T00:31:03.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.033+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=7SYVBSXQXH00 tag=70IDX4ATRBSV type=write size=1216012 2024-09-12T00:31:03.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.034+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=T2JSHGF8T41B type=del size=1345666 2024-09-12T00:31:03.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.036+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=OGRVIITO4M2U type=del 2024-09-12T00:31:03.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.039+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~DZYSK8YL66EA.0 size=936341 2024-09-12T00:31:03.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.039+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=DZYSK8YL66EA tag=9F4YR34Z6UO2 type=write size=1984917 2024-09-12T00:31:03.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.042+0000 7f0362c73780 1 < suggested remove operation key=6AYDT9X4LC6T tag=3VUWX249Q0U2 type=del 2024-09-12T00:31:03.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.043+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=W20LFM35EJO1 type=del size=2468944 2024-09-12T00:31:03.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.044+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=7URWI23G43O6 type=del 2024-09-12T00:31:03.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.047+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~DHAW9GF9CPGR.0 size=592772 2024-09-12T00:31:03.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.047+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=DHAW9GF9CPGR tag=DX8UG2AQK335 type=write size=1641348 2024-09-12T00:31:03.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.050+0000 7f0362c73780 1 < suggested update operation key=PYCRNXC9ITGF tag=5OVE0VMYT7HN type=write size=641156 2024-09-12T00:31:03.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.051+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=VLCN723MRHE0 type=del size=2969930 2024-09-12T00:31:03.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.053+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~KBXQL3S0S791.0 size=1048576 2024-09-12T00:31:03.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.054+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~KBXQL3S0S791.1 size=688255 2024-09-12T00:31:03.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.056+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=KBXQL3S0S791 tag=M8US61KKXIGS type=write size=2785407 2024-09-12T00:31:03.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.058+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=XK2SF774N771 type=del size=2270714 2024-09-12T00:31:03.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.060+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~6KB4HT5Q7G4O.0 size=181407 2024-09-12T00:31:03.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.062+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=6KB4HT5Q7G4O tag=5C3D0AB24OKT type=write size=1229983 2024-09-12T00:31:03.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.064+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=F7742EG4ZOAD type=del size=2196534 2024-09-12T00:31:03.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.065+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=3A1CTT2VAEIS type=del 2024-09-12T00:31:03.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.068+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~48REACDFV3MZ.0 size=650478 2024-09-12T00:31:03.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.068+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=48REACDFV3MZ tag=YHZOCUMMTOO4 type=write size=1699054 2024-09-12T00:31:03.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.069+0000 7f0362c73780 1 < completed write operation key=G2HW98G6624O tag=JFIYUX1Y1PYK type=write size=19193 2024-09-12T00:31:03.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.071+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=NDWDSOPVP9PG type=del size=2903454 2024-09-12T00:31:03.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.073+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=OK58UVS6HFRT type=del 2024-09-12T00:31:03.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.075+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~MEWLHFGG59Z0.0 size=1048576 2024-09-12T00:31:03.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.077+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~MEWLHFGG59Z0.1 size=725875 2024-09-12T00:31:03.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.077+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=MEWLHFGG59Z0 tag=C6HH0338AX8G type=write size=2823027 2024-09-12T00:31:03.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.077+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~0IUP07W08Z5V.0 size=1048576 2024-09-12T00:31:03.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.078+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~0IUP07W08Z5V.1 size=1048576 2024-09-12T00:31:03.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.078+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~0IUP07W08Z5V.2 size=848428 2024-09-12T00:31:03.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.080+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=0IUP07W08Z5V tag=HQPV17LS5I74 type=write size=3994156 2024-09-12T00:31:03.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.082+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=ZVD9QGKCSX0D type=del size=3855068 2024-09-12T00:31:03.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.084+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=N068AE2YJHJ1 type=del 2024-09-12T00:31:03.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.086+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~TSM8LIDO0PTB.0 size=1048576 2024-09-12T00:31:03.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.087+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~TSM8LIDO0PTB.1 size=144486 2024-09-12T00:31:03.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.087+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=TSM8LIDO0PTB tag=ZSMXEZWPZ84P type=write size=2241638 2024-09-12T00:31:03.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.089+0000 7f0362c73780 -1 < failed to complete operation key=6AYDT9X4LC6T tag=Q1OO8YL2DC2C type=del size=2417415: (22) Invalid argument 2024-09-12T00:31:03.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.090+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=SW4IGCYK1OFL type=write size=155318 2024-09-12T00:31:03.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.092+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~K84P6W533I5V.0 size=1048576 2024-09-12T00:31:03.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.093+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~K84P6W533I5V.1 size=1048576 2024-09-12T00:31:03.092 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.094+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~K84P6W533I5V.2 size=260979 2024-09-12T00:31:03.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.098+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=K84P6W533I5V tag=4LNXKNR9GM5W type=write size=3406707 2024-09-12T00:31:03.097 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.099+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=KZYQTRRH2A3U type=del size=2677926 2024-09-12T00:31:03.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.101+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=ZP9OI1EIPNE2 type=del 2024-09-12T00:31:03.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.102+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=J38XBB2W9TFP type=del size=2275347 2024-09-12T00:31:03.102 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.104+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~QX330HAERU6T.0 size=1048576 2024-09-12T00:31:03.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.105+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~QX330HAERU6T.1 size=776519 2024-09-12T00:31:03.105 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.107+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=QX330HAERU6T tag=B53FRZBM7DNT type=write size=2873671 2024-09-12T00:31:03.108 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.110+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~BTD1KWFEOASD.0 size=1048576 2024-09-12T00:31:03.109 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.111+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~BTD1KWFEOASD.1 size=1048576 2024-09-12T00:31:03.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.112+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~BTD1KWFEOASD.2 size=782538 2024-09-12T00:31:03.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.112+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=BTD1KWFEOASD tag=36FY3R2R732N type=write size=3928266 2024-09-12T00:31:03.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.114+0000 7f0362c73780 1 < suggested remove operation key=Q6M0D2698CUZ tag=T2JSHGF8T41B type=del 2024-09-12T00:31:03.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.116+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=73585BJMWPBZ type=del size=1239863 2024-09-12T00:31:03.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.117+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~DZYSK8YL66EA.0 size=936341 2024-09-12T00:31:03.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.120+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=DZYSK8YL66EA tag=9F4YR34Z6UO2 type=write size=1984917 2024-09-12T00:31:03.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.121+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=5UE4QQRMVURE type=del size=467665 2024-09-12T00:31:03.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.123+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=W20LFM35EJO1 type=del 2024-09-12T00:31:03.122 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.124+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=QW1YMHFFM0MG type=del size=2862938 2024-09-12T00:31:03.124 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.126+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~DHAW9GF9CPGR.0 size=592772 2024-09-12T00:31:03.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.128+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=DHAW9GF9CPGR tag=DX8UG2AQK335 type=write size=1641348 2024-09-12T00:31:03.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.131+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~2QXSUOGP1MBS.0 size=571727 2024-09-12T00:31:03.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.131+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=2QXSUOGP1MBS tag=F0HNATVBHM0W type=write size=1620303 2024-09-12T00:31:03.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.132+0000 7f0362c73780 1 < canceled operation key=PLAYMR18X9DZ tag=VLCN723MRHE0 type=del size=2969930 2024-09-12T00:31:03.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.134+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=8WA9MNDPLTPI type=del size=2278076 2024-09-12T00:31:03.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.135+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=XK2SF774N771 type=del 2024-09-12T00:31:03.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.137+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=FFNKPNNNELC6 type=del size=1182668 2024-09-12T00:31:03.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.138+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=F7742EG4ZOAD type=del 2024-09-12T00:31:03.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.140+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=CYKMX2Q84CJD type=del size=1237198 2024-09-12T00:31:03.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.141+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~48REACDFV3MZ.0 size=650478 2024-09-12T00:31:03.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.143+0000 7f0362c73780 1 < completed multipart upload key=927NCYXX8Z2P upload=48REACDFV3MZ tag=YHZOCUMMTOO4 type=write size=1699054 2024-09-12T00:31:03.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.145+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=N5G7CB05XFLM type=del size=3509173 2024-09-12T00:31:03.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.147+0000 7f0362c73780 1 < suggested update operation key=KWDEKRO3WICD tag=NDWDSOPVP9PG type=del size=2903454 2024-09-12T00:31:03.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.149+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=43STGHFTKV0O type=del size=2879464 2024-09-12T00:31:03.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.150+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~MEWLHFGG59Z0.0 size=1048576 2024-09-12T00:31:03.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.151+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~MEWLHFGG59Z0.1 size=725875 2024-09-12T00:31:03.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.153+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=MEWLHFGG59Z0 tag=C6HH0338AX8G type=write size=2823027 2024-09-12T00:31:03.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.155+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=SWCDVSE9BVYB type=del size=2631175 2024-09-12T00:31:03.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.156+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=ZVD9QGKCSX0D type=del 2024-09-12T00:31:03.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.158+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=WGP5P2FW9IIA type=write size=171893 2024-09-12T00:31:03.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.160+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~TSM8LIDO0PTB.0 size=1048576 2024-09-12T00:31:03.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.160+0000 7f0362c73780 1 < canceled part key=_multipart_PYCRNXC9ITGF.2~TSM8LIDO0PTB.1 size=144486 2024-09-12T00:31:03.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.162+0000 7f0362c73780 1 < canceled multipart upload key=PYCRNXC9ITGF upload=TSM8LIDO0PTB tag=ZSMXEZWPZ84P type=write size=2241638 2024-09-12T00:31:03.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.164+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=KZIQCTBB6IVG type=write size=709118 2024-09-12T00:31:03.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.166+0000 7f0362c73780 1 < completed write operation key=G4G6E7KTTZY9 tag=SW4IGCYK1OFL type=write size=155318 2024-09-12T00:31:03.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.168+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=AC3DZ4ODLSBM type=del size=12560 2024-09-12T00:31:03.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.171+0000 7f0362c73780 1 < suggested remove operation key=XR8L0HL374VC tag=KZYQTRRH2A3U type=del 2024-09-12T00:31:03.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.173+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~XVPRL6MGY4WC.0 size=1048576 2024-09-12T00:31:03.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.175+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~XVPRL6MGY4WC.1 size=1048576 2024-09-12T00:31:03.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.176+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~XVPRL6MGY4WC.2 size=853573 2024-09-12T00:31:03.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.176+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=XVPRL6MGY4WC tag=IUGF23TQ0S3W type=write size=3999301 2024-09-12T00:31:03.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.179+0000 7f0362c73780 1 < suggested remove operation key=I3B48QD9E40S tag=J38XBB2W9TFP type=del 2024-09-12T00:31:03.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.180+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=3W3QR76DVES3 type=write size=392708 2024-09-12T00:31:03.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.182+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~BTD1KWFEOASD.0 size=1048576 2024-09-12T00:31:03.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.183+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~BTD1KWFEOASD.1 size=1048576 2024-09-12T00:31:03.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.184+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~BTD1KWFEOASD.2 size=782538 2024-09-12T00:31:03.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.188+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=BTD1KWFEOASD tag=36FY3R2R732N type=write size=3928266 2024-09-12T00:31:03.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.191+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~40NICILUVPDM.0 size=774189 2024-09-12T00:31:03.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.191+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=40NICILUVPDM tag=09ZV3UUFGGD9 type=write size=1822765 2024-09-12T00:31:03.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.193+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=73585BJMWPBZ type=del 2024-09-12T00:31:03.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.195+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~R7UDJA8U60VD.0 size=1048576 2024-09-12T00:31:03.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.197+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~R7UDJA8U60VD.1 size=632999 2024-09-12T00:31:03.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.197+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=R7UDJA8U60VD tag=PHPT1KD67FIR type=write size=2730151 2024-09-12T00:31:03.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.198+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=5UE4QQRMVURE type=del 2024-09-12T00:31:03.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.200+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=XP451OMD69DE type=del size=992281 2024-09-12T00:31:03.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.201+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=QW1YMHFFM0MG type=del 2024-09-12T00:31:03.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.204+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~U41PGVADCBU3.0 size=1048576 2024-09-12T00:31:03.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.205+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~U41PGVADCBU3.1 size=1048576 2024-09-12T00:31:03.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.206+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~U41PGVADCBU3.2 size=283164 2024-09-12T00:31:03.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.207+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=U41PGVADCBU3 tag=JL2K0JGGY2Q7 type=write size=3428892 2024-09-12T00:31:03.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.207+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~2QXSUOGP1MBS.0 size=571727 2024-09-12T00:31:03.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.210+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=2QXSUOGP1MBS tag=F0HNATVBHM0W type=write size=1620303 2024-09-12T00:31:03.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.212+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~2FD53N0HSJV6.0 size=1048576 2024-09-12T00:31:03.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.214+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~2FD53N0HSJV6.1 size=1048576 2024-09-12T00:31:03.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.215+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~2FD53N0HSJV6.2 size=543940 2024-09-12T00:31:03.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.215+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=2FD53N0HSJV6 tag=C7VNQ1TDZIAC type=write size=3689668 2024-09-12T00:31:03.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.216+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=8WA9MNDPLTPI type=del 2024-09-12T00:31:03.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.218+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=M7XYM9P2M8LE type=del size=40436 2024-09-12T00:31:03.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.219+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=FFNKPNNNELC6 type=del 2024-09-12T00:31:03.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.221+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=I38X3BMI444J type=del size=2419346 2024-09-12T00:31:03.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.222+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=CYKMX2Q84CJD type=del 2024-09-12T00:31:03.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.225+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~106W059Q34N4.0 size=1048576 2024-09-12T00:31:03.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.226+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~106W059Q34N4.1 size=1048576 2024-09-12T00:31:03.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.227+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~106W059Q34N4.2 size=938427 2024-09-12T00:31:03.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.227+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=106W059Q34N4 tag=3OEWNLC86021 type=write size=4084155 2024-09-12T00:31:03.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.229+0000 7f0362c73780 -1 < failed to complete operation key=I3B48QD9E40S tag=N5G7CB05XFLM type=del size=3509173: (22) Invalid argument 2024-09-12T00:31:03.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.230+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=Y5Q30R80G6KY type=del size=802679 2024-09-12T00:31:03.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.233+0000 7f0362c73780 1 < suggested update operation key=WT0185G517YR tag=43STGHFTKV0O type=del size=2879464 2024-09-12T00:31:03.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.235+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=TO77NJPJ3ZU9 type=del size=2008999 2024-09-12T00:31:03.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.237+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=SWCDVSE9BVYB type=del 2024-09-12T00:31:03.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.240+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=4EE7I5SYK407 type=del size=2643444 2024-09-12T00:31:03.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.241+0000 7f0362c73780 1 < completed write operation key=G4G6E7KTTZY9 tag=WGP5P2FW9IIA type=write size=171893 2024-09-12T00:31:03.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.243+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=I1GT10RK50EE type=del size=3152781 2024-09-12T00:31:03.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.244+0000 7f0362c73780 1 < completed write operation key=84T1VJG5SHU4 tag=KZIQCTBB6IVG type=write size=709118 2024-09-12T00:31:03.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.247+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~9YVWE2DNFOOY.0 size=1048576 2024-09-12T00:31:03.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.248+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~9YVWE2DNFOOY.1 size=347025 2024-09-12T00:31:03.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.248+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=9YVWE2DNFOOY tag=GA48PP7BJ2F4 type=write size=2444177 2024-09-12T00:31:03.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.249+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=AC3DZ4ODLSBM type=del 2024-09-12T00:31:03.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.250+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=T20X5XOTHRCA type=write size=719532 2024-09-12T00:31:03.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.252+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~XVPRL6MGY4WC.0 size=1048576 2024-09-12T00:31:03.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.253+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~XVPRL6MGY4WC.1 size=1048576 2024-09-12T00:31:03.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.254+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~XVPRL6MGY4WC.2 size=853573 2024-09-12T00:31:03.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.256+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=XVPRL6MGY4WC tag=IUGF23TQ0S3W type=write size=3999301 2024-09-12T00:31:03.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.258+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=O467UFD9RJMK type=del size=266266 2024-09-12T00:31:03.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.259+0000 7f0362c73780 1 < completed write operation key=G2HW98G6624O tag=3W3QR76DVES3 type=write size=392708 2024-09-12T00:31:03.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.261+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=55YZLYNHZ8PN type=del size=4079753 2024-09-12T00:31:03.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.261+0000 7f0362c73780 1 < canceled part key=_multipart_PLAYMR18X9DZ.2~40NICILUVPDM.0 size=774189 2024-09-12T00:31:03.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.263+0000 7f0362c73780 1 < canceled multipart upload key=PLAYMR18X9DZ upload=40NICILUVPDM tag=09ZV3UUFGGD9 type=write size=1822765 2024-09-12T00:31:03.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.266+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~7HES9HFV5QQZ.0 size=1048576 2024-09-12T00:31:03.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.267+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~7HES9HFV5QQZ.1 size=927419 2024-09-12T00:31:03.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.267+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=7HES9HFV5QQZ tag=VAEPR41G6C1U type=write size=3024571 2024-09-12T00:31:03.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.268+0000 7f0362c73780 1 < canceled part key=_multipart_84T1VJG5SHU4.2~R7UDJA8U60VD.0 size=1048576 2024-09-12T00:31:03.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.269+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~R7UDJA8U60VD.1 size=632999 2024-09-12T00:31:03.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.271+0000 7f0362c73780 1 < canceled multipart upload key=84T1VJG5SHU4 upload=R7UDJA8U60VD tag=PHPT1KD67FIR type=write size=2730151 2024-09-12T00:31:03.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.273+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=5F974ZFKY31T type=del size=2594919 2024-09-12T00:31:03.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.275+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=XP451OMD69DE type=del 2024-09-12T00:31:03.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.276+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=31WX06SKK66Z type=del size=3488107 2024-09-12T00:31:03.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.278+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~U41PGVADCBU3.0 size=1048576 2024-09-12T00:31:03.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.279+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~U41PGVADCBU3.1 size=1048576 2024-09-12T00:31:03.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.280+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~U41PGVADCBU3.2 size=283164 2024-09-12T00:31:03.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.282+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=U41PGVADCBU3 tag=JL2K0JGGY2Q7 type=write size=3428892 2024-09-12T00:31:03.282 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.284+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=JNQ7GRT2P8TN type=del size=2683702 2024-09-12T00:31:03.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.285+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~2FD53N0HSJV6.0 size=1048576 2024-09-12T00:31:03.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.287+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~2FD53N0HSJV6.1 size=1048576 2024-09-12T00:31:03.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.288+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~2FD53N0HSJV6.2 size=543940 2024-09-12T00:31:03.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.290+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=2FD53N0HSJV6 tag=C7VNQ1TDZIAC type=write size=3689668 2024-09-12T00:31:03.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.293+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~NDAJFB1EVK9Y.0 size=1048576 2024-09-12T00:31:03.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.294+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~NDAJFB1EVK9Y.1 size=945474 2024-09-12T00:31:03.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.294+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=NDAJFB1EVK9Y tag=4GY605VS3GDH type=write size=3042626 2024-09-12T00:31:03.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.297+0000 7f0362c73780 1 < suggested remove operation key=G2HW98G6624O tag=M7XYM9P2M8LE type=del 2024-09-12T00:31:03.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.298+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=1FX44DYQ49HZ type=del size=2928801 2024-09-12T00:31:03.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.299+0000 7f0362c73780 1 < canceled operation key=X4ZML0796M7F tag=I38X3BMI444J type=del size=2419346 2024-09-12T00:31:03.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.302+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~QOHESO7X2DX8.0 size=1048576 2024-09-12T00:31:03.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.303+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~QOHESO7X2DX8.1 size=1035882 2024-09-12T00:31:03.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.303+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=QOHESO7X2DX8 tag=467ZWZO8HWHL type=write size=3133034 2024-09-12T00:31:03.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.304+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~106W059Q34N4.0 size=1048576 2024-09-12T00:31:03.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.306+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~106W059Q34N4.1 size=1048576 2024-09-12T00:31:03.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.307+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~106W059Q34N4.2 size=938427 2024-09-12T00:31:03.308 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.310+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=106W059Q34N4 tag=3OEWNLC86021 type=write size=4084155 2024-09-12T00:31:03.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.311+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=YX883GFP5IWA type=del size=1248382 2024-09-12T00:31:03.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.313+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=Y5Q30R80G6KY type=del 2024-09-12T00:31:03.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.314+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=VA7J53X0G0YF type=write size=671382 2024-09-12T00:31:03.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.316+0000 7f0362c73780 1 < canceled operation key=CZHT9UQS34JU tag=TO77NJPJ3ZU9 type=del size=2008999 2024-09-12T00:31:03.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.319+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~EQLOQNPOSM97.0 size=1048576 2024-09-12T00:31:03.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.320+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~EQLOQNPOSM97.1 size=168228 2024-09-12T00:31:03.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.320+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=EQLOQNPOSM97 tag=SM1KH5BIQ6WI type=write size=2265380 2024-09-12T00:31:03.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.321+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=4EE7I5SYK407 type=del 2024-09-12T00:31:03.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.325+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~ISR7701TGQ2C.0 size=1045447 2024-09-12T00:31:03.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.325+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=ISR7701TGQ2C tag=8CFW2K80WHWH type=write size=2094023 2024-09-12T00:31:03.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.326+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=I1GT10RK50EE type=del 2024-09-12T00:31:03.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.329+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~CHITJYHU2FFN.0 size=1048576 2024-09-12T00:31:03.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.330+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~CHITJYHU2FFN.1 size=1048576 2024-09-12T00:31:03.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.332+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~CHITJYHU2FFN.2 size=941021 2024-09-12T00:31:03.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.332+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=CHITJYHU2FFN tag=LP53AXQO44WQ type=write size=4086749 2024-09-12T00:31:03.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.332+0000 7f0362c73780 1 < canceled part key=_multipart_EHBOL435W9ZE.2~9YVWE2DNFOOY.0 size=1048576 2024-09-12T00:31:03.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.333+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~9YVWE2DNFOOY.1 size=347025 2024-09-12T00:31:03.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.336+0000 7f0362c73780 1 < canceled multipart upload key=EHBOL435W9ZE upload=9YVWE2DNFOOY tag=GA48PP7BJ2F4 type=write size=2444177 2024-09-12T00:31:03.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.339+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~3EXIC9MPERL1.0 size=1048576 2024-09-12T00:31:03.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.340+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~3EXIC9MPERL1.1 size=1048576 2024-09-12T00:31:03.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.341+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~3EXIC9MPERL1.2 size=619961 2024-09-12T00:31:03.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.341+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=3EXIC9MPERL1 tag=6Z43OQPTIWO9 type=write size=3765689 2024-09-12T00:31:03.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.343+0000 7f0362c73780 1 < canceled operation key=R4ABY5AY0S1P tag=T20X5XOTHRCA type=write size=719532 2024-09-12T00:31:03.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.345+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=DO10SPTHKTBA type=del size=3823200 2024-09-12T00:31:03.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.346+0000 7f0362c73780 1 < canceled operation key=PLAYMR18X9DZ tag=O467UFD9RJMK type=del size=266266 2024-09-12T00:31:03.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.349+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~XTEL0DCV89NJ.0 size=129919 2024-09-12T00:31:03.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.349+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=XTEL0DCV89NJ tag=JABPLELLV3YY type=write size=1178495 2024-09-12T00:31:03.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.353+0000 7f0362c73780 1 < suggested update operation key=WT0185G517YR tag=55YZLYNHZ8PN type=del size=4079753 2024-09-12T00:31:03.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.354+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=6XZTZOBRU7J4 type=del size=1105611 2024-09-12T00:31:03.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.356+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~7HES9HFV5QQZ.0 size=1048576 2024-09-12T00:31:03.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.357+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~7HES9HFV5QQZ.1 size=927419 2024-09-12T00:31:03.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.359+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=7HES9HFV5QQZ tag=VAEPR41G6C1U type=write size=3024571 2024-09-12T00:31:03.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.362+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~71PY3DOX79PT.0 size=1048576 2024-09-12T00:31:03.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.363+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~71PY3DOX79PT.1 size=1048576 2024-09-12T00:31:03.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.364+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~71PY3DOX79PT.2 size=653156 2024-09-12T00:31:03.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.364+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=71PY3DOX79PT tag=MJMGTOQO31ND type=write size=3798884 2024-09-12T00:31:03.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.366+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=5F974ZFKY31T type=del 2024-09-12T00:31:03.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.367+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=ZMS7TVWCB5DU type=del size=2613259 2024-09-12T00:31:03.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.370+0000 7f0362c73780 1 < suggested update operation key=OY30LP7FYXNF tag=31WX06SKK66Z type=del size=3488107 2024-09-12T00:31:03.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.372+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=WIM9SKB65Q22 type=del size=219636 2024-09-12T00:31:03.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.373+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=JNQ7GRT2P8TN type=del 2024-09-12T00:31:03.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.375+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=716CYOC82H4R type=del size=1687560 2024-09-12T00:31:03.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.375+0000 7f0362c73780 1 < canceled part key=_multipart_PLAYMR18X9DZ.2~NDAJFB1EVK9Y.0 size=1048576 2024-09-12T00:31:03.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.376+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~NDAJFB1EVK9Y.1 size=945474 2024-09-12T00:31:03.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.379+0000 7f0362c73780 1 < canceled multipart upload key=PLAYMR18X9DZ upload=NDAJFB1EVK9Y tag=4GY605VS3GDH type=write size=3042626 2024-09-12T00:31:03.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.381+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=2EU4ZTYOOU3Z type=del size=4069148 2024-09-12T00:31:03.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.382+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=1FX44DYQ49HZ type=del 2024-09-12T00:31:03.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.384+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=B35Z6EG02X46 type=del size=2719904 2024-09-12T00:31:03.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.386+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~QOHESO7X2DX8.0 size=1048576 2024-09-12T00:31:03.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.387+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~QOHESO7X2DX8.1 size=1035882 2024-09-12T00:31:03.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.389+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=QOHESO7X2DX8 tag=467ZWZO8HWHL type=write size=3133034 2024-09-12T00:31:03.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.391+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=2UI5IRRWAAMY type=write size=382959 2024-09-12T00:31:03.390 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.392+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=YX883GFP5IWA type=del 2024-09-12T00:31:03.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.394+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=F24EO5Y8ZDD0 type=del size=2841966 2024-09-12T00:31:03.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.395+0000 7f0362c73780 1 < completed write operation key=YTN99RBTKO39 tag=VA7J53X0G0YF type=write size=671382 2024-09-12T00:31:03.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.397+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=GP0SM2S8KMII type=del size=3939461 2024-09-12T00:31:03.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.398+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~EQLOQNPOSM97.0 size=1048576 2024-09-12T00:31:03.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.398+0000 7f0362c73780 1 < canceled part key=_multipart_EHBOL435W9ZE.2~EQLOQNPOSM97.1 size=168228 2024-09-12T00:31:03.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.400+0000 7f0362c73780 1 < canceled multipart upload key=EHBOL435W9ZE upload=EQLOQNPOSM97 tag=SM1KH5BIQ6WI type=write size=2265380 2024-09-12T00:31:03.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.402+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=EIANBLK0P9BY type=write size=83989 2024-09-12T00:31:03.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.403+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~ISR7701TGQ2C.0 size=1045447 2024-09-12T00:31:03.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.406+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=ISR7701TGQ2C tag=8CFW2K80WHWH type=write size=2094023 2024-09-12T00:31:03.406 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.408+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~JCW032D9OAX6.0 size=1048576 2024-09-12T00:31:03.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.409+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~JCW032D9OAX6.1 size=440280 2024-09-12T00:31:03.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.409+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=JCW032D9OAX6 tag=1NB1VXF98MHG type=write size=2537432 2024-09-12T00:31:03.409 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.411+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~CHITJYHU2FFN.0 size=1048576 2024-09-12T00:31:03.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.412+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~CHITJYHU2FFN.1 size=1048576 2024-09-12T00:31:03.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.413+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~CHITJYHU2FFN.2 size=941021 2024-09-12T00:31:03.414 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.416+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=CHITJYHU2FFN tag=LP53AXQO44WQ type=write size=4086749 2024-09-12T00:31:03.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.418+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=A56JBVF1MPGJ type=del size=2562134 2024-09-12T00:31:03.418 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.419+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~3EXIC9MPERL1.0 size=1048576 2024-09-12T00:31:03.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.421+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~3EXIC9MPERL1.1 size=1048576 2024-09-12T00:31:03.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.422+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~3EXIC9MPERL1.2 size=619961 2024-09-12T00:31:03.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.424+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=3EXIC9MPERL1 tag=6Z43OQPTIWO9 type=write size=3765689 2024-09-12T00:31:03.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.427+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~MU5XDFNORXGU.0 size=451426 2024-09-12T00:31:03.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.427+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=MU5XDFNORXGU tag=3QQ91EI8JJIK type=write size=1500002 2024-09-12T00:31:03.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.429+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=DO10SPTHKTBA type=del 2024-09-12T00:31:03.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.432+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~50BNMR1DYMP4.0 size=1048576 2024-09-12T00:31:03.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.433+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~50BNMR1DYMP4.1 size=1048576 2024-09-12T00:31:03.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.434+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~50BNMR1DYMP4.2 size=277669 2024-09-12T00:31:03.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.434+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=50BNMR1DYMP4 tag=BQMRKO3GRP8D type=write size=3423397 2024-09-12T00:31:03.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.436+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~XTEL0DCV89NJ.0 size=129919 2024-09-12T00:31:03.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.439+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=XTEL0DCV89NJ tag=JABPLELLV3YY type=write size=1178495 2024-09-12T00:31:03.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.440+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=SM4W6QY0TCR4 type=del size=3411580 2024-09-12T00:31:03.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.442+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=6XZTZOBRU7J4 type=del 2024-09-12T00:31:03.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.445+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~9W9Y0GMQ9W3G.0 size=296394 2024-09-12T00:31:03.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.445+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=9W9Y0GMQ9W3G tag=PZNTVM55B7ZV type=write size=1344970 2024-09-12T00:31:03.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.447+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~71PY3DOX79PT.0 size=1048576 2024-09-12T00:31:03.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.448+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~71PY3DOX79PT.1 size=1048576 2024-09-12T00:31:03.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.449+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~71PY3DOX79PT.2 size=653156 2024-09-12T00:31:03.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.452+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=71PY3DOX79PT tag=MJMGTOQO31ND type=write size=3798884 2024-09-12T00:31:03.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.455+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~OO5WEOKI3FOS.0 size=1048576 2024-09-12T00:31:03.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.456+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~OO5WEOKI3FOS.1 size=61724 2024-09-12T00:31:03.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.456+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=OO5WEOKI3FOS tag=H0JSXJ10USLO type=write size=2158876 2024-09-12T00:31:03.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.457+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=ZMS7TVWCB5DU type=del 2024-09-12T00:31:03.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.459+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=WOBJF4XMZS7R type=del size=1477320 2024-09-12T00:31:03.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.461+0000 7f0362c73780 1 < suggested remove operation key=R4ABY5AY0S1P tag=WIM9SKB65Q22 type=del 2024-09-12T00:31:03.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.464+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~QF2782FJ1T6I.0 size=1048576 2024-09-12T00:31:03.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.465+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~QF2782FJ1T6I.1 size=1032852 2024-09-12T00:31:03.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.465+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=QF2782FJ1T6I tag=DTXN9YEL32UV type=write size=3130004 2024-09-12T00:31:03.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.467+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=716CYOC82H4R type=del 2024-09-12T00:31:03.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.468+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=CBYVBTMI53RR type=del size=2292392 2024-09-12T00:31:03.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.470+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=2EU4ZTYOOU3Z type=del 2024-09-12T00:31:03.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.471+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=PLVWAM0RCY4L type=del size=3124745 2024-09-12T00:31:03.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.473+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=B35Z6EG02X46 type=del 2024-09-12T00:31:03.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.474+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=HN2M48CH1PJ3 type=del size=894150 2024-09-12T00:31:03.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.476+0000 7f0362c73780 1 < completed write operation key=VD0LFCNLI1YI tag=2UI5IRRWAAMY type=write size=382959 2024-09-12T00:31:03.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.477+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=X9FLOOMWSLK6 type=del size=3116017 2024-09-12T00:31:03.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.479+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=F24EO5Y8ZDD0 type=del 2024-09-12T00:31:03.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.482+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~1RP0R9RE5OA4.0 size=1048576 2024-09-12T00:31:03.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.483+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~1RP0R9RE5OA4.1 size=1048576 2024-09-12T00:31:03.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.484+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~1RP0R9RE5OA4.2 size=71608 2024-09-12T00:31:03.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.484+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=1RP0R9RE5OA4 tag=WKWS51LE884Q type=write size=3217336 2024-09-12T00:31:03.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.485+0000 7f0362c73780 1 < canceled operation key=XR8L0HL374VC tag=GP0SM2S8KMII type=del size=3939461 2024-09-12T00:31:03.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.488+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~LEY1ULTK69R2.0 size=1048576 2024-09-12T00:31:03.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.490+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~LEY1ULTK69R2.1 size=607131 2024-09-12T00:31:03.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.490+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=LEY1ULTK69R2 tag=LUQ4SHYK0Y04 type=write size=2704283 2024-09-12T00:31:03.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.493+0000 7f0362c73780 1 < suggested update operation key=HWSQFSK29S0V tag=EIANBLK0P9BY type=write size=83989 2024-09-12T00:31:03.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.494+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=BS1DAHFPYHCB type=del size=98232 2024-09-12T00:31:03.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.496+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~JCW032D9OAX6.0 size=1048576 2024-09-12T00:31:03.495 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.497+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~JCW032D9OAX6.1 size=440280 2024-09-12T00:31:03.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.499+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=JCW032D9OAX6 tag=1NB1VXF98MHG type=write size=2537432 2024-09-12T00:31:03.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.500+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=RJ2XFAAS72IJ type=write size=501665 2024-09-12T00:31:03.501 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.503+0000 7f0362c73780 1 < suggested remove operation key=44YJP6XPIFT5 tag=A56JBVF1MPGJ type=del 2024-09-12T00:31:03.503 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.505+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=SK03FB5O4OSH type=del size=433815 2024-09-12T00:31:03.504 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.506+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~MU5XDFNORXGU.0 size=451426 2024-09-12T00:31:03.506 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.508+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=MU5XDFNORXGU tag=3QQ91EI8JJIK type=write size=1500002 2024-09-12T00:31:03.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.511+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~SS7V14HASYMB.0 size=1048576 2024-09-12T00:31:03.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.512+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~SS7V14HASYMB.1 size=1048576 2024-09-12T00:31:03.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.513+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~SS7V14HASYMB.2 size=461841 2024-09-12T00:31:03.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.513+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=SS7V14HASYMB tag=XCEFE016YIDG type=write size=3607569 2024-09-12T00:31:03.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.514+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~50BNMR1DYMP4.0 size=1048576 2024-09-12T00:31:03.515 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.516+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~50BNMR1DYMP4.1 size=1048576 2024-09-12T00:31:03.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.518+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~50BNMR1DYMP4.2 size=277669 2024-09-12T00:31:03.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.520+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=50BNMR1DYMP4 tag=BQMRKO3GRP8D type=write size=3423397 2024-09-12T00:31:03.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.521+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=9PCF5SO3FZ9V type=del size=212326 2024-09-12T00:31:03.523 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.524+0000 7f0362c73780 1 < suggested update operation key=R4ABY5AY0S1P tag=SM4W6QY0TCR4 type=del size=3411580 2024-09-12T00:31:03.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.527+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~D1ZLAOXY9D9E.0 size=1048576 2024-09-12T00:31:03.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.528+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~D1ZLAOXY9D9E.1 size=1048576 2024-09-12T00:31:03.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.529+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~D1ZLAOXY9D9E.2 size=803526 2024-09-12T00:31:03.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.529+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=D1ZLAOXY9D9E tag=X619NU2C9U2Z type=write size=3949254 2024-09-12T00:31:03.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.530+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~9W9Y0GMQ9W3G.0 size=296394 2024-09-12T00:31:03.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.532+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=9W9Y0GMQ9W3G tag=PZNTVM55B7ZV type=write size=1344970 2024-09-12T00:31:03.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.534+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=R1M0QD7IBOJM type=del size=2388219 2024-09-12T00:31:03.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.535+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~OO5WEOKI3FOS.0 size=1048576 2024-09-12T00:31:03.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.535+0000 7f0362c73780 1 < canceled part key=_multipart_R4ABY5AY0S1P.2~OO5WEOKI3FOS.1 size=61724 2024-09-12T00:31:03.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.537+0000 7f0362c73780 1 < canceled multipart upload key=R4ABY5AY0S1P upload=OO5WEOKI3FOS tag=H0JSXJ10USLO type=write size=2158876 2024-09-12T00:31:03.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.540+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~9SRLPEQTORUP.0 size=139775 2024-09-12T00:31:03.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.540+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=9SRLPEQTORUP tag=APA2P4NOCAK9 type=write size=1188351 2024-09-12T00:31:03.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.541+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=WOBJF4XMZS7R type=del 2024-09-12T00:31:03.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.543+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=ROHS6VYP1I0X type=del size=471106 2024-09-12T00:31:03.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.543+0000 7f0362c73780 1 < canceled part key=_multipart_XR8L0HL374VC.2~QF2782FJ1T6I.0 size=1048576 2024-09-12T00:31:03.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.544+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~QF2782FJ1T6I.1 size=1032852 2024-09-12T00:31:03.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.546+0000 7f0362c73780 1 < canceled multipart upload key=XR8L0HL374VC upload=QF2782FJ1T6I tag=DTXN9YEL32UV type=write size=3130004 2024-09-12T00:31:03.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.548+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=NJ1PEQ93N1JK type=del size=2622754 2024-09-12T00:31:03.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.550+0000 7f0362c73780 1 < suggested update operation key=R4ABY5AY0S1P tag=CBYVBTMI53RR type=del size=2292392 2024-09-12T00:31:03.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.552+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=GBNI1PFA82S2 type=del size=1913298 2024-09-12T00:31:03.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.553+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=PLVWAM0RCY4L type=del 2024-09-12T00:31:03.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.555+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=ITY6HGNEEW9F type=write size=512932 2024-09-12T00:31:03.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.556+0000 7f0362c73780 -1 < failed to complete operation key=HWSQFSK29S0V tag=HN2M48CH1PJ3 type=del size=894150: (22) Invalid argument 2024-09-12T00:31:03.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.558+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~4RAZLKAMMSXN.0 size=1048576 2024-09-12T00:31:03.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.560+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~4RAZLKAMMSXN.1 size=1048576 2024-09-12T00:31:03.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.561+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~4RAZLKAMMSXN.2 size=975557 2024-09-12T00:31:03.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.561+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=4RAZLKAMMSXN tag=HFTZ1TOOZ5TF type=write size=4121285 2024-09-12T00:31:03.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.563+0000 7f0362c73780 1 < suggested update operation key=PLAYMR18X9DZ tag=X9FLOOMWSLK6 type=del size=3116017 2024-09-12T00:31:03.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.566+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~BYQADOMQDDST.0 size=545075 2024-09-12T00:31:03.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.566+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=BYQADOMQDDST tag=N674IFF2T202 type=write size=1593651 2024-09-12T00:31:03.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.567+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~1RP0R9RE5OA4.0 size=1048576 2024-09-12T00:31:03.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.568+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~1RP0R9RE5OA4.1 size=1048576 2024-09-12T00:31:03.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.568+0000 7f0362c73780 1 < canceled part key=_multipart_HWSQFSK29S0V.2~1RP0R9RE5OA4.2 size=71608 2024-09-12T00:31:03.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.571+0000 7f0362c73780 1 < canceled multipart upload key=HWSQFSK29S0V upload=1RP0R9RE5OA4 tag=WKWS51LE884Q type=write size=3217336 2024-09-12T00:31:03.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.574+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~JD7M3S9PXEJ3.0 size=1048576 2024-09-12T00:31:03.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.575+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~JD7M3S9PXEJ3.1 size=257580 2024-09-12T00:31:03.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.575+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=JD7M3S9PXEJ3 tag=0WWVWEZ7GF9C type=write size=2354732 2024-09-12T00:31:03.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.576+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~LEY1ULTK69R2.0 size=1048576 2024-09-12T00:31:03.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.579+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~LEY1ULTK69R2.1 size=607131 2024-09-12T00:31:03.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.581+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=LEY1ULTK69R2 tag=LUQ4SHYK0Y04 type=write size=2704283 2024-09-12T00:31:03.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.584+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~7FQOCVB16MZN.0 size=1048576 2024-09-12T00:31:03.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.585+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~7FQOCVB16MZN.1 size=1048576 2024-09-12T00:31:03.584 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.586+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~7FQOCVB16MZN.2 size=534481 2024-09-12T00:31:03.584 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.586+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=7FQOCVB16MZN tag=5HGPO9IT9KMJ type=write size=3680209 2024-09-12T00:31:03.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.589+0000 7f0362c73780 1 < suggested update operation key=I3B48QD9E40S tag=BS1DAHFPYHCB type=del size=98232 2024-09-12T00:31:03.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.591+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~9OQDPKK0A459.0 size=1048576 2024-09-12T00:31:03.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.592+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~9OQDPKK0A459.1 size=253823 2024-09-12T00:31:03.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.593+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=9OQDPKK0A459 tag=UN86P2I85RRY type=write size=2350975 2024-09-12T00:31:03.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.595+0000 7f0362c73780 1 < suggested update operation key=CZHT9UQS34JU tag=RJ2XFAAS72IJ type=write size=501665 2024-09-12T00:31:03.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.597+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=15M3PIBN61TQ type=del size=3328175 2024-09-12T00:31:03.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.599+0000 7f0362c73780 1 < suggested remove operation key=XR8L0HL374VC tag=SK03FB5O4OSH type=del 2024-09-12T00:31:03.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.603+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~XCZZ1UV55V33.0 size=1048576 2024-09-12T00:31:03.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.604+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~XCZZ1UV55V33.1 size=801988 2024-09-12T00:31:03.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.604+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=XCZZ1UV55V33 tag=UJIJIWXQXTDU type=write size=2899140 2024-09-12T00:31:03.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.606+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~SS7V14HASYMB.0 size=1048576 2024-09-12T00:31:03.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.607+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~SS7V14HASYMB.1 size=1048576 2024-09-12T00:31:03.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.608+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~SS7V14HASYMB.2 size=461841 2024-09-12T00:31:03.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.610+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=SS7V14HASYMB tag=XCEFE016YIDG type=write size=3607569 2024-09-12T00:31:03.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.613+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~42B1ELVSDX94.0 size=1048576 2024-09-12T00:31:03.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.614+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~42B1ELVSDX94.1 size=1048576 2024-09-12T00:31:03.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.615+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~42B1ELVSDX94.2 size=451972 2024-09-12T00:31:03.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.615+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=42B1ELVSDX94 tag=UZA1S14A3YOZ type=write size=3597700 2024-09-12T00:31:03.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.618+0000 7f0362c73780 1 < suggested update operation key=G2HW98G6624O tag=9PCF5SO3FZ9V type=del size=212326 2024-09-12T00:31:03.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.620+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=CVQJ7YQ7SB0L type=del size=719140 2024-09-12T00:31:03.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.620+0000 7f0362c73780 1 < canceled part key=_multipart_IIZAWZDLR2QE.2~D1ZLAOXY9D9E.0 size=1048576 2024-09-12T00:31:03.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.622+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~D1ZLAOXY9D9E.1 size=1048576 2024-09-12T00:31:03.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.623+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~D1ZLAOXY9D9E.2 size=803526 2024-09-12T00:31:03.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.626+0000 7f0362c73780 1 < canceled multipart upload key=IIZAWZDLR2QE upload=D1ZLAOXY9D9E tag=X619NU2C9U2Z type=write size=3949254 2024-09-12T00:31:03.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.627+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=IHKKFQ4HUOZM type=del size=3979310 2024-09-12T00:31:03.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.629+0000 7f0362c73780 -1 < failed to complete operation key=I3B48QD9E40S tag=R1M0QD7IBOJM type=del size=2388219: (22) Invalid argument 2024-09-12T00:31:03.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.631+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~CFXCT137A9MS.0 size=66577 2024-09-12T00:31:03.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.631+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=CFXCT137A9MS tag=TH8897AF32LS type=write size=1115153 2024-09-12T00:31:03.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.633+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~9SRLPEQTORUP.0 size=139775 2024-09-12T00:31:03.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.635+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=9SRLPEQTORUP tag=APA2P4NOCAK9 type=write size=1188351 2024-09-12T00:31:03.635 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.636+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=EQVFE9GILP4B type=del size=1287061 2024-09-12T00:31:03.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.638+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=ROHS6VYP1I0X type=del 2024-09-12T00:31:03.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.640+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~QCGPENXAQMJK.0 size=1048576 2024-09-12T00:31:03.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.641+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~QCGPENXAQMJK.1 size=947321 2024-09-12T00:31:03.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.641+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=QCGPENXAQMJK tag=ZFODP3CV3NC5 type=write size=3044473 2024-09-12T00:31:03.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.643+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=NJ1PEQ93N1JK type=del 2024-09-12T00:31:03.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.645+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~X30B3VLH4WB7.0 size=1048576 2024-09-12T00:31:03.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.647+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~X30B3VLH4WB7.1 size=267349 2024-09-12T00:31:03.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.647+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=X30B3VLH4WB7 tag=8FRTUUL1M1SG type=write size=2364501 2024-09-12T00:31:03.649 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.651+0000 7f0362c73780 1 < suggested remove operation key=VD0LFCNLI1YI tag=GBNI1PFA82S2 type=del 2024-09-12T00:31:03.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.652+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=0QMNUYKM8C93 type=del size=2426941 2024-09-12T00:31:03.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.653+0000 7f0362c73780 1 < canceled operation key=J5GSZCJW2BP1 tag=ITY6HGNEEW9F type=write size=512932 2024-09-12T00:31:03.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.655+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=DPOJHN19I160 type=del size=400701 2024-09-12T00:31:03.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.656+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~4RAZLKAMMSXN.0 size=1048576 2024-09-12T00:31:03.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.658+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~4RAZLKAMMSXN.1 size=1048576 2024-09-12T00:31:03.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.658+0000 7f0362c73780 1 < canceled part key=_multipart_I3B48QD9E40S.2~4RAZLKAMMSXN.2 size=975557 2024-09-12T00:31:03.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.660+0000 7f0362c73780 1 < canceled multipart upload key=I3B48QD9E40S upload=4RAZLKAMMSXN tag=HFTZ1TOOZ5TF type=write size=4121285 2024-09-12T00:31:03.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.661+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=BWS0C7CU5DNX type=del size=2483273 2024-09-12T00:31:03.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.663+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~BYQADOMQDDST.0 size=545075 2024-09-12T00:31:03.663 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.665+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=BYQADOMQDDST tag=N674IFF2T202 type=write size=1593651 2024-09-12T00:31:03.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.667+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=GUC57CO1VJZY type=del size=3204347 2024-09-12T00:31:03.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.667+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~JD7M3S9PXEJ3.0 size=1048576 2024-09-12T00:31:03.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.667+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~JD7M3S9PXEJ3.1 size=257580 2024-09-12T00:31:03.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.669+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=JD7M3S9PXEJ3 tag=0WWVWEZ7GF9C type=write size=2354732 2024-09-12T00:31:03.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.671+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=1KT7SOGH1GM0 type=del size=3132459 2024-09-12T00:31:03.671 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.672+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~7FQOCVB16MZN.0 size=1048576 2024-09-12T00:31:03.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.673+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~7FQOCVB16MZN.1 size=1048576 2024-09-12T00:31:03.673 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.675+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~7FQOCVB16MZN.2 size=534481 2024-09-12T00:31:03.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.677+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=7FQOCVB16MZN tag=5HGPO9IT9KMJ type=write size=3680209 2024-09-12T00:31:03.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.680+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~P5RU33C10F80.0 size=1048576 2024-09-12T00:31:03.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.681+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~P5RU33C10F80.1 size=243268 2024-09-12T00:31:03.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.681+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=P5RU33C10F80 tag=BC63HQCTSZB7 type=write size=2340420 2024-09-12T00:31:03.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.682+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~9OQDPKK0A459.0 size=1048576 2024-09-12T00:31:03.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.683+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~9OQDPKK0A459.1 size=253823 2024-09-12T00:31:03.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.686+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=9OQDPKK0A459 tag=UN86P2I85RRY type=write size=2350975 2024-09-12T00:31:03.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.687+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=3KR4RXQZ1IG4 type=del size=3342221 2024-09-12T00:31:03.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.688+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=15M3PIBN61TQ type=del 2024-09-12T00:31:03.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.690+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=O2BQ9S5SKI8U type=del size=3498744 2024-09-12T00:31:03.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.691+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~XCZZ1UV55V33.0 size=1048576 2024-09-12T00:31:03.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.692+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~XCZZ1UV55V33.1 size=801988 2024-09-12T00:31:03.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.695+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=XCZZ1UV55V33 tag=UJIJIWXQXTDU type=write size=2899140 2024-09-12T00:31:03.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.696+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=527IR4018UIE type=del size=1725046 2024-09-12T00:31:03.696 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.698+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~42B1ELVSDX94.0 size=1048576 2024-09-12T00:31:03.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.699+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~42B1ELVSDX94.1 size=1048576 2024-09-12T00:31:03.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.700+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~42B1ELVSDX94.2 size=451972 2024-09-12T00:31:03.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.702+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=42B1ELVSDX94 tag=UZA1S14A3YOZ type=write size=3597700 2024-09-12T00:31:03.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.704+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=5QV6NVMY57PQ type=del size=3785964 2024-09-12T00:31:03.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.707+0000 7f0362c73780 1 < suggested update operation key=XMMZOX8MH3GT tag=CVQJ7YQ7SB0L type=del size=719140 2024-09-12T00:31:03.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.709+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~P8P4EO3VMDOV.0 size=846227 2024-09-12T00:31:03.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.709+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=P8P4EO3VMDOV tag=3FUTDEKW8G6Q type=write size=1894803 2024-09-12T00:31:03.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.711+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=IHKKFQ4HUOZM type=del 2024-09-12T00:31:03.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.713+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=1STTTJ3TCZL8 type=write size=804774 2024-09-12T00:31:03.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.714+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~CFXCT137A9MS.0 size=66577 2024-09-12T00:31:03.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.716+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=CFXCT137A9MS tag=TH8897AF32LS type=write size=1115153 2024-09-12T00:31:03.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.718+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=19S1PPOZ725K type=del size=2156591 2024-09-12T00:31:03.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.719+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=EQVFE9GILP4B type=del 2024-09-12T00:31:03.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.721+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=CRMTFGWT186M type=del size=975861 2024-09-12T00:31:03.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.722+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~QCGPENXAQMJK.0 size=1048576 2024-09-12T00:31:03.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.723+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~QCGPENXAQMJK.1 size=947321 2024-09-12T00:31:03.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.726+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=QCGPENXAQMJK tag=ZFODP3CV3NC5 type=write size=3044473 2024-09-12T00:31:03.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.728+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=2SQZNH2G8LQM type=write size=1024735 2024-09-12T00:31:03.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.729+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~X30B3VLH4WB7.0 size=1048576 2024-09-12T00:31:03.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.731+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~X30B3VLH4WB7.1 size=267349 2024-09-12T00:31:03.731 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.733+0000 7f0362c73780 1 < completed multipart upload key=YTN99RBTKO39 upload=X30B3VLH4WB7 tag=8FRTUUL1M1SG type=write size=2364501 2024-09-12T00:31:03.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.735+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=JF22HOO9VUGU type=del size=1267067 2024-09-12T00:31:03.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.736+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=0QMNUYKM8C93 type=del 2024-09-12T00:31:03.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.739+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~7TM85Q17PFHW.0 size=513627 2024-09-12T00:31:03.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.739+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=7TM85Q17PFHW tag=SO0D53ZZGTU4 type=write size=1562203 2024-09-12T00:31:03.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.740+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=DPOJHN19I160 type=del 2024-09-12T00:31:03.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.742+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=ONDHYECYOEHS type=del size=915762 2024-09-12T00:31:03.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.743+0000 7f0362c73780 -1 < failed to complete operation key=XMMZOX8MH3GT tag=BWS0C7CU5DNX type=del size=2483273: (22) Invalid argument 2024-09-12T00:31:03.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.745+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=12LJI9HWKPW4 type=write size=914717 2024-09-12T00:31:03.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.748+0000 7f0362c73780 1 < suggested remove operation key=YTN99RBTKO39 tag=GUC57CO1VJZY type=del 2024-09-12T00:31:03.748 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.749+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=XS6K9NEQV1PS type=del size=196446 2024-09-12T00:31:03.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.751+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=1KT7SOGH1GM0 type=del 2024-09-12T00:31:03.750 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.752+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=3Q97MYIMGP9T type=del size=45094 2024-09-12T00:31:03.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.754+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~P5RU33C10F80.0 size=1048576 2024-09-12T00:31:03.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.755+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~P5RU33C10F80.1 size=243268 2024-09-12T00:31:03.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.757+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=P5RU33C10F80 tag=BC63HQCTSZB7 type=write size=2340420 2024-09-12T00:31:03.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.759+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=3YY5B5UC08GE type=del size=1000628 2024-09-12T00:31:03.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.760+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=3KR4RXQZ1IG4 type=del 2024-09-12T00:31:03.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.762+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=NCY73YQWZU0S type=del size=1608751 2024-09-12T00:31:03.762 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.764+0000 7f0362c73780 1 < completed delete operation key=WT0185G517YR tag=O2BQ9S5SKI8U type=del 2024-09-12T00:31:03.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.765+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=SJCOLRD2V9GI type=del size=1738309 2024-09-12T00:31:03.766 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.767+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=527IR4018UIE type=del 2024-09-12T00:31:03.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.770+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~BT9TG3O01F7F.0 size=484825 2024-09-12T00:31:03.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.770+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=BT9TG3O01F7F tag=TKKF1U6X9L16 type=write size=1533401 2024-09-12T00:31:03.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.771+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=5QV6NVMY57PQ type=del 2024-09-12T00:31:03.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.774+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~BBA2J3HEGAOW.0 size=334449 2024-09-12T00:31:03.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.774+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=BBA2J3HEGAOW tag=5TR63P3JPOG3 type=write size=1383025 2024-09-12T00:31:03.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.775+0000 7f0362c73780 1 < canceled part key=_multipart_PYCRNXC9ITGF.2~P8P4EO3VMDOV.0 size=846227 2024-09-12T00:31:03.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.777+0000 7f0362c73780 1 < canceled multipart upload key=PYCRNXC9ITGF upload=P8P4EO3VMDOV tag=3FUTDEKW8G6Q type=write size=1894803 2024-09-12T00:31:03.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.779+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~QSPV1OXEJW8U.0 size=1048576 2024-09-12T00:31:03.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.781+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~QSPV1OXEJW8U.1 size=1048576 2024-09-12T00:31:03.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.782+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~QSPV1OXEJW8U.2 size=913876 2024-09-12T00:31:03.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.782+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=QSPV1OXEJW8U tag=GQVM98XXZOLG type=write size=4059604 2024-09-12T00:31:03.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.783+0000 7f0362c73780 1 < completed write operation key=PYCRNXC9ITGF tag=1STTTJ3TCZL8 type=write size=804774 2024-09-12T00:31:03.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.785+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=4PN9I92X9A7E type=write size=688799 2024-09-12T00:31:03.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.787+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=19S1PPOZ725K type=del 2024-09-12T00:31:03.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.789+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=XARAATL9POFV type=del size=2655464 2024-09-12T00:31:03.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.790+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=CRMTFGWT186M type=del 2024-09-12T00:31:03.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.793+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~77E0CK1YEVL0.0 size=1048576 2024-09-12T00:31:03.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.794+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~77E0CK1YEVL0.1 size=857880 2024-09-12T00:31:03.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.794+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=77E0CK1YEVL0 tag=FIV8R3415E2G type=write size=2955032 2024-09-12T00:31:03.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.795+0000 7f0362c73780 1 < completed write operation key=44YJP6XPIFT5 tag=2SQZNH2G8LQM type=write size=1024735 2024-09-12T00:31:03.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.797+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=DP2BEJ560LZA type=del size=4075696 2024-09-12T00:31:03.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.798+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=JF22HOO9VUGU type=del 2024-09-12T00:31:03.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.799+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=L75Y9ZUEXLXK type=del size=649255 2024-09-12T00:31:03.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.801+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~7TM85Q17PFHW.0 size=513627 2024-09-12T00:31:03.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.803+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=7TM85Q17PFHW tag=SO0D53ZZGTU4 type=write size=1562203 2024-09-12T00:31:03.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.804+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=0IUMBKGV47MS type=del size=1299360 2024-09-12T00:31:03.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.806+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=ONDHYECYOEHS type=del 2024-09-12T00:31:03.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.807+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=TIHV8DFUBYRI type=del size=4126228 2024-09-12T00:31:03.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.809+0000 7f0362c73780 1 < completed write operation key=EHBOL435W9ZE tag=12LJI9HWKPW4 type=write size=914717 2024-09-12T00:31:03.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.811+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~LUXGDT6UWNX4.0 size=1048576 2024-09-12T00:31:03.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.812+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~LUXGDT6UWNX4.1 size=983996 2024-09-12T00:31:03.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.812+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=LUXGDT6UWNX4 tag=3RYJYI4THU4N type=write size=3081148 2024-09-12T00:31:03.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.813+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=XS6K9NEQV1PS type=del 2024-09-12T00:31:03.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.816+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~IY03PW8GSZPI.0 size=1048576 2024-09-12T00:31:03.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.817+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~IY03PW8GSZPI.1 size=1048576 2024-09-12T00:31:03.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.818+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~IY03PW8GSZPI.2 size=713765 2024-09-12T00:31:03.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.818+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=IY03PW8GSZPI tag=S3F28H3723JU type=write size=3859493 2024-09-12T00:31:03.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.820+0000 7f0362c73780 1 < suggested update operation key=EHBOL435W9ZE tag=3Q97MYIMGP9T type=del size=45094 2024-09-12T00:31:03.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.822+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=QNZE1YHGI92O type=del size=3642063 2024-09-12T00:31:03.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.823+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=3YY5B5UC08GE type=del 2024-09-12T00:31:03.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.826+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~J9MY349TTZQ2.0 size=456625 2024-09-12T00:31:03.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.826+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=J9MY349TTZQ2 tag=OTMYO32B1MK5 type=write size=1505201 2024-09-12T00:31:03.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.827+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=NCY73YQWZU0S type=del 2024-09-12T00:31:03.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.829+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=QF4UZK3HHX2O type=del size=2412250 2024-09-12T00:31:03.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.832+0000 7f0362c73780 1 < suggested remove operation key=1UUNRPUKAINC tag=SJCOLRD2V9GI type=del 2024-09-12T00:31:03.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.834+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~19BVDZ10L8O9.0 size=1048576 2024-09-12T00:31:03.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.837+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~19BVDZ10L8O9.1 size=674711 2024-09-12T00:31:03.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.837+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=19BVDZ10L8O9 tag=SX09D81VIO1F type=write size=2771863 2024-09-12T00:31:03.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.838+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~BT9TG3O01F7F.0 size=484825 2024-09-12T00:31:03.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.840+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=BT9TG3O01F7F tag=TKKF1U6X9L16 type=write size=1533401 2024-09-12T00:31:03.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.842+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=Z9TANYDIEISK type=del size=3855289 2024-09-12T00:31:03.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.844+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~BBA2J3HEGAOW.0 size=334449 2024-09-12T00:31:03.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.846+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=BBA2J3HEGAOW tag=5TR63P3JPOG3 type=write size=1383025 2024-09-12T00:31:03.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.849+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~KW9CJYF56MDI.0 size=1031574 2024-09-12T00:31:03.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.849+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=KW9CJYF56MDI tag=EC6JMIAQBM40 type=write size=2080150 2024-09-12T00:31:03.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.849+0000 7f0362c73780 1 < canceled part key=_multipart_84T1VJG5SHU4.2~QSPV1OXEJW8U.0 size=1048576 2024-09-12T00:31:03.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.850+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~QSPV1OXEJW8U.1 size=1048576 2024-09-12T00:31:03.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.850+0000 7f0362c73780 1 < canceled part key=_multipart_84T1VJG5SHU4.2~QSPV1OXEJW8U.2 size=913876 2024-09-12T00:31:03.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.853+0000 7f0362c73780 1 < canceled multipart upload key=84T1VJG5SHU4 upload=QSPV1OXEJW8U tag=GQVM98XXZOLG type=write size=4059604 2024-09-12T00:31:03.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.855+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=1E5A0GOT1IEJ type=del size=758214 2024-09-12T00:31:03.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.856+0000 7f0362c73780 1 < completed write operation key=HWSQFSK29S0V tag=4PN9I92X9A7E type=write size=688799 2024-09-12T00:31:03.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.859+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~KKKCQBJFGWKI.0 size=922130 2024-09-12T00:31:03.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.859+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=KKKCQBJFGWKI tag=BRSEUQQHMK4K type=write size=1970706 2024-09-12T00:31:03.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.861+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=XARAATL9POFV type=del 2024-09-12T00:31:03.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.862+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=LDG1F9BJNRGQ type=del size=1546305 2024-09-12T00:31:03.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.863+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~77E0CK1YEVL0.0 size=1048576 2024-09-12T00:31:03.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.864+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~77E0CK1YEVL0.1 size=857880 2024-09-12T00:31:03.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.867+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=77E0CK1YEVL0 tag=FIV8R3415E2G type=write size=2955032 2024-09-12T00:31:03.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.868+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=5ZS8LM8KYPQY type=del size=2359959 2024-09-12T00:31:03.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.872+0000 7f0362c73780 1 < suggested update operation key=G4G6E7KTTZY9 tag=DP2BEJ560LZA type=del size=4075696 2024-09-12T00:31:03.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.875+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~DOXKHQ3XD4IM.0 size=865401 2024-09-12T00:31:03.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.875+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=DOXKHQ3XD4IM tag=MA57JUOYNLHV type=write size=1913977 2024-09-12T00:31:03.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.876+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=L75Y9ZUEXLXK type=del 2024-09-12T00:31:03.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.878+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=YQ2K5RHZM0WU type=del size=2159873 2024-09-12T00:31:03.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.879+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=0IUMBKGV47MS type=del 2024-09-12T00:31:03.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.880+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=E14R2QJ34OZT type=write size=465 2024-09-12T00:31:03.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.882+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=TIHV8DFUBYRI type=del 2024-09-12T00:31:03.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.883+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=H8TUEQVVZL3S type=del size=2209029 2024-09-12T00:31:03.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.885+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~LUXGDT6UWNX4.0 size=1048576 2024-09-12T00:31:03.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.886+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~LUXGDT6UWNX4.1 size=983996 2024-09-12T00:31:03.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.888+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=LUXGDT6UWNX4 tag=3RYJYI4THU4N type=write size=3081148 2024-09-12T00:31:03.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.890+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=R3EFEQPLI3BU type=del size=59240 2024-09-12T00:31:03.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.891+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~IY03PW8GSZPI.0 size=1048576 2024-09-12T00:31:03.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.892+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~IY03PW8GSZPI.1 size=1048576 2024-09-12T00:31:03.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.894+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~IY03PW8GSZPI.2 size=713765 2024-09-12T00:31:03.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.896+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=IY03PW8GSZPI tag=S3F28H3723JU type=write size=3859493 2024-09-12T00:31:03.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.897+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=MM66A3X1YLMO type=write size=485826 2024-09-12T00:31:03.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.899+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=QNZE1YHGI92O type=del 2024-09-12T00:31:03.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.902+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~KVMB1G57HPWF.0 size=957100 2024-09-12T00:31:03.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.902+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=KVMB1G57HPWF tag=H9IN8VS0X2W2 type=write size=2005676 2024-09-12T00:31:03.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.903+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~J9MY349TTZQ2.0 size=456625 2024-09-12T00:31:03.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.906+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=J9MY349TTZQ2 tag=OTMYO32B1MK5 type=write size=1505201 2024-09-12T00:31:03.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.907+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=P9XZ62GRYNC1 type=del size=1892147 2024-09-12T00:31:03.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.910+0000 7f0362c73780 1 < suggested remove operation key=HEN9LUUIDAR5 tag=QF4UZK3HHX2O type=del 2024-09-12T00:31:03.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.911+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=FGRT39XZVJ8B type=del size=3443626 2024-09-12T00:31:03.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.911+0000 7f0362c73780 1 < canceled part key=_multipart_84T1VJG5SHU4.2~19BVDZ10L8O9.0 size=1048576 2024-09-12T00:31:03.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.912+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~19BVDZ10L8O9.1 size=674711 2024-09-12T00:31:03.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.915+0000 7f0362c73780 1 < canceled multipart upload key=84T1VJG5SHU4 upload=19BVDZ10L8O9 tag=SX09D81VIO1F type=write size=2771863 2024-09-12T00:31:03.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.917+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~37410E24SF8F.0 size=1048576 2024-09-12T00:31:03.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.918+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~37410E24SF8F.1 size=1048576 2024-09-12T00:31:03.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.919+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~37410E24SF8F.2 size=454885 2024-09-12T00:31:03.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.919+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=37410E24SF8F tag=TOBI1CKUF3B9 type=write size=3600613 2024-09-12T00:31:03.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.921+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=Z9TANYDIEISK type=del 2024-09-12T00:31:03.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.922+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=PG6GKMTDZCFB type=del size=1659524 2024-09-12T00:31:03.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.925+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~KW9CJYF56MDI.0 size=1031574 2024-09-12T00:31:03.926 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.928+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=KW9CJYF56MDI tag=EC6JMIAQBM40 type=write size=2080150 2024-09-12T00:31:03.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.930+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=DI51JL116QNB type=del size=1152039 2024-09-12T00:31:03.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.931+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=1E5A0GOT1IEJ type=del 2024-09-12T00:31:03.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.933+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=57QWJH82MFUE type=del size=1335639 2024-09-12T00:31:03.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.934+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~KKKCQBJFGWKI.0 size=922130 2024-09-12T00:31:03.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.937+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=KKKCQBJFGWKI tag=BRSEUQQHMK4K type=write size=1970706 2024-09-12T00:31:03.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.938+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=J2LVKIA5FGQK type=del size=1430256 2024-09-12T00:31:03.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.940+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=LDG1F9BJNRGQ type=del 2024-09-12T00:31:03.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.941+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=G35K854Y9IQC type=write size=216693 2024-09-12T00:31:03.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.942+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=5ZS8LM8KYPQY type=del 2024-09-12T00:31:03.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.945+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~OQ3FRL1WIHFN.0 size=1048576 2024-09-12T00:31:03.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.946+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~OQ3FRL1WIHFN.1 size=725152 2024-09-12T00:31:03.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.946+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=OQ3FRL1WIHFN tag=CLFN6OVM0E3F type=write size=2822304 2024-09-12T00:31:03.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.948+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~DOXKHQ3XD4IM.0 size=865401 2024-09-12T00:31:03.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.950+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=DOXKHQ3XD4IM tag=MA57JUOYNLHV type=write size=1913977 2024-09-12T00:31:03.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.951+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=T8V17ND75DTC type=write size=38733 2024-09-12T00:31:03.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.953+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=YQ2K5RHZM0WU type=del 2024-09-12T00:31:03.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.956+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~9GRB50EM4X1K.0 size=1048576 2024-09-12T00:31:03.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.957+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~9GRB50EM4X1K.1 size=740677 2024-09-12T00:31:03.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.957+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=9GRB50EM4X1K tag=OU7MVD82IK82 type=write size=2837829 2024-09-12T00:31:03.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.960+0000 7f0362c73780 1 < suggested remove operation key=HWSQFSK29S0V tag=E14R2QJ34OZT type=write 2024-09-12T00:31:03.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.961+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=MRCPDVWFYGHU type=del size=2381104 2024-09-12T00:31:03.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.963+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=H8TUEQVVZL3S type=del 2024-09-12T00:31:03.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.967+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~F6NV2IXK3D5A.0 size=1048576 2024-09-12T00:31:03.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.968+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~F6NV2IXK3D5A.1 size=1048576 2024-09-12T00:31:03.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.969+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~F6NV2IXK3D5A.2 size=284411 2024-09-12T00:31:03.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.969+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=F6NV2IXK3D5A tag=893ZSZ3H3LJZ type=write size=3430139 2024-09-12T00:31:03.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.971+0000 7f0362c73780 1 < canceled operation key=XR8L0HL374VC tag=R3EFEQPLI3BU type=del size=59240 2024-09-12T00:31:03.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.974+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~NQECDEX6PVAK.0 size=523791 2024-09-12T00:31:03.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.974+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=NQECDEX6PVAK tag=M9J6S9ZYULCR type=write size=1572367 2024-09-12T00:31:03.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.975+0000 7f0362c73780 1 < completed write operation key=1MLL1T362X51 tag=MM66A3X1YLMO type=write size=485826 2024-09-12T00:31:03.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.977+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=ZIDO3O00GFHF type=del size=640365 2024-09-12T00:31:03.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.979+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~KVMB1G57HPWF.0 size=957100 2024-09-12T00:31:03.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.982+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=KVMB1G57HPWF tag=H9IN8VS0X2W2 type=write size=2005676 2024-09-12T00:31:03.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.984+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~8U6QPRH2Z58T.0 size=1048576 2024-09-12T00:31:03.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.985+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~8U6QPRH2Z58T.1 size=752544 2024-09-12T00:31:03.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.985+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=8U6QPRH2Z58T tag=CK0B6VMWJ2IW type=write size=2849696 2024-09-12T00:31:03.985 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.987+0000 7f0362c73780 -1 < failed to complete operation key=HEN9LUUIDAR5 tag=P9XZ62GRYNC1 type=del size=1892147: (22) Invalid argument 2024-09-12T00:31:03.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.990+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~1GIZZ34EEW81.0 size=1048576 2024-09-12T00:31:03.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.991+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~1GIZZ34EEW81.1 size=41336 2024-09-12T00:31:03.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.991+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=1GIZZ34EEW81 tag=3G65S7H7UR2J type=write size=2138488 2024-09-12T00:31:03.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.993+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=FGRT39XZVJ8B type=del 2024-09-12T00:31:03.994 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.995+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~VFIH8KJOFB1S.0 size=457819 2024-09-12T00:31:03.994 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.996+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=VFIH8KJOFB1S tag=7TGIV9L7F5BW type=write size=1506395 2024-09-12T00:31:03.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.997+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~37410E24SF8F.0 size=1048576 2024-09-12T00:31:03.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:03.998+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~37410E24SF8F.1 size=1048576 2024-09-12T00:31:03.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.000+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~37410E24SF8F.2 size=454885 2024-09-12T00:31:04.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.002+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=37410E24SF8F tag=TOBI1CKUF3B9 type=write size=3600613 2024-09-12T00:31:04.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.006+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~WD4P9TMWV7PJ.0 size=264206 2024-09-12T00:31:04.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.006+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=WD4P9TMWV7PJ tag=9UUY02169I13 type=write size=1312782 2024-09-12T00:31:04.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.009+0000 7f0362c73780 1 < suggested update operation key=J5GSZCJW2BP1 tag=PG6GKMTDZCFB type=del size=1659524 2024-09-12T00:31:04.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.010+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=WF7KFI0U1JIP type=del size=3741237 2024-09-12T00:31:04.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.013+0000 7f0362c73780 1 < suggested remove operation key=CZHT9UQS34JU tag=DI51JL116QNB type=del 2024-09-12T00:31:04.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.016+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~X3U89ANGHUL9.0 size=559187 2024-09-12T00:31:04.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.016+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=X3U89ANGHUL9 tag=09GJLMUZ7X2C type=write size=1607763 2024-09-12T00:31:04.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.017+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=57QWJH82MFUE type=del 2024-09-12T00:31:04.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.019+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=UPPU19D96XOF type=del size=4014910 2024-09-12T00:31:04.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.020+0000 7f0362c73780 -1 < failed to complete operation key=J5GSZCJW2BP1 tag=J2LVKIA5FGQK type=del size=1430256: (22) Invalid argument 2024-09-12T00:31:04.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.022+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=GV1JC1K2CTXZ type=del size=3591433 2024-09-12T00:31:04.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.025+0000 7f0362c73780 1 < suggested update operation key=OY30LP7FYXNF tag=G35K854Y9IQC type=write size=216693 2024-09-12T00:31:04.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.027+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=1JZKRCZ3I9WI type=del size=2948481 2024-09-12T00:31:04.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.028+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~OQ3FRL1WIHFN.0 size=1048576 2024-09-12T00:31:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.029+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~OQ3FRL1WIHFN.1 size=725152 2024-09-12T00:31:04.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.031+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=OQ3FRL1WIHFN tag=CLFN6OVM0E3F type=write size=2822304 2024-09-12T00:31:04.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.033+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=V32BANR0ZE1R type=del size=2363237 2024-09-12T00:31:04.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.036+0000 7f0362c73780 1 < suggested remove operation key=PYCRNXC9ITGF tag=T8V17ND75DTC type=write 2024-09-12T00:31:04.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.038+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=TXAO83GV1DSZ type=del size=249896 2024-09-12T00:31:04.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.039+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~9GRB50EM4X1K.0 size=1048576 2024-09-12T00:31:04.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.040+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~9GRB50EM4X1K.1 size=740677 2024-09-12T00:31:04.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.043+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=9GRB50EM4X1K tag=OU7MVD82IK82 type=write size=2837829 2024-09-12T00:31:04.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.046+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~MQZLG4CKJHW4.0 size=1048576 2024-09-12T00:31:04.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.047+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~MQZLG4CKJHW4.1 size=884222 2024-09-12T00:31:04.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.047+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=MQZLG4CKJHW4 tag=S22E9LXSSPHG type=write size=2981374 2024-09-12T00:31:04.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.048+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=MRCPDVWFYGHU type=del 2024-09-12T00:31:04.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.050+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=51R2PS95RLYX type=del size=3432390 2024-09-12T00:31:04.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.050+0000 7f0362c73780 1 < canceled part key=_multipart_EHBOL435W9ZE.2~F6NV2IXK3D5A.0 size=1048576 2024-09-12T00:31:04.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.051+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~F6NV2IXK3D5A.1 size=1048576 2024-09-12T00:31:04.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.052+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~F6NV2IXK3D5A.2 size=284411 2024-09-12T00:31:04.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.054+0000 7f0362c73780 1 < canceled multipart upload key=EHBOL435W9ZE upload=F6NV2IXK3D5A tag=893ZSZ3H3LJZ type=write size=3430139 2024-09-12T00:31:04.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.056+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=C6IM9ALF2KY8 type=del size=531205 2024-09-12T00:31:04.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.058+0000 7f0362c73780 1 < completed part key=_multipart_I3B48QD9E40S.2~NQECDEX6PVAK.0 size=523791 2024-09-12T00:31:04.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.060+0000 7f0362c73780 1 < completed multipart upload key=I3B48QD9E40S upload=NQECDEX6PVAK tag=M9J6S9ZYULCR type=write size=1572367 2024-09-12T00:31:04.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.061+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=Y1E80TQYFNPB type=del size=951009 2024-09-12T00:31:04.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.063+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=ZIDO3O00GFHF type=del 2024-09-12T00:31:04.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.066+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~28I34X4LKXE2.0 size=1048576 2024-09-12T00:31:04.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.069+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~28I34X4LKXE2.1 size=1048576 2024-09-12T00:31:04.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.070+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~28I34X4LKXE2.2 size=774698 2024-09-12T00:31:04.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.070+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=28I34X4LKXE2 tag=43XJRK067CS2 type=write size=3920426 2024-09-12T00:31:04.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.072+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~8U6QPRH2Z58T.0 size=1048576 2024-09-12T00:31:04.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.072+0000 7f0362c73780 1 < canceled part key=_multipart_KWDEKRO3WICD.2~8U6QPRH2Z58T.1 size=752544 2024-09-12T00:31:04.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.074+0000 7f0362c73780 1 < canceled multipart upload key=KWDEKRO3WICD upload=8U6QPRH2Z58T tag=CK0B6VMWJ2IW type=write size=2849696 2024-09-12T00:31:04.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.076+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=89SSTTFKNKVW type=write size=371468 2024-09-12T00:31:04.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.078+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~1GIZZ34EEW81.0 size=1048576 2024-09-12T00:31:04.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.079+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~1GIZZ34EEW81.1 size=41336 2024-09-12T00:31:04.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.082+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=1GIZZ34EEW81 tag=3G65S7H7UR2J type=write size=2138488 2024-09-12T00:31:04.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.083+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=KP738S71EP65 type=write size=727076 2024-09-12T00:31:04.083 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.085+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~VFIH8KJOFB1S.0 size=457819 2024-09-12T00:31:04.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.088+0000 7f0362c73780 1 < completed multipart upload key=WT0185G517YR upload=VFIH8KJOFB1S tag=7TGIV9L7F5BW type=write size=1506395 2024-09-12T00:31:04.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.089+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=Y0C17OACZW87 type=del size=3534925 2024-09-12T00:31:04.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.091+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~WD4P9TMWV7PJ.0 size=264206 2024-09-12T00:31:04.092 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.094+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=WD4P9TMWV7PJ tag=9UUY02169I13 type=write size=1312782 2024-09-12T00:31:04.094 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.095+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=S6HGFY960YIV type=write size=366534 2024-09-12T00:31:04.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.097+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=WF7KFI0U1JIP type=del 2024-09-12T00:31:04.098 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.100+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~ZEX2KX6B32CG.0 size=1048576 2024-09-12T00:31:04.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.101+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~ZEX2KX6B32CG.1 size=512406 2024-09-12T00:31:04.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.101+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=ZEX2KX6B32CG tag=QDCLKBKMAOCI type=write size=2609558 2024-09-12T00:31:04.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.103+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~X3U89ANGHUL9.0 size=559187 2024-09-12T00:31:04.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.105+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=X3U89ANGHUL9 tag=09GJLMUZ7X2C type=write size=1607763 2024-09-12T00:31:04.105 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.107+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=Z99RKN16JDCI type=del size=1509028 2024-09-12T00:31:04.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.109+0000 7f0362c73780 1 < canceled operation key=3XZZX53L26G5 tag=UPPU19D96XOF type=del size=4014910 2024-09-12T00:31:04.108 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.110+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=QKVLV6BCSZLD type=del size=2263603 2024-09-12T00:31:04.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.112+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=GV1JC1K2CTXZ type=del 2024-09-12T00:31:04.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.114+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~TW6MYUZSBJQZ.0 size=1048576 2024-09-12T00:31:04.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.116+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~TW6MYUZSBJQZ.1 size=1048576 2024-09-12T00:31:04.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.117+0000 7f0362c73780 1 > prepared part key=_multipart_WT0185G517YR.2~TW6MYUZSBJQZ.2 size=508642 2024-09-12T00:31:04.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.117+0000 7f0362c73780 1 > prepared multipart upload key=WT0185G517YR upload=TW6MYUZSBJQZ tag=RO34ELBMJWHR type=write size=3654370 2024-09-12T00:31:04.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.119+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=1JZKRCZ3I9WI type=del 2024-09-12T00:31:04.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.122+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~RAVIQ2VGYPKP.0 size=1048576 2024-09-12T00:31:04.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.123+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~RAVIQ2VGYPKP.1 size=175146 2024-09-12T00:31:04.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.123+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=RAVIQ2VGYPKP tag=P6J73SM1QQSK type=write size=2272298 2024-09-12T00:31:04.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.124+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=V32BANR0ZE1R type=del 2024-09-12T00:31:04.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.127+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~UX84OWQCHJIK.0 size=408639 2024-09-12T00:31:04.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.127+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=UX84OWQCHJIK tag=Z5U04BEBT5DH type=write size=1457215 2024-09-12T00:31:04.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.129+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=TXAO83GV1DSZ type=del 2024-09-12T00:31:04.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.131+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~SYC7G40NRW7E.0 size=177506 2024-09-12T00:31:04.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.131+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=SYC7G40NRW7E tag=15W3FS60DBKA type=write size=1226082 2024-09-12T00:31:04.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.133+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~MQZLG4CKJHW4.0 size=1048576 2024-09-12T00:31:04.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.134+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~MQZLG4CKJHW4.1 size=884222 2024-09-12T00:31:04.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.137+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=MQZLG4CKJHW4 tag=S22E9LXSSPHG type=write size=2981374 2024-09-12T00:31:04.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.138+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=4NHI3L1A0X4R type=del size=1526467 2024-09-12T00:31:04.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.139+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=51R2PS95RLYX type=del 2024-09-12T00:31:04.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.142+0000 7f0362c73780 1 > prepared part key=_multipart_EHBOL435W9ZE.2~DCY8XMDI7TN6.0 size=378008 2024-09-12T00:31:04.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.142+0000 7f0362c73780 1 > prepared multipart upload key=EHBOL435W9ZE upload=DCY8XMDI7TN6 tag=BP9NHIJGCBBH type=write size=1426584 2024-09-12T00:31:04.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.144+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=C6IM9ALF2KY8 type=del 2024-09-12T00:31:04.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.145+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=M3XVWV7IGKD6 type=del size=2071732 2024-09-12T00:31:04.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.147+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=Y1E80TQYFNPB type=del 2024-09-12T00:31:04.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.149+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~6LE8VJL9ZQH2.0 size=1048576 2024-09-12T00:31:04.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.150+0000 7f0362c73780 1 > prepared part key=_multipart_PYCRNXC9ITGF.2~6LE8VJL9ZQH2.1 size=133257 2024-09-12T00:31:04.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.150+0000 7f0362c73780 1 > prepared multipart upload key=PYCRNXC9ITGF upload=6LE8VJL9ZQH2 tag=NAR96N3KT0KW type=write size=2230409 2024-09-12T00:31:04.149 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.151+0000 7f0362c73780 1 < canceled part key=_multipart_R4ABY5AY0S1P.2~28I34X4LKXE2.0 size=1048576 2024-09-12T00:31:04.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.152+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~28I34X4LKXE2.1 size=1048576 2024-09-12T00:31:04.151 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.153+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~28I34X4LKXE2.2 size=774698 2024-09-12T00:31:04.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.155+0000 7f0362c73780 1 < canceled multipart upload key=R4ABY5AY0S1P upload=28I34X4LKXE2 tag=43XJRK067CS2 type=write size=3920426 2024-09-12T00:31:04.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.156+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=KKXVLM0C00AF type=del size=435100 2024-09-12T00:31:04.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.158+0000 7f0362c73780 1 < canceled operation key=XR8L0HL374VC tag=89SSTTFKNKVW type=write size=371468 2024-09-12T00:31:04.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.159+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=0OQGN86HXUDH type=del size=4016285 2024-09-12T00:31:04.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.162+0000 7f0362c73780 1 < suggested remove operation key=1MLL1T362X51 tag=KP738S71EP65 type=write 2024-09-12T00:31:04.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.163+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=C6IFRVD1EUEX type=del size=673125 2024-09-12T00:31:04.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.165+0000 7f0362c73780 1 < canceled operation key=EHBOL435W9ZE tag=Y0C17OACZW87 type=del size=3534925 2024-09-12T00:31:04.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.166+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=2LW3D7WSBO8Q type=del size=3449711 2024-09-12T00:31:04.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.168+0000 7f0362c73780 1 < completed write operation key=OY30LP7FYXNF tag=S6HGFY960YIV type=write size=366534 2024-09-12T00:31:04.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.169+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=9AP9ML0TWIVH type=del size=4070134 2024-09-12T00:31:04.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.171+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~ZEX2KX6B32CG.0 size=1048576 2024-09-12T00:31:04.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.172+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~ZEX2KX6B32CG.1 size=512406 2024-09-12T00:31:04.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.174+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=ZEX2KX6B32CG tag=QDCLKBKMAOCI type=write size=2609558 2024-09-12T00:31:04.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.175+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=1ELTGZIO4HW4 type=del size=7883 2024-09-12T00:31:04.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.177+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=Z99RKN16JDCI type=del 2024-09-12T00:31:04.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.179+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~R9NRQ8OIF9ZX.0 size=1048576 2024-09-12T00:31:04.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.180+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~R9NRQ8OIF9ZX.1 size=788729 2024-09-12T00:31:04.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.180+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=R9NRQ8OIF9ZX tag=9ROXJX7MYKZI type=write size=2885881 2024-09-12T00:31:04.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.182+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=QKVLV6BCSZLD type=del 2024-09-12T00:31:04.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.184+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~38T9ROJLV3JN.0 size=1048576 2024-09-12T00:31:04.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.185+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~38T9ROJLV3JN.1 size=1048576 2024-09-12T00:31:04.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.186+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~38T9ROJLV3JN.2 size=640908 2024-09-12T00:31:04.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.186+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=38T9ROJLV3JN tag=GOICHPG4NO8H type=write size=3786636 2024-09-12T00:31:04.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.188+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~TW6MYUZSBJQZ.0 size=1048576 2024-09-12T00:31:04.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.188+0000 7f0362c73780 1 < canceled part key=_multipart_WT0185G517YR.2~TW6MYUZSBJQZ.1 size=1048576 2024-09-12T00:31:04.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.189+0000 7f0362c73780 1 < completed part key=_multipart_WT0185G517YR.2~TW6MYUZSBJQZ.2 size=508642 2024-09-12T00:31:04.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.191+0000 7f0362c73780 1 < canceled multipart upload key=WT0185G517YR upload=TW6MYUZSBJQZ tag=RO34ELBMJWHR type=write size=3654370 2024-09-12T00:31:04.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.193+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=N2CRF5KE5WB0 type=del size=2853515 2024-09-12T00:31:04.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.194+0000 7f0362c73780 1 < completed part key=_multipart_YTN99RBTKO39.2~RAVIQ2VGYPKP.0 size=1048576 2024-09-12T00:31:04.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.194+0000 7f0362c73780 1 < canceled part key=_multipart_YTN99RBTKO39.2~RAVIQ2VGYPKP.1 size=175146 2024-09-12T00:31:04.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.197+0000 7f0362c73780 1 < canceled multipart upload key=YTN99RBTKO39 upload=RAVIQ2VGYPKP tag=P6J73SM1QQSK type=write size=2272298 2024-09-12T00:31:04.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.198+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=SQULLLDM1F6X type=write size=75436 2024-09-12T00:31:04.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.200+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~UX84OWQCHJIK.0 size=408639 2024-09-12T00:31:04.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.202+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=UX84OWQCHJIK tag=Z5U04BEBT5DH type=write size=1457215 2024-09-12T00:31:04.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.205+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~OA05AX5RDPM9.0 size=1048576 2024-09-12T00:31:04.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.207+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~OA05AX5RDPM9.1 size=1048576 2024-09-12T00:31:04.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.208+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~OA05AX5RDPM9.2 size=101040 2024-09-12T00:31:04.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.208+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=OA05AX5RDPM9 tag=TMDD7EK0ZZKA type=write size=3246768 2024-09-12T00:31:04.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.209+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~SYC7G40NRW7E.0 size=177506 2024-09-12T00:31:04.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.211+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=SYC7G40NRW7E tag=15W3FS60DBKA type=write size=1226082 2024-09-12T00:31:04.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.214+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~TL0FCGTGG63W.0 size=1048576 2024-09-12T00:31:04.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.215+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~TL0FCGTGG63W.1 size=1048576 2024-09-12T00:31:04.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.216+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~TL0FCGTGG63W.2 size=214971 2024-09-12T00:31:04.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.216+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=TL0FCGTGG63W tag=ZRZLREURN8GE type=write size=3360699 2024-09-12T00:31:04.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.217+0000 7f0362c73780 1 < completed delete operation key=J5GSZCJW2BP1 tag=4NHI3L1A0X4R type=del 2024-09-12T00:31:04.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.220+0000 7f0362c73780 1 > prepared part key=_multipart_HWSQFSK29S0V.2~NNG7400IRXOS.0 size=482625 2024-09-12T00:31:04.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.220+0000 7f0362c73780 1 > prepared multipart upload key=HWSQFSK29S0V upload=NNG7400IRXOS tag=6R2HOMT2SZAV type=write size=1531201 2024-09-12T00:31:04.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.221+0000 7f0362c73780 1 < completed part key=_multipart_EHBOL435W9ZE.2~DCY8XMDI7TN6.0 size=378008 2024-09-12T00:31:04.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.223+0000 7f0362c73780 1 < completed multipart upload key=EHBOL435W9ZE upload=DCY8XMDI7TN6 tag=BP9NHIJGCBBH type=write size=1426584 2024-09-12T00:31:04.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.225+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=HZEVH1LF0X93 type=del size=2660610 2024-09-12T00:31:04.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.227+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=M3XVWV7IGKD6 type=del 2024-09-12T00:31:04.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.228+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=GP8BEQ2OM1SN type=del size=2082312 2024-09-12T00:31:04.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.230+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~6LE8VJL9ZQH2.0 size=1048576 2024-09-12T00:31:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.231+0000 7f0362c73780 1 < completed part key=_multipart_PYCRNXC9ITGF.2~6LE8VJL9ZQH2.1 size=133257 2024-09-12T00:31:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.233+0000 7f0362c73780 1 < completed multipart upload key=PYCRNXC9ITGF upload=6LE8VJL9ZQH2 tag=NAR96N3KT0KW type=write size=2230409 2024-09-12T00:31:04.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.235+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=BX01KFVFS7E4 type=write size=893989 2024-09-12T00:31:04.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.236+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=KKXVLM0C00AF type=del 2024-09-12T00:31:04.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.238+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=MXJF42DBO1IW type=del size=1042944 2024-09-12T00:31:04.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.239+0000 7f0362c73780 1 < canceled operation key=44YJP6XPIFT5 tag=0OQGN86HXUDH type=del size=4016285 2024-09-12T00:31:04.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.242+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~D67VZJF3RQQU.0 size=1048576 2024-09-12T00:31:04.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.243+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~D67VZJF3RQQU.1 size=1048576 2024-09-12T00:31:04.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.244+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~D67VZJF3RQQU.2 size=353764 2024-09-12T00:31:04.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.244+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=D67VZJF3RQQU tag=80F7R7BIEKPX type=write size=3499492 2024-09-12T00:31:04.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.245+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=C6IFRVD1EUEX type=del 2024-09-12T00:31:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.248+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~QOA8YU2AQJE8.0 size=284260 2024-09-12T00:31:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.248+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=QOA8YU2AQJE8 tag=WO848OFMI52N type=write size=1332836 2024-09-12T00:31:04.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.251+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=2LW3D7WSBO8Q type=del 2024-09-12T00:31:04.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.253+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~W0HZ8DXYQXQC.0 size=1048576 2024-09-12T00:31:04.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.254+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~W0HZ8DXYQXQC.1 size=4986 2024-09-12T00:31:04.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.254+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=W0HZ8DXYQXQC tag=FUJ79CQH4GLN type=write size=2102138 2024-09-12T00:31:04.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.256+0000 7f0362c73780 1 < canceled operation key=I3B48QD9E40S tag=9AP9ML0TWIVH type=del size=4070134 2024-09-12T00:31:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.258+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~1OO8C9YHKE4Z.0 size=1048576 2024-09-12T00:31:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.259+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~1OO8C9YHKE4Z.1 size=462262 2024-09-12T00:31:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.260+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=1OO8C9YHKE4Z tag=2X62EDGE7S2R type=write size=2559414 2024-09-12T00:31:04.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.261+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=1ELTGZIO4HW4 type=del 2024-09-12T00:31:04.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.262+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=7KLAFB85W3GD type=del size=714387 2024-09-12T00:31:04.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.263+0000 7f0362c73780 1 < canceled part key=_multipart_G4G6E7KTTZY9.2~R9NRQ8OIF9ZX.0 size=1048576 2024-09-12T00:31:04.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.264+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~R9NRQ8OIF9ZX.1 size=788729 2024-09-12T00:31:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.266+0000 7f0362c73780 1 < canceled multipart upload key=G4G6E7KTTZY9 upload=R9NRQ8OIF9ZX tag=9ROXJX7MYKZI type=write size=2885881 2024-09-12T00:31:04.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.269+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~2T2WQLFC7L9I.0 size=193435 2024-09-12T00:31:04.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.269+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=2T2WQLFC7L9I tag=NRBI4M2D9GLV type=write size=1242011 2024-09-12T00:31:04.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.270+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~38T9ROJLV3JN.0 size=1048576 2024-09-12T00:31:04.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.271+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~38T9ROJLV3JN.1 size=1048576 2024-09-12T00:31:04.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.272+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~38T9ROJLV3JN.2 size=640908 2024-09-12T00:31:04.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.275+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=38T9ROJLV3JN tag=GOICHPG4NO8H type=write size=3786636 2024-09-12T00:31:04.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.277+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~T99WMCYZLRZ9.0 size=434163 2024-09-12T00:31:04.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.277+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=T99WMCYZLRZ9 tag=5ZBLX4LR5AWK type=write size=1482739 2024-09-12T00:31:04.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.279+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=N2CRF5KE5WB0 type=del 2024-09-12T00:31:04.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.280+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=GGC8UMCFMJRI type=write size=153765 2024-09-12T00:31:04.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.282+0000 7f0362c73780 1 < completed write operation key=HEN9LUUIDAR5 tag=SQULLLDM1F6X type=write size=75436 2024-09-12T00:31:04.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.283+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=PN8BRXT3YYIA type=del size=685132 2024-09-12T00:31:04.282 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.283+0000 7f0362c73780 1 < canceled part key=_multipart_PLAYMR18X9DZ.2~OA05AX5RDPM9.0 size=1048576 2024-09-12T00:31:04.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.285+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~OA05AX5RDPM9.1 size=1048576 2024-09-12T00:31:04.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.286+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~OA05AX5RDPM9.2 size=101040 2024-09-12T00:31:04.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.288+0000 7f0362c73780 1 < canceled multipart upload key=PLAYMR18X9DZ upload=OA05AX5RDPM9 tag=TMDD7EK0ZZKA type=write size=3246768 2024-09-12T00:31:04.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.290+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=23PGHAVPW3LM type=del size=1020959 2024-09-12T00:31:04.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.290+0000 7f0362c73780 1 < canceled part key=_multipart_PLAYMR18X9DZ.2~TL0FCGTGG63W.0 size=1048576 2024-09-12T00:31:04.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.291+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~TL0FCGTGG63W.1 size=1048576 2024-09-12T00:31:04.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.293+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~TL0FCGTGG63W.2 size=214971 2024-09-12T00:31:04.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.295+0000 7f0362c73780 1 < canceled multipart upload key=PLAYMR18X9DZ upload=TL0FCGTGG63W tag=ZRZLREURN8GE type=write size=3360699 2024-09-12T00:31:04.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.297+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=PB7717OH5ZR8 type=del size=3485180 2024-09-12T00:31:04.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.298+0000 7f0362c73780 1 < completed part key=_multipart_HWSQFSK29S0V.2~NNG7400IRXOS.0 size=482625 2024-09-12T00:31:04.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.301+0000 7f0362c73780 1 < completed multipart upload key=HWSQFSK29S0V upload=NNG7400IRXOS tag=6R2HOMT2SZAV type=write size=1531201 2024-09-12T00:31:04.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.304+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~WHEHZUZBMB5X.0 size=936221 2024-09-12T00:31:04.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.304+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=WHEHZUZBMB5X tag=KAHC0VJL4RHC type=write size=1984797 2024-09-12T00:31:04.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.306+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=HZEVH1LF0X93 type=del 2024-09-12T00:31:04.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.307+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=KBVT9YOW74OI type=write size=680263 2024-09-12T00:31:04.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.309+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=GP8BEQ2OM1SN type=del 2024-09-12T00:31:04.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.310+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=VNFQNL6NNAUH type=del size=2921303 2024-09-12T00:31:04.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.312+0000 7f0362c73780 1 < canceled operation key=44YJP6XPIFT5 tag=BX01KFVFS7E4 type=write size=893989 2024-09-12T00:31:04.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.314+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=L06941Q1ACBU type=write size=744457 2024-09-12T00:31:04.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.317+0000 7f0362c73780 1 < suggested remove operation key=HEN9LUUIDAR5 tag=MXJF42DBO1IW type=del 2024-09-12T00:31:04.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.320+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~HDKZ28Y1BNDN.0 size=1048576 2024-09-12T00:31:04.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.321+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~HDKZ28Y1BNDN.1 size=1048576 2024-09-12T00:31:04.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.322+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~HDKZ28Y1BNDN.2 size=823723 2024-09-12T00:31:04.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.322+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=HDKZ28Y1BNDN tag=4ERHT2JFY188 type=write size=3969451 2024-09-12T00:31:04.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.324+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~D67VZJF3RQQU.0 size=1048576 2024-09-12T00:31:04.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.325+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~D67VZJF3RQQU.1 size=1048576 2024-09-12T00:31:04.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.326+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~D67VZJF3RQQU.2 size=353764 2024-09-12T00:31:04.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.328+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=D67VZJF3RQQU tag=80F7R7BIEKPX type=write size=3499492 2024-09-12T00:31:04.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.329+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=QQ74QVINJPPG type=del size=4111225 2024-09-12T00:31:04.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.331+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~QOA8YU2AQJE8.0 size=284260 2024-09-12T00:31:04.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.334+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=QOA8YU2AQJE8 tag=WO848OFMI52N type=write size=1332836 2024-09-12T00:31:04.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.335+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=FSEBCYKHPFS5 type=del size=3320101 2024-09-12T00:31:04.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.337+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~W0HZ8DXYQXQC.0 size=1048576 2024-09-12T00:31:04.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.338+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~W0HZ8DXYQXQC.1 size=4986 2024-09-12T00:31:04.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.340+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=W0HZ8DXYQXQC tag=FUJ79CQH4GLN type=write size=2102138 2024-09-12T00:31:04.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.342+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=5Z2Z3FL81F28 type=del size=2829438 2024-09-12T00:31:04.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.344+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~1OO8C9YHKE4Z.0 size=1048576 2024-09-12T00:31:04.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.345+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~1OO8C9YHKE4Z.1 size=462262 2024-09-12T00:31:04.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.347+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=1OO8C9YHKE4Z tag=2X62EDGE7S2R type=write size=2559414 2024-09-12T00:31:04.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.349+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=J37NNUG2SK8W type=del size=1491500 2024-09-12T00:31:04.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.351+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=7KLAFB85W3GD type=del 2024-09-12T00:31:04.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.353+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~FWBLI445T2J9.0 size=1036444 2024-09-12T00:31:04.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.353+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=FWBLI445T2J9 tag=C5JKRQOFZFVY type=write size=2085020 2024-09-12T00:31:04.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.355+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~2T2WQLFC7L9I.0 size=193435 2024-09-12T00:31:04.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.357+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=2T2WQLFC7L9I tag=NRBI4M2D9GLV type=write size=1242011 2024-09-12T00:31:04.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.360+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~LFATQHTVJ1M1.0 size=386136 2024-09-12T00:31:04.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.360+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=LFATQHTVJ1M1 tag=OVVY72KFKXNT type=write size=1434712 2024-09-12T00:31:04.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.362+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~T99WMCYZLRZ9.0 size=434163 2024-09-12T00:31:04.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.364+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=T99WMCYZLRZ9 tag=5ZBLX4LR5AWK type=write size=1482739 2024-09-12T00:31:04.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.367+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~3DRYU6RL4SFF.0 size=1048576 2024-09-12T00:31:04.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.368+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~3DRYU6RL4SFF.1 size=345162 2024-09-12T00:31:04.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.368+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=3DRYU6RL4SFF tag=8O9TVT00IGW7 type=write size=2442314 2024-09-12T00:31:04.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.369+0000 7f0362c73780 1 < completed write operation key=OY30LP7FYXNF tag=GGC8UMCFMJRI type=write size=153765 2024-09-12T00:31:04.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.372+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~A6RVTZSQ92OE.0 size=1048576 2024-09-12T00:31:04.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.374+0000 7f0362c73780 1 > prepared part key=_multipart_PLAYMR18X9DZ.2~A6RVTZSQ92OE.1 size=571066 2024-09-12T00:31:04.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.374+0000 7f0362c73780 1 > prepared multipart upload key=PLAYMR18X9DZ upload=A6RVTZSQ92OE tag=QGWEGZ199HJH type=write size=2668218 2024-09-12T00:31:04.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.375+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=PN8BRXT3YYIA type=del 2024-09-12T00:31:04.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.377+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=W0W034PQM6VO type=del size=2923281 2024-09-12T00:31:04.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.378+0000 7f0362c73780 1 < canceled operation key=44YJP6XPIFT5 tag=23PGHAVPW3LM type=del size=1020959 2024-09-12T00:31:04.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.382+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~D58QEDTOXG1I.0 size=1048576 2024-09-12T00:31:04.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.383+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~D58QEDTOXG1I.1 size=1048576 2024-09-12T00:31:04.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.384+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~D58QEDTOXG1I.2 size=938799 2024-09-12T00:31:04.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.384+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=D58QEDTOXG1I tag=F62LVQX46RJU type=write size=4084527 2024-09-12T00:31:04.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.385+0000 7f0362c73780 -1 < no bi entry to suggest for operation key=HEN9LUUIDAR5 tag=PB7717OH5ZR8 type=del size=3485180: (2) No such file or directory 2024-09-12T00:31:04.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.386+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=KB30CDAHO1G9 type=del size=2573728 2024-09-12T00:31:04.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.387+0000 7f0362c73780 1 < canceled part key=_multipart_CZHT9UQS34JU.2~WHEHZUZBMB5X.0 size=936221 2024-09-12T00:31:04.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.389+0000 7f0362c73780 1 < canceled multipart upload key=CZHT9UQS34JU upload=WHEHZUZBMB5X tag=KAHC0VJL4RHC type=write size=1984797 2024-09-12T00:31:04.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.391+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=AGLJ008E5872 type=del size=1721985 2024-09-12T00:31:04.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.393+0000 7f0362c73780 1 < completed write operation key=IIZAWZDLR2QE tag=KBVT9YOW74OI type=write size=680263 2024-09-12T00:31:04.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.394+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=IDPCSO5XYP1L type=del size=2984086 2024-09-12T00:31:04.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.397+0000 7f0362c73780 1 < suggested update operation key=HWSQFSK29S0V tag=VNFQNL6NNAUH type=del size=2921303 2024-09-12T00:31:04.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.400+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~6MYQ7JX3G620.0 size=1048576 2024-09-12T00:31:04.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.401+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~6MYQ7JX3G620.1 size=39558 2024-09-12T00:31:04.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.401+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=6MYQ7JX3G620 tag=IW935DXVYTKH type=write size=2136710 2024-09-12T00:31:04.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.404+0000 7f0362c73780 1 < suggested remove operation key=XMMZOX8MH3GT tag=L06941Q1ACBU type=write 2024-09-12T00:31:04.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.407+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~C8LLEEXNXE06.0 size=1001583 2024-09-12T00:31:04.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.407+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=C8LLEEXNXE06 tag=LRBSKX8R3DG2 type=write size=2050159 2024-09-12T00:31:04.406 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.408+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~HDKZ28Y1BNDN.0 size=1048576 2024-09-12T00:31:04.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.409+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~HDKZ28Y1BNDN.1 size=1048576 2024-09-12T00:31:04.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.412+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~HDKZ28Y1BNDN.2 size=823723 2024-09-12T00:31:04.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.414+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=HDKZ28Y1BNDN tag=4ERHT2JFY188 type=write size=3969451 2024-09-12T00:31:04.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.417+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~7GKWX0TLW8M2.0 size=667347 2024-09-12T00:31:04.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.417+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=7GKWX0TLW8M2 tag=61SIK48V8VEX type=write size=1715923 2024-09-12T00:31:04.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.418+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=QQ74QVINJPPG type=del 2024-09-12T00:31:04.418 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.420+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=MKC3QXVNGBOP type=del size=951272 2024-09-12T00:31:04.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.421+0000 7f0362c73780 1 < completed delete operation key=1IPW8SJ6SSU2 tag=FSEBCYKHPFS5 type=del 2024-09-12T00:31:04.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.423+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=2KX9O5QPSHQJ type=write size=659790 2024-09-12T00:31:04.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.424+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=5Z2Z3FL81F28 type=del 2024-09-12T00:31:04.424 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.425+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=3S2TAYUFQEDY type=del size=729895 2024-09-12T00:31:04.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.427+0000 7f0362c73780 1 < canceled operation key=I3B48QD9E40S tag=J37NNUG2SK8W type=del size=1491500 2024-09-12T00:31:04.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.429+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=S1PC5PPIL2X0 type=del size=332301 2024-09-12T00:31:04.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.430+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~FWBLI445T2J9.0 size=1036444 2024-09-12T00:31:04.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.433+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=FWBLI445T2J9 tag=C5JKRQOFZFVY type=write size=2085020 2024-09-12T00:31:04.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.434+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=T0G749M534I9 type=del size=2021678 2024-09-12T00:31:04.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.436+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~LFATQHTVJ1M1.0 size=386136 2024-09-12T00:31:04.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.438+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=LFATQHTVJ1M1 tag=OVVY72KFKXNT type=write size=1434712 2024-09-12T00:31:04.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.439+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=10U9KY55ZDR6 type=del size=1700230 2024-09-12T00:31:04.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.441+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~3DRYU6RL4SFF.0 size=1048576 2024-09-12T00:31:04.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.442+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~3DRYU6RL4SFF.1 size=345162 2024-09-12T00:31:04.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.444+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=3DRYU6RL4SFF tag=8O9TVT00IGW7 type=write size=2442314 2024-09-12T00:31:04.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.446+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=7ESZGA7I74WG type=write size=368349 2024-09-12T00:31:04.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.447+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~A6RVTZSQ92OE.0 size=1048576 2024-09-12T00:31:04.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.448+0000 7f0362c73780 1 < completed part key=_multipart_PLAYMR18X9DZ.2~A6RVTZSQ92OE.1 size=571066 2024-09-12T00:31:04.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.451+0000 7f0362c73780 1 < completed multipart upload key=PLAYMR18X9DZ upload=A6RVTZSQ92OE tag=QGWEGZ199HJH type=write size=2668218 2024-09-12T00:31:04.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.453+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~XIOH0XDNU602.0 size=1047523 2024-09-12T00:31:04.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.453+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=XIOH0XDNU602 tag=Z2P58Q4XSDUL type=write size=2096099 2024-09-12T00:31:04.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.455+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=W0W034PQM6VO type=del 2024-09-12T00:31:04.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.457+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=4MJ01N0R9MMA type=del size=3074324 2024-09-12T00:31:04.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.457+0000 7f0362c73780 1 < canceled part key=_multipart_IIZAWZDLR2QE.2~D58QEDTOXG1I.0 size=1048576 2024-09-12T00:31:04.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.458+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~D58QEDTOXG1I.1 size=1048576 2024-09-12T00:31:04.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.460+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~D58QEDTOXG1I.2 size=938799 2024-09-12T00:31:04.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.462+0000 7f0362c73780 1 < canceled multipart upload key=IIZAWZDLR2QE upload=D58QEDTOXG1I tag=F62LVQX46RJU type=write size=4084527 2024-09-12T00:31:04.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.463+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=HSE45QD78ENL type=del size=597218 2024-09-12T00:31:04.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.465+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=KB30CDAHO1G9 type=del 2024-09-12T00:31:04.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.466+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=CSHDHIDIULOB type=del size=499535 2024-09-12T00:31:04.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.468+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=AGLJ008E5872 type=del 2024-09-12T00:31:04.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.469+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=P537DPR35478 type=write size=564156 2024-09-12T00:31:04.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.472+0000 7f0362c73780 1 < suggested remove operation key=927NCYXX8Z2P tag=IDPCSO5XYP1L type=del 2024-09-12T00:31:04.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.473+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=0ZP2SIQBZH1H type=write size=907957 2024-09-12T00:31:04.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.475+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~6MYQ7JX3G620.0 size=1048576 2024-09-12T00:31:04.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.476+0000 7f0362c73780 1 < completed part key=_multipart_84T1VJG5SHU4.2~6MYQ7JX3G620.1 size=39558 2024-09-12T00:31:04.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.478+0000 7f0362c73780 1 < completed multipart upload key=84T1VJG5SHU4 upload=6MYQ7JX3G620 tag=IW935DXVYTKH type=write size=2136710 2024-09-12T00:31:04.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.479+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=SJHUT1JGMFXJ type=del size=1964583 2024-09-12T00:31:04.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.481+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~C8LLEEXNXE06.0 size=1001583 2024-09-12T00:31:04.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.484+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=C8LLEEXNXE06 tag=LRBSKX8R3DG2 type=write size=2050159 2024-09-12T00:31:04.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.485+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=860GYPGTXGI7 type=write size=314124 2024-09-12T00:31:04.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.487+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~7GKWX0TLW8M2.0 size=667347 2024-09-12T00:31:04.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.489+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=7GKWX0TLW8M2 tag=61SIK48V8VEX type=write size=1715923 2024-09-12T00:31:04.490 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.492+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~CYKT2C4K074J.0 size=1048576 2024-09-12T00:31:04.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.493+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~CYKT2C4K074J.1 size=841855 2024-09-12T00:31:04.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.493+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=CYKT2C4K074J tag=OIA88GHAXR5N type=write size=2939007 2024-09-12T00:31:04.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.494+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=MKC3QXVNGBOP type=del 2024-09-12T00:31:04.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.496+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=MW72OEPU44DE type=del size=3080088 2024-09-12T00:31:04.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.499+0000 7f0362c73780 1 < suggested update operation key=CZHT9UQS34JU tag=2KX9O5QPSHQJ type=write size=659790 2024-09-12T00:31:04.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.500+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=J7IR9PQZ64E8 type=del size=690291 2024-09-12T00:31:04.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.502+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=3S2TAYUFQEDY type=del 2024-09-12T00:31:04.501 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.503+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=LYCFMWZCG056 type=del size=1843912 2024-09-12T00:31:04.503 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.505+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=S1PC5PPIL2X0 type=del 2024-09-12T00:31:04.504 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.506+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=2WAGE9ZIMRPW type=del size=3467152 2024-09-12T00:31:04.506 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.508+0000 7f0362c73780 1 < canceled operation key=PLAYMR18X9DZ tag=T0G749M534I9 type=del size=2021678 2024-09-12T00:31:04.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.510+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~USUGMQVHIV8V.0 size=1048576 2024-09-12T00:31:04.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.511+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~USUGMQVHIV8V.1 size=708279 2024-09-12T00:31:04.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.511+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=USUGMQVHIV8V tag=BJ17824L7T7Z type=write size=2805431 2024-09-12T00:31:04.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.513+0000 7f0362c73780 1 < completed delete operation key=3XZZX53L26G5 tag=10U9KY55ZDR6 type=del 2024-09-12T00:31:04.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.514+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=53LDOHOWLL7W type=del size=597314 2024-09-12T00:31:04.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.516+0000 7f0362c73780 -1 < failed to complete operation key=927NCYXX8Z2P tag=7ESZGA7I74WG type=write size=368349: (22) Invalid argument 2024-09-12T00:31:04.516 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.518+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~H5FBTLW7S2R9.0 size=1048576 2024-09-12T00:31:04.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.519+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~H5FBTLW7S2R9.1 size=893175 2024-09-12T00:31:04.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.519+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=H5FBTLW7S2R9 tag=QL3IN2M5GNGW type=write size=2990327 2024-09-12T00:31:04.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.521+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~XIOH0XDNU602.0 size=1047523 2024-09-12T00:31:04.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.523+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=XIOH0XDNU602 tag=Z2P58Q4XSDUL type=write size=2096099 2024-09-12T00:31:04.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.526+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~SPE1A45PIWCP.0 size=1048576 2024-09-12T00:31:04.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.528+0000 7f0362c73780 1 > prepared part key=_multipart_G2HW98G6624O.2~SPE1A45PIWCP.1 size=861600 2024-09-12T00:31:04.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.528+0000 7f0362c73780 1 > prepared multipart upload key=G2HW98G6624O upload=SPE1A45PIWCP tag=4V2GCQJHDQM2 type=write size=2958752 2024-09-12T00:31:04.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.529+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=4MJ01N0R9MMA type=del 2024-09-12T00:31:04.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.530+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=MMPS0DZ6KI3X type=del size=3027562 2024-09-12T00:31:04.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.532+0000 7f0362c73780 1 < canceled operation key=YTN99RBTKO39 tag=HSE45QD78ENL type=del size=597218 2024-09-12T00:31:04.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.533+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=J0UCTI5QZZB2 type=del size=1186050 2024-09-12T00:31:04.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.535+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=CSHDHIDIULOB type=del 2024-09-12T00:31:04.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.536+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=OVWN4QE2ALU7 type=del size=3539099 2024-09-12T00:31:04.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.537+0000 7f0362c73780 1 < completed write operation key=EHBOL435W9ZE tag=P537DPR35478 type=write size=564156 2024-09-12T00:31:04.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.538+0000 7f0362c73780 1 > prepared operation key=CZHT9UQS34JU tag=32W33UK13RYO type=del size=2495402 2024-09-12T00:31:04.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.540+0000 7f0362c73780 1 < completed write operation key=KWDEKRO3WICD tag=0ZP2SIQBZH1H type=write size=907957 2024-09-12T00:31:04.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.542+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=LG9IO20E45ZZ type=del size=1271206 2024-09-12T00:31:04.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.543+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=SJHUT1JGMFXJ type=del 2024-09-12T00:31:04.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.545+0000 7f0362c73780 1 > prepared operation key=1IPW8SJ6SSU2 tag=R7BD18L2S702 type=write size=325918 2024-09-12T00:31:04.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.546+0000 7f0362c73780 1 < completed write operation key=1IPW8SJ6SSU2 tag=860GYPGTXGI7 type=write size=314124 2024-09-12T00:31:04.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.547+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=6CX7LK38YFTB type=del size=3436628 2024-09-12T00:31:04.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.548+0000 7f0362c73780 1 < canceled part key=_multipart_OY30LP7FYXNF.2~CYKT2C4K074J.0 size=1048576 2024-09-12T00:31:04.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.548+0000 7f0362c73780 1 < canceled part key=_multipart_OY30LP7FYXNF.2~CYKT2C4K074J.1 size=841855 2024-09-12T00:31:04.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.550+0000 7f0362c73780 1 < canceled multipart upload key=OY30LP7FYXNF upload=CYKT2C4K074J tag=OIA88GHAXR5N type=write size=2939007 2024-09-12T00:31:04.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.553+0000 7f0362c73780 1 > prepared part key=_multipart_1SE6WTQMW6JU.2~43DM82018LW8.0 size=1046832 2024-09-12T00:31:04.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.553+0000 7f0362c73780 1 > prepared multipart upload key=1SE6WTQMW6JU upload=43DM82018LW8 tag=ZSDJ6AALKR46 type=write size=2095408 2024-09-12T00:31:04.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.556+0000 7f0362c73780 1 < suggested update operation key=2DHHPBYV80O8 tag=MW72OEPU44DE type=del size=3080088 2024-09-12T00:31:04.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.557+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=KM3W8SK7D29F type=del size=260441 2024-09-12T00:31:04.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.558+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=J7IR9PQZ64E8 type=del 2024-09-12T00:31:04.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.560+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=IRY07H7QUPGX type=write size=866809 2024-09-12T00:31:04.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.561+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=LYCFMWZCG056 type=del 2024-09-12T00:31:04.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.563+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=ZURZRY9UHXTH type=del size=202903 2024-09-12T00:31:04.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.564+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=2WAGE9ZIMRPW type=del 2024-09-12T00:31:04.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.565+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=9ZZF3KB6IU61 type=del size=3846430 2024-09-12T00:31:04.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.567+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~USUGMQVHIV8V.0 size=1048576 2024-09-12T00:31:04.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.568+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~USUGMQVHIV8V.1 size=708279 2024-09-12T00:31:04.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.570+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=USUGMQVHIV8V tag=BJ17824L7T7Z type=write size=2805431 2024-09-12T00:31:04.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.573+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~4DRZORRMCMKG.0 size=544142 2024-09-12T00:31:04.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.573+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=4DRZORRMCMKG tag=E7UPCGJA1P23 type=write size=1592718 2024-09-12T00:31:04.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.574+0000 7f0362c73780 -1 < failed to complete operation key=2DHHPBYV80O8 tag=53LDOHOWLL7W type=del size=597314: (22) Invalid argument 2024-09-12T00:31:04.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.576+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~W7DXCVNS8KY1.0 size=1048576 2024-09-12T00:31:04.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.578+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~W7DXCVNS8KY1.1 size=1045487 2024-09-12T00:31:04.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.578+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=W7DXCVNS8KY1 tag=KLAEW1XYPG28 type=write size=3142639 2024-09-12T00:31:04.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.579+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~H5FBTLW7S2R9.0 size=1048576 2024-09-12T00:31:04.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.579+0000 7f0362c73780 1 < canceled part key=_multipart_1IPW8SJ6SSU2.2~H5FBTLW7S2R9.1 size=893175 2024-09-12T00:31:04.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.581+0000 7f0362c73780 1 < canceled multipart upload key=1IPW8SJ6SSU2 upload=H5FBTLW7S2R9 tag=QL3IN2M5GNGW type=write size=2990327 2024-09-12T00:31:04.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.583+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=A3R5BZ6QUCLD type=del size=4060641 2024-09-12T00:31:04.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.584+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~SPE1A45PIWCP.0 size=1048576 2024-09-12T00:31:04.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.585+0000 7f0362c73780 1 < completed part key=_multipart_G2HW98G6624O.2~SPE1A45PIWCP.1 size=861600 2024-09-12T00:31:04.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.587+0000 7f0362c73780 1 < completed multipart upload key=G2HW98G6624O upload=SPE1A45PIWCP tag=4V2GCQJHDQM2 type=write size=2958752 2024-09-12T00:31:04.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.589+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=QEMD7ZP26EXN type=write size=304468 2024-09-12T00:31:04.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.590+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=MMPS0DZ6KI3X type=del 2024-09-12T00:31:04.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.592+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=O4SX1VZL7JDA type=del size=3005110 2024-09-12T00:31:04.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.595+0000 7f0362c73780 1 < suggested remove operation key=1MLL1T362X51 tag=J0UCTI5QZZB2 type=del 2024-09-12T00:31:04.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.596+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=IHZKO20JEVAL type=del size=2477696 2024-09-12T00:31:04.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.598+0000 7f0362c73780 -1 < failed to complete operation key=1MLL1T362X51 tag=OVWN4QE2ALU7 type=del size=3539099: (22) Invalid argument 2024-09-12T00:31:04.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.600+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~8K4VVLZK8IY0.0 size=1048576 2024-09-12T00:31:04.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.601+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~8K4VVLZK8IY0.1 size=1048576 2024-09-12T00:31:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.602+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~8K4VVLZK8IY0.2 size=8594 2024-09-12T00:31:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.602+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=8K4VVLZK8IY0 tag=BQMI3WH0BINB type=write size=3154322 2024-09-12T00:31:04.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.604+0000 7f0362c73780 1 < completed delete operation key=CZHT9UQS34JU tag=32W33UK13RYO type=del 2024-09-12T00:31:04.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.605+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=N23JK2F3QUI1 type=del size=3523946 2024-09-12T00:31:04.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.608+0000 7f0362c73780 1 < suggested remove operation key=WT0185G517YR tag=LG9IO20E45ZZ type=del 2024-09-12T00:31:04.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.609+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=QNTDL63XZ0YJ type=del size=3969549 2024-09-12T00:31:04.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.611+0000 7f0362c73780 1 < completed write operation key=1IPW8SJ6SSU2 tag=R7BD18L2S702 type=write size=325918 2024-09-12T00:31:04.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.613+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~ESEUROZD1RBS.0 size=1044654 2024-09-12T00:31:04.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.613+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=ESEUROZD1RBS tag=JHV4FWDHH6AT type=write size=2093230 2024-09-12T00:31:04.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.615+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=6CX7LK38YFTB type=del 2024-09-12T00:31:04.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.616+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=L20DBIIFEZBP type=del size=1355529 2024-09-12T00:31:04.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.619+0000 7f0362c73780 1 < completed part key=_multipart_1SE6WTQMW6JU.2~43DM82018LW8.0 size=1046832 2024-09-12T00:31:04.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.623+0000 7f0362c73780 1 < completed multipart upload key=1SE6WTQMW6JU upload=43DM82018LW8 tag=ZSDJ6AALKR46 type=write size=2095408 2024-09-12T00:31:04.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.625+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~T2RK9WVY6X8L.0 size=506790 2024-09-12T00:31:04.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.625+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=T2RK9WVY6X8L tag=2UVVOISZWJZM type=write size=1555366 2024-09-12T00:31:04.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.626+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=KM3W8SK7D29F type=del 2024-09-12T00:31:04.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.628+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=8O4O7143ZS28 type=del size=427875 2024-09-12T00:31:04.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.635+0000 7f0362c73780 1 < suggested update operation key=XR8L0HL374VC tag=IRY07H7QUPGX type=write size=866809 2024-09-12T00:31:04.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.638+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~QL7MWTDUVMSI.0 size=1048576 2024-09-12T00:31:04.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.639+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~QL7MWTDUVMSI.1 size=1048576 2024-09-12T00:31:04.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.640+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~QL7MWTDUVMSI.2 size=457094 2024-09-12T00:31:04.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.640+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=QL7MWTDUVMSI tag=STRC8S5C8BBV type=write size=3602822 2024-09-12T00:31:04.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.641+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=ZURZRY9UHXTH type=del 2024-09-12T00:31:04.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.643+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=V7XXFEGQPZRN type=write size=324864 2024-09-12T00:31:04.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.646+0000 7f0362c73780 1 < suggested remove operation key=J5GSZCJW2BP1 tag=9ZZF3KB6IU61 type=del 2024-09-12T00:31:04.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.648+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~E6N3IBKWKZIF.0 size=1048576 2024-09-12T00:31:04.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.649+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~E6N3IBKWKZIF.1 size=1048576 2024-09-12T00:31:04.649 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.651+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~E6N3IBKWKZIF.2 size=963845 2024-09-12T00:31:04.649 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.651+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=E6N3IBKWKZIF tag=IPZMQNZPTRNY type=write size=4109573 2024-09-12T00:31:04.651 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.652+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~4DRZORRMCMKG.0 size=544142 2024-09-12T00:31:04.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.655+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=4DRZORRMCMKG tag=E7UPCGJA1P23 type=write size=1592718 2024-09-12T00:31:04.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.657+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~9GUY16KR96DZ.0 size=314911 2024-09-12T00:31:04.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.657+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=9GUY16KR96DZ tag=7TEBC2SWE6MB type=write size=1363487 2024-09-12T00:31:04.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.659+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~W7DXCVNS8KY1.0 size=1048576 2024-09-12T00:31:04.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.660+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~W7DXCVNS8KY1.1 size=1045487 2024-09-12T00:31:04.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.662+0000 7f0362c73780 1 < completed multipart upload key=927NCYXX8Z2P upload=W7DXCVNS8KY1 tag=KLAEW1XYPG28 type=write size=3142639 2024-09-12T00:31:04.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.664+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=UR4C2S2949M1 type=del size=2936961 2024-09-12T00:31:04.663 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.665+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=A3R5BZ6QUCLD type=del 2024-09-12T00:31:04.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.666+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=364GS6A7PFCD type=del size=2548787 2024-09-12T00:31:04.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.669+0000 7f0362c73780 1 < suggested remove operation key=84T1VJG5SHU4 tag=QEMD7ZP26EXN type=write 2024-09-12T00:31:04.670 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.672+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~RBHU2QT1GQPS.0 size=1048576 2024-09-12T00:31:04.671 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.673+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~RBHU2QT1GQPS.1 size=1048576 2024-09-12T00:31:04.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.674+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~RBHU2QT1GQPS.2 size=600467 2024-09-12T00:31:04.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.674+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=RBHU2QT1GQPS tag=QLWN8U0DK3E0 type=write size=3746195 2024-09-12T00:31:04.673 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.675+0000 7f0362c73780 1 < canceled operation key=G4G6E7KTTZY9 tag=O4SX1VZL7JDA type=del size=3005110 2024-09-12T00:31:04.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.678+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~PYVTZ7LOZMM5.0 size=1048576 2024-09-12T00:31:04.677 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.679+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~PYVTZ7LOZMM5.1 size=1048576 2024-09-12T00:31:04.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.680+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~PYVTZ7LOZMM5.2 size=283231 2024-09-12T00:31:04.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.680+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=PYVTZ7LOZMM5 tag=FEH6TBZ5AWVR type=write size=3428959 2024-09-12T00:31:04.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.681+0000 7f0362c73780 1 < completed delete operation key=XMMZOX8MH3GT tag=IHZKO20JEVAL type=del 2024-09-12T00:31:04.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.684+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~92LJ3TGXY2AK.0 size=1048576 2024-09-12T00:31:04.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.685+0000 7f0362c73780 1 > prepared part key=_multipart_2DHHPBYV80O8.2~92LJ3TGXY2AK.1 size=297814 2024-09-12T00:31:04.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.685+0000 7f0362c73780 1 > prepared multipart upload key=2DHHPBYV80O8 upload=92LJ3TGXY2AK tag=G6BU23HTY2Y0 type=write size=2394966 2024-09-12T00:31:04.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.686+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~8K4VVLZK8IY0.0 size=1048576 2024-09-12T00:31:04.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.687+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~8K4VVLZK8IY0.1 size=1048576 2024-09-12T00:31:04.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.687+0000 7f0362c73780 1 < canceled part key=_multipart_J5GSZCJW2BP1.2~8K4VVLZK8IY0.2 size=8594 2024-09-12T00:31:04.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.689+0000 7f0362c73780 1 < canceled multipart upload key=J5GSZCJW2BP1 upload=8K4VVLZK8IY0 tag=BQMI3WH0BINB type=write size=3154322 2024-09-12T00:31:04.690 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.692+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~RYIY4LQHTD7D.0 size=324537 2024-09-12T00:31:04.690 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.692+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=RYIY4LQHTD7D tag=WGS4B5KY8ZJI type=write size=1373113 2024-09-12T00:31:04.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.693+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=N23JK2F3QUI1 type=del 2024-09-12T00:31:04.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.695+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=512FR7T4ATP2 type=del size=4121725 2024-09-12T00:31:04.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.696+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=QNTDL63XZ0YJ type=del 2024-09-12T00:31:04.696 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.698+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=9Q0SIO8DWXC0 type=del size=2543390 2024-09-12T00:31:04.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.699+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~ESEUROZD1RBS.0 size=1044654 2024-09-12T00:31:04.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.702+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=ESEUROZD1RBS tag=JHV4FWDHH6AT type=write size=2093230 2024-09-12T00:31:04.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.703+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=ALELHOMYNKOU type=del size=3196209 2024-09-12T00:31:04.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.705+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=L20DBIIFEZBP type=del 2024-09-12T00:31:04.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.706+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=JCKED733TT3Z type=del size=668415 2024-09-12T00:31:04.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.708+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~T2RK9WVY6X8L.0 size=506790 2024-09-12T00:31:04.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.710+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=T2RK9WVY6X8L tag=2UVVOISZWJZM type=write size=1555366 2024-09-12T00:31:04.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.711+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=TM41O13LGU2R type=del size=1130147 2024-09-12T00:31:04.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.713+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=8O4O7143ZS28 type=del 2024-09-12T00:31:04.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.715+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=51LW0MKFO8AC type=del size=2431465 2024-09-12T00:31:04.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.715+0000 7f0362c73780 1 < canceled part key=_multipart_2DHHPBYV80O8.2~QL7MWTDUVMSI.0 size=1048576 2024-09-12T00:31:04.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.716+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~QL7MWTDUVMSI.1 size=1048576 2024-09-12T00:31:04.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.717+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~QL7MWTDUVMSI.2 size=457094 2024-09-12T00:31:04.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.720+0000 7f0362c73780 1 < canceled multipart upload key=2DHHPBYV80O8 upload=QL7MWTDUVMSI tag=STRC8S5C8BBV type=write size=3602822 2024-09-12T00:31:04.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.722+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=JAS3I4QG2VGG type=del size=2183174 2024-09-12T00:31:04.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.724+0000 7f0362c73780 1 < suggested update operation key=YTN99RBTKO39 tag=V7XXFEGQPZRN type=write size=324864 2024-09-12T00:31:04.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.726+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=QGVWOGI56DHZ type=del size=1952448 2024-09-12T00:31:04.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.727+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~E6N3IBKWKZIF.0 size=1048576 2024-09-12T00:31:04.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.729+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~E6N3IBKWKZIF.1 size=1048576 2024-09-12T00:31:04.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.730+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~E6N3IBKWKZIF.2 size=963845 2024-09-12T00:31:04.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.732+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=E6N3IBKWKZIF tag=IPZMQNZPTRNY type=write size=4109573 2024-09-12T00:31:04.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.735+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~V3SBAE32PUMP.0 size=666592 2024-09-12T00:31:04.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.735+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=V3SBAE32PUMP tag=FR6OLU2X3OTD type=write size=1715168 2024-09-12T00:31:04.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.736+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~9GUY16KR96DZ.0 size=314911 2024-09-12T00:31:04.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.739+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=9GUY16KR96DZ tag=7TEBC2SWE6MB type=write size=1363487 2024-09-12T00:31:04.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.741+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~4OCCICRAHL31.0 size=744063 2024-09-12T00:31:04.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.741+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=4OCCICRAHL31 tag=1QX6P0I1J8RJ type=write size=1792639 2024-09-12T00:31:04.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.744+0000 7f0362c73780 1 < suggested remove operation key=R4ABY5AY0S1P tag=UR4C2S2949M1 type=del 2024-09-12T00:31:04.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.746+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~1YTYU0E2ENPR.0 size=1048576 2024-09-12T00:31:04.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.748+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~1YTYU0E2ENPR.1 size=648505 2024-09-12T00:31:04.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.748+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=1YTYU0E2ENPR tag=KXIIWAUZFK7O type=write size=2745657 2024-09-12T00:31:04.747 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.749+0000 7f0362c73780 1 < completed delete operation key=XR8L0HL374VC tag=364GS6A7PFCD type=del 2024-09-12T00:31:04.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.751+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=VSJF6VG58IJG type=del size=2560028 2024-09-12T00:31:04.750 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.752+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~RBHU2QT1GQPS.0 size=1048576 2024-09-12T00:31:04.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.752+0000 7f0362c73780 1 < canceled part key=_multipart_44YJP6XPIFT5.2~RBHU2QT1GQPS.1 size=1048576 2024-09-12T00:31:04.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.753+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~RBHU2QT1GQPS.2 size=600467 2024-09-12T00:31:04.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.757+0000 7f0362c73780 1 < canceled multipart upload key=44YJP6XPIFT5 upload=RBHU2QT1GQPS tag=QLWN8U0DK3E0 type=write size=3746195 2024-09-12T00:31:04.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.758+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=SKQPXBRSMK0N type=del size=2519759 2024-09-12T00:31:04.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.760+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~PYVTZ7LOZMM5.0 size=1048576 2024-09-12T00:31:04.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.761+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~PYVTZ7LOZMM5.1 size=1048576 2024-09-12T00:31:04.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.762+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~PYVTZ7LOZMM5.2 size=283231 2024-09-12T00:31:04.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.764+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=PYVTZ7LOZMM5 tag=FEH6TBZ5AWVR type=write size=3428959 2024-09-12T00:31:04.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.766+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=5K67YS6CKSHG type=del size=130361 2024-09-12T00:31:04.766 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.768+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~92LJ3TGXY2AK.0 size=1048576 2024-09-12T00:31:04.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.769+0000 7f0362c73780 1 < completed part key=_multipart_2DHHPBYV80O8.2~92LJ3TGXY2AK.1 size=297814 2024-09-12T00:31:04.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.772+0000 7f0362c73780 1 < completed multipart upload key=2DHHPBYV80O8 upload=92LJ3TGXY2AK tag=G6BU23HTY2Y0 type=write size=2394966 2024-09-12T00:31:04.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.775+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~6AVJX4CPB3YB.0 size=463351 2024-09-12T00:31:04.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.775+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=6AVJX4CPB3YB tag=UU1V1EHBKC0U type=write size=1511927 2024-09-12T00:31:04.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.776+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~RYIY4LQHTD7D.0 size=324537 2024-09-12T00:31:04.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.778+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=RYIY4LQHTD7D tag=WGS4B5KY8ZJI type=write size=1373113 2024-09-12T00:31:04.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.781+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~KT40H6L32V7V.0 size=1048576 2024-09-12T00:31:04.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.782+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~KT40H6L32V7V.1 size=537165 2024-09-12T00:31:04.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.782+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=KT40H6L32V7V tag=MXBMT2VYSPMI type=write size=2634317 2024-09-12T00:31:04.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.783+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=512FR7T4ATP2 type=del 2024-09-12T00:31:04.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.785+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=OVOZY3B3MCM2 type=del size=2497742 2024-09-12T00:31:04.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.787+0000 7f0362c73780 1 < suggested update operation key=3XZZX53L26G5 tag=9Q0SIO8DWXC0 type=del size=2543390 2024-09-12T00:31:04.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.789+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=BRS7P1Y7JQ45 type=write size=71985 2024-09-12T00:31:04.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.790+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=ALELHOMYNKOU type=del 2024-09-12T00:31:04.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.793+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~KQAMHA76BLPV.0 size=1048576 2024-09-12T00:31:04.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.794+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~KQAMHA76BLPV.1 size=813931 2024-09-12T00:31:04.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.794+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=KQAMHA76BLPV tag=BWKGA7OL4WX0 type=write size=2911083 2024-09-12T00:31:04.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.797+0000 7f0362c73780 1 < suggested remove operation key=6AYDT9X4LC6T tag=JCKED733TT3Z type=del 2024-09-12T00:31:04.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.798+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=0ESU8MNH57IK type=write size=379636 2024-09-12T00:31:04.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.801+0000 7f0362c73780 1 < suggested remove operation key=G2HW98G6624O tag=TM41O13LGU2R type=del 2024-09-12T00:31:04.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.803+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=779H0SIML5F3 type=del size=694587 2024-09-12T00:31:04.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.804+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=51LW0MKFO8AC type=del 2024-09-12T00:31:04.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.807+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~72XCX7O5RHWJ.0 size=1048576 2024-09-12T00:31:04.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.808+0000 7f0362c73780 1 > prepared part key=_multipart_XR8L0HL374VC.2~72XCX7O5RHWJ.1 size=300420 2024-09-12T00:31:04.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.808+0000 7f0362c73780 1 > prepared multipart upload key=XR8L0HL374VC upload=72XCX7O5RHWJ tag=OFLD5EOCCA43 type=write size=2397572 2024-09-12T00:31:04.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.810+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=JAS3I4QG2VGG type=del 2024-09-12T00:31:04.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.812+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=WIYSS4VKAWFT type=del size=4074748 2024-09-12T00:31:04.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.813+0000 7f0362c73780 1 < canceled operation key=XMMZOX8MH3GT tag=QGVWOGI56DHZ type=del size=1952448 2024-09-12T00:31:04.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.815+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=3I8C3WERRLJ6 type=del size=1516769 2024-09-12T00:31:04.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.816+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~V3SBAE32PUMP.0 size=666592 2024-09-12T00:31:04.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.819+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=V3SBAE32PUMP tag=FR6OLU2X3OTD type=write size=1715168 2024-09-12T00:31:04.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.820+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=9NCGKPHQ81O3 type=del size=2187031 2024-09-12T00:31:04.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.822+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~4OCCICRAHL31.0 size=744063 2024-09-12T00:31:04.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.824+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=4OCCICRAHL31 tag=1QX6P0I1J8RJ type=write size=1792639 2024-09-12T00:31:04.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.827+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~P3FOFRD9YZSL.0 size=857305 2024-09-12T00:31:04.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.827+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=P3FOFRD9YZSL tag=AS7SSC545R74 type=write size=1905881 2024-09-12T00:31:04.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.828+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~1YTYU0E2ENPR.0 size=1048576 2024-09-12T00:31:04.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.829+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~1YTYU0E2ENPR.1 size=648505 2024-09-12T00:31:04.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.831+0000 7f0362c73780 1 < completed multipart upload key=1UUNRPUKAINC upload=1YTYU0E2ENPR tag=KXIIWAUZFK7O type=write size=2745657 2024-09-12T00:31:04.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.835+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~FB6ETAT49MZC.0 size=1048576 2024-09-12T00:31:04.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.836+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~FB6ETAT49MZC.1 size=1048576 2024-09-12T00:31:04.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.838+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~FB6ETAT49MZC.2 size=893260 2024-09-12T00:31:04.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.838+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=FB6ETAT49MZC tag=PLGK02SGNXSE type=write size=4038988 2024-09-12T00:31:04.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.839+0000 7f0362c73780 1 < canceled operation key=R4ABY5AY0S1P tag=VSJF6VG58IJG type=del size=2560028 2024-09-12T00:31:04.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.841+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=SG4ZTJRW0FYM type=write size=422720 2024-09-12T00:31:04.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.842+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=SKQPXBRSMK0N type=del 2024-09-12T00:31:04.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.844+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=MDIEQS054C5X type=write size=236211 2024-09-12T00:31:04.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.845+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=5K67YS6CKSHG type=del 2024-09-12T00:31:04.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.846+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=EOUJLRBPCBSK type=del size=4058489 2024-09-12T00:31:04.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.847+0000 7f0362c73780 1 < canceled part key=_multipart_I3B48QD9E40S.2~6AVJX4CPB3YB.0 size=463351 2024-09-12T00:31:04.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.850+0000 7f0362c73780 1 < canceled multipart upload key=I3B48QD9E40S upload=6AVJX4CPB3YB tag=UU1V1EHBKC0U type=write size=1511927 2024-09-12T00:31:04.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.851+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=ZXZPBYJDV5IH type=write size=47110 2024-09-12T00:31:04.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.853+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~KT40H6L32V7V.0 size=1048576 2024-09-12T00:31:04.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.854+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~KT40H6L32V7V.1 size=537165 2024-09-12T00:31:04.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.857+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=KT40H6L32V7V tag=MXBMT2VYSPMI type=write size=2634317 2024-09-12T00:31:04.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.859+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~JOPFR95H5UKN.0 size=1048576 2024-09-12T00:31:04.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.860+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~JOPFR95H5UKN.1 size=115902 2024-09-12T00:31:04.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.860+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=JOPFR95H5UKN tag=RK9MWLT8ABDJ type=write size=2213054 2024-09-12T00:31:04.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.862+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=OVOZY3B3MCM2 type=del 2024-09-12T00:31:04.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.863+0000 7f0362c73780 1 > prepared operation key=G2HW98G6624O tag=VWLTM2TI2LCM type=del size=3879063 2024-09-12T00:31:04.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.865+0000 7f0362c73780 1 < completed write operation key=R4ABY5AY0S1P tag=BRS7P1Y7JQ45 type=write size=71985 2024-09-12T00:31:04.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.866+0000 7f0362c73780 1 > prepared operation key=R4ABY5AY0S1P tag=J1HPRB8S2Z7W type=del size=3623451 2024-09-12T00:31:04.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.868+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~KQAMHA76BLPV.0 size=1048576 2024-09-12T00:31:04.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.868+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~KQAMHA76BLPV.1 size=813931 2024-09-12T00:31:04.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.870+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=KQAMHA76BLPV tag=BWKGA7OL4WX0 type=write size=2911083 2024-09-12T00:31:04.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.872+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=IKBII34MN8RY type=del size=670411 2024-09-12T00:31:04.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.875+0000 7f0362c73780 1 < suggested update operation key=YTN99RBTKO39 tag=0ESU8MNH57IK type=write size=379636 2024-09-12T00:31:04.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.876+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=PNHBMZFADIE6 type=del size=3281476 2024-09-12T00:31:04.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.878+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=779H0SIML5F3 type=del 2024-09-12T00:31:04.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.881+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~ROI30O0FS2EV.0 size=1024927 2024-09-12T00:31:04.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.881+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=ROI30O0FS2EV tag=SKPT45Q6KT42 type=write size=2073503 2024-09-12T00:31:04.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.882+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~72XCX7O5RHWJ.0 size=1048576 2024-09-12T00:31:04.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.883+0000 7f0362c73780 1 < completed part key=_multipart_XR8L0HL374VC.2~72XCX7O5RHWJ.1 size=300420 2024-09-12T00:31:04.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.886+0000 7f0362c73780 1 < completed multipart upload key=XR8L0HL374VC upload=72XCX7O5RHWJ tag=OFLD5EOCCA43 type=write size=2397572 2024-09-12T00:31:04.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.887+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=IK280RA6QQHB type=del size=2440936 2024-09-12T00:31:04.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.889+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=WIYSS4VKAWFT type=del 2024-09-12T00:31:04.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.890+0000 7f0362c73780 1 > prepared operation key=PLAYMR18X9DZ tag=SBDCX9X22XIA type=del size=2978218 2024-09-12T00:31:04.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.892+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=3I8C3WERRLJ6 type=del 2024-09-12T00:31:04.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.894+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~XMRZVEO04854.0 size=231574 2024-09-12T00:31:04.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.894+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=XMRZVEO04854 tag=08CE77GPTLDQ type=write size=1280150 2024-09-12T00:31:04.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.897+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=9NCGKPHQ81O3 type=del 2024-09-12T00:31:04.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.899+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=MKIBMCV08UW5 type=del size=3412843 2024-09-12T00:31:04.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.900+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~P3FOFRD9YZSL.0 size=857305 2024-09-12T00:31:04.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.903+0000 7f0362c73780 1 < completed multipart upload key=Q6M0D2698CUZ upload=P3FOFRD9YZSL tag=AS7SSC545R74 type=write size=1905881 2024-09-12T00:31:04.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.904+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=MIZCN3DLD1EX type=del size=3488097 2024-09-12T00:31:04.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.906+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~FB6ETAT49MZC.0 size=1048576 2024-09-12T00:31:04.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.907+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~FB6ETAT49MZC.1 size=1048576 2024-09-12T00:31:04.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.907+0000 7f0362c73780 1 < canceled part key=_multipart_KWDEKRO3WICD.2~FB6ETAT49MZC.2 size=893260 2024-09-12T00:31:04.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.909+0000 7f0362c73780 1 < canceled multipart upload key=KWDEKRO3WICD upload=FB6ETAT49MZC tag=PLGK02SGNXSE type=write size=4038988 2024-09-12T00:31:04.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.911+0000 7f0362c73780 1 > prepared operation key=WT0185G517YR tag=JL08MZ8942E8 type=del size=1605659 2024-09-12T00:31:04.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.912+0000 7f0362c73780 1 < completed write operation key=927NCYXX8Z2P tag=SG4ZTJRW0FYM type=write size=422720 2024-09-12T00:31:04.912 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.914+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=05YTC6WOJV3D type=del size=1876958 2024-09-12T00:31:04.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.915+0000 7f0362c73780 1 < completed write operation key=XMMZOX8MH3GT tag=MDIEQS054C5X type=write size=236211 2024-09-12T00:31:04.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.917+0000 7f0362c73780 1 > prepared operation key=XR8L0HL374VC tag=PVYDHUTCV4H0 type=del size=1362868 2024-09-12T00:31:04.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.918+0000 7f0362c73780 1 < completed delete operation key=1SE6WTQMW6JU tag=EOUJLRBPCBSK type=del 2024-09-12T00:31:04.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.919+0000 7f0362c73780 1 > prepared operation key=I3B48QD9E40S tag=UROGPC96J5CZ type=del size=182772 2024-09-12T00:31:04.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.921+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=ZXZPBYJDV5IH type=write size=47110 2024-09-12T00:31:04.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.923+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=ZR3TNG9AWNL8 type=del size=2814719 2024-09-12T00:31:04.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.924+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~JOPFR95H5UKN.0 size=1048576 2024-09-12T00:31:04.924 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.926+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~JOPFR95H5UKN.1 size=115902 2024-09-12T00:31:04.926 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.928+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=JOPFR95H5UKN tag=RK9MWLT8ABDJ type=write size=2213054 2024-09-12T00:31:04.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.930+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~R4F4MMBNT6UG.0 size=562701 2024-09-12T00:31:04.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.930+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=R4F4MMBNT6UG tag=Q53I9KPV90Q9 type=write size=1611277 2024-09-12T00:31:04.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.932+0000 7f0362c73780 1 < completed delete operation key=G2HW98G6624O tag=VWLTM2TI2LCM type=del 2024-09-12T00:31:04.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.933+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=59P36Z4SQWJA type=del size=3937319 2024-09-12T00:31:04.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.935+0000 7f0362c73780 1 < completed delete operation key=R4ABY5AY0S1P tag=J1HPRB8S2Z7W type=del 2024-09-12T00:31:04.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.936+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=XGC7RFQ92WII type=write size=729783 2024-09-12T00:31:04.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.937+0000 7f0362c73780 1 < completed delete operation key=EHBOL435W9ZE tag=IKBII34MN8RY type=del 2024-09-12T00:31:04.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.939+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=98L5XJ2VJQP0 type=del size=148585 2024-09-12T00:31:04.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.942+0000 7f0362c73780 1 < suggested remove operation key=1MLL1T362X51 tag=PNHBMZFADIE6 type=del 2024-09-12T00:31:04.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.943+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=VZ44GX720Z96 type=del size=3827173 2024-09-12T00:31:04.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.945+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~ROI30O0FS2EV.0 size=1024927 2024-09-12T00:31:04.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.948+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=ROI30O0FS2EV tag=SKPT45Q6KT42 type=write size=2073503 2024-09-12T00:31:04.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.950+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~5RGD2OPVH2IB.0 size=448444 2024-09-12T00:31:04.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.950+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=5RGD2OPVH2IB tag=RJDA6RA1JXT2 type=write size=1497020 2024-09-12T00:31:04.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.952+0000 7f0362c73780 1 < completed delete operation key=Q6M0D2698CUZ tag=IK280RA6QQHB type=del 2024-09-12T00:31:04.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.953+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=H064CFPJV1ZL type=del size=1383251 2024-09-12T00:31:04.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.954+0000 7f0362c73780 1 < completed delete operation key=PLAYMR18X9DZ tag=SBDCX9X22XIA type=del 2024-09-12T00:31:04.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.957+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~LE7YXM0LKC4Q.0 size=1048576 2024-09-12T00:31:04.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.958+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~LE7YXM0LKC4Q.1 size=1048576 2024-09-12T00:31:04.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.959+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~LE7YXM0LKC4Q.2 size=917529 2024-09-12T00:31:04.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.959+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=LE7YXM0LKC4Q tag=DH3M9YJMOSQP type=write size=4063257 2024-09-12T00:31:04.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.959+0000 7f0362c73780 1 < canceled part key=_multipart_J5GSZCJW2BP1.2~XMRZVEO04854.0 size=231574 2024-09-12T00:31:04.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.962+0000 7f0362c73780 1 < canceled multipart upload key=J5GSZCJW2BP1 upload=XMRZVEO04854 tag=08CE77GPTLDQ type=write size=1280150 2024-09-12T00:31:04.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.964+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~KDQRX2KJIIX8.0 size=1048576 2024-09-12T00:31:04.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.965+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~KDQRX2KJIIX8.1 size=767663 2024-09-12T00:31:04.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.965+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=KDQRX2KJIIX8 tag=VR7AE9G7GMN8 type=write size=2864815 2024-09-12T00:31:04.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.968+0000 7f0362c73780 1 < suggested update operation key=WT0185G517YR tag=MKIBMCV08UW5 type=del size=3412843 2024-09-12T00:31:04.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.970+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=17Z9V4KJGVU4 type=del size=4036278 2024-09-12T00:31:04.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.973+0000 7f0362c73780 1 < suggested update operation key=WT0185G517YR tag=MIZCN3DLD1EX type=del size=3488097 2024-09-12T00:31:04.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.975+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~H8W24DN7IZLC.0 size=306044 2024-09-12T00:31:04.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.975+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=H8W24DN7IZLC tag=QHTVPGCF7WSV type=write size=1354620 2024-09-12T00:31:04.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.977+0000 7f0362c73780 -1 < failed to complete operation key=WT0185G517YR tag=JL08MZ8942E8 type=del size=1605659: (22) Invalid argument 2024-09-12T00:31:04.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.978+0000 7f0362c73780 1 > prepared operation key=G4G6E7KTTZY9 tag=3GTNFIZ4E317 type=del size=2344006 2024-09-12T00:31:04.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.980+0000 7f0362c73780 1 < completed delete operation key=84T1VJG5SHU4 tag=05YTC6WOJV3D type=del 2024-09-12T00:31:04.981 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.982+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~U3JRK9O22PIW.0 size=1048576 2024-09-12T00:31:04.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.983+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~U3JRK9O22PIW.1 size=408124 2024-09-12T00:31:04.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.983+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=U3JRK9O22PIW tag=LG6Q1RI3EV20 type=write size=2505276 2024-09-12T00:31:04.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.986+0000 7f0362c73780 1 < suggested remove operation key=XR8L0HL374VC tag=PVYDHUTCV4H0 type=del 2024-09-12T00:31:04.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.988+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=DLKIQQTGUL0W type=del size=2124617 2024-09-12T00:31:04.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.989+0000 7f0362c73780 1 < completed delete operation key=I3B48QD9E40S tag=UROGPC96J5CZ type=del 2024-09-12T00:31:04.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.990+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=U9WYN30ZPYKG type=del size=3495454 2024-09-12T00:31:04.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.993+0000 7f0362c73780 1 < suggested remove operation key=PYCRNXC9ITGF tag=ZR3TNG9AWNL8 type=del 2024-09-12T00:31:04.994 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.996+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~10VGYKDTTNH5.0 size=1048576 2024-09-12T00:31:04.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.997+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~10VGYKDTTNH5.1 size=1048576 2024-09-12T00:31:04.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.998+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~10VGYKDTTNH5.2 size=533308 2024-09-12T00:31:04.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:04.998+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=10VGYKDTTNH5 tag=F515IVIKRA28 type=write size=3679036 2024-09-12T00:31:04.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.000+0000 7f0362c73780 1 < completed part key=_multipart_6AYDT9X4LC6T.2~R4F4MMBNT6UG.0 size=562701 2024-09-12T00:31:05.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.002+0000 7f0362c73780 1 < completed multipart upload key=6AYDT9X4LC6T upload=R4F4MMBNT6UG tag=Q53I9KPV90Q9 type=write size=1611277 2024-09-12T00:31:05.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.004+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=ZTYO9EZYFW80 type=del size=2847127 2024-09-12T00:31:05.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.005+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=59P36Z4SQWJA type=del 2024-09-12T00:31:05.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.008+0000 7f0362c73780 1 > prepared part key=_multipart_44YJP6XPIFT5.2~214OC1TIEY7B.0 size=146635 2024-09-12T00:31:05.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.008+0000 7f0362c73780 1 > prepared multipart upload key=44YJP6XPIFT5 upload=214OC1TIEY7B tag=WPQAIGEFAN2M type=write size=1195211 2024-09-12T00:31:05.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.009+0000 7f0362c73780 1 < completed write operation key=2DHHPBYV80O8 tag=XGC7RFQ92WII type=write size=729783 2024-09-12T00:31:05.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.012+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~4PGZDSM45QCJ.0 size=1048576 2024-09-12T00:31:05.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.013+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~4PGZDSM45QCJ.1 size=1048576 2024-09-12T00:31:05.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.014+0000 7f0362c73780 1 > prepared part key=_multipart_VD0LFCNLI1YI.2~4PGZDSM45QCJ.2 size=636771 2024-09-12T00:31:05.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.014+0000 7f0362c73780 1 > prepared multipart upload key=VD0LFCNLI1YI upload=4PGZDSM45QCJ tag=JW7HPCEG3YAW type=write size=3782499 2024-09-12T00:31:05.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.016+0000 7f0362c73780 1 < suggested remove operation key=EHBOL435W9ZE tag=98L5XJ2VJQP0 type=del 2024-09-12T00:31:05.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.018+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=WJJ80SQ3Q3U3 type=del size=669925 2024-09-12T00:31:05.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.021+0000 7f0362c73780 1 < suggested remove operation key=84T1VJG5SHU4 tag=VZ44GX720Z96 type=del 2024-09-12T00:31:05.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.023+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~209KKB2SW9JY.0 size=1048576 2024-09-12T00:31:05.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.024+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~209KKB2SW9JY.1 size=1048576 2024-09-12T00:31:05.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.025+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~209KKB2SW9JY.2 size=506161 2024-09-12T00:31:05.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.025+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=209KKB2SW9JY tag=IXJO2QMJQW1B type=write size=3651889 2024-09-12T00:31:05.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.027+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~5RGD2OPVH2IB.0 size=448444 2024-09-12T00:31:05.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.030+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=5RGD2OPVH2IB tag=RJDA6RA1JXT2 type=write size=1497020 2024-09-12T00:31:05.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.034+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~3QR2GNM0HM2S.0 size=1048576 2024-09-12T00:31:05.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.035+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~3QR2GNM0HM2S.1 size=1048576 2024-09-12T00:31:05.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.036+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~3QR2GNM0HM2S.2 size=531071 2024-09-12T00:31:05.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.036+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=3QR2GNM0HM2S tag=XZXWME46SHVW type=write size=3676799 2024-09-12T00:31:05.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.038+0000 7f0362c73780 1 < completed delete operation key=927NCYXX8Z2P tag=H064CFPJV1ZL type=del 2024-09-12T00:31:05.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.039+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=G09STLX24NOR type=del size=2705239 2024-09-12T00:31:05.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.041+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~LE7YXM0LKC4Q.0 size=1048576 2024-09-12T00:31:05.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.042+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~LE7YXM0LKC4Q.1 size=1048576 2024-09-12T00:31:05.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.044+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~LE7YXM0LKC4Q.2 size=917529 2024-09-12T00:31:05.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.046+0000 7f0362c73780 1 < completed multipart upload key=927NCYXX8Z2P upload=LE7YXM0LKC4Q tag=DH3M9YJMOSQP type=write size=4063257 2024-09-12T00:31:05.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.048+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=IBQ8MHG0WI27 type=del size=812685 2024-09-12T00:31:05.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.050+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~KDQRX2KJIIX8.0 size=1048576 2024-09-12T00:31:05.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.051+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~KDQRX2KJIIX8.1 size=767663 2024-09-12T00:31:05.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.053+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=KDQRX2KJIIX8 tag=VR7AE9G7GMN8 type=write size=2864815 2024-09-12T00:31:05.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.056+0000 7f0362c73780 1 > prepared part key=_multipart_X4ZML0796M7F.2~1IA75ED5IX4B.0 size=949763 2024-09-12T00:31:05.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.056+0000 7f0362c73780 1 > prepared multipart upload key=X4ZML0796M7F upload=1IA75ED5IX4B tag=7FJPH46W1ZY3 type=write size=1998339 2024-09-12T00:31:05.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.057+0000 7f0362c73780 1 < completed delete operation key=IIZAWZDLR2QE tag=17Z9V4KJGVU4 type=del 2024-09-12T00:31:05.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.059+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~36CBT5JZ4ZOH.0 size=1048576 2024-09-12T00:31:05.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.061+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~36CBT5JZ4ZOH.1 size=1048576 2024-09-12T00:31:05.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.062+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~36CBT5JZ4ZOH.2 size=228624 2024-09-12T00:31:05.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.062+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=36CBT5JZ4ZOH tag=5G05UIFFVLMS type=write size=3374352 2024-09-12T00:31:05.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.063+0000 7f0362c73780 1 < completed part key=_multipart_KWDEKRO3WICD.2~H8W24DN7IZLC.0 size=306044 2024-09-12T00:31:05.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.065+0000 7f0362c73780 1 < completed multipart upload key=KWDEKRO3WICD upload=H8W24DN7IZLC tag=QHTVPGCF7WSV type=write size=1354620 2024-09-12T00:31:05.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.067+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=QYR4C1RMBC9M type=del size=642040 2024-09-12T00:31:05.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.068+0000 7f0362c73780 1 < completed delete operation key=G4G6E7KTTZY9 tag=3GTNFIZ4E317 type=del 2024-09-12T00:31:05.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.070+0000 7f0362c73780 1 > prepared operation key=84T1VJG5SHU4 tag=5VHCZ110DFK6 type=write size=107671 2024-09-12T00:31:05.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.071+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~U3JRK9O22PIW.0 size=1048576 2024-09-12T00:31:05.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.072+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~U3JRK9O22PIW.1 size=408124 2024-09-12T00:31:05.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.075+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=U3JRK9O22PIW tag=LG6Q1RI3EV20 type=write size=2505276 2024-09-12T00:31:05.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.077+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~5ZYU2SKBYMGM.0 size=1048576 2024-09-12T00:31:05.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.078+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~5ZYU2SKBYMGM.1 size=1048576 2024-09-12T00:31:05.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.080+0000 7f0362c73780 1 > prepared part key=_multipart_IIZAWZDLR2QE.2~5ZYU2SKBYMGM.2 size=380929 2024-09-12T00:31:05.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.080+0000 7f0362c73780 1 > prepared multipart upload key=IIZAWZDLR2QE upload=5ZYU2SKBYMGM tag=7TV7LL2FAXD7 type=write size=3526657 2024-09-12T00:31:05.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.081+0000 7f0362c73780 1 < canceled operation key=IIZAWZDLR2QE tag=DLKIQQTGUL0W type=del size=2124617 2024-09-12T00:31:05.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.083+0000 7f0362c73780 1 > prepared operation key=1UUNRPUKAINC tag=Z9L3TI8A8EE3 type=del size=614647 2024-09-12T00:31:05.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.086+0000 7f0362c73780 1 < suggested update operation key=HWSQFSK29S0V tag=U9WYN30ZPYKG type=del size=3495454 2024-09-12T00:31:05.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.089+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~ELEAWG7QAHZO.0 size=1048576 2024-09-12T00:31:05.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.090+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~ELEAWG7QAHZO.1 size=1048576 2024-09-12T00:31:05.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.091+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~ELEAWG7QAHZO.2 size=828491 2024-09-12T00:31:05.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.091+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=ELEAWG7QAHZO tag=HW9FWNEQSISO type=write size=3974219 2024-09-12T00:31:05.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.092+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~10VGYKDTTNH5.0 size=1048576 2024-09-12T00:31:05.092 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.093+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~10VGYKDTTNH5.1 size=1048576 2024-09-12T00:31:05.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.095+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~10VGYKDTTNH5.2 size=533308 2024-09-12T00:31:05.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.097+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=10VGYKDTTNH5 tag=F515IVIKRA28 type=write size=3679036 2024-09-12T00:31:05.098 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.099+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~RGWH7FADPVDH.0 size=1048576 2024-09-12T00:31:05.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.101+0000 7f0362c73780 1 > prepared part key=_multipart_XMMZOX8MH3GT.2~RGWH7FADPVDH.1 size=398071 2024-09-12T00:31:05.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.101+0000 7f0362c73780 1 > prepared multipart upload key=XMMZOX8MH3GT upload=RGWH7FADPVDH tag=63GB9TT1ZU53 type=write size=2495223 2024-09-12T00:31:05.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.102+0000 7f0362c73780 1 < canceled operation key=OY30LP7FYXNF tag=ZTYO9EZYFW80 type=del size=2847127 2024-09-12T00:31:05.102 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.103+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=OW741OE7S135 type=del size=834208 2024-09-12T00:31:05.103 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.105+0000 7f0362c73780 1 < completed part key=_multipart_44YJP6XPIFT5.2~214OC1TIEY7B.0 size=146635 2024-09-12T00:31:05.105 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.107+0000 7f0362c73780 1 < completed multipart upload key=44YJP6XPIFT5 upload=214OC1TIEY7B tag=WPQAIGEFAN2M type=write size=1195211 2024-09-12T00:31:05.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.109+0000 7f0362c73780 1 > prepared operation key=1MLL1T362X51 tag=W12K2XQ4SYMW type=del size=4186961 2024-09-12T00:31:05.109 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.110+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~4PGZDSM45QCJ.0 size=1048576 2024-09-12T00:31:05.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.111+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~4PGZDSM45QCJ.1 size=1048576 2024-09-12T00:31:05.111 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.113+0000 7f0362c73780 1 < completed part key=_multipart_VD0LFCNLI1YI.2~4PGZDSM45QCJ.2 size=636771 2024-09-12T00:31:05.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.115+0000 7f0362c73780 1 < completed multipart upload key=VD0LFCNLI1YI upload=4PGZDSM45QCJ tag=JW7HPCEG3YAW type=write size=3782499 2024-09-12T00:31:05.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.117+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=64AZF0HSQFXV type=del size=153804 2024-09-12T00:31:05.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.119+0000 7f0362c73780 1 < suggested update operation key=HEN9LUUIDAR5 tag=WJJ80SQ3Q3U3 type=del size=669925 2024-09-12T00:31:05.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.122+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~2VZWUSGC0488.0 size=1048576 2024-09-12T00:31:05.122 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.123+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~2VZWUSGC0488.1 size=1048576 2024-09-12T00:31:05.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.124+0000 7f0362c73780 1 > prepared part key=_multipart_1IPW8SJ6SSU2.2~2VZWUSGC0488.2 size=682342 2024-09-12T00:31:05.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.124+0000 7f0362c73780 1 > prepared multipart upload key=1IPW8SJ6SSU2 upload=2VZWUSGC0488 tag=IDKVH30NXRMU type=write size=3828070 2024-09-12T00:31:05.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.126+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~209KKB2SW9JY.0 size=1048576 2024-09-12T00:31:05.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.127+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~209KKB2SW9JY.1 size=1048576 2024-09-12T00:31:05.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.129+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~209KKB2SW9JY.2 size=506161 2024-09-12T00:31:05.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.131+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=209KKB2SW9JY tag=IXJO2QMJQW1B type=write size=3651889 2024-09-12T00:31:05.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.133+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~Z3VJCFTSES4Z.0 size=1048576 2024-09-12T00:31:05.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.135+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~Z3VJCFTSES4Z.1 size=1048576 2024-09-12T00:31:05.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.136+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~Z3VJCFTSES4Z.2 size=656272 2024-09-12T00:31:05.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.136+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=Z3VJCFTSES4Z tag=UGD4FDITHJRW type=write size=3802000 2024-09-12T00:31:05.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.137+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~3QR2GNM0HM2S.0 size=1048576 2024-09-12T00:31:05.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.138+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~3QR2GNM0HM2S.1 size=1048576 2024-09-12T00:31:05.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.139+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~3QR2GNM0HM2S.2 size=531071 2024-09-12T00:31:05.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.142+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=3QR2GNM0HM2S tag=XZXWME46SHVW type=write size=3676799 2024-09-12T00:31:05.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.143+0000 7f0362c73780 1 > prepared operation key=927NCYXX8Z2P tag=SSV3MSUB4K81 type=write size=835558 2024-09-12T00:31:05.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.145+0000 7f0362c73780 1 < completed delete operation key=2DHHPBYV80O8 tag=G09STLX24NOR type=del 2024-09-12T00:31:05.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.146+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=B35DP44W2I9O type=del size=3756683 2024-09-12T00:31:05.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.147+0000 7f0362c73780 1 < canceled operation key=EHBOL435W9ZE tag=IBQ8MHG0WI27 type=del size=812685 2024-09-12T00:31:05.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.149+0000 7f0362c73780 1 > prepared operation key=HEN9LUUIDAR5 tag=3TSBQY1VNQ5L type=del size=2689674 2024-09-12T00:31:05.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.150+0000 7f0362c73780 1 < completed part key=_multipart_X4ZML0796M7F.2~1IA75ED5IX4B.0 size=949763 2024-09-12T00:31:05.150 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.152+0000 7f0362c73780 1 < completed multipart upload key=X4ZML0796M7F upload=1IA75ED5IX4B tag=7FJPH46W1ZY3 type=write size=1998339 2024-09-12T00:31:05.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.154+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=JW1YUZB780AY type=del size=1034999 2024-09-12T00:31:05.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.155+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~36CBT5JZ4ZOH.0 size=1048576 2024-09-12T00:31:05.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.157+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~36CBT5JZ4ZOH.1 size=1048576 2024-09-12T00:31:05.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.158+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~36CBT5JZ4ZOH.2 size=228624 2024-09-12T00:31:05.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.160+0000 7f0362c73780 1 < completed multipart upload key=927NCYXX8Z2P upload=36CBT5JZ4ZOH tag=5G05UIFFVLMS type=write size=3374352 2024-09-12T00:31:05.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.161+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=1MLMAAU3YO95 type=write size=562913 2024-09-12T00:31:05.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.165+0000 7f0362c73780 1 < suggested remove operation key=KWDEKRO3WICD tag=QYR4C1RMBC9M type=del 2024-09-12T00:31:05.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.167+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=HPO1LT52AVDC type=del size=4103266 2024-09-12T00:31:05.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.168+0000 7f0362c73780 1 < canceled operation key=84T1VJG5SHU4 tag=5VHCZ110DFK6 type=write size=107671 2024-09-12T00:31:05.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.170+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=01C8KWV6BZJB type=del size=2758837 2024-09-12T00:31:05.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.171+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~5ZYU2SKBYMGM.0 size=1048576 2024-09-12T00:31:05.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.172+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~5ZYU2SKBYMGM.1 size=1048576 2024-09-12T00:31:05.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.174+0000 7f0362c73780 1 < completed part key=_multipart_IIZAWZDLR2QE.2~5ZYU2SKBYMGM.2 size=380929 2024-09-12T00:31:05.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.176+0000 7f0362c73780 1 < completed multipart upload key=IIZAWZDLR2QE upload=5ZYU2SKBYMGM tag=7TV7LL2FAXD7 type=write size=3526657 2024-09-12T00:31:05.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.177+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=DUAEL9JLR01J type=write size=630057 2024-09-12T00:31:05.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.178+0000 7f0362c73780 1 < completed delete operation key=1UUNRPUKAINC tag=Z9L3TI8A8EE3 type=del 2024-09-12T00:31:05.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.180+0000 7f0362c73780 1 > prepared operation key=44YJP6XPIFT5 tag=AUV29UKK8002 type=del size=3398721 2024-09-12T00:31:05.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.181+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~ELEAWG7QAHZO.0 size=1048576 2024-09-12T00:31:05.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.182+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~ELEAWG7QAHZO.1 size=1048576 2024-09-12T00:31:05.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.183+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~ELEAWG7QAHZO.2 size=828491 2024-09-12T00:31:05.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.186+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=ELEAWG7QAHZO tag=HW9FWNEQSISO type=write size=3974219 2024-09-12T00:31:05.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.187+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=IKRV6YKDU6L3 type=del size=920157 2024-09-12T00:31:05.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.189+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~RGWH7FADPVDH.0 size=1048576 2024-09-12T00:31:05.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.190+0000 7f0362c73780 1 < completed part key=_multipart_XMMZOX8MH3GT.2~RGWH7FADPVDH.1 size=398071 2024-09-12T00:31:05.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.192+0000 7f0362c73780 1 < completed multipart upload key=XMMZOX8MH3GT upload=RGWH7FADPVDH tag=63GB9TT1ZU53 type=write size=2495223 2024-09-12T00:31:05.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.194+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~IKNEUL0MSGUB.0 size=1048576 2024-09-12T00:31:05.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.196+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~IKNEUL0MSGUB.1 size=1048576 2024-09-12T00:31:05.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.197+0000 7f0362c73780 1 > prepared part key=_multipart_3XZZX53L26G5.2~IKNEUL0MSGUB.2 size=1019558 2024-09-12T00:31:05.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.197+0000 7f0362c73780 1 > prepared multipart upload key=3XZZX53L26G5 upload=IKNEUL0MSGUB tag=KEM8F0NDTIF2 type=write size=4165286 2024-09-12T00:31:05.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.200+0000 7f0362c73780 1 < suggested update operation key=Q6M0D2698CUZ tag=OW741OE7S135 type=del size=834208 2024-09-12T00:31:05.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.201+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=9DP9LCBIVSL9 type=del size=409510 2024-09-12T00:31:05.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.203+0000 7f0362c73780 1 < completed delete operation key=1MLL1T362X51 tag=W12K2XQ4SYMW type=del 2024-09-12T00:31:05.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.204+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=M9ZZUA8GQ73U type=del size=2885710 2024-09-12T00:31:05.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.206+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=64AZF0HSQFXV type=del 2024-09-12T00:31:05.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.208+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~CQ2Q127DLTTT.0 size=1048576 2024-09-12T00:31:05.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.209+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~CQ2Q127DLTTT.1 size=1048576 2024-09-12T00:31:05.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.211+0000 7f0362c73780 1 > prepared part key=_multipart_XWW3882YBHAJ.2~CQ2Q127DLTTT.2 size=422618 2024-09-12T00:31:05.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.211+0000 7f0362c73780 1 > prepared multipart upload key=XWW3882YBHAJ upload=CQ2Q127DLTTT tag=3OQGM7BOYYEK type=write size=3568346 2024-09-12T00:31:05.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.212+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~2VZWUSGC0488.0 size=1048576 2024-09-12T00:31:05.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.213+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~2VZWUSGC0488.1 size=1048576 2024-09-12T00:31:05.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.214+0000 7f0362c73780 1 < completed part key=_multipart_1IPW8SJ6SSU2.2~2VZWUSGC0488.2 size=682342 2024-09-12T00:31:05.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.217+0000 7f0362c73780 1 < completed multipart upload key=1IPW8SJ6SSU2 upload=2VZWUSGC0488 tag=IDKVH30NXRMU type=write size=3828070 2024-09-12T00:31:05.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.219+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~2GF3Y8VO4FXE.0 size=1048576 2024-09-12T00:31:05.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.220+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~2GF3Y8VO4FXE.1 size=1048576 2024-09-12T00:31:05.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.222+0000 7f0362c73780 1 > prepared part key=_multipart_1UUNRPUKAINC.2~2GF3Y8VO4FXE.2 size=171647 2024-09-12T00:31:05.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.222+0000 7f0362c73780 1 > prepared multipart upload key=1UUNRPUKAINC upload=2GF3Y8VO4FXE tag=H2HQCE62U3MS type=write size=3317375 2024-09-12T00:31:05.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.222+0000 7f0362c73780 1 < canceled part key=_multipart_OY30LP7FYXNF.2~Z3VJCFTSES4Z.0 size=1048576 2024-09-12T00:31:05.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.223+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~Z3VJCFTSES4Z.1 size=1048576 2024-09-12T00:31:05.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.224+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~Z3VJCFTSES4Z.2 size=656272 2024-09-12T00:31:05.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.227+0000 7f0362c73780 1 < canceled multipart upload key=OY30LP7FYXNF upload=Z3VJCFTSES4Z tag=UGD4FDITHJRW type=write size=3802000 2024-09-12T00:31:05.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.228+0000 7f0362c73780 1 > prepared operation key=XWW3882YBHAJ tag=IRQ8L99ORVXP type=write size=165418 2024-09-12T00:31:05.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.230+0000 7f0362c73780 1 < completed write operation key=927NCYXX8Z2P tag=SSV3MSUB4K81 type=write size=835558 2024-09-12T00:31:05.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.232+0000 7f0362c73780 1 > prepared part key=_multipart_R4ABY5AY0S1P.2~MHR4JHJMTACN.0 size=151671 2024-09-12T00:31:05.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.232+0000 7f0362c73780 1 > prepared multipart upload key=R4ABY5AY0S1P upload=MHR4JHJMTACN tag=2R3BKD2K14OP type=write size=1200247 2024-09-12T00:31:05.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.235+0000 7f0362c73780 1 < suggested update operation key=IIZAWZDLR2QE tag=B35DP44W2I9O type=del size=3756683 2024-09-12T00:31:05.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.236+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=O9IMJCTOQ0XZ type=del size=3726412 2024-09-12T00:31:05.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.238+0000 7f0362c73780 1 < completed delete operation key=HEN9LUUIDAR5 tag=3TSBQY1VNQ5L type=del 2024-09-12T00:31:05.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.239+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=B88SFA961QJM type=del size=1674654 2024-09-12T00:31:05.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.240+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=JW1YUZB780AY type=del 2024-09-12T00:31:05.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.242+0000 7f0362c73780 1 > prepared operation key=J5GSZCJW2BP1 tag=EUWC3F92JCP4 type=write size=957111 2024-09-12T00:31:05.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.243+0000 7f0362c73780 1 < completed write operation key=HWSQFSK29S0V tag=1MLMAAU3YO95 type=write size=562913 2024-09-12T00:31:05.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.246+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~HR0JPDBVWMYX.0 size=1048576 2024-09-12T00:31:05.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.247+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~HR0JPDBVWMYX.1 size=235878 2024-09-12T00:31:05.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.247+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=HR0JPDBVWMYX tag=DU9C8TFN8RYO type=write size=2333030 2024-09-12T00:31:05.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.248+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=HPO1LT52AVDC type=del 2024-09-12T00:31:05.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.250+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~40V35LZ2G5G1.0 size=1048576 2024-09-12T00:31:05.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.252+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~40V35LZ2G5G1.1 size=173858 2024-09-12T00:31:05.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.252+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=40V35LZ2G5G1 tag=J15UXADVJHSZ type=write size=2271010 2024-09-12T00:31:05.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.253+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=01C8KWV6BZJB type=del 2024-09-12T00:31:05.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.254+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=ZHD62USP16AH type=del size=2630914 2024-09-12T00:31:05.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.256+0000 7f0362c73780 -1 < failed to complete operation key=Q6M0D2698CUZ tag=DUAEL9JLR01J type=write size=630057: (22) Invalid argument 2024-09-12T00:31:05.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.257+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=NGZ1TDKS7633 type=del size=2091979 2024-09-12T00:31:05.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.259+0000 7f0362c73780 1 < completed delete operation key=44YJP6XPIFT5 tag=AUV29UKK8002 type=del 2024-09-12T00:31:05.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.260+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=U0O1PN88KSJ4 type=del size=2936048 2024-09-12T00:31:05.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.262+0000 7f0362c73780 1 < canceled operation key=X4ZML0796M7F tag=IKRV6YKDU6L3 type=del size=920157 2024-09-12T00:31:05.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.263+0000 7f0362c73780 1 > prepared operation key=X4ZML0796M7F tag=UPILIEBB2ZAZ type=del size=3304024 2024-09-12T00:31:05.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.264+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~IKNEUL0MSGUB.0 size=1048576 2024-09-12T00:31:05.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.266+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~IKNEUL0MSGUB.1 size=1048576 2024-09-12T00:31:05.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.267+0000 7f0362c73780 1 < completed part key=_multipart_3XZZX53L26G5.2~IKNEUL0MSGUB.2 size=1019558 2024-09-12T00:31:05.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.269+0000 7f0362c73780 1 < completed multipart upload key=3XZZX53L26G5 upload=IKNEUL0MSGUB tag=KEM8F0NDTIF2 type=write size=4165286 2024-09-12T00:31:05.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.272+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~H9IUAAV6464O.0 size=1048576 2024-09-12T00:31:05.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.273+0000 7f0362c73780 1 > prepared part key=_multipart_J5GSZCJW2BP1.2~H9IUAAV6464O.1 size=496084 2024-09-12T00:31:05.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.273+0000 7f0362c73780 1 > prepared multipart upload key=J5GSZCJW2BP1 upload=H9IUAAV6464O tag=7GSMQMPJEQ3M type=write size=2593236 2024-09-12T00:31:05.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.274+0000 7f0362c73780 1 < canceled operation key=2DHHPBYV80O8 tag=9DP9LCBIVSL9 type=del size=409510 2024-09-12T00:31:05.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.276+0000 7f0362c73780 1 > prepared operation key=OY30LP7FYXNF tag=R8H3CUWBKVGJ type=del size=1211641 2024-09-12T00:31:05.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.278+0000 7f0362c73780 1 < completed delete operation key=X4ZML0796M7F tag=M9ZZUA8GQ73U type=del 2024-09-12T00:31:05.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.279+0000 7f0362c73780 1 > prepared operation key=EHBOL435W9ZE tag=E3CNMNW33II2 type=del size=1651366 2024-09-12T00:31:05.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.281+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~CQ2Q127DLTTT.0 size=1048576 2024-09-12T00:31:05.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.282+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~CQ2Q127DLTTT.1 size=1048576 2024-09-12T00:31:05.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.283+0000 7f0362c73780 1 < completed part key=_multipart_XWW3882YBHAJ.2~CQ2Q127DLTTT.2 size=422618 2024-09-12T00:31:05.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.285+0000 7f0362c73780 1 < completed multipart upload key=XWW3882YBHAJ upload=CQ2Q127DLTTT tag=3OQGM7BOYYEK type=write size=3568346 2024-09-12T00:31:05.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.287+0000 7f0362c73780 1 > prepared operation key=YTN99RBTKO39 tag=HLLYOI1MSGKU type=del size=3056829 2024-09-12T00:31:05.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.287+0000 7f0362c73780 1 < canceled part key=_multipart_1UUNRPUKAINC.2~2GF3Y8VO4FXE.0 size=1048576 2024-09-12T00:31:05.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.288+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~2GF3Y8VO4FXE.1 size=1048576 2024-09-12T00:31:05.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.289+0000 7f0362c73780 1 < completed part key=_multipart_1UUNRPUKAINC.2~2GF3Y8VO4FXE.2 size=171647 2024-09-12T00:31:05.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.292+0000 7f0362c73780 1 < canceled multipart upload key=1UUNRPUKAINC upload=2GF3Y8VO4FXE tag=H2HQCE62U3MS type=write size=3317375 2024-09-12T00:31:05.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.293+0000 7f0362c73780 1 > prepared operation key=PYCRNXC9ITGF tag=PU98P15SY6X5 type=del size=3037002 2024-09-12T00:31:05.293 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.294+0000 7f0362c73780 1 < completed write operation key=XWW3882YBHAJ tag=IRQ8L99ORVXP type=write size=165418 2024-09-12T00:31:05.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.299+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~F6BAMBFCY6HR.0 size=1048576 2024-09-12T00:31:05.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.300+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~F6BAMBFCY6HR.1 size=1048576 2024-09-12T00:31:05.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.302+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~F6BAMBFCY6HR.2 size=12525 2024-09-12T00:31:05.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.302+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=F6BAMBFCY6HR tag=9XJY8IEESP6O type=write size=3158253 2024-09-12T00:31:05.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.303+0000 7f0362c73780 1 < completed part key=_multipart_R4ABY5AY0S1P.2~MHR4JHJMTACN.0 size=151671 2024-09-12T00:31:05.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.306+0000 7f0362c73780 1 < completed multipart upload key=R4ABY5AY0S1P upload=MHR4JHJMTACN tag=2R3BKD2K14OP type=write size=1200247 2024-09-12T00:31:05.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.307+0000 7f0362c73780 1 > prepared operation key=KWDEKRO3WICD tag=1IR0EHM6NNVO type=del size=2427442 2024-09-12T00:31:05.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.308+0000 7f0362c73780 1 < canceled operation key=Q6M0D2698CUZ tag=O9IMJCTOQ0XZ type=del size=3726412 2024-09-12T00:31:05.308 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.310+0000 7f0362c73780 1 > prepared operation key=3XZZX53L26G5 tag=L4LZZIBMQAHU type=write size=521784 2024-09-12T00:31:05.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.311+0000 7f0362c73780 1 < completed delete operation key=6AYDT9X4LC6T tag=B88SFA961QJM type=del 2024-09-12T00:31:05.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.312+0000 7f0362c73780 1 > prepared operation key=HWSQFSK29S0V tag=JUC40STHQYMV type=del size=1812651 2024-09-12T00:31:05.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.315+0000 7f0362c73780 1 < suggested remove operation key=J5GSZCJW2BP1 tag=EUWC3F92JCP4 type=write 2024-09-12T00:31:05.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.317+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=LQR16KHRUJER type=del size=1772879 2024-09-12T00:31:05.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.318+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~HR0JPDBVWMYX.0 size=1048576 2024-09-12T00:31:05.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.319+0000 7f0362c73780 1 < completed part key=_multipart_1MLL1T362X51.2~HR0JPDBVWMYX.1 size=235878 2024-09-12T00:31:05.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.321+0000 7f0362c73780 1 < completed multipart upload key=1MLL1T362X51 upload=HR0JPDBVWMYX tag=DU9C8TFN8RYO type=write size=2333030 2024-09-12T00:31:05.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.324+0000 7f0362c73780 1 > prepared part key=_multipart_G4G6E7KTTZY9.2~1FF20RUA4A3P.0 size=647737 2024-09-12T00:31:05.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.324+0000 7f0362c73780 1 > prepared multipart upload key=G4G6E7KTTZY9 upload=1FF20RUA4A3P tag=UZPX8JU03ASI type=write size=1696313 2024-09-12T00:31:05.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.324+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~40V35LZ2G5G1.0 size=1048576 2024-09-12T00:31:05.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.326+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~40V35LZ2G5G1.1 size=173858 2024-09-12T00:31:05.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.328+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=40V35LZ2G5G1 tag=J15UXADVJHSZ type=write size=2271010 2024-09-12T00:31:05.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.329+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=07H8RUOBG4DF type=del size=2833565 2024-09-12T00:31:05.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.332+0000 7f0362c73780 1 < suggested remove operation key=XMMZOX8MH3GT tag=ZHD62USP16AH type=del 2024-09-12T00:31:05.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.335+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~AE9UTF0XZ5BJ.0 size=1048576 2024-09-12T00:31:05.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.336+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~AE9UTF0XZ5BJ.1 size=1048576 2024-09-12T00:31:05.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.337+0000 7f0362c73780 1 > prepared part key=_multipart_OY30LP7FYXNF.2~AE9UTF0XZ5BJ.2 size=321441 2024-09-12T00:31:05.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.337+0000 7f0362c73780 1 > prepared multipart upload key=OY30LP7FYXNF upload=AE9UTF0XZ5BJ tag=FRFMQOJ4XXZV type=write size=3467169 2024-09-12T00:31:05.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.340+0000 7f0362c73780 1 < suggested update operation key=EHBOL435W9ZE tag=NGZ1TDKS7633 type=del size=2091979 2024-09-12T00:31:05.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.343+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~26G1CG9BGHSJ.0 size=1048576 2024-09-12T00:31:05.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.344+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~26G1CG9BGHSJ.1 size=1048576 2024-09-12T00:31:05.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.345+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~26G1CG9BGHSJ.2 size=824164 2024-09-12T00:31:05.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.345+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=26G1CG9BGHSJ tag=1TTSQN3P6TLX type=write size=3969892 2024-09-12T00:31:05.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.347+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=U0O1PN88KSJ4 type=del 2024-09-12T00:31:05.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.349+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~GTNVGHE2J4IC.0 size=1048576 2024-09-12T00:31:05.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.350+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~GTNVGHE2J4IC.1 size=1048576 2024-09-12T00:31:05.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.351+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~GTNVGHE2J4IC.2 size=1003830 2024-09-12T00:31:05.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.351+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=GTNVGHE2J4IC tag=EMFWKZ3ELVTM type=write size=4149558 2024-09-12T00:31:05.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.354+0000 7f0362c73780 1 < suggested remove operation key=X4ZML0796M7F tag=UPILIEBB2ZAZ type=del 2024-09-12T00:31:05.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.357+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~2UEYRWFJTQIC.0 size=1048576 2024-09-12T00:31:05.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.358+0000 7f0362c73780 1 > prepared part key=_multipart_HEN9LUUIDAR5.2~2UEYRWFJTQIC.1 size=854957 2024-09-12T00:31:05.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.358+0000 7f0362c73780 1 > prepared multipart upload key=HEN9LUUIDAR5 upload=2UEYRWFJTQIC tag=7GLCVHR3A2E9 type=write size=2952109 2024-09-12T00:31:05.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.359+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~H9IUAAV6464O.0 size=1048576 2024-09-12T00:31:05.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.360+0000 7f0362c73780 1 < completed part key=_multipart_J5GSZCJW2BP1.2~H9IUAAV6464O.1 size=496084 2024-09-12T00:31:05.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.363+0000 7f0362c73780 1 < completed multipart upload key=J5GSZCJW2BP1 upload=H9IUAAV6464O tag=7GSMQMPJEQ3M type=write size=2593236 2024-09-12T00:31:05.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.364+0000 7f0362c73780 1 > prepared operation key=Q6M0D2698CUZ tag=5NC2V5DVZT26 type=write size=550067 2024-09-12T00:31:05.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.365+0000 7f0362c73780 1 < completed delete operation key=OY30LP7FYXNF tag=R8H3CUWBKVGJ type=del 2024-09-12T00:31:05.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.367+0000 7f0362c73780 1 > prepared operation key=6AYDT9X4LC6T tag=Y0YFGVARM08G type=del size=559293 2024-09-12T00:31:05.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.368+0000 7f0362c73780 -1 < failed to complete operation key=EHBOL435W9ZE tag=E3CNMNW33II2 type=del size=1651366: (22) Invalid argument 2024-09-12T00:31:05.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.371+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~E39MN3K5SNP8.0 size=1048576 2024-09-12T00:31:05.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.372+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~E39MN3K5SNP8.1 size=1048576 2024-09-12T00:31:05.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.373+0000 7f0362c73780 1 > prepared part key=_multipart_YTN99RBTKO39.2~E39MN3K5SNP8.2 size=11760 2024-09-12T00:31:05.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.373+0000 7f0362c73780 1 > prepared multipart upload key=YTN99RBTKO39 upload=E39MN3K5SNP8 tag=Z26OUZ2N35EY type=write size=3157488 2024-09-12T00:31:05.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.374+0000 7f0362c73780 1 < completed delete operation key=YTN99RBTKO39 tag=HLLYOI1MSGKU type=del 2024-09-12T00:31:05.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.377+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~8B33Z89IVVWL.0 size=1048576 2024-09-12T00:31:05.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.378+0000 7f0362c73780 1 > prepared part key=_multipart_1MLL1T362X51.2~8B33Z89IVVWL.1 size=685541 2024-09-12T00:31:05.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.378+0000 7f0362c73780 1 > prepared multipart upload key=1MLL1T362X51 upload=8B33Z89IVVWL tag=3ZJBSL7P04AR type=write size=2782693 2024-09-12T00:31:05.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.379+0000 7f0362c73780 1 < completed delete operation key=PYCRNXC9ITGF tag=PU98P15SY6X5 type=del 2024-09-12T00:31:05.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.382+0000 7f0362c73780 1 > prepared part key=_multipart_84T1VJG5SHU4.2~1XYUMUEZ34A4.0 size=676312 2024-09-12T00:31:05.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.382+0000 7f0362c73780 1 > prepared multipart upload key=84T1VJG5SHU4 upload=1XYUMUEZ34A4 tag=H431SAEPV5R5 type=write size=1724888 2024-09-12T00:31:05.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.383+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~F6BAMBFCY6HR.0 size=1048576 2024-09-12T00:31:05.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.385+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~F6BAMBFCY6HR.1 size=1048576 2024-09-12T00:31:05.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.386+0000 7f0362c73780 1 < completed part key=_multipart_CZHT9UQS34JU.2~F6BAMBFCY6HR.2 size=12525 2024-09-12T00:31:05.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.388+0000 7f0362c73780 1 < completed multipart upload key=CZHT9UQS34JU upload=F6BAMBFCY6HR tag=9XJY8IEESP6O type=write size=3158253 2024-09-12T00:31:05.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.390+0000 7f0362c73780 1 > prepared operation key=IIZAWZDLR2QE tag=I93DF835CXYZ type=del size=2631345 2024-09-12T00:31:05.390 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.391+0000 7f0362c73780 1 < completed delete operation key=KWDEKRO3WICD tag=1IR0EHM6NNVO type=del 2024-09-12T00:31:05.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.394+0000 7f0362c73780 1 > prepared part key=_multipart_KWDEKRO3WICD.2~DX6781YPLS89.0 size=973659 2024-09-12T00:31:05.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.394+0000 7f0362c73780 1 > prepared multipart upload key=KWDEKRO3WICD upload=DX6781YPLS89 tag=78LLO0O77U69 type=write size=2022235 2024-09-12T00:31:05.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.395+0000 7f0362c73780 1 < completed write operation key=3XZZX53L26G5 tag=L4LZZIBMQAHU type=write size=521784 2024-09-12T00:31:05.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.397+0000 7f0362c73780 1 > prepared operation key=1SE6WTQMW6JU tag=QAORENKLMBSL type=del size=755751 2024-09-12T00:31:05.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.398+0000 7f0362c73780 1 < completed delete operation key=HWSQFSK29S0V tag=JUC40STHQYMV type=del 2024-09-12T00:31:05.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.401+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~982Q3HA8EFK1.0 size=1048576 2024-09-12T00:31:05.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.402+0000 7f0362c73780 1 > prepared part key=_multipart_927NCYXX8Z2P.2~982Q3HA8EFK1.1 size=391154 2024-09-12T00:31:05.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.402+0000 7f0362c73780 1 > prepared multipart upload key=927NCYXX8Z2P upload=982Q3HA8EFK1 tag=OJAMTE5ZRUWS type=write size=2488306 2024-09-12T00:31:05.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.403+0000 7f0362c73780 -1 < failed to complete operation key=XMMZOX8MH3GT tag=LQR16KHRUJER type=del size=1772879: (22) Invalid argument 2024-09-12T00:31:05.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.405+0000 7f0362c73780 1 > prepared operation key=2DHHPBYV80O8 tag=OQPLU0L6G15A type=del size=1001554 2024-09-12T00:31:05.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.406+0000 7f0362c73780 1 < completed part key=_multipart_G4G6E7KTTZY9.2~1FF20RUA4A3P.0 size=647737 2024-09-12T00:31:05.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.409+0000 7f0362c73780 1 < completed multipart upload key=G4G6E7KTTZY9 upload=1FF20RUA4A3P tag=UZPX8JU03ASI type=write size=1696313 2024-09-12T00:31:05.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.412+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~H98GOK3GXTD5.0 size=1048576 2024-09-12T00:31:05.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.413+0000 7f0362c73780 1 > prepared part key=_multipart_6AYDT9X4LC6T.2~H98GOK3GXTD5.1 size=973801 2024-09-12T00:31:05.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.413+0000 7f0362c73780 1 > prepared multipart upload key=6AYDT9X4LC6T upload=H98GOK3GXTD5 tag=BQ8X2HGGC24X type=write size=3070953 2024-09-12T00:31:05.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.414+0000 7f0362c73780 1 < completed delete operation key=VD0LFCNLI1YI tag=07H8RUOBG4DF type=del 2024-09-12T00:31:05.414 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.416+0000 7f0362c73780 1 > prepared operation key=XMMZOX8MH3GT tag=WD8XN26DR8CG type=del size=3018193 2024-09-12T00:31:05.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.417+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~AE9UTF0XZ5BJ.0 size=1048576 2024-09-12T00:31:05.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.418+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~AE9UTF0XZ5BJ.1 size=1048576 2024-09-12T00:31:05.418 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.420+0000 7f0362c73780 1 < completed part key=_multipart_OY30LP7FYXNF.2~AE9UTF0XZ5BJ.2 size=321441 2024-09-12T00:31:05.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.422+0000 7f0362c73780 1 < completed multipart upload key=OY30LP7FYXNF upload=AE9UTF0XZ5BJ tag=FRFMQOJ4XXZV type=write size=3467169 2024-09-12T00:31:05.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.425+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~PK6G744OB6UJ.0 size=1048576 2024-09-12T00:31:05.424 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.426+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~PK6G744OB6UJ.1 size=1048576 2024-09-12T00:31:05.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.427+0000 7f0362c73780 1 > prepared part key=_multipart_Q6M0D2698CUZ.2~PK6G744OB6UJ.2 size=994041 2024-09-12T00:31:05.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.427+0000 7f0362c73780 1 > prepared multipart upload key=Q6M0D2698CUZ upload=PK6G744OB6UJ tag=6T1ZO4PSR5KT type=write size=4139769 2024-09-12T00:31:05.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.427+0000 7f0362c73780 1 < canceled part key=_multipart_927NCYXX8Z2P.2~26G1CG9BGHSJ.0 size=1048576 2024-09-12T00:31:05.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.429+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~26G1CG9BGHSJ.1 size=1048576 2024-09-12T00:31:05.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.430+0000 7f0362c73780 1 < completed part key=_multipart_927NCYXX8Z2P.2~26G1CG9BGHSJ.2 size=824164 2024-09-12T00:31:05.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.433+0000 7f0362c73780 1 < canceled multipart upload key=927NCYXX8Z2P upload=26G1CG9BGHSJ tag=1TTSQN3P6TLX type=write size=3969892 2024-09-12T00:31:05.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.434+0000 7f0362c73780 1 > prepared operation key=VD0LFCNLI1YI tag=HX071DOU9CDU type=del size=1646313 2024-09-12T00:31:05.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.434+0000 7f0362c73780 1 < canceled part key=_multipart_Q6M0D2698CUZ.2~GTNVGHE2J4IC.0 size=1048576 2024-09-12T00:31:05.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.435+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~GTNVGHE2J4IC.1 size=1048576 2024-09-12T00:31:05.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.436+0000 7f0362c73780 1 < completed part key=_multipart_Q6M0D2698CUZ.2~GTNVGHE2J4IC.2 size=1003830 2024-09-12T00:31:05.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.439+0000 7f0362c73780 1 < canceled multipart upload key=Q6M0D2698CUZ upload=GTNVGHE2J4IC tag=EMFWKZ3ELVTM type=write size=4149558 2024-09-12T00:31:05.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.442+0000 7f0362c73780 1 > prepared part key=_multipart_I3B48QD9E40S.2~4T0RPP20JEB5.0 size=326660 2024-09-12T00:31:05.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.442+0000 7f0362c73780 1 > prepared multipart upload key=I3B48QD9E40S upload=4T0RPP20JEB5 tag=WPLAB7JMHBXJ type=write size=1375236 2024-09-12T00:31:05.441 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.443+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~2UEYRWFJTQIC.0 size=1048576 2024-09-12T00:31:05.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.444+0000 7f0362c73780 1 < completed part key=_multipart_HEN9LUUIDAR5.2~2UEYRWFJTQIC.1 size=854957 2024-09-12T00:31:05.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.447+0000 7f0362c73780 1 < completed multipart upload key=HEN9LUUIDAR5 upload=2UEYRWFJTQIC tag=7GLCVHR3A2E9 type=write size=2952109 2024-09-12T00:31:05.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.450+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~T0VT722L0GMJ.0 size=1048576 2024-09-12T00:31:05.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.451+0000 7f0362c73780 1 > prepared part key=_multipart_CZHT9UQS34JU.2~T0VT722L0GMJ.1 size=801666 2024-09-12T00:31:05.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:31:05.451+0000 7f0362c73780 1 > prepared multipart upload key=CZHT9UQS34JU upload=T0VT722L0GMJ tag=WM7JZCGA9AKR type=write size=2898818 2024-09-12T00:31:05.449 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] cls_rgw_stats.simulate (11209 ms) 2024-09-12T00:31:05.450 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 1 test from cls_rgw_stats (11209 ms total) 2024-09-12T00:31:05.450 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:31:05.450 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:31:06.265 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 1 test from 1 test suite ran. (13930 ms total) 2024-09-12T00:31:06.265 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 1 test. 2024-09-12T00:31:06.269 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:31:06.269 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:31:06.355 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:31:06.356 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:31:06.356 DEBUG:teuthology.orchestra.run.smithi019:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:31:06.405 INFO:tasks.workunit.client.0.smithi019.stdout:Running main() from gmock_main.cc 2024-09-12T00:31:06.405 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:31:06.405 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:31:08.288 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:31:08.288 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:31:08.300 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (13 ms) 2024-09-12T00:31:08.300 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:31:08.305 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (5 ms) 2024-09-12T00:31:08.305 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:31:08.308 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (3 ms) 2024-09-12T00:31:08.308 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:31:08.312 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (3 ms) 2024-09-12T00:31:08.312 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:31:08.319 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_str (7 ms) 2024-09-12T00:31:08.319 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:31:08.325 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_u64 (6 ms) 2024-09-12T00:31:08.325 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:31:08.328 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (3 ms) 2024-09-12T00:31:08.328 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:31:08.331 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (3 ms) 2024-09-12T00:31:08.331 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:31:08.334 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-12T00:31:08.335 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:31:08.338 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (3 ms) 2024-09-12T00:31:08.338 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:31:08.339 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T00:31:08.339 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:31:08.339 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T00:31:08.339 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:31:08.346 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (6 ms) 2024-09-12T00:31:08.346 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:31:08.353 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (8 ms) 2024-09-12T00:31:08.354 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:31:08.359 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (5 ms) 2024-09-12T00:31:08.359 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:31:08.365 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (7 ms) 2024-09-12T00:31:08.365 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:31:08.375 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_set_vals_str (10 ms) 2024-09-12T00:31:08.375 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:31:08.384 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (8 ms) 2024-09-12T00:31:08.384 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:31:08.387 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (2 ms) 2024-09-12T00:31:08.387 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:31:08.389 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (3 ms) 2024-09-12T00:31:08.389 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:31:08.390 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (1 ms) 2024-09-12T00:31:08.390 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:31:08.391 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (0 ms) 2024-09-12T00:31:08.391 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:31:08.398 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (7 ms) 2024-09-12T00:31:08.398 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:31:08.405 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (7 ms) 2024-09-12T00:31:08.405 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:31:08.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (8 ms) 2024-09-12T00:31:08.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:31:08.419 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (7 ms) 2024-09-12T00:31:08.419 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:31:08.421 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (2 ms) 2024-09-12T00:31:08.422 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:31:08.425 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (3 ms) 2024-09-12T00:31:08.425 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:31:08.426 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (1 ms) 2024-09-12T00:31:08.426 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:31:08.426 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (1 ms) 2024-09-12T00:31:08.426 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:31:08.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (7 ms) 2024-09-12T00:31:08.433 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 31 tests from CmpOmap (146 ms total) 2024-09-12T00:31:08.434 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:31:08.434 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:31:09.291 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 31 tests from 1 test suite ran. (2886 ms total) 2024-09-12T00:31:09.291 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 31 tests. 2024-09-12T00:31:09.294 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:31:09.294 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:31:09.341 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:31:09.343 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:31:09.343 DEBUG:teuthology.orchestra.run.smithi019:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:31:09.392 INFO:tasks.workunit.client.0.smithi019.stdout:Running main() from gmock_main.cc 2024-09-12T00:31:09.392 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:31:09.392 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:31:09.393 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:31:09.393 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:31:12.296 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2902 ms) 2024-09-12T00:31:12.296 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:31:15.328 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3033 ms) 2024-09-12T00:31:15.328 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:31:18.335 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.Reserve (3007 ms) 2024-09-12T00:31:18.335 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:31:21.360 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3026 ms) 2024-09-12T00:31:21.361 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:31:24.365 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.Commit (3004 ms) 2024-09-12T00:31:24.365 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:31:27.380 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.Stats (3015 ms) 2024-09-12T00:31:27.380 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:31:31.409 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (4029 ms) 2024-09-12T00:31:31.409 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:31:34.432 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.Abort (3024 ms) 2024-09-12T00:31:34.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:31:37.454 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.ReserveError (3021 ms) 2024-09-12T00:31:37.454 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:31:40.461 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.CommitError (3007 ms) 2024-09-12T00:31:40.461 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:31:43.491 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.AbortError (3029 ms) 2024-09-12T00:31:43.492 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:31:46.494 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3004 ms) 2024-09-12T00:31:46.495 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:31:49.535 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3040 ms) 2024-09-12T00:31:49.535 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:31:52.535 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3000 ms) 2024-09-12T00:31:52.535 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:31:55.569 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3034 ms) 2024-09-12T00:31:55.569 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:31:58.590 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3021 ms) 2024-09-12T00:31:58.590 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:32:01.612 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3022 ms) 2024-09-12T00:32:01.612 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:32:04.631 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.Cleanup (3016 ms) 2024-09-12T00:32:04.631 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:32:15.683 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.MultiProducer (11055 ms) 2024-09-12T00:32:15.683 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:32:18.684 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (3002 ms) 2024-09-12T00:32:18.685 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:32:32.473 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13788 ms) 2024-09-12T00:32:32.473 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:32:36.508 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (4035 ms) 2024-09-12T00:32:36.508 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:32:41.550 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (5042 ms) 2024-09-12T00:32:41.550 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:32:46.625 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (5075 ms) 2024-09-12T00:32:46.625 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 24 tests from TestCls2PCQueue (97232 ms total) 2024-09-12T00:32:46.625 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:32:46.625 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:32:46.626 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 24 tests from 1 test suite ran. (97233 ms total) 2024-09-12T00:32:46.626 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 24 tests. 2024-09-12T00:32:46.629 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:32:46.629 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:32:46.672 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:32:46.673 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:32:46.673 DEBUG:teuthology.orchestra.run.smithi019:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:32:46.766 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:46.766 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:46.767 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:32:46.767 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:32:48.646 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:32:48.646 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:32:48.666 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsAccount.add (20 ms) 2024-09-12T00:32:48.666 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:32:48.672 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsAccount.get (6 ms) 2024-09-12T00:32:48.672 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:32:48.679 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsAccount.rm (7 ms) 2024-09-12T00:32:48.679 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:32:48.695 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] ClsAccount.list (15 ms) 2024-09-12T00:32:48.695 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 4 tests from ClsAccount (49 ms total) 2024-09-12T00:32:48.695 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:32:48.695 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:32:49.650 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 4 tests from 1 test suite ran. (2883 ms total) 2024-09-12T00:32:49.650 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 4 tests. 2024-09-12T00:32:49.654 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:32:49.654 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:32:49.699 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:32:49.700 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:32:49.701 DEBUG:teuthology.orchestra.run.smithi019:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:32:49.758 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:49.758 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:49.759 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:32:49.759 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:32:51.654 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:32:51.654 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:32:51.674 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] rgw_gc_log.init_existing_queue (20 ms) 2024-09-12T00:32:51.674 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:32:51.677 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] rgw_gc_log.init_existing_omap (3 ms) 2024-09-12T00:32:51.677 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:32:51.715 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (38 ms) 2024-09-12T00:32:51.715 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:32:51.716 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (1 ms) 2024-09-12T00:32:51.716 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:32:51.718 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] rgw_gc_log.defer1_after_init (3 ms) 2024-09-12T00:32:51.718 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:32:51.720 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] rgw_gc_log.defer2_before_init (2 ms) 2024-09-12T00:32:51.720 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 6 tests from rgw_gc_log (67 ms total) 2024-09-12T00:32:51.720 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:32:51.720 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:32:52.671 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 6 tests from 1 test suite ran. (2913 ms total) 2024-09-12T00:32:52.671 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 6 tests. 2024-09-12T00:32:52.675 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:32:52.675 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:32:52.719 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:32:52.721 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:32:52.721 DEBUG:teuthology.orchestra.run.smithi019:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:32:52.781 INFO:tasks.workunit.client.0.smithi019.stdout:Running main() from gmock_main.cc 2024-09-12T00:32:52.781 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:32:52.781 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:32:52.781 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:32:52.781 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:32:52.782 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.782 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.782 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns= i= 2024-09-12T00:32:52.782 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.782 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.782 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns= i= 2024-09-12T00:32:52.782 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.782 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.782 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns= i= 2024-09-12T00:32:52.782 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "obj1": { 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.783 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: "obj2": { 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.784 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3": { 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.785 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.786 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.786 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.786 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.786 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.786 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.786 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.786 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.786 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3-2": { 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.787 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.788 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns=ns i= 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns=ns i= 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns=ns i= 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout: "obj1": { 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.789 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.790 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: "obj2": { 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.791 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3": { 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.792 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3-2": { 2024-09-12T00:32:52.793 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.794 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns= i=v1 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns= i=v1 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns= i=v1 2024-09-12T00:32:52.795 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.796 INFO:tasks.workunit.client.0.smithi019.stdout: "obj1": { 2024-09-12T00:32:52.796 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.796 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.796 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.796 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.796 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.796 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.796 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.796 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.796 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.796 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: "obj2": { 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.797 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.798 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.798 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.798 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.798 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.798 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.798 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.798 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.798 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.798 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.798 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.798 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3": { 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.799 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3-2": { 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.800 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.801 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: _obj[v1] 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout: "obj1": { 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.802 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.803 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.803 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.803 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.803 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.803 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.803 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.803 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.803 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.803 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.803 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.803 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.804 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.804 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.804 INFO:tasks.workunit.client.0.smithi019.stdout: "obj2": { 2024-09-12T00:32:52.804 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.804 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.804 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.804 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.804 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.804 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.804 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.804 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3": { 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.805 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.806 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3-2": { 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.807 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.808 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.809 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.809 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_obj", 2024-09-12T00:32:52.809 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.809 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.809 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.809 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.809 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.809 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestRGWObj.underscore (0 ms) 2024-09-12T00:32:52.809 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:32:52.809 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.809 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns= i= 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns= i= 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns= i= 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout: "obj1": { 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.810 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.811 INFO:tasks.workunit.client.0.smithi019.stdout: "obj2": { 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.812 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3": { 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.813 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3-2": { 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.814 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.815 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns=ns i= 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns=ns i= 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns=ns i= 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout: "obj1": { 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.816 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.817 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: "obj2": { 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.818 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3": { 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.819 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3-2": { 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.820 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.821 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns= i=v1 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns= i=v1 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns= i=v1 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.822 INFO:tasks.workunit.client.0.smithi019.stdout: "obj1": { 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.823 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.824 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.824 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.824 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.824 INFO:tasks.workunit.client.0.smithi019.stdout: "obj2": { 2024-09-12T00:32:52.824 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.824 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.824 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.824 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.824 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.824 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.824 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3": { 2024-09-12T00:32:52.825 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.826 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3-2": { 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.827 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.828 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout:parsed: obj[v1] 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout: "obj1": { 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.829 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: "obj2": { 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.830 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.831 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3": { 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.832 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "obj3-2": { 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.833 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "obj", 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "v1", 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.834 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.835 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.836 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker_myobj", 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.837 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.838 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.839 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.840 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker_myobj", 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.841 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.842 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.843 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.844 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:32:52.845 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.848 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.848 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.848 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.848 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.848 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.848 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.848 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.849 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.850 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.851 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.852 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.853 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.854 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.855 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.856 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.857 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.858 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.859 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.860 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.861 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.862 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.863 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.864 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.865 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.866 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.866 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.866 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.866 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.866 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.866 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.866 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.866 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.866 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.867 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.868 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.869 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.870 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.871 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.872 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.873 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker___myobj", 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj" 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.874 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.875 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.876 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.877 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker___myobj", 2024-09-12T00:32:52.878 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj" 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.879 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.880 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.881 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.882 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.883 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.884 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.885 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.886 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.887 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.888 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.889 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.890 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj" 2024-09-12T00:32:52.891 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.892 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.893 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.894 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.895 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj" 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.896 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.897 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.898 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.899 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.900 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.901 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.902 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.903 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.904 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.905 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.906 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.907 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker___myobj_", 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj_" 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.908 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.909 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.910 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.911 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker___myobj_", 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj_" 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.912 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.913 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.914 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.915 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.916 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.917 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.918 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.919 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:32:52.920 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.921 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.922 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.923 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.924 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.925 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.925 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.925 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:32:52.925 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj_" 2024-09-12T00:32:52.925 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.925 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.925 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.925 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.926 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.927 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.928 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.929 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj_" 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.930 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.931 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.932 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.933 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": "default-placement.data", 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "test", 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.934 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": "", 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": "" 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.935 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.936 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "obj": { 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.937 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.938 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.939 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestRGWObj.obj_to_raw (1 ms) 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker_myobj", 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.940 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.941 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker_myobj", 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.942 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.943 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.944 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.945 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.946 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.947 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.948 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.949 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.950 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.951 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.952 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.953 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.954 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "myobj", 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.955 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker___myobj", 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj" 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.956 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.957 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker___myobj", 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj" 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.958 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.959 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.960 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.961 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.962 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.963 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj" 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.964 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.965 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj" 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.966 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.967 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.968 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.969 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.970 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj", 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.971 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker___myobj_", 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj_" 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.972 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.973 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker___myobj_", 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj_" 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.974 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.975 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.976 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.977 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.977 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.977 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.977 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.977 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.977 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.977 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.977 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.977 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.977 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.977 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.978 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.979 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "", 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.980 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj_" 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.981 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.982 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "marker__myobj_" 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.983 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "" 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj": { 2024-09-12T00:32:52.984 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj": { 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.985 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: "raw_obj2": { 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: "pool": ".data-pool", 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:32:52.986 INFO:tasks.workunit.client.0.smithi019.stdout: "loc": "" 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: "new_obj2": { 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket": { 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "ebtest", 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: "marker": "marker", 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_id": "bucket-id", 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: "tenant": "", 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: "explicit_placement": { 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: "data_pool": ".data-pool", 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: "data_extra_pool": "", 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: "index_pool": ".index-pool" 2024-09-12T00:32:52.987 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout: "key": { 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout: "name": "_myobj_", 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout: "instance": "inst", 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout: "ns": "ns" 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] TestRGWObj.old_to_raw (0 ms) 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 4 tests from TestRGWObj (1 ms total) 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:32:52.988 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:32:52.989 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 4 tests from 1 test suite ran. (1 ms total) 2024-09-12T00:32:52.989 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 4 tests. 2024-09-12T00:32:52.989 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:32:52.989 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:32:53.032 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:32:53.033 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:32:53.033 DEBUG:teuthology.orchestra.run.smithi019:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:32:53.154 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:53.154 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:53.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.205+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.206+0000 7f6dbed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:53.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.206+0000 7f6dbed25800 20 realm 2024-09-12T00:32:53.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.206+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.207+0000 7f6dbed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:53.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.207+0000 7f6dbed25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:53.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.207+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.207+0000 7f6dbed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:53.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.207+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.208+0000 7f6dbed25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:53.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.208+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.208+0000 7f6dbed25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:53.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.208+0000 7f6dbed25800 20 searching for the correct realm 2024-09-12T00:32:53.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.210+0000 7f6dba933640 0 -- 172.21.15.19:0/3253575252 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x5611d955c270 msgr2=0x5611d955e6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:53.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.218+0000 7f6dbb134640 0 -- 172.21.15.19:0/3253575252 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x5611d955c270 msgr2=0x7f6dac0d39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:53.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.432+0000 7f6dbed25800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:32:53.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.432+0000 7f6dbed25800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:32:53.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.432+0000 7f6dbed25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:53.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.432+0000 7f6dbed25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:53.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.432+0000 7f6dbed25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:53.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.432+0000 7f6dbed25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:53.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.432+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.432+0000 7f6dbed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:53.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.432+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.432+0000 7f6dbed25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:53.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.432+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.433+0000 7f6dbed25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:53.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.433+0000 7f6dbed25800 20 zone default found 2024-09-12T00:32:53.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.433+0000 7f6dbed25800 4 Realm: () 2024-09-12T00:32:53.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.433+0000 7f6dbed25800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:32:53.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.433+0000 7f6dbed25800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:32:53.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.433+0000 7f6dbed25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:53.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.433+0000 7f6dbed25800 20 zonegroup default 2024-09-12T00:32:53.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.433+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.434+0000 7f6dbed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:53.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.434+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.434+0000 7f6dbed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:53.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.434+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.435+0000 7f6dbed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:53.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.435+0000 7f6dbed25800 20 started sync module instance, tier type = 2024-09-12T00:32:53.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.435+0000 7f6dbed25800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:32:53.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.446+0000 7f6dbed25800 20 add_watcher() i=0 2024-09-12T00:32:53.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.446+0000 7f6dbed25800 20 add_watcher() i=1 2024-09-12T00:32:53.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.446+0000 7f6dbed25800 20 add_watcher() i=2 2024-09-12T00:32:53.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.446+0000 7f6dbed25800 20 add_watcher() i=3 2024-09-12T00:32:53.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.446+0000 7f6dbed25800 20 add_watcher() i=4 2024-09-12T00:32:53.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.446+0000 7f6dbed25800 20 add_watcher() i=5 2024-09-12T00:32:53.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.446+0000 7f6dbed25800 20 add_watcher() i=6 2024-09-12T00:32:53.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.447+0000 7f6dbed25800 20 add_watcher() i=7 2024-09-12T00:32:53.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.447+0000 7f6dbed25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:53.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.448+0000 7f6c717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:53.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.449+0000 7f6dbed25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:53.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.449+0000 7f6dbed25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:53.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.449+0000 7f6dbed25800 5 note: GC not initialized 2024-09-12T00:32:53.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.449+0000 7f6bebfff640 20 reqs_thread_entry: start 2024-09-12T00:32:53.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.449+0000 7f6dbed25800 20 init_complete bucket index max shards: 11 2024-09-12T00:32:53.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.449+0000 7f6dbed25800 20 Filter name: none 2024-09-12T00:32:53.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.449+0000 7f6be9ffb640 20 reqs_thread_entry: start 2024-09-12T00:32:53.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.449+0000 7f6dbed25800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:32:53.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.449+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:53.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:32:53.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:32:53.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:32:53.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:53.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:32:53.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:32:53.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 10 cache get: name=default.rgw.meta+users.keys+04IpdUtOiaH9TYNKfOkZ87DnEjs= : miss 2024-09-12T00:32:53.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 20 rados->read ofs=0 len=0 2024-09-12T00:32:53.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:53.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 10 cache put: name=default.rgw.meta+users.keys+04IpdUtOiaH9TYNKfOkZ87DnEjs= info.flags=0x0 2024-09-12T00:32:53.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 10 adding default.rgw.meta+users.keys+04IpdUtOiaH9TYNKfOkZ87DnEjs= to cache LRU end 2024-09-12T00:32:53.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 10 cache get: name=default.rgw.meta+users.keys+04IpdUtOiaH9TYNKfOkZ87DnEjs= : hit (negative entry) 2024-09-12T00:32:53.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.450+0000 7f6dbed25800 10 cache get: name=default.rgw.meta+users.keys+04IpdUtOiaH9TYNKfOkZ87DnEjs= : hit (negative entry) 2024-09-12T00:32:53.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.452+0000 7f6dbed25800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:32:53.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.452+0000 7f6dbed25800 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:32:53.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.452+0000 7f6dbed25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:32:53.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.452+0000 7f6c9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693185 cookie 94634660742272 notifier 5517 bl.length()=697 2024-09-12T00:32:53.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.452+0000 7f6c9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:32:53.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.452+0000 7f6c9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:32:53.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.455+0000 7f6dbed25800 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:32:53.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.455+0000 7f6dbed25800 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:32:53.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.455+0000 7f6dbed25800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:32:53.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.455+0000 7f6c9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693184 cookie 94634660743680 notifier 5517 bl.length()=194 2024-09-12T00:32:53.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.455+0000 7f6c9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:32:53.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.455+0000 7f6c9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:32:53.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.461+0000 7f6dbed25800 10 cache put: name=default.rgw.meta+users.keys+04IpdUtOiaH9TYNKfOkZ87DnEjs= info.flags=0x7 2024-09-12T00:32:53.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.461+0000 7f6dbed25800 10 moving default.rgw.meta+users.keys+04IpdUtOiaH9TYNKfOkZ87DnEjs= to cache LRU end 2024-09-12T00:32:53.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.461+0000 7f6dbed25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:04IpdUtOiaH9TYNKfOkZ87DnEjs=, ofs0, ns] 2024-09-12T00:32:53.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.461+0000 7f6c9e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693186 cookie 94634660742272 notifier 5517 bl.length()=203 2024-09-12T00:32:53.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.461+0000 7f6c9e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+04IpdUtOiaH9TYNKfOkZ87DnEjs= info.flags=0x7 2024-09-12T00:32:53.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.461+0000 7f6c9e7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+04IpdUtOiaH9TYNKfOkZ87DnEjs= to cache LRU end 2024-09-12T00:32:53.461 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:32:53.461 INFO:tasks.workunit.client.0.smithi019.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:32:53.461 INFO:tasks.workunit.client.0.smithi019.stdout: "display_name": "librgw test user", 2024-09-12T00:32:53.461 INFO:tasks.workunit.client.0.smithi019.stdout: "email": "librgw@example.com", 2024-09-12T00:32:53.461 INFO:tasks.workunit.client.0.smithi019.stdout: "suspended": 0, 2024-09-12T00:32:53.461 INFO:tasks.workunit.client.0.smithi019.stdout: "max_buckets": 1000, 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: "subusers": [], 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: "keys": [ 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: { 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: "access_key": "04IpdUtOiaH9TYNKfOkZ87DnEjs=", 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: "secret_key": "DHv1ztJRfTf53aaNW95jDZYGUWz8E8bVP76Bj+6PNPXW9NutloMQ1Q==", 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: "active": true, 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: "create_date": "2024-09-12T00:32:53.451623Z" 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: ], 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: "swift_keys": [], 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: "caps": [], 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T00:32:53.462 INFO:tasks.workunit.client.0.smithi019.stdout: "default_placement": "", 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "default_storage_class": "", 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "placement_tags": [], 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_quota": { 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "enabled": false, 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size": -1, 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "max_objects": -1 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "user_quota": { 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "enabled": false, 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size": -1, 2024-09-12T00:32:53.463 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout: "max_objects": -1 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout: "temp_url_keys": [], 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout: "type": "rgw", 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout: "mfa_ids": [], 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout: "account_id": "", 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout: "path": "/", 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout: "create_date": "2024-09-12T00:32:53.451606Z", 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout: "tags": [], 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout: "group_ids": [] 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:32:53.464 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:32:53.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.464+0000 7f6c717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:53.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.466+0000 7f6dbed25800 20 remove_watcher() i=0 2024-09-12T00:32:53.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.466+0000 7f6dbed25800 2 removed watcher, disabling cache 2024-09-12T00:32:53.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.467+0000 7f6dbed25800 20 remove_watcher() i=1 2024-09-12T00:32:53.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.468+0000 7f6dbed25800 20 remove_watcher() i=2 2024-09-12T00:32:53.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.469+0000 7f6dbed25800 20 remove_watcher() i=3 2024-09-12T00:32:53.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.470+0000 7f6dbed25800 20 remove_watcher() i=4 2024-09-12T00:32:53.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.471+0000 7f6dbed25800 20 remove_watcher() i=5 2024-09-12T00:32:53.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.473+0000 7f6dbed25800 20 remove_watcher() i=6 2024-09-12T00:32:53.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:53.474+0000 7f6dbed25800 20 remove_watcher() i=7 2024-09-12T00:32:53.483 INFO:tasks.workunit.client.0.smithi019.stdout:phase 1.1 2024-09-12T00:32:53.505 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:32:53.505 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:32:53.505 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:32:53.505 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:32:53.516 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:53.516 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:53.897 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (393 ms) 2024-09-12T00:32:53.898 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:32:53.899 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:32:53.899 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:32:53.899 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:32:53.899 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:32:53.911 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:32:53.916 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/f1 2024-09-12T00:32:53.919 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/f2 2024-09-12T00:32:53.923 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:32:53.926 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:32:53.929 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:32:53.931 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:32:53.935 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:32:53.937 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:32:53.940 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:32:53.943 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:32:53.946 INFO:tasks.workunit.client.0.smithi019.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:32:53.949 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SETUP_HIER1 (51 ms) 2024-09-12T00:32:53.949 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:32:54.056 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SETUP_DIRS1 (106 ms) 2024-09-12T00:32:54.056 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:32:54.056 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:32:54.056 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:32:54.075 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (20 ms) 2024-09-12T00:32:54.075 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:32:54.125 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (49 ms) 2024-09-12T00:32:54.125 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:32:54.125 INFO:tasks.workunit.client.0.smithi019.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:32:54.131 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (7 ms) 2024-09-12T00:32:54.132 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:32:54.132 INFO:tasks.workunit.client.0.smithi019.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:32:54.139 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (7 ms) 2024-09-12T00:32:54.139 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:32:54.139 INFO:tasks.workunit.client.0.smithi019.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:32:54.139 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:32:54.139 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:32:54.139 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:32:54.139 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:32:54.139 INFO:tasks.workunit.client.0.smithi019.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:32:54.139 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:32:54.140 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:32:54.141 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:32:54.141 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:32:54.143 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:32:54.143 INFO:tasks.workunit.client.0.smithi019.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:32:54.143 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:32:54.144 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:32:54.144 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:32:54.146 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:32:54.146 INFO:tasks.workunit.client.0.smithi019.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:32:54.146 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:32:54.147 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:32:54.147 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:32:54.149 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:32:54.149 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READ_DIRS1 (10 ms) 2024-09-12T00:32:54.149 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:32:54.330 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READF_SETUP1 (181 ms) 2024-09-12T00:32:54.330 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:32:54.330 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:32:54.330 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:32:54.330 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:32:54.330 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:32:54.330 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:32:54.330 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:32:54.331 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:32:54.339 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:32:54.339 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:32:54.342 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:32:54.344 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:32:54.347 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:32:54.348 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:32:54.348 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:32:54.349 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:32:54.349 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:32:54.350 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:32:54.351 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:32:54.353 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:32:54.354 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:32:54.354 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:32:54.354 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:32:54.354 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:32:54.354 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.HIER1 (23 ms) 2024-09-12T00:32:54.354 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:32:54.354 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:32:54.354 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:32:54.354 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:32:54.355 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:32:54.355 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:32:54.355 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:32:54.355 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:32:54.355 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:32:54.355 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:32:54.355 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:32:54.355 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:32:54.356 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:32:54.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:54.355+0000 7fb8b5b238c0 -1 shutting down 2024-09-12T00:32:54.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:32:54.356+0000 7fb78d0c7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 63650, si_uid : 1000, si_addr0x3e80000f8a2, si_status0 2024-09-12T00:33:23.976 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (29622 ms) 2024-09-12T00:33:23.977 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 24 tests from LibRGW (30470 ms total) 2024-09-12T00:33:23.977 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:33:23.977 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:33:23.977 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 24 tests from 1 test suite ran. (30470 ms total) 2024-09-12T00:33:23.977 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 24 tests. 2024-09-12T00:33:23.981 INFO:tasks.workunit.client.0.smithi019.stdout:phase 1.2 2024-09-12T00:33:24.007 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:33:24.007 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:33:24.007 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:33:24.007 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:33:24.016 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:24.016 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:24.409 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (402 ms) 2024-09-12T00:33:24.409 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:33:24.411 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:33:24.411 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:33:24.411 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:33:24.411 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:33:24.411 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:33:24.412 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:33:24.413 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:33:24.413 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:33:24.413 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:33:24.413 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:33:24.413 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:33:24.413 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:33:24.413 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:33:24.413 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:33:24.414 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:33:24.414 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:33:24.414 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:33:24.414 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:33:24.414 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:33:24.414 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:33:24.415 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:33:24.415 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:33:24.415 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:33:24.415 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:33:24.415 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:33:24.415 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:33:24.415 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:33:24.416 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:33:24.416 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:33:24.416 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:33:24.416 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:33:24.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:33:24.411+0000 7f8be38538c0 -1 shutting down 2024-09-12T00:33:24.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:33:24.412+0000 7f8abd592640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64269, si_uid : 1000, si_addr0x3e80000fb0d, si_status0 2024-09-12T00:33:54.633 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (30223 ms) 2024-09-12T00:33:54.634 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 24 tests from LibRGW (30626 ms total) 2024-09-12T00:33:54.634 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:33:54.634 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:33:54.634 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 24 tests from 1 test suite ran. (30626 ms total) 2024-09-12T00:33:54.634 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 24 tests. 2024-09-12T00:33:54.640 INFO:tasks.workunit.client.0.smithi019.stdout:phase 1.3 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:33:54.676 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:54.676 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (406 ms) 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT_NOROOT (1 ms) 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:33:55.073 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:33:55.073 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:33:55.078 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SETUP_HIER1 (6 ms) 2024-09-12T00:33:55.079 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:33:55.145 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SETUP_DIRS1 (66 ms) 2024-09-12T00:33:55.145 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:33:55.145 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:33:55.145 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:33:55.145 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:33:55.145 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:33:55.145 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:33:55.146 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi019.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi019.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi019.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:33:55.147 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:33:55.148 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:33:55.148 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:33:55.148 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:33:55.148 INFO:tasks.workunit.client.0.smithi019.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:33:55.148 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:33:55.149 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:33:55.150 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:33:55.150 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:33:55.150 INFO:tasks.workunit.client.0.smithi019.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:33:55.151 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:33:55.152 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:33:55.152 INFO:tasks.workunit.client.0.smithi019.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:33:55.154 INFO:tasks.workunit.client.0.smithi019.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:33:55.154 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READ_DIRS1 (9 ms) 2024-09-12T00:33:55.154 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:33:55.154 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:33:55.154 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:33:55.155 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:33:55.156 INFO:tasks.workunit.client.0.smithi019.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:33:55.156 INFO:tasks.workunit.client.0.smithi019.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:33:55.156 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:33:55.156 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:33:55.168 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:33:55.168 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:33:55.171 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:33:55.174 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:33:55.176 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:33:55.177 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:33:55.177 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:33:55.178 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:33:55.178 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:33:55.178 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:33:55.179 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:33:55.182 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:33:55.182 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:33:55.182 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:33:55.182 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:33:55.182 INFO:tasks.workunit.client.0.smithi019.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:33:55.182 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.HIER1 (28 ms) 2024-09-12T00:33:55.182 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:33:55.183 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:33:55.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:33:55.182+0000 7fdb467278c0 -1 shutting down 2024-09-12T00:33:55.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:33:55.183+0000 7fda20464640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 64888, si_uid : 1000, si_addr0x3e80000fd78, si_status0 2024-09-12T00:34:25.143 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (29961 ms) 2024-09-12T00:34:25.144 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 24 tests from LibRGW (30477 ms total) 2024-09-12T00:34:25.144 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:34:25.144 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:34:25.144 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 24 tests from 1 test suite ran. (30477 ms total) 2024-09-12T00:34:25.144 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 24 tests. 2024-09-12T00:34:25.150 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2.1 2024-09-12T00:34:25.176 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:34:25.177 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:34:25.177 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:34:25.177 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:34:25.186 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:25.186 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:25.586 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (409 ms) 2024-09-12T00:34:25.586 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:34:25.586 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:34:25.586 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:34:25.598 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CREATE_BUCKET (12 ms) 2024-09-12T00:34:25.598 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:34:25.598 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:34:25.598 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:34:25.609 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave0 2024-09-12T00:34:25.619 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave1 2024-09-12T00:34:25.630 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave2 2024-09-12T00:34:25.640 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave3 2024-09-12T00:34:25.650 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave4 2024-09-12T00:34:25.660 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave5 2024-09-12T00:34:25.673 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave6 2024-09-12T00:34:25.685 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave7 2024-09-12T00:34:25.696 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave8 2024-09-12T00:34:25.711 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave9 2024-09-12T00:34:25.712 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (113 ms) 2024-09-12T00:34:25.712 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:34:26.017 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (305 ms) 2024-09-12T00:34:26.017 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:34:26.017 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:34:26.017 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:34:26.017 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:34:26.017 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:34:26.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:34:26.019+0000 7f375792f8c0 -1 shutting down 2024-09-12T00:34:26.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:34:26.020+0000 7f362f8c7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 65507, si_uid : 1000, si_addr0x3e80000ffe3, si_status0 2024-09-12T00:34:55.736 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (29719 ms) 2024-09-12T00:34:55.737 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 9 tests from LibRGW (30559 ms total) 2024-09-12T00:34:55.737 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:34:55.737 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:34:55.737 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 9 tests from 1 test suite ran. (30559 ms total) 2024-09-12T00:34:55.737 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 9 tests. 2024-09-12T00:34:55.742 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2.2 2024-09-12T00:34:55.769 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:34:55.769 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:34:55.769 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:34:55.769 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:34:55.779 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:55.779 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:56.171 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (402 ms) 2024-09-12T00:34:56.171 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:34:56.172 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:34:56.172 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:34:56.172 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:34:56.172 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:34:56.205 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_BUCKET (34 ms) 2024-09-12T00:34:56.206 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:34:56.217 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave0 2024-09-12T00:34:56.230 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave1 2024-09-12T00:34:56.241 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave2 2024-09-12T00:34:56.251 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave3 2024-09-12T00:34:56.261 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave4 2024-09-12T00:34:56.274 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave5 2024-09-12T00:34:56.285 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave6 2024-09-12T00:34:56.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave7 2024-09-12T00:34:56.305 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave8 2024-09-12T00:34:56.315 INFO:tasks.workunit.client.0.smithi019.stdout:created: sorrydave9 2024-09-12T00:34:56.315 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (110 ms) 2024-09-12T00:34:56.315 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:34:56.629 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (313 ms) 2024-09-12T00:34:56.630 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:34:56.630 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:34:56.630 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:34:56.630 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:34:56.630 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:34:56.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:34:56.631+0000 7fc9dce2f8c0 -1 shutting down 2024-09-12T00:34:56.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:34:56.632+0000 7fc8b235a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66126, si_uid : 1000, si_addr0x3e80001024e, si_status0 2024-09-12T00:35:26.369 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (29740 ms) 2024-09-12T00:35:26.370 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 9 tests from LibRGW (30600 ms total) 2024-09-12T00:35:26.370 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:35:26.370 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:35:26.370 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 9 tests from 1 test suite ran. (30600 ms total) 2024-09-12T00:35:26.370 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 9 tests. 2024-09-12T00:35:26.375 INFO:tasks.workunit.client.0.smithi019.stdout:phase 3.1 2024-09-12T00:35:26.709 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:35:26.709 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:35:26.709 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:35:26.709 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:35:26.718 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:26.718 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:26.898 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (189 ms) 2024-09-12T00:35:26.898 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:35:26.898 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:35:26.898 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:35:26.909 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-12T00:35:26.909 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:35:26.913 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:35:26.913 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:35:26.915 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T00:35:26.915 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:35:26.972 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LARGE1 (56 ms) 2024-09-12T00:35:26.972 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:35:27.012 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LARGE2 (40 ms) 2024-09-12T00:35:27.012 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:35:27.012 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:35:27.012 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:35:27.012 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:35:27.012 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:35:27.012 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:35:27.012 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:35:27.012 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:35:27.012 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:35:27.013 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:35:27.013 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:35:27.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:35:27.012+0000 7f81352c18c0 -1 shutting down 2024-09-12T00:35:27.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:35:27.013+0000 7f800c2d5640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 66746, si_uid : 1000, si_addr0x3e8000104ba, si_status0 2024-09-12T00:35:57.091 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (30079 ms) 2024-09-12T00:35:57.092 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 13 tests from LibRGW (30382 ms total) 2024-09-12T00:35:57.092 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:35:57.092 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:35:57.092 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 13 tests from 1 test suite ran. (30382 ms total) 2024-09-12T00:35:57.092 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 13 tests. 2024-09-12T00:35:57.099 INFO:tasks.workunit.client.0.smithi019.stdout:phase 3.2 2024-09-12T00:35:57.430 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:35:57.430 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:35:57.430 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:35:57.430 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:35:57.438 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:57.438 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:57.824 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (394 ms) 2024-09-12T00:35:57.824 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:35:57.825 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:35:57.825 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:35:57.825 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:35:57.825 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:35:57.830 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:35:57.830 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:35:57.834 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T00:35:57.834 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:35:57.907 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LARGE1 (73 ms) 2024-09-12T00:35:57.907 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:35:57.907 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:35:57.907 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:35:57.907 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:35:57.908 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:35:57.912 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_OBJECT (5 ms) 2024-09-12T00:35:57.912 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:35:57.942 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_BUCKET (30 ms) 2024-09-12T00:35:57.942 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:35:57.942 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:35:57.943 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:35:57.943 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:35:57.943 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:35:57.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:35:57.944+0000 7f8c1d5228c0 -1 shutting down 2024-09-12T00:35:57.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:35:57.945+0000 7f8af54bd640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67365, si_uid : 1000, si_addr0x3e800010725, si_status0 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (30214 ms) 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 13 tests from LibRGW (30726 ms total) 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:36:28.157 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 13 tests from 1 test suite ran. (30726 ms total) 2024-09-12T00:36:28.158 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 13 tests. 2024-09-12T00:36:28.164 INFO:tasks.workunit.client.0.smithi019.stdout:phase 4.1 2024-09-12T00:36:28.190 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:36:28.190 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:36:28.190 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:36:28.190 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:36:28.191 INFO:tasks.workunit.client.0.smithi019.stdout:read i1: 64001 2024-09-12T00:36:28.191 INFO:tasks.workunit.client.0.smithi019.stdout:read s1: blunderbuss 2024-09-12T00:36:28.191 INFO:tasks.workunit.client.0.smithi019.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:36:28.191 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:36:28.202 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:28.202 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:28.797 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (607 ms) 2024-09-12T00:36:28.797 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:36:28.798 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:36:28.798 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:36:28.820 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (22 ms) 2024-09-12T00:36:28.820 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:36:29.293 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_0 2024-09-12T00:36:29.293 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_1 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_2 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_3 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_4 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_5 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_6 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_7 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_8 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_9 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_10 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_11 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_12 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_13 2024-09-12T00:36:29.294 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_14 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_15 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_16 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_17 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_18 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_19 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_20 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_21 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_22 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_23 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_24 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_25 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_26 2024-09-12T00:36:29.295 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_27 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_28 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_29 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_30 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_31 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_32 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_33 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_34 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_35 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_36 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_37 2024-09-12T00:36:29.296 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_38 2024-09-12T00:36:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_39 2024-09-12T00:36:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_40 2024-09-12T00:36:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_41 2024-09-12T00:36:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_42 2024-09-12T00:36:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_43 2024-09-12T00:36:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_44 2024-09-12T00:36:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_45 2024-09-12T00:36:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_46 2024-09-12T00:36:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_47 2024-09-12T00:36:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_48 2024-09-12T00:36:29.297 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_49 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_50 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_51 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_52 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_53 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_54 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_55 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_56 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_57 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_58 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_59 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_60 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_61 2024-09-12T00:36:29.298 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_62 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_63 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_64 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_65 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_66 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_67 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_68 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_69 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_70 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_71 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_72 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_73 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_74 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_75 2024-09-12T00:36:29.299 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_76 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_77 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_78 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_79 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_80 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_81 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_82 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_83 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_84 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_85 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_86 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_87 2024-09-12T00:36:29.300 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_88 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_89 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_90 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_91 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_92 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_93 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_94 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_95 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_96 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_97 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_98 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:created: dmarker:f_99 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (473 ms) 2024-09-12T00:36:29.301 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:36:29.303 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:36:29.303 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:36:29.303 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:36:29.303 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:36:29.303 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:36:29.303 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:36:29.304 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:36:29.304 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:36:29.304 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:36:29.304 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:36:29.304 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:36:29.304 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:36:29.304 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:36:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:36:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:36:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:36:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:36:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:36:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:36:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:36:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:36:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:36:29.305 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:36:29.306 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:36:29.307 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:36:29.307 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:36:29.307 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:36:29.307 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:36:29.308 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:36:29.309 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:36:29.310 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:36:29.311 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_READDIR (3 ms) 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:36:29.312 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:36:29.313 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:36:29.313 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:36:29.313 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:36:29.313 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:36:29.313 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:36:29.313 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:36:29.313 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:36:29.313 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:36:29.313 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:36:29.314 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:36:29.315 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:36:29.316 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:36:29.317 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:36:29.318 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:36:29.319 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:36:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:36:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:36:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:36:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:36:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:36:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:36:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:36:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER2_READDIR (1 ms) 2024-09-12T00:36:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:36:29.320 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (1 ms) 2024-09-12T00:36:29.321 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:36:29.321 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:36:29.321 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:36:29.321 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:36:29.321 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:36:29.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:36:29.299+0000 7f5985f358c0 -1 shutting down 2024-09-12T00:36:29.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:36:29.300+0000 7f585de0e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 67985, si_uid : 1000, si_addr0x3e800010991, si_status0 2024-09-12T00:36:58.874 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (29575 ms) 2024-09-12T00:36:58.874 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 11 tests from LibRGW (30683 ms total) 2024-09-12T00:36:58.874 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:36:58.874 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:36:58.874 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 11 tests from 1 test suite ran. (30683 ms total) 2024-09-12T00:36:58.875 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 11 tests. 2024-09-12T00:36:58.880 INFO:tasks.workunit.client.0.smithi019.stdout:phase 4.2 2024-09-12T00:36:58.906 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:36:58.906 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:36:58.907 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:36:58.907 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:36:58.907 INFO:tasks.workunit.client.0.smithi019.stdout:read i1: 64001 2024-09-12T00:36:58.907 INFO:tasks.workunit.client.0.smithi019.stdout:read s1: blunderbuss 2024-09-12T00:36:58.907 INFO:tasks.workunit.client.0.smithi019.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:36:58.907 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:36:58.915 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:58.915 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:59.326 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (419 ms) 2024-09-12T00:36:59.326 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:36:59.326 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:36:59.326 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:36:59.336 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (10 ms) 2024-09-12T00:36:59.337 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:36:59.337 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:36:59.337 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:36:59.337 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:36:59.337 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:36:59.339 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:36:59.339 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:36:59.339 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:36:59.340 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:36:59.340 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:36:59.340 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:36:59.340 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:36:59.340 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:36:59.340 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:36:59.340 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:36:59.340 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:36:59.340 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:36:59.341 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:36:59.342 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:36:59.343 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:36:59.344 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:36:59.345 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:36:59.346 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER2_READDIR (2 ms) 2024-09-12T00:36:59.347 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:36:59.348 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:36:59.348 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:36:59.348 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:36:59.348 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:36:59.348 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:36:59.348 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:36:59.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:36:59.340+0000 7f7584d248c0 -1 shutting down 2024-09-12T00:36:59.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:36:59.341+0000 7f745cc9a640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 68604, si_uid : 1000, si_addr0x3e800010bfc, si_status0 2024-09-12T00:37:29.374 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (30034 ms) 2024-09-12T00:37:29.374 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 11 tests from LibRGW (30466 ms total) 2024-09-12T00:37:29.374 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:37:29.374 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:37:29.375 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 11 tests from 1 test suite ran. (30466 ms total) 2024-09-12T00:37:29.375 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 11 tests. 2024-09-12T00:37:29.379 INFO:tasks.workunit.client.0.smithi019.stdout:phase 5.1 2024-09-12T00:37:29.418 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:37:29.418 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:37:29.418 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:37:29.418 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:37:29.429 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:29.429 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:29.838 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (421 ms) 2024-09-12T00:37:29.839 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:37:29.839 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:37:29.840 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:37:29.851 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CREATE_BUCKET (11 ms) 2024-09-12T00:37:29.851 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:37:29.855 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:37:29.855 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:37:29.855 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:37:29.855 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:37:29.857 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (2 ms) 2024-09-12T00:37:29.857 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:37:29.857 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:37:29.857 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:37:29.861 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-12T00:37:29.861 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:37:29.863 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.GET_OBJECT (2 ms) 2024-09-12T00:37:29.863 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:37:29.863 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:37:29.863 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:37:29.863 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:37:29.863 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:37:29.863 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:37:29.863 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:37:29.864 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:37:29.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:37:29.864+0000 7eff20d428c0 -1 shutting down 2024-09-12T00:37:29.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:37:29.865+0000 7efdf8d47640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69223, si_uid : 1000, si_addr0x3e800010e67, si_status0 2024-09-12T00:37:59.980 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (30116 ms) 2024-09-12T00:37:59.980 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 19 tests from LibRGW (30561 ms total) 2024-09-12T00:37:59.981 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:37:59.981 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:37:59.981 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 19 tests from 1 test suite ran. (30561 ms total) 2024-09-12T00:37:59.981 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 19 tests. 2024-09-12T00:37:59.986 INFO:tasks.workunit.client.0.smithi019.stdout:phase 5.2 2024-09-12T00:38:00.020 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:38:00.020 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:38:00.020 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:38:00.020 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:38:00.028 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:00.028 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:00.425 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (405 ms) 2024-09-12T00:38:00.425 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:38:00.426 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:38:00.426 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:38:00.426 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:38:00.426 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:38:00.432 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (6 ms) 2024-09-12T00:38:00.432 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:38:00.432 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:38:00.432 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:38:00.432 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:38:00.433 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:38:00.434 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:38:00.434 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:38:00.434 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:38:00.434 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:38:00.435 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-12T00:38:00.436 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:38:00.470 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.DELETE_BUCKET (34 ms) 2024-09-12T00:38:00.470 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:38:00.470 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:38:00.470 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:38:00.471 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:38:00.471 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:38:00.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:38:00.470+0000 7fb6649208c0 -1 shutting down 2024-09-12T00:38:00.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:38:00.472+0000 7fb53c775640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 69855, si_uid : 1000, si_addr0x3e8000110df, si_status0 2024-09-12T00:38:30.582 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (30112 ms) 2024-09-12T00:38:30.583 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 19 tests from LibRGW (30562 ms total) 2024-09-12T00:38:30.583 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:38:30.583 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:38:30.583 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 19 tests from 1 test suite ran. (30562 ms total) 2024-09-12T00:38:30.583 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 19 tests. 2024-09-12T00:38:30.588 INFO:tasks.workunit.client.0.smithi019.stdout:phase 6.1 2024-09-12T00:38:30.614 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:38:30.614 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment set-up. 2024-09-12T00:38:30.615 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:38:30.615 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:38:30.622 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:30.622 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:31.016 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.INIT (402 ms) 2024-09-12T00:38:31.016 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:38:31.017 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:38:31.017 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:38:31.039 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CREATE_BUCKETS (22 ms) 2024-09-12T00:38:31.039 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:38:31.047 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (8 ms) 2024-09-12T00:38:31.047 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:38:31.065 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.TOPDIR_RENAME (18 ms) 2024-09-12T00:38:31.065 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:38:31.089 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SUBDIR_RENAME (24 ms) 2024-09-12T00:38:31.089 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:38:31.109 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (21 ms) 2024-09-12T00:38:31.110 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:38:31.110 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:38:31.110 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:38:31.110 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:38:31.110 INFO:tasks.workunit.client.0.smithi019.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:38:31.110 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:38:31.111+0000 7fb53d6bf8c0 -1 shutting down 2024-09-12T00:38:31.111 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:38:31.112+0000 7fb414604640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 70475, si_uid : 1000, si_addr0x3e80001134b, si_status0 2024-09-12T00:39:01.353 INFO:tasks.workunit.client.0.smithi019.stdout:[ OK ] LibRGW.SHUTDOWN (30242 ms) 2024-09-12T00:39:01.354 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] 10 tests from LibRGW (30739 ms total) 2024-09-12T00:39:01.354 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:39:01.354 INFO:tasks.workunit.client.0.smithi019.stdout:[----------] Global test environment tear-down 2024-09-12T00:39:01.354 INFO:tasks.workunit.client.0.smithi019.stdout:[==========] 10 tests from 1 test suite ran. (30739 ms total) 2024-09-12T00:39:01.354 INFO:tasks.workunit.client.0.smithi019.stdout:[ PASSED ] 10 tests. 2024-09-12T00:39:01.360 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:39:01.361 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:39:01.408 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:39:01.411 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:39:01.411 DEBUG:teuthology.orchestra.run.smithi019:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:39:01.449 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -z ']' 2024-09-12T00:39:01.449 INFO:tasks.workunit.client.0.smithi019.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:39:01.449 INFO:tasks.workunit.client.0.smithi019.stderr:+ AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:39:01.449 INFO:tasks.workunit.client.0.smithi019.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:39:01.449 INFO:tasks.workunit.client.0.smithi019.stderr:+ AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:39:01.449 INFO:tasks.workunit.client.0.smithi019.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name 'maven test user' --email sigv4@example.com 2024-09-12T00:39:01.488 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:01.488 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:01.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.532+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.533+0000 7fe378c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:01.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.533+0000 7fe378c2f800 20 realm 2024-09-12T00:39:01.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.533+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.533+0000 7fe378c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:01.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.533+0000 7fe378c2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:01.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.533+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.534+0000 7fe378c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:01.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.534+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.534+0000 7fe378c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:01.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.534+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.535+0000 7fe378c2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:01.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.535+0000 7fe378c2f800 20 searching for the correct realm 2024-09-12T00:39:01.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.537+0000 7fe376f1a640 0 -- 172.21.15.19:0/515963360 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7fe36c07b070 msgr2=0x7fe36c090040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:01.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.540+0000 7fe375f18640 0 -- 172.21.15.19:0/515963360 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5642cca73e60 msgr2=0x5642cca762a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.547+0000 7fe378c2f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:39:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.547+0000 7fe378c2f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:39:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.547+0000 7fe378c2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.547+0000 7fe378c2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.547+0000 7fe378c2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.547+0000 7fe378c2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.547+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.547+0000 7fe378c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:01.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.547+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:01.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:01.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 20 zone default found 2024-09-12T00:39:01.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 4 Realm: () 2024-09-12T00:39:01.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:39:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:39:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 20 zonegroup default 2024-09-12T00:39:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.548+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.549+0000 7fe378c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.549+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.549+0000 7fe378c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.549+0000 7fe378c2f800 20 started sync module instance, tier type = 2024-09-12T00:39:01.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.549+0000 7fe378c2f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:39:01.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.559+0000 7fe378c2f800 20 add_watcher() i=0 2024-09-12T00:39:01.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.559+0000 7fe378c2f800 20 add_watcher() i=1 2024-09-12T00:39:01.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.559+0000 7fe378c2f800 20 add_watcher() i=2 2024-09-12T00:39:01.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.559+0000 7fe378c2f800 20 add_watcher() i=3 2024-09-12T00:39:01.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.559+0000 7fe378c2f800 20 add_watcher() i=4 2024-09-12T00:39:01.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.559+0000 7fe378c2f800 20 add_watcher() i=5 2024-09-12T00:39:01.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.559+0000 7fe378c2f800 20 add_watcher() i=6 2024-09-12T00:39:01.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.560+0000 7fe378c2f800 20 add_watcher() i=7 2024-09-12T00:39:01.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.560+0000 7fe378c2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:01.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.562+0000 7fe22cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:01.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.563+0000 7fe378c2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:01.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.563+0000 7fe378c2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:01.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.563+0000 7fe378c2f800 5 note: GC not initialized 2024-09-12T00:39:01.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.563+0000 7fe1a77fe640 20 reqs_thread_entry: start 2024-09-12T00:39:01.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.563+0000 7fe378c2f800 20 init_complete bucket index max shards: 11 2024-09-12T00:39:01.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.563+0000 7fe378c2f800 20 Filter name: none 2024-09-12T00:39:01.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.563+0000 7fe1a57fa640 20 reqs_thread_entry: start 2024-09-12T00:39:01.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.563+0000 7fe378c2f800 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:39:01.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.563+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:01.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:39:01.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 20 rados->read ofs=0 len=0 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.564+0000 7fe378c2f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:39:01.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.565+0000 7fe378c2f800 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:39:01.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.566+0000 7fe378c2f800 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:39:01.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.566+0000 7fe378c2f800 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:39:01.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.566+0000 7fe378c2f800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:39:01.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.567+0000 7fe259ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693246 cookie 94844901409344 notifier 5486 bl.length()=677 2024-09-12T00:39:01.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.567+0000 7fe259ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:39:01.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.567+0000 7fe259ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:39:01.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.570+0000 7fe378c2f800 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:39:01.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.570+0000 7fe378c2f800 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:39:01.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.570+0000 7fe378c2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:39:01.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.570+0000 7fe259ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693193 cookie 94844901393088 notifier 5486 bl.length()=187 2024-09-12T00:39:01.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.570+0000 7fe259ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:39:01.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.570+0000 7fe259ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:39:01.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.573+0000 7fe378c2f800 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:39:01.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.573+0000 7fe378c2f800 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:39:01.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.573+0000 7fe378c2f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:39:01.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.573+0000 7fe259ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693194 cookie 94844901393088 notifier 5486 bl.length()=197 2024-09-12T00:39:01.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.573+0000 7fe259ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:39:01.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.573+0000 7fe259ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout: "display_name": "maven test user", 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout: "email": "sigv4@example.com", 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout: "suspended": 0, 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout: "max_buckets": 1000, 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout: "subusers": [], 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout: "keys": [ 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout: { 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout: "user": "ceph-test-maven", 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:39:01.573 INFO:tasks.workunit.client.0.smithi019.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "active": true, 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "create_date": "2024-09-12T00:39:01.565688Z" 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: ], 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "swift_keys": [], 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "caps": [], 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "default_placement": "", 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "default_storage_class": "", 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "placement_tags": [], 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_quota": { 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "enabled": false, 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:39:01.574 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size": -1, 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "max_objects": -1 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "user_quota": { 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "enabled": false, 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size": -1, 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "max_objects": -1 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "temp_url_keys": [], 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "type": "rgw", 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "mfa_ids": [], 2024-09-12T00:39:01.575 INFO:tasks.workunit.client.0.smithi019.stdout: "account_id": "", 2024-09-12T00:39:01.576 INFO:tasks.workunit.client.0.smithi019.stdout: "path": "/", 2024-09-12T00:39:01.576 INFO:tasks.workunit.client.0.smithi019.stdout: "create_date": "2024-09-12T00:39:01.565619Z", 2024-09-12T00:39:01.576 INFO:tasks.workunit.client.0.smithi019.stdout: "tags": [], 2024-09-12T00:39:01.576 INFO:tasks.workunit.client.0.smithi019.stdout: "group_ids": [] 2024-09-12T00:39:01.576 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:39:01.576 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:39:01.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.575+0000 7fe22cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:01.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.578+0000 7fe378c2f800 20 remove_watcher() i=0 2024-09-12T00:39:01.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.578+0000 7fe378c2f800 2 removed watcher, disabling cache 2024-09-12T00:39:01.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.579+0000 7fe378c2f800 20 remove_watcher() i=1 2024-09-12T00:39:01.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.580+0000 7fe378c2f800 20 remove_watcher() i=2 2024-09-12T00:39:01.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.581+0000 7fe378c2f800 20 remove_watcher() i=3 2024-09-12T00:39:01.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.582+0000 7fe378c2f800 20 remove_watcher() i=4 2024-09-12T00:39:01.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.583+0000 7fe378c2f800 20 remove_watcher() i=5 2024-09-12T00:39:01.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.584+0000 7fe378c2f800 20 remove_watcher() i=6 2024-09-12T00:39:01.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:39:01.585+0000 7fe378c2f800 20 remove_watcher() i=7 2024-09-12T00:39:01.595 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -z ']' 2024-09-12T00:39:01.595 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -z /home/ubuntu/cephtest ']' 2024-09-12T00:39:01.595 INFO:tasks.workunit.client.0.smithi019.stderr:++ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:39:01.596 INFO:tasks.workunit.client.0.smithi019.stderr:+ export RGW_HTTP_ENDPOINT_URL=https://smithi019.front.sepia.ceph.com:443 2024-09-12T00:39:01.596 INFO:tasks.workunit.client.0.smithi019.stderr:+ RGW_HTTP_ENDPOINT_URL=https://smithi019.front.sepia.ceph.com:443 2024-09-12T00:39:01.596 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -z /home/ubuntu/cephtest/clone.client.0 ']' 2024-09-12T00:39:01.596 INFO:tasks.workunit.client.0.smithi019.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:39:01.596 INFO:tasks.workunit.client.0.smithi019.stderr:+ ./mvnw clean package 2024-09-12T00:39:01.605 INFO:tasks.workunit.client.0.smithi019.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:39:03.145 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Scanning for projects... 2024-09-12T00:39:03.270 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:39:03.364 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 58 kB/s) 2024-09-12T00:39:03.380 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:39:03.422 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/83 kB Progress (1): 33/83 kB Progress (1): 49/83 kB Progress (1): 66/83 kB Progress (1): 82/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-12T00:39:03.433 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:39:03.457 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/77 kB Progress (1): 32/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.1 MB/s) 2024-09-12T00:39:03.490 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:03.490 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:39:03.490 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:39:03.490 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] from pom.xml 2024-09-12T00:39:03.490 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:39:03.493 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:39:03.509 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 332 kB/s) 2024-09-12T00:39:03.515 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:39:03.532 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 619 kB/s) 2024-09-12T00:39:03.535 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:39:03.555 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.3 MB/s) 2024-09-12T00:39:03.561 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:39:03.578 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 15/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.2 MB/s) 2024-09-12T00:39:03.589 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:39:03.619 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 1.2 MB/s) 2024-09-12T00:39:03.627 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:39:03.647 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 429 kB/s) 2024-09-12T00:39:03.649 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:39:03.664 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 506 kB/s) 2024-09-12T00:39:03.667 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:39:03.686 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.5 MB/s) 2024-09-12T00:39:03.692 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:39:03.713 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 15/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 987 kB/s) 2024-09-12T00:39:03.719 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:39:03.738 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.7 MB/s) 2024-09-12T00:39:03.746 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:39:03.765 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 517 kB/s) 2024-09-12T00:39:03.770 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:39:03.789 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 3.5 MB/s) 2024-09-12T00:39:03.796 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:39:03.818 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 222 kB/s) 2024-09-12T00:39:03.821 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:39:03.837 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.4 MB/s) 2024-09-12T00:39:03.840 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:39:03.864 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.1 MB/s) 2024-09-12T00:39:03.868 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:39:03.884 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.5 MB/s) 2024-09-12T00:39:03.889 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:39:03.904 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 375 kB/s) 2024-09-12T00:39:03.908 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:39:03.926 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 2.5 MB/s) 2024-09-12T00:39:03.933 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:39:03.951 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 356 kB/s) 2024-09-12T00:39:03.954 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:39:03.983 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 330 kB/s) 2024-09-12T00:39:03.985 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:39:04.001 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/46 kB Progress (1): 33/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 3.0 MB/s) 2024-09-12T00:39:04.004 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:39:04.019 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 1.3 MB/s) 2024-09-12T00:39:04.024 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:39:04.042 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.5 MB/s) 2024-09-12T00:39:04.056 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:39:04.072 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 358 kB/s) 2024-09-12T00:39:04.074 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:39:04.092 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.2 MB/s) 2024-09-12T00:39:04.097 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:39:04.113 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.2 MB/s) 2024-09-12T00:39:04.121 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:39:04.143 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 182 kB/s) 2024-09-12T00:39:04.144 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:39:04.161 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 97 kB/s) 2024-09-12T00:39:04.163 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:39:04.180 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 131 kB/s) 2024-09-12T00:39:04.184 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:39:04.201 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 227 kB/s) 2024-09-12T00:39:04.205 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:39:04.222 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 201 kB/s) 2024-09-12T00:39:04.226 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:39:04.243 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 609 kB/s) 2024-09-12T00:39:04.248 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:39:04.263 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 105 kB/s) 2024-09-12T00:39:04.267 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:39:04.291 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 153 kB/s) 2024-09-12T00:39:04.295 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:39:04.311 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 289 kB/s) 2024-09-12T00:39:04.314 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:39:04.338 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 50 kB/s) 2024-09-12T00:39:04.340 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:39:04.355 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 274 kB/s) 2024-09-12T00:39:04.357 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:39:04.373 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 863 kB/s) 2024-09-12T00:39:04.376 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:39:04.392 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 230 kB/s) 2024-09-12T00:39:04.396 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:39:04.414 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 136 kB/s) 2024-09-12T00:39:04.417 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:39:04.433 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 182 kB/s) 2024-09-12T00:39:04.437 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:39:04.452 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 494 kB/s) 2024-09-12T00:39:04.455 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:39:04.471 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 341 kB/s) 2024-09-12T00:39:04.475 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:39:04.490 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 233 kB/s) 2024-09-12T00:39:04.494 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:39:04.512 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 244 kB/s) 2024-09-12T00:39:04.514 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:39:04.531 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 142 kB/s) 2024-09-12T00:39:04.534 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:39:04.552 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 339 kB/s) 2024-09-12T00:39:04.556 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:39:04.575 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 303 kB/s) 2024-09-12T00:39:04.579 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:39:04.595 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 186 kB/s) 2024-09-12T00:39:04.599 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:39:04.617 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 193 kB/s) 2024-09-12T00:39:04.620 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:39:04.636 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 272 kB/s) 2024-09-12T00:39:04.638 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:39:04.654 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 111 kB/s) 2024-09-12T00:39:04.658 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:39:04.672 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 472 kB/s) 2024-09-12T00:39:04.674 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:39:04.693 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 862 kB/s) 2024-09-12T00:39:04.695 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:39:04.711 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 2.2 MB/s) 2024-09-12T00:39:04.714 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:39:04.730 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 1.0 MB/s) 2024-09-12T00:39:04.735 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:39:04.751 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 292 kB/s) 2024-09-12T00:39:04.754 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:39:04.770 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 823 kB/s) 2024-09-12T00:39:04.774 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:39:04.791 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 776 kB/s) 2024-09-12T00:39:04.794 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:39:04.811 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 37/68 kB Progress (1): 53/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 4.0 MB/s) 2024-09-12T00:39:04.817 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:39:04.831 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 1.0 MB/s) 2024-09-12T00:39:04.835 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:39:04.852 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 908 kB/s) 2024-09-12T00:39:04.854 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:39:04.870 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.7 MB/s) 2024-09-12T00:39:04.874 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:39:04.889 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 1.2 MB/s) 2024-09-12T00:39:04.892 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:39:04.915 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 908 kB/s) 2024-09-12T00:39:04.917 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:39:04.936 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 4.3 MB/s) 2024-09-12T00:39:04.941 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:39:04.957 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 256 kB/s) 2024-09-12T00:39:04.959 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:39:04.976 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 812 kB/s) 2024-09-12T00:39:04.978 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:39:04.999 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 160 kB/s) 2024-09-12T00:39:05.001 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:39:05.019 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 177 kB/s) 2024-09-12T00:39:05.021 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:39:05.036 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 136 kB/s) 2024-09-12T00:39:05.038 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:39:05.054 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 177 kB/s) 2024-09-12T00:39:05.056 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:39:05.072 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 90 kB/s) 2024-09-12T00:39:05.074 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:39:05.091 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 188 kB/s) 2024-09-12T00:39:05.093 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:39:05.109 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 214 kB/s) 2024-09-12T00:39:05.111 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:39:05.127 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 200 kB/s) 2024-09-12T00:39:05.129 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:39:05.145 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 68 kB/s) 2024-09-12T00:39:05.149 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:39:05.164 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 60 kB/s) 2024-09-12T00:39:05.167 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:39:05.183 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 203 kB/s) 2024-09-12T00:39:05.186 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:39:05.201 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 190 kB/s) 2024-09-12T00:39:05.203 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:39:05.222 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T00:39:05.224 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:39:05.239 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 229 kB/s) 2024-09-12T00:39:05.241 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:39:05.258 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 178 kB/s) 2024-09-12T00:39:05.275 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:39:05.373 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 34 MB/s) 2024-09-12T00:39:05.375 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:39:05.375 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:39:05.375 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:39:05.375 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:39:05.375 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:39:05.396 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/98 kB Progress (1): 32/98 kB Progress (1): 49/98 kB Progress (1): 65/98 kB Progress (1): 81/98 kB Progress (1): 98/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 4.3 MB/s) 2024-09-12T00:39:05.396 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:39:05.429 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.4/35 kB Progress (2): 1.4/35 kB | 1.4/49 kB Progress (3): 1.4/35 kB | 1.4/49 kB | 1.4/71 kB Progress (3): 2.8/35 kB | 1.4/49 kB | 1.4/71 kB Progress (3): 2.8/35 kB | 1.4/49 kB | 2.8/71 kB Progress (3): 2.8/35 kB | 2.8/49 kB | 2.8/71 kB Progress (3): 4.1/35 kB | 2.8/49 kB | 2.8/71 kB Progress (3): 4.1/35 kB | 4.1/49 kB | 2.8/71 kB Progress (3): 4.1/35 kB | 4.1/49 kB | 4.1/71 kB Progress (3): 4.1/35 kB | 5.5/49 kB | 4.1/71 kB Progress (3): 5.5/35 kB | 5.5/49 kB | 4.1/71 kB Progress (3): 5.5/35 kB | 6.9/49 kB | 4.1/71 kB Progress (3): 5.5/35 kB | 6.9/49 kB | 5.5/71 kB Progress (4): 5.5/35 kB | 6.9/49 kB | 5.5/71 kB | 1.4/16 kB Progress (4): 5.5/35 kB | 6.9/49 kB | 6.9/71 kB | 1.4/16 kB Progress (4): 5.5/35 kB | 8.3/49 kB | 6.9/71 kB | 1.4/16 kB Progress (4): 6.9/35 kB | 8.3/49 kB | 6.9/71 kB | 1.4/16 kB Progress (4): 6.9/35 kB | 9.7/49 kB | 6.9/71 kB | 1.4/16 kB Progress (4): 8.3/35 kB | 9.7/49 kB | 6.9/71 kB | 1.4/16 kB Progress (4): 8.3/35 kB | 9.7/49 kB | 8.3/71 kB | 1.4/16 kB Progress (4): 8.3/35 kB | 9.7/49 kB | 8.3/71 kB | 2.8/16 kB Progress (4): 8.3/35 kB | 9.7/49 kB | 9.7/71 kB | 2.8/16 kB Progress (4): 9.7/35 kB | 9.7/49 kB | 9.7/71 kB | 2.8/16 kB Progress (4): 9.7/35 kB | 11/49 kB | 9.7/71 kB | 2.8/16 kB Progress (4): 11/35 kB | 11/49 kB | 9.7/71 kB | 2.8/16 kB Progress (4): 11/35 kB | 11/49 kB | 11/71 kB | 2.8/16 kB Progress (4): 11/35 kB | 11/49 kB | 11/71 kB | 4.1/16 kB Progress (4): 11/35 kB | 11/49 kB | 12/71 kB | 4.1/16 kB Progress (4): 12/35 kB | 11/49 kB | 12/71 kB | 4.1/16 kB Progress (4): 12/35 kB | 12/49 kB | 12/71 kB | 4.1/16 kB Progress (4): 14/35 kB | 12/49 kB | 12/71 kB | 4.1/16 kB Progress (4): 14/35 kB | 12/49 kB | 14/71 kB | 4.1/16 kB Progress (4): 14/35 kB | 12/49 kB | 14/71 kB | 5.5/16 kB Progress (4): 14/35 kB | 12/49 kB | 15/71 kB | 5.5/16 kB Progress (4): 15/35 kB | 12/49 kB | 15/71 kB | 5.5/16 kB Progress (4): 15/35 kB | 14/49 kB | 15/71 kB | 5.5/16 kB Progress (4): 16/35 kB | 14/49 kB | 15/71 kB | 5.5/16 kB Progress (4): 16/35 kB | 14/49 kB | 16/71 kB | 5.5/16 kB Progress (4): 16/35 kB | 14/49 kB | 16/71 kB | 6.9/16 kB Progress (4): 17/35 kB | 14/49 kB | 16/71 kB | 6.9/16 kB Progress (4): 17/35 kB | 15/49 kB | 16/71 kB | 6.9/16 kB Progress (4): 19/35 kB | 15/49 kB | 16/71 kB | 6.9/16 kB Progress (4): 19/35 kB | 15/49 kB | 16/71 kB | 8.3/16 kB Progress (4): 20/35 kB | 15/49 kB | 16/71 kB | 8.3/16 kB Progress (4): 20/35 kB | 16/49 kB | 16/71 kB | 8.3/16 kB Progress (4): 21/35 kB | 16/49 kB | 16/71 kB | 8.3/16 kB Progress (4): 21/35 kB | 16/49 kB | 16/71 kB | 9.7/16 kB Progress (4): 23/35 kB | 16/49 kB | 16/71 kB | 9.7/16 kB Progress (4): 23/35 kB | 17/49 kB | 16/71 kB | 9.7/16 kB Progress (4): 24/35 kB | 17/49 kB | 16/71 kB | 9.7/16 kB Progress (4): 24/35 kB | 17/49 kB | 16/71 kB | 11/16 kB Progress (4): 25/35 kB | 17/49 kB | 16/71 kB | 11/16 kB Progress (4): 25/35 kB | 19/49 kB | 16/71 kB | 11/16 kB Progress (4): 27/35 kB | 19/49 kB | 16/71 kB | 11/16 kB Progress (4): 27/35 kB | 19/49 kB | 16/71 kB | 12/16 kB Progress (4): 27/35 kB | 20/49 kB | 16/71 kB | 12/16 kB Progress (4): 28/35 kB | 20/49 kB | 16/71 kB | 12/16 kB Progress (4): 28/35 kB | 21/49 kB | 16/71 kB | 12/16 kB Progress (4): 28/35 kB | 21/49 kB | 16/71 kB | 14/16 kB Progress (4): 30/35 kB | 21/49 kB | 16/71 kB | 14/16 kB Progress (4): 30/35 kB | 23/49 kB | 16/71 kB | 14/16 kB Progress (4): 30/35 kB | 23/49 kB | 16/71 kB | 15/16 kB Progress (4): 30/35 kB | 24/49 kB | 16/71 kB | 15/16 kB Progress (4): 30/35 kB | 24/49 kB | 16/71 kB | 16 kB Progress (4): 30/35 kB | 25/49 kB | 16/71 kB | 16 kB Progress (4): 30/35 kB | 27/49 kB | 16/71 kB | 16 kB Progress (4): 30/35 kB | 28/49 kB | 16/71 kB | 16 kB Progress (4): 30/35 kB | 30/49 kB | 16/71 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 310 kB/s) 2024-09-12T00:39:05.429 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:39:05.433 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (3): 30/35 kB | 31/49 kB | 16/71 kB Progress (3): 30/35 kB | 32/49 kB | 16/71 kB Progress (3): 30/35 kB | 32/49 kB | 32/71 kB Progress (3): 30/35 kB | 34/49 kB | 32/71 kB Progress (3): 31/35 kB | 34/49 kB | 32/71 kB Progress (3): 31/35 kB | 35/49 kB | 32/71 kB Progress (3): 32/35 kB | 35/49 kB | 32/71 kB Progress (3): 32/35 kB | 36/49 kB | 32/71 kB Progress (3): 34/35 kB | 36/49 kB | 32/71 kB Progress (3): 34/35 kB | 38/49 kB | 32/71 kB Progress (3): 35/35 kB | 38/49 kB | 32/71 kB Progress (3): 35/35 kB | 39/49 kB | 32/71 kB Progress (3): 35 kB | 39/49 kB | 32/71 kB Progress (3): 35 kB | 41/49 kB | 32/71 kB Progress (3): 35 kB | 42/49 kB | 32/71 kB Progress (3): 35 kB | 43/49 kB | 32/71 kB Progress (3): 35 kB | 45/49 kB | 32/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 617 kB/s) 2024-09-12T00:39:05.433 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:39:05.433 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 45/49 kB | 49/71 kB Progress (2): 46/49 kB | 49/71 kB Progress (2): 48/49 kB | 49/71 kB Progress (2): 49/49 kB | 49/71 kB Progress (2): 49 kB | 49/71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 834 kB/s) 2024-09-12T00:39:05.434 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:39:05.444 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 65/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.0 MB/s) 2024-09-12T00:39:05.444 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:39:05.452 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/782 kB Progress (2): 16/782 kB | 1.4/11 kB Progress (2): 16/782 kB | 2.8/11 kB Progress (2): 16/782 kB | 4.1/11 kB Progress (2): 16/782 kB | 5.5/11 kB Progress (2): 16/782 kB | 6.9/11 kB Progress (2): 16/782 kB | 8.3/11 kB Progress (3): 16/782 kB | 8.3/11 kB | 1.4/205 kB Progress (3): 16/782 kB | 9.7/11 kB | 1.4/205 kB Progress (3): 16/782 kB | 9.7/11 kB | 2.8/205 kB Progress (3): 16/782 kB | 11/11 kB | 2.8/205 kB Progress (3): 16/782 kB | 11/11 kB | 4.1/205 kB Progress (3): 16/782 kB | 11 kB | 4.1/205 kB Progress (3): 16/782 kB | 11 kB | 5.5/205 kB Progress (3): 16/782 kB | 11 kB | 6.9/205 kB Progress (3): 16/782 kB | 11 kB | 8.3/205 kB Progress (3): 16/782 kB | 11 kB | 9.7/205 kB Progress (3): 16/782 kB | 11 kB | 11/205 kB Progress (3): 16/782 kB | 11 kB | 12/205 kB Progress (3): 16/782 kB | 11 kB | 14/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 152 kB/s) 2024-09-12T00:39:05.452 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 16/782 kB | 15/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:39:05.455 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 16/782 kB | 16/205 kB Progress (2): 16/782 kB | 32/205 kB Progress (3): 16/782 kB | 32/205 kB | 16/16 kB Progress (3): 16/782 kB | 32/205 kB | 16 kB Progress (3): 33/782 kB | 32/205 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 200 kB/s) 2024-09-12T00:39:05.455 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:39:05.461 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 49/782 kB | 32/205 kB Progress (2): 66/782 kB | 32/205 kB Progress (3): 66/782 kB | 32/205 kB | 16/30 kB Progress (3): 82/782 kB | 32/205 kB | 16/30 kB Progress (3): 82/782 kB | 32/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 355 kB/s) 2024-09-12T00:39:05.461 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:39:05.478 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 82/782 kB | 49/205 kB Progress (2): 82/782 kB | 65/205 kB Progress (2): 82/782 kB | 81/205 kB Progress (2): 82/782 kB | 98/205 kB Progress (2): 82/782 kB | 114/205 kB Progress (2): 98/782 kB | 114/205 kB Progress (2): 98/782 kB | 130/205 kB Progress (2): 115/782 kB | 130/205 kB Progress (2): 131/782 kB | 130/205 kB Progress (2): 147/782 kB | 130/205 kB Progress (2): 164/782 kB | 130/205 kB Progress (2): 180/782 kB | 130/205 kB Progress (2): 197/782 kB | 130/205 kB Progress (2): 213/782 kB | 130/205 kB Progress (2): 213/782 kB | 147/205 kB Progress (2): 229/782 kB | 147/205 kB Progress (2): 229/782 kB | 163/205 kB Progress (3): 229/782 kB | 163/205 kB | 16/798 kB Progress (3): 229/782 kB | 180/205 kB | 16/798 kB Progress (3): 229/782 kB | 180/205 kB | 32/798 kB Progress (3): 229/782 kB | 180/205 kB | 49/798 kB Progress (3): 229/782 kB | 180/205 kB | 65/798 kB Progress (3): 229/782 kB | 196/205 kB | 65/798 kB Progress (3): 229/782 kB | 196/205 kB | 81/798 kB Progress (3): 229/782 kB | 205 kB | 81/798 kB Progress (3): 229/782 kB | 205 kB | 98/798 kB Progress (3): 229/782 kB | 205 kB | 114/798 kB Progress (3): 229/782 kB | 205 kB | 130/798 kB Progress (3): 229/782 kB | 205 kB | 147/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 2.0 MB/s) 2024-09-12T00:39:05.478 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (3): 229/782 kB | 147/798 kB | 13 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:39:05.478 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (3): 229/782 kB | 163/798 kB | 13 kB Progress (3): 229/782 kB | 180/798 kB | 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 131 kB/s) 2024-09-12T00:39:05.478 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:39:05.492 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 229/782 kB | 196/798 kB Progress (2): 229/782 kB | 212/798 kB Progress (2): 229/782 kB | 229/798 kB Progress (2): 246/782 kB | 229/798 kB Progress (2): 256/782 kB | 229/798 kB Progress (2): 256/782 kB | 245/798 kB Progress (2): 256/782 kB | 262/798 kB Progress (2): 272/782 kB | 262/798 kB Progress (2): 272/782 kB | 278/798 kB Progress (2): 289/782 kB | 278/798 kB Progress (2): 289/782 kB | 294/798 kB Progress (2): 305/782 kB | 294/798 kB Progress (2): 305/782 kB | 311/798 kB Progress (2): 305/782 kB | 327/798 kB Progress (2): 321/782 kB | 327/798 kB Progress (2): 321/782 kB | 343/798 kB Progress (2): 321/782 kB | 360/798 kB Progress (2): 338/782 kB | 360/798 kB Progress (2): 338/782 kB | 376/798 kB Progress (2): 354/782 kB | 376/798 kB Progress (2): 354/782 kB | 393/798 kB Progress (2): 370/782 kB | 393/798 kB Progress (2): 370/782 kB | 402/798 kB Progress (2): 387/782 kB | 402/798 kB Progress (2): 387/782 kB | 418/798 kB Progress (2): 387/782 kB | 435/798 kB Progress (2): 403/782 kB | 435/798 kB Progress (2): 403/782 kB | 451/798 kB Progress (2): 420/782 kB | 451/798 kB Progress (2): 420/782 kB | 468/798 kB Progress (2): 436/782 kB | 468/798 kB Progress (2): 436/782 kB | 484/798 kB Progress (2): 452/782 kB | 484/798 kB Progress (2): 452/782 kB | 500/798 kB Progress (2): 469/782 kB | 500/798 kB Progress (2): 469/782 kB | 517/798 kB Progress (2): 485/782 kB | 517/798 kB Progress (2): 485/782 kB | 533/798 kB Progress (2): 502/782 kB | 533/798 kB Progress (2): 502/782 kB | 549/798 kB Progress (2): 502/782 kB | 566/798 kB Progress (2): 502/782 kB | 582/798 kB Progress (3): 502/782 kB | 582/798 kB | 16/81 kB Progress (3): 502/782 kB | 599/798 kB | 16/81 kB Progress (3): 502/782 kB | 615/798 kB | 16/81 kB Progress (3): 502/782 kB | 631/798 kB | 16/81 kB Progress (3): 502/782 kB | 648/798 kB | 16/81 kB Progress (3): 502/782 kB | 664/798 kB | 16/81 kB Progress (3): 502/782 kB | 681/798 kB | 16/81 kB Progress (3): 518/782 kB | 681/798 kB | 16/81 kB Progress (3): 518/782 kB | 697/798 kB | 16/81 kB Progress (3): 518/782 kB | 713/798 kB | 16/81 kB Progress (3): 518/782 kB | 730/798 kB | 16/81 kB Progress (3): 518/782 kB | 730/798 kB | 32/81 kB Progress (3): 518/782 kB | 746/798 kB | 32/81 kB Progress (3): 518/782 kB | 762/798 kB | 32/81 kB Progress (3): 534/782 kB | 762/798 kB | 32/81 kB Progress (3): 534/782 kB | 779/798 kB | 32/81 kB Progress (3): 551/782 kB | 779/798 kB | 32/81 kB Progress (3): 551/782 kB | 779/798 kB | 49/81 kB Progress (3): 567/782 kB | 779/798 kB | 49/81 kB Progress (3): 567/782 kB | 795/798 kB | 49/81 kB Progress (3): 567/782 kB | 798 kB | 49/81 kB Progress (3): 583/782 kB | 798 kB | 49/81 kB Progress (3): 600/782 kB | 798 kB | 49/81 kB Progress (3): 616/782 kB | 798 kB | 49/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 6.9 MB/s) 2024-09-12T00:39:05.492 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:39:05.495 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 633/782 kB | 49/81 kB Progress (2): 649/782 kB | 49/81 kB Progress (2): 665/782 kB | 49/81 kB Progress (2): 665/782 kB | 65/81 kB Progress (2): 682/782 kB | 65/81 kB Progress (2): 698/782 kB | 65/81 kB Progress (2): 715/782 kB | 65/81 kB Progress (2): 731/782 kB | 65/81 kB Progress (2): 747/782 kB | 65/81 kB Progress (2): 764/782 kB | 65/81 kB Progress (2): 780/782 kB | 65/81 kB Progress (2): 782 kB | 65/81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 6.5 MB/s) 2024-09-12T00:39:05.495 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:39:05.500 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 65/81 kB | 16/151 kB Progress (2): 65/81 kB | 32/151 kB Progress (2): 65/81 kB | 49/151 kB Progress (3): 65/81 kB | 49/151 kB | 16/182 kB Progress (3): 65/81 kB | 65/151 kB | 16/182 kB Progress (3): 65/81 kB | 81/151 kB | 16/182 kB Progress (3): 65/81 kB | 98/151 kB | 16/182 kB Progress (3): 81 kB | 98/151 kB | 16/182 kB Progress (3): 81 kB | 114/151 kB | 16/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 661 kB/s) 2024-09-12T00:39:05.500 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 130/151 kB | 16/182 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:39:05.500 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 130/151 kB | 32/182 kB Progress (2): 147/151 kB | 32/182 kB Progress (2): 151 kB | 32/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.2 MB/s) 2024-09-12T00:39:05.500 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:39:05.507 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 49/182 kB Progress (1): 65/182 kB Progress (2): 65/182 kB | 16/27 kB Progress (2): 65/182 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 208 kB/s) 2024-09-12T00:39:05.507 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:39:05.511 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 81/182 kB Progress (1): 98/182 kB Progress (1): 114/182 kB Progress (2): 114/182 kB | 16/30 kB Progress (2): 114/182 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 223 kB/s) 2024-09-12T00:39:05.512 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:39:05.514 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 130/182 kB Progress (1): 147/182 kB Progress (1): 163/182 kB Progress (1): 180/182 kB Progress (1): 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.3 MB/s) 2024-09-12T00:39:05.515 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:39:05.518 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 94 kB/s) 2024-09-12T00:39:05.518 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:39:05.538 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/780 kB Progress (1): 33/780 kB Progress (1): 49/780 kB Progress (1): 65/780 kB Progress (1): 81/780 kB Progress (1): 98/780 kB Progress (1): 114/780 kB Progress (1): 131/780 kB Progress (1): 147/780 kB Progress (1): 163/780 kB Progress (1): 180/780 kB Progress (1): 196/780 kB Progress (1): 213/780 kB Progress (1): 229/780 kB Progress (1): 245/780 kB Progress (1): 262/780 kB Progress (1): 278/780 kB Progress (1): 294/780 kB Progress (1): 311/780 kB Progress (1): 327/780 kB Progress (1): 344/780 kB Progress (1): 360/780 kB Progress (1): 376/780 kB Progress (1): 393/780 kB Progress (1): 409/780 kB Progress (1): 426/780 kB Progress (1): 442/780 kB Progress (1): 458/780 kB Progress (1): 475/780 kB Progress (1): 491/780 kB Progress (2): 491/780 kB | 16/329 kB Progress (2): 507/780 kB | 16/329 kB Progress (2): 507/780 kB | 32/329 kB Progress (2): 524/780 kB | 32/329 kB Progress (2): 540/780 kB | 32/329 kB Progress (2): 540/780 kB | 49/329 kB Progress (3): 540/780 kB | 49/329 kB | 16/75 kB Progress (3): 557/780 kB | 49/329 kB | 16/75 kB Progress (3): 557/780 kB | 65/329 kB | 16/75 kB Progress (3): 573/780 kB | 65/329 kB | 16/75 kB Progress (3): 573/780 kB | 81/329 kB | 16/75 kB Progress (3): 589/780 kB | 81/329 kB | 16/75 kB Progress (3): 589/780 kB | 81/329 kB | 32/75 kB Progress (3): 589/780 kB | 98/329 kB | 32/75 kB Progress (3): 606/780 kB | 98/329 kB | 32/75 kB Progress (3): 610/780 kB | 98/329 kB | 32/75 kB Progress (3): 610/780 kB | 98/329 kB | 49/75 kB Progress (3): 610/780 kB | 114/329 kB | 49/75 kB Progress (3): 626/780 kB | 114/329 kB | 49/75 kB Progress (3): 626/780 kB | 114/329 kB | 65/75 kB Progress (3): 626/780 kB | 114/329 kB | 75 kB Progress (3): 643/780 kB | 114/329 kB | 75 kB Progress (3): 643/780 kB | 130/329 kB | 75 kB Progress (3): 655/780 kB | 130/329 kB | 75 kB Progress (3): 655/780 kB | 147/329 kB | 75 kB Progress (3): 671/780 kB | 147/329 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 472 kB/s) 2024-09-12T00:39:05.539 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 671/780 kB | 163/329 kB Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:39:05.539 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 688/780 kB | 163/329 kB Progress (2): 688/780 kB | 180/329 kB Progress (2): 704/780 kB | 180/329 kB Progress (2): 704/780 kB | 196/329 kB Progress (2): 720/780 kB | 196/329 kB Progress (2): 737/780 kB | 196/329 kB Progress (2): 753/780 kB | 196/329 kB Progress (2): 753/780 kB | 212/329 kB Progress (2): 770/780 kB | 212/329 kB Progress (2): 780 kB | 212/329 kB Progress (2): 780 kB | 229/329 kB Progress (2): 780 kB | 245/329 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 4.8 MB/s) 2024-09-12T00:39:05.539 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:39:05.563 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 245/329 kB | 16/501 kB Progress (2): 262/329 kB | 16/501 kB Progress (2): 262/329 kB | 32/501 kB Progress (2): 278/329 kB | 32/501 kB Progress (3): 278/329 kB | 32/501 kB | 16/41 kB Progress (4): 278/329 kB | 32/501 kB | 16/41 kB | 16/385 kB Progress (4): 278/329 kB | 49/501 kB | 16/41 kB | 16/385 kB Progress (5): 278/329 kB | 49/501 kB | 16/41 kB | 16/385 kB | 16/354 kB Progress (5): 294/329 kB | 49/501 kB | 16/41 kB | 16/385 kB | 16/354 kB Progress (5): 294/329 kB | 49/501 kB | 33/41 kB | 16/385 kB | 16/354 kB Progress (5): 294/329 kB | 49/501 kB | 33/41 kB | 32/385 kB | 16/354 kB Progress (5): 294/329 kB | 65/501 kB | 33/41 kB | 32/385 kB | 16/354 kB Progress (5): 294/329 kB | 65/501 kB | 33/41 kB | 32/385 kB | 33/354 kB Progress (5): 294/329 kB | 65/501 kB | 41 kB | 32/385 kB | 33/354 kB Progress (5): 311/329 kB | 65/501 kB | 41 kB | 32/385 kB | 33/354 kB Progress (5): 311/329 kB | 81/501 kB | 41 kB | 32/385 kB | 33/354 kB Progress (5): 311/329 kB | 81/501 kB | 41 kB | 49/385 kB | 33/354 kB Progress (5): 311/329 kB | 81/501 kB | 41 kB | 49/385 kB | 49/354 kB Progress (5): 327/329 kB | 81/501 kB | 41 kB | 49/385 kB | 49/354 kB Progress (5): 327/329 kB | 98/501 kB | 41 kB | 49/385 kB | 49/354 kB Progress (5): 329 kB | 98/501 kB | 41 kB | 49/385 kB | 49/354 kB Progress (5): 329 kB | 98/501 kB | 41 kB | 65/385 kB | 49/354 kB Progress (5): 329 kB | 98/501 kB | 41 kB | 65/385 kB | 63/354 kB Progress (5): 329 kB | 114/501 kB | 41 kB | 65/385 kB | 63/354 kB Progress (5): 329 kB | 114/501 kB | 41 kB | 81/385 kB | 63/354 kB Progress (5): 329 kB | 114/501 kB | 41 kB | 81/385 kB | 79/354 kB Progress (5): 329 kB | 114/501 kB | 41 kB | 81/385 kB | 96/354 kB Progress (5): 329 kB | 114/501 kB | 41 kB | 98/385 kB | 96/354 kB Progress (5): 329 kB | 114/501 kB | 41 kB | 98/385 kB | 112/354 kB Progress (5): 329 kB | 114/501 kB | 41 kB | 114/385 kB | 112/354 kB Progress (5): 329 kB | 114/501 kB | 41 kB | 130/385 kB | 112/354 kB Progress (5): 329 kB | 114/501 kB | 41 kB | 147/385 kB | 112/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 222 kB/s) 2024-09-12T00:39:05.563 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (4): 329 kB | 114/501 kB | 147/385 kB | 128/354 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.8 MB/s) 2024-09-12T00:39:05.564 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (3): 130/501 kB | 147/385 kB | 128/354 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:39:05.564 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:39:05.568 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (3): 130/501 kB | 147/385 kB | 145/354 kB Progress (3): 147/501 kB | 147/385 kB | 145/354 kB Progress (3): 163/501 kB | 147/385 kB | 145/354 kB Progress (3): 163/501 kB | 147/385 kB | 161/354 kB Progress (3): 180/501 kB | 147/385 kB | 161/354 kB Progress (3): 180/501 kB | 147/385 kB | 177/354 kB Progress (3): 196/501 kB | 147/385 kB | 177/354 kB Progress (3): 196/501 kB | 147/385 kB | 194/354 kB Progress (3): 212/501 kB | 147/385 kB | 194/354 kB Progress (3): 212/501 kB | 147/385 kB | 210/354 kB Progress (3): 229/501 kB | 147/385 kB | 210/354 kB Progress (3): 229/501 kB | 147/385 kB | 227/354 kB Progress (3): 245/501 kB | 147/385 kB | 227/354 kB Progress (3): 245/501 kB | 147/385 kB | 243/354 kB Progress (3): 262/501 kB | 147/385 kB | 243/354 kB Progress (3): 262/501 kB | 147/385 kB | 259/354 kB Progress (3): 278/501 kB | 147/385 kB | 259/354 kB Progress (3): 278/501 kB | 147/385 kB | 276/354 kB Progress (3): 294/501 kB | 147/385 kB | 276/354 kB Progress (3): 294/501 kB | 147/385 kB | 292/354 kB Progress (3): 311/501 kB | 147/385 kB | 292/354 kB Progress (3): 311/501 kB | 147/385 kB | 309/354 kB Progress (3): 327/501 kB | 147/385 kB | 309/354 kB Progress (3): 327/501 kB | 147/385 kB | 325/354 kB Progress (3): 343/501 kB | 147/385 kB | 325/354 kB Progress (3): 343/501 kB | 147/385 kB | 341/354 kB Progress (3): 343/501 kB | 147/385 kB | 354 kB Progress (3): 360/501 kB | 147/385 kB | 354 kB Progress (3): 376/501 kB | 147/385 kB | 354 kB Progress (3): 393/501 kB | 147/385 kB | 354 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.9 MB/s) 2024-09-12T00:39:05.568 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:39:05.572 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 402/501 kB | 147/385 kB Progress (2): 418/501 kB | 147/385 kB Progress (2): 435/501 kB | 147/385 kB Progress (2): 451/501 kB | 147/385 kB Progress (2): 468/501 kB | 147/385 kB Progress (2): 484/501 kB | 147/385 kB Progress (2): 500/501 kB | 147/385 kB Progress (2): 501 kB | 147/385 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.6 MB/s) 2024-09-12T00:39:05.572 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:39:05.579 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 147/385 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 31 kB/s) 2024-09-12T00:39:05.579 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:39:05.592 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 147/385 kB | 16/586 kB Progress (3): 147/385 kB | 16/586 kB | 16/211 kB Progress (3): 147/385 kB | 32/586 kB | 16/211 kB Progress (3): 147/385 kB | 32/586 kB | 33/211 kB Progress (3): 147/385 kB | 49/586 kB | 33/211 kB Progress (3): 163/385 kB | 49/586 kB | 33/211 kB Progress (3): 163/385 kB | 49/586 kB | 49/211 kB Progress (3): 163/385 kB | 65/586 kB | 49/211 kB Progress (3): 180/385 kB | 65/586 kB | 49/211 kB Progress (3): 180/385 kB | 65/586 kB | 66/211 kB Progress (3): 180/385 kB | 81/586 kB | 66/211 kB Progress (3): 196/385 kB | 81/586 kB | 66/211 kB Progress (3): 196/385 kB | 81/586 kB | 82/211 kB Progress (3): 196/385 kB | 98/586 kB | 82/211 kB Progress (3): 212/385 kB | 98/586 kB | 82/211 kB Progress (3): 212/385 kB | 98/586 kB | 98/211 kB Progress (3): 212/385 kB | 114/586 kB | 98/211 kB Progress (3): 229/385 kB | 114/586 kB | 98/211 kB Progress (3): 229/385 kB | 114/586 kB | 115/211 kB Progress (3): 229/385 kB | 130/586 kB | 115/211 kB Progress (3): 245/385 kB | 130/586 kB | 115/211 kB Progress (3): 245/385 kB | 130/586 kB | 131/211 kB Progress (3): 245/385 kB | 147/586 kB | 131/211 kB Progress (3): 262/385 kB | 147/586 kB | 131/211 kB Progress (3): 262/385 kB | 147/586 kB | 147/211 kB Progress (3): 262/385 kB | 163/586 kB | 147/211 kB Progress (3): 278/385 kB | 163/586 kB | 147/211 kB Progress (3): 278/385 kB | 163/586 kB | 164/211 kB Progress (3): 278/385 kB | 180/586 kB | 164/211 kB Progress (3): 294/385 kB | 180/586 kB | 164/211 kB Progress (3): 294/385 kB | 180/586 kB | 180/211 kB Progress (3): 294/385 kB | 196/586 kB | 180/211 kB Progress (3): 311/385 kB | 196/586 kB | 180/211 kB Progress (3): 311/385 kB | 196/586 kB | 197/211 kB Progress (3): 311/385 kB | 212/586 kB | 197/211 kB Progress (3): 327/385 kB | 212/586 kB | 197/211 kB Progress (3): 327/385 kB | 212/586 kB | 211 kB Progress (3): 327/385 kB | 229/586 kB | 211 kB Progress (4): 327/385 kB | 229/586 kB | 211 kB | 14 kB Progress (4): 343/385 kB | 229/586 kB | 211 kB | 14 kB Progress (4): 343/385 kB | 245/586 kB | 211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 990 kB/s) 2024-09-12T00:39:05.592 INFO:tasks.workunit.client.0.smithi019.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 67 kB/s) 2024-09-12T00:39:05.593 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:39:05.593 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:39:05.595 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 343/385 kB | 262/586 kB Progress (2): 343/385 kB | 278/586 kB Progress (2): 343/385 kB | 294/586 kB Progress (2): 343/385 kB | 311/586 kB Progress (2): 343/385 kB | 327/586 kB Progress (2): 343/385 kB | 343/586 kB Progress (2): 343/385 kB | 360/586 kB Progress (2): 343/385 kB | 376/586 kB Progress (2): 343/385 kB | 393/586 kB Progress (2): 343/385 kB | 402/586 kB Progress (2): 343/385 kB | 418/586 kB Progress (2): 343/385 kB | 435/586 kB Progress (2): 343/385 kB | 451/586 kB Progress (2): 343/385 kB | 468/586 kB Progress (2): 343/385 kB | 484/586 kB Progress (2): 343/385 kB | 500/586 kB Progress (2): 343/385 kB | 517/586 kB Progress (2): 343/385 kB | 533/586 kB Progress (2): 343/385 kB | 549/586 kB Progress (2): 343/385 kB | 566/586 kB Progress (2): 343/385 kB | 582/586 kB Progress (2): 343/385 kB | 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.7 MB/s) 2024-09-12T00:39:05.596 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:39:05.601 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 343/385 kB | 16/106 kB Progress (2): 343/385 kB | 33/106 kB Progress (2): 343/385 kB | 49/106 kB Progress (2): 343/385 kB | 66/106 kB Progress (2): 343/385 kB | 82/106 kB Progress (2): 343/385 kB | 98/106 kB Progress (2): 343/385 kB | 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 472 kB/s) 2024-09-12T00:39:05.602 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:39:05.611 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 343/385 kB | 6.8 kB Progress (3): 343/385 kB | 6.8 kB | 16/245 kB Progress (3): 343/385 kB | 6.8 kB | 32/245 kB Progress (3): 360/385 kB | 6.8 kB | 32/245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 29 kB/s) 2024-09-12T00:39:05.611 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:39:05.611 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 360/385 kB | 49/245 kB Progress (2): 376/385 kB | 49/245 kB Progress (2): 376/385 kB | 65/245 kB Progress (2): 385 kB | 65/245 kB Progress (2): 385 kB | 81/245 kB Progress (2): 385 kB | 98/245 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 1.6 MB/s) 2024-09-12T00:39:05.612 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:39:05.613 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 114/245 kB Progress (1): 130/245 kB Progress (1): 147/245 kB Progress (1): 163/245 kB Progress (1): 180/245 kB Progress (1): 196/245 kB Progress (1): 212/245 kB Progress (1): 229/245 kB Progress (1): 245 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.0 MB/s) 2024-09-12T00:39:05.613 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:39:05.622 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 62 kB/s) 2024-09-12T00:39:05.622 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:39:05.624 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 67 kB/s) 2024-09-12T00:39:05.625 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:39:05.633 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 89 kB/s) 2024-09-12T00:39:05.633 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:39:05.638 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 93 kB/s) 2024-09-12T00:39:05.646 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 24 kB/s) 2024-09-12T00:39:05.653 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/184 kB Progress (1): 32/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Progress (2): 184 kB | 16/17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 666 kB/s) 2024-09-12T00:39:05.659 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 61 kB/s) 2024-09-12T00:39:05.664 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/205 kB Progress (1): 32/205 kB Progress (1): 49/205 kB Progress (1): 65/205 kB Progress (1): 81/205 kB Progress (1): 98/205 kB Progress (1): 114/205 kB Progress (1): 130/205 kB Progress (1): 147/205 kB Progress (1): 163/205 kB Progress (1): 180/205 kB Progress (1): 196/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 716 kB/s) 2024-09-12T00:39:05.690 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:05.690 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:39:05.698 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:39:05.715 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 324 kB/s) 2024-09-12T00:39:05.718 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:39:05.734 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 318 kB/s) 2024-09-12T00:39:05.736 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:39:05.753 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.4 MB/s) 2024-09-12T00:39:05.760 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:39:05.776 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 839 kB/s) 2024-09-12T00:39:05.783 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:39:05.801 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/153 kB Progress (1): 33/153 kB Progress (1): 49/153 kB Progress (1): 62/153 kB Progress (1): 79/153 kB Progress (1): 95/153 kB Progress (1): 111/153 kB Progress (1): 128/153 kB Progress (1): 144/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 8.5 MB/s) 2024-09-12T00:39:05.801 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:39:05.819 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/215 kB Progress (1): 33/215 kB Progress (1): 49/215 kB Progress (1): 64/215 kB Progress (1): 81/215 kB Progress (1): 97/215 kB Progress (1): 113/215 kB Progress (1): 130/215 kB Progress (1): 146/215 kB Progress (1): 163/215 kB Progress (1): 179/215 kB Progress (1): 195/215 kB Progress (1): 212/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-12T00:39:05.857 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:05.857 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:39:05.861 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:39:05.877 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 156 kB/s) 2024-09-12T00:39:05.879 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:39:05.895 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.3 MB/s) 2024-09-12T00:39:05.899 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:39:05.917 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 487 kB/s) 2024-09-12T00:39:05.919 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:39:05.939 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.3 MB/s) 2024-09-12T00:39:05.942 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:39:05.957 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 402 kB/s) 2024-09-12T00:39:05.958 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:39:05.978 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 153 kB/s) 2024-09-12T00:39:05.981 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:39:05.996 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-12T00:39:05.998 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:39:06.011 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 196 kB/s) 2024-09-12T00:39:06.013 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:39:06.027 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 1.0 MB/s) 2024-09-12T00:39:06.029 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:39:06.043 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 229 kB/s) 2024-09-12T00:39:06.045 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:39:06.062 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 492 kB/s) 2024-09-12T00:39:06.064 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:39:06.078 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 597 kB/s) 2024-09-12T00:39:06.080 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:39:06.094 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 534 kB/s) 2024-09-12T00:39:06.097 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:39:06.116 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.0 MB/s) 2024-09-12T00:39:06.121 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:39:06.135 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 364 kB/s) 2024-09-12T00:39:06.137 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:39:06.157 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.5 MB/s) 2024-09-12T00:39:06.161 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:39:06.177 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 319 kB/s) 2024-09-12T00:39:06.180 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:39:06.196 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/85 kB Progress (1): 32/85 kB Progress (1): 49/85 kB Progress (1): 65/85 kB Progress (1): 81/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 5.3 MB/s) 2024-09-12T00:39:06.197 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:39:06.197 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:39:06.197 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:39:06.198 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:39:06.198 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:39:06.212 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 565 kB/s) 2024-09-12T00:39:06.212 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:39:06.213 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 156 kB/s) 2024-09-12T00:39:06.213 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:39:06.216 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/55 kB Progress (1): 33/55 kB Progress (1): 49/55 kB Progress (1): 55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.9 MB/s) 2024-09-12T00:39:06.218 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/41 kB Progress (1): 32/41 kB Progress (1): 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 1.9 MB/s) 2024-09-12T00:39:06.226 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/269 kB Progress (1): 33/269 kB Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 9.3 MB/s) 2024-09-12T00:39:06.233 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/327 kB Progress (1): 32/327 kB Progress (2): 32/327 kB | 16/587 kB Progress (2): 49/327 kB | 16/587 kB Progress (2): 49/327 kB | 33/587 kB Progress (2): 65/327 kB | 33/587 kB Progress (2): 65/327 kB | 49/587 kB Progress (2): 81/327 kB | 49/587 kB Progress (2): 81/327 kB | 64/587 kB Progress (2): 98/327 kB | 64/587 kB Progress (2): 98/327 kB | 80/587 kB Progress (2): 114/327 kB | 80/587 kB Progress (2): 114/327 kB | 97/587 kB Progress (2): 130/327 kB | 97/587 kB Progress (2): 130/327 kB | 113/587 kB Progress (2): 147/327 kB | 113/587 kB Progress (2): 147/327 kB | 129/587 kB Progress (2): 163/327 kB | 129/587 kB Progress (2): 163/327 kB | 146/587 kB Progress (2): 180/327 kB | 146/587 kB Progress (2): 180/327 kB | 162/587 kB Progress (2): 196/327 kB | 162/587 kB Progress (2): 196/327 kB | 178/587 kB Progress (2): 212/327 kB | 178/587 kB Progress (2): 212/327 kB | 195/587 kB Progress (2): 229/327 kB | 195/587 kB Progress (2): 229/327 kB | 211/587 kB Progress (2): 245/327 kB | 211/587 kB Progress (2): 245/327 kB | 228/587 kB Progress (2): 262/327 kB | 228/587 kB Progress (2): 262/327 kB | 244/587 kB Progress (2): 278/327 kB | 244/587 kB Progress (2): 278/327 kB | 260/587 kB Progress (2): 294/327 kB | 260/587 kB Progress (2): 294/327 kB | 277/587 kB Progress (2): 311/327 kB | 277/587 kB Progress (2): 311/327 kB | 293/587 kB Progress (2): 327/327 kB | 293/587 kB Progress (2): 327 kB | 293/587 kB Progress (2): 327 kB | 309/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.3 MB/s) 2024-09-12T00:39:06.237 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 326/587 kB Progress (1): 342/587 kB Progress (1): 359/587 kB Progress (1): 375/587 kB Progress (1): 391/587 kB Progress (1): 408/587 kB Progress (1): 424/587 kB Progress (1): 441/587 kB Progress (1): 457/587 kB Progress (1): 473/587 kB Progress (1): 490/587 kB Progress (1): 506/587 kB Progress (1): 522/587 kB Progress (1): 539/587 kB Progress (1): 555/587 kB Progress (1): 572/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 15 MB/s) 2024-09-12T00:39:06.268 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:39:06.268 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:06.268 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:39:06.272 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:39:06.286 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 339 kB/s) 2024-09-12T00:39:06.288 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:39:06.302 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 424 kB/s) 2024-09-12T00:39:06.304 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:39:06.318 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-12T00:39:06.320 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:39:06.335 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 932 kB/s) 2024-09-12T00:39:06.338 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:39:06.351 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 58 kB/s) 2024-09-12T00:39:06.353 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:39:06.371 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 236 kB/s) 2024-09-12T00:39:06.373 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:39:06.397 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 721 kB/s) 2024-09-12T00:39:06.399 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:39:06.420 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 237 kB/s) 2024-09-12T00:39:06.422 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:39:06.438 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 259 kB/s) 2024-09-12T00:39:06.441 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:39:06.456 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 158 kB/s) 2024-09-12T00:39:06.457 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:39:06.475 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 627 kB/s) 2024-09-12T00:39:06.477 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:39:06.495 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 958 kB/s) 2024-09-12T00:39:06.497 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:39:06.513 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 411 kB/s) 2024-09-12T00:39:06.516 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:39:06.536 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 53 kB/s) 2024-09-12T00:39:06.538 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:39:06.561 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 364 kB/s) 2024-09-12T00:39:06.563 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:39:06.579 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 167 kB/s) 2024-09-12T00:39:06.582 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:39:06.600 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 313 kB/s) 2024-09-12T00:39:06.602 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:39:06.618 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 76 kB/s) 2024-09-12T00:39:06.621 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:39:06.637 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 45 kB/s) 2024-09-12T00:39:06.639 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:39:06.658 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 302 kB/s) 2024-09-12T00:39:06.660 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:39:06.676 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.6 MB/s) 2024-09-12T00:39:06.678 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:39:06.692 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 93 kB/s) 2024-09-12T00:39:06.694 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:39:06.710 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 83 kB/s) 2024-09-12T00:39:06.715 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:39:06.730 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 903 kB/s) 2024-09-12T00:39:06.730 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:39:06.730 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:39:06.731 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:39:06.731 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:39:06.731 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:39:06.746 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 281 kB/s) 2024-09-12T00:39:06.746 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/27 kB Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:39:06.746 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 27 kB Progress (2): 27 kB | 16/55 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.8 MB/s) 2024-09-12T00:39:06.746 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:39:06.749 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 33/55 kB Progress (1): 49/55 kB Progress (1): 55 kB Progress (2): 55 kB | 16/122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.2 MB/s) 2024-09-12T00:39:06.749 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:39:06.749 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 33/122 kB Progress (1): 49/122 kB Progress (1): 66/122 kB Progress (2): 66/122 kB | 16/334 kB Progress (2): 82/122 kB | 16/334 kB Progress (2): 82/122 kB | 32/334 kB Progress (2): 98/122 kB | 32/334 kB Progress (2): 98/122 kB | 49/334 kB Progress (2): 115/122 kB | 49/334 kB Progress (2): 122 kB | 49/334 kB Progress (2): 122 kB | 65/334 kB Progress (2): 122 kB | 81/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 6.8 MB/s) 2024-09-12T00:39:06.752 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 98/334 kB Progress (1): 114/334 kB Progress (1): 130/334 kB Progress (1): 147/334 kB Progress (1): 163/334 kB Progress (1): 180/334 kB Progress (1): 196/334 kB Progress (1): 212/334 kB Progress (1): 229/334 kB Progress (1): 245/334 kB Progress (1): 262/334 kB Progress (1): 278/334 kB Progress (1): 294/334 kB Progress (1): 311/334 kB Progress (1): 327/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-09-12T00:39:06.762 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/267 kB Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (2): 115/267 kB | 16/23 kB Progress (2): 131/267 kB | 16/23 kB Progress (2): 131/267 kB | 23 kB Progress (2): 147/267 kB | 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 735 kB/s) 2024-09-12T00:39:06.764 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 8.1 MB/s) 2024-09-12T00:39:06.767 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 126 kB/s) 2024-09-12T00:39:06.817 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:39:06.817 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:39:07.417 INFO:tasks.workunit.client.0.smithi019.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:39:07.417 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:07.418 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:39:07.420 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:39:07.420 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:07.421 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:39:07.425 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:39:07.425 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:39:07.580 INFO:tasks.workunit.client.0.smithi019.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:39:07.581 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:07.581 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:39:07.585 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:39:07.602 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 367 kB/s) 2024-09-12T00:39:07.605 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:39:07.621 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 221 kB/s) 2024-09-12T00:39:07.626 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:39:07.646 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 155 kB/s) 2024-09-12T00:39:07.651 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:39:07.668 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 239 kB/s) 2024-09-12T00:39:07.673 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:39:07.693 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 165 kB/s) 2024-09-12T00:39:07.697 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:39:07.716 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 248 kB/s) 2024-09-12T00:39:07.721 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:39:07.736 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 117 kB/s) 2024-09-12T00:39:07.740 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:39:07.757 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 137 kB/s) 2024-09-12T00:39:07.759 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:39:07.776 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.8 MB/s) 2024-09-12T00:39:07.778 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:39:07.793 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T00:39:07.797 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:39:07.813 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 362 kB/s) 2024-09-12T00:39:07.817 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:39:07.834 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 138 kB/s) 2024-09-12T00:39:07.836 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:39:07.852 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.3 MB/s) 2024-09-12T00:39:07.854 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:39:07.871 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.3 MB/s) 2024-09-12T00:39:07.874 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:39:07.888 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.1 MB/s) 2024-09-12T00:39:07.892 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:39:07.908 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 541 kB/s) 2024-09-12T00:39:07.910 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:39:07.926 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.6 MB/s) 2024-09-12T00:39:07.929 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:39:07.945 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 504 kB/s) 2024-09-12T00:39:07.949 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:39:07.964 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-12T00:39:07.967 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:39:07.983 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 162 kB/s) 2024-09-12T00:39:07.986 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:39:08.007 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 73 kB/s) 2024-09-12T00:39:08.008 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:39:08.023 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 204 kB/s) 2024-09-12T00:39:08.024 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:39:08.041 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.1 MB/s) 2024-09-12T00:39:08.044 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:39:08.058 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 483 kB/s) 2024-09-12T00:39:08.059 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:39:08.074 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 969 kB/s) 2024-09-12T00:39:08.077 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:39:08.094 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 174 kB/s) 2024-09-12T00:39:08.095 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:39:08.109 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 486 kB/s) 2024-09-12T00:39:08.110 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:39:08.125 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 600 kB/s) 2024-09-12T00:39:08.127 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:39:08.143 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 121 kB/s) 2024-09-12T00:39:08.146 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:39:08.162 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 139 kB/s) 2024-09-12T00:39:08.165 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:39:08.181 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 189 kB/s) 2024-09-12T00:39:08.184 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:39:08.200 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 935 kB/s) 2024-09-12T00:39:08.201 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:39:08.217 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 967 kB/s) 2024-09-12T00:39:08.220 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:39:08.243 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 560 kB/s) 2024-09-12T00:39:08.245 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:39:08.262 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 282 kB/s) 2024-09-12T00:39:08.264 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:39:08.279 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 392 kB/s) 2024-09-12T00:39:08.281 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:39:08.297 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.9 MB/s) 2024-09-12T00:39:08.300 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:39:08.314 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 1.2 MB/s) 2024-09-12T00:39:08.316 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:39:08.333 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 871 kB/s) 2024-09-12T00:39:08.335 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:39:08.353 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 42 kB/s) 2024-09-12T00:39:08.354 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:39:08.372 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 267 kB/s) 2024-09-12T00:39:08.392 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:39:08.392 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 465 kB/s) 2024-09-12T00:39:08.393 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:39:08.439 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 64 kB/s) 2024-09-12T00:39:08.442 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:39:08.480 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 112 kB/s) 2024-09-12T00:39:08.483 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:39:08.497 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 137 kB/s) 2024-09-12T00:39:08.500 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:39:08.518 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 183 kB/s) 2024-09-12T00:39:08.521 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:39:08.536 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 729 kB/s) 2024-09-12T00:39:08.537 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:39:08.552 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 842 kB/s) 2024-09-12T00:39:08.554 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:39:08.574 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 937 kB/s) 2024-09-12T00:39:08.576 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:39:08.593 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 21 kB/s) 2024-09-12T00:39:08.594 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:39:08.613 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 305 kB/s) 2024-09-12T00:39:08.615 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:39:08.651 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 204 kB/s) 2024-09-12T00:39:08.652 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:39:08.666 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 345 kB/s) 2024-09-12T00:39:08.668 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:39:08.684 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 487 kB/s) 2024-09-12T00:39:08.686 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:39:08.702 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.4 MB/s) 2024-09-12T00:39:08.704 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:39:08.723 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.1 MB/s) 2024-09-12T00:39:08.726 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:39:08.743 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-12T00:39:08.746 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:39:08.766 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 282 kB/s) 2024-09-12T00:39:08.768 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:39:08.783 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 285 kB/s) 2024-09-12T00:39:08.785 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:39:08.801 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 200 kB/s) 2024-09-12T00:39:08.802 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:39:08.829 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.1 MB/s) 2024-09-12T00:39:08.831 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:39:08.851 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 118 kB/s) 2024-09-12T00:39:08.855 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:39:08.878 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/308 kB Progress (1): 32/308 kB Progress (1): 49/308 kB Progress (1): 65/308 kB Progress (1): 81/308 kB Progress (1): 98/308 kB Progress (1): 114/308 kB Progress (1): 130/308 kB Progress (1): 147/308 kB Progress (1): 163/308 kB Progress (1): 180/308 kB Progress (1): 196/308 kB Progress (1): 212/308 kB Progress (1): 229/308 kB Progress (1): 245/308 kB Progress (1): 262/308 kB Progress (1): 278/308 kB Progress (1): 294/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 15 MB/s) 2024-09-12T00:39:08.878 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:39:08.878 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:39:08.878 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:39:08.879 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:39:08.879 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:39:08.900 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.2 kB Progress (2): 8.2 kB | 14 kB Progress (3): 8.2 kB | 14 kB | 16/118 kB Progress (3): 8.2 kB | 14 kB | 32/118 kB Progress (3): 8.2 kB | 14 kB | 49/118 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 481 kB/s) 2024-09-12T00:39:08.900 INFO:tasks.workunit.client.0.smithi019.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-09-12T00:39:08.900 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:39:08.900 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:39:08.901 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 65/118 kB Progress (1): 81/118 kB Progress (1): 98/118 kB Progress (1): 114/118 kB Progress (1): 118 kB Progress (2): 118 kB | 16/171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 6.5 MB/s) 2024-09-12T00:39:08.901 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 32/171 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:39:08.901 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 49/171 kB Progress (1): 65/171 kB Progress (1): 81/171 kB Progress (1): 98/171 kB Progress (1): 114/171 kB Progress (1): 130/171 kB Progress (1): 147/171 kB Progress (2): 147/171 kB | 16/26 kB Progress (2): 163/171 kB | 16/26 kB Progress (2): 171 kB | 16/26 kB Progress (2): 171 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.2 MB/s) 2024-09-12T00:39:08.901 INFO:tasks.workunit.client.0.smithi019.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 7.8 MB/s) 2024-09-12T00:39:08.901 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:39:08.901 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:39:08.911 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/136 kB Progress (1): 32/136 kB Progress (1): 49/136 kB Progress (1): 65/136 kB Progress (1): 81/136 kB Progress (1): 98/136 kB Progress (1): 114/136 kB Progress (1): 130/136 kB Progress (1): 136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 4.0 MB/s) 2024-09-12T00:39:08.912 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:39:08.915 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/61 kB Progress (1): 33/61 kB Progress (2): 33/61 kB | 16/501 kB Progress (2): 49/61 kB | 16/501 kB Progress (2): 49/61 kB | 32/501 kB Progress (2): 61 kB | 32/501 kB Progress (2): 61 kB | 49/501 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.6 MB/s) 2024-09-12T00:39:08.915 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:39:08.918 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 65/501 kB Progress (1): 81/501 kB Progress (1): 98/501 kB Progress (1): 114/501 kB Progress (1): 130/501 kB Progress (1): 147/501 kB Progress (1): 163/501 kB Progress (2): 163/501 kB | 16/58 kB Progress (2): 180/501 kB | 16/58 kB Progress (2): 180/501 kB | 32/58 kB Progress (2): 196/501 kB | 32/58 kB Progress (2): 196/501 kB | 49/58 kB Progress (2): 212/501 kB | 49/58 kB Progress (2): 212/501 kB | 58 kB Progress (2): 219/501 kB | 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.4 MB/s) 2024-09-12T00:39:08.928 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 236/501 kB Progress (1): 252/501 kB Progress (1): 268/501 kB Progress (1): 285/501 kB Progress (1): 301/501 kB Progress (1): 318/501 kB Progress (1): 334/501 kB Progress (1): 350/501 kB Progress (1): 367/501 kB Progress (1): 383/501 kB Progress (1): 399/501 kB Progress (1): 416/501 kB Progress (1): 432/501 kB Progress (1): 439/501 kB Progress (1): 455/501 kB Progress (1): 471/501 kB Progress (1): 488/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 10 MB/s) 2024-09-12T00:39:08.929 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/124 kB Progress (1): 32/124 kB Progress (1): 49/124 kB Progress (1): 65/124 kB Progress (1): 81/124 kB Progress (1): 98/124 kB Progress (1): 114/124 kB Progress (1): 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.4 MB/s) 2024-09-12T00:39:08.934 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/146 kB Progress (1): 32/146 kB Progress (1): 49/146 kB Progress (1): 65/146 kB Progress (1): 81/146 kB Progress (1): 98/146 kB Progress (1): 114/146 kB Progress (1): 130/146 kB Progress (1): 146 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 2.6 MB/s) 2024-09-12T00:39:09.145 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 9.1 MB/s) 2024-09-12T00:39:09.215 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:09.215 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:39:09.218 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:39:09.245 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 173 kB/s) 2024-09-12T00:39:09.247 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:39:09.263 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 326 kB/s) 2024-09-12T00:39:09.265 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:39:09.287 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/45 kB Progress (1): 32/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 2.1 MB/s) 2024-09-12T00:39:09.290 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:39:09.310 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.0 MB/s) 2024-09-12T00:39:09.317 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:39:09.337 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 216 kB/s) 2024-09-12T00:39:09.340 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:39:09.371 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 126 kB/s) 2024-09-12T00:39:09.373 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:39:09.393 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 301 kB/s) 2024-09-12T00:39:09.395 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:39:09.421 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 241 kB/s) 2024-09-12T00:39:09.423 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:39:09.453 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 656 kB/s) 2024-09-12T00:39:09.457 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:39:09.477 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 727 kB/s) 2024-09-12T00:39:09.480 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:39:09.496 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 128 kB/s) 2024-09-12T00:39:09.498 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:39:09.515 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 456 kB/s) 2024-09-12T00:39:09.518 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:39:09.536 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.4 MB/s) 2024-09-12T00:39:09.543 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:39:09.562 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/36 kB Progress (1): 32/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 1.9 MB/s) 2024-09-12T00:39:09.563 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:39:09.563 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:39:09.563 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:39:09.563 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:39:09.563 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:39:09.579 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 49/79 kB Progress (1): 66/79 kB Progress (1): 79 kB Progress (2): 79 kB | 16/26 kB Progress (3): 79 kB | 16/26 kB | 16/58 kB Progress (3): 79 kB | 26 kB | 16/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 4.7 MB/s) 2024-09-12T00:39:09.579 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:39:09.579 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 26 kB | 33/58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-12T00:39:09.579 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:39:09.580 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 49/58 kB Progress (1): 58 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.4 MB/s) 2024-09-12T00:39:09.587 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 0/1.0 MB Progress (1): 0/1.0 MB Progress (1): 0/1.0 MB Progress (1): 0.1/1.0 MB Progress (1): 0.1/1.0 MB Progress (2): 0.1/1.0 MB | 16/211 kB Progress (2): 0.1/1.0 MB | 16/211 kB Progress (2): 0.1/1.0 MB | 33/211 kB Progress (2): 0.1/1.0 MB | 33/211 kB Progress (2): 0.1/1.0 MB | 49/211 kB Progress (2): 0.1/1.0 MB | 49/211 kB Progress (2): 0.1/1.0 MB | 49/211 kB Progress (2): 0.1/1.0 MB | 66/211 kB Progress (2): 0.2/1.0 MB | 66/211 kB Progress (2): 0.2/1.0 MB | 82/211 kB Progress (2): 0.2/1.0 MB | 82/211 kB Progress (2): 0.2/1.0 MB | 98/211 kB Progress (2): 0.2/1.0 MB | 98/211 kB Progress (2): 0.2/1.0 MB | 98/211 kB Progress (2): 0.2/1.0 MB | 115/211 kB Progress (2): 0.2/1.0 MB | 115/211 kB Progress (2): 0.2/1.0 MB | 131/211 kB Progress (2): 0.2/1.0 MB | 131/211 kB Progress (2): 0.3/1.0 MB | 131/211 kB Progress (2): 0.3/1.0 MB | 147/211 kB Progress (2): 0.3/1.0 MB | 147/211 kB Progress (2): 0.3/1.0 MB | 164/211 kB Progress (2): 0.3/1.0 MB | 164/211 kB Progress (2): 0.3/1.0 MB | 164/211 kB Progress (2): 0.3/1.0 MB | 180/211 kB Progress (2): 0.3/1.0 MB | 180/211 kB Progress (2): 0.3/1.0 MB | 197/211 kB Progress (2): 0.3/1.0 MB | 197/211 kB Progress (2): 0.4/1.0 MB | 197/211 kB Progress (2): 0.4/1.0 MB | 211 kB Progress (2): 0.4/1.0 MB | 211 kB Progress (2): 0.4/1.0 MB | 211 kB Progress (2): 0.4/1.0 MB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 8.8 MB/s) 2024-09-12T00:39:09.595 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 0.4/1.0 MB Progress (1): 0.4/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.5/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.6/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (2): 0.8/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 16/116 kB Progress (2): 0.9/1.0 MB | 33/116 kB Progress (2): 0.9/1.0 MB | 33/116 kB Progress (2): 0.9/1.0 MB | 49/116 kB Progress (2): 0.9/1.0 MB | 49/116 kB Progress (2): 0.9/1.0 MB | 66/116 kB Progress (2): 0.9/1.0 MB | 66/116 kB Progress (2): 0.9/1.0 MB | 82/116 kB Progress (2): 0.9/1.0 MB | 82/116 kB Progress (2): 0.9/1.0 MB | 98/116 kB Progress (2): 1.0/1.0 MB | 98/116 kB Progress (2): 1.0/1.0 MB | 115/116 kB Progress (2): 1.0/1.0 MB | 115/116 kB Progress (2): 1.0/1.0 MB | 116 kB Progress (2): 1.0/1.0 MB | 116 kB Progress (2): 1.0/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.6 MB/s) 2024-09-12T00:39:09.595 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 32 MB/s) 2024-09-12T00:39:09.608 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/267 kB Progress (1): 32/267 kB Progress (1): 49/267 kB Progress (1): 65/267 kB Progress (1): 81/267 kB Progress (1): 98/267 kB Progress (1): 114/267 kB Progress (1): 130/267 kB Progress (1): 147/267 kB Progress (1): 163/267 kB Progress (1): 180/267 kB Progress (1): 196/267 kB Progress (1): 212/267 kB Progress (1): 229/267 kB Progress (1): 245/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 5.9 MB/s) 2024-09-12T00:39:09.768 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:39:09.808 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:39:09.808 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:39:09.809 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:39:09.809 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Total time: 6.696 s 2024-09-12T00:39:09.809 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Finished at: 2024-09-12T00:39:09Z 2024-09-12T00:39:09.809 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:39:09.833 INFO:tasks.workunit.client.0.smithi019.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:39:09.842 INFO:tasks.workunit.client.0.smithi019.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:39:10.873 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Scanning for projects... 2024-09-12T00:39:10.949 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:10.949 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:39:10.949 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:39:10.950 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] from pom.xml 2024-09-12T00:39:10.950 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:39:11.205 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:11.205 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:39:11.302 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:39:11.303 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:11.303 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:39:11.391 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:39:11.391 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:11.391 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:39:11.393 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:39:11.393 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:11.393 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:39:11.398 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:39:11.398 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:11.399 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:39:11.592 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:39:11.827 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:39:12.024 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 23 kB/s) 2024-09-12T00:39:12.033 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:39:12.053 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 131 kB/s) 2024-09-12T00:39:12.058 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:39:12.079 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 128 kB/s) 2024-09-12T00:39:12.084 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:39:12.103 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 159 kB/s) 2024-09-12T00:39:12.106 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:39:12.123 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-12T00:39:12.125 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:39:12.143 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 94 kB/s) 2024-09-12T00:39:12.145 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:39:12.162 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 167 kB/s) 2024-09-12T00:39:12.167 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:39:12.189 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.2 MB/s) 2024-09-12T00:39:12.190 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:39:12.190 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:39:12.191 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:39:12.191 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:39:12.192 INFO:tasks.workunit.client.0.smithi019.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:39:12.231 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/169 kB Progress (1): 33/169 kB Progress (1): 49/169 kB Progress (1): 66/169 kB Progress (1): 82/169 kB Progress (1): 98/169 kB Progress (1): 115/169 kB Progress (1): 131/169 kB Progress (1): 147/169 kB Progress (1): 164/169 kB Progress (1): 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 4.1 MB/s) 2024-09-12T00:39:12.239 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (1): 5.5/7.7 kB Progress (1): 6.9/7.7 kB Progress (1): 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 156 kB/s) 2024-09-12T00:39:12.263 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 16/189 kB Progress (2): 16/189 kB | 16/103 kB Progress (2): 33/189 kB | 16/103 kB Progress (2): 49/189 kB | 16/103 kB Progress (2): 49/189 kB | 33/103 kB Progress (2): 49/189 kB | 49/103 kB Progress (3): 49/189 kB | 49/103 kB | 1.4/18 kB Progress (3): 49/189 kB | 49/103 kB | 2.8/18 kB Progress (3): 49/189 kB | 49/103 kB | 4.1/18 kB Progress (3): 49/189 kB | 49/103 kB | 5.5/18 kB Progress (3): 49/189 kB | 49/103 kB | 6.9/18 kB Progress (3): 49/189 kB | 49/103 kB | 8.3/18 kB Progress (3): 49/189 kB | 49/103 kB | 9.7/18 kB Progress (3): 49/189 kB | 49/103 kB | 11/18 kB Progress (3): 49/189 kB | 49/103 kB | 12/18 kB Progress (3): 49/189 kB | 49/103 kB | 14/18 kB Progress (3): 49/189 kB | 49/103 kB | 15/18 kB Progress (3): 49/189 kB | 49/103 kB | 16/18 kB Progress (3): 49/189 kB | 49/103 kB | 17/18 kB Progress (3): 66/189 kB | 49/103 kB | 17/18 kB Progress (3): 66/189 kB | 49/103 kB | 18 kB Progress (3): 82/189 kB | 49/103 kB | 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 237 kB/s) 2024-09-12T00:39:12.268 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (2): 98/189 kB | 49/103 kB Progress (2): 98/189 kB | 66/103 kB Progress (2): 98/189 kB | 82/103 kB Progress (2): 115/189 kB | 82/103 kB Progress (2): 115/189 kB | 98/103 kB Progress (2): 115/189 kB | 103 kB Progress (2): 131/189 kB | 103 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.3 MB/s) 2024-09-12T00:39:12.280 INFO:tasks.workunit.client.0.smithi019.stdout:Progress (1): 147/189 kB Progress (1): 164/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.1 MB/s) 2024-09-12T00:39:12.295 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:39:12.296 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:39:12.296 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] T E S T S 2024-09-12T00:39:12.296 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:39:12.737 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:39:12.864 INFO:tasks.workunit.client.0.smithi019.stdout:PutObjects.java: starting test run: 2024-09-12T00:39:12.864 INFO:tasks.workunit.client.0.smithi019.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:39:12.864 INFO:tasks.workunit.client.0.smithi019.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:39:12.864 INFO:tasks.workunit.client.0.smithi019.stdout: EndpointUrl=https://smithi019.front.sepia.ceph.com:443 2024-09-12T00:39:12.865 INFO:tasks.workunit.client.0.smithi019.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:39:12.962 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: Environment Variables Read 2024-09-12T00:39:13.263 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:39:13.263 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: Generating File 2024-09-12T00:39:13.263 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: File Generated 2024-09-12T00:39:13.263 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: Generating File 2024-09-12T00:39:13.263 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: File Generated 2024-09-12T00:39:13.263 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: Generating File 2024-09-12T00:39:13.363 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: File Generated 2024-09-12T00:39:13.363 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: Generating File 2024-09-12T00:39:13.363 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: File Generated 2024-09-12T00:39:13.363 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: Generating File 2024-09-12T00:39:13.363 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: File Generated 2024-09-12T00:39:13.363 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: Generating File 2024-09-12T00:39:13.363 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: File Generated 2024-09-12T00:39:13.363 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: Generated Big Files 2024-09-12T00:39:13.763 INFO:tasks.workunit.client.0.smithi019.stdout:HeadBucketResponse() 2024-09-12T00:39:13.763 INFO:tasks.workunit.client.0.smithi019.stdout:sheik is ready 2024-09-12T00:39:13.763 INFO:tasks.workunit.client.0.smithi019.stdout:DEBUG: Test Bucket Created 2024-09-12T00:39:13.863 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:39:14.063 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:39:14.164 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:39:14.364 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:39:14.464 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:39:14.564 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:39:14.865 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:39:15.065 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:39:15.666 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:39:16.066 INFO:tasks.workunit.client.0.smithi019.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:39:19.972 INFO:tasks.workunit.client.0.smithi019.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:39:23.877 INFO:tasks.workunit.client.0.smithi019.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:40:05.116 INFO:tasks.workunit.client.0.smithi019.stdout:arg: file-0b 2024-09-12T00:40:05.117 INFO:tasks.workunit.client.0.smithi019.stdout:arg: file-8b 2024-09-12T00:40:05.117 INFO:tasks.workunit.client.0.smithi019.stdout:arg: file-200b 2024-09-12T00:40:05.118 INFO:tasks.workunit.client.0.smithi019.stdout:arg: file-21983b 2024-09-12T00:40:05.119 INFO:tasks.workunit.client.0.smithi019.stdout:arg: file-5519b 2024-09-12T00:40:05.120 INFO:tasks.workunit.client.0.smithi019.stdout:arg: file-204329b 2024-09-12T00:40:05.121 INFO:tasks.workunit.client.0.smithi019.stdout:arg: file-256k 2024-09-12T00:40:05.122 INFO:tasks.workunit.client.0.smithi019.stdout:arg: file-1m 2024-09-12T00:40:05.123 INFO:tasks.workunit.client.0.smithi019.stdout:arg: file-1038757b 2024-09-12T00:40:05.225 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:40:05.268 INFO:tasks.workunit.client.0.smithi019.stdout:PutObjectResponse 2024-09-12T00:40:05.325 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:40:05.394 INFO:tasks.workunit.client.0.smithi019.stdout:PutObjectResponse 2024-09-12T00:40:05.425 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:40:05.514 INFO:tasks.workunit.client.0.smithi019.stdout:PutObjectResponse 2024-09-12T00:40:05.525 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:40:05.625 INFO:tasks.workunit.client.0.smithi019.stdout:PutObjectResponse 2024-09-12T00:40:05.725 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:40:05.725 INFO:tasks.workunit.client.0.smithi019.stdout:PutObjectResponse 2024-09-12T00:40:05.825 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:40:05.925 INFO:tasks.workunit.client.0.smithi019.stdout:PutObjectResponse 2024-09-12T00:40:06.025 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:40:06.125 INFO:tasks.workunit.client.0.smithi019.stdout:PutObjectResponse 2024-09-12T00:40:06.226 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:40:06.626 INFO:tasks.workunit.client.0.smithi019.stdout:PutObjectResponse 2024-09-12T00:40:06.726 INFO:tasks.workunit.client.0.smithi019.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:40:07.126 INFO:tasks.workunit.client.0.smithi019.stdout:PutObjectResponse 2024-09-12T00:40:07.327 INFO:tasks.workunit.client.0.smithi019.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:40:10.930 INFO:tasks.workunit.client.0.smithi019.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:40:16.135 INFO:tasks.workunit.client.0.smithi019.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:41:09.910 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 117.2 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:41:09.930 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:41:09.930 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Results: 2024-09-12T00:41:09.930 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:41:09.930 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:41:09.930 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] 2024-09-12T00:41:09.932 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:41:09.932 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:41:09.932 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:41:09.933 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Total time: 01:59 min 2024-09-12T00:41:09.933 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] Finished at: 2024-09-12T00:41:09Z 2024-09-12T00:41:09.933 INFO:tasks.workunit.client.0.smithi019.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:41:09.945 INFO:tasks.workunit.client.0.smithi019.stderr:+ exit 2024-09-12T00:41:09.946 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:41:09.946 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:41:10.026 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:41:10.027 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:41:10.414 DEBUG:teuthology.parallel:result is None 2024-09-12T00:41:10.414 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:41:10.454 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:41:10.454 DEBUG:teuthology.orchestra.run.smithi019:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:41:10.524 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:41:10.524 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:41:10.534 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:41:10.534 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:41:10.534 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:41:10.594 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:41:10.594 INFO:teuthology.orchestra.run.smithi019.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:41:10.595 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:41:10.664 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:41:10.664 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:41:10.734 INFO:tasks.workunit:timeout=3h 2024-09-12T00:41:10.734 INFO:tasks.workunit:cleanup=True 2024-09-12T00:41:10.735 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:41:10.805 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:41:57.156 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:41:57.156 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:41:57.156 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:41:57.156 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:41:57.157 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:41:57.158 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:41:57.160 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:41:57.231 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:41:57.234 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:41:57.234 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:41:57.284 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:41:57.333 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:41:57.374 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:41:57.376 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:41:57.376 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:41:57.416 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:41:57.419 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:41:57.420 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:41:57.490 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:41:57.491 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:41:57.492 DEBUG:teuthology.orchestra.run.smithi019:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:41:57.566 INFO:tasks.workunit.client.0.smithi019.stdout:INFO: fully qualified domain name: smithi019.front.sepia.ceph.com 2024-09-12T00:41:57.566 INFO:tasks.workunit.client.0.smithi019.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:41:57.566 INFO:tasks.workunit.client.0.smithi019.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T00:42:00.204 INFO:tasks.workunit.client.0.smithi019.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:42:00.395 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting pip 2024-09-12T00:42:00.401 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:42:00.448 INFO:tasks.workunit.client.0.smithi019.stdout:Installing collected packages: pip 2024-09-12T00:42:00.448 INFO:tasks.workunit.client.0.smithi019.stdout: Attempting uninstall: pip 2024-09-12T00:42:00.448 INFO:tasks.workunit.client.0.smithi019.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:42:00.609 INFO:tasks.workunit.client.0.smithi019.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:42:00.615 INFO:tasks.workunit.client.0.smithi019.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:42:01.392 INFO:tasks.workunit.client.0.smithi019.stdout:Successfully installed pip-24.2 2024-09-12T00:42:02.296 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting boto3 2024-09-12T00:42:02.297 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:42:02.854 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:42:02.856 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:42:02.910 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:42:02.911 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:42:02.965 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:42:02.967 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:42:03.016 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:42:03.017 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:42:03.096 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:42:03.096 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:42:03.247 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:42:03.248 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:42:03.252 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:42:03.254 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:42:03.263 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:42:03.264 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:42:03.266 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:42:03.267 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:42:03.269 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:42:03.346 INFO:tasks.workunit.client.0.smithi019.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:42:04.742 INFO:tasks.workunit.client.0.smithi019.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:42:05.190 INFO:tasks.workunit.client.0.smithi019.stdout:INFO: creating user 2024-09-12T00:42:05.921 INFO:tasks.workunit.client.0.smithi019.stdout:{ 2024-09-12T00:42:05.921 INFO:tasks.workunit.client.0.smithi019.stdout: "user_id": "testid", 2024-09-12T00:42:05.921 INFO:tasks.workunit.client.0.smithi019.stdout: "display_name": "M. Tester", 2024-09-12T00:42:05.921 INFO:tasks.workunit.client.0.smithi019.stdout: "email": "tester@ceph.com", 2024-09-12T00:42:05.921 INFO:tasks.workunit.client.0.smithi019.stdout: "suspended": 0, 2024-09-12T00:42:05.921 INFO:tasks.workunit.client.0.smithi019.stdout: "max_buckets": 1000, 2024-09-12T00:42:05.921 INFO:tasks.workunit.client.0.smithi019.stdout: "subusers": [], 2024-09-12T00:42:05.921 INFO:tasks.workunit.client.0.smithi019.stdout: "keys": [ 2024-09-12T00:42:05.921 INFO:tasks.workunit.client.0.smithi019.stdout: { 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: "user": "testid", 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: "active": true, 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: "create_date": "2024-09-12T00:42:05.912482Z" 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: } 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: ], 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: "swift_keys": [], 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: "caps": [], 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: "default_placement": "", 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: "default_storage_class": "", 2024-09-12T00:42:05.922 INFO:tasks.workunit.client.0.smithi019.stdout: "placement_tags": [], 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "bucket_quota": { 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "enabled": false, 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size": -1, 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "max_objects": -1 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "user_quota": { 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "enabled": false, 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size": -1, 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: "max_objects": -1 2024-09-12T00:42:05.923 INFO:tasks.workunit.client.0.smithi019.stdout: }, 2024-09-12T00:42:05.924 INFO:tasks.workunit.client.0.smithi019.stdout: "temp_url_keys": [], 2024-09-12T00:42:05.924 INFO:tasks.workunit.client.0.smithi019.stdout: "type": "rgw", 2024-09-12T00:42:05.924 INFO:tasks.workunit.client.0.smithi019.stdout: "mfa_ids": [], 2024-09-12T00:42:05.924 INFO:tasks.workunit.client.0.smithi019.stdout: "account_id": "", 2024-09-12T00:42:05.924 INFO:tasks.workunit.client.0.smithi019.stdout: "path": "/", 2024-09-12T00:42:05.924 INFO:tasks.workunit.client.0.smithi019.stdout: "create_date": "2024-09-12T00:42:05.912468Z", 2024-09-12T00:42:05.924 INFO:tasks.workunit.client.0.smithi019.stdout: "tags": [], 2024-09-12T00:42:05.924 INFO:tasks.workunit.client.0.smithi019.stdout: "group_ids": [] 2024-09-12T00:42:05.924 INFO:tasks.workunit.client.0.smithi019.stdout:} 2024-09-12T00:42:05.924 INFO:tasks.workunit.client.0.smithi019.stdout: 2024-09-12T00:42:11.300 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:11.300 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:11.371 INFO:tasks.workunit.client.0.smithi019.stderr:5+0 records in 2024-09-12T00:42:11.371 INFO:tasks.workunit.client.0.smithi019.stderr:5+0 records out 2024-09-12T00:42:11.371 INFO:tasks.workunit.client.0.smithi019.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0144353 s, 363 MB/s 2024-09-12T00:42:11.374 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:11.374 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:11.455 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:11.455 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:14.497 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:14.497 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:17.515 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:17.515 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:20.553 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:20.553 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:23.613 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:23.613 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:26.655 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:26.655 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:29.700 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:29.700 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:32.747 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:32.747 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:35.787 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:35.787 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:38.831 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:38.831 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:41.870 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:41.871 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:44.907 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:44.908 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:47.947 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:47.948 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:50.969 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:42:50.970 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:42:51.094 INFO:tasks.workunit.client.0.smithi019.stdout:bucket nams is reupload-bkt-118335 2024-09-12T00:42:51.094 INFO:tasks.workunit.client.0.smithi019.stdout:endpoint is https://smithi019.front.sepia.ceph.com:443 2024-09-12T00:42:51.094 INFO:tasks.workunit.client.0.smithi019.stdout:start UploadId=2~ZaqkCv2Q7UyYVqinu5EKFNksWxHglXN 2024-09-12T00:42:51.094 INFO:tasks.workunit.client.0.smithi019.stdout:phase 1 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.094 INFO:tasks.workunit.client.0.smithi019.stdout:phase 1 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 2} 2024-09-12T00:42:51.094 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.095 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.095 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.095 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.095 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.095 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.095 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.095 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.095 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.095 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.095 INFO:tasks.workunit.client.0.smithi019.stdout:phase 2 uploaded part {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1} 2024-09-12T00:42:51.095 INFO:tasks.workunit.client.0.smithi019.stdout:completing multipart upload, parts=[{'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 1}, {'ETag': '"38cb03bc87e70f1cbc76bd5940625134"', 'PartNumber': 2}] 2024-09-12T00:42:52.319 INFO:tasks.workunit.client.0.smithi019.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:42:52.320 INFO:tasks.workunit.client.0.smithi019.stdout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3_mpu_test4 2024-09-12T00:42:52.320 INFO:tasks.workunit.client.0.smithi019.stdout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3__multipart_mpu_test4.2~ZaqkCv2Q7UyYVqinu5EKFNksWxHglXN.2 2024-09-12T00:42:52.320 INFO:tasks.workunit.client.0.smithi019.stdout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3__multipart_mpu_test4.lPF4THK9x6r3b_pkKLvP2d0uBpt21B0W.1 2024-09-12T00:42:52.320 INFO:tasks.workunit.client.0.smithi019.stdout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3__shadow_mpu_test4.2~ZaqkCv2Q7UyYVqinu5EKFNksWxHglXN.2_1 2024-09-12T00:42:52.320 INFO:tasks.workunit.client.0.smithi019.stdout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3__shadow_mpu_test4.lPF4THK9x6r3b_pkKLvP2d0uBpt21B0W.1_1 2024-09-12T00:42:52.379 INFO:tasks.workunit.client.0.smithi019.stdout:rados ls: 2024-09-12T00:42:52.380 INFO:tasks.workunit.client.0.smithi019.stdout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3_mpu_test4 2024-09-12T00:42:52.380 INFO:tasks.workunit.client.0.smithi019.stdout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3__multipart_mpu_test4.2~ZaqkCv2Q7UyYVqinu5EKFNksWxHglXN.2 2024-09-12T00:42:52.380 INFO:tasks.workunit.client.0.smithi019.stdout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3__multipart_mpu_test4.lPF4THK9x6r3b_pkKLvP2d0uBpt21B0W.1 2024-09-12T00:42:52.380 INFO:tasks.workunit.client.0.smithi019.stdout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3__shadow_mpu_test4.2~ZaqkCv2Q7UyYVqinu5EKFNksWxHglXN.2_1 2024-09-12T00:42:52.380 INFO:tasks.workunit.client.0.smithi019.stdout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3__shadow_mpu_test4.lPF4THK9x6r3b_pkKLvP2d0uBpt21B0W.1_1 2024-09-12T00:42:52.392 INFO:tasks.workunit.client.0.smithi019.stdout:== PASSED == 2024-09-12T00:42:52.393 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:42:52.393 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:42:52.473 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:42:52.474 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:42:52.909 DEBUG:teuthology.parallel:result is None 2024-09-12T00:42:52.909 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:42:52.949 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:42:52.949 DEBUG:teuthology.orchestra.run.smithi019:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:42:53.018 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:42:53.019 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:42:53.034 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:42:53.034 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:42:53.034 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:42:53.034 DEBUG:teuthology.orchestra.run.smithi019:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:42:53.088 INFO:teuthology.orchestra.run.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:42:53.260 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:42:53.261 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:42:53.261 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key CRZTWOCKAOAXNBNGTCXH --secret HITw/WyKLuNMv8xZ0x+dqcr2FkwVZwGO62eXXrHHOLXJKzScIBu3LA== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:42:53.369 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:53.370 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:53.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.405+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.407+0000 7f44e5126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.407+0000 7f44e5126800 20 realm 2024-09-12T00:42:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.407+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.407+0000 7f44e5126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.407+0000 7f44e5126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.407+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.407+0000 7f44e5126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.407+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.408+0000 7f44e5126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.408+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.408+0000 7f44e5126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:53.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.408+0000 7f44e5126800 20 searching for the correct realm 2024-09-12T00:42:53.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.412+0000 7f44e064a640 0 -- 172.21.15.19:0/735364495 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f44c8027420 msgr2=0x7f44c80278a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:53.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.618+0000 7f44e164c640 0 -- 172.21.15.19:0/735364495 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x564b433d77a0 msgr2=0x564b433d9c30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:53.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.622+0000 7f44e5126800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:42:53.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.622+0000 7f44e5126800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:42:53.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.622+0000 7f44e5126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:53.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.622+0000 7f44e5126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:53.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.622+0000 7f44e5126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:53.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.622+0000 7f44e5126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:53.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.622+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.622+0000 7f44e5126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.622+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.622+0000 7f44e5126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.623+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.623+0000 7f44e5126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.623+0000 7f44e5126800 20 zone default found 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.623+0000 7f44e5126800 4 Realm: () 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.623+0000 7f44e5126800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.623+0000 7f44e5126800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.623+0000 7f44e5126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.623+0000 7f44e5126800 20 zonegroup default 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.623+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.623+0000 7f44e5126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.623+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.624+0000 7f44e5126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.624+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.624+0000 7f44e5126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.624+0000 7f44e5126800 20 started sync module instance, tier type = 2024-09-12T00:42:53.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.624+0000 7f44e5126800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:42:53.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.633+0000 7f44e5126800 20 add_watcher() i=0 2024-09-12T00:42:53.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.633+0000 7f44e5126800 20 add_watcher() i=1 2024-09-12T00:42:53.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.633+0000 7f44e5126800 20 add_watcher() i=2 2024-09-12T00:42:53.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.633+0000 7f44e5126800 20 add_watcher() i=3 2024-09-12T00:42:53.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.633+0000 7f44e5126800 20 add_watcher() i=4 2024-09-12T00:42:53.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.633+0000 7f44e5126800 20 add_watcher() i=5 2024-09-12T00:42:53.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.633+0000 7f44e5126800 20 add_watcher() i=6 2024-09-12T00:42:53.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.634+0000 7f44e5126800 20 add_watcher() i=7 2024-09-12T00:42:53.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.634+0000 7f44e5126800 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:53.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.636+0000 7f4396fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:53.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.636+0000 7f44e5126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:53.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.636+0000 7f44e5126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:53.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.636+0000 7f44e5126800 5 note: GC not initialized 2024-09-12T00:42:53.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.636+0000 7f4395fe3640 20 reqs_thread_entry: start 2024-09-12T00:42:53.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.636+0000 7f44e5126800 20 init_complete bucket index max shards: 11 2024-09-12T00:42:53.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 20 Filter name: none 2024-09-12T00:42:53.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f43077fe640 20 reqs_thread_entry: start 2024-09-12T00:42:53.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:42:53.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:42:53.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:42:53.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:42:53.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:42:53.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:42:53.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 10 cache get: name=default.rgw.meta+users.keys+CRZTWOCKAOAXNBNGTCXH : miss 2024-09-12T00:42:53.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.637+0000 7f44e5126800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.638+0000 7f44e5126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.638+0000 7f44e5126800 10 cache put: name=default.rgw.meta+users.keys+CRZTWOCKAOAXNBNGTCXH info.flags=0x0 2024-09-12T00:42:53.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.638+0000 7f44e5126800 10 adding default.rgw.meta+users.keys+CRZTWOCKAOAXNBNGTCXH to cache LRU end 2024-09-12T00:42:53.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.638+0000 7f44e5126800 10 cache get: name=default.rgw.meta+users.keys+CRZTWOCKAOAXNBNGTCXH : hit (negative entry) 2024-09-12T00:42:53.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.638+0000 7f44e5126800 10 cache get: name=default.rgw.meta+users.keys+CRZTWOCKAOAXNBNGTCXH : hit (negative entry) 2024-09-12T00:42:53.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.639+0000 7f44e5126800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:42:53.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.639+0000 7f44e5126800 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:42:53.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.639+0000 7f44e5126800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:42:53.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.639+0000 7f43b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595123 cookie 94881250699616 notifier 5886 bl.length()=675 2024-09-12T00:42:53.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.639+0000 7f43b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:42:53.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.639+0000 7f43b7fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:42:53.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.642+0000 7f44e5126800 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:42:53.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.642+0000 7f44e5126800 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:42:53.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.642+0000 7f44e5126800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:42:53.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.642+0000 7f43b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595083 cookie 94881250694672 notifier 5886 bl.length()=202 2024-09-12T00:42:53.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.642+0000 7f43b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:42:53.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.642+0000 7f43b7fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:42:53.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.644+0000 7f44e5126800 10 cache put: name=default.rgw.meta+users.keys+CRZTWOCKAOAXNBNGTCXH info.flags=0x7 2024-09-12T00:42:53.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.644+0000 7f44e5126800 10 moving default.rgw.meta+users.keys+CRZTWOCKAOAXNBNGTCXH to cache LRU end 2024-09-12T00:42:53.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.644+0000 7f44e5126800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:CRZTWOCKAOAXNBNGTCXH, ofs0, ns] 2024-09-12T00:42:53.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.645+0000 7f43b7fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595084 cookie 94881250694672 notifier 5886 bl.length()=190 2024-09-12T00:42:53.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.645+0000 7f43b7fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CRZTWOCKAOAXNBNGTCXH info.flags=0x7 2024-09-12T00:42:53.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.645+0000 7f43b7fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CRZTWOCKAOAXNBNGTCXH to cache LRU end 2024-09-12T00:42:53.645 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:42:53.645 INFO:teuthology.orchestra.run.smithi019.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: "suspended": 0, 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: "subusers": [], 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: "keys": [ 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: "user": "ragweed.client.0", 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: "access_key": "CRZTWOCKAOAXNBNGTCXH", 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: "secret_key": "HITw/WyKLuNMv8xZ0x+dqcr2FkwVZwGO62eXXrHHOLXJKzScIBu3LA==", 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: "active": true, 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T00:42:53.639858Z" 2024-09-12T00:42:53.646 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "swift_keys": [], 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": [], 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "default_placement": "", 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "default_storage_class": "", 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "placement_tags": [], 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T00:42:53.647 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "user_quota": { 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "temp_url_keys": [], 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "rgw", 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "mfa_ids": [], 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "account_id": "", 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T00:42:53.639840Z", 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-12T00:42:53.648 INFO:teuthology.orchestra.run.smithi019.stdout: "group_ids": [] 2024-09-12T00:42:53.649 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:42:53.649 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:42:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.647+0000 7f4396fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.649+0000 7f44e5126800 20 remove_watcher() i=0 2024-09-12T00:42:53.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.649+0000 7f44e5126800 2 removed watcher, disabling cache 2024-09-12T00:42:53.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.651+0000 7f44e5126800 20 remove_watcher() i=1 2024-09-12T00:42:53.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.652+0000 7f44e5126800 20 remove_watcher() i=2 2024-09-12T00:42:53.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.653+0000 7f44e5126800 20 remove_watcher() i=3 2024-09-12T00:42:53.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.654+0000 7f44e5126800 20 remove_watcher() i=4 2024-09-12T00:42:53.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.655+0000 7f44e5126800 20 remove_watcher() i=5 2024-09-12T00:42:53.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.657+0000 7f44e5126800 20 remove_watcher() i=6 2024-09-12T00:42:53.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.658+0000 7f44e5126800 20 remove_watcher() i=7 2024-09-12T00:42:53.669 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:42:53.669 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key YRYZWQJHAVGHWOSMGSQN --secret MVbj5XNNkHt7+zBFd8ntVKfah3LjSTP/zVVM3ZSd+jvcCdeBUiFz0Q== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:42:53.739 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:42:53.739 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:42:53.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.776+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.777+0000 7f374180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.778+0000 7f374180e800 20 realm 2024-09-12T00:42:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.778+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.778+0000 7f374180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.778+0000 7f374180e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:42:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.778+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.778+0000 7f374180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.778+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.779+0000 7f374180e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:53.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.779+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.779+0000 7f374180e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:42:53.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.779+0000 7f374180e800 20 searching for the correct realm 2024-09-12T00:42:53.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.782+0000 7f373476a640 0 -- 172.21.15.19:0/1318017797 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f372403f510 msgr2=0x7f3724045c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:53.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.988+0000 7f373d76c640 0 -- 172.21.15.19:0/1318017797 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55a3760e1ba0 msgr2=0x55a3760e4060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:42:53.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.992+0000 7f374180e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:42:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.992+0000 7f374180e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:42:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.992+0000 7f374180e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:42:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.992+0000 7f374180e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:42:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.992+0000 7f374180e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:42:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.992+0000 7f374180e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:42:53.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.992+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.992+0000 7f374180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.992+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:42:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:42:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 20 zone default found 2024-09-12T00:42:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 4 Realm: () 2024-09-12T00:42:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:42:53.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:42:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:42:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 20 zonegroup default 2024-09-12T00:42:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.993+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.994+0000 7f374180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.994+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.994+0000 7f374180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.994+0000 7f374180e800 20 started sync module instance, tier type = 2024-09-12T00:42:53.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:53.994+0000 7f374180e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:42:54.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.004+0000 7f374180e800 20 add_watcher() i=0 2024-09-12T00:42:54.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.004+0000 7f374180e800 20 add_watcher() i=1 2024-09-12T00:42:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.004+0000 7f374180e800 20 add_watcher() i=2 2024-09-12T00:42:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.004+0000 7f374180e800 20 add_watcher() i=3 2024-09-12T00:42:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.004+0000 7f374180e800 20 add_watcher() i=4 2024-09-12T00:42:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.004+0000 7f374180e800 20 add_watcher() i=5 2024-09-12T00:42:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.004+0000 7f374180e800 20 add_watcher() i=6 2024-09-12T00:42:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.005+0000 7f374180e800 20 add_watcher() i=7 2024-09-12T00:42:54.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.005+0000 7f374180e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:42:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.007+0000 7f35f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.007+0000 7f374180e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:42:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.007+0000 7f374180e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:42:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.007+0000 7f374180e800 5 note: GC not initialized 2024-09-12T00:42:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.007+0000 7f35f1fe3640 20 reqs_thread_entry: start 2024-09-12T00:42:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.007+0000 7f374180e800 20 init_complete bucket index max shards: 11 2024-09-12T00:42:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.007+0000 7f374180e800 20 Filter name: none 2024-09-12T00:42:54.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.007+0000 7f35637fe640 20 reqs_thread_entry: start 2024-09-12T00:42:54.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:42:54.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:54.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 10 cache get: name=default.rgw.meta+users.keys+YRYZWQJHAVGHWOSMGSQN : miss 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 20 rados->read ofs=0 len=0 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.008+0000 7f374180e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.009+0000 7f374180e800 10 cache put: name=default.rgw.meta+users.keys+YRYZWQJHAVGHWOSMGSQN info.flags=0x0 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.009+0000 7f374180e800 10 adding default.rgw.meta+users.keys+YRYZWQJHAVGHWOSMGSQN to cache LRU end 2024-09-12T00:42:54.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.009+0000 7f374180e800 10 cache get: name=default.rgw.meta+users.keys+YRYZWQJHAVGHWOSMGSQN : hit (negative entry) 2024-09-12T00:42:54.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.009+0000 7f374180e800 10 cache get: name=default.rgw.meta+users.keys+YRYZWQJHAVGHWOSMGSQN : hit (negative entry) 2024-09-12T00:42:54.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.011+0000 7f374180e800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:42:54.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.011+0000 7f374180e800 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:42:54.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.011+0000 7f374180e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:42:54.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.011+0000 7f3613fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595085 cookie 94160548719552 notifier 5904 bl.length()=675 2024-09-12T00:42:54.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.011+0000 7f3613fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:42:54.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.011+0000 7f3613fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:42:54.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.014+0000 7f374180e800 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:42:54.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.014+0000 7f374180e800 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:42:54.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.014+0000 7f374180e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:42:54.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.015+0000 7f3613fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595124 cookie 94160548726880 notifier 5904 bl.length()=202 2024-09-12T00:42:54.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.015+0000 7f3613fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:42:54.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.015+0000 7f3613fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:42:54.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.017+0000 7f374180e800 10 cache put: name=default.rgw.meta+users.keys+YRYZWQJHAVGHWOSMGSQN info.flags=0x7 2024-09-12T00:42:54.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.017+0000 7f374180e800 10 moving default.rgw.meta+users.keys+YRYZWQJHAVGHWOSMGSQN to cache LRU end 2024-09-12T00:42:54.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.017+0000 7f374180e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:YRYZWQJHAVGHWOSMGSQN, ofs0, ns] 2024-09-12T00:42:54.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.018+0000 7f3613fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595086 cookie 94160548719552 notifier 5904 bl.length()=190 2024-09-12T00:42:54.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.018+0000 7f3613fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YRYZWQJHAVGHWOSMGSQN info.flags=0x7 2024-09-12T00:42:54.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.018+0000 7f3613fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YRYZWQJHAVGHWOSMGSQN to cache LRU end 2024-09-12T00:42:54.018 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "suspended": 0, 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "subusers": [], 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "keys": [ 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "user": "sysuser.client.0", 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "access_key": "YRYZWQJHAVGHWOSMGSQN", 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "secret_key": "MVbj5XNNkHt7+zBFd8ntVKfah3LjSTP/zVVM3ZSd+jvcCdeBUiFz0Q==", 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "active": true, 2024-09-12T00:42:54.019 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T00:42:54.010737Z" 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "swift_keys": [], 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": [], 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "system": true, 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "default_placement": "", 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "default_storage_class": "", 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "placement_tags": [], 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T00:42:54.020 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "user_quota": { 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "temp_url_keys": [], 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "rgw", 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "mfa_ids": [], 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "account_id": "", 2024-09-12T00:42:54.021 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-12T00:42:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T00:42:54.010709Z", 2024-09-12T00:42:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-12T00:42:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: "group_ids": [] 2024-09-12T00:42:54.022 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:42:54.022 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:42:54.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.020+0000 7f35f2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:42:54.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.022+0000 7f374180e800 20 remove_watcher() i=0 2024-09-12T00:42:54.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.022+0000 7f374180e800 2 removed watcher, disabling cache 2024-09-12T00:42:54.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.023+0000 7f374180e800 20 remove_watcher() i=1 2024-09-12T00:42:54.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.025+0000 7f374180e800 20 remove_watcher() i=2 2024-09-12T00:42:54.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.026+0000 7f374180e800 20 remove_watcher() i=3 2024-09-12T00:42:54.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.027+0000 7f374180e800 20 remove_watcher() i=4 2024-09-12T00:42:54.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.028+0000 7f374180e800 20 remove_watcher() i=5 2024-09-12T00:42:54.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.029+0000 7f374180e800 20 remove_watcher() i=6 2024-09-12T00:42:54.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:42:54.030+0000 7f374180e800 20 remove_watcher() i=7 2024-09-12T00:42:54.041 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:42:54.041 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:42:54.042 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:42:54.071 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:42:54.071 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:42:54.072 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:42:54.141 DEBUG:teuthology.orchestra.run.smithi019:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:42:54.336 INFO:teuthology.orchestra.run.smithi019.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:42:54.511 INFO:teuthology.orchestra.run.smithi019.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:42:55.091 INFO:teuthology.orchestra.run.smithi019.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:43:01.558 INFO:teuthology.orchestra.run.smithi019.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:43:05.124 INFO:teuthology.orchestra.run.smithi019.stdout:py installed: asyncssh==2.13.2,Babel==2.9.1,bcrypt==3.2.2,boto==2.49.0,cachetools==4.2.4,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2023.5.7,cffi==1.14.5,chardet==4.0.0,cheroot==8.6.0,CherryPy==18.6.1,cockpit @ file:///builddir/build/BUILD/cockpit-323/tmp/wheel/cockpit-323-py3-none-any.whl,cryptography==36.0.1,dasbus==1.4,dbus-python==1.2.18,distro==1.5.0,docopt==0.6.2,exceptiongroup==1.2.2,execnet==2.1.1,file-magic==0.4.0,gevent==24.2.1,google-auth==2.34.0,gpg==1.15.1,greenlet==3.1.0,grpcio==1.46.7,grpcio-tools==1.46.7,httplib2==0.22.0,idna==2.10,iniconfig==2.0.0,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.0.0,jaraco.functools==3.5.0,jaraco.text==3.2.0,Jinja2==2.11.3,jsonpatch==1.21,jsonpointer==2.0,kubernetes==26.1.0,libcomps==0.1.18,logutils==0.3.5,lxml==4.6.5,Mako==1.1.4.dev0,MarkupSafe==1.1.1,more-itertools==8.12.0,munch==4.0.0,natsort==7.1.1,nftables==0.1,numpy==1.20.1,oauthlib==3.1.1,packaging==20.9,pecan==1.4.2,perf==0.1,pexpect==4.8.0,pluggy==1.5.0,ply==3.11,portend==3.1.0,prettytable==0.7.2,protobuf==3.14.0,psutil==5.8.0,ptyprocess==0.6.0,pyasn1==0.4.8,pyasn1-modules==0.2.8,pycparser==2.20,PyGObject==3.40.1,pyOpenSSL==21.0.0,pyparsing==2.4.7,PySocks==1.7.1,pytest==8.3.3,python-dateutil==2.8.1,python-linux-procfs==0.7.3,pytz==2021.1,pyudev==0.22.0,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=68a4128127ddec833e4f453cf6e40c3ebe770f5f8ebe1d66441570bae7761346,rbd==2.0.0,registries-conf-ctl==1.0,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rpm==4.16.1.3,rsa==4.9,s3cmd==2.4.0,scipy==1.6.2,selinux==3.6,sepolicy==3.6,setools==4.4.4,setroubleshoot @ file:///builddir/build/BUILD/setroubleshoot-3.3.32/src,six==1.15.0,systemd-python==234,tempora==5.0.0,toml==0.10.2,tomli==2.0.1,typing_extensions==4.12.2,urllib3==1.26.5,WebOb==1.8.8,websocket-client==1.2.3,Werkzeug==2.0.3,zc.lockfile==2.0,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:43:05.124 INFO:teuthology.orchestra.run.smithi019.stdout:py run-test-pre: PYTHONHASHSEED='3987918442' 2024-09-12T00:43:05.124 INFO:teuthology.orchestra.run.smithi019.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:43:05.326 INFO:teuthology.orchestra.run.smithi019.stdout:============================= test session starts ============================== 2024-09-12T00:43:05.327 INFO:teuthology.orchestra.run.smithi019.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:43:05.327 INFO:teuthology.orchestra.run.smithi019.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:43:05.327 INFO:teuthology.orchestra.run.smithi019.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:43:05.327 INFO:teuthology.orchestra.run.smithi019.stdout:configfile: pytest.ini 2024-09-12T00:43:05.428 INFO:teuthology.orchestra.run.smithi019.stdout:collecting ... collected 9 items 2024-09-12T00:43:05.428 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:43:11.116 INFO:teuthology.orchestra.run.smithi019.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:43:17.876 INFO:teuthology.orchestra.run.smithi019.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:43:22.401 INFO:teuthology.orchestra.run.smithi019.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:43:29.209 INFO:teuthology.orchestra.run.smithi019.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:43:37.192 INFO:teuthology.orchestra.run.smithi019.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:43:53.185 INFO:teuthology.orchestra.run.smithi019.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:44:05.922 INFO:teuthology.orchestra.run.smithi019.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:44:20.234 INFO:teuthology.orchestra.run.smithi019.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:44:47.712 INFO:teuthology.orchestra.run.smithi019.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:44:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:44:47.712 INFO:teuthology.orchestra.run.smithi019.stdout:=============================== warnings summary =============================== 2024-09-12T00:44:47.712 INFO:teuthology.orchestra.run.smithi019.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T00:44:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T00:44:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: import imp 2024-09-12T00:44:47.712 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:44:47.713 INFO:teuthology.orchestra.run.smithi019.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T00:44:47.713 INFO:teuthology.orchestra.run.smithi019.stdout:=================== 9 passed, 1 warning in 102.39s (0:01:42) =================== 2024-09-12T00:44:47.743 INFO:teuthology.orchestra.run.smithi019.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:44:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: py: commands succeeded 2024-09-12T00:44:47.743 INFO:teuthology.orchestra.run.smithi019.stdout: congratulations :) 2024-09-12T00:44:47.761 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:44:47.762 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:44:47.791 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:44:47.891 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:47.891 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:47.927 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.928+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:47.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.931+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:47.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.931+0000 7fd278923800 20 realm 2024-09-12T00:44:47.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.931+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:47.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.931+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:47.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.931+0000 7fd278923800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:47.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.931+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:47.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.931+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:47.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.931+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:47.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.932+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:47.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.932+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:47.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.932+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:47.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.932+0000 7fd278923800 20 searching for the correct realm 2024-09-12T00:44:47.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:47.935+0000 7fd273e12640 0 -- 172.21.15.19:0/2673752828 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fd268026040 msgr2=0x7fd26803f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:48.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.142+0000 7fd273e12640 0 -- 172.21.15.19:0/2673752828 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55d32404aba0 msgr2=0x55d32404d010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:48.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.146+0000 7fd278923800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:44:48.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.146+0000 7fd278923800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:44:48.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.146+0000 7fd278923800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:48.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.146+0000 7fd278923800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:48.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.146+0000 7fd278923800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:48.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.146+0000 7fd278923800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:48.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.146+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.147+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.147+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.147+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.147+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:48.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 20 zone default found 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 4 Realm: () 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 20 zonegroup default 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.148+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.149+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.149+0000 7fd278923800 20 started sync module instance, tier type = 2024-09-12T00:44:48.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.149+0000 7fd278923800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:44:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.158+0000 7fd278923800 20 add_watcher() i=0 2024-09-12T00:44:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.158+0000 7fd278923800 20 add_watcher() i=1 2024-09-12T00:44:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.158+0000 7fd278923800 20 add_watcher() i=2 2024-09-12T00:44:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.158+0000 7fd278923800 20 add_watcher() i=3 2024-09-12T00:44:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.158+0000 7fd278923800 20 add_watcher() i=4 2024-09-12T00:44:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.158+0000 7fd278923800 20 add_watcher() i=5 2024-09-12T00:44:48.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.158+0000 7fd278923800 20 add_watcher() i=6 2024-09-12T00:44:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.160+0000 7fd278923800 20 add_watcher() i=7 2024-09-12T00:44:48.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.160+0000 7fd278923800 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:48.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.162+0000 7fd12afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:48.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.162+0000 7fd278923800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:48.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.162+0000 7fd278923800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:48.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.203+0000 7fd129fdb640 20 reqs_thread_entry: start 2024-09-12T00:44:48.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.203+0000 7fd278923800 20 init_complete bucket index max shards: 11 2024-09-12T00:44:48.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.203+0000 7fd278923800 20 Filter name: none 2024-09-12T00:44:48.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.203+0000 7fd09b7fe640 20 reqs_thread_entry: start 2024-09-12T00:44:48.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.203+0000 7fd278923800 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:44:48.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.203+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.203+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:44:48.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.203+0000 7fd278923800 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:44:48.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.203+0000 7fd278923800 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:44:48.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.203+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.204+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4 : miss 2024-09-12T00:44:48.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.204+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.205+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:44:48.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.205+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4 info.flags=0x17 2024-09-12T00:44:48.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.205+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4 to cache LRU end 2024-09-12T00:44:48.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.205+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.205+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.205+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4 2024-09-12T00:44:48.204 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.206+0000 7fd278923800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:44:48.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.206+0000 7fd278923800 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:44:48.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.206+0000 7fd278923800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:44:48.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.207+0000 7fd278923800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:44:48.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.207+0000 7fd278923800 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:44:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.207+0000 7fd278923800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:44:48.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.207+0000 7fd278923800 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:44:48.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.208+0000 7fd278923800 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:44:48.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.209+0000 7fd278923800 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:44:48.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.210+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55d324114428 s->prefetch_data=0 2024-09-12T00:44:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.210+0000 7fd278923800 10 manifest: total_size = 7740 2024-09-12T00:44:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.210+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15504438328918549940 2024-09-12T00:44:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.210+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55d324114428 s->prefetch_data=0 2024-09-12T00:44:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.210+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d324114428 2024-09-12T00:44:48.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.210+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4.1 2024-09-12T00:44:48.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.213+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.214+0000 7fd278923800 10 manifest: total_size = 4895 2024-09-12T00:44:48.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.214+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.2947504847683286985 2024-09-12T00:44:48.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.214+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.214+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3241143e8 2024-09-12T00:44:48.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.214+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4.2 2024-09-12T00:44:48.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.214+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:44:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.216+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.217+0000 7fd278923800 10 manifest: total_size = 5245 2024-09-12T00:44:48.215 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.217+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3653303577127268392 2024-09-12T00:44:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.217+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.217+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3241143e8 2024-09-12T00:44:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.217+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4.2 2024-09-12T00:44:48.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.218+0000 7fd14affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:44:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.219+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.220+0000 7fd278923800 10 manifest: total_size = 5013 2024-09-12T00:44:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.220+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12893552250955710769 2024-09-12T00:44:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.220+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.220+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3241143e8 2024-09-12T00:44:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.220+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4.3 2024-09-12T00:44:48.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.221+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:44:48.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.223+0000 7fd278923800 20 get_obj_state: octx=0x55d324115040 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.223+0000 7fd278923800 10 manifest: total_size = 5203 2024-09-12T00:44:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.223+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1834553995373527686 2024-09-12T00:44:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.223+0000 7fd278923800 20 get_obj_state: octx=0x55d324115040 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.223+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3241143e8 2024-09-12T00:44:48.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.223+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4.4 2024-09-12T00:44:48.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.224+0000 7fd14affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:44:48.224 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.226+0000 7fd278923800 20 get_obj_state: octx=0x55d324115040 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.226+0000 7fd278923800 10 manifest: total_size = 7533 2024-09-12T00:44:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.226+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4991220995553428071 2024-09-12T00:44:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.226+0000 7fd278923800 20 get_obj_state: octx=0x55d324115040 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.226+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3241143e8 2024-09-12T00:44:48.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.226+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4.4 2024-09-12T00:44:48.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.227+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:44:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.229+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.229+0000 7fd278923800 10 manifest: total_size = 12854 2024-09-12T00:44:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.229+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7367362156146587954 2024-09-12T00:44:48.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.229+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.229+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3241143e8 2024-09-12T00:44:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.229+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4.5 2024-09-12T00:44:48.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.230+0000 7fd14affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:44:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.232+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.232+0000 7fd278923800 10 manifest: total_size = 5176 2024-09-12T00:44:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.232+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7690078609233617115 2024-09-12T00:44:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.232+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55d3241143e8 s->prefetch_data=0 2024-09-12T00:44:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.232+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3241143e8 2024-09-12T00:44:48.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.233+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4.7 2024-09-12T00:44:48.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.233+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:44:48.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.235+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55d32409c548 s->prefetch_data=0 2024-09-12T00:44:48.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.236+0000 7fd278923800 10 manifest: total_size = 8747 2024-09-12T00:44:48.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.236+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14374010409246068373 2024-09-12T00:44:48.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.236+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55d32409c548 s->prefetch_data=0 2024-09-12T00:44:48.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.236+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409c548 2024-09-12T00:44:48.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.236+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4.8 2024-09-12T00:44:48.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.236+0000 7fd14affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:44:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.238+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.238+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.241+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:44:48.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.241+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.241+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.241+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.241+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.241+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.243+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:44:48.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.243+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.243+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:44:48.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.243+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:44:48.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.243+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:44:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.244+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:44:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.244+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:44:48.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.245+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398868 cookie 94365330752128 notifier 5633 bl.length()=162 2024-09-12T00:44:48.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.247+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4 from cache 2024-09-12T00:44:48.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.247+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4, ofs0, ns] 2024-09-12T00:44:48.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.248+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398921 cookie 94365330808288 notifier 5633 bl.length()=219 2024-09-12T00:44:48.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.251+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4 : miss 2024-09-12T00:44:48.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.251+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.251+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.251+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4 info.flags=0x0 2024-09-12T00:44:48.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.251+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4 to cache LRU end 2024-09-12T00:44:48.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.253+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11 : miss 2024-09-12T00:44:48.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.253+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.254+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:44:48.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.254+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11 info.flags=0x17 2024-09-12T00:44:48.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.254+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11 to cache LRU end 2024-09-12T00:44:48.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.254+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.254+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.254+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11 2024-09-12T00:44:48.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.258+0000 7fd278923800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:44:48.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.258+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55d32409aa38 s->prefetch_data=0 2024-09-12T00:44:48.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.258+0000 7fd278923800 10 manifest: total_size = 886297 2024-09-12T00:44:48.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.258+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6665534206580483315 2024-09-12T00:44:48.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.258+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55d32409aa38 s->prefetch_data=0 2024-09-12T00:44:48.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.258+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409aa38 2024-09-12T00:44:48.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.258+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11.10 2024-09-12T00:44:48.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:44:48.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2024-09-12T00:44:48.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:44:48.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6665534206580483315 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11__multipart_foo.2~pywVykB0IpYUj7qQLcbv4ZoUeQcjKQq.1 2024-09-12T00:44:48.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:44:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11__multipart_foo.2~pywVykB0IpYUj7qQLcbv4ZoUeQcjKQq.2 2024-09-12T00:44:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:44:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11__multipart_foo.2~pywVykB0IpYUj7qQLcbv4ZoUeQcjKQq.3 2024-09-12T00:44:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:44:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11__multipart_foo.2~pywVykB0IpYUj7qQLcbv4ZoUeQcjKQq.4 2024-09-12T00:44:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:44:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.261+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6665534206580483315 2024-09-12T00:44:48.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.263+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:44:48.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.263+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.263+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.264+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.264+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.264+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.264+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.264+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.266+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:44:48.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.266+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.266+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:44:48.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.266+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:44:48.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.266+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:44:48.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.267+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:44:48.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.267+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:44:48.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.267+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398910 cookie 94365330754336 notifier 5633 bl.length()=191 2024-09-12T00:44:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.270+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11 from cache 2024-09-12T00:44:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.270+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11, ofs0, ns] 2024-09-12T00:44:48.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.270+0000 7fd14affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398911 cookie 94365330754336 notifier 5633 bl.length()=249 2024-09-12T00:44:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.274+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11 : miss 2024-09-12T00:44:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.274+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.274+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.274+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11 info.flags=0x0 2024-09-12T00:44:48.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.274+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11 to cache LRU end 2024-09-12T00:44:48.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.276+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12 : miss 2024-09-12T00:44:48.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.276+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.277+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:44:48.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.277+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12 info.flags=0x17 2024-09-12T00:44:48.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.277+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12 to cache LRU end 2024-09-12T00:44:48.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.277+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.277+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.277+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12 2024-09-12T00:44:48.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.282+0000 7fd278923800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:44:48.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.282+0000 7fd278923800 20 get_obj_state: octx=0x55d32409f1f0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.282+0000 7fd278923800 10 manifest: total_size = 26083 2024-09-12T00:44:48.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.282+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5440206347788700520 2024-09-12T00:44:48.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.282+0000 7fd278923800 20 get_obj_state: octx=0x55d32409f1f0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.282+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.282+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12.10 2024-09-12T00:44:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=4 2024-09-12T00:44:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=7671 2024-09-12T00:44:48.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7672 2024-09-12T00:44:48.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=7672 rules.size()=4 2024-09-12T00:44:48.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4197879 part_ofs=7671 rule->part_size=7672 2024-09-12T00:44:48.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=15343 stripe_ofs=15343 part_ofs=15343 rule->part_size=7673 2024-09-12T00:44:48.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=4 2024-09-12T00:44:48.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4205551 part_ofs=15343 rule->part_size=7673 2024-09-12T00:44:48.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=23016 stripe_ofs=23016 part_ofs=23016 rule->part_size=3067 2024-09-12T00:44:48.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=3067 rules.size()=4 2024-09-12T00:44:48.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4213224 part_ofs=23016 rule->part_size=3067 2024-09-12T00:44:48.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=26083 stripe_ofs=26083 part_ofs=26083 rule->part_size=3067 2024-09-12T00:44:48.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5440206347788700520 2024-09-12T00:44:48.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12__multipart_foo.2~iR_AdDCiLcSCEM7bGO-FITXdRzW0B0p.1 2024-09-12T00:44:48.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:44:48.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12__multipart_foo.2~iR_AdDCiLcSCEM7bGO-FITXdRzW0B0p.2 2024-09-12T00:44:48.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:44:48.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12__multipart_foo.2~iR_AdDCiLcSCEM7bGO-FITXdRzW0B0p.3 2024-09-12T00:44:48.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:44:48.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12__multipart_foo.2~iR_AdDCiLcSCEM7bGO-FITXdRzW0B0p.4 2024-09-12T00:44:48.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:44:48.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.285+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5440206347788700520 2024-09-12T00:44:48.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.286+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:44:48.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.286+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.286+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.287+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.287+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.287+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.287+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.287+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.289+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:44:48.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.289+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.289+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:44:48.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.289+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:44:48.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.289+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:44:48.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.290+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:44:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.290+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:44:48.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.291+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398867 cookie 94365330800752 notifier 5633 bl.length()=198 2024-09-12T00:44:48.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.293+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12 from cache 2024-09-12T00:44:48.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.293+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12, ofs0, ns] 2024-09-12T00:44:48.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.294+0000 7fd14affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398922 cookie 94365330813600 notifier 5633 bl.length()=256 2024-09-12T00:44:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.297+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12 : miss 2024-09-12T00:44:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.297+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.297+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.297+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12 info.flags=0x0 2024-09-12T00:44:48.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.297+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12 to cache LRU end 2024-09-12T00:44:48.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.299+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10 : miss 2024-09-12T00:44:48.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.299+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.300+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:44:48.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.300+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10 info.flags=0x17 2024-09-12T00:44:48.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.300+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10 to cache LRU end 2024-09-12T00:44:48.299 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.300+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.300+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.300+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10 2024-09-12T00:44:48.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.304+0000 7fd278923800 10 cls_bucket_list_unordered: got foo[IZgD7v-1sF.9uMwauL8IVHQlH6DWjpn] 2024-09-12T00:44:48.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.304+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10.10 2024-09-12T00:44:48.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.305+0000 7fd278923800 20 get_obj_state: octx=0x55d32409f1f0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.305+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 3rmawnu6d2u7i5kl8yq3vy01ks5qa76q 2024-09-12T00:44:48.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.305+0000 7fd278923800 20 get_obj_state_impl: setting s->olh_tag to 4znrfu3fdt3djn8nabkxgtuix7c0lp01 2024-09-12T00:44:48.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.305+0000 7fd278923800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=4znrfu3fdt3djn8nabkxgtuix7c0lp01 2024-09-12T00:44:48.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.306+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10.10 2024-09-12T00:44:48.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.308+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10.10 2024-09-12T00:44:48.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.308+0000 7fd278923800 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:44:48.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.308+0000 7fd278923800 20 olh_log_entry: epoch=3 op=3 key=foo[IZgD7v-1sF.9uMwauL8IVHQlH6DWjpn] 2024-09-12T00:44:48.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.308+0000 7fd278923800 20 get_obj_state: octx=0x55d32409f1f0 obj=test-client.0-r-test-multipart-index-versioning.1:_:IZgD7v-1sF.9uMwauL8IVHQlH6DWjpn_foo state=0x55d3240a0828 s->prefetch_data=0 2024-09-12T00:44:48.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.308+0000 7fd278923800 10 manifest: total_size = 74198 2024-09-12T00:44:48.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.308+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5279243247369810204 2024-09-12T00:44:48.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.308+0000 7fd278923800 20 get_obj_state: octx=0x55d32409f1f0 obj=test-client.0-r-test-multipart-index-versioning.1:_:IZgD7v-1sF.9uMwauL8IVHQlH6DWjpn_foo state=0x55d3240a0828 s->prefetch_data=0 2024-09-12T00:44:48.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.308+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a0828 2024-09-12T00:44:48.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.308+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10.10 2024-09-12T00:44:48.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:44:48.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2024-09-12T00:44:48.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:44:48.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:44:48.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2024-09-12T00:44:48.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:44:48.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:44:48.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=20613 2024-09-12T00:44:48.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:44:48.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4252047 part_ofs=61839 rule->part_size=12359 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5279243247369810204 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10__multipart_foo.2~FVKuaPnx342gprr07ZmWRNf8yo6xOHq.1 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10__multipart_foo.2~FVKuaPnx342gprr07ZmWRNf8yo6xOHq.2 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10__multipart_foo.2~FVKuaPnx342gprr07ZmWRNf8yo6xOHq.3 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10__multipart_foo.2~FVKuaPnx342gprr07ZmWRNf8yo6xOHq.4 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:44:48.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.311+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5279243247369810204 2024-09-12T00:44:48.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.312+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo[IZgD7v-1sF.9uMwauL8IVHQlH6DWjpn] 2024-09-12T00:44:48.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.314+0000 7fd278923800 20 get_obj_state: octx=0x55d32409f1f0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.315+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10.10 2024-09-12T00:44:48.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.316+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10.10 2024-09-12T00:44:48.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.316+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.316+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.317+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.317+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.317+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.317+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.316 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.317+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.319+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:44:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.319+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.320+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:44:48.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.320+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:44:48.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.320+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:44:48.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.320+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:44:48.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.320+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:44:48.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.321+0000 7fd14affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398868 cookie 94365330800752 notifier 5633 bl.length()=193 2024-09-12T00:44:48.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.323+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10 from cache 2024-09-12T00:44:48.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.323+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10, ofs0, ns] 2024-09-12T00:44:48.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.324+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398912 cookie 94365330807232 notifier 5633 bl.length()=251 2024-09-12T00:44:48.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.327+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10 : miss 2024-09-12T00:44:48.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.327+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.328+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.328+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10 info.flags=0x0 2024-09-12T00:44:48.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.328+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10 to cache LRU end 2024-09-12T00:44:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.330+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9 : miss 2024-09-12T00:44:48.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.330+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.330+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:44:48.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.330+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9 info.flags=0x17 2024-09-12T00:44:48.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.330+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9 to cache LRU end 2024-09-12T00:44:48.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.330+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.330+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.330+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9 2024-09-12T00:44:48.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.334+0000 7fd278923800 10 cls_bucket_list_unordered: got foo 2024-09-12T00:44:48.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.334+0000 7fd278923800 20 get_obj_state: octx=0x55d32409f1f0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55d3240983a8 s->prefetch_data=0 2024-09-12T00:44:48.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.335+0000 7fd278923800 10 manifest: total_size = 74198 2024-09-12T00:44:48.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.335+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15596505835200184670 2024-09-12T00:44:48.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.335+0000 7fd278923800 20 get_obj_state: octx=0x55d32409f1f0 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55d3240983a8 s->prefetch_data=0 2024-09-12T00:44:48.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.335+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240983a8 2024-09-12T00:44:48.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.335+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9.10 2024-09-12T00:44:48.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:44:48.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=20613 2024-09-12T00:44:48.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:44:48.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:44:48.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4210821 part_ofs=20613 rule->part_size=20613 2024-09-12T00:44:48.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4231434 part_ofs=41226 rule->part_size=20613 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4252047 part_ofs=61839 rule->part_size=12359 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15596505835200184670 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9__multipart_foo.2~6SFVDGLVVMscVDE9vKNqLbjk23fpUxT.1 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 345 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9__multipart_foo.2~6SFVDGLVVMscVDE9vKNqLbjk23fpUxT.2 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 589 2024-09-12T00:44:48.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9__multipart_foo.2~6SFVDGLVVMscVDE9vKNqLbjk23fpUxT.3 2024-09-12T00:44:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 833 2024-09-12T00:44:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9__multipart_foo.2~6SFVDGLVVMscVDE9vKNqLbjk23fpUxT.4 2024-09-12T00:44:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1077 2024-09-12T00:44:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.337+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15596505835200184670 2024-09-12T00:44:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.338+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:44:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.339+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.339+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.339+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.339+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.339+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.339+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.339+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.341+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:44:48.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.341+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.341+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:44:48.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.341+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:44:48.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.341+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:44:48.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.342+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:44:48.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.342+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:44:48.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.343+0000 7fd14affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398913 cookie 94365330807232 notifier 5633 bl.length()=183 2024-09-12T00:44:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.345+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9 from cache 2024-09-12T00:44:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.345+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9, ofs0, ns] 2024-09-12T00:44:48.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.345+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398868 cookie 94365330797008 notifier 5633 bl.length()=240 2024-09-12T00:44:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.349+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9 : miss 2024-09-12T00:44:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.349+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.349+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.349+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9 info.flags=0x0 2024-09-12T00:44:48.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.349+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9 to cache LRU end 2024-09-12T00:44:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.351+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15 : miss 2024-09-12T00:44:48.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.351+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.354+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:44:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.354+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15 info.flags=0x17 2024-09-12T00:44:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.354+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15 to cache LRU end 2024-09-12T00:44:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.354+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.354+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.354+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15 2024-09-12T00:44:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.354+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:44:48.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.355+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:44:48.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.355+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:44:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.356+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:44:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.356+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:44:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.356+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:44:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.357+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:44:48.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.357+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:44:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.357+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:44:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.358+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:44:48.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.358+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:44:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.358+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:44:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.358+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.359+0000 7fd278923800 10 manifest: total_size = 27195 2024-09-12T00:44:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.359+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _4jh3XSVzKcPKbPdNSH1UzBVUFoiooG0 2024-09-12T00:44:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.359+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.359+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.359+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.0 2024-09-12T00:44:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.361+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.361+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=27195 stripe_ofs=27195 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.361+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _4jh3XSVzKcPKbPdNSH1UzBVUFoiooG0 2024-09-12T00:44:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.361+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.361+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.w0aYziz0AAnJvKGqT80ABVAlUQnKQ94_0 2024-09-12T00:44:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.361+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:44:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.361+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.361+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _4jh3XSVzKcPKbPdNSH1UzBVUFoiooG0 2024-09-12T00:44:48.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.362+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:44:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.362+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.363+0000 7fd278923800 10 manifest: total_size = 5242880 2024-09-12T00:44:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.363+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _Dn2HZAmWVTl7jmCB64W7PCd6TA2kgOI 2024-09-12T00:44:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.363+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.363+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.363+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.2 2024-09-12T00:44:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.365+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.365+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.365+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _Dn2HZAmWVTl7jmCB64W7PCd6TA2kgOI 2024-09-12T00:44:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.365+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.365+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.e9LJDiNmIQHy4VZYn_6ShTAXR1ziKWh_1 2024-09-12T00:44:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.365+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:44:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.365+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.365+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: _Dn2HZAmWVTl7jmCB64W7PCd6TA2kgOI 2024-09-12T00:44:48.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.367+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:44:48.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.367+0000 7fd278923800 20 get_obj_state: octx=0x55d3240a5d10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.367+0000 7fd278923800 10 manifest: total_size = 5242880 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.367+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1359761561105354428 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.367+0000 7fd278923800 20 get_obj_state: octx=0x55d3240a5d10 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.367+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.367+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.3 2024-09-12T00:44:48.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1359761561105354428 2024-09-12T00:44:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.jp2dtLN_cDXyL8E-7LT41Bx08sJNwiP_0 2024-09-12T00:44:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:44:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.jp2dtLN_cDXyL8E-7LT41Bx08sJNwiP_1 2024-09-12T00:44:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:44:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.369+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1359761561105354428 2024-09-12T00:44:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.371+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:44:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.371+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.371+0000 7fd278923800 10 manifest: total_size = 5242880 2024-09-12T00:44:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.371+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _LsU8i_Q9RjTmId0k_NMKLRTc6ABuneQ 2024-09-12T00:44:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.371+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.371+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.371+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.5 2024-09-12T00:44:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _LsU8i_Q9RjTmId0k_NMKLRTc6ABuneQ 2024-09-12T00:44:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.Foq_hmkMAe_Rn-vQ4eQudkK1aMu4UhZ_0 2024-09-12T00:44:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:44:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.Foq_hmkMAe_Rn-vQ4eQudkK1aMu4UhZ_1 2024-09-12T00:44:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:44:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.373+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: _LsU8i_Q9RjTmId0k_NMKLRTc6ABuneQ 2024-09-12T00:44:48.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.375+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:44:48.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.375+0000 7fd278923800 20 get_obj_state: octx=0x7fd264076670 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.375+0000 7fd278923800 10 manifest: total_size = 5242880 2024-09-12T00:44:48.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.375+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _7AEWM2xdqEempY0QNNq1nVvzTLVmYSi 2024-09-12T00:44:48.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.375+0000 7fd278923800 20 get_obj_state: octx=0x7fd264076670 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.375+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.375+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.5 2024-09-12T00:44:48.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _7AEWM2xdqEempY0QNNq1nVvzTLVmYSi 2024-09-12T00:44:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.mqm_N3QWJawpJko8UHReeg-8_u_G1Cd_0 2024-09-12T00:44:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:44:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.mqm_N3QWJawpJko8UHReeg-8_u_G1Cd_1 2024-09-12T00:44:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:44:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.378+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _7AEWM2xdqEempY0QNNq1nVvzTLVmYSi 2024-09-12T00:44:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.379+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:44:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.379+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.378 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.380+0000 7fd278923800 10 manifest: total_size = 27195 2024-09-12T00:44:48.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.380+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5209802252542472596 2024-09-12T00:44:48.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.380+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.380+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.380+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.5 2024-09-12T00:44:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.382+0000 7fd278923800 20 get_obj_state: octx=0x55d3240a44e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.383+0000 7fd278923800 10 manifest: total_size = 5242880 2024-09-12T00:44:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.383+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _XRclkBQ3uU8S95nD0iaDFAg9erELWCo 2024-09-12T00:44:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.383+0000 7fd278923800 20 get_obj_state: octx=0x55d3240a44e0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.383+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.381 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.383+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.7 2024-09-12T00:44:48.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.384+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:44:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.385+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.385+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.385+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _XRclkBQ3uU8S95nD0iaDFAg9erELWCo 2024-09-12T00:44:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.385+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.385+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.SiaoEFo_brQrtJ0m8meG3HPTmhxHBuL_1 2024-09-12T00:44:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.385+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:44:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.385+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.385+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _XRclkBQ3uU8S95nD0iaDFAg9erELWCo 2024-09-12T00:44:48.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.386+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:44:48.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.387+0000 7fd278923800 20 get_obj_state: octx=0x7fd268049f00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.387+0000 7fd278923800 10 manifest: total_size = 5242880 2024-09-12T00:44:48.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.387+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14168597094602997839 2024-09-12T00:44:48.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.387+0000 7fd278923800 20 get_obj_state: octx=0x7fd268049f00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.387+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.387+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.7 2024-09-12T00:44:48.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.391+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.391+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.391+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.391+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.391+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14168597094602997839 2024-09-12T00:44:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.391+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.391+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.6OGuGVEmt6ziIE9C8j1SAF2mtuZRYDL_0 2024-09-12T00:44:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.391+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:44:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.391+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.6OGuGVEmt6ziIE9C8j1SAF2mtuZRYDL_1 2024-09-12T00:44:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.391+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T00:44:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.391+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.392+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14168597094602997839 2024-09-12T00:44:48.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.393+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:44:48.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.393+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.393+0000 7fd278923800 10 manifest: total_size = 27195 2024-09-12T00:44:48.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.393+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _fjLRfpV7DJV7waeSMWR-zmfoG0RBX0r 2024-09-12T00:44:48.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.393+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.393+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.393+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.7 2024-09-12T00:44:48.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.396+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.396+0000 7fd278923800 10 manifest: total_size = 5242880 2024-09-12T00:44:48.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.396+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3322312607224284375 2024-09-12T00:44:48.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.396+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.396+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.396+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.8 2024-09-12T00:44:48.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.397+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3322312607224284375 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.6OGuGVEmt6ziIE9C8j1SAF2mtuZRYDL_0 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.6OGuGVEmt6ziIE9C8j1SAF2mtuZRYDL_1 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.399+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3322312607224284375 2024-09-12T00:44:48.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.400+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:44:48.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.401+0000 7fd278923800 20 get_obj_state: octx=0x7fd268049f00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.401+0000 7fd278923800 10 manifest: total_size = 27195 2024-09-12T00:44:48.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.401+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _Q_9Wml6dWTsbk9tD-K0rSqyIJ5b9mT4 2024-09-12T00:44:48.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.401+0000 7fd278923800 20 get_obj_state: octx=0x7fd268049f00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.401+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.401+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.8 2024-09-12T00:44:48.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.404+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.404+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=27195 stripe_ofs=27195 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.404+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _Q_9Wml6dWTsbk9tD-K0rSqyIJ5b9mT4 2024-09-12T00:44:48.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.404+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.404+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.R4UvJeTKfOYxo9-DBdtn_OU6N50_ZJr_0 2024-09-12T00:44:48.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.404+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:44:48.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.404+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.404+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: _Q_9Wml6dWTsbk9tD-K0rSqyIJ5b9mT4 2024-09-12T00:44:48.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.405+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:44:48.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.405+0000 7fd278923800 20 get_obj_state: octx=0x7fd268049f00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.405+0000 7fd278923800 10 manifest: total_size = 5242880 2024-09-12T00:44:48.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.405+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7351978077085484376 2024-09-12T00:44:48.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.405+0000 7fd278923800 20 get_obj_state: octx=0x7fd268049f00 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55d32409bfd8 s->prefetch_data=0 2024-09-12T00:44:48.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.405+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d32409bfd8 2024-09-12T00:44:48.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.405+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15.9 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7351978077085484376 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.jp2dtLN_cDXyL8E-7LT41Bx08sJNwiP_0 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.jp2dtLN_cDXyL8E-7LT41Bx08sJNwiP_1 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.408+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7351978077085484376 2024-09-12T00:44:48.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.410+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:44:48.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.410+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.409 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.410+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.411+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.411+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.411+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.411+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.411+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.411 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.413+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:44:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.413+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.413+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:44:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.413+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:44:48.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.413+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:44:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.415+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:44:48.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.415+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:44:48.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.415+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398869 cookie 94365330800752 notifier 5633 bl.length()=189 2024-09-12T00:44:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.418+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15 from cache 2024-09-12T00:44:48.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.418+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15, ofs0, ns] 2024-09-12T00:44:48.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.418+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398914 cookie 94365330807232 notifier 5633 bl.length()=247 2024-09-12T00:44:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.422+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15 : miss 2024-09-12T00:44:48.420 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.422+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.422+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.422+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15 info.flags=0x0 2024-09-12T00:44:48.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.422+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15 to cache LRU end 2024-09-12T00:44:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.424+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16 : miss 2024-09-12T00:44:48.422 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.424+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.424+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:44:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.424+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16 info.flags=0x17 2024-09-12T00:44:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.424+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16 to cache LRU end 2024-09-12T00:44:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.424+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.424+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.424+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16 2024-09-12T00:44:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.425+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:44:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.425+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:44:48.424 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.426+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:44:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.426+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:44:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.426+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:44:48.425 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.426+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:44:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.427+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:44:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.427+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:44:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.427+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:44:48.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.428+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:44:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.428+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:44:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.428+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:44:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.428+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.429+0000 7fd278923800 10 manifest: total_size = 1087 2024-09-12T00:44:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.429+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _7YF162-Q5t-_j5SHYQyIeetx_JfqyVD 2024-09-12T00:44:48.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.429+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.429+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.429+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.0 2024-09-12T00:44:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.431+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.431+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.431+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _7YF162-Q5t-_j5SHYQyIeetx_JfqyVD 2024-09-12T00:44:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.431+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.431+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.sPPLEtlrVnZ2TEss33roJE_ct0VSIK4_0 2024-09-12T00:44:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.431+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:44:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.431+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.431+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _7YF162-Q5t-_j5SHYQyIeetx_JfqyVD 2024-09-12T00:44:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.432+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:44:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.433+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.433+0000 7fd278923800 10 manifest: total_size = 11534336 2024-09-12T00:44:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.433+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _fu25QoKmQN8DVarSv8XA249RwDgBh0h 2024-09-12T00:44:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.433+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.433+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.433+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.2 2024-09-12T00:44:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _fu25QoKmQN8DVarSv8XA249RwDgBh0h 2024-09-12T00:44:48.434 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.MA6mScv4JOMjVPYlsY18RH2s7QN4_h9_1 2024-09-12T00:44:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:44:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.MA6mScv4JOMjVPYlsY18RH2s7QN4_h9_2 2024-09-12T00:44:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:44:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.435+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _fu25QoKmQN8DVarSv8XA249RwDgBh0h 2024-09-12T00:44:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.437+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:44:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.437+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.437+0000 7fd278923800 10 manifest: total_size = 11534336 2024-09-12T00:44:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.437+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13589380348398336201 2024-09-12T00:44:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.437+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.437+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.437+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.3 2024-09-12T00:44:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:44:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:44:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13589380348398336201 2024-09-12T00:44:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.1 2024-09-12T00:44:48.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:44:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.1_1 2024-09-12T00:44:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T00:44:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.2 2024-09-12T00:44:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T00:44:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.2_1 2024-09-12T00:44:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T00:44:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.3 2024-09-12T00:44:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T00:44:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.441 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.440+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13589380348398336201 2024-09-12T00:44:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.441+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:44:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.442+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.442+0000 7fd278923800 10 manifest: total_size = 11534336 2024-09-12T00:44:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.442+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _ORFJYDeOMtz2sxMnzWNUFr0sseAPTrp 2024-09-12T00:44:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.442+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.442 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.442+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.443 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.442+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.5 2024-09-12T00:44:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.444 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _ORFJYDeOMtz2sxMnzWNUFr0sseAPTrp 2024-09-12T00:44:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.2NypNftmlARtb3KIK0UtH0Q6C9jiZP4_0 2024-09-12T00:44:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:44:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.2NypNftmlARtb3KIK0UtH0Q6C9jiZP4_1 2024-09-12T00:44:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:44:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.2NypNftmlARtb3KIK0UtH0Q6C9jiZP4_2 2024-09-12T00:44:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T00:44:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.445 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.445+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: _ORFJYDeOMtz2sxMnzWNUFr0sseAPTrp 2024-09-12T00:44:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.447+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:44:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.447+0000 7fd278923800 20 get_obj_state: octx=0x7fd268049f00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.447+0000 7fd278923800 10 manifest: total_size = 11534336 2024-09-12T00:44:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.447+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _z0FHcYY3HV6dbioHWwJl6h-NyR4RHsZ 2024-09-12T00:44:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.447+0000 7fd278923800 20 get_obj_state: octx=0x7fd268049f00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.446 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.447+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.447+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.5 2024-09-12T00:44:48.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.448 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _z0FHcYY3HV6dbioHWwJl6h-NyR4RHsZ 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.NgF2YsfllR-5GNi3GvUKXuZqrKQuH3L_0 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.NgF2YsfllR-5GNi3GvUKXuZqrKQuH3L_1 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.NgF2YsfllR-5GNi3GvUKXuZqrKQuH3L_2 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.449 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.449+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _z0FHcYY3HV6dbioHWwJl6h-NyR4RHsZ 2024-09-12T00:44:48.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.451+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:44:48.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.451+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.451+0000 7fd278923800 10 manifest: total_size = 1087 2024-09-12T00:44:48.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.451+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8933943863736858152 2024-09-12T00:44:48.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.451+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.451+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.451+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.5 2024-09-12T00:44:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:44:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-12T00:44:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:44:48.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=55 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8933943863736858152 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.1 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.2 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.3 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:44:48.453 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.453+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8933943863736858152 2024-09-12T00:44:48.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.455+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:44:48.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.455+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.454 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.455+0000 7fd278923800 10 manifest: total_size = 11534336 2024-09-12T00:44:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.455+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _J908ixsFL_Y4obn9MuNeV0zqbNhbn9x 2024-09-12T00:44:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.455+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.455+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.455 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.455+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.7 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _J908ixsFL_Y4obn9MuNeV0zqbNhbn9x 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.uRMcL1WDtrZwmQ8ovXCg22EHB8GJOGG_1 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.uRMcL1WDtrZwmQ8ovXCg22EHB8GJOGG_2 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.458+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.12tag is: _J908ixsFL_Y4obn9MuNeV0zqbNhbn9x 2024-09-12T00:44:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.460+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:44:48.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.460+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.460+0000 7fd278923800 10 manifest: total_size = 11534336 2024-09-12T00:44:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.460+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4654643825064238513 2024-09-12T00:44:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.460+0000 7fd278923800 20 get_obj_state: octx=0x7fd264065630 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.460+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.459 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.460+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.7 2024-09-12T00:44:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.461 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:44:48.462 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4654643825064238513 2024-09-12T00:44:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.1 2024-09-12T00:44:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:44:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.1_1 2024-09-12T00:44:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T00:44:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.2 2024-09-12T00:44:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T00:44:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.2_1 2024-09-12T00:44:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T00:44:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.3 2024-09-12T00:44:48.463 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T00:44:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.462+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4654643825064238513 2024-09-12T00:44:48.464 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.464+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:44:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.464+0000 7fd278923800 20 get_obj_state: octx=0x55d324114ad0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.464+0000 7fd278923800 10 manifest: total_size = 1087 2024-09-12T00:44:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.464+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.978535672187611597 2024-09-12T00:44:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.464+0000 7fd278923800 20 get_obj_state: octx=0x55d324114ad0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.464+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.465 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.464+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.7 2024-09-12T00:44:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:44:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=516 2024-09-12T00:44:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:44:48.466 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4190724 part_ofs=516 rule->part_size=516 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=55 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=55 rules.size()=2 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4191240 part_ofs=1032 rule->part_size=55 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=1087 rule->part_size=55 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.978535672187611597 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.1 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.2 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.3 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-12T00:44:48.467 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.467+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.978535672187611597 2024-09-12T00:44:48.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.469+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:44:48.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.469+0000 7fd278923800 20 get_obj_state: octx=0x55d3240b6b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.468 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.469+0000 7fd278923800 10 manifest: total_size = 11534336 2024-09-12T00:44:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.469+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4056489938823761789 2024-09-12T00:44:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.469+0000 7fd278923800 20 get_obj_state: octx=0x55d3240b6b00 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.469+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.469+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.8 2024-09-12T00:44:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4056489938823761789 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.1 2024-09-12T00:44:48.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:44:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.1_1 2024-09-12T00:44:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T00:44:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.2 2024-09-12T00:44:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T00:44:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.2_1 2024-09-12T00:44:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T00:44:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.3 2024-09-12T00:44:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T00:44:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.472+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4056489938823761789 2024-09-12T00:44:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.473+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:44:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.473+0000 7fd278923800 20 get_obj_state: octx=0x55d324099cb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.474+0000 7fd278923800 10 manifest: total_size = 1087 2024-09-12T00:44:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.474+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to _O3ejJQg0CXIZPTZssxoDV57D92PRbxK 2024-09-12T00:44:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.474+0000 7fd278923800 20 get_obj_state: octx=0x55d324099cb0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.474+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.474 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.474+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.8 2024-09-12T00:44:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.476+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.476+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=1087 stripe_ofs=1087 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.476+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: _O3ejJQg0CXIZPTZssxoDV57D92PRbxK 2024-09-12T00:44:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.476+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.476+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.DKWdtIS4RC0J6qT0oRd17lX-n74h1oC_0 2024-09-12T00:44:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.476+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:44:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.476+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.476+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: _O3ejJQg0CXIZPTZssxoDV57D92PRbxK 2024-09-12T00:44:48.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.478+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.478+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:44:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.478+0000 7fd278923800 10 manifest: total_size = 11534336 2024-09-12T00:44:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.478+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3467870845072686979 2024-09-12T00:44:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.478+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55d3240a8ea8 s->prefetch_data=0 2024-09-12T00:44:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.478+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a8ea8 2024-09-12T00:44:48.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.478+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16.9 2024-09-12T00:44:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3467870845072686979 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.1 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:44:48.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.1_1 2024-09-12T00:44:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:44:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.2 2024-09-12T00:44:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:44:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.2_1 2024-09-12T00:44:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:44:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.3 2024-09-12T00:44:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:44:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.481+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3467870845072686979 2024-09-12T00:44:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.482+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:44:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.483+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.483+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.484+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.484+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.484+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.484+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.484+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.485+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:44:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.485+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.486+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:44:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.486+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:44:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.486+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:44:48.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.487+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:44:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.487+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:44:48.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.487+0000 7fd14affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398869 cookie 94365330797008 notifier 5633 bl.length()=199 2024-09-12T00:44:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.490+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16 from cache 2024-09-12T00:44:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.490+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16, ofs0, ns] 2024-09-12T00:44:48.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.490+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398923 cookie 94365330815744 notifier 5633 bl.length()=257 2024-09-12T00:44:48.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.494+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16 : miss 2024-09-12T00:44:48.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.494+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.494+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.494+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16 info.flags=0x0 2024-09-12T00:44:48.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.494+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16 to cache LRU end 2024-09-12T00:44:48.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.497+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14 : miss 2024-09-12T00:44:48.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.497+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.497+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:44:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.497+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14 info.flags=0x17 2024-09-12T00:44:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.497+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14 to cache LRU end 2024-09-12T00:44:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.497+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.497+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.497+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14 2024-09-12T00:44:48.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.499+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:44:48.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.500+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:44:48.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.500+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:44:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.501+0000 7fd278923800 20 get_obj_state: octx=0x55d32409ebe0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.502+0000 7fd278923800 10 manifest: total_size = 11534336 2024-09-12T00:44:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.502+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16654132493071302455 2024-09-12T00:44:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.502+0000 7fd278923800 20 get_obj_state: octx=0x55d32409ebe0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.502+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a48e8 2024-09-12T00:44:48.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.502+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14.3 2024-09-12T00:44:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16654132493071302455 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-FROZEN.2~Hi6a8Suz1mikoyXWsk3Qb3IIk9l8PWk.1 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-FROZEN.2~Hi6a8Suz1mikoyXWsk3Qb3IIk9l8PWk.1_1 2024-09-12T00:44:48.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T00:44:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-FROZEN.2~Hi6a8Suz1mikoyXWsk3Qb3IIk9l8PWk.2 2024-09-12T00:44:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T00:44:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-FROZEN.2~Hi6a8Suz1mikoyXWsk3Qb3IIk9l8PWk.2_1 2024-09-12T00:44:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T00:44:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-FROZEN.2~Hi6a8Suz1mikoyXWsk3Qb3IIk9l8PWk.3 2024-09-12T00:44:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T00:44:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.504+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16654132493071302455 2024-09-12T00:44:48.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.505+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:44:48.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.506+0000 7fd278923800 20 get_obj_state: octx=0x55d32409c950 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.506+0000 7fd278923800 10 manifest: total_size = 11534336 2024-09-12T00:44:48.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.506+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.2383221703664704022 2024-09-12T00:44:48.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.506+0000 7fd278923800 20 get_obj_state: octx=0x55d32409c950 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.506+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a48e8 2024-09-12T00:44:48.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.506+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14.5 2024-09-12T00:44:48.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.2383221703664704022 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-STANDARD.2~YaobJVHN5e5S-SoUudQg8UmruJ_t-cR.1 2024-09-12T00:44:48.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:44:48.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-STANDARD.2~YaobJVHN5e5S-SoUudQg8UmruJ_t-cR.1_1 2024-09-12T00:44:48.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 626 2024-09-12T00:44:48.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-STANDARD.2~YaobJVHN5e5S-SoUudQg8UmruJ_t-cR.2 2024-09-12T00:44:48.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 890 2024-09-12T00:44:48.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-STANDARD.2~YaobJVHN5e5S-SoUudQg8UmruJ_t-cR.2_1 2024-09-12T00:44:48.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1152 2024-09-12T00:44:48.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-STANDARD.2~YaobJVHN5e5S-SoUudQg8UmruJ_t-cR.3 2024-09-12T00:44:48.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1416 2024-09-12T00:44:48.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.508+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.2383221703664704022 2024-09-12T00:44:48.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.510+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:44:48.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.512+0000 7fd278923800 20 get_obj_state: octx=0x55d3240a3040 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.512+0000 7fd278923800 10 manifest: total_size = 11534336 2024-09-12T00:44:48.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.512+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8554560583895401482 2024-09-12T00:44:48.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.512+0000 7fd278923800 20 get_obj_state: octx=0x55d3240a3040 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.512+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a48e8 2024-09-12T00:44:48.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.512+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14.7 2024-09-12T00:44:48.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:44:48.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8554560583895401482 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-LUKEWARM.2~bSTzICmqwwKp7Zz4clAgVGjWsI-Ylyv.1 2024-09-12T00:44:48.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:44:48.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-LUKEWARM.2~bSTzICmqwwKp7Zz4clAgVGjWsI-Ylyv.1_1 2024-09-12T00:44:48.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T00:44:48.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-LUKEWARM.2~bSTzICmqwwKp7Zz4clAgVGjWsI-Ylyv.2 2024-09-12T00:44:48.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T00:44:48.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-LUKEWARM.2~bSTzICmqwwKp7Zz4clAgVGjWsI-Ylyv.2_1 2024-09-12T00:44:48.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T00:44:48.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-LUKEWARM.2~bSTzICmqwwKp7Zz4clAgVGjWsI-Ylyv.3 2024-09-12T00:44:48.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T00:44:48.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.514+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8554560583895401482 2024-09-12T00:44:48.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.516+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:44:48.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.516+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.516+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.517+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.517+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.517+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.517+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.517+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.518+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:44:48.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.518+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.519+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:44:48.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.519+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:44:48.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.519+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:44:48.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.520+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:44:48.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.520+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:44:48.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.520+0000 7fd14affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398924 cookie 94365330808288 notifier 5633 bl.length()=194 2024-09-12T00:44:48.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.523+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14 from cache 2024-09-12T00:44:48.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.523+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14, ofs0, ns] 2024-09-12T00:44:48.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.523+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398925 cookie 94365330815744 notifier 5633 bl.length()=252 2024-09-12T00:44:48.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.527+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14 : miss 2024-09-12T00:44:48.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.527+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.527+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.527+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14 info.flags=0x0 2024-09-12T00:44:48.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.527+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14 to cache LRU end 2024-09-12T00:44:48.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.530+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13 : miss 2024-09-12T00:44:48.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.530+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.530+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:44:48.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.530+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13 info.flags=0x17 2024-09-12T00:44:48.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.530+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13 to cache LRU end 2024-09-12T00:44:48.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.530+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.530+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.530+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13 2024-09-12T00:44:48.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.532+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:44:48.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.532+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:44:48.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.533+0000 7fd278923800 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:44:48.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.534+0000 7fd278923800 20 get_obj_state: octx=0x55d3241167f0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.534+0000 7fd278923800 10 manifest: total_size = 10485760 2024-09-12T00:44:48.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.534+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15011727309784485814 2024-09-12T00:44:48.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.534+0000 7fd278923800 20 get_obj_state: octx=0x55d3241167f0 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.534+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a48e8 2024-09-12T00:44:48.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.535+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13.3 2024-09-12T00:44:48.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15011727309784485814 2024-09-12T00:44:48.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.bh3-nkBbN161J35wAgxCUE_eMd6SHFA_0 2024-09-12T00:44:48.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:44:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.bh3-nkBbN161J35wAgxCUE_eMd6SHFA_1 2024-09-12T00:44:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T00:44:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.bh3-nkBbN161J35wAgxCUE_eMd6SHFA_2 2024-09-12T00:44:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-12T00:44:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.537+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15011727309784485814 2024-09-12T00:44:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.538+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:44:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.538+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.539+0000 7fd278923800 10 manifest: total_size = 44258 2024-09-12T00:44:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.539+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12636895959110171467 2024-09-12T00:44:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.539+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.539+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a48e8 2024-09-12T00:44:48.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.539+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13.5 2024-09-12T00:44:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.541+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.541+0000 7fd278923800 10 manifest: total_size = 10485760 2024-09-12T00:44:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.541+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14288371563683417402 2024-09-12T00:44:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.541+0000 7fd278923800 20 get_obj_state: octx=0x7fd268026b40 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.541+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a48e8 2024-09-12T00:44:48.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.541+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13.7 2024-09-12T00:44:48.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.542+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:44:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:44:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:44:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14288371563683417402 2024-09-12T00:44:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:44:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.8mj80BeHca1S4OTUR_m69QYXl-etNDH_0 2024-09-12T00:44:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:44:48.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.8mj80BeHca1S4OTUR_m69QYXl-etNDH_1 2024-09-12T00:44:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T00:44:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.8mj80BeHca1S4OTUR_m69QYXl-etNDH_2 2024-09-12T00:44:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 818 2024-09-12T00:44:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:44:48.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.544+0000 7fd278923800 20 garbage collection: RGWGC::send_chain - on object name: gc.16tag is: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14288371563683417402 2024-09-12T00:44:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.545+0000 7fd14affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:44:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.545+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.545+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.546+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.546+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.546+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.546+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.546+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.548+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:44:48.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.548+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.548+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:44:48.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.548+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:44:48.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.548+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:44:48.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.549+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:44:48.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.549+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:44:48.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.549+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398870 cookie 94365330800752 notifier 5633 bl.length()=184 2024-09-12T00:44:48.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.552+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13 from cache 2024-09-12T00:44:48.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.552+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13, ofs0, ns] 2024-09-12T00:44:48.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.552+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398926 cookie 94365330813600 notifier 5633 bl.length()=242 2024-09-12T00:44:48.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.556+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13 : miss 2024-09-12T00:44:48.554 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.556+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.556+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.556+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13 info.flags=0x0 2024-09-12T00:44:48.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.556+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13 to cache LRU end 2024-09-12T00:44:48.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.558+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6 : miss 2024-09-12T00:44:48.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.558+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.558+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:44:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.558+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6 info.flags=0x17 2024-09-12T00:44:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.558+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6 to cache LRU end 2024-09-12T00:44:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.558+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.558+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.558+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6 2024-09-12T00:44:48.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.559+0000 7fd278923800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:44:48.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.560+0000 7fd278923800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:44:48.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.561+0000 7fd278923800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:44:48.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.561+0000 7fd278923800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:44:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.562+0000 7fd278923800 20 get_obj_state: octx=0x55d3241150e0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55d3240b5668 s->prefetch_data=0 2024-09-12T00:44:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.562+0000 7fd278923800 10 manifest: total_size = 0 2024-09-12T00:44:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.562+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.2855369048739763208 2024-09-12T00:44:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.562+0000 7fd278923800 20 get_obj_state: octx=0x55d3241150e0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55d3240b5668 s->prefetch_data=0 2024-09-12T00:44:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.562+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240b5668 2024-09-12T00:44:48.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.562+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6.2 2024-09-12T00:44:48.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.565+0000 7fd278923800 20 get_obj_state: octx=0x55d3241150e0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55d3240b5668 s->prefetch_data=0 2024-09-12T00:44:48.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.565+0000 7fd278923800 10 manifest: total_size = 0 2024-09-12T00:44:48.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.565+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9323362076038234524 2024-09-12T00:44:48.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.565+0000 7fd278923800 20 get_obj_state: octx=0x55d3241150e0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55d3240b5668 s->prefetch_data=0 2024-09-12T00:44:48.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.565+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240b5668 2024-09-12T00:44:48.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.565+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6.3 2024-09-12T00:44:48.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.567+0000 7fd14affd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:44:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.568+0000 7fd278923800 20 get_obj_state: octx=0x55d3241150e0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55d3240b5668 s->prefetch_data=0 2024-09-12T00:44:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.569+0000 7fd278923800 10 manifest: total_size = 0 2024-09-12T00:44:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.569+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18089877237334426095 2024-09-12T00:44:48.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.569+0000 7fd278923800 20 get_obj_state: octx=0x55d3241150e0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55d3240b5668 s->prefetch_data=0 2024-09-12T00:44:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.569+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240b5668 2024-09-12T00:44:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.569+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6.6 2024-09-12T00:44:48.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.570+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:44:48.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.571+0000 7fd278923800 20 get_obj_state: octx=0x55d3241150e0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55d3240b5668 s->prefetch_data=0 2024-09-12T00:44:48.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.572+0000 7fd278923800 10 manifest: total_size = 0 2024-09-12T00:44:48.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.572+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8187197695172800587 2024-09-12T00:44:48.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.572+0000 7fd278923800 20 get_obj_state: octx=0x55d3241150e0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55d3240b5668 s->prefetch_data=0 2024-09-12T00:44:48.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.572+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240b5668 2024-09-12T00:44:48.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.572+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6.8 2024-09-12T00:44:48.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.573+0000 7fd14affd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:44:48.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.575+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.575+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.576+0000 7fd14affd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:44:48.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.576+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.576+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.576+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.576+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.576+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.578+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:44:48.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.578+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.578+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:44:48.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.578+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:44:48.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.578+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:44:48.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.579+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:44:48.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.579+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:44:48.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.580+0000 7fd14affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398915 cookie 94365330754336 notifier 5633 bl.length()=181 2024-09-12T00:44:48.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.582+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6 from cache 2024-09-12T00:44:48.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.582+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6, ofs0, ns] 2024-09-12T00:44:48.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.582+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398869 cookie 94365330752128 notifier 5633 bl.length()=238 2024-09-12T00:44:48.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.588+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6 : miss 2024-09-12T00:44:48.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.588+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.588+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.588+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6 info.flags=0x0 2024-09-12T00:44:48.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.588+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6 to cache LRU end 2024-09-12T00:44:48.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.590+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7 : miss 2024-09-12T00:44:48.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.590+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.591+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:44:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.591+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7 info.flags=0x17 2024-09-12T00:44:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.591+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7 to cache LRU end 2024-09-12T00:44:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.591+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.591+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.591+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7 2024-09-12T00:44:48.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.592+0000 7fd278923800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:44:48.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.592+0000 7fd278923800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:44:48.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.593+0000 7fd278923800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:44:48.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.594+0000 7fd278923800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:44:48.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.595+0000 7fd278923800 20 get_obj_state: octx=0x55d3240b6430 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.595+0000 7fd278923800 10 manifest: total_size = 24595 2024-09-12T00:44:48.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.595+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13331206572602593579 2024-09-12T00:44:48.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.595+0000 7fd278923800 20 get_obj_state: octx=0x55d3240b6430 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.595+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a48e8 2024-09-12T00:44:48.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.595+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7.2 2024-09-12T00:44:48.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.598+0000 7fd278923800 20 get_obj_state: octx=0x55d3240b6430 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.598+0000 7fd278923800 10 manifest: total_size = 24595 2024-09-12T00:44:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.598+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10238032938042584456 2024-09-12T00:44:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.598+0000 7fd278923800 20 get_obj_state: octx=0x55d3240b6430 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.598+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a48e8 2024-09-12T00:44:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.598+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7.3 2024-09-12T00:44:48.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.599+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:44:48.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.601+0000 7fd278923800 20 get_obj_state: octx=0x55d3240b6430 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.601+0000 7fd278923800 10 manifest: total_size = 524288 2024-09-12T00:44:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.601+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8586558016374499381 2024-09-12T00:44:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.601+0000 7fd278923800 20 get_obj_state: octx=0x55d3240b6430 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.601+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a48e8 2024-09-12T00:44:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.601+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7.6 2024-09-12T00:44:48.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.602+0000 7fd14affd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:44:48.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.604+0000 7fd278923800 20 get_obj_state: octx=0x7fd26408c0d0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.604+0000 7fd278923800 10 manifest: total_size = 524288 2024-09-12T00:44:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.604+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15806083705129490715 2024-09-12T00:44:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.604+0000 7fd278923800 20 get_obj_state: octx=0x7fd26408c0d0 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55d3240a48e8 s->prefetch_data=0 2024-09-12T00:44:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.604+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240a48e8 2024-09-12T00:44:48.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.604+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7.8 2024-09-12T00:44:48.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.605+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:44:48.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.607+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.607+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.608+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:44:48.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.609+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.609+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.609+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.609+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.608 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.609+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.610+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:44:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.610+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.611+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:44:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.611+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:44:48.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.611+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:44:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.612+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:44:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.612+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:44:48.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.612+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398916 cookie 94365330754336 notifier 5633 bl.length()=181 2024-09-12T00:44:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.615+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7 from cache 2024-09-12T00:44:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.615+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7, ofs0, ns] 2024-09-12T00:44:48.614 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.615+0000 7fd14affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398870 cookie 94365330752128 notifier 5633 bl.length()=238 2024-09-12T00:44:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.619+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7 : miss 2024-09-12T00:44:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.619+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.619+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.619+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7 info.flags=0x0 2024-09-12T00:44:48.618 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.619+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7 to cache LRU end 2024-09-12T00:44:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.621+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8 : miss 2024-09-12T00:44:48.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.621+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.622+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:44:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.622+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8 info.flags=0x17 2024-09-12T00:44:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.622+0000 7fd278923800 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8 to cache LRU end 2024-09-12T00:44:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.622+0000 7fd278923800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.622+0000 7fd278923800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:44:48.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.622+0000 7fd278923800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8 2024-09-12T00:44:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.623+0000 7fd278923800 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:44:48.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.624+0000 7fd278923800 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:44:48.623 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.625+0000 7fd278923800 10 cls_bucket_list_unordered: got __ 2024-09-12T00:44:48.624 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.626+0000 7fd278923800 10 cls_bucket_list_unordered: got obj 2024-09-12T00:44:48.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.626+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55d3240b4d28 s->prefetch_data=0 2024-09-12T00:44:48.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.627+0000 7fd278923800 10 manifest: total_size = 49187 2024-09-12T00:44:48.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.627+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15952960851856175023 2024-09-12T00:44:48.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.627+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55d3240b4d28 s->prefetch_data=0 2024-09-12T00:44:48.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.627+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240b4d28 2024-09-12T00:44:48.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.627+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8.2 2024-09-12T00:44:48.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.630+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55d3240b4d28 s->prefetch_data=0 2024-09-12T00:44:48.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.630+0000 7fd278923800 10 manifest: total_size = 1048576 2024-09-12T00:44:48.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.630+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9840097343804022553 2024-09-12T00:44:48.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.630+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55d3240b4d28 s->prefetch_data=0 2024-09-12T00:44:48.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.630+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240b4d28 2024-09-12T00:44:48.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.630+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8.3 2024-09-12T00:44:48.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.631+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:44:48.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.633+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55d3240b4d28 s->prefetch_data=0 2024-09-12T00:44:48.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.633+0000 7fd278923800 10 manifest: total_size = 1048576 2024-09-12T00:44:48.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.633+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10047808333606905825 2024-09-12T00:44:48.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.633+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55d3240b4d28 s->prefetch_data=0 2024-09-12T00:44:48.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.633+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240b4d28 2024-09-12T00:44:48.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.633+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8.6 2024-09-12T00:44:48.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.634+0000 7fd14affd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:44:48.634 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.636+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55d3240b4d28 s->prefetch_data=0 2024-09-12T00:44:48.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.636+0000 7fd278923800 10 manifest: total_size = 4134 2024-09-12T00:44:48.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.636+0000 7fd278923800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3041402666453630804 2024-09-12T00:44:48.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.636+0000 7fd278923800 20 get_obj_state: octx=0x7fd2640027a0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55d3240b4d28 s->prefetch_data=0 2024-09-12T00:44:48.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.636+0000 7fd278923800 20 prepare_atomic_modification: state is not atomic. state=0x55d3240b4d28 2024-09-12T00:44:48.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.636+0000 7fd278923800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8.8 2024-09-12T00:44:48.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.637+0000 7fd14b7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:44:48.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.639+0000 7fd278923800 20 list_objects_ordered: starting attempt 1 2024-09-12T00:44:48.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.639+0000 7fd278923800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:44:48.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.640+0000 7fd14affd640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:44:48.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.641+0000 7fd278923800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:44:48.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.641+0000 7fd278923800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:44:48.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.641+0000 7fd278923800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:44:48.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.641+0000 7fd278923800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:44:48.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.641+0000 7fd278923800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:44:48.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.642+0000 7fd278923800 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:44:48.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.642+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.643+0000 7fd278923800 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:44:48.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.643+0000 7fd278923800 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:44:48.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.643+0000 7fd278923800 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:44:48.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.644+0000 7fd278923800 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:44:48.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.644+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:44:48.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.644+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398917 cookie 94365330754336 notifier 5633 bl.length()=181 2024-09-12T00:44:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.647+0000 7fd278923800 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8 from cache 2024-09-12T00:44:48.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.647+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8, ofs0, ns] 2024-09-12T00:44:48.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.647+0000 7fd14affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398871 cookie 94365330752128 notifier 5633 bl.length()=238 2024-09-12T00:44:48.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.653+0000 7fd278923800 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8 : miss 2024-09-12T00:44:48.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.653+0000 7fd278923800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.653+0000 7fd278923800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.653+0000 7fd278923800 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8 info.flags=0x0 2024-09-12T00:44:48.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.653+0000 7fd278923800 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8 to cache LRU end 2024-09-12T00:44:48.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.655+0000 7fd278923800 10 removing key index: CRZTWOCKAOAXNBNGTCXH 2024-09-12T00:44:48.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.656+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:CRZTWOCKAOAXNBNGTCXH, ofs0, ns] 2024-09-12T00:44:48.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.656+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398871 cookie 94365330800752 notifier 5633 bl.length()=170 2024-09-12T00:44:48.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.658+0000 7fd278923800 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:44:48.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.659+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:44:48.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.659+0000 7fd14affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398872 cookie 94365330800752 notifier 5633 bl.length()=182 2024-09-12T00:44:48.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.660+0000 7fd278923800 10 removing user buckets index 2024-09-12T00:44:48.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.661+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:44:48.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.661+0000 7fd14b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398927 cookie 94365330808288 notifier 5633 bl.length()=173 2024-09-12T00:44:48.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.663+0000 7fd278923800 10 removing user index: ragweed.client.0 2024-09-12T00:44:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.664+0000 7fd278923800 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:44:48.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.664+0000 7fd278923800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:44:48.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.664+0000 7fd14affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398918 cookie 94365330807232 notifier 5633 bl.length()=165 2024-09-12T00:44:48.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.668+0000 7fd12afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.670+0000 7fd278923800 20 remove_watcher() i=0 2024-09-12T00:44:48.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.670+0000 7fd278923800 2 removed watcher, disabling cache 2024-09-12T00:44:48.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.671+0000 7fd278923800 20 remove_watcher() i=1 2024-09-12T00:44:48.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.672+0000 7fd278923800 20 remove_watcher() i=2 2024-09-12T00:44:48.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.673+0000 7fd278923800 20 remove_watcher() i=3 2024-09-12T00:44:48.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.674+0000 7fd278923800 20 remove_watcher() i=4 2024-09-12T00:44:48.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.675+0000 7fd278923800 20 remove_watcher() i=5 2024-09-12T00:44:48.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.676+0000 7fd278923800 20 remove_watcher() i=6 2024-09-12T00:44:48.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.677+0000 7fd278923800 20 remove_watcher() i=7 2024-09-12T00:44:48.687 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:44:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:44:48.745 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:44:48.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.782+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.784+0000 7ffb0af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.784+0000 7ffb0af19800 20 realm 2024-09-12T00:44:48.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.784+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.784+0000 7ffb0af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.784+0000 7ffb0af19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:44:48.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.784+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.784+0000 7ffb0af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.784+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.785+0000 7ffb0af19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:48.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.785+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.785+0000 7ffb0af19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:44:48.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.785+0000 7ffb0af19800 20 searching for the correct realm 2024-09-12T00:44:48.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.788+0000 7ffb08202640 0 -- 172.21.15.19:0/239244394 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7ffaf00c6890 msgr2=0x7ffaf00cd1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:44:48.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.993+0000 7ffb09204640 0 -- 172.21.15.19:0/239244394 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55e6e31b2750 msgr2=0x55e6e31b4ba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:44:48.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.997+0000 7ffb0af19800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:44:48.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.997+0000 7ffb0af19800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:44:48.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.997+0000 7ffb0af19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:44:48.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.997+0000 7ffb0af19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:44:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.997+0000 7ffb0af19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:44:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.997+0000 7ffb0af19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:44:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.997+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.998+0000 7ffb0af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.998+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.998+0000 7ffb0af19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:44:48.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.998+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:48.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:44:48.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 20 zone default found 2024-09-12T00:44:48.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 4 Realm: () 2024-09-12T00:44:48.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:44:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:44:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:44:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 20 zonegroup default 2024-09-12T00:44:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:48.999+0000 7ffb0af19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:44:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.000+0000 7ffb0af19800 20 started sync module instance, tier type = 2024-09-12T00:44:49.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.000+0000 7ffb0af19800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:44:49.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.008+0000 7ffb0af19800 20 add_watcher() i=0 2024-09-12T00:44:49.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.008+0000 7ffb0af19800 20 add_watcher() i=1 2024-09-12T00:44:49.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.008+0000 7ffb0af19800 20 add_watcher() i=2 2024-09-12T00:44:49.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.008+0000 7ffb0af19800 20 add_watcher() i=3 2024-09-12T00:44:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.008+0000 7ffb0af19800 20 add_watcher() i=4 2024-09-12T00:44:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.008+0000 7ffb0af19800 20 add_watcher() i=5 2024-09-12T00:44:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.008+0000 7ffb0af19800 20 add_watcher() i=6 2024-09-12T00:44:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.010+0000 7ffb0af19800 20 add_watcher() i=7 2024-09-12T00:44:49.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.010+0000 7ffb0af19800 2 all 8 watchers are set, enabling cache 2024-09-12T00:44:49.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.011+0000 7ff9bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:49.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.012+0000 7ffb0af19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:44:49.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.012+0000 7ffb0af19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:44:49.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.047+0000 7ff9be7e4640 20 reqs_thread_entry: start 2024-09-12T00:44:49.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.047+0000 7ffb0af19800 20 init_complete bucket index max shards: 11 2024-09-12T00:44:49.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.047+0000 7ffb0af19800 20 Filter name: none 2024-09-12T00:44:49.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.047+0000 7ff9b7fff640 20 reqs_thread_entry: start 2024-09-12T00:44:49.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.047+0000 7ffb0af19800 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:44:49.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.047+0000 7ffb0af19800 20 rados->read ofs=0 len=0 2024-09-12T00:44:49.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.047+0000 7ffb0af19800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:44:49.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.047+0000 7ffb0af19800 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:44:49.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.047+0000 7ffb0af19800 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:44:49.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.047+0000 7ffb0af19800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:44:49.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.048+0000 7ffb0af19800 10 removing key index: YRYZWQJHAVGHWOSMGSQN 2024-09-12T00:44:49.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.049+0000 7ffb0af19800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:YRYZWQJHAVGHWOSMGSQN, ofs0, ns] 2024-09-12T00:44:49.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.049+0000 7ff9dffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 94450141101952 notifier 5958 bl.length()=170 2024-09-12T00:44:49.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.051+0000 7ffb0af19800 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:44:49.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.052+0000 7ffb0af19800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:44:49.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.052+0000 7ff9df7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398919 cookie 94450141106000 notifier 5958 bl.length()=182 2024-09-12T00:44:49.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.053+0000 7ffb0af19800 10 removing user buckets index 2024-09-12T00:44:49.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.054+0000 7ffb0af19800 10 removing user index: sysuser.client.0 2024-09-12T00:44:49.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.055+0000 7ffb0af19800 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:44:49.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.055+0000 7ffb0af19800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:44:49.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.055+0000 7ff9df7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398874 cookie 94450141101952 notifier 5958 bl.length()=165 2024-09-12T00:44:49.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.058+0000 7ff9bf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:44:49.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.060+0000 7ffb0af19800 20 remove_watcher() i=0 2024-09-12T00:44:49.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.060+0000 7ffb0af19800 2 removed watcher, disabling cache 2024-09-12T00:44:49.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.061+0000 7ffb0af19800 20 remove_watcher() i=1 2024-09-12T00:44:49.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.062+0000 7ffb0af19800 20 remove_watcher() i=2 2024-09-12T00:44:49.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.063+0000 7ffb0af19800 20 remove_watcher() i=3 2024-09-12T00:44:49.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.064+0000 7ffb0af19800 20 remove_watcher() i=4 2024-09-12T00:44:49.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.065+0000 7ffb0af19800 20 remove_watcher() i=5 2024-09-12T00:44:49.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.066+0000 7ffb0af19800 20 remove_watcher() i=6 2024-09-12T00:44:49.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:44:49.067+0000 7ffb0af19800 20 remove_watcher() i=7 2024-09-12T00:44:49.077 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:44:49.077 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:44:49.162 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:44:49.173 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:44:49.173 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:44:49.173 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:44:49.203 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:44:49.203 INFO:teuthology.orchestra.run.smithi019.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:44:49.203 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:44:49.273 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:44:49.274 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:44:49.343 INFO:tasks.workunit:timeout=3h 2024-09-12T00:44:49.343 INFO:tasks.workunit:cleanup=True 2024-09-12T00:44:49.344 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:44:49.414 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:45:51.732 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:45:51.733 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-09-12T00:45:51.734 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:45:51.734 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-09-12T00:45:51.734 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:45:51.734 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:45:51.734 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:45:51.734 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:45:51.737 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:45:51.806 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:45:51.808 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:45:51.809 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:45:51.861 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:45:51.911 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:45:51.952 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:45:51.954 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:45:51.954 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:45:51.995 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:45:51.998 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:45:51.998 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:45:52.069 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:45:52.070 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:45:52.070 DEBUG:teuthology.orchestra.run.smithi019:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:45:52.143 INFO:tasks.workunit.client.0.smithi019.stderr:+ ulimit -c 0 2024-09-12T00:45:52.143 INFO:tasks.workunit.client.0.smithi019.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:45:52.144 INFO:tasks.workunit.client.0.smithi019.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:45:52.144 INFO:tasks.workunit.client.0.smithi019.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:45:54.533 INFO:tasks.workunit.client.0.smithi019.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:45:54.533 INFO:tasks.workunit.client.0.smithi019.stderr:++ deactivate nondestructive 2024-09-12T00:45:54.533 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ hash -r 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ export VIRTUAL_ENV 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ export PATH 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T00:45:54.534 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -z '' ']' 2024-09-12T00:45:54.535 INFO:tasks.workunit.client.0.smithi019.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:45:54.535 INFO:tasks.workunit.client.0.smithi019.stderr:++ PS1='(rgw) ' 2024-09-12T00:45:54.535 INFO:tasks.workunit.client.0.smithi019.stderr:++ export PS1 2024-09-12T00:45:54.535 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:45:54.535 INFO:tasks.workunit.client.0.smithi019.stderr:++ hash -r 2024-09-12T00:45:54.535 INFO:tasks.workunit.client.0.smithi019.stderr:+ pip install pip --upgrade 2024-09-12T00:45:54.774 INFO:tasks.workunit.client.0.smithi019.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T00:45:54.962 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting pip 2024-09-12T00:45:54.968 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:45:55.015 INFO:tasks.workunit.client.0.smithi019.stdout:Installing collected packages: pip 2024-09-12T00:45:55.015 INFO:tasks.workunit.client.0.smithi019.stdout: Attempting uninstall: pip 2024-09-12T00:45:55.015 INFO:tasks.workunit.client.0.smithi019.stdout: Found existing installation: pip 21.3.1 2024-09-12T00:45:55.177 INFO:tasks.workunit.client.0.smithi019.stdout: Uninstalling pip-21.3.1: 2024-09-12T00:45:55.183 INFO:tasks.workunit.client.0.smithi019.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T00:45:55.950 INFO:tasks.workunit.client.0.smithi019.stdout:Successfully installed pip-24.2 2024-09-12T00:45:55.999 INFO:tasks.workunit.client.0.smithi019.stderr:+ pip install boto3 2024-09-12T00:45:56.805 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting boto3 2024-09-12T00:45:56.807 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:45:57.362 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:45:57.364 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:45:57.418 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:45:57.419 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:45:57.472 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:45:57.474 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:45:57.534 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:45:57.535 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:45:57.610 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:45:57.611 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T00:45:57.754 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:45:57.756 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:45:57.760 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:45:57.762 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:45:57.772 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:45:57.773 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:45:57.774 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:45:57.776 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T00:45:57.777 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:45:57.858 INFO:tasks.workunit.client.0.smithi019.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:45:58.885 INFO:tasks.workunit.client.0.smithi019.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T00:45:59.002 INFO:tasks.workunit.client.0.smithi019.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:45:59.132 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:45:59.167 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:45:59.167 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:45:59.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.208+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.210+0000 7f8c29c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.210+0000 7f8c29c40800 20 realm 2024-09-12T00:45:59.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.210+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.210+0000 7f8c29c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.210+0000 7f8c29c40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:45:59.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.210+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.210+0000 7f8c29c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.210+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.211+0000 7f8c29c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:59.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.211+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.212+0000 7f8c29c40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:45:59.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.212+0000 7f8c29c40800 20 searching for the correct realm 2024-09-12T00:45:59.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.215+0000 7f8c26f29640 0 -- 172.21.15.19:0/4178762584 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f8c1c099bd0 msgr2=0x7f8c1c082120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:45:59.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.421+0000 7f8c26f29640 0 -- 172.21.15.19:0/4178762584 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5556052f0550 msgr2=0x5556052f29f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:45:59.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.426+0000 7f8c29c40800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:45:59.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.426+0000 7f8c29c40800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:45:59.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.426+0000 7f8c29c40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:45:59.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.426+0000 7f8c29c40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:45:59.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.426+0000 7f8c29c40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:45:59.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.426+0000 7f8c29c40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:45:59.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.426+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.426+0000 7f8c29c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.426+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:45:59.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:45:59.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 20 zone default found 2024-09-12T00:45:59.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 4 Realm: () 2024-09-12T00:45:59.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:45:59.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:45:59.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:45:59.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 20 zonegroup default 2024-09-12T00:45:59.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.427+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.428+0000 7f8c29c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.428+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.428+0000 7f8c29c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.428+0000 7f8c29c40800 20 started sync module instance, tier type = 2024-09-12T00:45:59.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.428+0000 7f8c29c40800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:45:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.438+0000 7f8c29c40800 20 add_watcher() i=0 2024-09-12T00:45:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.438+0000 7f8c29c40800 20 add_watcher() i=1 2024-09-12T00:45:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.438+0000 7f8c29c40800 20 add_watcher() i=2 2024-09-12T00:45:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.438+0000 7f8c29c40800 20 add_watcher() i=3 2024-09-12T00:45:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.438+0000 7f8c29c40800 20 add_watcher() i=4 2024-09-12T00:45:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.438+0000 7f8c29c40800 20 add_watcher() i=5 2024-09-12T00:45:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.438+0000 7f8c29c40800 20 add_watcher() i=6 2024-09-12T00:45:59.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.439+0000 7f8c29c40800 20 add_watcher() i=7 2024-09-12T00:45:59.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.439+0000 7f8c29c40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:45:59.441 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.442+0000 7f8addfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:59.442 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.442+0000 7f8c29c40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:45:59.442 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.442+0000 7f8c29c40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:45:59.442 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.442+0000 7f8c29c40800 5 note: GC not initialized 2024-09-12T00:45:59.442 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.442+0000 7f8adcfe1640 20 reqs_thread_entry: start 2024-09-12T00:45:59.442 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.442+0000 7f8c29c40800 20 init_complete bucket index max shards: 11 2024-09-12T00:45:59.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.442+0000 7f8c29c40800 20 Filter name: none 2024-09-12T00:45:59.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.442+0000 7f8a567fc640 20 reqs_thread_entry: start 2024-09-12T00:45:59.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:45:59.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:45:59.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:45:59.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:45:59.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 20 rados->read ofs=0 len=0 2024-09-12T00:45:59.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:45:59.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T00:45:59.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:45:59.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:45:59.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.443+0000 7f8c29c40800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:45:59.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.445+0000 7f8c29c40800 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:45:59.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.445+0000 7f8c29c40800 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:45:59.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.445+0000 7f8c29c40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T00:45:59.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.445+0000 7f8b0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398928 cookie 93827942579024 notifier 5666 bl.length()=569 2024-09-12T00:45:59.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.445+0000 7f8b0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:45:59.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.445+0000 7f8b0affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:45:59.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.448+0000 7f8c29c40800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:45:59.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.448+0000 7f8c29c40800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:45:59.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.448+0000 7f8c29c40800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T00:45:59.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.449+0000 7f8b0affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398929 cookie 93827942567888 notifier 5666 bl.length()=180 2024-09-12T00:45:59.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.449+0000 7f8b0affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:45:59.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.449+0000 7f8b0affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:45:59.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.451+0000 7f8addfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:45:59.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.454+0000 7f8c29c40800 20 remove_watcher() i=0 2024-09-12T00:45:59.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.454+0000 7f8c29c40800 2 removed watcher, disabling cache 2024-09-12T00:45:59.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.455+0000 7f8c29c40800 20 remove_watcher() i=1 2024-09-12T00:45:59.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.456+0000 7f8c29c40800 20 remove_watcher() i=2 2024-09-12T00:45:59.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.457+0000 7f8c29c40800 20 remove_watcher() i=3 2024-09-12T00:45:59.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.458+0000 7f8c29c40800 20 remove_watcher() i=4 2024-09-12T00:45:59.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.460+0000 7f8c29c40800 20 remove_watcher() i=5 2024-09-12T00:45:59.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.461+0000 7f8c29c40800 20 remove_watcher() i=6 2024-09-12T00:45:59.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:45:59.462+0000 7f8c29c40800 20 remove_watcher() i=7 2024-09-12T00:46:10.603 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:10.603 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:10.652 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:10.653 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:10.701 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:10.701 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:10.750 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:10.750 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:10.781 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:10.781 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:10.842 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:10.842 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:10.898 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard add 2024-09-12T00:46:10.898 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:10.899 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:46:10.928 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:10.928 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:10.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.968+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.970+0000 7fe6f811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.970+0000 7fe6f811f800 20 realm 2024-09-12T00:46:10.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.970+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.970+0000 7fe6f811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.970+0000 7fe6f811f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:10.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.970+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.971+0000 7fe6f811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:10.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.971+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.971+0000 7fe6f811f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:10.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.971+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:10.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.972+0000 7fe6f811f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:10.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.972+0000 7fe6f811f800 20 searching for the correct realm 2024-09-12T00:46:10.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:10.975+0000 7fe6f36a8640 0 -- 172.21.15.19:0/3725953459 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fe6e80880e0 msgr2=0x7fe6e80918d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:11.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.180+0000 7fe6f36a8640 0 -- 172.21.15.19:0/3725953459 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x562186ffba70 msgr2=0x562186ffdf30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:11.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.185+0000 7fe6f811f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:11.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.185+0000 7fe6f811f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:11.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.185+0000 7fe6f811f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:11.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.185+0000 7fe6f811f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:11.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.185+0000 7fe6f811f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:11.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.185+0000 7fe6f811f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:11.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.185+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.185+0000 7fe6f811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.185+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.185+0000 7fe6f811f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:11.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.185+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.186+0000 7fe6f811f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:11.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.186+0000 7fe6f811f800 20 zone default found 2024-09-12T00:46:11.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.186+0000 7fe6f811f800 4 Realm: () 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.186+0000 7fe6f811f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.186+0000 7fe6f811f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.186+0000 7fe6f811f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.186+0000 7fe6f811f800 20 zonegroup default 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.186+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.186+0000 7fe6f811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.186+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.187+0000 7fe6f811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.187+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.187+0000 7fe6f811f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.187+0000 7fe6f811f800 20 started sync module instance, tier type = 2024-09-12T00:46:11.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.187+0000 7fe6f811f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:11.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.197+0000 7fe6f811f800 20 add_watcher() i=0 2024-09-12T00:46:11.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.197+0000 7fe6f811f800 20 add_watcher() i=1 2024-09-12T00:46:11.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.197+0000 7fe6f811f800 20 add_watcher() i=2 2024-09-12T00:46:11.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.197+0000 7fe6f811f800 20 add_watcher() i=3 2024-09-12T00:46:11.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.197+0000 7fe6f811f800 20 add_watcher() i=4 2024-09-12T00:46:11.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.197+0000 7fe6f811f800 20 add_watcher() i=5 2024-09-12T00:46:11.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.198+0000 7fe6f811f800 20 add_watcher() i=6 2024-09-12T00:46:11.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.199+0000 7fe6f811f800 20 add_watcher() i=7 2024-09-12T00:46:11.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.199+0000 7fe6f811f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:11.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.201+0000 7fe5a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.201+0000 7fe6f811f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:11.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.201+0000 7fe6f811f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:11.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.201+0000 7fe6f811f800 5 note: GC not initialized 2024-09-12T00:46:11.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.201+0000 7fe5a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:11.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.201+0000 7fe6f811f800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:11.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.201+0000 7fe6f811f800 20 Filter name: none 2024-09-12T00:46:11.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.201+0000 7fe5227fc640 20 reqs_thread_entry: start 2024-09-12T00:46:11.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.202+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.202+0000 7fe6f811f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:11.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.202+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.203+0000 7fe6f811f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:11.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.203+0000 7fe6f811f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:11.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.203+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.203+0000 7fe6f811f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:11.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.203+0000 7fe6f811f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.203+0000 7fe6f811f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:11.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.203+0000 7fe6f811f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:11.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.205+0000 7fe5a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.207+0000 7fe6f811f800 20 remove_watcher() i=0 2024-09-12T00:46:11.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.207+0000 7fe6f811f800 2 removed watcher, disabling cache 2024-09-12T00:46:11.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.208+0000 7fe6f811f800 20 remove_watcher() i=1 2024-09-12T00:46:11.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.209+0000 7fe6f811f800 20 remove_watcher() i=2 2024-09-12T00:46:11.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.211+0000 7fe6f811f800 20 remove_watcher() i=3 2024-09-12T00:46:11.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.212+0000 7fe6f811f800 20 remove_watcher() i=4 2024-09-12T00:46:11.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.213+0000 7fe6f811f800 20 remove_watcher() i=5 2024-09-12T00:46:11.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.214+0000 7fe6f811f800 20 remove_watcher() i=6 2024-09-12T00:46:11.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.215+0000 7fe6f811f800 20 remove_watcher() i=7 2024-09-12T00:46:11.226 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:11.226 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:11.226 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: a-bucket id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:46:11.226 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:11.227 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T00:46:11.260 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:11.260 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:11.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.300+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.302+0000 7f8ab9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.302+0000 7f8ab9335800 20 realm 2024-09-12T00:46:11.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.302+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.302+0000 7f8ab9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.302+0000 7f8ab9335800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:11.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.302+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.302+0000 7f8ab9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.302+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.303+0000 7f8ab9335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:11.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.303+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.303+0000 7f8ab9335800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:11.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.303+0000 7f8ab9335800 20 searching for the correct realm 2024-09-12T00:46:11.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.307+0000 7f8ab48e3640 0 -- 172.21.15.19:0/2385520762 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f8aac0c57f0 msgr2=0x7f8aac0a9cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:11.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.513+0000 7f8ab58e5640 0 -- 172.21.15.19:0/2385520762 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55e24e046ad0 msgr2=0x55e24e048f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:11.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.517+0000 7f8ab9335800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:11.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.517+0000 7f8ab9335800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:11.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.517+0000 7f8ab9335800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:11.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.517+0000 7f8ab9335800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:11.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.517+0000 7f8ab9335800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:11.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.517+0000 7f8ab9335800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:11.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.518+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.518+0000 7f8ab9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.518+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.518 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.518+0000 7f8ab9335800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:11.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.518+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 20 zone default found 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 4 Realm: () 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 20 zonegroup default 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 20 started sync module instance, tier type = 2024-09-12T00:46:11.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.519+0000 7f8ab9335800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:11.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.529+0000 7f8ab9335800 20 add_watcher() i=0 2024-09-12T00:46:11.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.529+0000 7f8ab9335800 20 add_watcher() i=1 2024-09-12T00:46:11.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.529+0000 7f8ab9335800 20 add_watcher() i=2 2024-09-12T00:46:11.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.529+0000 7f8ab9335800 20 add_watcher() i=3 2024-09-12T00:46:11.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.529+0000 7f8ab9335800 20 add_watcher() i=4 2024-09-12T00:46:11.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.529+0000 7f8ab9335800 20 add_watcher() i=5 2024-09-12T00:46:11.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.529+0000 7f8ab9335800 20 add_watcher() i=6 2024-09-12T00:46:11.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.531+0000 7f8ab9335800 20 add_watcher() i=7 2024-09-12T00:46:11.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.531+0000 7f8ab9335800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:11.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.532+0000 7f896bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.533+0000 7f8ab9335800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:11.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.533+0000 7f8ab9335800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:11.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.533+0000 7f8ab9335800 5 note: GC not initialized 2024-09-12T00:46:11.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.533+0000 7f896afe5640 20 reqs_thread_entry: start 2024-09-12T00:46:11.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.533+0000 7f8ab9335800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:11.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.533+0000 7f8ab9335800 20 Filter name: none 2024-09-12T00:46:11.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.533+0000 7f8968fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:11.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.533+0000 7f8ab9335800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:46:11.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.533+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.534+0000 7f8ab9335800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:11.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.534+0000 7f8ab9335800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:46:11.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.534+0000 7f8ab9335800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:46:11.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.534+0000 7f8ab9335800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:46:11.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.534+0000 7f8ab9335800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.534+0000 7f8ab9335800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:11.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.534+0000 7f8ab9335800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:11.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.534+0000 7f8ab9335800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:11.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.534+0000 7f8ab9335800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:11.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.534+0000 7f8ab9335800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:11.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.534+0000 7f8ab9335800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:46:11.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.536+0000 7f896bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.539+0000 7f8ab9335800 20 remove_watcher() i=0 2024-09-12T00:46:11.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.539+0000 7f8ab9335800 2 removed watcher, disabling cache 2024-09-12T00:46:11.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.540+0000 7f8ab9335800 20 remove_watcher() i=1 2024-09-12T00:46:11.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.541+0000 7f8ab9335800 20 remove_watcher() i=2 2024-09-12T00:46:11.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.543+0000 7f8ab9335800 20 remove_watcher() i=3 2024-09-12T00:46:11.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.544+0000 7f8ab9335800 20 remove_watcher() i=4 2024-09-12T00:46:11.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.545+0000 7f8ab9335800 20 remove_watcher() i=5 2024-09-12T00:46:11.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.546+0000 7f8ab9335800 20 remove_watcher() i=6 2024-09-12T00:46:11.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.547+0000 7f8ab9335800 20 remove_watcher() i=7 2024-09-12T00:46:11.560 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshard list 2024-09-12T00:46:11.587 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:11.587 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:11.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.627+0000 7f85fce19800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.629+0000 7f85fce19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.629+0000 7f85fce19800 20 realm 2024-09-12T00:46:11.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.629+0000 7f85fce19800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.629+0000 7f85fce19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.629+0000 7f85fce19800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:11.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.629+0000 7f85fce19800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.629+0000 7f85fce19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.629+0000 7f85fce19800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.630+0000 7f85fce19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:11.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.630+0000 7f85fce19800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.630+0000 7f85fce19800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:11.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.630+0000 7f85fce19800 20 searching for the correct realm 2024-09-12T00:46:11.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.634+0000 7f85f7dea640 0 -- 172.21.15.19:0/219788262 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f85ec072680 msgr2=0x7f85ec067d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:11.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.840+0000 7f85f8dec640 0 -- 172.21.15.19:0/219788262 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55b3c80f3e50 msgr2=0x55b3c80f62a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:11.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.845+0000 7f85fce19800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:11.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.845+0000 7f85fce19800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:11.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.845+0000 7f85fce19800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:11.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.845+0000 7f85fce19800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:11.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.845+0000 7f85fce19800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:11.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.845+0000 7f85fce19800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:11.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.845+0000 7f85fce19800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.845+0000 7f85fce19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.845+0000 7f85fce19800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:11.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:11.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 20 zone default found 2024-09-12T00:46:11.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 4 Realm: () 2024-09-12T00:46:11.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:11.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:11.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:11.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 20 zonegroup default 2024-09-12T00:46:11.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.846+0000 7f85fce19800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.847+0000 7f85fce19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.847+0000 7f85fce19800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.847+0000 7f85fce19800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.847+0000 7f85fce19800 20 started sync module instance, tier type = 2024-09-12T00:46:11.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.847+0000 7f85fce19800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:11.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.857+0000 7f85fce19800 20 add_watcher() i=0 2024-09-12T00:46:11.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.857+0000 7f85fce19800 20 add_watcher() i=1 2024-09-12T00:46:11.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.857+0000 7f85fce19800 20 add_watcher() i=2 2024-09-12T00:46:11.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.857+0000 7f85fce19800 20 add_watcher() i=3 2024-09-12T00:46:11.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.857+0000 7f85fce19800 20 add_watcher() i=4 2024-09-12T00:46:11.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.857+0000 7f85fce19800 20 add_watcher() i=5 2024-09-12T00:46:11.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.857+0000 7f85fce19800 20 add_watcher() i=6 2024-09-12T00:46:11.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.858+0000 7f85fce19800 20 add_watcher() i=7 2024-09-12T00:46:11.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.858+0000 7f85fce19800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:11.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.860+0000 7f84aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.861+0000 7f85fce19800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:11.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.861+0000 7f85fce19800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:11.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.861+0000 7f85fce19800 5 note: GC not initialized 2024-09-12T00:46:11.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.861+0000 7f84adfdb640 20 reqs_thread_entry: start 2024-09-12T00:46:11.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.861+0000 7f85fce19800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:11.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.861+0000 7f85fce19800 20 Filter name: none 2024-09-12T00:46:11.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.861+0000 7f841f7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:11.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.868+0000 7f84aefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:11.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.871+0000 7f85fce19800 20 remove_watcher() i=0 2024-09-12T00:46:11.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.871+0000 7f85fce19800 2 removed watcher, disabling cache 2024-09-12T00:46:11.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.872+0000 7f85fce19800 20 remove_watcher() i=1 2024-09-12T00:46:11.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.873+0000 7f85fce19800 20 remove_watcher() i=2 2024-09-12T00:46:11.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.874+0000 7f85fce19800 20 remove_watcher() i=3 2024-09-12T00:46:11.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.875+0000 7f85fce19800 20 remove_watcher() i=4 2024-09-12T00:46:11.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.876+0000 7f85fce19800 20 remove_watcher() i=5 2024-09-12T00:46:11.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.878+0000 7f85fce19800 20 remove_watcher() i=6 2024-09-12T00:46:11.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.879+0000 7f85fce19800 20 remove_watcher() i=7 2024-09-12T00:46:11.890 INFO:tasks.workunit.client.0.smithi019.stderr:bucket name a-bucket 2024-09-12T00:46:11.890 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard process 2024-09-12T00:46:11.890 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:11.891 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshard process 2024-09-12T00:46:11.919 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:11.919 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:11.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.959+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.961+0000 7f77b360e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.961+0000 7f77b360e800 20 realm 2024-09-12T00:46:11.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.961+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.961+0000 7f77b360e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.961+0000 7f77b360e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:11.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.961+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.961+0000 7f77b360e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:11.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.961+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.962+0000 7f77b360e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:11.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.962+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:11.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.962+0000 7f77b360e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:11.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.962+0000 7f77b360e800 20 searching for the correct realm 2024-09-12T00:46:11.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:11.966+0000 7f77ae458640 0 -- 172.21.15.19:0/432659212 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f77a402a030 msgr2=0x7f77a400a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:12.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.171+0000 7f77af45a640 0 -- 172.21.15.19:0/432659212 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55f5e21980d0 msgr2=0x55f5e219a540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:12.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.175+0000 7f77b360e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:12.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.175+0000 7f77b360e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:12.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.175+0000 7f77b360e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:12.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.175+0000 7f77b360e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:12.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.175+0000 7f77b360e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:12.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.175+0000 7f77b360e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:12.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.175+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:12.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:12.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 20 zone default found 2024-09-12T00:46:12.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 4 Realm: () 2024-09-12T00:46:12.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:12.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:12.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:12.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 20 zonegroup default 2024-09-12T00:46:12.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.176+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.177+0000 7f77b360e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.177+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.177+0000 7f77b360e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.177+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.177+0000 7f77b360e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:12.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.177+0000 7f77b360e800 20 started sync module instance, tier type = 2024-09-12T00:46:12.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.177+0000 7f77b360e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:12.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.187+0000 7f77b360e800 20 add_watcher() i=0 2024-09-12T00:46:12.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.187+0000 7f77b360e800 20 add_watcher() i=1 2024-09-12T00:46:12.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.187+0000 7f77b360e800 20 add_watcher() i=2 2024-09-12T00:46:12.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.187+0000 7f77b360e800 20 add_watcher() i=3 2024-09-12T00:46:12.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.187+0000 7f77b360e800 20 add_watcher() i=4 2024-09-12T00:46:12.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.187+0000 7f77b360e800 20 add_watcher() i=5 2024-09-12T00:46:12.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.187+0000 7f77b360e800 20 add_watcher() i=6 2024-09-12T00:46:12.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.189+0000 7f77b360e800 20 add_watcher() i=7 2024-09-12T00:46:12.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.189+0000 7f77b360e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:12.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.190+0000 7f76657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:12.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.191+0000 7f77b360e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:12.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.191+0000 7f77b360e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:12.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.191+0000 7f77b360e800 5 note: GC not initialized 2024-09-12T00:46:12.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.191+0000 7f75dffff640 20 reqs_thread_entry: start 2024-09-12T00:46:12.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.191+0000 7f77b360e800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:12.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.191+0000 7f77b360e800 20 Filter name: none 2024-09-12T00:46:12.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.191+0000 7f75ddffb640 20 reqs_thread_entry: start 2024-09-12T00:46:12.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.191+0000 7f77b360e800 20 processing logshard = reshard.0000000000 2024-09-12T00:46:12.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.194+0000 7f77b360e800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:46:12.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.194+0000 7f77b360e800 20 processing logshard = reshard.0000000001 2024-09-12T00:46:12.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.197+0000 7f77b360e800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:46:12.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.197+0000 7f77b360e800 20 processing logshard = reshard.0000000002 2024-09-12T00:46:12.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.200+0000 7f77b360e800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:46:12.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.200+0000 7f77b360e800 20 processing logshard = reshard.0000000003 2024-09-12T00:46:12.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.202+0000 7f77b360e800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:46:12.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.202+0000 7f77b360e800 20 processing logshard = reshard.0000000004 2024-09-12T00:46:12.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.205+0000 7f77b360e800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:46:12.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.205+0000 7f77b360e800 20 processing logshard = reshard.0000000005 2024-09-12T00:46:12.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.208+0000 7f77b360e800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:46:12.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.208+0000 7f77b360e800 20 processing logshard = reshard.0000000006 2024-09-12T00:46:12.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.209+0000 7f77b360e800 20 process_entry resharding a-bucket 2024-09-12T00:46:12.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.209+0000 7f77b360e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:46:12.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.209+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.210+0000 7f77b360e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:12.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.210+0000 7f77b360e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:46:12.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.210+0000 7f77b360e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:46:12.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.210+0000 7f77b360e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:46:12.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.210+0000 7f77b360e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:12.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.210+0000 7f77b360e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:12.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.210+0000 7f77b360e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:12.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.210+0000 7f77b360e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:12.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.210+0000 7f77b360e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:12.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.210+0000 7f77b360e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:12.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.210+0000 7f77b360e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:46:12.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.219+0000 7f77b360e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:12.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.219+0000 7f77b360e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:12.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.219+0000 7f77b360e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:12.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.219+0000 7f77b360e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:46:12.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.219+0000 7f76927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398922 cookie 94514548726848 notifier 5735 bl.length()=827 2024-09-12T00:46:12.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.219+0000 7f76927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:12.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.219+0000 7f76927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:12.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.219+0000 7f76927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:12.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.221+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:46:12.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.221+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:46:12.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.221+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:46:12.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.221+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:46:12.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.225+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.0 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.225+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.0 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.1 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.1 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.2 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.2 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.3 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.3 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.4 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.4 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.5 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.5 2024-09-12T00:46:12.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.6 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.6 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.7 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.7 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.8 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.8 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.9 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.9 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.10 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.10 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.11 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.11 2024-09-12T00:46:12.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.0 2024-09-12T00:46:12.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1 2024-09-12T00:46:12.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.226+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2 2024-09-12T00:46:12.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.227+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3 2024-09-12T00:46:12.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.227+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.4 2024-09-12T00:46:12.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.228+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.5 2024-09-12T00:46:12.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.229+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.6 2024-09-12T00:46:12.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.229+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.7 2024-09-12T00:46:12.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.230+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.8 2024-09-12T00:46:12.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.230+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.9 2024-09-12T00:46:12.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.231+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.10 2024-09-12T00:46:12.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.231+0000 7f77b360e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:12.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.231+0000 7f77b360e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:46:12.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.232+0000 7f77b360e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:12.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.232+0000 7f77b360e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:12.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.232+0000 7f77b360e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:12.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.232+0000 7f77b360e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:46:12.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.233+0000 7f76927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398923 cookie 94514548726848 notifier 5735 bl.length()=827 2024-09-12T00:46:12.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.233+0000 7f76927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:12.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.233+0000 7f76927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:12.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.233+0000 7f76927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:12.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.234+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:46:12.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.234+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:46:12.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.234+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:46:12.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.234+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:46:12.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.237+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.0 2024-09-12T00:46:12.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.237+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1 2024-09-12T00:46:12.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.237+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2 2024-09-12T00:46:12.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.238+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3 2024-09-12T00:46:12.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.238+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.4 2024-09-12T00:46:12.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.238+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.5 2024-09-12T00:46:12.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.239+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.6 2024-09-12T00:46:12.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.239+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.7 2024-09-12T00:46:12.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.240+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.8 2024-09-12T00:46:12.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.240+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.9 2024-09-12T00:46:12.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.240+0000 7f77b360e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.10 2024-09-12T00:46:12.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.241+0000 7f77b360e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:12.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.241+0000 7f77b360e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:46:12.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.242+0000 7f77b360e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:12.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.242+0000 7f77b360e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:12.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.242+0000 7f77b360e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:12.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.242+0000 7f77b360e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:46:12.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.242+0000 7f76927fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398924 cookie 94514548726848 notifier 5735 bl.length()=795 2024-09-12T00:46:12.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.242+0000 7f76927fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:12.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.243+0000 7f76927fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:12.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.243+0000 7f76927fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:12.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.244+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:46:12.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.244+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:46:12.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.244+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:46:12.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.244+0000 7f77b360e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:46:12.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.246+0000 7f77b360e800 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T00:46:12.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.247+0000 7f77b360e800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:46:12.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.250+0000 7f77b360e800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:46:12.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.250+0000 7f77b360e800 20 processing logshard = reshard.0000000007 2024-09-12T00:46:12.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.252+0000 7f77b360e800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:46:12.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.252+0000 7f77b360e800 20 processing logshard = reshard.0000000008 2024-09-12T00:46:12.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.255+0000 7f77b360e800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:46:12.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.255+0000 7f77b360e800 20 processing logshard = reshard.0000000009 2024-09-12T00:46:12.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.257+0000 7f77b360e800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:46:12.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.257+0000 7f77b360e800 20 processing logshard = reshard.0000000010 2024-09-12T00:46:12.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.260+0000 7f77b360e800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:46:12.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.260+0000 7f77b360e800 20 processing logshard = reshard.0000000011 2024-09-12T00:46:12.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.262+0000 7f77b360e800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:46:12.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.262+0000 7f77b360e800 20 processing logshard = reshard.0000000012 2024-09-12T00:46:12.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.264+0000 7f77b360e800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:46:12.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.264+0000 7f77b360e800 20 processing logshard = reshard.0000000013 2024-09-12T00:46:12.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.267+0000 7f77b360e800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:46:12.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.267+0000 7f77b360e800 20 processing logshard = reshard.0000000014 2024-09-12T00:46:12.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.269+0000 7f77b360e800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:46:12.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.269+0000 7f77b360e800 20 processing logshard = reshard.0000000015 2024-09-12T00:46:12.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.272+0000 7f77b360e800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:46:12.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.272+0000 7f76657e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:12.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.275+0000 7f77b360e800 20 remove_watcher() i=0 2024-09-12T00:46:12.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.275+0000 7f77b360e800 2 removed watcher, disabling cache 2024-09-12T00:46:12.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.276+0000 7f77b360e800 20 remove_watcher() i=1 2024-09-12T00:46:12.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.277+0000 7f77b360e800 20 remove_watcher() i=2 2024-09-12T00:46:12.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.279+0000 7f77b360e800 20 remove_watcher() i=3 2024-09-12T00:46:12.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.280+0000 7f77b360e800 20 remove_watcher() i=4 2024-09-12T00:46:12.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.281+0000 7f77b360e800 20 remove_watcher() i=5 2024-09-12T00:46:12.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.282+0000 7f77b360e800 20 remove_watcher() i=6 2024-09-12T00:46:12.282 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:12.283+0000 7f77b360e800 20 remove_watcher() i=7 2024-09-12T00:46:17.300 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:46:17.333 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:17.334 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:17.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.381+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.383+0000 7f3a1ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:17.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.383+0000 7f3a1ca11800 20 realm 2024-09-12T00:46:17.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.383+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.383+0000 7f3a1ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:17.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.383+0000 7f3a1ca11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:17.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.383+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.383+0000 7f3a1ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:17.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.383+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.384+0000 7f3a1ca11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:17.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.384+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.384+0000 7f3a1ca11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:17.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.384+0000 7f3a1ca11800 20 searching for the correct realm 2024-09-12T00:46:17.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.388+0000 7f3a17921640 0 -- 172.21.15.19:0/1031891139 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3a0c071d20 msgr2=0x7f3a0c06e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:17.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.595+0000 7f3a18923640 0 -- 172.21.15.19:0/1031891139 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55a023549010 msgr2=0x55a02354b460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:17.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.601+0000 7f3a1ca11800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:17.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.601+0000 7f3a1ca11800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:17.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.601+0000 7f3a1ca11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:17.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.601+0000 7f3a1ca11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:17.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.601+0000 7f3a1ca11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:17.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.601+0000 7f3a1ca11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:17.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.601+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.601+0000 7f3a1ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:17.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.601+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.602+0000 7f3a1ca11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:17.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.602+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.602+0000 7f3a1ca11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.602+0000 7f3a1ca11800 20 zone default found 2024-09-12T00:46:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.602+0000 7f3a1ca11800 4 Realm: () 2024-09-12T00:46:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.602+0000 7f3a1ca11800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.602+0000 7f3a1ca11800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.602+0000 7f3a1ca11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.602+0000 7f3a1ca11800 20 zonegroup default 2024-09-12T00:46:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.602+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.603+0000 7f3a1ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.603+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.603+0000 7f3a1ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:17.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.603+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.603+0000 7f3a1ca11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:17.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.603+0000 7f3a1ca11800 20 started sync module instance, tier type = 2024-09-12T00:46:17.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.603+0000 7f3a1ca11800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:17.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.614+0000 7f3a1ca11800 20 add_watcher() i=0 2024-09-12T00:46:17.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.614+0000 7f3a1ca11800 20 add_watcher() i=1 2024-09-12T00:46:17.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.614+0000 7f3a1ca11800 20 add_watcher() i=2 2024-09-12T00:46:17.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.614+0000 7f3a1ca11800 20 add_watcher() i=3 2024-09-12T00:46:17.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.614+0000 7f3a1ca11800 20 add_watcher() i=4 2024-09-12T00:46:17.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.614+0000 7f3a1ca11800 20 add_watcher() i=5 2024-09-12T00:46:17.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.614+0000 7f3a1ca11800 20 add_watcher() i=6 2024-09-12T00:46:17.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.616+0000 7f3a1ca11800 20 add_watcher() i=7 2024-09-12T00:46:17.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.616+0000 7f3a1ca11800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:17.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.618+0000 7f38cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:17.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.618+0000 7f3a1ca11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:17.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.618+0000 7f3a1ca11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:17.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.618+0000 7f3a1ca11800 5 note: GC not initialized 2024-09-12T00:46:17.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.618+0000 7f38cdfdb640 20 reqs_thread_entry: start 2024-09-12T00:46:17.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.619+0000 7f3a1ca11800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:17.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.619+0000 7f3a1ca11800 20 Filter name: none 2024-09-12T00:46:17.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.619+0000 7f383f7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:17.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.619+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.619+0000 7f3a1ca11800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:17.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.619+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.620+0000 7f3a1ca11800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:17.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.620+0000 7f3a1ca11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:17.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.620+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.620+0000 7f3a1ca11800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:17.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.620+0000 7f3a1ca11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:17.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.621+0000 7f3a1ca11800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:17.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.621+0000 7f3a1ca11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:17.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.623+0000 7f38cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:17.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.625+0000 7f3a1ca11800 20 remove_watcher() i=0 2024-09-12T00:46:17.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.625+0000 7f3a1ca11800 2 removed watcher, disabling cache 2024-09-12T00:46:17.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.626+0000 7f3a1ca11800 20 remove_watcher() i=1 2024-09-12T00:46:17.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.627+0000 7f3a1ca11800 20 remove_watcher() i=2 2024-09-12T00:46:17.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.628+0000 7f3a1ca11800 20 remove_watcher() i=3 2024-09-12T00:46:17.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.630+0000 7f3a1ca11800 20 remove_watcher() i=4 2024-09-12T00:46:17.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.631+0000 7f3a1ca11800 20 remove_watcher() i=5 2024-09-12T00:46:17.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.632+0000 7f3a1ca11800 20 remove_watcher() i=6 2024-09-12T00:46:17.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:17.633+0000 7f3a1ca11800 20 remove_watcher() i=7 2024-09-12T00:46:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:17.645 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:17.645 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: a-bucket id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:46:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:17.645 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard add non empty bucket 2024-09-12T00:46:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:17.650 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:17.650 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:17.690 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:17.690 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:17.723 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:17.723 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:17.757 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:17.757 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:17.793 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:17.793 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:17.826 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:17.826 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:17.865 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:17.865 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:17.898 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:17.899 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:17.931 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:46:17.960 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:17.960 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:18.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.001+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.003+0000 7fc6be126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.003+0000 7fc6be126800 20 realm 2024-09-12T00:46:18.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.003+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.003+0000 7fc6be126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.003+0000 7fc6be126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:18.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.003+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.003+0000 7fc6be126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.003+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.004+0000 7fc6be126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:18.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.004+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.004+0000 7fc6be126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:18.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.004+0000 7fc6be126800 20 searching for the correct realm 2024-09-12T00:46:18.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.008+0000 7fc6b9508640 0 -- 172.21.15.19:0/4070296098 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc6b00a3950 msgr2=0x7fc6b0056a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:18.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.214+0000 7fc6ba50a640 0 -- 172.21.15.19:0/4070296098 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x562e700b7100 msgr2=0x562e700b94f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:18.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.218+0000 7fc6be126800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:18.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.218+0000 7fc6be126800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:18.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.218+0000 7fc6be126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:18.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.218+0000 7fc6be126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:18.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.218+0000 7fc6be126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:18.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.218+0000 7fc6be126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:18.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.218+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.218+0000 7fc6be126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.218+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:18.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:18.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 20 zone default found 2024-09-12T00:46:18.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 4 Realm: () 2024-09-12T00:46:18.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:18.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:18.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:18.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 20 zonegroup default 2024-09-12T00:46:18.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.219+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.220+0000 7fc6be126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.220+0000 7fc6be126800 20 started sync module instance, tier type = 2024-09-12T00:46:18.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.220+0000 7fc6be126800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:18.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.229+0000 7fc6be126800 20 add_watcher() i=0 2024-09-12T00:46:18.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.229+0000 7fc6be126800 20 add_watcher() i=1 2024-09-12T00:46:18.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.229+0000 7fc6be126800 20 add_watcher() i=2 2024-09-12T00:46:18.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.229+0000 7fc6be126800 20 add_watcher() i=3 2024-09-12T00:46:18.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.229+0000 7fc6be126800 20 add_watcher() i=4 2024-09-12T00:46:18.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.229+0000 7fc6be126800 20 add_watcher() i=5 2024-09-12T00:46:18.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.229+0000 7fc6be126800 20 add_watcher() i=6 2024-09-12T00:46:18.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.230+0000 7fc6be126800 20 add_watcher() i=7 2024-09-12T00:46:18.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.230+0000 7fc6be126800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:18.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.232+0000 7fc5637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:18.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.233+0000 7fc6be126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:18.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.233+0000 7fc6be126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:18.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.233+0000 7fc6be126800 5 note: GC not initialized 2024-09-12T00:46:18.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.233+0000 7fc5627fc640 20 reqs_thread_entry: start 2024-09-12T00:46:18.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.233+0000 7fc6be126800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:18.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.233+0000 7fc6be126800 20 Filter name: none 2024-09-12T00:46:18.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.233+0000 7fc4dbfff640 20 reqs_thread_entry: start 2024-09-12T00:46:18.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.233+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.234+0000 7fc6be126800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:18.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.234+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.234+0000 7fc6be126800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:18.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.234+0000 7fc6be126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:18.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.234+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.234+0000 7fc6be126800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:18.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.234+0000 7fc6be126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.235+0000 7fc6be126800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:18.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.235+0000 7fc6be126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:18.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.237+0000 7fc5637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:18.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.239+0000 7fc6be126800 20 remove_watcher() i=0 2024-09-12T00:46:18.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.239+0000 7fc6be126800 2 removed watcher, disabling cache 2024-09-12T00:46:18.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.240+0000 7fc6be126800 20 remove_watcher() i=1 2024-09-12T00:46:18.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.242+0000 7fc6be126800 20 remove_watcher() i=2 2024-09-12T00:46:18.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.243+0000 7fc6be126800 20 remove_watcher() i=3 2024-09-12T00:46:18.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.244+0000 7fc6be126800 20 remove_watcher() i=4 2024-09-12T00:46:18.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.245+0000 7fc6be126800 20 remove_watcher() i=5 2024-09-12T00:46:18.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.246+0000 7fc6be126800 20 remove_watcher() i=6 2024-09-12T00:46:18.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.247+0000 7fc6be126800 20 remove_watcher() i=7 2024-09-12T00:46:18.257 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:18.257 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:18.257 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: a-bucket id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T00:46:18.257 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:18.258 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T00:46:18.290 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:18.290 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:18.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.331+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.333+0000 7fd479e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.333+0000 7fd479e2f800 20 realm 2024-09-12T00:46:18.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.333+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.333+0000 7fd479e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.333+0000 7fd479e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:18.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.333+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.333+0000 7fd479e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.333+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.334+0000 7fd479e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:18.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.334+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.334+0000 7fd479e2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:18.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.334+0000 7fd479e2f800 20 searching for the correct realm 2024-09-12T00:46:18.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.338+0000 7fd477118640 0 -- 172.21.15.19:0/817138253 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fd46c030060 msgr2=0x7fd46c07b900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:18.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.341+0000 7fd477919640 0 -- 172.21.15.19:0/817138253 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fd470061040 msgr2=0x7fd4700a3e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:18.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.346+0000 7fd479e2f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:18.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.346+0000 7fd479e2f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:18.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.346+0000 7fd479e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:18.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.346+0000 7fd479e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:18.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.346+0000 7fd479e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:18.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.346+0000 7fd479e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:18.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.346+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.346+0000 7fd479e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.346+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.346+0000 7fd479e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:18.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.346+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.347+0000 7fd479e2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:18.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.347+0000 7fd479e2f800 20 zone default found 2024-09-12T00:46:18.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.347+0000 7fd479e2f800 4 Realm: () 2024-09-12T00:46:18.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.347+0000 7fd479e2f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:18.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.347+0000 7fd479e2f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:18.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.347+0000 7fd479e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:18.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.347+0000 7fd479e2f800 20 zonegroup default 2024-09-12T00:46:18.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.347+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.347+0000 7fd479e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.347+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.348+0000 7fd479e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.348+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.348+0000 7fd479e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.348+0000 7fd479e2f800 20 started sync module instance, tier type = 2024-09-12T00:46:18.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.348+0000 7fd479e2f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:18.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.357+0000 7fd479e2f800 20 add_watcher() i=0 2024-09-12T00:46:18.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.357+0000 7fd479e2f800 20 add_watcher() i=1 2024-09-12T00:46:18.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.357+0000 7fd479e2f800 20 add_watcher() i=2 2024-09-12T00:46:18.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.357+0000 7fd479e2f800 20 add_watcher() i=3 2024-09-12T00:46:18.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.357+0000 7fd479e2f800 20 add_watcher() i=4 2024-09-12T00:46:18.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.357+0000 7fd479e2f800 20 add_watcher() i=5 2024-09-12T00:46:18.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.357+0000 7fd479e2f800 20 add_watcher() i=6 2024-09-12T00:46:18.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.358+0000 7fd479e2f800 20 add_watcher() i=7 2024-09-12T00:46:18.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.358+0000 7fd479e2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:18.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.360+0000 7fd32dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:18.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.360+0000 7fd479e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:18.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.360+0000 7fd479e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:18.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.360+0000 7fd479e2f800 5 note: GC not initialized 2024-09-12T00:46:18.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.360+0000 7fd32cfe1640 20 reqs_thread_entry: start 2024-09-12T00:46:18.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.360+0000 7fd479e2f800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:18.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.361+0000 7fd479e2f800 20 Filter name: none 2024-09-12T00:46:18.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.361+0000 7fd2a67fc640 20 reqs_thread_entry: start 2024-09-12T00:46:18.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.361+0000 7fd479e2f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:46:18.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.361+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.361+0000 7fd479e2f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:18.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.361+0000 7fd479e2f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:46:18.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.361+0000 7fd479e2f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:46:18.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.361+0000 7fd479e2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:46:18.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.361+0000 7fd479e2f800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.362+0000 7fd479e2f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:18.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.362+0000 7fd479e2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:18.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.362+0000 7fd479e2f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:18.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.362+0000 7fd479e2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:18.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.362+0000 7fd479e2f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:18.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.362+0000 7fd479e2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:46:18.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.364+0000 7fd32dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:18.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.366+0000 7fd479e2f800 20 remove_watcher() i=0 2024-09-12T00:46:18.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.366+0000 7fd479e2f800 2 removed watcher, disabling cache 2024-09-12T00:46:18.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.368+0000 7fd479e2f800 20 remove_watcher() i=1 2024-09-12T00:46:18.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.369+0000 7fd479e2f800 20 remove_watcher() i=2 2024-09-12T00:46:18.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.371+0000 7fd479e2f800 20 remove_watcher() i=3 2024-09-12T00:46:18.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.372+0000 7fd479e2f800 20 remove_watcher() i=4 2024-09-12T00:46:18.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.373+0000 7fd479e2f800 20 remove_watcher() i=5 2024-09-12T00:46:18.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.374+0000 7fd479e2f800 20 remove_watcher() i=6 2024-09-12T00:46:18.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.375+0000 7fd479e2f800 20 remove_watcher() i=7 2024-09-12T00:46:18.386 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshard list 2024-09-12T00:46:18.414 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:18.414 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:18.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.455+0000 7f6effd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.457+0000 7f6effd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.457+0000 7f6effd2e800 20 realm 2024-09-12T00:46:18.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.457+0000 7f6effd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.457+0000 7f6effd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.457+0000 7f6effd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:18.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.457+0000 7f6effd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.457+0000 7f6effd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.457+0000 7f6effd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.458+0000 7f6effd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:18.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.458+0000 7f6effd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.458+0000 7f6effd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:18.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.458+0000 7f6effd2e800 20 searching for the correct realm 2024-09-12T00:46:18.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.460+0000 7f6efb964640 0 -- 172.21.15.19:0/1769504118 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f6eec034040 msgr2=0x7f6eec041410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:18.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.666+0000 7f6efb964640 0 -- 172.21.15.19:0/1769504118 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f6ef4015030 msgr2=0x7f6ef405faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:18.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.874+0000 7f6effd2e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:18.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.874+0000 7f6effd2e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:18.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.874+0000 7f6effd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:18.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.874+0000 7f6effd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:18.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.874+0000 7f6effd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:18.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.874+0000 7f6effd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:18.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.874+0000 7f6effd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.874+0000 7f6effd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.874+0000 7f6effd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:18.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:18.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 20 zone default found 2024-09-12T00:46:18.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 4 Realm: () 2024-09-12T00:46:18.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:18.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:18.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:18.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 20 zonegroup default 2024-09-12T00:46:18.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.875+0000 7f6effd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.876+0000 7f6effd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.876+0000 7f6effd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.876+0000 7f6effd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.876+0000 7f6effd2e800 20 started sync module instance, tier type = 2024-09-12T00:46:18.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.876+0000 7f6effd2e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:18.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.886+0000 7f6effd2e800 20 add_watcher() i=0 2024-09-12T00:46:18.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.886+0000 7f6effd2e800 20 add_watcher() i=1 2024-09-12T00:46:18.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.886+0000 7f6effd2e800 20 add_watcher() i=2 2024-09-12T00:46:18.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.886+0000 7f6effd2e800 20 add_watcher() i=3 2024-09-12T00:46:18.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.886+0000 7f6effd2e800 20 add_watcher() i=4 2024-09-12T00:46:18.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.886+0000 7f6effd2e800 20 add_watcher() i=5 2024-09-12T00:46:18.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.886+0000 7f6effd2e800 20 add_watcher() i=6 2024-09-12T00:46:18.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.887+0000 7f6effd2e800 20 add_watcher() i=7 2024-09-12T00:46:18.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.887+0000 7f6effd2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:18.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.889+0000 7f6db1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:18.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.890+0000 7f6effd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:18.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.890+0000 7f6effd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:18.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.890+0000 7f6effd2e800 5 note: GC not initialized 2024-09-12T00:46:18.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.890+0000 7f6db0fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:18.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.890+0000 7f6effd2e800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:18.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.890+0000 7f6effd2e800 20 Filter name: none 2024-09-12T00:46:18.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.890+0000 7f6d2a7fc640 20 reqs_thread_entry: start 2024-09-12T00:46:18.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.897+0000 7f6db1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:18.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.899+0000 7f6effd2e800 20 remove_watcher() i=0 2024-09-12T00:46:18.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.899+0000 7f6effd2e800 2 removed watcher, disabling cache 2024-09-12T00:46:18.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.900+0000 7f6effd2e800 20 remove_watcher() i=1 2024-09-12T00:46:18.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.901+0000 7f6effd2e800 20 remove_watcher() i=2 2024-09-12T00:46:18.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.903+0000 7f6effd2e800 20 remove_watcher() i=3 2024-09-12T00:46:18.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.904+0000 7f6effd2e800 20 remove_watcher() i=4 2024-09-12T00:46:18.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.905+0000 7f6effd2e800 20 remove_watcher() i=5 2024-09-12T00:46:18.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.906+0000 7f6effd2e800 20 remove_watcher() i=6 2024-09-12T00:46:18.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.907+0000 7f6effd2e800 20 remove_watcher() i=7 2024-09-12T00:46:18.918 INFO:tasks.workunit.client.0.smithi019.stderr:bucket name a-bucket 2024-09-12T00:46:18.918 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard process non empty bucket 2024-09-12T00:46:18.919 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:18.920 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshard process 2024-09-12T00:46:18.948 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:18.948 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:18.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.989+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.990+0000 7f5c9ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.990+0000 7f5c9ae0e800 20 realm 2024-09-12T00:46:18.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.990+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.991+0000 7f5c9ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.991+0000 7f5c9ae0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:18.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.991+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.991+0000 7f5c9ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:18.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.991+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.992+0000 7f5c9ae0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:18.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.992+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:18.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.992+0000 7f5c9ae0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:18.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.992+0000 7f5c9ae0e800 20 searching for the correct realm 2024-09-12T00:46:18.994 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:18.995+0000 7f5c95d6a640 0 -- 172.21.15.19:0/286913888 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f5c8c03b920 msgr2=0x7f5c8c025410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:19.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.200+0000 7f5c96d6c640 0 -- 172.21.15.19:0/286913888 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5608bc342390 msgr2=0x5608bc344850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:19.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.205+0000 7f5c9ae0e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:19.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.205+0000 7f5c9ae0e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:19.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.205+0000 7f5c9ae0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:19.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.205+0000 7f5c9ae0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:19.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.205+0000 7f5c9ae0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:19.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.205+0000 7f5c9ae0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:19.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.205+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.205+0000 7f5c9ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:19.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.205+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.205+0000 7f5c9ae0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:19.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.205+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 20 zone default found 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 4 Realm: () 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 20 zonegroup default 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 20 started sync module instance, tier type = 2024-09-12T00:46:19.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.206+0000 7f5c9ae0e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:19.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.216+0000 7f5c9ae0e800 20 add_watcher() i=0 2024-09-12T00:46:19.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.216+0000 7f5c9ae0e800 20 add_watcher() i=1 2024-09-12T00:46:19.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.216+0000 7f5c9ae0e800 20 add_watcher() i=2 2024-09-12T00:46:19.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.216+0000 7f5c9ae0e800 20 add_watcher() i=3 2024-09-12T00:46:19.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.216+0000 7f5c9ae0e800 20 add_watcher() i=4 2024-09-12T00:46:19.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.216+0000 7f5c9ae0e800 20 add_watcher() i=5 2024-09-12T00:46:19.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.216+0000 7f5c9ae0e800 20 add_watcher() i=6 2024-09-12T00:46:19.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.217+0000 7f5c9ae0e800 20 add_watcher() i=7 2024-09-12T00:46:19.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.217+0000 7f5c9ae0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:19.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.218+0000 7f5b4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:19.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.219+0000 7f5c9ae0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:19.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.219+0000 7f5c9ae0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:19.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.219+0000 7f5c9ae0e800 5 note: GC not initialized 2024-09-12T00:46:19.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.219+0000 7f5ac77fe640 20 reqs_thread_entry: start 2024-09-12T00:46:19.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.219+0000 7f5c9ae0e800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:19.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.219+0000 7f5c9ae0e800 20 Filter name: none 2024-09-12T00:46:19.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.219+0000 7f5ac57fa640 20 reqs_thread_entry: start 2024-09-12T00:46:19.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.219+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000000 2024-09-12T00:46:19.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.222+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:46:19.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.222+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000001 2024-09-12T00:46:19.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.224+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:46:19.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.224+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000002 2024-09-12T00:46:19.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.227+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:46:19.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.227+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000003 2024-09-12T00:46:19.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.230+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:46:19.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.230+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000004 2024-09-12T00:46:19.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.232+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:46:19.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.232+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000005 2024-09-12T00:46:19.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.235+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:46:19.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.235+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000006 2024-09-12T00:46:19.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.236+0000 7f5c9ae0e800 20 process_entry resharding a-bucket 2024-09-12T00:46:19.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.236+0000 7f5c9ae0e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:46:19.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.236+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.237+0000 7f5c9ae0e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:19.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.237+0000 7f5c9ae0e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:46:19.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.237+0000 7f5c9ae0e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:46:19.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.237+0000 7f5c9ae0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:46:19.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.237+0000 7f5c9ae0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.237+0000 7f5c9ae0e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:19.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.237+0000 7f5c9ae0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:19.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.237+0000 7f5c9ae0e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:19.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.237+0000 7f5c9ae0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:19.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.237+0000 7f5c9ae0e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:19.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.237+0000 7f5c9ae0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:46:19.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.244+0000 7f5c9ae0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:19.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.244+0000 7f5c9ae0e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:19.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.244+0000 7f5c9ae0e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:19.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.244+0000 7f5c9ae0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:46:19.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.245+0000 7f5b797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398925 cookie 94595517267136 notifier 6132 bl.length()=827 2024-09-12T00:46:19.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.245+0000 7f5b797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:19.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.245+0000 7f5b797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:19.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.245+0000 7f5b797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:19.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.246+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:46:19.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.246+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:46:19.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.246+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:46:19.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.246+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:46:19.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:46:19.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:46:19.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.0 2024-09-12T00:46:19.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.251+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.0 2024-09-12T00:46:19.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.252+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.1 2024-09-12T00:46:19.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.252+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.1 2024-09-12T00:46:19.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.252+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.2 2024-09-12T00:46:19.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.252+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.2 2024-09-12T00:46:19.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.253+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.3 2024-09-12T00:46:19.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.253+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.3 2024-09-12T00:46:19.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.254+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.4 2024-09-12T00:46:19.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.254+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.4 2024-09-12T00:46:19.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.254+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.5 2024-09-12T00:46:19.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.254+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.5 2024-09-12T00:46:19.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.255+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.6 2024-09-12T00:46:19.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.255+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.6 2024-09-12T00:46:19.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.256+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.7 2024-09-12T00:46:19.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.256+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.7 2024-09-12T00:46:19.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.256+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.8 2024-09-12T00:46:19.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.256+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.8 2024-09-12T00:46:19.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.257+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.9 2024-09-12T00:46:19.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.257+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.9 2024-09-12T00:46:19.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.257+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.10 2024-09-12T00:46:19.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.257+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.10 2024-09-12T00:46:19.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.258+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.11 2024-09-12T00:46:19.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.258+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.11 2024-09-12T00:46:19.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.261+0000 7f5c9ae0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:19.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.261+0000 7f5c9ae0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:46:19.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.262+0000 7f5c9ae0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:19.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.262+0000 7f5c9ae0e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:19.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.262+0000 7f5c9ae0e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:19.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.262+0000 7f5c9ae0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:46:19.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.262+0000 7f5b797fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398926 cookie 94595517267136 notifier 6132 bl.length()=827 2024-09-12T00:46:19.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.262+0000 7f5b797fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:19.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.262+0000 7f5b797fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:19.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.262+0000 7f5b797fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:19.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.264+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:46:19.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.264+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:46:19.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.264+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:46:19.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.264+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:46:19.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.266+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.0 2024-09-12T00:46:19.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.266+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.0 2024-09-12T00:46:19.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.267+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.1 2024-09-12T00:46:19.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.267+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.1 2024-09-12T00:46:19.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.267+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.2 2024-09-12T00:46:19.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.267+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.2 2024-09-12T00:46:19.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.267+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.3 2024-09-12T00:46:19.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.267+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.3 2024-09-12T00:46:19.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.267+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.4 2024-09-12T00:46:19.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.267+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.4 2024-09-12T00:46:19.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.268+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.5 2024-09-12T00:46:19.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.268+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.5 2024-09-12T00:46:19.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.268+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.6 2024-09-12T00:46:19.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.268+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.6 2024-09-12T00:46:19.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.268+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.7 2024-09-12T00:46:19.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.268+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.7 2024-09-12T00:46:19.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.269+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.8 2024-09-12T00:46:19.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.269+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.8 2024-09-12T00:46:19.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.269+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.9 2024-09-12T00:46:19.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.269+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.9 2024-09-12T00:46:19.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.269+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.10 2024-09-12T00:46:19.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.269+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.10 2024-09-12T00:46:19.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.270+0000 7f5c9ae0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.11 2024-09-12T00:46:19.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.270+0000 7f5c9ae0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.1.11 2024-09-12T00:46:19.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.270+0000 7f5c9ae0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:19.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.270+0000 7f5c9ae0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:46:19.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.271+0000 7f5c9ae0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:19.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.271+0000 7f5c9ae0e800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:19.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.271+0000 7f5c9ae0e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:19.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.271+0000 7f5c9ae0e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:46:19.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.272+0000 7f5b79ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398927 cookie 94595517267136 notifier 6132 bl.length()=795 2024-09-12T00:46:19.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.272+0000 7f5b79ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:46:19.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.272+0000 7f5b79ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:46:19.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.272+0000 7f5b79ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:46:19.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.273+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:46:19.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.273+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:46:19.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.273+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:46:19.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.273+0000 7f5c9ae0e800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:46:19.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.277+0000 7f5c9ae0e800 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T00:46:19.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.278+0000 7f5c9ae0e800 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:46:19.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.281+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:46:19.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.281+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000007 2024-09-12T00:46:19.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.283+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:46:19.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.283+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000008 2024-09-12T00:46:19.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.286+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:46:19.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.286+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000009 2024-09-12T00:46:19.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.288+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:46:19.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.288+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000010 2024-09-12T00:46:19.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.290+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:46:19.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.290+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000011 2024-09-12T00:46:19.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.293+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:46:19.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.293+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000012 2024-09-12T00:46:19.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.296+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:46:19.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.296+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000013 2024-09-12T00:46:19.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.298+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:46:19.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.298+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000014 2024-09-12T00:46:19.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.301+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:46:19.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.301+0000 7f5c9ae0e800 20 processing logshard = reshard.0000000015 2024-09-12T00:46:19.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.303+0000 7f5c9ae0e800 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:46:19.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.304+0000 7f5b4cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:19.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.307+0000 7f5c9ae0e800 20 remove_watcher() i=0 2024-09-12T00:46:19.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.307+0000 7f5c9ae0e800 2 removed watcher, disabling cache 2024-09-12T00:46:19.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.308+0000 7f5c9ae0e800 20 remove_watcher() i=1 2024-09-12T00:46:19.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.309+0000 7f5c9ae0e800 20 remove_watcher() i=2 2024-09-12T00:46:19.308 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.310+0000 7f5c9ae0e800 20 remove_watcher() i=3 2024-09-12T00:46:19.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.311+0000 7f5c9ae0e800 20 remove_watcher() i=4 2024-09-12T00:46:19.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.312+0000 7f5c9ae0e800 20 remove_watcher() i=5 2024-09-12T00:46:19.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.313+0000 7f5c9ae0e800 20 remove_watcher() i=6 2024-09-12T00:46:19.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.314+0000 7f5c9ae0e800 20 remove_watcher() i=7 2024-09-12T00:46:19.326 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:46:19.354 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:19.355 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:19.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.395+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.397+0000 7f2085125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:19.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.397+0000 7f2085125800 20 realm 2024-09-12T00:46:19.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.397+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.397+0000 7f2085125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:19.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.397+0000 7f2085125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:19.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.397+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.398+0000 7f2085125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:19.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.398+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.398+0000 7f2085125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:19.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.398+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.399+0000 7f2085125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:19.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.399+0000 7f2085125800 20 searching for the correct realm 2024-09-12T00:46:19.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.401+0000 7f2080dae640 0 -- 172.21.15.19:0/1340463390 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f2070043070 msgr2=0x7f207006c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:19.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.607+0000 7f2080dae640 0 -- 172.21.15.19:0/1340463390 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f2078078070 msgr2=0x7f20780608b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:19.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.814+0000 7f2085125800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:19.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.814+0000 7f2085125800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:19.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.814+0000 7f2085125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:19.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.814+0000 7f2085125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:19.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.814+0000 7f2085125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:19.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.814+0000 7f2085125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:19.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.814+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:19.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:19.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 20 zone default found 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 4 Realm: () 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 20 zonegroup default 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.815+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.816+0000 7f2085125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.816+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.816+0000 7f2085125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:19.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.816+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.816+0000 7f2085125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:19.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.816+0000 7f2085125800 20 started sync module instance, tier type = 2024-09-12T00:46:19.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.816+0000 7f2085125800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:19.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.826+0000 7f2085125800 20 add_watcher() i=0 2024-09-12T00:46:19.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.826+0000 7f2085125800 20 add_watcher() i=1 2024-09-12T00:46:19.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.826+0000 7f2085125800 20 add_watcher() i=2 2024-09-12T00:46:19.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.826+0000 7f2085125800 20 add_watcher() i=3 2024-09-12T00:46:19.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.826+0000 7f2085125800 20 add_watcher() i=4 2024-09-12T00:46:19.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.826+0000 7f2085125800 20 add_watcher() i=5 2024-09-12T00:46:19.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.826+0000 7f2085125800 20 add_watcher() i=6 2024-09-12T00:46:19.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.827+0000 7f2085125800 20 add_watcher() i=7 2024-09-12T00:46:19.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.827+0000 7f2085125800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:19.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.828+0000 7f1f377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:19.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.829+0000 7f2085125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:19.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.829+0000 7f2085125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:19.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.829+0000 7f2085125800 5 note: GC not initialized 2024-09-12T00:46:19.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.829+0000 7f1f367e4640 20 reqs_thread_entry: start 2024-09-12T00:46:19.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.829+0000 7f2085125800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:19.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.829+0000 7f2085125800 20 Filter name: none 2024-09-12T00:46:19.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.829+0000 7f1f2f7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:19.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.829+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.830+0000 7f2085125800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:19.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.830+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.830+0000 7f2085125800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:19.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.830+0000 7f2085125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:19.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.830+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.831+0000 7f2085125800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:46:19.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.831+0000 7f2085125800 20 rados->read ofs=0 len=0 2024-09-12T00:46:19.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.831+0000 7f2085125800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:46:19.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.831+0000 7f2085125800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:19.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.833+0000 7f1f377e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:19.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.836+0000 7f2085125800 20 remove_watcher() i=0 2024-09-12T00:46:19.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.836+0000 7f2085125800 2 removed watcher, disabling cache 2024-09-12T00:46:19.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.837+0000 7f2085125800 20 remove_watcher() i=1 2024-09-12T00:46:19.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.838+0000 7f2085125800 20 remove_watcher() i=2 2024-09-12T00:46:19.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.839+0000 7f2085125800 20 remove_watcher() i=3 2024-09-12T00:46:19.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.840+0000 7f2085125800 20 remove_watcher() i=4 2024-09-12T00:46:19.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.841+0000 7f2085125800 20 remove_watcher() i=5 2024-09-12T00:46:19.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.842+0000 7f2085125800 20 remove_watcher() i=6 2024-09-12T00:46:19.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:19.843+0000 7f2085125800 20 remove_watcher() i=7 2024-09-12T00:46:19.855 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:19.855 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:19.855 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: a-bucket id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:46:19.855 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:19.855 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:46:19.855 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:19.857 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:19.857 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:19.910 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:19.911 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:19.971 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:19.971 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.008 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.008 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.044 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.044 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.079 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.079 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.113 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.113 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.146 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.146 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.179 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.179 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.212 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.212 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.246 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.246 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.279 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.280 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.314 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.314 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.347 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.348 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.381 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.381 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.414 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.414 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.447 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.448 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.483 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.483 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.519 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.519 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.552 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.552 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.587 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.587 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.621 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:20.622 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:20.656 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:46:20.685 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:20.685 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:20.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.728+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.730+0000 7f6895c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:20.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.730+0000 7f6895c11800 20 realm 2024-09-12T00:46:20.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.730+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.730+0000 7f6895c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:20.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.730+0000 7f6895c11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:20.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.730+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.730+0000 7f6895c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:20.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.730+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.731+0000 7f6895c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:20.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.731+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.731+0000 7f6895c11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:20.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.732+0000 7f6895c11800 20 searching for the correct realm 2024-09-12T00:46:20.731 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.733+0000 7f6891b49640 0 -- 172.21.15.19:0/2145506258 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7f6888001a30 msgr2=0x7f688807a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:20.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.939+0000 7f6891b49640 0 -- 172.21.15.19:0/2145506258 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5653c12c10f0 msgr2=0x5653c12c3580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:20.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.944+0000 7f6895c11800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:20.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.944+0000 7f6895c11800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:20.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.944+0000 7f6895c11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:20.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.945+0000 7f6895c11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:20.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.945+0000 7f6895c11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:20.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.945+0000 7f6895c11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:20.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.945+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.945+0000 7f6895c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:20.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.945+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.945+0000 7f6895c11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:20.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.945+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:20.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 20 zone default found 2024-09-12T00:46:20.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 4 Realm: () 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 20 zonegroup default 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 20 started sync module instance, tier type = 2024-09-12T00:46:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.946+0000 7f6895c11800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:20.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.955+0000 7f6895c11800 20 add_watcher() i=0 2024-09-12T00:46:20.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.955+0000 7f6895c11800 20 add_watcher() i=1 2024-09-12T00:46:20.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.955+0000 7f6895c11800 20 add_watcher() i=2 2024-09-12T00:46:20.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.955+0000 7f6895c11800 20 add_watcher() i=3 2024-09-12T00:46:20.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.955+0000 7f6895c11800 20 add_watcher() i=4 2024-09-12T00:46:20.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.955+0000 7f6895c11800 20 add_watcher() i=5 2024-09-12T00:46:20.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.955+0000 7f6895c11800 20 add_watcher() i=6 2024-09-12T00:46:20.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.957+0000 7f6895c11800 20 add_watcher() i=7 2024-09-12T00:46:20.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.957+0000 7f6895c11800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:20.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.958+0000 7f67437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:20.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.958+0000 7f6895c11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:20.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.958+0000 7f6895c11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:20.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.959+0000 7f6895c11800 5 note: GC not initialized 2024-09-12T00:46:20.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.959+0000 7f67427e4640 20 reqs_thread_entry: start 2024-09-12T00:46:20.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.959+0000 7f6895c11800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:20.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.959+0000 7f6895c11800 20 Filter name: none 2024-09-12T00:46:20.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.959+0000 7f66b3fff640 20 reqs_thread_entry: start 2024-09-12T00:46:20.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.959+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.960+0000 7f6895c11800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:20.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.960+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.961+0000 7f6895c11800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:20.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.961+0000 7f6895c11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:20.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.961+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.961+0000 7f6895c11800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:20.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.961+0000 7f6895c11800 20 rados->read ofs=0 len=0 2024-09-12T00:46:20.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.961+0000 7f6895c11800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:20.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.961+0000 7f6895c11800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:20.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.963+0000 7f67437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:20.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.965+0000 7f6895c11800 20 remove_watcher() i=0 2024-09-12T00:46:20.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.965+0000 7f6895c11800 2 removed watcher, disabling cache 2024-09-12T00:46:20.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.966+0000 7f6895c11800 20 remove_watcher() i=1 2024-09-12T00:46:20.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.967+0000 7f6895c11800 20 remove_watcher() i=2 2024-09-12T00:46:20.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.968+0000 7f6895c11800 20 remove_watcher() i=3 2024-09-12T00:46:20.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.969+0000 7f6895c11800 20 remove_watcher() i=4 2024-09-12T00:46:20.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.970+0000 7f6895c11800 20 remove_watcher() i=5 2024-09-12T00:46:20.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.971+0000 7f6895c11800 20 remove_watcher() i=6 2024-09-12T00:46:20.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:20.972+0000 7f6895c11800 20 remove_watcher() i=7 2024-09-12T00:46:20.982 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:20.982 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:20.982 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-init-index id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:46:20.982 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:20.983 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:46:21.018 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:21.018 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:21.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.059+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.060+0000 7fe1b2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.060+0000 7fe1b2b46800 20 realm 2024-09-12T00:46:21.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.060+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.060+0000 7fe1b2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.060+0000 7fe1b2b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:21.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.060+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.060+0000 7fe1b2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.060+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.061+0000 7fe1b2b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:21.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.061+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.061+0000 7fe1b2b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:21.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.061+0000 7fe1b2b46800 20 searching for the correct realm 2024-09-12T00:46:21.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.065+0000 7fe1afe36640 0 -- 172.21.15.19:0/3284920775 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fe1a401f040 msgr2=0x7fe1a4047430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:21.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.271+0000 7fe1b0e38640 0 -- 172.21.15.19:0/3284920775 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x557d1e021fb0 msgr2=0x557d1e024470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:21.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:21.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:21.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:21.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:21.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:21.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:21.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 zone default found 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 4 Realm: () 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 zonegroup default 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.275+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.276+0000 7fe1b2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.276+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.276+0000 7fe1b2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.276+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.276+0000 7fe1b2b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.276+0000 7fe1b2b46800 20 started sync module instance, tier type = 2024-09-12T00:46:21.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.276+0000 7fe1b2b46800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:21.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.285+0000 7fe1b2b46800 20 add_watcher() i=0 2024-09-12T00:46:21.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.285+0000 7fe1b2b46800 20 add_watcher() i=1 2024-09-12T00:46:21.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.285+0000 7fe1b2b46800 20 add_watcher() i=2 2024-09-12T00:46:21.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.285+0000 7fe1b2b46800 20 add_watcher() i=3 2024-09-12T00:46:21.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.285+0000 7fe1b2b46800 20 add_watcher() i=4 2024-09-12T00:46:21.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.285+0000 7fe1b2b46800 20 add_watcher() i=5 2024-09-12T00:46:21.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.285+0000 7fe1b2b46800 20 add_watcher() i=6 2024-09-12T00:46:21.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.286+0000 7fe1b2b46800 20 add_watcher() i=7 2024-09-12T00:46:21.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.286+0000 7fe1b2b46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:21.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.288+0000 7fe066fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:21.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.288+0000 7fe1b2b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:21.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.288+0000 7fe1b2b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:21.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.288+0000 7fe1b2b46800 5 note: GC not initialized 2024-09-12T00:46:21.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.289+0000 7fe065fe3640 20 reqs_thread_entry: start 2024-09-12T00:46:21.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.289+0000 7fe1b2b46800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:21.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.289+0000 7fe1b2b46800 20 Filter name: none 2024-09-12T00:46:21.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.289+0000 7fe05f7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:21.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.289+0000 7fe1b2b46800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:46:21.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.289+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.289+0000 7fe1b2b46800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:21.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.289+0000 7fe1b2b46800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:46:21.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.289+0000 7fe1b2b46800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:46:21.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.289+0000 7fe1b2b46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 : miss 2024-09-12T00:46:21.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.289+0000 7fe1b2b46800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.290+0000 7fe1b2b46800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:21.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.290+0000 7fe1b2b46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 info.flags=0x17 2024-09-12T00:46:21.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.290+0000 7fe1b2b46800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 to cache LRU end 2024-09-12T00:46:21.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.290+0000 7fe1b2b46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:21.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.290+0000 7fe1b2b46800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:21.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.290+0000 7fe1b2b46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 2024-09-12T00:46:21.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.292+0000 7fe1b2b46800 -1 Injecting error=-5 at location=init_index 2024-09-12T00:46:21.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.292+0000 7fe1b2b46800 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:46:21.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.293+0000 7fe066fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:21.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.296+0000 7fe1b2b46800 20 remove_watcher() i=0 2024-09-12T00:46:21.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.296+0000 7fe1b2b46800 2 removed watcher, disabling cache 2024-09-12T00:46:21.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.297+0000 7fe1b2b46800 20 remove_watcher() i=1 2024-09-12T00:46:21.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.298+0000 7fe1b2b46800 20 remove_watcher() i=2 2024-09-12T00:46:21.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.299+0000 7fe1b2b46800 20 remove_watcher() i=3 2024-09-12T00:46:21.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.300+0000 7fe1b2b46800 20 remove_watcher() i=4 2024-09-12T00:46:21.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.301+0000 7fe1b2b46800 20 remove_watcher() i=5 2024-09-12T00:46:21.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.302+0000 7fe1b2b46800 20 remove_watcher() i=6 2024-09-12T00:46:21.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.303+0000 7fe1b2b46800 20 remove_watcher() i=7 2024-09-12T00:46:21.314 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:46:21.344 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:21.344 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:21.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.385+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.387+0000 7fde22533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.387+0000 7fde22533800 20 realm 2024-09-12T00:46:21.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.387+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.387+0000 7fde22533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.387+0000 7fde22533800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:21.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.387+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.387+0000 7fde22533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.387+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.388+0000 7fde22533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:21.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.388+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.388+0000 7fde22533800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:21.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.388+0000 7fde22533800 20 searching for the correct realm 2024-09-12T00:46:21.390 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.391+0000 7fde1da75640 0 -- 172.21.15.19:0/65490067 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fde14072190 msgr2=0x7fde140a1080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:21.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.596+0000 7fde1ea77640 0 -- 172.21.15.19:0/65490067 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55b72e192730 msgr2=0x55b72e194b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:21.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.600+0000 7fde22533800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:21.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.600+0000 7fde22533800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:21.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.600+0000 7fde22533800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:21.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.600+0000 7fde22533800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:21.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.600+0000 7fde22533800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:21.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.600+0000 7fde22533800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:21.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.600+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:21.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 20 zone default found 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 4 Realm: () 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 20 zonegroup default 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.601+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.602+0000 7fde22533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.602+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.602+0000 7fde22533800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.602+0000 7fde22533800 20 started sync module instance, tier type = 2024-09-12T00:46:21.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.602+0000 7fde22533800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:21.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.611+0000 7fde22533800 20 add_watcher() i=0 2024-09-12T00:46:21.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.611+0000 7fde22533800 20 add_watcher() i=1 2024-09-12T00:46:21.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.611+0000 7fde22533800 20 add_watcher() i=2 2024-09-12T00:46:21.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.611+0000 7fde22533800 20 add_watcher() i=3 2024-09-12T00:46:21.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.611+0000 7fde22533800 20 add_watcher() i=4 2024-09-12T00:46:21.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.611+0000 7fde22533800 20 add_watcher() i=5 2024-09-12T00:46:21.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.611+0000 7fde22533800 20 add_watcher() i=6 2024-09-12T00:46:21.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.612+0000 7fde22533800 20 add_watcher() i=7 2024-09-12T00:46:21.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.612+0000 7fde22533800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:21.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.614+0000 7fdcd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:21.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.614+0000 7fde22533800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:21.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.614+0000 7fde22533800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:21.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.614+0000 7fde22533800 5 note: GC not initialized 2024-09-12T00:46:21.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.614+0000 7fdc4f7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:21.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.614+0000 7fde22533800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:21.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.614+0000 7fde22533800 20 Filter name: none 2024-09-12T00:46:21.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.615+0000 7fdc4d7fa640 20 reqs_thread_entry: start 2024-09-12T00:46:21.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.615+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.615+0000 7fde22533800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:21.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.615+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.616+0000 7fde22533800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:21.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.616+0000 7fde22533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:21.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.616+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.616+0000 7fde22533800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:21.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.616+0000 7fde22533800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.616+0000 7fde22533800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:21.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.616+0000 7fde22533800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:21.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.618+0000 7fdcd4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:21.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.620+0000 7fde22533800 20 remove_watcher() i=0 2024-09-12T00:46:21.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.620+0000 7fde22533800 2 removed watcher, disabling cache 2024-09-12T00:46:21.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.621+0000 7fde22533800 20 remove_watcher() i=1 2024-09-12T00:46:21.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.622+0000 7fde22533800 20 remove_watcher() i=2 2024-09-12T00:46:21.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.623+0000 7fde22533800 20 remove_watcher() i=3 2024-09-12T00:46:21.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.624+0000 7fde22533800 20 remove_watcher() i=4 2024-09-12T00:46:21.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.625+0000 7fde22533800 20 remove_watcher() i=5 2024-09-12T00:46:21.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.626+0000 7fde22533800 20 remove_watcher() i=6 2024-09-12T00:46:21.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.628+0000 7fde22533800 20 remove_watcher() i=7 2024-09-12T00:46:21.638 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:21.638 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:21.638 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-init-index id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:46:21.638 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:21.641 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:21.641 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:21.671 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:21.671 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:21.730 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:46:21.763 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:21.763 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:21.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.804+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.806+0000 7f4549640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.806+0000 7f4549640800 20 realm 2024-09-12T00:46:21.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.806+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.806+0000 7f4549640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.806+0000 7f4549640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:21.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.806+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.807+0000 7f4549640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.807+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.807+0000 7f4549640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:21.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.807+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.808+0000 7f4549640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:21.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.808+0000 7f4549640800 20 searching for the correct realm 2024-09-12T00:46:21.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.812+0000 7f4546929640 0 -- 172.21.15.19:0/1387372270 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f453c06d070 msgr2=0x7f453c08c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:21.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.816+0000 7f4546929640 0 -- 172.21.15.19:0/1387372270 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5637ee2f63b0 msgr2=0x5637ee2f8800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:21.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.820+0000 7f4549640800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:21.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.820+0000 7f4549640800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:21.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.820+0000 7f4549640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:21.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.820+0000 7f4549640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:21.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.820+0000 7f4549640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:21.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.820+0000 7f4549640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:21.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.820+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.820+0000 7f4549640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.820+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.820+0000 7f4549640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:21.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.820+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:21.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 20 zone default found 2024-09-12T00:46:21.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 4 Realm: () 2024-09-12T00:46:21.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:21.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:21.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:21.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 20 zonegroup default 2024-09-12T00:46:21.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.821+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.822+0000 7f4549640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.822+0000 7f4549640800 20 started sync module instance, tier type = 2024-09-12T00:46:21.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.822+0000 7f4549640800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:21.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.830+0000 7f4549640800 20 add_watcher() i=0 2024-09-12T00:46:21.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.830+0000 7f4549640800 20 add_watcher() i=1 2024-09-12T00:46:21.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.830+0000 7f4549640800 20 add_watcher() i=2 2024-09-12T00:46:21.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.830+0000 7f4549640800 20 add_watcher() i=3 2024-09-12T00:46:21.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.830+0000 7f4549640800 20 add_watcher() i=4 2024-09-12T00:46:21.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.830+0000 7f4549640800 20 add_watcher() i=5 2024-09-12T00:46:21.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.830+0000 7f4549640800 20 add_watcher() i=6 2024-09-12T00:46:21.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.831+0000 7f4549640800 20 add_watcher() i=7 2024-09-12T00:46:21.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.831+0000 7f4549640800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:21.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.833+0000 7f43fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:21.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.833+0000 7f4549640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:21.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.833+0000 7f4549640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:21.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.833+0000 7f4549640800 5 note: GC not initialized 2024-09-12T00:46:21.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.833+0000 7f43fd7e2640 20 reqs_thread_entry: start 2024-09-12T00:46:21.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.834+0000 7f4549640800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:21.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.834+0000 7f4549640800 20 Filter name: none 2024-09-12T00:46:21.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.834+0000 7f43f67fc640 20 reqs_thread_entry: start 2024-09-12T00:46:21.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.834+0000 7f4549640800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:46:21.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.834+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.834+0000 7f4549640800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:21.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.834+0000 7f4549640800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:46:21.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.834+0000 7f4549640800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:46:21.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.834+0000 7f4549640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 : miss 2024-09-12T00:46:21.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.834+0000 7f4549640800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.835+0000 7f4549640800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:21.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.835+0000 7f4549640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 info.flags=0x17 2024-09-12T00:46:21.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.835+0000 7f4549640800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 to cache LRU end 2024-09-12T00:46:21.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.835+0000 7f4549640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:21.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.835+0000 7f4549640800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:21.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.835+0000 7f4549640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 2024-09-12T00:46:21.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.840+0000 7f4549640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 info.flags=0x17 2024-09-12T00:46:21.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.840+0000 7f4549640800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 to cache LRU end 2024-09-12T00:46:21.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.840+0000 7f4549640800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:21.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.840+0000 7f4549640800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19, ofs0, ns] 2024-09-12T00:46:21.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.840+0000 7f442a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398872 cookie 94798219323296 notifier 5897 bl.length()=911 2024-09-12T00:46:21.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.840+0000 7f442a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 info.flags=0x17 2024-09-12T00:46:21.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.840+0000 7f442a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 to cache LRU end 2024-09-12T00:46:21.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.840+0000 7f442a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:21.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.842+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): orig_sources= new_sources= 2024-09-12T00:46:21.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.842+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): potential sources added=[] removed=[] 2024-09-12T00:46:21.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.842+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): orig_dests= new_dests= 2024-09-12T00:46:21.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.842+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): potential dests added=[] removed=[] 2024-09-12T00:46:21.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.0 2024-09-12T00:46:21.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.0 2024-09-12T00:46:21.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.1 2024-09-12T00:46:21.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.1 2024-09-12T00:46:21.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.2 2024-09-12T00:46:21.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.2 2024-09-12T00:46:21.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.3 2024-09-12T00:46:21.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.3 2024-09-12T00:46:21.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.4 2024-09-12T00:46:21.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.4 2024-09-12T00:46:21.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.5 2024-09-12T00:46:21.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.5 2024-09-12T00:46:21.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.6 2024-09-12T00:46:21.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.6 2024-09-12T00:46:21.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.7 2024-09-12T00:46:21.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.7 2024-09-12T00:46:21.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.8 2024-09-12T00:46:21.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.8 2024-09-12T00:46:21.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.9 2024-09-12T00:46:21.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.9 2024-09-12T00:46:21.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.10 2024-09-12T00:46:21.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.10 2024-09-12T00:46:21.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.11 2024-09-12T00:46:21.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1.11 2024-09-12T00:46:21.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.846+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.0 2024-09-12T00:46:21.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.847+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1 2024-09-12T00:46:21.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.847+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.2 2024-09-12T00:46:21.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.848+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.3 2024-09-12T00:46:21.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.848+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.4 2024-09-12T00:46:21.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.849+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.5 2024-09-12T00:46:21.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.849+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.6 2024-09-12T00:46:21.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.850+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.7 2024-09-12T00:46:21.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.850+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.8 2024-09-12T00:46:21.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.851+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.9 2024-09-12T00:46:21.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.851+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.10 2024-09-12T00:46:21.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.854+0000 7f4549640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:21.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.854+0000 7f4549640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 2024-09-12T00:46:21.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.855+0000 7f4549640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 info.flags=0x17 2024-09-12T00:46:21.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.855+0000 7f4549640800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 to cache LRU end 2024-09-12T00:46:21.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.855+0000 7f4549640800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:21.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.855+0000 7f4549640800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19, ofs0, ns] 2024-09-12T00:46:21.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.856+0000 7f442a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 94798219323296 notifier 5897 bl.length()=911 2024-09-12T00:46:21.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.856+0000 7f442a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 info.flags=0x17 2024-09-12T00:46:21.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.856+0000 7f442a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 to cache LRU end 2024-09-12T00:46:21.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.856+0000 7f442a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:21.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.857+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): orig_sources= new_sources= 2024-09-12T00:46:21.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.857+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): potential sources added=[] removed=[] 2024-09-12T00:46:21.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.857+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): orig_dests= new_dests= 2024-09-12T00:46:21.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.857+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): potential dests added=[] removed=[] 2024-09-12T00:46:21.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.860+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.0 2024-09-12T00:46:21.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.860+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.1 2024-09-12T00:46:21.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.860+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.2 2024-09-12T00:46:21.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.861+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.3 2024-09-12T00:46:21.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.861+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.4 2024-09-12T00:46:21.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.861+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.5 2024-09-12T00:46:21.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.862+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.6 2024-09-12T00:46:21.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.862+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.7 2024-09-12T00:46:21.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.862+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.8 2024-09-12T00:46:21.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.863+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.9 2024-09-12T00:46:21.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.863+0000 7f4549640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19.10 2024-09-12T00:46:21.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.863+0000 7f4549640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:21.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.864+0000 7f4549640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 2024-09-12T00:46:21.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.865+0000 7f4549640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 info.flags=0x17 2024-09-12T00:46:21.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.865+0000 7f4549640800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 to cache LRU end 2024-09-12T00:46:21.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.865+0000 7f4549640800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:21.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.865+0000 7f4549640800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19, ofs0, ns] 2024-09-12T00:46:21.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.865+0000 7f442a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398874 cookie 94798219323296 notifier 5897 bl.length()=879 2024-09-12T00:46:21.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.865+0000 7f442a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 info.flags=0x17 2024-09-12T00:46:21.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.865+0000 7f442a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 to cache LRU end 2024-09-12T00:46:21.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.865+0000 7f442a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:21.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.867+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): orig_sources= new_sources= 2024-09-12T00:46:21.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.867+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): potential sources added=[] removed=[] 2024-09-12T00:46:21.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.867+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): orig_dests= new_dests= 2024-09-12T00:46:21.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.867+0000 7f4549640800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19]): potential dests added=[] removed=[] 2024-09-12T00:46:21.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.870+0000 7f4549640800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:46:21.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.872+0000 7f43fe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:21.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.875+0000 7f4549640800 20 remove_watcher() i=0 2024-09-12T00:46:21.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.875+0000 7f4549640800 2 removed watcher, disabling cache 2024-09-12T00:46:21.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.876+0000 7f4549640800 20 remove_watcher() i=1 2024-09-12T00:46:21.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.877+0000 7f4549640800 20 remove_watcher() i=2 2024-09-12T00:46:21.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.878+0000 7f4549640800 20 remove_watcher() i=3 2024-09-12T00:46:21.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.879+0000 7f4549640800 20 remove_watcher() i=4 2024-09-12T00:46:21.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.880+0000 7f4549640800 20 remove_watcher() i=5 2024-09-12T00:46:21.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.881+0000 7f4549640800 20 remove_watcher() i=6 2024-09-12T00:46:21.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.882+0000 7f4549640800 20 remove_watcher() i=7 2024-09-12T00:46:21.894 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:46:21.924 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:21.924 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:21.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.964+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.966+0000 7fb124126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.966+0000 7fb124126800 20 realm 2024-09-12T00:46:21.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.966+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.966+0000 7fb124126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.966+0000 7fb124126800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:21.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.966+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.966+0000 7fb124126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:21.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.966+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.967+0000 7fb124126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:21.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.967+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:21.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.967+0000 7fb124126800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:21.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.967+0000 7fb124126800 20 searching for the correct realm 2024-09-12T00:46:21.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:21.970+0000 7fb11f55c640 0 -- 172.21.15.19:0/3349085940 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fb114064440 msgr2=0x7fb1140648a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:22.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.176+0000 7fb12055e640 0 -- 172.21.15.19:0/3349085940 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5566848c2080 msgr2=0x5566848c4520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:22.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.180+0000 7fb124126800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:22.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.180+0000 7fb124126800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:22.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.180+0000 7fb124126800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:22.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.180+0000 7fb124126800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:22.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.180+0000 7fb124126800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:22.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.180+0000 7fb124126800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:22.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.180+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:22.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:22.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:22.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:22.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:22.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:22.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 20 zone default found 2024-09-12T00:46:22.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 4 Realm: () 2024-09-12T00:46:22.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:22.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:22.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:22.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 20 zonegroup default 2024-09-12T00:46:22.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:22.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:22.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.181+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:22.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.182+0000 7fb124126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:22.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.182+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:22.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.182+0000 7fb124126800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:22.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.182+0000 7fb124126800 20 started sync module instance, tier type = 2024-09-12T00:46:22.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.182+0000 7fb124126800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:22.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.191+0000 7fb124126800 20 add_watcher() i=0 2024-09-12T00:46:22.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.191+0000 7fb124126800 20 add_watcher() i=1 2024-09-12T00:46:22.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.191+0000 7fb124126800 20 add_watcher() i=2 2024-09-12T00:46:22.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.191+0000 7fb124126800 20 add_watcher() i=3 2024-09-12T00:46:22.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.191+0000 7fb124126800 20 add_watcher() i=4 2024-09-12T00:46:22.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.191+0000 7fb124126800 20 add_watcher() i=5 2024-09-12T00:46:22.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.191+0000 7fb124126800 20 add_watcher() i=6 2024-09-12T00:46:22.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.192+0000 7fb124126800 20 add_watcher() i=7 2024-09-12T00:46:22.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.192+0000 7fb124126800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:22.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.193+0000 7fafd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:22.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.193+0000 7fb124126800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:22.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.193+0000 7fb124126800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:22.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.194+0000 7fb124126800 5 note: GC not initialized 2024-09-12T00:46:22.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.194+0000 7fafd4fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:22.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.194+0000 7fb124126800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:22.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.194+0000 7fb124126800 20 Filter name: none 2024-09-12T00:46:22.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.194+0000 7faf4e7fc640 20 reqs_thread_entry: start 2024-09-12T00:46:22.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.194+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:22.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.194+0000 7fb124126800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:22.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.194+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:22.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.195+0000 7fb124126800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:22.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.195+0000 7fb124126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:22.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.195+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:22.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.195+0000 7fb124126800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:22.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.195+0000 7fb124126800 20 rados->read ofs=0 len=0 2024-09-12T00:46:22.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.196+0000 7fb124126800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:22.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.196+0000 7fb124126800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:22.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.198+0000 7fafd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:22.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.200+0000 7fb124126800 20 remove_watcher() i=0 2024-09-12T00:46:22.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.200+0000 7fb124126800 2 removed watcher, disabling cache 2024-09-12T00:46:22.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.201+0000 7fb124126800 20 remove_watcher() i=1 2024-09-12T00:46:22.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.202+0000 7fb124126800 20 remove_watcher() i=2 2024-09-12T00:46:22.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.203+0000 7fb124126800 20 remove_watcher() i=3 2024-09-12T00:46:22.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.204+0000 7fb124126800 20 remove_watcher() i=4 2024-09-12T00:46:22.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.206+0000 7fb124126800 20 remove_watcher() i=5 2024-09-12T00:46:22.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.207+0000 7fb124126800 20 remove_watcher() i=6 2024-09-12T00:46:22.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:22.209+0000 7fb124126800 20 remove_watcher() i=7 2024-09-12T00:46:22.219 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:22.219 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:22.219 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-init-index id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:46:22.219 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:22.221 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.222 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.242 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.242 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.439 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.439 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.582 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:46:22.582 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:22.583 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.583 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.630 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.630 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.687 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.687 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.720 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.720 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.753 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.753 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.787 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.787 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.822 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.823 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.862 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.862 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.896 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.896 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.930 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.930 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.963 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.963 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:22.997 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:22.997 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:23.030 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:23.030 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:23.064 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:23.064 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:23.098 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:23.098 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:23.133 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:23.133 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:23.165 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:23.165 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:23.198 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:23.199 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:23.231 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:23.231 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:23.267 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:23.267 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:23.301 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:23.301 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:23.334 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:23.335 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:23.368 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:46:23.397 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:23.397 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:23.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.624+0000 7f51203e6640 0 --2- 172.21.15.19:0/3425858993 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55f9aa35e250 0x55f9aa4efdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:46:23.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.641+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.643+0000 7f5125417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:23.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.643+0000 7f5125417800 20 realm 2024-09-12T00:46:23.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.643+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.643+0000 7f5125417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:23.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.643+0000 7f5125417800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:23.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.643+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.643+0000 7f5125417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:23.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.643+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.644+0000 7f5125417800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:23.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.644+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.644+0000 7f5125417800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:23.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.644+0000 7f5125417800 20 searching for the correct realm 2024-09-12T00:46:23.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.646+0000 7f5120be7640 0 -- 172.21.15.19:0/850073066 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55f9aa598980 msgr2=0x55f9aa59ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:23.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.650+0000 7f51213e8640 0 -- 172.21.15.19:0/850073066 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7f51100a9040 msgr2=0x7f51100a9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:23.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.858+0000 7f5125417800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:23.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.858+0000 7f5125417800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:23.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.858+0000 7f5125417800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:23.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.858+0000 7f5125417800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:23.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.858+0000 7f5125417800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:23.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.858+0000 7f5125417800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:23.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.858+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.858+0000 7f5125417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:23.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.858+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.858+0000 7f5125417800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:23.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.858+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:23.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 20 zone default found 2024-09-12T00:46:23.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 4 Realm: () 2024-09-12T00:46:23.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:23.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:23.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:23.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 20 zonegroup default 2024-09-12T00:46:23.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:23.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:23.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.859+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.860+0000 7f5125417800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:23.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.860+0000 7f5125417800 20 started sync module instance, tier type = 2024-09-12T00:46:23.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.860+0000 7f5125417800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:23.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.869+0000 7f5125417800 20 add_watcher() i=0 2024-09-12T00:46:23.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.869+0000 7f5125417800 20 add_watcher() i=1 2024-09-12T00:46:23.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.869+0000 7f5125417800 20 add_watcher() i=2 2024-09-12T00:46:23.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.869+0000 7f5125417800 20 add_watcher() i=3 2024-09-12T00:46:23.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.869+0000 7f5125417800 20 add_watcher() i=4 2024-09-12T00:46:23.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.869+0000 7f5125417800 20 add_watcher() i=5 2024-09-12T00:46:23.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.869+0000 7f5125417800 20 add_watcher() i=6 2024-09-12T00:46:23.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.870+0000 7f5125417800 20 add_watcher() i=7 2024-09-12T00:46:23.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.870+0000 7f5125417800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:23.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.872+0000 7f4fd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:23.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.872+0000 7f5125417800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:23.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.872+0000 7f5125417800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:23.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.872+0000 7f5125417800 5 note: GC not initialized 2024-09-12T00:46:23.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.873+0000 7f4fd5fe3640 20 reqs_thread_entry: start 2024-09-12T00:46:23.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.873+0000 7f5125417800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:23.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.873+0000 7f5125417800 20 Filter name: none 2024-09-12T00:46:23.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.873+0000 7f4f477fe640 20 reqs_thread_entry: start 2024-09-12T00:46:23.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.873+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.874+0000 7f5125417800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:23.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.874+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.874+0000 7f5125417800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:23.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.874+0000 7f5125417800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:23.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.874+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.875+0000 7f5125417800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:23.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.875+0000 7f5125417800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.875+0000 7f5125417800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:23.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.875+0000 7f5125417800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:23.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.877+0000 7f4fd6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:23.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.879+0000 7f5125417800 20 remove_watcher() i=0 2024-09-12T00:46:23.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.879+0000 7f5125417800 2 removed watcher, disabling cache 2024-09-12T00:46:23.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.880+0000 7f5125417800 20 remove_watcher() i=1 2024-09-12T00:46:23.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.881+0000 7f5125417800 20 remove_watcher() i=2 2024-09-12T00:46:23.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.882+0000 7f5125417800 20 remove_watcher() i=3 2024-09-12T00:46:23.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.883+0000 7f5125417800 20 remove_watcher() i=4 2024-09-12T00:46:23.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.884+0000 7f5125417800 20 remove_watcher() i=5 2024-09-12T00:46:23.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.885+0000 7f5125417800 20 remove_watcher() i=6 2024-09-12T00:46:23.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.886+0000 7f5125417800 20 remove_watcher() i=7 2024-09-12T00:46:23.896 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:23.896 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:23.896 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-init-index id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:46:23.896 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:23.897 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:46:23.934 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:23.934 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:23.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.976+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.977+0000 7f2a49b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:23.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.977+0000 7f2a49b39800 20 realm 2024-09-12T00:46:23.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.977+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.977+0000 7f2a49b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:23.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.977+0000 7f2a49b39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:23.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.977+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.977+0000 7f2a49b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:23.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.977+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.978+0000 7f2a49b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:23.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.978+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:23.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.978+0000 7f2a49b39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:23.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.978+0000 7f2a49b39800 20 searching for the correct realm 2024-09-12T00:46:23.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:23.982+0000 7f2a44fc6640 0 -- 172.21.15.19:0/1967290596 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f2a3c0adfc0 msgr2=0x7f2a3c0ad040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:24.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.187+0000 7f2a45fc8640 0 -- 172.21.15.19:0/1967290596 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x56290d6a7160 msgr2=0x56290d6a95e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:24.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.191+0000 7f2a49b39800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:24.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.191+0000 7f2a49b39800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:24.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.191+0000 7f2a49b39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:24.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.191+0000 7f2a49b39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:24.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.191+0000 7f2a49b39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:24.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.191+0000 7f2a49b39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:24.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.191+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:24.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:24.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 20 zone default found 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 4 Realm: () 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 20 zonegroup default 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.192+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.193+0000 7f2a49b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.193+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.193+0000 7f2a49b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.193+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.193+0000 7f2a49b39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.193+0000 7f2a49b39800 20 started sync module instance, tier type = 2024-09-12T00:46:24.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.193+0000 7f2a49b39800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:24.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.202+0000 7f2a49b39800 20 add_watcher() i=0 2024-09-12T00:46:24.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.202+0000 7f2a49b39800 20 add_watcher() i=1 2024-09-12T00:46:24.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.202+0000 7f2a49b39800 20 add_watcher() i=2 2024-09-12T00:46:24.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.202+0000 7f2a49b39800 20 add_watcher() i=3 2024-09-12T00:46:24.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.202+0000 7f2a49b39800 20 add_watcher() i=4 2024-09-12T00:46:24.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.202+0000 7f2a49b39800 20 add_watcher() i=5 2024-09-12T00:46:24.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.202+0000 7f2a49b39800 20 add_watcher() i=6 2024-09-12T00:46:24.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.203+0000 7f2a49b39800 20 add_watcher() i=7 2024-09-12T00:46:24.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.203+0000 7f2a49b39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:24.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.205+0000 7f28fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:24.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.205+0000 7f2a49b39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:24.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.205+0000 7f2a49b39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:24.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.205+0000 7f2a49b39800 5 note: GC not initialized 2024-09-12T00:46:24.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.205+0000 7f28fa7e4640 20 reqs_thread_entry: start 2024-09-12T00:46:24.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.205+0000 7f2a49b39800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:24.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.205+0000 7f2a49b39800 20 Filter name: none 2024-09-12T00:46:24.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.206+0000 7f286bfff640 20 reqs_thread_entry: start 2024-09-12T00:46:24.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.206+0000 7f2a49b39800 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:46:24.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.206+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.206+0000 7f2a49b39800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:24.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.206+0000 7f2a49b39800 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:46:24.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.206+0000 7f2a49b39800 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:46:24.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.206+0000 7f2a49b39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 : miss 2024-09-12T00:46:24.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.206+0000 7f2a49b39800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.207+0000 7f2a49b39800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:24.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.207+0000 7f2a49b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 info.flags=0x17 2024-09-12T00:46:24.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.207+0000 7f2a49b39800 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 to cache LRU end 2024-09-12T00:46:24.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.207+0000 7f2a49b39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:24.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.207+0000 7f2a49b39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:24.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.207+0000 7f2a49b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 2024-09-12T00:46:24.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.208+0000 7f2a49b39800 -1 Injecting error=-95 at location=init_index 2024-09-12T00:46:24.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.208+0000 7f2a49b39800 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:46:24.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.213+0000 7f2a49b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 info.flags=0x17 2024-09-12T00:46:24.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.213+0000 7f2a49b39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 to cache LRU end 2024-09-12T00:46:24.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.214+0000 7f2a49b39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:24.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.214+0000 7f2a49b39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20, ofs0, ns] 2024-09-12T00:46:24.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.214+0000 7f2917fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398877 cookie 94734318735504 notifier 6285 bl.length()=911 2024-09-12T00:46:24.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.214+0000 7f2917fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 info.flags=0x17 2024-09-12T00:46:24.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.214+0000 7f2917fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 to cache LRU end 2024-09-12T00:46:24.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.214+0000 7f2917fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:24.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.216+0000 7f2a49b39800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20]): orig_sources= new_sources= 2024-09-12T00:46:24.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.216+0000 7f2a49b39800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20]): potential sources added=[] removed=[] 2024-09-12T00:46:24.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.216+0000 7f2a49b39800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20]): orig_dests= new_dests= 2024-09-12T00:46:24.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.216+0000 7f2a49b39800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20]): potential dests added=[] removed=[] 2024-09-12T00:46:24.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.0 2024-09-12T00:46:24.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.0 2024-09-12T00:46:24.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.1 2024-09-12T00:46:24.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.1 2024-09-12T00:46:24.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.2 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.2 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.3 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.3 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.4 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.4 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.5 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.5 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.6 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.6 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.7 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.7 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.8 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.8 2024-09-12T00:46:24.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.9 2024-09-12T00:46:24.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.9 2024-09-12T00:46:24.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.10 2024-09-12T00:46:24.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.10 2024-09-12T00:46:24.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.11 2024-09-12T00:46:24.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1.11 2024-09-12T00:46:24.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.218+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.0 2024-09-12T00:46:24.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.219+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.1 2024-09-12T00:46:24.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.219+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.2 2024-09-12T00:46:24.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.220+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.3 2024-09-12T00:46:24.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.220+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.4 2024-09-12T00:46:24.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.221+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.5 2024-09-12T00:46:24.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.222+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.6 2024-09-12T00:46:24.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.222+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.7 2024-09-12T00:46:24.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.223+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.8 2024-09-12T00:46:24.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.223+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.9 2024-09-12T00:46:24.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.224+0000 7f2a49b39800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20.10 2024-09-12T00:46:24.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.227+0000 7f2a49b39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:24.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.227+0000 7f2a49b39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 2024-09-12T00:46:24.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.228+0000 7f2a49b39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 info.flags=0x17 2024-09-12T00:46:24.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.228+0000 7f2a49b39800 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 to cache LRU end 2024-09-12T00:46:24.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.228+0000 7f2a49b39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:24.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.228+0000 7f2a49b39800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20, ofs0, ns] 2024-09-12T00:46:24.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.228+0000 7f2928ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 94734318735504 notifier 6285 bl.length()=879 2024-09-12T00:46:24.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.228+0000 7f2928ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 info.flags=0x17 2024-09-12T00:46:24.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.228+0000 7f2928ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 to cache LRU end 2024-09-12T00:46:24.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.228+0000 7f2928ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:24.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.230+0000 7f2a49b39800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20]): orig_sources= new_sources= 2024-09-12T00:46:24.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.230+0000 7f2a49b39800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20]): potential sources added=[] removed=[] 2024-09-12T00:46:24.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.230+0000 7f2a49b39800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20]): orig_dests= new_dests= 2024-09-12T00:46:24.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.230+0000 7f2a49b39800 20 handle_bi_update(): bucket=:error-at-init-index[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20]): potential dests added=[] removed=[] 2024-09-12T00:46:24.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.232+0000 7f2a49b39800 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:46:24.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.234+0000 7f28fb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:24.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.236+0000 7f2a49b39800 20 remove_watcher() i=0 2024-09-12T00:46:24.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.236+0000 7f2a49b39800 2 removed watcher, disabling cache 2024-09-12T00:46:24.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.237+0000 7f2a49b39800 20 remove_watcher() i=1 2024-09-12T00:46:24.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.239+0000 7f2a49b39800 20 remove_watcher() i=2 2024-09-12T00:46:24.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.240+0000 7f2a49b39800 20 remove_watcher() i=3 2024-09-12T00:46:24.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.242+0000 7f2a49b39800 20 remove_watcher() i=4 2024-09-12T00:46:24.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.243+0000 7f2a49b39800 20 remove_watcher() i=5 2024-09-12T00:46:24.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.244+0000 7f2a49b39800 20 remove_watcher() i=6 2024-09-12T00:46:24.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.245+0000 7f2a49b39800 20 remove_watcher() i=7 2024-09-12T00:46:24.256 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:46:24.285 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:24.285 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:24.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.325+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.327+0000 7fd5f500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:24.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.327+0000 7fd5f500e800 20 realm 2024-09-12T00:46:24.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.327+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.327+0000 7fd5f500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:24.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.327+0000 7fd5f500e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:24.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.327+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.328+0000 7fd5f500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:24.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.328+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.328+0000 7fd5f500e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:24.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.328+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.328+0000 7fd5f500e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:24.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.328+0000 7fd5f500e800 20 searching for the correct realm 2024-09-12T00:46:24.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.332+0000 7fd5eff79640 0 -- 172.21.15.19:0/3613148911 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fd5e4056a60 msgr2=0x7fd5e40bf130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:24.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.336+0000 7fd5f0f7b640 0 -- 172.21.15.19:0/3613148911 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x561dec5d7200 msgr2=0x561dec5d9670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:24.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.339+0000 7fd5f500e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:24.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.339+0000 7fd5f500e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:24.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.339+0000 7fd5f500e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:24.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.339+0000 7fd5f500e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:24.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.339+0000 7fd5f500e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:24.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.339+0000 7fd5f500e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:24.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.339+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:24.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:24.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:24.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 20 zone default found 2024-09-12T00:46:24.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 4 Realm: () 2024-09-12T00:46:24.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:24.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:24.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:24.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 20 zonegroup default 2024-09-12T00:46:24.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:24.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.340+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.341+0000 7fd5f500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:24.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.341+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.341+0000 7fd5f500e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:24.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.341+0000 7fd5f500e800 20 started sync module instance, tier type = 2024-09-12T00:46:24.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.341+0000 7fd5f500e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:24.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.349+0000 7fd5f500e800 20 add_watcher() i=0 2024-09-12T00:46:24.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.349+0000 7fd5f500e800 20 add_watcher() i=1 2024-09-12T00:46:24.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.349+0000 7fd5f500e800 20 add_watcher() i=2 2024-09-12T00:46:24.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.349+0000 7fd5f500e800 20 add_watcher() i=3 2024-09-12T00:46:24.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.349+0000 7fd5f500e800 20 add_watcher() i=4 2024-09-12T00:46:24.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.349+0000 7fd5f500e800 20 add_watcher() i=5 2024-09-12T00:46:24.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.349+0000 7fd5f500e800 20 add_watcher() i=6 2024-09-12T00:46:24.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.350+0000 7fd5f500e800 20 add_watcher() i=7 2024-09-12T00:46:24.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.350+0000 7fd5f500e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:24.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.352+0000 7fd4a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:24.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.352+0000 7fd5f500e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:24.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.352+0000 7fd5f500e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:24.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.352+0000 7fd5f500e800 5 note: GC not initialized 2024-09-12T00:46:24.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.353+0000 7fd4a5fdb640 20 reqs_thread_entry: start 2024-09-12T00:46:24.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.353+0000 7fd5f500e800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:24.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.353+0000 7fd5f500e800 20 Filter name: none 2024-09-12T00:46:24.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.353+0000 7fd4177fe640 20 reqs_thread_entry: start 2024-09-12T00:46:24.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.353+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.353+0000 7fd5f500e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:24.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.353+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.354+0000 7fd5f500e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:24.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.354+0000 7fd5f500e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:24.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.354+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.354+0000 7fd5f500e800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:46:24.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.354+0000 7fd5f500e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:24.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.355+0000 7fd5f500e800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:46:24.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.355+0000 7fd5f500e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:24.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.357+0000 7fd4a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:24.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.359+0000 7fd5f500e800 20 remove_watcher() i=0 2024-09-12T00:46:24.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.359+0000 7fd5f500e800 2 removed watcher, disabling cache 2024-09-12T00:46:24.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.360+0000 7fd5f500e800 20 remove_watcher() i=1 2024-09-12T00:46:24.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.361+0000 7fd5f500e800 20 remove_watcher() i=2 2024-09-12T00:46:24.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.362+0000 7fd5f500e800 20 remove_watcher() i=3 2024-09-12T00:46:24.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.362+0000 7fd5f500e800 20 remove_watcher() i=4 2024-09-12T00:46:24.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.363+0000 7fd5f500e800 20 remove_watcher() i=5 2024-09-12T00:46:24.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.364+0000 7fd5f500e800 20 remove_watcher() i=6 2024-09-12T00:46:24.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:24.365+0000 7fd5f500e800 20 remove_watcher() i=7 2024-09-12T00:46:24.375 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:24.375 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:24.375 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-init-index id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:46:24.375 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:24.377 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:24.378 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:24.399 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:24.399 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:24.598 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:24.599 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:24.735 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:46:24.736 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:24.737 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:24.737 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:24.785 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:24.786 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:24.842 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:24.843 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:24.879 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:24.879 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:24.912 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:24.913 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:24.949 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:24.949 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:24.983 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:24.983 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.016 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.016 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.050 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.051 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.084 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.084 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.119 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.119 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.153 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.154 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.188 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.188 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.222 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.222 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.257 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.258 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.292 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.292 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.327 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.327 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.361 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.361 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.393 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.394 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.427 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.427 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.461 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.461 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.495 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:25.495 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:25.529 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:46:25.558 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:25.558 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:25.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.598+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.600+0000 7fd798975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.600+0000 7fd798975800 20 realm 2024-09-12T00:46:25.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.600+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.600+0000 7fd798975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.600+0000 7fd798975800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:25.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.600+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.601+0000 7fd798975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.601+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.601+0000 7fd798975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:25.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.601+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.602+0000 7fd798975800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:25.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.602+0000 7fd798975800 20 searching for the correct realm 2024-09-12T00:46:25.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.605+0000 7fd795c5e640 0 -- 172.21.15.19:0/2582010772 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fd78c071c00 msgr2=0x7fd78c070960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:25.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.608+0000 7fd796c60640 0 -- 172.21.15.19:0/2582010772 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x557ed70c7470 msgr2=0x557ed70c9910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:25.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.613+0000 7fd798975800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:25.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.613+0000 7fd798975800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:25.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.613+0000 7fd798975800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:25.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.613+0000 7fd798975800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:25.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.613+0000 7fd798975800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:25.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.613+0000 7fd798975800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:25.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.613+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.613+0000 7fd798975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.613+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.613+0000 7fd798975800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:25.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.613+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:25.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 20 zone default found 2024-09-12T00:46:25.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 4 Realm: () 2024-09-12T00:46:25.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:25.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:25.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:25.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 20 zonegroup default 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.614+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.615+0000 7fd798975800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.615+0000 7fd798975800 20 started sync module instance, tier type = 2024-09-12T00:46:25.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.615+0000 7fd798975800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.623+0000 7fd798975800 20 add_watcher() i=0 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.623+0000 7fd798975800 20 add_watcher() i=1 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.623+0000 7fd798975800 20 add_watcher() i=2 2024-09-12T00:46:25.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.623+0000 7fd798975800 20 add_watcher() i=3 2024-09-12T00:46:25.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.623+0000 7fd798975800 20 add_watcher() i=4 2024-09-12T00:46:25.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.623+0000 7fd798975800 20 add_watcher() i=5 2024-09-12T00:46:25.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.623+0000 7fd798975800 20 add_watcher() i=6 2024-09-12T00:46:25.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.624+0000 7fd798975800 20 add_watcher() i=7 2024-09-12T00:46:25.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.624+0000 7fd798975800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:25.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.626+0000 7fd64cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:25.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.626+0000 7fd798975800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:25.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.626+0000 7fd798975800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:25.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.626+0000 7fd798975800 5 note: GC not initialized 2024-09-12T00:46:25.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.626+0000 7fd5c77fe640 20 reqs_thread_entry: start 2024-09-12T00:46:25.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.626+0000 7fd798975800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:25.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.626+0000 7fd798975800 20 Filter name: none 2024-09-12T00:46:25.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.626+0000 7fd5c57fa640 20 reqs_thread_entry: start 2024-09-12T00:46:25.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.626+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.627+0000 7fd798975800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:46:25.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.627+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.628+0000 7fd798975800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:46:25.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.628+0000 7fd798975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:25.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.628+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.628+0000 7fd798975800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:46:25.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.628+0000 7fd798975800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.628+0000 7fd798975800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:46:25.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.628+0000 7fd798975800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:25.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.630+0000 7fd64cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:25.630 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.632+0000 7fd798975800 20 remove_watcher() i=0 2024-09-12T00:46:25.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.632+0000 7fd798975800 2 removed watcher, disabling cache 2024-09-12T00:46:25.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.633+0000 7fd798975800 20 remove_watcher() i=1 2024-09-12T00:46:25.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.634+0000 7fd798975800 20 remove_watcher() i=2 2024-09-12T00:46:25.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.635+0000 7fd798975800 20 remove_watcher() i=3 2024-09-12T00:46:25.634 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.636+0000 7fd798975800 20 remove_watcher() i=4 2024-09-12T00:46:25.635 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.636+0000 7fd798975800 20 remove_watcher() i=5 2024-09-12T00:46:25.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.637+0000 7fd798975800 20 remove_watcher() i=6 2024-09-12T00:46:25.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.638+0000 7fd798975800 20 remove_watcher() i=7 2024-09-12T00:46:25.649 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:25.649 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:25.649 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-init-indext id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:46:25.649 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:25.650 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:46:25.684 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:25.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.726+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.727+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.727+0000 7fcabf119800 20 realm 2024-09-12T00:46:25.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.727+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.728+0000 7fcabf119800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:25.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:25.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:25.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.729+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:25.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.729+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:25.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.729+0000 7fcabf119800 20 searching for the correct realm 2024-09-12T00:46:25.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.731+0000 7fcabcc0a640 0 -- 172.21.15.19:0/3639147051 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7fcaac0bd020 msgr2=0x7fcaac0a3890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:25.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:25.936+0000 7fcabd40b640 0 -- 172.21.15.19:0/3639147051 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7fcaac05ac10 msgr2=0x7fcaac0b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:26.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 20 zone default found 2024-09-12T00:46:26.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 4 Realm: () 2024-09-12T00:46:26.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:26.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:26.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:26.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 20 zonegroup default 2024-09-12T00:46:26.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.146+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.146+0000 7fcabf119800 20 started sync module instance, tier type = 2024-09-12T00:46:26.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.146+0000 7fcabf119800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:26.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=0 2024-09-12T00:46:26.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=1 2024-09-12T00:46:26.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=2 2024-09-12T00:46:26.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=3 2024-09-12T00:46:26.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=4 2024-09-12T00:46:26.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=5 2024-09-12T00:46:26.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=6 2024-09-12T00:46:26.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.156+0000 7fcabf119800 20 add_watcher() i=7 2024-09-12T00:46:26.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.156+0000 7fcabf119800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:26.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.158+0000 7fc9737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:26.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.158+0000 7fcabf119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:26.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.158+0000 7fcabf119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:26.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.158+0000 7fcabf119800 5 note: GC not initialized 2024-09-12T00:46:26.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.158+0000 7fc9727e4640 20 reqs_thread_entry: start 2024-09-12T00:46:26.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.158+0000 7fcabf119800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:26.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.158+0000 7fcabf119800 20 Filter name: none 2024-09-12T00:46:26.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.158+0000 7fc96bfff640 20 reqs_thread_entry: start 2024-09-12T00:46:26.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:46:26.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:46:26.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:46:26.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:46:26.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 : miss 2024-09-12T00:46:26.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:46:26.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 info.flags=0x17 2024-09-12T00:46:26.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to cache LRU end 2024-09-12T00:46:26.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:26.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:26.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.159+0000 7fcabf119800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 2024-09-12T00:46:26.159 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcabf119800 time 2024-09-12T00:46:26.161737+0000 2024-09-12T00:46:26.159 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:46:26.160 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:46:26.160 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcac258c71a] 2024-09-12T00:46:26.160 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcac258c8d8] 2024-09-12T00:46:26.160 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b2187f1641] 2024-09-12T00:46:26.160 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd877a4) [0x55b218d037a4] 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b21880131d] 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcac1229590] 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fcabf119800 thread_name:radosgw-admin 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.161+0000 7fcabf119800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcabf119800 time 2024-09-12T00:46:26.161737+0000 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcac258c71a] 2024-09-12T00:46:26.161 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcac258c8d8] 2024-09-12T00:46:26.162 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b2187f1641] 2024-09-12T00:46:26.162 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd877a4) [0x55b218d037a4] 2024-09-12T00:46:26.162 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b21880131d] 2024-09-12T00:46:26.162 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:46:26.162 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcac1229590] 2024-09-12T00:46:26.162 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:46:26.162 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:46:26.162 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.182 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:46:26.182 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcac123e6f0] 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcac128b99c] 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcac258c774] 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcac258c8d8] 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b2187f1641] 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd877a4) [0x55b218d037a4] 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b21880131d] 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcac1229590] 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:46:26.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.162+0000 7fcabf119800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fcabf119800 thread_name:radosgw-admin 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcac123e6f0] 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcac128b99c] 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcac258c774] 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcac258c8d8] 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b2187f1641] 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd877a4) [0x55b218d037a4] 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b21880131d] 2024-09-12T00:46:26.184 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcac1229590] 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 monclient: authenticate success, global_id 6327 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:46:25.708+0000 7fcabf119800 10 monclient: get_monmap_and_config success 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:46:25.708+0000 7fcabf119800 4 set_mon_vals no callback set 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:46:25.708+0000 7fc9aae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:46:25.708+0000 7fc9aae0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:46:25.708+0000 7fc9aae0d640 10 monclient: dump: 2024-09-12T00:46:26.185 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:46:25.708+0000 7fcabf119800 10 monclient: shutdown 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 asok(0x55b21a8ee630) unregister_commands rotate-key 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:46:25.708+0000 7fcabf119800 10 monclient: build_initial_monmap 2024-09-12T00:46:26.186 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:46:25.708+0000 7fcabf119800 1 build_initial for_mkfs: 0 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:46:25.708+0000 7fcabf119800 10 monclient: monmap: 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding auth protocol: cephx 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding auth protocol: cephx 2024-09-12T00:46:26.187 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding auth protocol: cephx 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:46:25.709+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.188 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:46:25.709+0000 7fcabf119800 1 librados: starting msgr at 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:46:25.709+0000 7fcabf119800 1 librados: starting objecter 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command objecter_requests hook 0x55b21ab421a0 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:46:25.709+0000 7fcabf119800 1 librados: setting wanted keys 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:46:25.709+0000 7fcabf119800 1 librados: calling monclient init 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient: init 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding auth protocol: cephx 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding auth protocol: cephx 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding auth protocol: cephx 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.189 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:46:25.709+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:46:25.709+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command rotate-key hook 0x55b21ab108c8 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient: _reopen_session rank -1 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:46:26.190 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-a con 0x55b21a9c4620 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-b con 0x55b21a9c64f0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-c con 0x55b21aa580b0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): _renew_subs 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): authenticate will time out at 2052.211989s 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request con 0x55b21a9c4620 auth_method 0 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): get_auth_request con 0x55b21aa580b0 auth_method 0 2024-09-12T00:46:26.191 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): get_auth_request con 0x55b21a9c64f0 auth_method 0 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.192 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_done global_id 6330 payload 824 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient: _finish_hunting 0 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 1 monclient: found mon.noname-a 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: dump: 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.193 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: _finish_auth 0 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: _check_auth_tickets 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: dump: 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.194 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.195 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.195 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.195 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.195 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.195 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.195 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.195 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.195 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:46:25.710+0000 7fcabf119800 5 monclient: authenticate success, global_id 6330 2024-09-12T00:46:26.195 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:46:25.710+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.195 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:46:25.710+0000 7fcabf119800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:46:25.710+0000 7fc9aae0d640 4 set_mon_vals no callback set 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:46:25.710+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:46:25.710+0000 7fcabf119800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:46:25.710+0000 7fcabf119800 1 librados: init done 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:46:25.712+0000 7fc9a960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:46:25.712+0000 7fc9a960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:46:25.712+0000 7fc9a960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:46:25.713+0000 7fcabc409640 10 monclient: get_auth_request con 0x7fc9a4076470 auth_method 0 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:46:25.713+0000 7fcabd40b640 10 monclient: get_auth_request con 0x55b21ab38e60 auth_method 0 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:46:25.714+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x55b21ab5be50 auth_method 0 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:46:25.714+0000 7fc9a960a640 1 client.6330.objecter ms_handle_reset 0x55b21ab5be50 session 0x55b21ab5b7d0 osd.1 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:46:25.714+0000 7fc9a960a640 10 monclient: _renew_subs 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:46:25.714+0000 7fc9a960a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:46:26.196 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:46:25.714+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x7fc9a4086790 auth_method 0 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:46:25.715+0000 7fcabc409640 10 monclient: get_auth_request con 0x55b21ab5cdc0 auth_method 0 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:46:25.716+0000 7fcabf119800 10 monclient: build_initial_monmap 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:46:25.716+0000 7fcabf119800 1 build_initial for_mkfs: 0 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:46:25.716+0000 7fcabf119800 10 monclient: monmap: 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:46:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding auth protocol: cephx 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding auth protocol: cephx 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding auth protocol: cephx 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.198 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:46:25.716+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command objecter_requests cmddesc objecter_requests hook 0x55b21ab66510 EEXIST 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient: init 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding auth protocol: cephx 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding auth protocol: cephx 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding auth protocol: cephx 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.199 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:46:25.717+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:46:25.717+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command rotate-key cmddesc rotate-key hook 0x55b21ab61bf0 EEXIST 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient: _reopen_session rank -1 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:46:26.200 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-c con 0x55b21ab8a200 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-a con 0x55b21ab8c4d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-b con 0x55b21ab889d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): _renew_subs 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): authenticate will time out at 2052.219706s 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request con 0x55b21ab8a200 auth_method 0 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): get_auth_request con 0x55b21ab8c4d0 auth_method 0 2024-09-12T00:46:26.201 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:46:25.717+0000 7fcabd40b640 10 monclient(hunting): get_auth_request con 0x55b21ab889d0 auth_method 0 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:46:25.717+0000 7fcabd40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:46:25.717+0000 7fcabd40b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:46:25.717+0000 7fcabd40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:46:25.717+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.202 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:46:25.718+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:46:25.718+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:46:25.718+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_done global_id 5993 payload 824 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:46:25.718+0000 7fcabcc0a640 10 monclient: _finish_hunting 0 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:46:25.718+0000 7fcabcc0a640 1 monclient: found mon.noname-c 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:46:25.718+0000 7fcabcc0a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: dump: 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.203 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: _finish_auth 0 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: _check_auth_tickets 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: dump: 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:46:25.718+0000 7fcabf119800 5 monclient: authenticate success, global_id 5993 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:46:25.718+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:46:25.718+0000 7fcabdc0c640 4 set_mon_vals no callback set 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:46:25.718+0000 7fcabf119800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.205 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:46:25.718+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:46:25.718+0000 7fcabf119800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:46:25.720+0000 7fc9a27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:46:25.720+0000 7fc9a27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:46:25.720+0000 7fc9a27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:46:25.720+0000 7fcabc409640 10 monclient: get_auth_request con 0x7fc994076380 auth_method 0 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:46:25.720+0000 7fcabf119800 10 monclient: get_monmap_and_config 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:46:25.720+0000 7fcabf119800 10 monclient: build_initial_monmap 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:46:25.720+0000 7fcabf119800 1 build_initial for_mkfs: 0 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:46:25.720+0000 7fcabf119800 10 monclient: monmap: 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:46:26.206 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding auth protocol: cephx 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding auth protocol: cephx 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding auth protocol: cephx 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.207 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:46:25.720+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient: init 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding auth protocol: cephx 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding auth protocol: cephx 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding auth protocol: cephx 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.208 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:46:25.721+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:46:25.721+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.209 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command rotate-key cmddesc rotate-key hook 0x7fff4a7d6d68 EEXIST 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient: _reopen_session rank -1 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-b con 0x55b21abde220 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-a con 0x55b21abceb70 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-c con 0x55b21abd9650 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): _renew_subs 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): authenticate will time out at 2052.223546s 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): get_auth_request con 0x55b21abceb70 auth_method 0 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.210 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.211 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.211 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): get_auth_request con 0x55b21abd9650 auth_method 0 2024-09-12T00:46:26.211 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.211 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.211 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.211 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.211 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.211 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.211 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:46:25.721+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request con 0x55b21abde220 auth_method 0 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:46:25.721+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:46:25.721+0000 7fcabcc0a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:46:25.721+0000 7fcabcc0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): handle_auth_done global_id 6336 payload 274 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient: _finish_hunting 0 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:46:25.721+0000 7fcabc409640 1 monclient: found mon.noname-a 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.213 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: dump: 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: _finish_auth 0 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: _check_auth_tickets 2024-09-12T00:46:26.214 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 monclient: authenticate success, global_id 6336 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:46:25.722+0000 7fcabf119800 10 monclient: get_monmap_and_config success 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:46:25.722+0000 7fcabf119800 4 set_mon_vals no callback set 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: dump: 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.215 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:46:25.722+0000 7fcabf119800 10 monclient: shutdown 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:46:25.722+0000 7fcabf119800 10 monclient: build_initial_monmap 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:46:25.722+0000 7fcabf119800 1 build_initial for_mkfs: 0 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:46:25.722+0000 7fcabf119800 10 monclient: monmap: 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:46:26.216 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding auth protocol: cephx 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding auth protocol: cephx 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding auth protocol: cephx 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.217 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:46:25.723+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:46:25.723+0000 7fcabf119800 1 librados: starting msgr at 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:46:25.723+0000 7fcabf119800 1 librados: starting objecter 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command objecter_requests cmddesc objecter_requests hook 0x55b21abad690 EEXIST 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:46:25.723+0000 7fcabf119800 1 librados: setting wanted keys 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:46:25.723+0000 7fcabf119800 1 librados: calling monclient init 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient: init 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding auth protocol: cephx 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding auth protocol: cephx 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding auth protocol: cephx 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.218 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:46:25.723+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:46:25.723+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command rotate-key cmddesc rotate-key hook 0x55b21aba20f8 EEXIST 2024-09-12T00:46:26.219 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient: _reopen_session rank -1 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-b con 0x55b21abceb70 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-c con 0x55b21abd9650 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-a con 0x55b21abde220 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): _renew_subs 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): authenticate will time out at 2052.225871s 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:46:25.723+0000 7fcabc409640 10 monclient(hunting): get_auth_request con 0x55b21abd9650 auth_method 0 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:46:25.723+0000 7fcabc409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:46:25.723+0000 7fcabc409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.220 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:46:25.723+0000 7fcabc409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): get_auth_request con 0x55b21abde220 auth_method 0 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request con 0x55b21abceb70 auth_method 0 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.221 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient(hunting): handle_auth_done global_id 5999 payload 824 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient: _finish_hunting 0 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:46:25.724+0000 7fcabc409640 1 monclient: found mon.noname-c 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: dump: 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.222 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: _finish_auth 0 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: _check_auth_tickets 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: dump: 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.223 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:46:25.724+0000 7fcabf119800 5 monclient: authenticate success, global_id 5999 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:46:25.724+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:46:25.724+0000 7fc993fff640 4 set_mon_vals no callback set 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:46:25.724+0000 7fcabf119800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.224 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:46:25.724+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:46:25.724+0000 7fcabf119800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:46:25.724+0000 7fcabf119800 1 librados: init done 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:46:25.724+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command cr dump hook 0x55b21abd39e8 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:46:25.726+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:46:25.726+0000 7fc9927fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:46:25.726+0000 7fc9927fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:46:25.726+0000 7fc9927fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:46:25.726+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x7fc9880764a0 auth_method 0 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:46:25.727+0000 7fcabd40b640 10 monclient: get_auth_request con 0x55b21abf89a0 auth_method 0 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:46:25.727+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:46:25.727+0000 7fcabf119800 20 realm 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:46:25.727+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.225 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:46:25.728+0000 7fcabf119800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:46:25.728+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x55b21abfcb90 auth_method 0 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:46:25.729+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:46:25.729+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:46:25.729+0000 7fcabf119800 20 searching for the correct realm 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:46:25.729+0000 7fcabc409640 10 monclient: get_auth_request con 0x55b21ac01e20 auth_method 0 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:46:25.730+0000 7fcabd40b640 10 monclient: get_auth_request con 0x7fcab0043020 auth_method 0 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:46:25.731+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x7fcaac0bd020 auth_method 0 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:46:25.731+0000 7fcabcc0a640 0 -- 172.21.15.19:0/3639147051 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7fcaac0bd020 msgr2=0x7fcaac0a3890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:26.226 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:46:25.932+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x7fcaac0bd020 auth_method 0 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:46:25.933+0000 7fcabc409640 10 monclient: get_auth_request con 0x7fcab0039070 auth_method 0 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:46:25.933+0000 7fc9927fc640 1 client.5999.objecter ms_handle_reset 0x7fcab0039070 session 0x7fcab006de40 osd.5 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:46:25.933+0000 7fc9927fc640 10 monclient: _renew_subs 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:46:25.933+0000 7fc9927fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:46:25.934+0000 7fcabc409640 10 monclient: get_auth_request con 0x7fc9880867c0 auth_method 0 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:46:25.936+0000 7fcabd40b640 10 monclient: get_auth_request con 0x7fcaac05ac10 auth_method 0 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:46:25.936+0000 7fcabd40b640 0 -- 172.21.15.19:0/3639147051 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7fcaac05ac10 msgr2=0x7fcaac0b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:46:26.137+0000 7fcabd40b640 10 monclient: get_auth_request con 0x7fcaac05ac10 auth_method 0 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:46:26.138+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x7fcab4032040 auth_method 0 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:26.227 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 zone default found 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:46:26.145+0000 7fcabf119800 4 Realm: () 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:46:26.145+0000 7fcabf119800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:46:26.145+0000 7fcabf119800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:46:26.145+0000 7fcabf119800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 zonegroup default 2024-09-12T00:46:26.228 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:46:26.146+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:46:26.146+0000 7fcabf119800 20 started sync module instance, tier type = 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:46:26.146+0000 7fcabf119800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=0 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=1 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=2 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=3 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=4 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=5 2024-09-12T00:46:26.229 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=6 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:46:26.156+0000 7fcabf119800 20 add_watcher() i=7 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:46:26.156+0000 7fcabf119800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding auth protocol: cephx 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding auth protocol: cephx 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding auth protocol: cephx 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.230 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:46:26.158+0000 7fc9737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:46:26.158+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:46:26.158+0000 7fcabf119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:46:26.158+0000 7fcabf119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command cache list hook 0x55b21abd2d40 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command cache inspect hook 0x55b21abd2d40 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command cache erase hook 0x55b21abd2d40 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command cache zap hook 0x55b21abd2d40 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 note: GC not initialized 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:46:26.158+0000 7fc9727e4640 20 reqs_thread_entry: start 2024-09-12T00:46:26.231 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command sync trace show hook 0x7fcab0013070 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command sync trace history hook 0x7fcab0013070 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command sync trace active hook 0x7fcab0013070 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command sync trace active_short hook 0x7fcab0013070 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:46:26.158+0000 7fcabf119800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:46:26.158+0000 7fcabf119800 20 Filter name: none 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:46:26.158+0000 7fc96bfff640 20 reqs_thread_entry: start 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 : miss 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.232 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 info.flags=0x17 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to cache LRU end 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:46:26.161+0000 7fcabf119800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcabf119800 time 2024-09-12T00:46:26.161737+0000 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcac258c71a] 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcac258c8d8] 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b2187f1641] 2024-09-12T00:46:26.233 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd877a4) [0x55b218d037a4] 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b21880131d] 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcac1229590] 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:46:26.162+0000 7fcabf119800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fcabf119800 thread_name:radosgw-admin 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcac123e6f0] 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcac128b99c] 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:46:26.234 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcac258c774] 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcac258c8d8] 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b2187f1641] 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd877a4) [0x55b218d037a4] 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b21880131d] 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcac1229590] 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:46:26.235 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:46:26.236 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:46:26.237 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:46:26.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:46:26.239 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:46:26.240 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:46:26.241 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc96bfff640 / http_manager 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9727e4640 / http_manager 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9737e6640 / rgw_dt_lg_renew 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9927fc640 / ms_dispatch 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc993fff640 / io_context_pool 2024-09-12T00:46:26.242 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9a27fc640 / ms_dispatch 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9a960a640 / ms_dispatch 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9aae0d640 / io_context_pool 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: 7fcabc409640 / msgr-worker-2 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: 7fcabcc0a640 / msgr-worker-1 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: 7fcabd40b640 / msgr-worker-0 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: 7fcabdc0c640 / io_context_pool 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: 7fcabf119800 / radosgw-admin 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.89896.log 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 monclient: authenticate success, global_id 6327 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:46:25.708+0000 7fcabf119800 10 monclient: get_monmap_and_config success 2024-09-12T00:46:26.243 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:46:25.708+0000 7fcabf119800 4 set_mon_vals no callback set 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:46:25.708+0000 7fc9aae0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:46:25.708+0000 7fc9aae0d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:46:25.708+0000 7fc9aae0d640 10 monclient: dump: 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.244 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:46:25.708+0000 7fcabf119800 10 monclient: shutdown 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 asok(0x55b21a8ee630) unregister_commands rotate-key 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:46:25.708+0000 7fcabf119800 10 monclient: build_initial_monmap 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:46:25.708+0000 7fcabf119800 1 build_initial for_mkfs: 0 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:46:25.708+0000 7fcabf119800 10 monclient: monmap: 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:46:26.245 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding auth protocol: cephx 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding auth protocol: cephx 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding auth protocol: cephx 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.246 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:46:25.708+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: crc 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab16370) adding con mode: secure 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:46:25.709+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:46:25.709+0000 7fcabf119800 1 librados: starting msgr at 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:46:25.709+0000 7fcabf119800 1 librados: starting objecter 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command objecter_requests hook 0x55b21ab421a0 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:46:25.709+0000 7fcabf119800 1 librados: setting wanted keys 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:46:25.709+0000 7fcabf119800 1 librados: calling monclient init 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient: init 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding auth protocol: cephx 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding auth protocol: cephx 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding auth protocol: cephx 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.247 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: crc 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 AuthRegistry(0x55b21ab10780) adding con mode: secure 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:46:25.709+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:46:25.709+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:46:25.709+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command rotate-key hook 0x55b21ab108c8 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient: _reopen_session rank -1 2024-09-12T00:46:26.248 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-a con 0x55b21a9c4620 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-b con 0x55b21a9c64f0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-c con 0x55b21aa580b0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): _renew_subs 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:46:25.709+0000 7fcabf119800 10 monclient(hunting): authenticate will time out at 2052.211989s 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request con 0x55b21a9c4620 auth_method 0 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.249 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): get_auth_request con 0x55b21aa580b0 auth_method 0 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): get_auth_request con 0x55b21a9c64f0 auth_method 0 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.250 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:46:25.710+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:46:25.710+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_done global_id 6330 payload 824 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient: _finish_hunting 0 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 1 monclient: found mon.noname-a 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:46:25.710+0000 7fcabcc0a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: dump: 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.251 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: _finish_auth 0 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: _check_auth_tickets 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:46:25.710+0000 7fc9a960a640 10 monclient: dump: 2024-09-12T00:46:26.252 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:46:25.710+0000 7fcabf119800 5 monclient: authenticate success, global_id 6330 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:46:25.710+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:46:25.710+0000 7fcabf119800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:46:25.710+0000 7fc9aae0d640 4 set_mon_vals no callback set 2024-09-12T00:46:26.253 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:46:25.710+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:46:25.710+0000 7fcabf119800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:46:25.710+0000 7fcabf119800 1 librados: init done 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:46:25.712+0000 7fc9a960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:46:25.712+0000 7fc9a960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:46:25.712+0000 7fc9a960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:46:25.713+0000 7fcabc409640 10 monclient: get_auth_request con 0x7fc9a4076470 auth_method 0 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:46:25.713+0000 7fcabd40b640 10 monclient: get_auth_request con 0x55b21ab38e60 auth_method 0 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:46:25.714+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x55b21ab5be50 auth_method 0 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:46:25.714+0000 7fc9a960a640 1 client.6330.objecter ms_handle_reset 0x55b21ab5be50 session 0x55b21ab5b7d0 osd.1 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:46:25.714+0000 7fc9a960a640 10 monclient: _renew_subs 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:46:25.714+0000 7fc9a960a640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:46:26.254 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:46:25.714+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x7fc9a4086790 auth_method 0 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:46:25.715+0000 7fcabc409640 10 monclient: get_auth_request con 0x55b21ab5cdc0 auth_method 0 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:46:25.716+0000 7fcabf119800 10 monclient: build_initial_monmap 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:46:25.716+0000 7fcabf119800 1 build_initial for_mkfs: 0 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:46:25.716+0000 7fcabf119800 10 monclient: monmap: 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:46:26.255 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding auth protocol: cephx 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding auth protocol: cephx 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding auth protocol: cephx 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.256 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: crc 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:46:25.716+0000 7fcabf119800 5 AuthRegistry(0x55b21ab62aa0) adding con mode: secure 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:46:25.716+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command objecter_requests cmddesc objecter_requests hook 0x55b21ab66510 EEXIST 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient: init 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding auth protocol: cephx 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding auth protocol: cephx 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding auth protocol: cephx 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.257 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: crc 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 AuthRegistry(0x55b21ab61aa8) adding con mode: secure 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:46:25.717+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:46:25.717+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:46:25.717+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command rotate-key cmddesc rotate-key hook 0x55b21ab61bf0 EEXIST 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient: _reopen_session rank -1 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:46:26.258 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-c con 0x55b21ab8a200 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-a con 0x55b21ab8c4d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-b con 0x55b21ab889d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): _renew_subs 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:46:25.717+0000 7fcabf119800 10 monclient(hunting): authenticate will time out at 2052.219706s 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request con 0x55b21ab8a200 auth_method 0 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): get_auth_request con 0x55b21ab8c4d0 auth_method 0 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.259 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:46:25.717+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:46:25.717+0000 7fcabd40b640 10 monclient(hunting): get_auth_request con 0x55b21ab889d0 auth_method 0 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:46:25.717+0000 7fcabd40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:46:25.717+0000 7fcabd40b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:46:25.717+0000 7fcabd40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:46:25.717+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:46:25.717+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:46:25.718+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.260 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:46:25.718+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:46:25.718+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_done global_id 5993 payload 824 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:46:25.718+0000 7fcabcc0a640 10 monclient: _finish_hunting 0 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:46:25.718+0000 7fcabcc0a640 1 monclient: found mon.noname-c 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:46:25.718+0000 7fcabcc0a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: dump: 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.261 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: _finish_auth 0 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: _check_auth_tickets 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:46:25.718+0000 7fc9a27fc640 10 monclient: dump: 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.262 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:46:25.718+0000 7fcabf119800 5 monclient: authenticate success, global_id 5993 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:46:25.718+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:46:25.718+0000 7fcabdc0c640 4 set_mon_vals no callback set 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:46:25.718+0000 7fcabf119800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:46:25.718+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.263 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:46:25.718+0000 7fcabf119800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.264 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:46:25.720+0000 7fc9a27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:46:26.264 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:46:25.720+0000 7fc9a27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.264 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:46:25.720+0000 7fc9a27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.264 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:46:25.720+0000 7fcabc409640 10 monclient: get_auth_request con 0x7fc994076380 auth_method 0 2024-09-12T00:46:26.264 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:46:25.720+0000 7fcabf119800 10 monclient: get_monmap_and_config 2024-09-12T00:46:26.264 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:46:25.720+0000 7fcabf119800 10 monclient: build_initial_monmap 2024-09-12T00:46:26.264 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:46:25.720+0000 7fcabf119800 1 build_initial for_mkfs: 0 2024-09-12T00:46:26.264 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:46:25.720+0000 7fcabf119800 10 monclient: monmap: 2024-09-12T00:46:26.264 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:46:26.264 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:46:26.265 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:46:26.265 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:46:26.265 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:46:26.265 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.265 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:46:26.265 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:46:26.265 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:46:26.265 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.265 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding auth protocol: cephx 2024-09-12T00:46:26.265 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding auth protocol: cephx 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding auth protocol: cephx 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.266 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: crc 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:46:25.720+0000 7fcabf119800 5 AuthRegistry(0x55b21aba9c30) adding con mode: secure 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:46:25.720+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient: init 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding auth protocol: cephx 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding auth protocol: cephx 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding auth protocol: cephx 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.267 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: crc 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d6c20) adding con mode: secure 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:46:25.721+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:46:25.721+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:46:25.721+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command rotate-key cmddesc rotate-key hook 0x7fff4a7d6d68 EEXIST 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient: _reopen_session rank -1 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-b con 0x55b21abde220 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-a con 0x55b21abceb70 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-c con 0x55b21abd9650 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:46:26.268 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): _renew_subs 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:46:25.721+0000 7fcabf119800 10 monclient(hunting): authenticate will time out at 2052.223546s 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): get_auth_request con 0x55b21abceb70 auth_method 0 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): get_auth_request con 0x55b21abd9650 auth_method 0 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.269 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:46:25.721+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:46:25.721+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request con 0x55b21abde220 auth_method 0 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:46:25.721+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:46:25.721+0000 7fcabcc0a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:46:25.721+0000 7fcabcc0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient(hunting): handle_auth_done global_id 6336 payload 274 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient: _finish_hunting 0 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:46:25.721+0000 7fcabc409640 1 monclient: found mon.noname-a 2024-09-12T00:46:26.270 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:46:25.721+0000 7fcabc409640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: dump: 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.271 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: _finish_auth 0 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: _check_auth_tickets 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 monclient: authenticate success, global_id 6336 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:46:25.722+0000 7fcabf119800 10 monclient: get_monmap_and_config success 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:46:25.722+0000 7fcabf119800 4 set_mon_vals no callback set 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:46:25.722+0000 7fc993fff640 10 monclient: dump: 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.272 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:46:25.722+0000 7fcabf119800 10 monclient: shutdown 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:46:25.722+0000 7fcabf119800 10 monclient: build_initial_monmap 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:46:25.722+0000 7fcabf119800 1 build_initial for_mkfs: 0 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:46:25.722+0000 7fcabf119800 10 monclient: monmap: 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:46:26.273 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding auth protocol: cephx 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding auth protocol: cephx 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding auth protocol: cephx 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.274 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: crc 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:46:25.722+0000 7fcabf119800 5 AuthRegistry(0x55b21abad780) adding con mode: secure 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:46:25.723+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:46:25.723+0000 7fcabf119800 1 librados: starting msgr at 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:46:25.723+0000 7fcabf119800 1 librados: starting objecter 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command objecter_requests cmddesc objecter_requests hook 0x55b21abad690 EEXIST 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:46:25.723+0000 7fcabf119800 1 librados: setting wanted keys 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:46:25.723+0000 7fcabf119800 1 librados: calling monclient init 2024-09-12T00:46:26.275 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient: init 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding auth protocol: cephx 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding auth protocol: cephx 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding auth protocol: cephx 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.276 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: crc 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 AuthRegistry(0x55b21aba1fb0) adding con mode: secure 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:46:25.723+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:46:25.723+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:46:25.723+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command rotate-key cmddesc rotate-key hook 0x55b21aba20f8 EEXIST 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient: _reopen_session rank -1 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-b con 0x55b21abceb70 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-c con 0x55b21abd9650 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): picked mon.noname-a con 0x55b21abde220 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): start opening mon connection 2024-09-12T00:46:26.277 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): _renew_subs 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:46:25.723+0000 7fcabf119800 10 monclient(hunting): authenticate will time out at 2052.225871s 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:46:25.723+0000 7fcabc409640 10 monclient(hunting): get_auth_request con 0x55b21abd9650 auth_method 0 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:46:25.723+0000 7fcabc409640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:46:25.723+0000 7fcabc409640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:46:25.723+0000 7fcabc409640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): get_auth_request con 0x55b21abde220 auth_method 0 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request con 0x55b21abceb70 auth_method 0 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:46:26.278 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:46:25.724+0000 7fcabd40b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:46:25.724+0000 7fcabcc0a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient(hunting): handle_auth_done global_id 5999 payload 824 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient: _finish_hunting 0 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:46:25.724+0000 7fcabc409640 1 monclient: found mon.noname-c 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:46:25.724+0000 7fcabc409640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.279 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: dump: 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.280 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: _finish_auth 0 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: _check_auth_tickets 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:46:25.724+0000 7fc9927fc640 10 monclient: dump: 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:46:26.281 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:46:25.724+0000 7fcabf119800 5 monclient: authenticate success, global_id 5999 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:46:25.724+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:46:25.724+0000 7fc993fff640 4 set_mon_vals no callback set 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:46:25.724+0000 7fcabf119800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:46:25.724+0000 7fcabf119800 10 monclient: _renew_subs 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:46:25.724+0000 7fcabf119800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:46:25.724+0000 7fcabf119800 1 librados: init done 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:46:25.724+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command cr dump hook 0x55b21abd39e8 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:46:25.726+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:46:25.726+0000 7fc9927fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:46:25.726+0000 7fc9927fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:46:25.726+0000 7fc9927fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:46:26.282 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:46:25.726+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x7fc9880764a0 auth_method 0 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:46:25.727+0000 7fcabd40b640 10 monclient: get_auth_request con 0x55b21abf89a0 auth_method 0 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:46:25.727+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:46:25.727+0000 7fcabf119800 20 realm 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:46:25.727+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:46:25.728+0000 7fcabf119800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:46:25.728+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x55b21abfcb90 auth_method 0 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:46:25.728+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:46:25.729+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:46:25.729+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:46:25.729+0000 7fcabf119800 20 searching for the correct realm 2024-09-12T00:46:26.283 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:46:25.729+0000 7fcabc409640 10 monclient: get_auth_request con 0x55b21ac01e20 auth_method 0 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:46:25.730+0000 7fcabd40b640 10 monclient: get_auth_request con 0x7fcab0043020 auth_method 0 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:46:25.731+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x7fcaac0bd020 auth_method 0 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:46:25.731+0000 7fcabcc0a640 0 -- 172.21.15.19:0/3639147051 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7fcaac0bd020 msgr2=0x7fcaac0a3890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:46:25.932+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x7fcaac0bd020 auth_method 0 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:46:25.933+0000 7fcabc409640 10 monclient: get_auth_request con 0x7fcab0039070 auth_method 0 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:46:25.933+0000 7fc9927fc640 1 client.5999.objecter ms_handle_reset 0x7fcab0039070 session 0x7fcab006de40 osd.5 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:46:25.933+0000 7fc9927fc640 10 monclient: _renew_subs 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:46:25.933+0000 7fc9927fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:46:25.934+0000 7fcabc409640 10 monclient: get_auth_request con 0x7fc9880867c0 auth_method 0 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:46:25.936+0000 7fcabd40b640 10 monclient: get_auth_request con 0x7fcaac05ac10 auth_method 0 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:46:25.936+0000 7fcabd40b640 0 -- 172.21.15.19:0/3639147051 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7fcaac05ac10 msgr2=0x7fcaac0b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:26.284 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:46:26.137+0000 7fcabd40b640 10 monclient: get_auth_request con 0x7fcaac05ac10 auth_method 0 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:46:26.138+0000 7fcabcc0a640 10 monclient: get_auth_request con 0x7fcab4032040 auth_method 0 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:46:26.144+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.285 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 zone default found 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:46:26.145+0000 7fcabf119800 4 Realm: () 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:46:26.145+0000 7fcabf119800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:46:26.145+0000 7fcabf119800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:46:26.145+0000 7fcabf119800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 zonegroup default 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:46:26.145+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:46:26.146+0000 7fcabf119800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:46:26.146+0000 7fcabf119800 20 started sync module instance, tier type = 2024-09-12T00:46:26.286 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:46:26.146+0000 7fcabf119800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=0 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=1 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=2 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=3 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=4 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=5 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:46:26.155+0000 7fcabf119800 20 add_watcher() i=6 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:46:26.156+0000 7fcabf119800 20 add_watcher() i=7 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:46:26.156+0000 7fcabf119800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding auth protocol: cephx 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding auth protocol: cephx 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding auth protocol: cephx 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.287 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: crc 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 AuthRegistry(0x7fff4a7d7100) adding con mode: secure 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:46:26.158+0000 7fc9737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:46:26.158+0000 7fcabf119800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:46:26.158+0000 7fcabf119800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:26.288 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:46:26.158+0000 7fcabf119800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command cache list hook 0x55b21abd2d40 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command cache inspect hook 0x55b21abd2d40 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command cache erase hook 0x55b21abd2d40 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command cache zap hook 0x55b21abd2d40 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 note: GC not initialized 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:46:26.158+0000 7fc9727e4640 20 reqs_thread_entry: start 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command sync trace show hook 0x7fcab0013070 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command sync trace history hook 0x7fcab0013070 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command sync trace active hook 0x7fcab0013070 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:46:26.158+0000 7fcabf119800 5 asok(0x55b21a8ee630) register_command sync trace active_short hook 0x7fcab0013070 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:46:26.158+0000 7fcabf119800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:46:26.158+0000 7fcabf119800 20 Filter name: none 2024-09-12T00:46:26.289 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:46:26.158+0000 7fc96bfff640 20 reqs_thread_entry: start 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 : miss 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:46:26.159+0000 7fcabf119800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 info.flags=0x17 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to cache LRU end 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:46:26.159+0000 7fcabf119800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 2024-09-12T00:46:26.290 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:46:26.161+0000 7fcabf119800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fcabf119800 time 2024-09-12T00:46:26.161737+0000 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fcac258c71a] 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcac258c8d8] 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b2187f1641] 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd877a4) [0x55b218d037a4] 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b21880131d] 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fcac1229590] 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:46:26.291 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:46:26.162+0000 7fcabf119800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fcabf119800 thread_name:radosgw-admin 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fcac123e6f0] 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fcac128b99c] 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fcac258c774] 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fcac258c8d8] 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b2187f1641] 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd877a4) [0x55b218d037a4] 2024-09-12T00:46:26.292 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b21880131d] 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fcac1229590] 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:46:26.293 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:46:26.294 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:46:26.295 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:46:26.296 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:46:26.297 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:46:26.298 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:46:26.299 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc96bfff640 / http_manager 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9727e4640 / http_manager 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9737e6640 / rgw_dt_lg_renew 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9927fc640 / ms_dispatch 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc993fff640 / io_context_pool 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9a27fc640 / ms_dispatch 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9a960a640 / ms_dispatch 2024-09-12T00:46:26.300 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc9aae0d640 / io_context_pool 2024-09-12T00:46:26.301 INFO:tasks.workunit.client.0.smithi019.stderr: 7fcabc409640 / msgr-worker-2 2024-09-12T00:46:26.301 INFO:tasks.workunit.client.0.smithi019.stderr: 7fcabcc0a640 / msgr-worker-1 2024-09-12T00:46:26.301 INFO:tasks.workunit.client.0.smithi019.stderr: 7fcabd40b640 / msgr-worker-0 2024-09-12T00:46:26.301 INFO:tasks.workunit.client.0.smithi019.stderr: 7fcabdc0c640 / io_context_pool 2024-09-12T00:46:26.301 INFO:tasks.workunit.client.0.smithi019.stderr: 7fcabf119800 / radosgw-admin 2024-09-12T00:46:26.301 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:46:26.301 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:46:26.301 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:46:26.163397Z_a12e1526-2089-4d00-b36b-9eba70ddc4ce/log 2024-09-12T00:46:26.301 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:46:26.301 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:46:26.303 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:26.303 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:26.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.242+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.244+0000 7fdf66724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.244+0000 7fdf66724800 20 realm 2024-09-12T00:46:26.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.244+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.244+0000 7fdf66724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.244+0000 7fdf66724800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:26.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.244+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.244+0000 7fdf66724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.244+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.245+0000 7fdf66724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.245+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.245+0000 7fdf66724800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:26.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.245+0000 7fdf66724800 20 searching for the correct realm 2024-09-12T00:46:26.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.249+0000 7fdf5bfff640 0 -- 172.21.15.19:0/2997064038 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fdf4c01f040 msgr2=0x7fdf4c03c920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:26.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.455+0000 7fdf62b03640 0 -- 172.21.15.19:0/2997064038 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x557825110430 msgr2=0x557825112880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:26.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.459+0000 7fdf66724800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:26.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.459+0000 7fdf66724800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:26.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.459+0000 7fdf66724800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:26.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.459+0000 7fdf66724800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:26.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.459+0000 7fdf66724800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:26.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.459+0000 7fdf66724800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:26.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.459+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:26.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 20 zone default found 2024-09-12T00:46:26.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 4 Realm: () 2024-09-12T00:46:26.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:26.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:26.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:26.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 20 zonegroup default 2024-09-12T00:46:26.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.460+0000 7fdf66724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.461+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.461+0000 7fdf66724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.461+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.461+0000 7fdf66724800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.461+0000 7fdf66724800 20 started sync module instance, tier type = 2024-09-12T00:46:26.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.461+0000 7fdf66724800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:26.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.470+0000 7fdf66724800 20 add_watcher() i=0 2024-09-12T00:46:26.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.470+0000 7fdf66724800 20 add_watcher() i=1 2024-09-12T00:46:26.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.470+0000 7fdf66724800 20 add_watcher() i=2 2024-09-12T00:46:26.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.470+0000 7fdf66724800 20 add_watcher() i=3 2024-09-12T00:46:26.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.470+0000 7fdf66724800 20 add_watcher() i=4 2024-09-12T00:46:26.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.470+0000 7fdf66724800 20 add_watcher() i=5 2024-09-12T00:46:26.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.470+0000 7fdf66724800 20 add_watcher() i=6 2024-09-12T00:46:26.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.471+0000 7fdf66724800 20 add_watcher() i=7 2024-09-12T00:46:26.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.471+0000 7fdf66724800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:26.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.473+0000 7fde18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:26.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.473+0000 7fdf66724800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:26.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.473+0000 7fdf66724800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:26.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.473+0000 7fdf66724800 5 note: GC not initialized 2024-09-12T00:46:26.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.474+0000 7fdd937fe640 20 reqs_thread_entry: start 2024-09-12T00:46:26.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.474+0000 7fdf66724800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:26.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.474+0000 7fdf66724800 20 Filter name: none 2024-09-12T00:46:26.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.474+0000 7fdd917fa640 20 reqs_thread_entry: start 2024-09-12T00:46:26.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.474+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.475+0000 7fdf66724800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:46:26.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.475+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.475+0000 7fdf66724800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:46:26.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.475+0000 7fdf66724800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:26.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.475+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.476+0000 7fdf66724800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:46:26.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.476+0000 7fdf66724800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.476+0000 7fdf66724800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:46:26.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.476+0000 7fdf66724800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:26.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.478+0000 7fde18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:26.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.480+0000 7fdf66724800 20 remove_watcher() i=0 2024-09-12T00:46:26.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.480+0000 7fdf66724800 2 removed watcher, disabling cache 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.481+0000 7fdf66724800 20 remove_watcher() i=1 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.482+0000 7fdf66724800 20 remove_watcher() i=2 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.483+0000 7fdf66724800 20 remove_watcher() i=3 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.484+0000 7fdf66724800 20 remove_watcher() i=4 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.486+0000 7fdf66724800 20 remove_watcher() i=5 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.487+0000 7fdf66724800 20 remove_watcher() i=6 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.488+0000 7fdf66724800 20 remove_watcher() i=7 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:26.819 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-init-indext id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:46:26.820 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:26.820 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:26.820 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:26.820 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:26.820 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:26.820 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:46:26.820 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.662+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.663+0000 7f623ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.663+0000 7f623ab24800 20 realm 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.663+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.663+0000 7f623ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.663+0000 7f623ab24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.663+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.663+0000 7f623ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.663+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.664+0000 7f623ab24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.664+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.664+0000 7f623ab24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:26.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.664+0000 7f623ab24800 20 searching for the correct realm 2024-09-12T00:46:26.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.668+0000 7f6235f01640 0 -- 172.21.15.19:0/2132169042 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f622c03e950 msgr2=0x7f622c030410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:26.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.873+0000 7f6235f01640 0 -- 172.21.15.19:0/2132169042 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x556902914d10 msgr2=0x556902917160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:26.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:26.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:26.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:26.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:26.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:26.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:26.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:26.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:26.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 zone default found 2024-09-12T00:46:26.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 4 Realm: () 2024-09-12T00:46:26.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:26.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:26.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:26.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 zonegroup default 2024-09-12T00:46:26.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.878+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.879+0000 7f623ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.879+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.879+0000 7f623ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.879+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.879+0000 7f623ab24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:26.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.879+0000 7f623ab24800 20 started sync module instance, tier type = 2024-09-12T00:46:26.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.879+0000 7f623ab24800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:26.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.888+0000 7f623ab24800 20 add_watcher() i=0 2024-09-12T00:46:26.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.888+0000 7f623ab24800 20 add_watcher() i=1 2024-09-12T00:46:26.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.888+0000 7f623ab24800 20 add_watcher() i=2 2024-09-12T00:46:26.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.888+0000 7f623ab24800 20 add_watcher() i=3 2024-09-12T00:46:26.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.888+0000 7f623ab24800 20 add_watcher() i=4 2024-09-12T00:46:26.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.888+0000 7f623ab24800 20 add_watcher() i=5 2024-09-12T00:46:26.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.888+0000 7f623ab24800 20 add_watcher() i=6 2024-09-12T00:46:26.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.889+0000 7f623ab24800 20 add_watcher() i=7 2024-09-12T00:46:26.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.889+0000 7f623ab24800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:26.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.891+0000 7f60ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:26.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.891+0000 7f623ab24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:26.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.891+0000 7f623ab24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:26.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.891+0000 7f623ab24800 5 note: GC not initialized 2024-09-12T00:46:26.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.891+0000 7f60677fe640 20 reqs_thread_entry: start 2024-09-12T00:46:26.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.891+0000 7f623ab24800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:26.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.891+0000 7f623ab24800 20 Filter name: none 2024-09-12T00:46:26.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.891+0000 7f60657fa640 20 reqs_thread_entry: start 2024-09-12T00:46:26.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:46:26.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:46:26.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:46:26.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:46:26.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 : miss 2024-09-12T00:46:26.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 20 rados->read ofs=0 len=0 2024-09-12T00:46:26.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:46:26.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 info.flags=0x17 2024-09-12T00:46:26.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to cache LRU end 2024-09-12T00:46:26.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:26.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:26.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.892+0000 7f623ab24800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 2024-09-12T00:46:26.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.894+0000 7f623ab24800 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to be held by another RGW process; skipping for now 2024-09-12T00:46:26.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.894+0000 7f60ecfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:26.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.897+0000 7f623ab24800 20 remove_watcher() i=0 2024-09-12T00:46:26.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.897+0000 7f623ab24800 2 removed watcher, disabling cache 2024-09-12T00:46:26.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.898+0000 7f623ab24800 20 remove_watcher() i=1 2024-09-12T00:46:26.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.899+0000 7f623ab24800 20 remove_watcher() i=2 2024-09-12T00:46:26.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.900+0000 7f623ab24800 20 remove_watcher() i=3 2024-09-12T00:46:26.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.901+0000 7f623ab24800 20 remove_watcher() i=4 2024-09-12T00:46:26.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.902+0000 7f623ab24800 20 remove_watcher() i=5 2024-09-12T00:46:26.901 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.903+0000 7f623ab24800 20 remove_watcher() i=6 2024-09-12T00:46:26.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:26.904+0000 7f623ab24800 20 remove_watcher() i=7 2024-09-12T00:46:26.913 INFO:tasks.workunit.client.0.smithi019.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:46:56.941 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:46:56.978 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:56.978 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:57.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.026+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.028+0000 7f14d5735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.028+0000 7f14d5735800 20 realm 2024-09-12T00:46:57.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.028+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.028+0000 7f14d5735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.028+0000 7f14d5735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:57.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.028+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.028+0000 7f14d5735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.028+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.029+0000 7f14d5735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:57.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.029+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.029+0000 7f14d5735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:57.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.029+0000 7f14d5735800 20 searching for the correct realm 2024-09-12T00:46:57.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.033+0000 7f14d0ce3640 0 -- 172.21.15.19:0/2385802962 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f14c8018070 msgr2=0x7f14c808c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:57.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.239+0000 7f14d1ce5640 0 -- 172.21.15.19:0/2385802962 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55d101548160 msgr2=0x55d10154a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:57.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.244+0000 7f14d5735800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:57.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.245+0000 7f14d5735800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:57.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.245+0000 7f14d5735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:57.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.245+0000 7f14d5735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:57.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.245+0000 7f14d5735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:57.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.245+0000 7f14d5735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:57.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.245+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.245+0000 7f14d5735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.245+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.245+0000 7f14d5735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:57.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.245+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:57.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 20 zone default found 2024-09-12T00:46:57.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 4 Realm: () 2024-09-12T00:46:57.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:57.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:57.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:57.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 20 zonegroup default 2024-09-12T00:46:57.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.246+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.247+0000 7f14d5735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.247+0000 7f14d5735800 20 started sync module instance, tier type = 2024-09-12T00:46:57.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.247+0000 7f14d5735800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:57.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.257+0000 7f14d5735800 20 add_watcher() i=0 2024-09-12T00:46:57.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.257+0000 7f14d5735800 20 add_watcher() i=1 2024-09-12T00:46:57.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.257+0000 7f14d5735800 20 add_watcher() i=2 2024-09-12T00:46:57.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.257+0000 7f14d5735800 20 add_watcher() i=3 2024-09-12T00:46:57.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.257+0000 7f14d5735800 20 add_watcher() i=4 2024-09-12T00:46:57.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.257+0000 7f14d5735800 20 add_watcher() i=5 2024-09-12T00:46:57.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.257+0000 7f14d5735800 20 add_watcher() i=6 2024-09-12T00:46:57.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.258+0000 7f14d5735800 20 add_watcher() i=7 2024-09-12T00:46:57.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.258+0000 7f14d5735800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:57.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.260+0000 7f13877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:57.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.260+0000 7f14d5735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:57.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.260+0000 7f14d5735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:57.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.261+0000 7f14d5735800 5 note: GC not initialized 2024-09-12T00:46:57.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.261+0000 7f13867e4640 20 reqs_thread_entry: start 2024-09-12T00:46:57.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.261+0000 7f14d5735800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:57.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.261+0000 7f14d5735800 20 Filter name: none 2024-09-12T00:46:57.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.261+0000 7f12f7fff640 20 reqs_thread_entry: start 2024-09-12T00:46:57.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.261+0000 7f14d5735800 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:46:57.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.261+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.262+0000 7f14d5735800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:46:57.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.262+0000 7f14d5735800 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:46:57.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.262+0000 7f14d5735800 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:46:57.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.262+0000 7f14d5735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 : miss 2024-09-12T00:46:57.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.262+0000 7f14d5735800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.262+0000 7f14d5735800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:46:57.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.262+0000 7f14d5735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 info.flags=0x17 2024-09-12T00:46:57.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.262+0000 7f14d5735800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to cache LRU end 2024-09-12T00:46:57.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.262+0000 7f14d5735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:57.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.262+0000 7f14d5735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:57.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.262+0000 7f14d5735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 2024-09-12T00:46:57.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.268+0000 7f14d5735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 info.flags=0x17 2024-09-12T00:46:57.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.268+0000 7f14d5735800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to cache LRU end 2024-09-12T00:46:57.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.268+0000 7f14d5735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:57.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.268+0000 7f14d5735800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21, ofs0, ns] 2024-09-12T00:46:57.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.268+0000 7f13a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398881 cookie 94356158899328 notifier 6050 bl.length()=913 2024-09-12T00:46:57.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.268+0000 7f13a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 info.flags=0x17 2024-09-12T00:46:57.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.268+0000 7f13a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to cache LRU end 2024-09-12T00:46:57.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.268+0000 7f13a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:57.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.270+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): orig_sources= new_sources= 2024-09-12T00:46:57.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.270+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): potential sources added=[] removed=[] 2024-09-12T00:46:57.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.270+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): orig_dests= new_dests= 2024-09-12T00:46:57.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.270+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): potential dests added=[] removed=[] 2024-09-12T00:46:57.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.0 2024-09-12T00:46:57.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.0 2024-09-12T00:46:57.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.1 2024-09-12T00:46:57.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.1 2024-09-12T00:46:57.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.2 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.2 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.3 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.3 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.4 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.4 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.5 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.5 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.6 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.6 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.7 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.7 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.8 2024-09-12T00:46:57.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.8 2024-09-12T00:46:57.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.9 2024-09-12T00:46:57.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.9 2024-09-12T00:46:57.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.10 2024-09-12T00:46:57.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.10 2024-09-12T00:46:57.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.11 2024-09-12T00:46:57.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1.11 2024-09-12T00:46:57.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.275+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.0 2024-09-12T00:46:57.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.276+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1 2024-09-12T00:46:57.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.276+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.2 2024-09-12T00:46:57.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.277+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.3 2024-09-12T00:46:57.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.278+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.4 2024-09-12T00:46:57.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.279+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.5 2024-09-12T00:46:57.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.280+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.6 2024-09-12T00:46:57.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.281+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.7 2024-09-12T00:46:57.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.282+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.8 2024-09-12T00:46:57.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.282+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.9 2024-09-12T00:46:57.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.283+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.10 2024-09-12T00:46:57.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.286+0000 7f14d5735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:57.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.286+0000 7f14d5735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 2024-09-12T00:46:57.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.287+0000 7f14d5735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 info.flags=0x17 2024-09-12T00:46:57.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.287+0000 7f14d5735800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to cache LRU end 2024-09-12T00:46:57.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.287+0000 7f14d5735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:57.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.287+0000 7f14d5735800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21, ofs0, ns] 2024-09-12T00:46:57.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.288+0000 7f13a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398882 cookie 94356158899328 notifier 6050 bl.length()=913 2024-09-12T00:46:57.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.288+0000 7f13a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 info.flags=0x17 2024-09-12T00:46:57.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.288+0000 7f13a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to cache LRU end 2024-09-12T00:46:57.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.288+0000 7f13a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:57.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.290+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): orig_sources= new_sources= 2024-09-12T00:46:57.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.290+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): potential sources added=[] removed=[] 2024-09-12T00:46:57.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.290+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): orig_dests= new_dests= 2024-09-12T00:46:57.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.290+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): potential dests added=[] removed=[] 2024-09-12T00:46:57.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.294+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.0 2024-09-12T00:46:57.293 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.294+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.1 2024-09-12T00:46:57.293 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.294+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.2 2024-09-12T00:46:57.293 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.295+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.3 2024-09-12T00:46:57.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.295+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.4 2024-09-12T00:46:57.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.296+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.5 2024-09-12T00:46:57.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.296+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.6 2024-09-12T00:46:57.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.296+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.7 2024-09-12T00:46:57.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.297+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.8 2024-09-12T00:46:57.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.297+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.9 2024-09-12T00:46:57.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.297+0000 7f14d5735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21.10 2024-09-12T00:46:57.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.298+0000 7f14d5735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:57.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.298+0000 7f14d5735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 2024-09-12T00:46:57.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.299+0000 7f14d5735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 info.flags=0x17 2024-09-12T00:46:57.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.299+0000 7f14d5735800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to cache LRU end 2024-09-12T00:46:57.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.299+0000 7f14d5735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:57.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.299+0000 7f14d5735800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21, ofs0, ns] 2024-09-12T00:46:57.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.299+0000 7f13a3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398883 cookie 94356158899328 notifier 6050 bl.length()=881 2024-09-12T00:46:57.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.299+0000 7f13a3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 info.flags=0x17 2024-09-12T00:46:57.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.299+0000 7f13a3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 to cache LRU end 2024-09-12T00:46:57.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.299+0000 7f13a3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:57.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.301+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): orig_sources= new_sources= 2024-09-12T00:46:57.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.301+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): potential sources added=[] removed=[] 2024-09-12T00:46:57.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.301+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): orig_dests= new_dests= 2024-09-12T00:46:57.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.301+0000 7f14d5735800 20 handle_bi_update(): bucket=:abort-at-init-indext[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21]): potential dests added=[] removed=[] 2024-09-12T00:46:57.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.303+0000 7f14d5735800 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T00:46:57.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.306+0000 7f13877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:57.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.308+0000 7f14d5735800 20 remove_watcher() i=0 2024-09-12T00:46:57.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.308+0000 7f14d5735800 2 removed watcher, disabling cache 2024-09-12T00:46:57.308 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.309+0000 7f14d5735800 20 remove_watcher() i=1 2024-09-12T00:46:57.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.310+0000 7f14d5735800 20 remove_watcher() i=2 2024-09-12T00:46:57.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.311+0000 7f14d5735800 20 remove_watcher() i=3 2024-09-12T00:46:57.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.312+0000 7f14d5735800 20 remove_watcher() i=4 2024-09-12T00:46:57.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.314+0000 7f14d5735800 20 remove_watcher() i=5 2024-09-12T00:46:57.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.315+0000 7f14d5735800 20 remove_watcher() i=6 2024-09-12T00:46:57.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.316+0000 7f14d5735800 20 remove_watcher() i=7 2024-09-12T00:46:57.328 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:46:57.358 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:57.358 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:57.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.400+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.402+0000 7f9321414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.402+0000 7f9321414800 20 realm 2024-09-12T00:46:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.402+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.402+0000 7f9321414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.402+0000 7f9321414800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:57.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.402+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.402+0000 7f9321414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.402+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.403+0000 7f9321414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:57.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.403+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.403+0000 7f9321414800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:57.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.403+0000 7f9321414800 20 searching for the correct realm 2024-09-12T00:46:57.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.407+0000 7f931c2ca640 0 -- 172.21.15.19:0/2905056412 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f9310066700 msgr2=0x7f931006c0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:57.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.612+0000 7f931d2cc640 0 -- 172.21.15.19:0/2905056412 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x562448fc56c0 msgr2=0x562448fc7b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:57.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.617+0000 7f9321414800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:57.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.617+0000 7f9321414800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:57.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.617+0000 7f9321414800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:57.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.617+0000 7f9321414800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:57.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.617+0000 7f9321414800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:57.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.617+0000 7f9321414800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:57.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.617+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.617+0000 7f9321414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.617+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.617+0000 7f9321414800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:57.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.617+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:57.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 20 zone default found 2024-09-12T00:46:57.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 4 Realm: () 2024-09-12T00:46:57.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 20 zonegroup default 2024-09-12T00:46:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 20 started sync module instance, tier type = 2024-09-12T00:46:57.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.618+0000 7f9321414800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:57.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.628+0000 7f9321414800 20 add_watcher() i=0 2024-09-12T00:46:57.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.628+0000 7f9321414800 20 add_watcher() i=1 2024-09-12T00:46:57.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.628+0000 7f9321414800 20 add_watcher() i=2 2024-09-12T00:46:57.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.628+0000 7f9321414800 20 add_watcher() i=3 2024-09-12T00:46:57.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.628+0000 7f9321414800 20 add_watcher() i=4 2024-09-12T00:46:57.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.628+0000 7f9321414800 20 add_watcher() i=5 2024-09-12T00:46:57.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.628+0000 7f9321414800 20 add_watcher() i=6 2024-09-12T00:46:57.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.629+0000 7f9321414800 20 add_watcher() i=7 2024-09-12T00:46:57.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.629+0000 7f9321414800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:57.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.631+0000 7f91d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:57.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.632+0000 7f9321414800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:57.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.632+0000 7f9321414800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:57.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.632+0000 7f9321414800 5 note: GC not initialized 2024-09-12T00:46:57.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.632+0000 7f91d1fe3640 20 reqs_thread_entry: start 2024-09-12T00:46:57.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.632+0000 7f9321414800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:57.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.632+0000 7f9321414800 20 Filter name: none 2024-09-12T00:46:57.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.632+0000 7f91437fe640 20 reqs_thread_entry: start 2024-09-12T00:46:57.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.632+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.633+0000 7f9321414800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:46:57.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.633+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.634+0000 7f9321414800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:46:57.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.634+0000 7f9321414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:57.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.634+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.634+0000 7f9321414800 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:46:57.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.634+0000 7f9321414800 20 rados->read ofs=0 len=0 2024-09-12T00:46:57.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.635+0000 7f9321414800 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:46:57.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.635+0000 7f9321414800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:57.635 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.637+0000 7f91d2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:57.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.640+0000 7f9321414800 20 remove_watcher() i=0 2024-09-12T00:46:57.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.640+0000 7f9321414800 2 removed watcher, disabling cache 2024-09-12T00:46:57.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.642+0000 7f9321414800 20 remove_watcher() i=1 2024-09-12T00:46:57.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.643+0000 7f9321414800 20 remove_watcher() i=2 2024-09-12T00:46:57.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.644+0000 7f9321414800 20 remove_watcher() i=3 2024-09-12T00:46:57.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.645+0000 7f9321414800 20 remove_watcher() i=4 2024-09-12T00:46:57.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.646+0000 7f9321414800 20 remove_watcher() i=5 2024-09-12T00:46:57.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.647+0000 7f9321414800 20 remove_watcher() i=6 2024-09-12T00:46:57.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:57.648+0000 7f9321414800 20 remove_watcher() i=7 2024-09-12T00:46:57.659 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:57.659 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:57.659 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-init-indext id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:46:57.659 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:57.661 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:57.661 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:57.682 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:57.682 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:57.878 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:57.878 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.013 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:46:58.014 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:58.014 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.015 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.065 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.065 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.122 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.123 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.159 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.159 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.192 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.192 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.226 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.226 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.260 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.260 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.294 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.295 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.328 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.328 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.362 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.362 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.396 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.396 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.431 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.431 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.464 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.465 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.499 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.499 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.534 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.534 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.568 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.568 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.602 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.602 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.637 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.637 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.671 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.671 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.705 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.705 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.741 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.741 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.775 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:58.775 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:58.811 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:46:58.841 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:58.841 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:58.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.882+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.883+0000 7fd02ab15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.883+0000 7fd02ab15800 20 realm 2024-09-12T00:46:58.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.883+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.884+0000 7fd02ab15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.884+0000 7fd02ab15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:58.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.884+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.884+0000 7fd02ab15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:58.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.884+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.885+0000 7fd02ab15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:58.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.885+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:58.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.885+0000 7fd02ab15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:58.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.885+0000 7fd02ab15800 20 searching for the correct realm 2024-09-12T00:46:58.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:58.887+0000 7fd0285ff640 0 -- 172.21.15.19:0/1088546436 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7fd018045040 msgr2=0x7fd01801e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:59.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.093+0000 7fd0285ff640 0 -- 172.21.15.19:0/1088546436 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fd020030070 msgr2=0x7fd020063080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:59.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.301+0000 7fd02ab15800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:59.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.301+0000 7fd02ab15800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:59.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.301+0000 7fd02ab15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:59.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.301+0000 7fd02ab15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:59.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.301+0000 7fd02ab15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:59.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.301+0000 7fd02ab15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:59.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.301+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.301+0000 7fd02ab15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.301+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:59.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:59.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 20 zone default found 2024-09-12T00:46:59.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 4 Realm: () 2024-09-12T00:46:59.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:59.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:59.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:59.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 20 zonegroup default 2024-09-12T00:46:59.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.302+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.303+0000 7fd02ab15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.303+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.303+0000 7fd02ab15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.303+0000 7fd02ab15800 20 started sync module instance, tier type = 2024-09-12T00:46:59.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.303+0000 7fd02ab15800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:59.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.313+0000 7fd02ab15800 20 add_watcher() i=0 2024-09-12T00:46:59.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.313+0000 7fd02ab15800 20 add_watcher() i=1 2024-09-12T00:46:59.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.313+0000 7fd02ab15800 20 add_watcher() i=2 2024-09-12T00:46:59.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.313+0000 7fd02ab15800 20 add_watcher() i=3 2024-09-12T00:46:59.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.313+0000 7fd02ab15800 20 add_watcher() i=4 2024-09-12T00:46:59.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.313+0000 7fd02ab15800 20 add_watcher() i=5 2024-09-12T00:46:59.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.313+0000 7fd02ab15800 20 add_watcher() i=6 2024-09-12T00:46:59.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.314+0000 7fd02ab15800 20 add_watcher() i=7 2024-09-12T00:46:59.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.314+0000 7fd02ab15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:59.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.316+0000 7fcedefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:59.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.317+0000 7fd02ab15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:59.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.317+0000 7fd02ab15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:59.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.317+0000 7fd02ab15800 5 note: GC not initialized 2024-09-12T00:46:59.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.317+0000 7fceddfdb640 20 reqs_thread_entry: start 2024-09-12T00:46:59.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.317+0000 7fd02ab15800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:59.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.317+0000 7fd02ab15800 20 Filter name: none 2024-09-12T00:46:59.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.317+0000 7fce4f7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:59.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.317+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.318+0000 7fd02ab15800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:46:59.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.318+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.319+0000 7fd02ab15800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:46:59.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.319+0000 7fd02ab15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:59.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.319+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.320+0000 7fd02ab15800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:46:59.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.320+0000 7fd02ab15800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.320+0000 7fd02ab15800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:46:59.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.320+0000 7fd02ab15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:59.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.322+0000 7fcedefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:59.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.325+0000 7fd02ab15800 20 remove_watcher() i=0 2024-09-12T00:46:59.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.325+0000 7fd02ab15800 2 removed watcher, disabling cache 2024-09-12T00:46:59.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.326+0000 7fd02ab15800 20 remove_watcher() i=1 2024-09-12T00:46:59.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.327+0000 7fd02ab15800 20 remove_watcher() i=2 2024-09-12T00:46:59.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.328+0000 7fd02ab15800 20 remove_watcher() i=3 2024-09-12T00:46:59.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.329+0000 7fd02ab15800 20 remove_watcher() i=4 2024-09-12T00:46:59.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.330+0000 7fd02ab15800 20 remove_watcher() i=5 2024-09-12T00:46:59.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.331+0000 7fd02ab15800 20 remove_watcher() i=6 2024-09-12T00:46:59.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.333+0000 7fd02ab15800 20 remove_watcher() i=7 2024-09-12T00:46:59.343 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:59.344 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:59.344 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-set-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:46:59.344 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:59.345 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:46:59.381 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:59.381 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:59.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.423+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.424 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.425+0000 7f0a65f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.425+0000 7f0a65f75800 20 realm 2024-09-12T00:46:59.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.425+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.426+0000 7f0a65f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.426+0000 7f0a65f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:59.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.426+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.426+0000 7f0a65f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.426+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.427+0000 7f0a65f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:59.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.427+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.427+0000 7f0a65f75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:59.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.427+0000 7f0a65f75800 20 searching for the correct realm 2024-09-12T00:46:59.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.431+0000 7f0a6325e640 0 -- 172.21.15.19:0/2980265056 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f0a58021470 msgr2=0x7f0a580218f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:59.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.434+0000 7f0a63a5f640 0 -- 172.21.15.19:0/2980265056 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f0a5c0e0bb0 msgr2=0x7f0a5c0c39b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:46:59.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.438+0000 7f0a65f75800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:59.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.438+0000 7f0a65f75800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:59.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.438+0000 7f0a65f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.438+0000 7f0a65f75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.438+0000 7f0a65f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.438+0000 7f0a65f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.438+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.438+0000 7f0a65f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.438+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:59.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:59.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 20 zone default found 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 4 Realm: () 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 20 zonegroup default 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.439+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.440+0000 7f0a65f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.440+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.440+0000 7f0a65f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.440+0000 7f0a65f75800 20 started sync module instance, tier type = 2024-09-12T00:46:59.441 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.440+0000 7f0a65f75800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:59.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.448+0000 7f0a65f75800 20 add_watcher() i=0 2024-09-12T00:46:59.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.448+0000 7f0a65f75800 20 add_watcher() i=1 2024-09-12T00:46:59.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.448+0000 7f0a65f75800 20 add_watcher() i=2 2024-09-12T00:46:59.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.448+0000 7f0a65f75800 20 add_watcher() i=3 2024-09-12T00:46:59.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.448+0000 7f0a65f75800 20 add_watcher() i=4 2024-09-12T00:46:59.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.448+0000 7f0a65f75800 20 add_watcher() i=5 2024-09-12T00:46:59.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.448+0000 7f0a65f75800 20 add_watcher() i=6 2024-09-12T00:46:59.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.449+0000 7f0a65f75800 20 add_watcher() i=7 2024-09-12T00:46:59.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.449+0000 7f0a65f75800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:59.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.452+0000 7f0919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:59.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.452+0000 7f0a65f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:59.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.452+0000 7f0a65f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:59.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.452+0000 7f0a65f75800 5 note: GC not initialized 2024-09-12T00:46:59.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.452+0000 7f0918fe1640 20 reqs_thread_entry: start 2024-09-12T00:46:59.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.452+0000 7f0a65f75800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:59.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.453+0000 7f0a65f75800 20 Filter name: none 2024-09-12T00:46:59.452 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.453+0000 7f08927fc640 20 reqs_thread_entry: start 2024-09-12T00:46:59.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.453+0000 7f0a65f75800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:46:59.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.453+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.453+0000 7f0a65f75800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:46:59.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.453+0000 7f0a65f75800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:46:59.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.453+0000 7f0a65f75800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:46:59.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.453+0000 7f0a65f75800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 : miss 2024-09-12T00:46:59.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.453+0000 7f0a65f75800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.454+0000 7f0a65f75800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:46:59.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.454+0000 7f0a65f75800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 info.flags=0x17 2024-09-12T00:46:59.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.454+0000 7f0a65f75800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 to cache LRU end 2024-09-12T00:46:59.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.454+0000 7f0a65f75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:59.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.454+0000 7f0a65f75800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:59.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.454+0000 7f0a65f75800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 2024-09-12T00:46:59.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.457+0000 7f0a65f75800 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:46:59.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.457+0000 7f0a65f75800 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:46:59.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.464+0000 7f0919fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:59.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.466+0000 7f0a65f75800 20 remove_watcher() i=0 2024-09-12T00:46:59.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.466+0000 7f0a65f75800 2 removed watcher, disabling cache 2024-09-12T00:46:59.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.467+0000 7f0a65f75800 20 remove_watcher() i=1 2024-09-12T00:46:59.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.468+0000 7f0a65f75800 20 remove_watcher() i=2 2024-09-12T00:46:59.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.469+0000 7f0a65f75800 20 remove_watcher() i=3 2024-09-12T00:46:59.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.470+0000 7f0a65f75800 20 remove_watcher() i=4 2024-09-12T00:46:59.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.471+0000 7f0a65f75800 20 remove_watcher() i=5 2024-09-12T00:46:59.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.472+0000 7f0a65f75800 20 remove_watcher() i=6 2024-09-12T00:46:59.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.473+0000 7f0a65f75800 20 remove_watcher() i=7 2024-09-12T00:46:59.485 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:46:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:59.514 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:59.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.554+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.556+0000 7f26cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.556+0000 7f26cca0e800 20 realm 2024-09-12T00:46:59.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.556+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.556+0000 7f26cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.556+0000 7f26cca0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:59.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.556+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.556+0000 7f26cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.556+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.557+0000 7f26cca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:59.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.557+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.557+0000 7f26cca0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:59.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.557+0000 7f26cca0e800 20 searching for the correct realm 2024-09-12T00:46:59.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.562+0000 7f26c816b640 0 -- 172.21.15.19:0/741192474 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f26b80bcba0 msgr2=0x7f26b80e42b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:59.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.565+0000 7f26c816b640 0 -- 172.21.15.19:0/741192474 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55e4ecad8740 msgr2=0x55e4ecadac00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:59.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.568+0000 7f26cca0e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:59.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.568+0000 7f26cca0e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:59.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.568+0000 7f26cca0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:59.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.568+0000 7f26cca0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:59.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.568+0000 7f26cca0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:59.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.568+0000 7f26cca0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:59.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.568+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:59.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:59.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 20 zone default found 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 4 Realm: () 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 20 zonegroup default 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.569+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.570+0000 7f26cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.570+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.570+0000 7f26cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.570+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.570+0000 7f26cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.570+0000 7f26cca0e800 20 started sync module instance, tier type = 2024-09-12T00:46:59.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.570+0000 7f26cca0e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:59.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.578+0000 7f26cca0e800 20 add_watcher() i=0 2024-09-12T00:46:59.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.578+0000 7f26cca0e800 20 add_watcher() i=1 2024-09-12T00:46:59.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.578+0000 7f26cca0e800 20 add_watcher() i=2 2024-09-12T00:46:59.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.578+0000 7f26cca0e800 20 add_watcher() i=3 2024-09-12T00:46:59.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.578+0000 7f26cca0e800 20 add_watcher() i=4 2024-09-12T00:46:59.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.578+0000 7f26cca0e800 20 add_watcher() i=5 2024-09-12T00:46:59.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.578+0000 7f26cca0e800 20 add_watcher() i=6 2024-09-12T00:46:59.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.579+0000 7f26cca0e800 20 add_watcher() i=7 2024-09-12T00:46:59.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.579+0000 7f26cca0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:59.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.581+0000 7f257efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:59.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.582+0000 7f26cca0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:59.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.582+0000 7f26cca0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:59.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.582+0000 7f26cca0e800 5 note: GC not initialized 2024-09-12T00:46:59.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.582+0000 7f257dfdb640 20 reqs_thread_entry: start 2024-09-12T00:46:59.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.582+0000 7f26cca0e800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:59.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.582+0000 7f26cca0e800 20 Filter name: none 2024-09-12T00:46:59.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.582+0000 7f24ef7fe640 20 reqs_thread_entry: start 2024-09-12T00:46:59.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.582+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.583+0000 7f26cca0e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:46:59.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.583+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.583+0000 7f26cca0e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:46:59.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.583+0000 7f26cca0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:59.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.583+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.584+0000 7f26cca0e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:46:59.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.584+0000 7f26cca0e800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.584+0000 7f26cca0e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:46:59.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.584+0000 7f26cca0e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:46:59.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.586+0000 7f257efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:59.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.588+0000 7f26cca0e800 20 remove_watcher() i=0 2024-09-12T00:46:59.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.588+0000 7f26cca0e800 2 removed watcher, disabling cache 2024-09-12T00:46:59.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.589+0000 7f26cca0e800 20 remove_watcher() i=1 2024-09-12T00:46:59.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.590+0000 7f26cca0e800 20 remove_watcher() i=2 2024-09-12T00:46:59.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.591+0000 7f26cca0e800 20 remove_watcher() i=3 2024-09-12T00:46:59.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.592+0000 7f26cca0e800 20 remove_watcher() i=4 2024-09-12T00:46:59.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.593+0000 7f26cca0e800 20 remove_watcher() i=5 2024-09-12T00:46:59.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.594+0000 7f26cca0e800 20 remove_watcher() i=6 2024-09-12T00:46:59.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.595+0000 7f26cca0e800 20 remove_watcher() i=7 2024-09-12T00:46:59.604 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:59.604 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:46:59.604 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-set-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:46:59.605 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:46:59.606 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:59.606 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:59.635 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:46:59.635 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:46:59.694 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:46:59.726 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:59.726 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:46:59.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.768+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.769+0000 7fb6bdb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.769+0000 7fb6bdb42800 20 realm 2024-09-12T00:46:59.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.769+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.769+0000 7fb6bdb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.769+0000 7fb6bdb42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:46:59.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.769+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.769+0000 7fb6bdb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.768 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.769+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.770+0000 7fb6bdb42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:59.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.770+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.770+0000 7fb6bdb42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:46:59.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.770+0000 7fb6bdb42800 20 searching for the correct realm 2024-09-12T00:46:59.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.774+0000 7fb6b9085640 0 -- 172.21.15.19:0/1588084300 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fb6b007a120 msgr2=0x7fb6b0068840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:59.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.777+0000 7fb6ba087640 0 -- 172.21.15.19:0/1588084300 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x555df5626ac0 msgr2=0x555df5628f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:46:59.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.781+0000 7fb6bdb42800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:46:59.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.781+0000 7fb6bdb42800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:46:59.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.781+0000 7fb6bdb42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:46:59.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.781+0000 7fb6bdb42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:46:59.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.781+0000 7fb6bdb42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:46:59.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.781+0000 7fb6bdb42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:46:59.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.781+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.781+0000 7fb6bdb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.781+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.782+0000 7fb6bdb42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.782+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.782+0000 7fb6bdb42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.782+0000 7fb6bdb42800 20 zone default found 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.782+0000 7fb6bdb42800 4 Realm: () 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.782+0000 7fb6bdb42800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.782+0000 7fb6bdb42800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.782+0000 7fb6bdb42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.782+0000 7fb6bdb42800 20 zonegroup default 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.782+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.783+0000 7fb6bdb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.783+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.783+0000 7fb6bdb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.783+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.783+0000 7fb6bdb42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:46:59.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.783+0000 7fb6bdb42800 20 started sync module instance, tier type = 2024-09-12T00:46:59.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.783+0000 7fb6bdb42800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:46:59.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.792+0000 7fb6bdb42800 20 add_watcher() i=0 2024-09-12T00:46:59.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.792+0000 7fb6bdb42800 20 add_watcher() i=1 2024-09-12T00:46:59.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.792+0000 7fb6bdb42800 20 add_watcher() i=2 2024-09-12T00:46:59.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.792+0000 7fb6bdb42800 20 add_watcher() i=3 2024-09-12T00:46:59.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.792+0000 7fb6bdb42800 20 add_watcher() i=4 2024-09-12T00:46:59.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.792+0000 7fb6bdb42800 20 add_watcher() i=5 2024-09-12T00:46:59.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.792+0000 7fb6bdb42800 20 add_watcher() i=6 2024-09-12T00:46:59.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.793+0000 7fb6bdb42800 20 add_watcher() i=7 2024-09-12T00:46:59.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.793+0000 7fb6bdb42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:46:59.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.795+0000 7fb56b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:59.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.795+0000 7fb6bdb42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:46:59.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.795+0000 7fb6bdb42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:46:59.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.795+0000 7fb6bdb42800 5 note: GC not initialized 2024-09-12T00:46:59.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.795+0000 7fb56a7fc640 20 reqs_thread_entry: start 2024-09-12T00:46:59.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.795+0000 7fb6bdb42800 20 init_complete bucket index max shards: 11 2024-09-12T00:46:59.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.796+0000 7fb6bdb42800 20 Filter name: none 2024-09-12T00:46:59.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.796+0000 7fb4dbfff640 20 reqs_thread_entry: start 2024-09-12T00:46:59.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.796+0000 7fb6bdb42800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:46:59.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.796+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.796+0000 7fb6bdb42800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:46:59.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.796+0000 7fb6bdb42800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:46:59.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.796+0000 7fb6bdb42800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:46:59.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.796+0000 7fb6bdb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 : miss 2024-09-12T00:46:59.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.796+0000 7fb6bdb42800 20 rados->read ofs=0 len=0 2024-09-12T00:46:59.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.797+0000 7fb6bdb42800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:46:59.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.797+0000 7fb6bdb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 info.flags=0x17 2024-09-12T00:46:59.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.797+0000 7fb6bdb42800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 to cache LRU end 2024-09-12T00:46:59.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.797+0000 7fb6bdb42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:46:59.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.797+0000 7fb6bdb42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:59.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.797+0000 7fb6bdb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 2024-09-12T00:46:59.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.801+0000 7fb6bdb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 info.flags=0x17 2024-09-12T00:46:59.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.801+0000 7fb6bdb42800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 to cache LRU end 2024-09-12T00:46:59.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.801+0000 7fb6bdb42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:59.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.801+0000 7fb6bdb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22, ofs0, ns] 2024-09-12T00:46:59.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.802+0000 7fb59cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398931 cookie 93862037227504 notifier 6128 bl.length()=925 2024-09-12T00:46:59.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.802+0000 7fb59cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 info.flags=0x17 2024-09-12T00:46:59.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.802+0000 7fb59cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 to cache LRU end 2024-09-12T00:46:59.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.802+0000 7fb59cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:59.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.803+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): orig_sources= new_sources= 2024-09-12T00:46:59.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.803+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): potential sources added=[] removed=[] 2024-09-12T00:46:59.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.803+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): orig_dests= new_dests= 2024-09-12T00:46:59.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.803+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): potential dests added=[] removed=[] 2024-09-12T00:46:59.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.0 2024-09-12T00:46:59.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.0 2024-09-12T00:46:59.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.1 2024-09-12T00:46:59.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.1 2024-09-12T00:46:59.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.2 2024-09-12T00:46:59.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.2 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.3 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.3 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.4 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.4 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.5 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.5 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.6 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.6 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.7 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.7 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.8 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.8 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.9 2024-09-12T00:46:59.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.9 2024-09-12T00:46:59.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.10 2024-09-12T00:46:59.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.10 2024-09-12T00:46:59.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.11 2024-09-12T00:46:59.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1.11 2024-09-12T00:46:59.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.808+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.0 2024-09-12T00:46:59.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.809+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1 2024-09-12T00:46:59.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.809+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.2 2024-09-12T00:46:59.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.810+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.3 2024-09-12T00:46:59.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.810+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.4 2024-09-12T00:46:59.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.811+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.5 2024-09-12T00:46:59.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.811+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.6 2024-09-12T00:46:59.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.811+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.7 2024-09-12T00:46:59.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.812+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.8 2024-09-12T00:46:59.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.813+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.9 2024-09-12T00:46:59.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.813+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.10 2024-09-12T00:46:59.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.816+0000 7fb6bdb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:59.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.816+0000 7fb6bdb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 2024-09-12T00:46:59.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.819+0000 7fb6bdb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 info.flags=0x17 2024-09-12T00:46:59.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.819+0000 7fb6bdb42800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 to cache LRU end 2024-09-12T00:46:59.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.819+0000 7fb6bdb42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:59.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.819+0000 7fb6bdb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22, ofs0, ns] 2024-09-12T00:46:59.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.819+0000 7fb59cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398932 cookie 93862037227504 notifier 6128 bl.length()=925 2024-09-12T00:46:59.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.819+0000 7fb59cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 info.flags=0x17 2024-09-12T00:46:59.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.819+0000 7fb59cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 to cache LRU end 2024-09-12T00:46:59.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.819+0000 7fb59cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:59.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.820+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): orig_sources= new_sources= 2024-09-12T00:46:59.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.820+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): potential sources added=[] removed=[] 2024-09-12T00:46:59.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.820+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): orig_dests= new_dests= 2024-09-12T00:46:59.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.820+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): potential dests added=[] removed=[] 2024-09-12T00:46:59.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.823+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.0 2024-09-12T00:46:59.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.823+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.1 2024-09-12T00:46:59.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.824+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.2 2024-09-12T00:46:59.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.824+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.3 2024-09-12T00:46:59.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.824+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.4 2024-09-12T00:46:59.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.824+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.5 2024-09-12T00:46:59.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.825+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.6 2024-09-12T00:46:59.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.825+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.7 2024-09-12T00:46:59.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.825+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.8 2024-09-12T00:46:59.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.826+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.9 2024-09-12T00:46:59.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.826+0000 7fb6bdb42800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22.10 2024-09-12T00:46:59.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.826+0000 7fb6bdb42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:46:59.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.826+0000 7fb6bdb42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 2024-09-12T00:46:59.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.828+0000 7fb6bdb42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 info.flags=0x17 2024-09-12T00:46:59.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.828+0000 7fb6bdb42800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 to cache LRU end 2024-09-12T00:46:59.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.828+0000 7fb6bdb42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:59.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.828+0000 7fb6bdb42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22, ofs0, ns] 2024-09-12T00:46:59.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.828+0000 7fb59d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398933 cookie 93862037227504 notifier 6128 bl.length()=893 2024-09-12T00:46:59.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.828+0000 7fb59d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 info.flags=0x17 2024-09-12T00:46:59.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.828+0000 7fb59d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 to cache LRU end 2024-09-12T00:46:59.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.828+0000 7fb59d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:46:59.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.830+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): orig_sources= new_sources= 2024-09-12T00:46:59.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.830+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): potential sources added=[] removed=[] 2024-09-12T00:46:59.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.830+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): orig_dests= new_dests= 2024-09-12T00:46:59.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.830+0000 7fb6bdb42800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22]): potential dests added=[] removed=[] 2024-09-12T00:46:59.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.832+0000 7fb6bdb42800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:46:59.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.834+0000 7fb56b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:46:59.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.836+0000 7fb6bdb42800 20 remove_watcher() i=0 2024-09-12T00:46:59.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.836+0000 7fb6bdb42800 2 removed watcher, disabling cache 2024-09-12T00:46:59.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.837+0000 7fb6bdb42800 20 remove_watcher() i=1 2024-09-12T00:46:59.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.838+0000 7fb6bdb42800 20 remove_watcher() i=2 2024-09-12T00:46:59.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.839+0000 7fb6bdb42800 20 remove_watcher() i=3 2024-09-12T00:46:59.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.840+0000 7fb6bdb42800 20 remove_watcher() i=4 2024-09-12T00:46:59.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.841+0000 7fb6bdb42800 20 remove_watcher() i=5 2024-09-12T00:46:59.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.842+0000 7fb6bdb42800 20 remove_watcher() i=6 2024-09-12T00:46:59.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:46:59.843+0000 7fb6bdb42800 20 remove_watcher() i=7 2024-09-12T00:46:59.854 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:46:59.884 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:46:59.884 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:00.106 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.108+0000 7fc156791640 0 --2- 172.21.15.19:0/2032720980 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55580879b250 0x5558089172c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:47:00.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.127+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.129+0000 7fc15b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.129+0000 7fc15b811800 20 realm 2024-09-12T00:47:00.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.129+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.129+0000 7fc15b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.129+0000 7fc15b811800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:00.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.129+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.129+0000 7fc15b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.129+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.130+0000 7fc15b811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:00.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.130+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.130+0000 7fc15b811800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:00.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.130+0000 7fc15b811800 20 searching for the correct realm 2024-09-12T00:47:00.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.132+0000 7fc156f92640 0 -- 172.21.15.19:0/1984790212 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7fc148028040 msgr2=0x7fc14805b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:00.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.337+0000 7fc156f92640 0 -- 172.21.15.19:0/1984790212 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fc150089950 msgr2=0x7fc150055410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:00.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.545+0000 7fc15b811800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:00.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.545+0000 7fc15b811800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:00.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.545+0000 7fc15b811800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:00.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.545+0000 7fc15b811800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:00.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.545+0000 7fc15b811800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:00.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.545+0000 7fc15b811800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:00.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.545+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:00.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:00.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 20 zone default found 2024-09-12T00:47:00.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 4 Realm: () 2024-09-12T00:47:00.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 20 zonegroup default 2024-09-12T00:47:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.546+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.547+0000 7fc15b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.547+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.547+0000 7fc15b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.547+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.547+0000 7fc15b811800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.547+0000 7fc15b811800 20 started sync module instance, tier type = 2024-09-12T00:47:00.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.547+0000 7fc15b811800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:00.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.558+0000 7fc15b811800 20 add_watcher() i=0 2024-09-12T00:47:00.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.558+0000 7fc15b811800 20 add_watcher() i=1 2024-09-12T00:47:00.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.558+0000 7fc15b811800 20 add_watcher() i=2 2024-09-12T00:47:00.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.558+0000 7fc15b811800 20 add_watcher() i=3 2024-09-12T00:47:00.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.558+0000 7fc15b811800 20 add_watcher() i=4 2024-09-12T00:47:00.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.558+0000 7fc15b811800 20 add_watcher() i=5 2024-09-12T00:47:00.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.558+0000 7fc15b811800 20 add_watcher() i=6 2024-09-12T00:47:00.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.559+0000 7fc15b811800 20 add_watcher() i=7 2024-09-12T00:47:00.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.559+0000 7fc15b811800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:00.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.561+0000 7fc00d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:00.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.561+0000 7fc15b811800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:00.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.561+0000 7fc15b811800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:00.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.561+0000 7fc15b811800 5 note: GC not initialized 2024-09-12T00:47:00.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.561+0000 7fbf87fff640 20 reqs_thread_entry: start 2024-09-12T00:47:00.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.562+0000 7fc15b811800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:00.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.562+0000 7fc15b811800 20 Filter name: none 2024-09-12T00:47:00.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.562+0000 7fbf85ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:00.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.562+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.563+0000 7fc15b811800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:00.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.563+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.563+0000 7fc15b811800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:00.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.563+0000 7fc15b811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:00.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.563+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.564+0000 7fc15b811800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:00.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.564+0000 7fc15b811800 20 rados->read ofs=0 len=0 2024-09-12T00:47:00.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.564+0000 7fc15b811800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:00.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.564+0000 7fc15b811800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:00.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.566+0000 7fc00d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:00.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.569+0000 7fc15b811800 20 remove_watcher() i=0 2024-09-12T00:47:00.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.569+0000 7fc15b811800 2 removed watcher, disabling cache 2024-09-12T00:47:00.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.570+0000 7fc15b811800 20 remove_watcher() i=1 2024-09-12T00:47:00.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.571+0000 7fc15b811800 20 remove_watcher() i=2 2024-09-12T00:47:00.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.572+0000 7fc15b811800 20 remove_watcher() i=3 2024-09-12T00:47:00.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.573+0000 7fc15b811800 20 remove_watcher() i=4 2024-09-12T00:47:00.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.574+0000 7fc15b811800 20 remove_watcher() i=5 2024-09-12T00:47:00.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.575+0000 7fc15b811800 20 remove_watcher() i=6 2024-09-12T00:47:00.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:00.576+0000 7fc15b811800 20 remove_watcher() i=7 2024-09-12T00:47:00.587 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:00.588 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:00.588 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-set-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:47:00.588 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:00.590 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:00.590 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:00.609 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:00.609 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:00.824 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:00.824 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:00.961 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:47:00.961 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:00.962 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:00.962 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.010 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.010 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.067 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.067 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.099 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.099 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.132 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.132 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.167 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.167 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.202 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.202 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.235 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.235 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.268 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.268 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.302 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.302 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.337 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.338 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.372 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.372 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.405 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.406 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.440 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.440 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.474 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.474 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.507 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.508 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.542 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.542 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.576 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.576 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.610 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.610 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.644 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.645 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.679 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.679 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.712 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:01.712 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:01.747 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:47:01.777 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:01.777 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:01.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.818+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.820+0000 7fef20087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.820+0000 7fef20087800 20 realm 2024-09-12T00:47:01.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.820+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.820+0000 7fef20087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.820+0000 7fef20087800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:01.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.820+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.820+0000 7fef20087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.820+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.821+0000 7fef20087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:01.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.821+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.821+0000 7fef20087800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:01.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.821+0000 7fef20087800 20 searching for the correct realm 2024-09-12T00:47:01.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.825+0000 7fef15370640 0 -- 172.21.15.19:0/3150645010 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fef080973c0 msgr2=0x7fef08097860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:01.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.828+0000 7fef1db71640 0 -- 172.21.15.19:0/3150645010 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fef180a6180 msgr2=0x7fef180a4bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:01.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.833+0000 7fef20087800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:01.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.833+0000 7fef20087800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:01.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.833+0000 7fef20087800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:01.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.833+0000 7fef20087800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:01.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.833+0000 7fef20087800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:01.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.833+0000 7fef20087800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:01.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.833+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.833+0000 7fef20087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.833+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:01.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 20 zone default found 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 4 Realm: () 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 20 zonegroup default 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.834+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.835+0000 7fef20087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.835+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.835+0000 7fef20087800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.835+0000 7fef20087800 20 started sync module instance, tier type = 2024-09-12T00:47:01.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.835+0000 7fef20087800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:01.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.844+0000 7fef20087800 20 add_watcher() i=0 2024-09-12T00:47:01.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.844+0000 7fef20087800 20 add_watcher() i=1 2024-09-12T00:47:01.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.844+0000 7fef20087800 20 add_watcher() i=2 2024-09-12T00:47:01.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.844+0000 7fef20087800 20 add_watcher() i=3 2024-09-12T00:47:01.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.844+0000 7fef20087800 20 add_watcher() i=4 2024-09-12T00:47:01.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.844+0000 7fef20087800 20 add_watcher() i=5 2024-09-12T00:47:01.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.844+0000 7fef20087800 20 add_watcher() i=6 2024-09-12T00:47:01.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.845+0000 7fef20087800 20 add_watcher() i=7 2024-09-12T00:47:01.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.845+0000 7fef20087800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:01.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.847+0000 7fedcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:01.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.847+0000 7fef20087800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:01.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.847+0000 7fef20087800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:01.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.847+0000 7fef20087800 5 note: GC not initialized 2024-09-12T00:47:01.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.847+0000 7fedce7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:01.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.847+0000 7fef20087800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:01.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.847+0000 7fef20087800 20 Filter name: none 2024-09-12T00:47:01.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.847+0000 7fed3ffff640 20 reqs_thread_entry: start 2024-09-12T00:47:01.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.848+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.848+0000 7fef20087800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:01.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.848+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.849+0000 7fef20087800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:01.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.849+0000 7fef20087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:01.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.849+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.849+0000 7fef20087800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:01.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.849+0000 7fef20087800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.849+0000 7fef20087800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:01.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.849+0000 7fef20087800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:01.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.851+0000 7fedcf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:01.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.853+0000 7fef20087800 20 remove_watcher() i=0 2024-09-12T00:47:01.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.853+0000 7fef20087800 2 removed watcher, disabling cache 2024-09-12T00:47:01.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.854+0000 7fef20087800 20 remove_watcher() i=1 2024-09-12T00:47:01.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.855+0000 7fef20087800 20 remove_watcher() i=2 2024-09-12T00:47:01.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.856+0000 7fef20087800 20 remove_watcher() i=3 2024-09-12T00:47:01.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.857+0000 7fef20087800 20 remove_watcher() i=4 2024-09-12T00:47:01.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.858+0000 7fef20087800 20 remove_watcher() i=5 2024-09-12T00:47:01.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.859+0000 7fef20087800 20 remove_watcher() i=6 2024-09-12T00:47:01.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.860+0000 7fef20087800 20 remove_watcher() i=7 2024-09-12T00:47:01.870 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:01.870 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:01.870 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-set-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:47:01.870 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:01.871 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:47:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:01.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.949+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.950+0000 7f975c33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.950+0000 7f975c33e800 20 realm 2024-09-12T00:47:01.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.950+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.950+0000 7f975c33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.950+0000 7f975c33e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:01.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.950+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.950+0000 7f975c33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:01.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.950+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.951+0000 7f975c33e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:01.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.951+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:01.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.952+0000 7f975c33e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:01.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.952+0000 7f975c33e800 20 searching for the correct realm 2024-09-12T00:47:01.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:01.955+0000 7f974f885640 0 -- 172.21.15.19:0/1897211767 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f97400dabd0 msgr2=0x7f97400c4890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:02.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.159+0000 7f974f885640 0 -- 172.21.15.19:0/1897211767 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x557c02ace5d0 msgr2=0x557c02ad0a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:02.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:02.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:02.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:02.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:02.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:02.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:02.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:02.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 20 zone default found 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 4 Realm: () 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.164+0000 7f975c33e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.165+0000 7f975c33e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.165+0000 7f975c33e800 20 zonegroup default 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.165+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.165+0000 7f975c33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.165+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.165+0000 7f975c33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.165+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.165+0000 7f975c33e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.165+0000 7f975c33e800 20 started sync module instance, tier type = 2024-09-12T00:47:02.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.165+0000 7f975c33e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:02.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.174+0000 7f975c33e800 20 add_watcher() i=0 2024-09-12T00:47:02.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.174+0000 7f975c33e800 20 add_watcher() i=1 2024-09-12T00:47:02.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.174+0000 7f975c33e800 20 add_watcher() i=2 2024-09-12T00:47:02.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.174+0000 7f975c33e800 20 add_watcher() i=3 2024-09-12T00:47:02.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.174+0000 7f975c33e800 20 add_watcher() i=4 2024-09-12T00:47:02.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.174+0000 7f975c33e800 20 add_watcher() i=5 2024-09-12T00:47:02.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.174+0000 7f975c33e800 20 add_watcher() i=6 2024-09-12T00:47:02.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.175+0000 7f975c33e800 20 add_watcher() i=7 2024-09-12T00:47:02.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.175+0000 7f975c33e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:02.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.177+0000 7f960e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:02.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.177+0000 7f975c33e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:02.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.177+0000 7f975c33e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:02.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.177+0000 7f975c33e800 5 note: GC not initialized 2024-09-12T00:47:02.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.178+0000 7f960d7e2640 20 reqs_thread_entry: start 2024-09-12T00:47:02.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.178+0000 7f975c33e800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:02.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.178+0000 7f975c33e800 20 Filter name: none 2024-09-12T00:47:02.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.178+0000 7f957effd640 20 reqs_thread_entry: start 2024-09-12T00:47:02.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.178+0000 7f975c33e800 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:47:02.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.178+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.178+0000 7f975c33e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:02.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.178+0000 7f975c33e800 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:47:02.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.178+0000 7f975c33e800 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:47:02.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.178+0000 7f975c33e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 : miss 2024-09-12T00:47:02.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.178+0000 7f975c33e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.179+0000 7f975c33e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:02.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.179+0000 7f975c33e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 info.flags=0x17 2024-09-12T00:47:02.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.179+0000 7f975c33e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 to cache LRU end 2024-09-12T00:47:02.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.179+0000 7f975c33e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:02.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.179+0000 7f975c33e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:02.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.179+0000 7f975c33e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 2024-09-12T00:47:02.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.183+0000 7f975c33e800 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:47:02.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.184+0000 7f975c33e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 info.flags=0x17 2024-09-12T00:47:02.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.184+0000 7f975c33e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 to cache LRU end 2024-09-12T00:47:02.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.184+0000 7f975c33e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:02.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.184+0000 7f975c33e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23, ofs0, ns] 2024-09-12T00:47:02.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.185+0000 7f96377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398936 cookie 93991109240512 notifier 6176 bl.length()=925 2024-09-12T00:47:02.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.185+0000 7f96377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 info.flags=0x17 2024-09-12T00:47:02.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.185+0000 7f96377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 to cache LRU end 2024-09-12T00:47:02.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.185+0000 7f96377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:02.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.186+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): orig_sources= new_sources= 2024-09-12T00:47:02.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.186+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): potential sources added=[] removed=[] 2024-09-12T00:47:02.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.186+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): orig_dests= new_dests= 2024-09-12T00:47:02.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.186+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): potential dests added=[] removed=[] 2024-09-12T00:47:02.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.0 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.0 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.1 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.1 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.2 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.2 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.3 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.3 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.4 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.4 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.5 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.5 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.6 2024-09-12T00:47:02.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.6 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.7 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.7 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.8 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.8 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.9 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.9 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.10 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.10 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.11 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.190+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1.11 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.191+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.0 2024-09-12T00:47:02.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.191+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1 2024-09-12T00:47:02.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.191+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.2 2024-09-12T00:47:02.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.192+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.3 2024-09-12T00:47:02.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.192+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.4 2024-09-12T00:47:02.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.193+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.5 2024-09-12T00:47:02.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.193+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.6 2024-09-12T00:47:02.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.194+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.7 2024-09-12T00:47:02.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.195+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.8 2024-09-12T00:47:02.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.195+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.9 2024-09-12T00:47:02.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.196+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.10 2024-09-12T00:47:02.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.199+0000 7f975c33e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:02.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.199+0000 7f975c33e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 2024-09-12T00:47:02.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.200+0000 7f975c33e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 info.flags=0x17 2024-09-12T00:47:02.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.200+0000 7f975c33e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 to cache LRU end 2024-09-12T00:47:02.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.200+0000 7f975c33e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:02.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.200+0000 7f975c33e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23, ofs0, ns] 2024-09-12T00:47:02.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.201+0000 7f96377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398937 cookie 93991109240512 notifier 6176 bl.length()=925 2024-09-12T00:47:02.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.201+0000 7f96377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 info.flags=0x17 2024-09-12T00:47:02.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.201+0000 7f96377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 to cache LRU end 2024-09-12T00:47:02.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.201+0000 7f96377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:02.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.202+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): orig_sources= new_sources= 2024-09-12T00:47:02.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.202+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): potential sources added=[] removed=[] 2024-09-12T00:47:02.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.202+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): orig_dests= new_dests= 2024-09-12T00:47:02.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.202+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): potential dests added=[] removed=[] 2024-09-12T00:47:02.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.204+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.0 2024-09-12T00:47:02.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.205+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.1 2024-09-12T00:47:02.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.205+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.2 2024-09-12T00:47:02.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.205+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.3 2024-09-12T00:47:02.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.206+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.4 2024-09-12T00:47:02.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.206+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.5 2024-09-12T00:47:02.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.206+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.6 2024-09-12T00:47:02.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.207+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.7 2024-09-12T00:47:02.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.207+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.8 2024-09-12T00:47:02.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.208+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.9 2024-09-12T00:47:02.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.208+0000 7f975c33e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23.10 2024-09-12T00:47:02.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.208+0000 7f975c33e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:02.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.208+0000 7f975c33e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 2024-09-12T00:47:02.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.210+0000 7f975c33e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 info.flags=0x17 2024-09-12T00:47:02.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.210+0000 7f975c33e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 to cache LRU end 2024-09-12T00:47:02.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.210+0000 7f975c33e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:02.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.210+0000 7f975c33e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23, ofs0, ns] 2024-09-12T00:47:02.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.210+0000 7f96377fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398938 cookie 93991109240512 notifier 6176 bl.length()=893 2024-09-12T00:47:02.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.210+0000 7f96377fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 info.flags=0x17 2024-09-12T00:47:02.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.210+0000 7f96377fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 to cache LRU end 2024-09-12T00:47:02.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.210+0000 7f96377fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:02.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.211+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): orig_sources= new_sources= 2024-09-12T00:47:02.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.211+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): potential sources added=[] removed=[] 2024-09-12T00:47:02.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.211+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): orig_dests= new_dests= 2024-09-12T00:47:02.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.211+0000 7f975c33e800 20 handle_bi_update(): bucket=:error-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23]): potential dests added=[] removed=[] 2024-09-12T00:47:02.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.214+0000 7f975c33e800 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:47:02.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.216+0000 7f960e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:02.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.218+0000 7f975c33e800 20 remove_watcher() i=0 2024-09-12T00:47:02.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.218+0000 7f975c33e800 2 removed watcher, disabling cache 2024-09-12T00:47:02.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.219+0000 7f975c33e800 20 remove_watcher() i=1 2024-09-12T00:47:02.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.220+0000 7f975c33e800 20 remove_watcher() i=2 2024-09-12T00:47:02.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.221+0000 7f975c33e800 20 remove_watcher() i=3 2024-09-12T00:47:02.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.222+0000 7f975c33e800 20 remove_watcher() i=4 2024-09-12T00:47:02.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.223+0000 7f975c33e800 20 remove_watcher() i=5 2024-09-12T00:47:02.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.224+0000 7f975c33e800 20 remove_watcher() i=6 2024-09-12T00:47:02.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.225+0000 7f975c33e800 20 remove_watcher() i=7 2024-09-12T00:47:02.236 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:47:02.265 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:02.265 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:02.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.305+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.307+0000 7fbf78725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.307+0000 7fbf78725800 20 realm 2024-09-12T00:47:02.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.307+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.307+0000 7fbf78725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.307+0000 7fbf78725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:02.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.307+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.308+0000 7fbf78725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.308+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.308+0000 7fbf78725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:02.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.308+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.308 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.309+0000 7fbf78725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:02.308 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.309+0000 7fbf78725800 20 searching for the correct realm 2024-09-12T00:47:02.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.312+0000 7fbf73bad640 0 -- 172.21.15.19:0/3651908911 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fbf68071e10 msgr2=0x7fbf6803b820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:02.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.315+0000 7fbf74baf640 0 -- 172.21.15.19:0/3651908911 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55c13fd96df0 msgr2=0x55c13fd99240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:02.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.320+0000 7fbf78725800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:02.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.320+0000 7fbf78725800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:02.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.320+0000 7fbf78725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:02.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.320+0000 7fbf78725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:02.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.320+0000 7fbf78725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:02.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.320+0000 7fbf78725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:02.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.320+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.320+0000 7fbf78725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.319 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.320+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.320+0000 7fbf78725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:02.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.320+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 20 zone default found 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 4 Realm: () 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 20 zonegroup default 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:02.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 20 started sync module instance, tier type = 2024-09-12T00:47:02.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.321+0000 7fbf78725800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:02.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.330+0000 7fbf78725800 20 add_watcher() i=0 2024-09-12T00:47:02.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.330+0000 7fbf78725800 20 add_watcher() i=1 2024-09-12T00:47:02.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.330+0000 7fbf78725800 20 add_watcher() i=2 2024-09-12T00:47:02.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.330+0000 7fbf78725800 20 add_watcher() i=3 2024-09-12T00:47:02.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.330+0000 7fbf78725800 20 add_watcher() i=4 2024-09-12T00:47:02.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.330+0000 7fbf78725800 20 add_watcher() i=5 2024-09-12T00:47:02.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.330+0000 7fbf78725800 20 add_watcher() i=6 2024-09-12T00:47:02.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.331+0000 7fbf78725800 20 add_watcher() i=7 2024-09-12T00:47:02.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.331+0000 7fbf78725800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:02.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.332+0000 7fbe2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:02.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.333+0000 7fbf78725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:02.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.333+0000 7fbf78725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:02.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.333+0000 7fbf78725800 5 note: GC not initialized 2024-09-12T00:47:02.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.333+0000 7fbe29fdb640 20 reqs_thread_entry: start 2024-09-12T00:47:02.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.333+0000 7fbf78725800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:02.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.333+0000 7fbf78725800 20 Filter name: none 2024-09-12T00:47:02.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.333+0000 7fbd9b7fe640 20 reqs_thread_entry: start 2024-09-12T00:47:02.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.333+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.334+0000 7fbf78725800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:02.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.334+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.335+0000 7fbf78725800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:02.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.335+0000 7fbf78725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:02.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.335+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.335+0000 7fbf78725800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:02.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.335+0000 7fbf78725800 20 rados->read ofs=0 len=0 2024-09-12T00:47:02.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.335+0000 7fbf78725800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:02.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.335+0000 7fbf78725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:02.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.337+0000 7fbe2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:02.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.339+0000 7fbf78725800 20 remove_watcher() i=0 2024-09-12T00:47:02.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.339+0000 7fbf78725800 2 removed watcher, disabling cache 2024-09-12T00:47:02.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.340+0000 7fbf78725800 20 remove_watcher() i=1 2024-09-12T00:47:02.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.341+0000 7fbf78725800 20 remove_watcher() i=2 2024-09-12T00:47:02.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.342+0000 7fbf78725800 20 remove_watcher() i=3 2024-09-12T00:47:02.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.343+0000 7fbf78725800 20 remove_watcher() i=4 2024-09-12T00:47:02.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.344+0000 7fbf78725800 20 remove_watcher() i=5 2024-09-12T00:47:02.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.345+0000 7fbf78725800 20 remove_watcher() i=6 2024-09-12T00:47:02.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:02.346+0000 7fbf78725800 20 remove_watcher() i=7 2024-09-12T00:47:02.355 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:02.355 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:02.355 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-set-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:47:02.356 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:02.357 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:02.358 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:02.375 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:02.375 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:02.575 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:02.575 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:02.713 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:47:02.713 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:02.714 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:02.714 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:02.763 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:02.763 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:02.820 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:02.820 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:02.858 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:02.858 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:02.899 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:02.899 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:02.933 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:02.933 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:02.968 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:02.968 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.004 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.005 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.038 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.038 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.073 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.073 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.107 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.107 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.141 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.141 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.176 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.176 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.210 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.210 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.244 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.245 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.280 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.280 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.314 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.314 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.347 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.347 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.381 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.381 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.415 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.415 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.449 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.449 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.482 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:03.483 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:03.517 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:47:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:03.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.587+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.589+0000 7f579d415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.589+0000 7f579d415800 20 realm 2024-09-12T00:47:03.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.589+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.589+0000 7f579d415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.589+0000 7f579d415800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:03.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.589+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.589+0000 7f579d415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.589+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.590+0000 7f579d415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:03.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.590+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.590+0000 7f579d415800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:03.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.590+0000 7f579d415800 20 searching for the correct realm 2024-09-12T00:47:03.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.593+0000 7f5798391640 0 -- 172.21.15.19:0/3167450039 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f578c06a870 msgr2=0x7f578c06d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:03.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.799+0000 7f5799393640 0 -- 172.21.15.19:0/3167450039 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5604bc5747f0 msgr2=0x5604bc576c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:03.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.803+0000 7f579d415800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:03.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.803+0000 7f579d415800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:03.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.803+0000 7f579d415800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:03.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.803+0000 7f579d415800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:03.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.803+0000 7f579d415800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:03.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.803+0000 7f579d415800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:03.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.803+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.803+0000 7f579d415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.803+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:03.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:03.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 20 zone default found 2024-09-12T00:47:03.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 4 Realm: () 2024-09-12T00:47:03.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:03.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:03.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:03.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 20 zonegroup default 2024-09-12T00:47:03.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.804+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.805+0000 7f579d415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.805+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.805+0000 7f579d415800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.805+0000 7f579d415800 20 started sync module instance, tier type = 2024-09-12T00:47:03.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.805+0000 7f579d415800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:03.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.813+0000 7f579d415800 20 add_watcher() i=0 2024-09-12T00:47:03.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.813+0000 7f579d415800 20 add_watcher() i=1 2024-09-12T00:47:03.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.813+0000 7f579d415800 20 add_watcher() i=2 2024-09-12T00:47:03.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.813+0000 7f579d415800 20 add_watcher() i=3 2024-09-12T00:47:03.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.813+0000 7f579d415800 20 add_watcher() i=4 2024-09-12T00:47:03.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.813+0000 7f579d415800 20 add_watcher() i=5 2024-09-12T00:47:03.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.813+0000 7f579d415800 20 add_watcher() i=6 2024-09-12T00:47:03.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.814+0000 7f579d415800 20 add_watcher() i=7 2024-09-12T00:47:03.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.814+0000 7f579d415800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:03.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.816+0000 7f564efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:03.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.817+0000 7f579d415800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:03.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.817+0000 7f579d415800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:03.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.817+0000 7f579d415800 5 note: GC not initialized 2024-09-12T00:47:03.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.817+0000 7f564dfe3640 20 reqs_thread_entry: start 2024-09-12T00:47:03.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.817+0000 7f579d415800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:03.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.817+0000 7f579d415800 20 Filter name: none 2024-09-12T00:47:03.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.817+0000 7f55bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:47:03.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.817+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.818+0000 7f579d415800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:03.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.818+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.818+0000 7f579d415800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:03.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.819+0000 7f579d415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:03.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.819+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.819+0000 7f579d415800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:03.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.819+0000 7f579d415800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.819+0000 7f579d415800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:03.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.819+0000 7f579d415800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:03.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.821+0000 7f564efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:03.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.823+0000 7f579d415800 20 remove_watcher() i=0 2024-09-12T00:47:03.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.823+0000 7f579d415800 2 removed watcher, disabling cache 2024-09-12T00:47:03.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.824+0000 7f579d415800 20 remove_watcher() i=1 2024-09-12T00:47:03.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.825+0000 7f579d415800 20 remove_watcher() i=2 2024-09-12T00:47:03.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.826+0000 7f579d415800 20 remove_watcher() i=3 2024-09-12T00:47:03.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.827+0000 7f579d415800 20 remove_watcher() i=4 2024-09-12T00:47:03.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.828+0000 7f579d415800 20 remove_watcher() i=5 2024-09-12T00:47:03.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.829+0000 7f579d415800 20 remove_watcher() i=6 2024-09-12T00:47:03.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.830+0000 7f579d415800 20 remove_watcher() i=7 2024-09-12T00:47:03.840 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.840 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:03.840 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-set-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:47:03.840 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.841 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:47:03.876 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:03.876 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:03.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.917+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.919+0000 7f61eeb28800 20 realm 2024-09-12T00:47:03.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.919+0000 7f61eeb28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:03.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.920+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:03.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.920+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.920+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:03.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.920+0000 7f61eeb28800 20 searching for the correct realm 2024-09-12T00:47:03.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.924+0000 7f61ea06e640 0 -- 172.21.15.19:0/651621471 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f61e002a3f0 msgr2=0x7f61e002a830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:03.926 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.927+0000 7f61ea86f640 0 -- 172.21.15.19:0/651621471 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f61e4030060 msgr2=0x7f61e4026430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:03.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:03.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:03.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:03.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:03.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:03.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:03.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.931+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.931+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.931+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:03.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:03.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 20 zone default found 2024-09-12T00:47:03.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 4 Realm: () 2024-09-12T00:47:03.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:03.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:03.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:03.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 20 zonegroup default 2024-09-12T00:47:03.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.933+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:03.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.933+0000 7f61eeb28800 20 started sync module instance, tier type = 2024-09-12T00:47:03.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.933+0000 7f61eeb28800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:03.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=0 2024-09-12T00:47:03.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=1 2024-09-12T00:47:03.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=2 2024-09-12T00:47:03.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=3 2024-09-12T00:47:03.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=4 2024-09-12T00:47:03.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=5 2024-09-12T00:47:03.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=6 2024-09-12T00:47:03.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.942+0000 7f61eeb28800 20 add_watcher() i=7 2024-09-12T00:47:03.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.942+0000 7f61eeb28800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:03.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.944+0000 7f60a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:03.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.944+0000 7f61eeb28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:03.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.944+0000 7f61eeb28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:03.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.944+0000 7f61eeb28800 5 note: GC not initialized 2024-09-12T00:47:03.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.944+0000 7f601bfff640 20 reqs_thread_entry: start 2024-09-12T00:47:03.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.944+0000 7f61eeb28800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:03.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.944+0000 7f61eeb28800 20 Filter name: none 2024-09-12T00:47:03.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.944+0000 7f6019ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:03.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.944+0000 7f61eeb28800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:47:03.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.944+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.945+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:03.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.945+0000 7f61eeb28800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:47:03.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.945+0000 7f61eeb28800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:47:03.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.945+0000 7f61eeb28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 : miss 2024-09-12T00:47:03.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.945+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:03.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.945+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:03.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.945+0000 7f61eeb28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 info.flags=0x17 2024-09-12T00:47:03.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.945+0000 7f61eeb28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to cache LRU end 2024-09-12T00:47:03.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.945+0000 7f61eeb28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:03.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.945+0000 7f61eeb28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:03.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.945+0000 7f61eeb28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 2024-09-12T00:47:03.948 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61eeb28800 time 2024-09-12T00:47:03.950600+0000 2024-09-12T00:47:03.948 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:03.949 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:03.949 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f61f038c71a] 2024-09-12T00:47:03.949 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61f038c8d8] 2024-09-12T00:47:03.949 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595bcc40641] 2024-09-12T00:47:03.949 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd878e8) [0x5595bd1528e8] 2024-09-12T00:47:03.949 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5595bcc5031d] 2024-09-12T00:47:03.949 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f61ef029590] 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.950+0000 7f61eeb28800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61eeb28800 time 2024-09-12T00:47:03.950600+0000 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f61f038c71a] 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61f038c8d8] 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595bcc40641] 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd878e8) [0x5595bd1528e8] 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5595bcc5031d] 2024-09-12T00:47:03.950 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:47:03.951 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f61ef029590] 2024-09-12T00:47:03.951 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:47:03.951 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:47:03.951 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.951 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:47:03.951 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f61eeb28800 thread_name:radosgw-admin 2024-09-12T00:47:03.966 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:03.966 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f61ef03e6f0] 2024-09-12T00:47:03.966 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f61ef08b99c] 2024-09-12T00:47:03.966 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:47:03.966 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:47:03.966 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f61f038c774] 2024-09-12T00:47:03.966 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61f038c8d8] 2024-09-12T00:47:03.966 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595bcc40641] 2024-09-12T00:47:03.966 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd878e8) [0x5595bd1528e8] 2024-09-12T00:47:03.966 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5595bcc5031d] 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f61ef029590] 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:03.951+0000 7f61eeb28800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f61eeb28800 thread_name:radosgw-admin 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f61ef03e6f0] 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f61ef08b99c] 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f61f038c774] 2024-09-12T00:47:03.967 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61f038c8d8] 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595bcc40641] 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd878e8) [0x5595bd1528e8] 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5595bcc5031d] 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f61ef029590] 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:47:03.899+0000 7f61ea06e640 10 monclient(hunting): handle_auth_done global_id 6212 payload 274 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:47:03.899+0000 7f61ea06e640 10 monclient: _finish_hunting 0 2024-09-12T00:47:03.968 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:47:03.899+0000 7f61ea06e640 1 monclient: found mon.noname-c 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:47:03.899+0000 7f61ea06e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: dump: 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:03.969 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: _finish_auth 0 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: _check_auth_tickets 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: dump: 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:03.970 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:47:03.899+0000 7f61eeb28800 5 monclient: authenticate success, global_id 6212 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:47:03.899+0000 7f61eeb28800 10 monclient: get_monmap_and_config success 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:47:03.899+0000 7f61eeb28800 4 set_mon_vals no callback set 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:47:03.900+0000 7f61eeb28800 10 monclient: shutdown 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 asok(0x5595bef3e630) unregister_commands rotate-key 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:47:03.900+0000 7f61eeb28800 10 monclient: build_initial_monmap 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:47:03.900+0000 7f61eeb28800 1 build_initial for_mkfs: 0 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:47:03.900+0000 7f61eeb28800 10 monclient: monmap: 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:03.971 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding auth protocol: cephx 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding auth protocol: cephx 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding auth protocol: cephx 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:03.972 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:47:03.900+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:47:03.900+0000 7f61eeb28800 1 librados: starting msgr at 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:47:03.900+0000 7f61eeb28800 1 librados: starting objecter 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command objecter_requests hook 0x5595bf162d90 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:47:03.900+0000 7f61eeb28800 1 librados: setting wanted keys 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:47:03.900+0000 7f61eeb28800 1 librados: calling monclient init 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:47:03.900+0000 7f61eeb28800 10 monclient: init 2024-09-12T00:47:03.973 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding auth protocol: cephx 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding auth protocol: cephx 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding auth protocol: cephx 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:03.974 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:47:03.901+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:47:03.901+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:47:03.901+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command rotate-key hook 0x5595bf15d5a8 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-c con 0x5595bf015180 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-b con 0x5595bf099710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-a con 0x5595bf0a3d40 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): authenticate will time out at 2090.403515s 2024-09-12T00:47:03.975 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): get_auth_request con 0x5595bf015180 auth_method 0 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): get_auth_request con 0x5595bf0a3d40 auth_method 0 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): get_auth_request con 0x5595bf099710 auth_method 0 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:03.976 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): handle_auth_done global_id 6215 payload 824 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient: _finish_hunting 0 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:47:03.901+0000 7f61ea86f640 1 monclient: found mon.noname-c 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: dump: 2024-09-12T00:47:03.977 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: _finish_auth 0 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: _check_auth_tickets 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:03.978 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: dump: 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:47:03.902+0000 7f61eeb28800 5 monclient: authenticate success, global_id 6215 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:47:03.902+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:03.979 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:47:03.902+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:47:03.902+0000 7f60d8e09640 4 set_mon_vals no callback set 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:47:03.902+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:47:03.902+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:47:03.902+0000 7f61eeb28800 1 librados: init done 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:47:03.904+0000 7f60d7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:47:03.904+0000 7f60d7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:47:03.904+0000 7f60d7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:47:03.904+0000 7f61ea06e640 10 monclient: get_auth_request con 0x7f60d0076470 auth_method 0 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:47:03.905+0000 7f61eb070640 10 monclient: get_auth_request con 0x5595bf186380 auth_method 0 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:47:03.905+0000 7f61ea86f640 10 monclient: get_auth_request con 0x5595bf1a8af0 auth_method 0 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:47:03.907+0000 7f61ea06e640 10 monclient: get_auth_request con 0x5595bf1ae060 auth_method 0 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:47:03.908+0000 7f61eeb28800 10 monclient: build_initial_monmap 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:47:03.908+0000 7f61eeb28800 1 build_initial for_mkfs: 0 2024-09-12T00:47:03.980 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:47:03.908+0000 7f61eeb28800 10 monclient: monmap: 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding auth protocol: cephx 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding auth protocol: cephx 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding auth protocol: cephx 2024-09-12T00:47:03.981 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:47:03.908+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command objecter_requests cmddesc objecter_requests hook 0x5595bf1b5410 EEXIST 2024-09-12T00:47:03.982 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:47:03.908+0000 7f61eeb28800 10 monclient: init 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding auth protocol: cephx 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding auth protocol: cephx 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding auth protocol: cephx 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:03.983 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:47:03.908+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:47:03.909+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:47:03.909+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command rotate-key cmddesc rotate-key hook 0x5595bf1b0fc0 EEXIST 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-c con 0x5595bf1d9730 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-b con 0x5595bf1d9b10 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-a con 0x5595bf1d8440 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:03.984 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): authenticate will time out at 2090.411339s 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): get_auth_request con 0x5595bf1d9730 auth_method 0 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): get_auth_request con 0x5595bf1d8440 auth_method 0 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:03.985 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:47:03.909+0000 7f61ea06e640 10 monclient(hunting): get_auth_request con 0x5595bf1d9b10 auth_method 0 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:47:03.909+0000 7f61ea06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:47:03.909+0000 7f61ea06e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:47:03.909+0000 7f61ea06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): handle_auth_done global_id 6218 payload 824 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient: _finish_hunting 0 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:47:03.909+0000 7f61ea86f640 1 monclient: found mon.noname-c 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:47:03.909+0000 7f60d4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:47:03.909+0000 7f60d4e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:47:03.909+0000 7f60d4e01640 10 monclient: dump: 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:03.986 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: _finish_auth 0 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: _check_auth_tickets 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: dump: 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:03.987 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:47:03.910+0000 7f61eeb28800 5 monclient: authenticate success, global_id 6218 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:47:03.910+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:47:03.910+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:47:03.910+0000 7f61eb871640 4 set_mon_vals no callback set 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:47:03.910+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:03.988 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:47:03.910+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:47:03.911+0000 7f60d4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:47:03.911+0000 7f60d4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:47:03.911+0000 7f60d4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:47:03.911+0000 7f61ea06e640 10 monclient: get_auth_request con 0x7f60c4076380 auth_method 0 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:47:03.911+0000 7f61eeb28800 10 monclient: get_monmap_and_config 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:47:03.911+0000 7f61eeb28800 10 monclient: build_initial_monmap 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:47:03.911+0000 7f61eeb28800 1 build_initial for_mkfs: 0 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient: monmap: 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:03.989 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding auth protocol: cephx 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding auth protocol: cephx 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding auth protocol: cephx 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:03.990 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:47:03.912+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient: init 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding auth protocol: cephx 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding auth protocol: cephx 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding auth protocol: cephx 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:03.991 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:47:03.912+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:47:03.912+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command rotate-key cmddesc rotate-key hook 0x7fff4a53eba8 EEXIST 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-a con 0x5595bf22d7b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:03.992 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-c con 0x5595bf1fe7c0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-b con 0x5595bf228c90 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): authenticate will time out at 2090.415027s 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): get_auth_request con 0x5595bf22d7b0 auth_method 0 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): get_auth_request con 0x5595bf1fe7c0 auth_method 0 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:03.993 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): get_auth_request con 0x5595bf228c90 auth_method 0 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): handle_auth_done global_id 6597 payload 274 2024-09-12T00:47:03.994 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient: _finish_hunting 0 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:47:03.913+0000 7f61ea86f640 1 monclient: found mon.noname-a 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: dump: 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:03.995 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: _finish_auth 0 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:47:03.913+0000 7f61eeb28800 5 monclient: authenticate success, global_id 6597 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient: get_monmap_and_config success 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:47:03.913+0000 7f61eeb28800 4 set_mon_vals no callback set 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: dump: 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.996 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:47:03.914+0000 7f61eeb28800 10 monclient: shutdown 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:47:03.914+0000 7f61eeb28800 10 monclient: build_initial_monmap 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:47:03.914+0000 7f61eeb28800 1 build_initial for_mkfs: 0 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:47:03.914+0000 7f61eeb28800 10 monclient: monmap: 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:03.997 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding auth protocol: cephx 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding auth protocol: cephx 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding auth protocol: cephx 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:03.998 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:47:03.914+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:47:03.914+0000 7f61eeb28800 1 librados: starting msgr at 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:47:03.914+0000 7f61eeb28800 1 librados: starting objecter 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command objecter_requests cmddesc objecter_requests hook 0x5595bf2273d0 EEXIST 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:47:03.914+0000 7f61eeb28800 1 librados: setting wanted keys 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:47:03.914+0000 7f61eeb28800 1 librados: calling monclient init 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:47:03.914+0000 7f61eeb28800 10 monclient: init 2024-09-12T00:47:03.999 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding auth protocol: cephx 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding auth protocol: cephx 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding auth protocol: cephx 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.000 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:47:03.915+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:47:03.915+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:47:03.915+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command rotate-key cmddesc rotate-key hook 0x5595bf1ee138 EEXIST 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-c con 0x5595bf1fe7c0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-a con 0x5595bf228c90 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-b con 0x5595bf22d7b0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): authenticate will time out at 2090.417350s 2024-09-12T00:47:04.001 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): get_auth_request con 0x5595bf228c90 auth_method 0 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): get_auth_request con 0x5595bf1fe7c0 auth_method 0 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.002 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): handle_auth_done global_id 6224 payload 824 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient: _finish_hunting 0 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:47:03.915+0000 7f61ea86f640 1 monclient: found mon.noname-c 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:47:03.915+0000 7f61eb070640 10 monclient: get_auth_request con 0x5595bf22d7b0 auth_method 0 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: dump: 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.003 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: _finish_auth 0 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: _check_auth_tickets 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: dump: 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.004 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:47:03.915+0000 7f60ce7fc640 4 set_mon_vals no callback set 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:47:03.915+0000 7f61eeb28800 5 monclient: authenticate success, global_id 6224 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:47:03.916+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:47:03.916+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:47:03.916+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:47:03.916+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:47:03.916+0000 7f61eeb28800 1 librados: init done 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:47:03.916+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command cr dump hook 0x5595bf224788 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:47:03.917+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.005 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:47:03.917+0000 7f60ccff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:04.006 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:47:03.917+0000 7f60ccff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:04.006 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:47:03.918+0000 7f60ccff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:04.006 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:47:03.918+0000 7f61ea06e640 10 monclient: get_auth_request con 0x7f60b4076470 auth_method 0 2024-09-12T00:47:04.006 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:47:03.918+0000 7f61eb070640 10 monclient: get_auth_request con 0x5595bf248030 auth_method 0 2024-09-12T00:47:04.006 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.006 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 realm 2024-09-12T00:47:04.006 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.006 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.006 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:47:03.919+0000 7f61eeb28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:47:03.919+0000 7f61ea86f640 10 monclient: get_auth_request con 0x5595bf24c3a0 auth_method 0 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:47:03.920+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:47:03.920+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:47:03.920+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:47:03.920+0000 7f61eeb28800 20 searching for the correct realm 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:47:03.920+0000 7f61ea06e640 10 monclient: get_auth_request con 0x5595bf251510 auth_method 0 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:47:03.921+0000 7f61eb070640 10 monclient: get_auth_request con 0x7f61e0038ba0 auth_method 0 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:47:03.922+0000 7f61ea86f640 10 monclient: get_auth_request con 0x7f61dc0cf070 auth_method 0 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:47:03.923+0000 7f61ea06e640 10 monclient: get_auth_request con 0x7f61e002a3f0 auth_method 0 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:47:03.924+0000 7f61ea06e640 0 -- 172.21.15.19:0/651621471 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f61e002a3f0 msgr2=0x7f61e002a830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:04.007 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:47:03.924+0000 7f60ccff9640 1 client.6224.objecter ms_handle_reset 0x7f61e002a3f0 session 0x7f61e0041040 osd.5 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:47:03.924+0000 7f60ccff9640 10 monclient: _renew_subs 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:47:03.924+0000 7f60ccff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:47:03.924+0000 7f61ea06e640 10 monclient: get_auth_request con 0x7f60b40867f0 auth_method 0 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:47:03.926+0000 7f61eb070640 10 monclient: get_auth_request con 0x7f61dc06d060 auth_method 0 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:47:03.926+0000 7f61ea86f640 10 monclient: get_auth_request con 0x7f61e4030060 auth_method 0 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:47:03.927+0000 7f61ea86f640 0 -- 172.21.15.19:0/651621471 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f61e4030060 msgr2=0x7f61e4026430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:47:03.927+0000 7f60ccff9640 1 client.6224.objecter ms_handle_reset 0x7f61e4030060 session 0x7f61e4014a20 osd.3 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:47:03.927+0000 7f61ea86f640 10 monclient: get_auth_request con 0x7f61e002a3f0 auth_method 0 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:04.008 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 zone default found 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:47:03.932+0000 7f61eeb28800 4 Realm: () 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:47:03.932+0000 7f61eeb28800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:47:03.932+0000 7f61eeb28800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:47:03.932+0000 7f61eeb28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 zonegroup default 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.009 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:47:03.933+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:47:03.933+0000 7f61eeb28800 20 started sync module instance, tier type = 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:47:03.933+0000 7f61eeb28800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=0 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=1 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=2 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=3 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=4 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=5 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=6 2024-09-12T00:47:04.010 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:47:03.942+0000 7f61eeb28800 20 add_watcher() i=7 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:47:03.942+0000 7f61eeb28800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding auth protocol: cephx 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding auth protocol: cephx 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding auth protocol: cephx 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.011 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:47:03.944+0000 7f60a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:47:03.944+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:47:03.944+0000 7f61eeb28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:47:03.944+0000 7f61eeb28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command cache list hook 0x5595bf23c840 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command cache inspect hook 0x5595bf23c840 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command cache erase hook 0x5595bf23c840 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command cache zap hook 0x5595bf23c840 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 note: GC not initialized 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:47:03.944+0000 7f601bfff640 20 reqs_thread_entry: start 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command sync trace show hook 0x7f61e4013040 2024-09-12T00:47:04.012 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command sync trace history hook 0x7f61e4013040 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command sync trace active hook 0x7f61e4013040 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command sync trace active_short hook 0x7f61e4013040 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:47:03.944+0000 7f61eeb28800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:47:03.944+0000 7f61eeb28800 20 Filter name: none 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:47:03.944+0000 7f6019ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:47:03.944+0000 7f61eeb28800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:47:03.944+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:47:03.945+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 : miss 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:47:03.945+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:47:03.945+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:04.013 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 info.flags=0x17 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to cache LRU end 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:47:03.950+0000 7f61eeb28800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61eeb28800 time 2024-09-12T00:47:03.950600+0000 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f61f038c71a] 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61f038c8d8] 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595bcc40641] 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd878e8) [0x5595bd1528e8] 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5595bcc5031d] 2024-09-12T00:47:04.014 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f61ef029590] 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:47:03.951+0000 7f61eeb28800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f61eeb28800 thread_name:radosgw-admin 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f61ef03e6f0] 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f61ef08b99c] 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f61f038c774] 2024-09-12T00:47:04.015 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61f038c8d8] 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595bcc40641] 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd878e8) [0x5595bd1528e8] 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5595bcc5031d] 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f61ef029590] 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:47:04.016 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:47:04.017 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:47:04.018 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:47:04.019 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:47:04.020 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:47:04.021 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:47:04.022 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6019ffb640 / http_manager 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 7f601bfff640 / http_manager 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60a17e2640 / rgw_dt_lg_renew 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60ccff9640 / ms_dispatch 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60ce7fc640 / io_context_pool 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60d4e01640 / ms_dispatch 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60d7606640 / ms_dispatch 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60d8e09640 / io_context_pool 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 7f61ea06e640 / msgr-worker-2 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 7f61ea86f640 / msgr-worker-1 2024-09-12T00:47:04.023 INFO:tasks.workunit.client.0.smithi019.stderr: 7f61eb070640 / msgr-worker-0 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: 7f61eb871640 / io_context_pool 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: 7f61eeb28800 / radosgw-admin 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.98142.log 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:47:03.899+0000 7f61ea06e640 10 monclient(hunting): handle_auth_done global_id 6212 payload 274 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:47:03.899+0000 7f61ea06e640 10 monclient: _finish_hunting 0 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:47:03.899+0000 7f61ea06e640 1 monclient: found mon.noname-c 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:47:03.899+0000 7f61ea06e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:04.024 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: dump: 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: _finish_auth 0 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: _check_auth_tickets 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:04.025 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:47:03.899+0000 7f60d8e09640 10 monclient: dump: 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:47:03.899+0000 7f61eeb28800 5 monclient: authenticate success, global_id 6212 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:47:03.899+0000 7f61eeb28800 10 monclient: get_monmap_and_config success 2024-09-12T00:47:04.026 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:47:03.899+0000 7f61eeb28800 4 set_mon_vals no callback set 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:47:03.900+0000 7f61eeb28800 10 monclient: shutdown 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 asok(0x5595bef3e630) unregister_commands rotate-key 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:47:03.900+0000 7f61eeb28800 10 monclient: build_initial_monmap 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:47:03.900+0000 7f61eeb28800 1 build_initial for_mkfs: 0 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:47:03.900+0000 7f61eeb28800 10 monclient: monmap: 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding auth protocol: cephx 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding auth protocol: cephx 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding auth protocol: cephx 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:04.028 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: crc 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1630a0) adding con mode: secure 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:47:03.900+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:47:03.900+0000 7f61eeb28800 1 librados: starting msgr at 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:47:03.900+0000 7f61eeb28800 1 librados: starting objecter 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command objecter_requests hook 0x5595bf162d90 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:47:03.900+0000 7f61eeb28800 1 librados: setting wanted keys 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:47:03.900+0000 7f61eeb28800 1 librados: calling monclient init 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:47:03.900+0000 7f61eeb28800 10 monclient: init 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding auth protocol: cephx 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding auth protocol: cephx 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding auth protocol: cephx 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:04.029 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: crc 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:47:03.900+0000 7f61eeb28800 5 AuthRegistry(0x5595bf15d460) adding con mode: secure 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:47:03.901+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:47:03.901+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:47:03.901+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command rotate-key hook 0x5595bf15d5a8 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:04.030 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-c con 0x5595bf015180 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-b con 0x5595bf099710 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-a con 0x5595bf0a3d40 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:47:03.901+0000 7f61eeb28800 10 monclient(hunting): authenticate will time out at 2090.403515s 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): get_auth_request con 0x5595bf015180 auth_method 0 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.031 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): get_auth_request con 0x5595bf0a3d40 auth_method 0 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): get_auth_request con 0x5595bf099710 auth_method 0 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:47:03.901+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.032 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:47:03.901+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient(hunting): handle_auth_done global_id 6215 payload 824 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient: _finish_hunting 0 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:47:03.901+0000 7f61ea86f640 1 monclient: found mon.noname-c 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:47:03.901+0000 7f61ea86f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: dump: 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.033 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: _finish_auth 0 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: _check_auth_tickets 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:47:03.902+0000 7f60d7606640 10 monclient: dump: 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.034 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:47:03.902+0000 7f61eeb28800 5 monclient: authenticate success, global_id 6215 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:47:03.902+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:47:03.902+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:47:03.902+0000 7f60d8e09640 4 set_mon_vals no callback set 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:47:03.902+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:47:03.902+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:47:03.902+0000 7f61eeb28800 1 librados: init done 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:47:03.904+0000 7f60d7606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:04.035 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:47:03.904+0000 7f60d7606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:47:03.904+0000 7f60d7606640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:47:03.904+0000 7f61ea06e640 10 monclient: get_auth_request con 0x7f60d0076470 auth_method 0 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:47:03.905+0000 7f61eb070640 10 monclient: get_auth_request con 0x5595bf186380 auth_method 0 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:47:03.905+0000 7f61ea86f640 10 monclient: get_auth_request con 0x5595bf1a8af0 auth_method 0 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:47:03.907+0000 7f61ea06e640 10 monclient: get_auth_request con 0x5595bf1ae060 auth_method 0 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:47:03.908+0000 7f61eeb28800 10 monclient: build_initial_monmap 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:47:03.908+0000 7f61eeb28800 1 build_initial for_mkfs: 0 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:47:03.908+0000 7f61eeb28800 10 monclient: monmap: 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:04.036 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.037 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:04.037 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:04.037 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:04.037 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.037 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding auth protocol: cephx 2024-09-12T00:47:04.037 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding auth protocol: cephx 2024-09-12T00:47:04.037 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding auth protocol: cephx 2024-09-12T00:47:04.037 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:04.037 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:04.037 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:04.037 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: crc 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b1ee0) adding con mode: secure 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:47:03.908+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command objecter_requests cmddesc objecter_requests hook 0x5595bf1b5410 EEXIST 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:47:03.908+0000 7f61eeb28800 10 monclient: init 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding auth protocol: cephx 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding auth protocol: cephx 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding auth protocol: cephx 2024-09-12T00:47:04.038 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: crc 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:47:03.908+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1b0e78) adding con mode: secure 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:47:03.908+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:47:03.909+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.039 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:47:03.909+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command rotate-key cmddesc rotate-key hook 0x5595bf1b0fc0 EEXIST 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-c con 0x5595bf1d9730 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-b con 0x5595bf1d9b10 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-a con 0x5595bf1d8440 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:47:03.909+0000 7f61eeb28800 10 monclient(hunting): authenticate will time out at 2090.411339s 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): get_auth_request con 0x5595bf1d9730 auth_method 0 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.040 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): get_auth_request con 0x5595bf1d8440 auth_method 0 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:47:03.909+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:47:03.909+0000 7f61ea06e640 10 monclient(hunting): get_auth_request con 0x5595bf1d9b10 auth_method 0 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:47:03.909+0000 7f61ea06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:47:03.909+0000 7f61ea06e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.041 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:47:03.909+0000 7f61ea06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient(hunting): handle_auth_done global_id 6218 payload 824 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient: _finish_hunting 0 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:47:03.909+0000 7f61ea86f640 1 monclient: found mon.noname-c 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:47:03.909+0000 7f61ea86f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:47:03.909+0000 7f60d4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:47:03.909+0000 7f60d4e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:47:03.909+0000 7f60d4e01640 10 monclient: dump: 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.042 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: _finish_auth 0 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: _check_auth_tickets 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:47:03.910+0000 7f60d4e01640 10 monclient: dump: 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.043 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:47:03.910+0000 7f61eeb28800 5 monclient: authenticate success, global_id 6218 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:47:03.910+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:47:03.910+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:47:03.910+0000 7f61eb871640 4 set_mon_vals no callback set 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:47:03.910+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:47:03.910+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:47:03.911+0000 7f60d4e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:04.044 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:47:03.911+0000 7f60d4e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:47:03.911+0000 7f60d4e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:47:03.911+0000 7f61ea06e640 10 monclient: get_auth_request con 0x7f60c4076380 auth_method 0 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:47:03.911+0000 7f61eeb28800 10 monclient: get_monmap_and_config 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:47:03.911+0000 7f61eeb28800 10 monclient: build_initial_monmap 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:47:03.911+0000 7f61eeb28800 1 build_initial for_mkfs: 0 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient: monmap: 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:04.045 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding auth protocol: cephx 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding auth protocol: cephx 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding auth protocol: cephx 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:04.046 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: crc 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1f9190) adding con mode: secure 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:47:03.912+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient: init 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding auth protocol: cephx 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding auth protocol: cephx 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding auth protocol: cephx 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:04.047 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: crc 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ea60) adding con mode: secure 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:47:03.912+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:47:03.912+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:47:03.912+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command rotate-key cmddesc rotate-key hook 0x7fff4a53eba8 EEXIST 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:04.048 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-a con 0x5595bf22d7b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:47:03.912+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-c con 0x5595bf1fe7c0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-b con 0x5595bf228c90 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient(hunting): authenticate will time out at 2090.415027s 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): get_auth_request con 0x5595bf22d7b0 auth_method 0 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): get_auth_request con 0x5595bf1fe7c0 auth_method 0 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.049 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.050 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.050 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.050 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.052 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.052 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): get_auth_request con 0x5595bf228c90 auth_method 0 2024-09-12T00:47:04.052 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.052 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.052 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:47:03.913+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:47:03.913+0000 7f61eb070640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient(hunting): handle_auth_done global_id 6597 payload 274 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient: _finish_hunting 0 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:47:03.913+0000 7f61ea86f640 1 monclient: found mon.noname-a 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:47:03.913+0000 7f61ea86f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: dump: 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.053 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: _finish_auth 0 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:47:03.913+0000 7f61eeb28800 5 monclient: authenticate success, global_id 6597 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:47:03.913+0000 7f61eeb28800 10 monclient: get_monmap_and_config success 2024-09-12T00:47:04.054 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:47:03.913+0000 7f61eeb28800 4 set_mon_vals no callback set 2024-09-12T00:47:04.055 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.055 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:47:04.055 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:47:03.913+0000 7f60ce7fc640 10 monclient: dump: 2024-09-12T00:47:04.055 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.055 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.055 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.055 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.055 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.055 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.055 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.055 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:47:03.914+0000 7f61eeb28800 10 monclient: shutdown 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:47:03.914+0000 7f61eeb28800 10 monclient: build_initial_monmap 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:47:03.914+0000 7f61eeb28800 1 build_initial for_mkfs: 0 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:47:03.914+0000 7f61eeb28800 10 monclient: monmap: 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:04.056 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding auth protocol: cephx 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding auth protocol: cephx 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding auth protocol: cephx 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:04.057 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: crc 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf21f3e0) adding con mode: secure 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:47:03.914+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:47:03.914+0000 7f61eeb28800 1 librados: starting msgr at 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:47:03.914+0000 7f61eeb28800 1 librados: starting objecter 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command objecter_requests cmddesc objecter_requests hook 0x5595bf2273d0 EEXIST 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:47:03.914+0000 7f61eeb28800 1 librados: setting wanted keys 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:47:03.914+0000 7f61eeb28800 1 librados: calling monclient init 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:47:03.914+0000 7f61eeb28800 10 monclient: init 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding auth protocol: cephx 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding auth protocol: cephx 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding auth protocol: cephx 2024-09-12T00:47:04.058 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: crc 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:47:03.914+0000 7f61eeb28800 5 AuthRegistry(0x5595bf1edff0) adding con mode: secure 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:47:03.915+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:47:03.915+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:47:03.915+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command rotate-key cmddesc rotate-key hook 0x5595bf1ee138 EEXIST 2024-09-12T00:47:04.059 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-c con 0x5595bf1fe7c0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-a con 0x5595bf228c90 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): picked mon.noname-b con 0x5595bf22d7b0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:47:03.915+0000 7f61eeb28800 10 monclient(hunting): authenticate will time out at 2090.417350s 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): get_auth_request con 0x5595bf228c90 auth_method 0 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.060 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): get_auth_request con 0x5595bf1fe7c0 auth_method 0 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:47:03.915+0000 7f61ea06e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient(hunting): handle_auth_done global_id 6224 payload 824 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient: _finish_hunting 0 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:47:03.915+0000 7f61ea86f640 1 monclient: found mon.noname-c 2024-09-12T00:47:04.061 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:47:03.915+0000 7f61ea86f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:47:03.915+0000 7f61eb070640 10 monclient: get_auth_request con 0x5595bf22d7b0 auth_method 0 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: dump: 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.062 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: _finish_auth 0 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: _check_auth_tickets 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:47:03.915+0000 7f60ccff9640 10 monclient: dump: 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:04.063 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:47:03.915+0000 7f60ce7fc640 4 set_mon_vals no callback set 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:47:03.915+0000 7f61eeb28800 5 monclient: authenticate success, global_id 6224 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:47:03.916+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:47:03.916+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:47:03.916+0000 7f61eeb28800 10 monclient: _renew_subs 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:47:03.916+0000 7f61eeb28800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:47:03.916+0000 7f61eeb28800 1 librados: init done 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:47:03.916+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command cr dump hook 0x5595bf224788 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:47:03.917+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:47:03.917+0000 7f60ccff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:47:03.917+0000 7f60ccff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:04.064 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:47:03.918+0000 7f60ccff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:47:03.918+0000 7f61ea06e640 10 monclient: get_auth_request con 0x7f60b4076470 auth_method 0 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:47:03.918+0000 7f61eb070640 10 monclient: get_auth_request con 0x5595bf248030 auth_method 0 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 realm 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:47:03.919+0000 7f61eeb28800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:47:03.919+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:47:03.919+0000 7f61ea86f640 10 monclient: get_auth_request con 0x5595bf24c3a0 auth_method 0 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:47:03.920+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:47:03.920+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.065 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:47:03.920+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:47:03.920+0000 7f61eeb28800 20 searching for the correct realm 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:47:03.920+0000 7f61ea06e640 10 monclient: get_auth_request con 0x5595bf251510 auth_method 0 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:47:03.921+0000 7f61eb070640 10 monclient: get_auth_request con 0x7f61e0038ba0 auth_method 0 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:47:03.922+0000 7f61ea86f640 10 monclient: get_auth_request con 0x7f61dc0cf070 auth_method 0 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:47:03.923+0000 7f61ea06e640 10 monclient: get_auth_request con 0x7f61e002a3f0 auth_method 0 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:47:03.924+0000 7f61ea06e640 0 -- 172.21.15.19:0/651621471 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f61e002a3f0 msgr2=0x7f61e002a830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:47:03.924+0000 7f60ccff9640 1 client.6224.objecter ms_handle_reset 0x7f61e002a3f0 session 0x7f61e0041040 osd.5 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:47:03.924+0000 7f60ccff9640 10 monclient: _renew_subs 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:47:03.924+0000 7f60ccff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:47:03.924+0000 7f61ea06e640 10 monclient: get_auth_request con 0x7f60b40867f0 auth_method 0 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:47:03.926+0000 7f61eb070640 10 monclient: get_auth_request con 0x7f61dc06d060 auth_method 0 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:47:03.926+0000 7f61ea86f640 10 monclient: get_auth_request con 0x7f61e4030060 auth_method 0 2024-09-12T00:47:04.066 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:47:03.927+0000 7f61ea86f640 0 -- 172.21.15.19:0/651621471 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f61e4030060 msgr2=0x7f61e4026430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:47:03.927+0000 7f60ccff9640 1 client.6224.objecter ms_handle_reset 0x7f61e4030060 session 0x7f61e4014a20 osd.3 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:47:03.927+0000 7f61ea86f640 10 monclient: get_auth_request con 0x7f61e002a3f0 auth_method 0 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:47:03.931+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:04.067 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 zone default found 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:47:03.932+0000 7f61eeb28800 4 Realm: () 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:47:03.932+0000 7f61eeb28800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:47:03.932+0000 7f61eeb28800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:47:03.932+0000 7f61eeb28800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 zonegroup default 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:47:03.932+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:47:03.933+0000 7f61eeb28800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:47:03.933+0000 7f61eeb28800 20 started sync module instance, tier type = 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:47:03.933+0000 7f61eeb28800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:04.068 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=0 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=1 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=2 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=3 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=4 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=5 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:47:03.941+0000 7f61eeb28800 20 add_watcher() i=6 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:47:03.942+0000 7f61eeb28800 20 add_watcher() i=7 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:47:03.942+0000 7f61eeb28800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding auth protocol: cephx 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding auth protocol: cephx 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding auth protocol: cephx 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.069 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: crc 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 AuthRegistry(0x7fff4a53ef40) adding con mode: secure 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:47:03.944+0000 7f60a17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:47:03.944+0000 7f61eeb28800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:47:03.944+0000 7f61eeb28800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:47:03.944+0000 7f61eeb28800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:04.070 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command cache list hook 0x5595bf23c840 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command cache inspect hook 0x5595bf23c840 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command cache erase hook 0x5595bf23c840 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command cache zap hook 0x5595bf23c840 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 note: GC not initialized 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:47:03.944+0000 7f601bfff640 20 reqs_thread_entry: start 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command sync trace show hook 0x7f61e4013040 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command sync trace history hook 0x7f61e4013040 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command sync trace active hook 0x7f61e4013040 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:47:03.944+0000 7f61eeb28800 5 asok(0x5595bef3e630) register_command sync trace active_short hook 0x7f61e4013040 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:47:03.944+0000 7f61eeb28800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:47:03.944+0000 7f61eeb28800 20 Filter name: none 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:47:03.944+0000 7f6019ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:47:03.944+0000 7f61eeb28800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:47:03.944+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.071 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:47:03.945+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 : miss 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:47:03.945+0000 7f61eeb28800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:47:03.945+0000 7f61eeb28800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 info.flags=0x17 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to cache LRU end 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:47:03.945+0000 7f61eeb28800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:47:03.950+0000 7f61eeb28800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f61eeb28800 time 2024-09-12T00:47:03.950600+0000 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:04.072 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f61f038c71a] 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61f038c8d8] 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595bcc40641] 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd878e8) [0x5595bd1528e8] 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5595bcc5031d] 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f61ef029590] 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:47:03.951+0000 7f61eeb28800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f61eeb28800 thread_name:radosgw-admin 2024-09-12T00:47:04.073 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f61ef03e6f0] 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f61ef08b99c] 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f61f038c774] 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f61f038c8d8] 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5595bcc40641] 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd878e8) [0x5595bd1528e8] 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5595bcc5031d] 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f61ef029590] 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:47:04.074 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:47:04.075 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:47:04.076 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:47:04.077 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:47:04.078 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:47:04.079 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:47:04.080 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6019ffb640 / http_manager 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 7f601bfff640 / http_manager 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60a17e2640 / rgw_dt_lg_renew 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60ccff9640 / ms_dispatch 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60ce7fc640 / io_context_pool 2024-09-12T00:47:04.081 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60d4e01640 / ms_dispatch 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60d7606640 / ms_dispatch 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr: 7f60d8e09640 / io_context_pool 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr: 7f61ea06e640 / msgr-worker-2 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr: 7f61ea86f640 / msgr-worker-1 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr: 7f61eb070640 / msgr-worker-0 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr: 7f61eb871640 / io_context_pool 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr: 7f61eeb28800 / radosgw-admin 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:47:03.952274Z_bfd5e188-9761-488b-9e1c-bb31e7df589d/log 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:47:04.082 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:47:04.084 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:04.084 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:04.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.029+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.031+0000 7f26401af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.031+0000 7f26401af800 20 realm 2024-09-12T00:47:04.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.031+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.031+0000 7f26401af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.031+0000 7f26401af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:04.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.031+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.031+0000 7f26401af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.031+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.032+0000 7f26401af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:04.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.032+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.032+0000 7f26401af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:04.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.032+0000 7f26401af800 20 searching for the correct realm 2024-09-12T00:47:04.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.036+0000 7f263d498640 0 -- 172.21.15.19:0/330577489 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f2628073bc0 msgr2=0x7f262807c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:04.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.241+0000 7f263e49a640 0 -- 172.21.15.19:0/330577489 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55db4a90fff0 msgr2=0x55db4a912460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:04.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.245+0000 7f26401af800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:04.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.245+0000 7f26401af800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:04.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.245+0000 7f26401af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:04.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.245+0000 7f26401af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:04.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.245+0000 7f26401af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:04.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.245+0000 7f26401af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:04.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.245+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.245+0000 7f26401af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.245+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 20 zone default found 2024-09-12T00:47:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 4 Realm: () 2024-09-12T00:47:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 20 zonegroup default 2024-09-12T00:47:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.246+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.247+0000 7f26401af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.247+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.247+0000 7f26401af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.247+0000 7f26401af800 20 started sync module instance, tier type = 2024-09-12T00:47:04.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.247+0000 7f26401af800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:04.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.256+0000 7f26401af800 20 add_watcher() i=0 2024-09-12T00:47:04.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.256+0000 7f26401af800 20 add_watcher() i=1 2024-09-12T00:47:04.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.256+0000 7f26401af800 20 add_watcher() i=2 2024-09-12T00:47:04.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.256+0000 7f26401af800 20 add_watcher() i=3 2024-09-12T00:47:04.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.256+0000 7f26401af800 20 add_watcher() i=4 2024-09-12T00:47:04.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.256+0000 7f26401af800 20 add_watcher() i=5 2024-09-12T00:47:04.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.256+0000 7f26401af800 20 add_watcher() i=6 2024-09-12T00:47:04.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.257+0000 7f26401af800 20 add_watcher() i=7 2024-09-12T00:47:04.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.257+0000 7f26401af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:04.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.259+0000 7f24ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:04.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.259+0000 7f26401af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:04.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.259+0000 7f26401af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:04.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.259+0000 7f26401af800 5 note: GC not initialized 2024-09-12T00:47:04.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.260+0000 7f24ee7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:04.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.260+0000 7f26401af800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:04.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.260+0000 7f26401af800 20 Filter name: none 2024-09-12T00:47:04.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.260+0000 7f245ffff640 20 reqs_thread_entry: start 2024-09-12T00:47:04.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.260+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.260+0000 7f26401af800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.260+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.261+0000 7f26401af800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.261+0000 7f26401af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.261+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.261+0000 7f26401af800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.261+0000 7f26401af800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.261+0000 7f26401af800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.261+0000 7f26401af800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.263+0000 7f24ef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.266+0000 7f26401af800 20 remove_watcher() i=0 2024-09-12T00:47:04.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.266+0000 7f26401af800 2 removed watcher, disabling cache 2024-09-12T00:47:04.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.267+0000 7f26401af800 20 remove_watcher() i=1 2024-09-12T00:47:04.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.268+0000 7f26401af800 20 remove_watcher() i=2 2024-09-12T00:47:04.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.269+0000 7f26401af800 20 remove_watcher() i=3 2024-09-12T00:47:04.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.270+0000 7f26401af800 20 remove_watcher() i=4 2024-09-12T00:47:04.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.271+0000 7f26401af800 20 remove_watcher() i=5 2024-09-12T00:47:04.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.272+0000 7f26401af800 20 remove_watcher() i=6 2024-09-12T00:47:04.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.273+0000 7f26401af800 20 remove_watcher() i=7 2024-09-12T00:47:04.283 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.283 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:04.284 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-set-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:47:04.284 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:04.285 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:04.285 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:04.315 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:04.315 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:04.374 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:47:04.406 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:04.406 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:04.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.447+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.449+0000 7f401fb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.449+0000 7f401fb39800 20 realm 2024-09-12T00:47:04.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.449+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.449+0000 7f401fb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.449+0000 7f401fb39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:04.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.449+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.450+0000 7f401fb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.450+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.450+0000 7f401fb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:04.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.450+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.450+0000 7f401fb39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:04.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.450+0000 7f401fb39800 20 searching for the correct realm 2024-09-12T00:47:04.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.454+0000 7f401bfc8640 0 -- 172.21.15.19:0/3459462224 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7f4010031040 msgr2=0x7f4010021450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:04.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.457+0000 7f401b7c7640 0 -- 172.21.15.19:0/3459462224 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f4014092990 msgr2=0x7f40140847b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:04.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.461+0000 7f401fb39800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:04.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.461+0000 7f401fb39800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:04.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.461+0000 7f401fb39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:04.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.461+0000 7f401fb39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:04.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.461+0000 7f401fb39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:04.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.461+0000 7f401fb39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:04.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.461+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:04.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:04.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 20 zone default found 2024-09-12T00:47:04.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 4 Realm: () 2024-09-12T00:47:04.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:04.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:04.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:04.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 20 zonegroup default 2024-09-12T00:47:04.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.462+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.463+0000 7f401fb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.463+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.463+0000 7f401fb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.463+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.463+0000 7f401fb39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:04.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.463+0000 7f401fb39800 20 started sync module instance, tier type = 2024-09-12T00:47:04.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.463+0000 7f401fb39800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:04.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.472+0000 7f401fb39800 20 add_watcher() i=0 2024-09-12T00:47:04.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.472+0000 7f401fb39800 20 add_watcher() i=1 2024-09-12T00:47:04.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.472+0000 7f401fb39800 20 add_watcher() i=2 2024-09-12T00:47:04.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.472+0000 7f401fb39800 20 add_watcher() i=3 2024-09-12T00:47:04.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.472+0000 7f401fb39800 20 add_watcher() i=4 2024-09-12T00:47:04.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.472+0000 7f401fb39800 20 add_watcher() i=5 2024-09-12T00:47:04.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.472+0000 7f401fb39800 20 add_watcher() i=6 2024-09-12T00:47:04.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.473+0000 7f401fb39800 20 add_watcher() i=7 2024-09-12T00:47:04.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.473+0000 7f401fb39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:04.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.475+0000 7f3ed1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:04.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.475+0000 7f401fb39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:04.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.475+0000 7f401fb39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:04.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.475+0000 7f401fb39800 5 note: GC not initialized 2024-09-12T00:47:04.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.475+0000 7f3ed0fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:04.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.475+0000 7f401fb39800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:04.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.476+0000 7f401fb39800 20 Filter name: none 2024-09-12T00:47:04.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.476+0000 7f3e4a7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:04.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.476+0000 7f401fb39800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:47:04.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.476+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.476+0000 7f401fb39800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:04.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.476+0000 7f401fb39800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:47:04.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.476+0000 7f401fb39800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:47:04.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.476+0000 7f401fb39800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 : miss 2024-09-12T00:47:04.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.476+0000 7f401fb39800 20 rados->read ofs=0 len=0 2024-09-12T00:47:04.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.477+0000 7f401fb39800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:04.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.477+0000 7f401fb39800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 info.flags=0x17 2024-09-12T00:47:04.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.477+0000 7f401fb39800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to cache LRU end 2024-09-12T00:47:04.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.477+0000 7f401fb39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:04.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.477+0000 7f401fb39800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:04.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.477+0000 7f401fb39800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 2024-09-12T00:47:04.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.478+0000 7f401fb39800 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to be held by another RGW process; skipping for now 2024-09-12T00:47:04.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.478+0000 7f3ed1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:04.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.480+0000 7f401fb39800 20 remove_watcher() i=0 2024-09-12T00:47:04.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.480+0000 7f401fb39800 2 removed watcher, disabling cache 2024-09-12T00:47:04.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.481+0000 7f401fb39800 20 remove_watcher() i=1 2024-09-12T00:47:04.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.483+0000 7f401fb39800 20 remove_watcher() i=2 2024-09-12T00:47:04.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.484+0000 7f401fb39800 20 remove_watcher() i=3 2024-09-12T00:47:04.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.485+0000 7f401fb39800 20 remove_watcher() i=4 2024-09-12T00:47:04.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.486+0000 7f401fb39800 20 remove_watcher() i=5 2024-09-12T00:47:04.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.487+0000 7f401fb39800 20 remove_watcher() i=6 2024-09-12T00:47:04.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:04.488+0000 7f401fb39800 20 remove_watcher() i=7 2024-09-12T00:47:04.497 INFO:tasks.workunit.client.0.smithi019.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:47:34.522 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:47:34.558 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:34.558 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:34.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.601+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:34.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.603+0000 7f59dc431800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:34.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.603+0000 7f59dc431800 20 realm 2024-09-12T00:47:34.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.603+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:34.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.603+0000 7f59dc431800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:34.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.603+0000 7f59dc431800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:34.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.603+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:34.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.603+0000 7f59dc431800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:34.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.603+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:34.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.604+0000 7f59dc431800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:34.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.604+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:34.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.604+0000 7f59dc431800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:34.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.604+0000 7f59dc431800 20 searching for the correct realm 2024-09-12T00:47:34.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:34.809+0000 7f59d6f8a640 0 -- 172.21.15.19:0/1356369894 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f59cc0abf20 msgr2=0x7f59cc0ac3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:35.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.015+0000 7f59d7f8c640 0 -- 172.21.15.19:0/1356369894 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55d492133a70 msgr2=0x55d492135e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:35.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.020+0000 7f59dc431800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:35.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.020+0000 7f59dc431800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:35.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.020+0000 7f59dc431800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:35.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.020+0000 7f59dc431800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:35.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.020+0000 7f59dc431800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:35.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.020+0000 7f59dc431800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:35.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.020+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.020+0000 7f59dc431800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:35.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.020+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.021+0000 7f59dc431800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:35.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.021+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.021+0000 7f59dc431800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:35.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.021+0000 7f59dc431800 20 zone default found 2024-09-12T00:47:35.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.021+0000 7f59dc431800 4 Realm: () 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.021+0000 7f59dc431800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.021+0000 7f59dc431800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.021+0000 7f59dc431800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.021+0000 7f59dc431800 20 zonegroup default 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.021+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.022+0000 7f59dc431800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.022+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.022+0000 7f59dc431800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.022+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.022+0000 7f59dc431800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.022+0000 7f59dc431800 20 started sync module instance, tier type = 2024-09-12T00:47:35.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.022+0000 7f59dc431800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:35.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.033+0000 7f59dc431800 20 add_watcher() i=0 2024-09-12T00:47:35.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.033+0000 7f59dc431800 20 add_watcher() i=1 2024-09-12T00:47:35.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.033+0000 7f59dc431800 20 add_watcher() i=2 2024-09-12T00:47:35.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.033+0000 7f59dc431800 20 add_watcher() i=3 2024-09-12T00:47:35.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.033+0000 7f59dc431800 20 add_watcher() i=4 2024-09-12T00:47:35.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.033+0000 7f59dc431800 20 add_watcher() i=5 2024-09-12T00:47:35.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.033+0000 7f59dc431800 20 add_watcher() i=6 2024-09-12T00:47:35.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.034+0000 7f59dc431800 20 add_watcher() i=7 2024-09-12T00:47:35.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.034+0000 7f59dc431800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:35.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.036+0000 7f588dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:35.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.037+0000 7f59dc431800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:35.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.037+0000 7f59dc431800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:35.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.037+0000 7f59dc431800 5 note: GC not initialized 2024-09-12T00:47:35.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.037+0000 7f588cfe1640 20 reqs_thread_entry: start 2024-09-12T00:47:35.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.037+0000 7f59dc431800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:35.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.037+0000 7f59dc431800 20 Filter name: none 2024-09-12T00:47:35.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.037+0000 7f58067fc640 20 reqs_thread_entry: start 2024-09-12T00:47:35.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.037+0000 7f59dc431800 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:47:35.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.037+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.038+0000 7f59dc431800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:35.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.038+0000 7f59dc431800 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:47:35.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.038+0000 7f59dc431800 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:47:35.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.038+0000 7f59dc431800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 : miss 2024-09-12T00:47:35.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.038+0000 7f59dc431800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.038+0000 7f59dc431800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:35.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.038+0000 7f59dc431800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 info.flags=0x17 2024-09-12T00:47:35.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.038+0000 7f59dc431800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to cache LRU end 2024-09-12T00:47:35.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.038+0000 7f59dc431800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:35.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.038+0000 7f59dc431800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:35.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.038+0000 7f59dc431800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 2024-09-12T00:47:35.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.044+0000 7f59dc431800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 info.flags=0x17 2024-09-12T00:47:35.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.044+0000 7f59dc431800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to cache LRU end 2024-09-12T00:47:35.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.044+0000 7f59dc431800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:35.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.044+0000 7f59dc431800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24, ofs0, ns] 2024-09-12T00:47:35.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.044+0000 7f58ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398935 cookie 94371472217552 notifier 6272 bl.length()=925 2024-09-12T00:47:35.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.044+0000 7f58ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 info.flags=0x17 2024-09-12T00:47:35.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.044+0000 7f58ba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to cache LRU end 2024-09-12T00:47:35.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.044+0000 7f58ba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:35.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.046+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): orig_sources= new_sources= 2024-09-12T00:47:35.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.046+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): potential sources added=[] removed=[] 2024-09-12T00:47:35.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.046+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): orig_dests= new_dests= 2024-09-12T00:47:35.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.046+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): potential dests added=[] removed=[] 2024-09-12T00:47:35.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.0 2024-09-12T00:47:35.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.0 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.1 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.1 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.2 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.2 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.3 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.3 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.4 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.4 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.5 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.5 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.6 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.6 2024-09-12T00:47:35.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.7 2024-09-12T00:47:35.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.7 2024-09-12T00:47:35.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.8 2024-09-12T00:47:35.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.8 2024-09-12T00:47:35.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.9 2024-09-12T00:47:35.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.9 2024-09-12T00:47:35.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.10 2024-09-12T00:47:35.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.10 2024-09-12T00:47:35.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.11 2024-09-12T00:47:35.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1.11 2024-09-12T00:47:35.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.051+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.0 2024-09-12T00:47:35.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.052+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1 2024-09-12T00:47:35.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.052+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.2 2024-09-12T00:47:35.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.053+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.3 2024-09-12T00:47:35.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.053+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.4 2024-09-12T00:47:35.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.054+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.5 2024-09-12T00:47:35.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.054+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.6 2024-09-12T00:47:35.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.055+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.7 2024-09-12T00:47:35.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.055+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.8 2024-09-12T00:47:35.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.056+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.9 2024-09-12T00:47:35.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.056+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.10 2024-09-12T00:47:35.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.061+0000 7f59dc431800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:35.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.061+0000 7f59dc431800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 2024-09-12T00:47:35.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.062+0000 7f59dc431800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 info.flags=0x17 2024-09-12T00:47:35.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.062+0000 7f59dc431800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to cache LRU end 2024-09-12T00:47:35.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.062+0000 7f59dc431800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:35.062 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.062+0000 7f59dc431800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24, ofs0, ns] 2024-09-12T00:47:35.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.063+0000 7f58ba7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398936 cookie 94371472217552 notifier 6272 bl.length()=925 2024-09-12T00:47:35.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.063+0000 7f58ba7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 info.flags=0x17 2024-09-12T00:47:35.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.063+0000 7f58ba7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to cache LRU end 2024-09-12T00:47:35.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.063+0000 7f58ba7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:35.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.065+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): orig_sources= new_sources= 2024-09-12T00:47:35.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.065+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): potential sources added=[] removed=[] 2024-09-12T00:47:35.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.065+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): orig_dests= new_dests= 2024-09-12T00:47:35.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.065+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): potential dests added=[] removed=[] 2024-09-12T00:47:35.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.067+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.0 2024-09-12T00:47:35.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.068+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.1 2024-09-12T00:47:35.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.068+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.2 2024-09-12T00:47:35.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.068+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.3 2024-09-12T00:47:35.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.069+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.4 2024-09-12T00:47:35.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.069+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.5 2024-09-12T00:47:35.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.069+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.6 2024-09-12T00:47:35.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.070+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.7 2024-09-12T00:47:35.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.070+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.8 2024-09-12T00:47:35.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.071+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.9 2024-09-12T00:47:35.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.071+0000 7f59dc431800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24.10 2024-09-12T00:47:35.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.071+0000 7f59dc431800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:35.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.071+0000 7f59dc431800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 2024-09-12T00:47:35.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.073+0000 7f59dc431800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 info.flags=0x17 2024-09-12T00:47:35.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.073+0000 7f59dc431800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to cache LRU end 2024-09-12T00:47:35.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.073+0000 7f59dc431800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:35.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.073+0000 7f59dc431800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24, ofs0, ns] 2024-09-12T00:47:35.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.073+0000 7f58baffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398937 cookie 94371472217552 notifier 6272 bl.length()=893 2024-09-12T00:47:35.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.073+0000 7f58baffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 info.flags=0x17 2024-09-12T00:47:35.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.073+0000 7f58baffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 to cache LRU end 2024-09-12T00:47:35.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.073+0000 7f58baffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:35.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.075+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): orig_sources= new_sources= 2024-09-12T00:47:35.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.075+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): potential sources added=[] removed=[] 2024-09-12T00:47:35.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.075+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): orig_dests= new_dests= 2024-09-12T00:47:35.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.075+0000 7f59dc431800 20 handle_bi_update(): bucket=:abort-at-set-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24]): potential dests added=[] removed=[] 2024-09-12T00:47:35.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.078+0000 7f59dc431800 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:47:35.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.080+0000 7f588dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:35.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.083+0000 7f59dc431800 20 remove_watcher() i=0 2024-09-12T00:47:35.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.083+0000 7f59dc431800 2 removed watcher, disabling cache 2024-09-12T00:47:35.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.084+0000 7f59dc431800 20 remove_watcher() i=1 2024-09-12T00:47:35.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.085+0000 7f59dc431800 20 remove_watcher() i=2 2024-09-12T00:47:35.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.086+0000 7f59dc431800 20 remove_watcher() i=3 2024-09-12T00:47:35.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.087+0000 7f59dc431800 20 remove_watcher() i=4 2024-09-12T00:47:35.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.088+0000 7f59dc431800 20 remove_watcher() i=5 2024-09-12T00:47:35.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.089+0000 7f59dc431800 20 remove_watcher() i=6 2024-09-12T00:47:35.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.090+0000 7f59dc431800 20 remove_watcher() i=7 2024-09-12T00:47:35.103 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:47:35.133 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:35.133 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:35.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.174+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.176+0000 7f966592e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:35.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.176+0000 7f966592e800 20 realm 2024-09-12T00:47:35.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.176+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.176+0000 7f966592e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:35.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.176+0000 7f966592e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:35.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.176+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.177+0000 7f966592e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:35.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.177+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.177+0000 7f966592e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:35.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.177+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.178+0000 7f966592e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:35.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.178+0000 7f966592e800 20 searching for the correct realm 2024-09-12T00:47:35.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.180+0000 7f966156b640 0 -- 172.21.15.19:0/1235320696 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f9654098060 msgr2=0x7f9654059050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:35.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.385+0000 7f966156b640 0 -- 172.21.15.19:0/1235320696 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f965c068970 msgr2=0x7f965c0673e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:35.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.594+0000 7f966592e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:35.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.594+0000 7f966592e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:35.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.594+0000 7f966592e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:35.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.594+0000 7f966592e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:35.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.594+0000 7f966592e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:35.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.594+0000 7f966592e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:35.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.594+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.594+0000 7f966592e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:35.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.594+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:35.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:35.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 20 zone default found 2024-09-12T00:47:35.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 4 Realm: () 2024-09-12T00:47:35.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:35.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:35.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:35.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 20 zonegroup default 2024-09-12T00:47:35.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:35.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.595+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.596+0000 7f966592e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:35.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.596+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.596+0000 7f966592e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:35.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.596+0000 7f966592e800 20 started sync module instance, tier type = 2024-09-12T00:47:35.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.596+0000 7f966592e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:35.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.607+0000 7f966592e800 20 add_watcher() i=0 2024-09-12T00:47:35.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.607+0000 7f966592e800 20 add_watcher() i=1 2024-09-12T00:47:35.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.607+0000 7f966592e800 20 add_watcher() i=2 2024-09-12T00:47:35.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.607+0000 7f966592e800 20 add_watcher() i=3 2024-09-12T00:47:35.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.607+0000 7f966592e800 20 add_watcher() i=4 2024-09-12T00:47:35.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.607+0000 7f966592e800 20 add_watcher() i=5 2024-09-12T00:47:35.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.607+0000 7f966592e800 20 add_watcher() i=6 2024-09-12T00:47:35.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.608+0000 7f966592e800 20 add_watcher() i=7 2024-09-12T00:47:35.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.608+0000 7f966592e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:35.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.610+0000 7f95137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:35.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.611+0000 7f966592e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:35.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.611+0000 7f966592e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:35.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.611+0000 7f966592e800 5 note: GC not initialized 2024-09-12T00:47:35.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.611+0000 7f95127e4640 20 reqs_thread_entry: start 2024-09-12T00:47:35.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.611+0000 7f966592e800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:35.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.611+0000 7f966592e800 20 Filter name: none 2024-09-12T00:47:35.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.611+0000 7f9483fff640 20 reqs_thread_entry: start 2024-09-12T00:47:35.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.611+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.612+0000 7f966592e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:35.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.612+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.612+0000 7f966592e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:35.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.612+0000 7f966592e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:35.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.612+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.613+0000 7f966592e800 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:47:35.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.613+0000 7f966592e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:35.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.613+0000 7f966592e800 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:47:35.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.613+0000 7f966592e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:35.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.615+0000 7f95137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:35.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.618+0000 7f966592e800 20 remove_watcher() i=0 2024-09-12T00:47:35.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.618+0000 7f966592e800 2 removed watcher, disabling cache 2024-09-12T00:47:35.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.619+0000 7f966592e800 20 remove_watcher() i=1 2024-09-12T00:47:35.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.620+0000 7f966592e800 20 remove_watcher() i=2 2024-09-12T00:47:35.621 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.621+0000 7f966592e800 20 remove_watcher() i=3 2024-09-12T00:47:35.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.622+0000 7f966592e800 20 remove_watcher() i=4 2024-09-12T00:47:35.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.623+0000 7f966592e800 20 remove_watcher() i=5 2024-09-12T00:47:35.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.625+0000 7f966592e800 20 remove_watcher() i=6 2024-09-12T00:47:35.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:35.626+0000 7f966592e800 20 remove_watcher() i=7 2024-09-12T00:47:35.638 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:35.638 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:35.638 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-set-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:47:35.638 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:35.640 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:35.640 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:35.661 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:35.662 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:35.850 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:35.850 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:35.989 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:47:35.990 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:35.990 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:35.990 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.039 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.039 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.096 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.096 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.133 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.133 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.167 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.167 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.201 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.201 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.234 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.235 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.269 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.269 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.302 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.302 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.339 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.339 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.373 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.373 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.408 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.408 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.443 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.443 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.478 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.478 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.519 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.519 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.554 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.554 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.588 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.588 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.655 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.655 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.689 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.689 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.722 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.722 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.755 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.755 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.789 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:36.789 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:36.823 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:47:36.853 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:36.853 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:36.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.892+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.893+0000 7fc654919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:36.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.893+0000 7fc654919800 20 realm 2024-09-12T00:47:36.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.893+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.894+0000 7fc654919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:36.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.894+0000 7fc654919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:36.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.894+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.894+0000 7fc654919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:36.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.894+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.894+0000 7fc654919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:36.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.895+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.895+0000 7fc654919800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:36.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.895+0000 7fc654919800 20 searching for the correct realm 2024-09-12T00:47:36.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.898+0000 7fc651c09640 0 -- 172.21.15.19:0/3367382224 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc63c049950 msgr2=0x7fc63c0678f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:36.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.902+0000 7fc65240a640 0 -- 172.21.15.19:0/3367382224 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fc64c0363f0 msgr2=0x7fc64c036850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:36.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.906+0000 7fc654919800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:36.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.906+0000 7fc654919800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:36.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.906+0000 7fc654919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:36.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.906+0000 7fc654919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:36.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.906+0000 7fc654919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:36.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.906+0000 7fc654919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:36.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.906+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.906+0000 7fc654919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:36.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.906+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:36.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 20 zone default found 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 4 Realm: () 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 20 zonegroup default 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.907+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.908+0000 7fc654919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.908+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.908+0000 7fc654919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:36.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.908+0000 7fc654919800 20 started sync module instance, tier type = 2024-09-12T00:47:36.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.908+0000 7fc654919800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:36.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.916+0000 7fc654919800 20 add_watcher() i=0 2024-09-12T00:47:36.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.916+0000 7fc654919800 20 add_watcher() i=1 2024-09-12T00:47:36.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.916+0000 7fc654919800 20 add_watcher() i=2 2024-09-12T00:47:36.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.916+0000 7fc654919800 20 add_watcher() i=3 2024-09-12T00:47:36.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.916+0000 7fc654919800 20 add_watcher() i=4 2024-09-12T00:47:36.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.916+0000 7fc654919800 20 add_watcher() i=5 2024-09-12T00:47:36.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.916+0000 7fc654919800 20 add_watcher() i=6 2024-09-12T00:47:36.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.917+0000 7fc654919800 20 add_watcher() i=7 2024-09-12T00:47:36.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.917+0000 7fc654919800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:36.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.919+0000 7fc508fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:36.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.919+0000 7fc654919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:36.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.919+0000 7fc654919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:36.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.919+0000 7fc654919800 5 note: GC not initialized 2024-09-12T00:47:36.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.919+0000 7fc4837fe640 20 reqs_thread_entry: start 2024-09-12T00:47:36.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.919+0000 7fc654919800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:36.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.919+0000 7fc654919800 20 Filter name: none 2024-09-12T00:47:36.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.920+0000 7fc4817fa640 20 reqs_thread_entry: start 2024-09-12T00:47:36.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.920+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.920+0000 7fc654919800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:36.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.920+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.921+0000 7fc654919800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:36.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.921+0000 7fc654919800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:36.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.921+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.921+0000 7fc654919800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:36.922 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.921+0000 7fc654919800 20 rados->read ofs=0 len=0 2024-09-12T00:47:36.922 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.921+0000 7fc654919800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:36.922 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.921+0000 7fc654919800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:36.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.923+0000 7fc508fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:36.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.925+0000 7fc654919800 20 remove_watcher() i=0 2024-09-12T00:47:36.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.925+0000 7fc654919800 2 removed watcher, disabling cache 2024-09-12T00:47:36.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.926+0000 7fc654919800 20 remove_watcher() i=1 2024-09-12T00:47:36.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.927+0000 7fc654919800 20 remove_watcher() i=2 2024-09-12T00:47:36.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.928+0000 7fc654919800 20 remove_watcher() i=3 2024-09-12T00:47:36.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.929+0000 7fc654919800 20 remove_watcher() i=4 2024-09-12T00:47:36.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.930+0000 7fc654919800 20 remove_watcher() i=5 2024-09-12T00:47:36.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.931+0000 7fc654919800 20 remove_watcher() i=6 2024-09-12T00:47:36.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:36.932+0000 7fc654919800 20 remove_watcher() i=7 2024-09-12T00:47:36.943 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:36.943 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:36.943 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-trim-reshard-log-entries id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:47:36.943 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:36.945 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:47:36.979 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:36.979 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:37.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.019+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.021+0000 7f398df42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.021+0000 7f398df42800 20 realm 2024-09-12T00:47:37.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.021+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.021+0000 7f398df42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.021+0000 7f398df42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:37.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.021+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.021+0000 7f398df42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.021+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.022+0000 7f398df42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:37.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.022+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.022+0000 7f398df42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:37.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.022+0000 7f398df42800 20 searching for the correct realm 2024-09-12T00:47:37.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.026+0000 7f3989c86640 0 -- 172.21.15.19:0/3153069001 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f397c015040 msgr2=0x7f397c06b990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:37.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.030+0000 7f3989c86640 0 -- 172.21.15.19:0/3153069001 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55df1f8a69a0 msgr2=0x55df1f8a8db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:37.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.037+0000 7f398df42800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:37.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.037+0000 7f398df42800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:37.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.037+0000 7f398df42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:37.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.037+0000 7f398df42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:37.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.037+0000 7f398df42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:37.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.037+0000 7f398df42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:37.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.037+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.037+0000 7f398df42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.037+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 20 zone default found 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 4 Realm: () 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 20 zonegroup default 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.038+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.039+0000 7f398df42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.039+0000 7f398df42800 20 started sync module instance, tier type = 2024-09-12T00:47:37.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.039+0000 7f398df42800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:37.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.047+0000 7f398df42800 20 add_watcher() i=0 2024-09-12T00:47:37.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.047+0000 7f398df42800 20 add_watcher() i=1 2024-09-12T00:47:37.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.047+0000 7f398df42800 20 add_watcher() i=2 2024-09-12T00:47:37.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.047+0000 7f398df42800 20 add_watcher() i=3 2024-09-12T00:47:37.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.047+0000 7f398df42800 20 add_watcher() i=4 2024-09-12T00:47:37.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.047+0000 7f398df42800 20 add_watcher() i=5 2024-09-12T00:47:37.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.047+0000 7f398df42800 20 add_watcher() i=6 2024-09-12T00:47:37.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.048+0000 7f398df42800 20 add_watcher() i=7 2024-09-12T00:47:37.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.048+0000 7f398df42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:37.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.050+0000 7f383b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:37.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.050+0000 7f398df42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:37.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.050+0000 7f398df42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:37.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.050+0000 7f398df42800 5 note: GC not initialized 2024-09-12T00:47:37.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.050+0000 7f383a7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:37.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.051+0000 7f398df42800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:37.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.051+0000 7f398df42800 20 Filter name: none 2024-09-12T00:47:37.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.051+0000 7f37abfff640 20 reqs_thread_entry: start 2024-09-12T00:47:37.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.051+0000 7f398df42800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:47:37.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.051+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.051+0000 7f398df42800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:37.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.051+0000 7f398df42800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:47:37.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.051+0000 7f398df42800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:47:37.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.051+0000 7f398df42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 : miss 2024-09-12T00:47:37.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.051+0000 7f398df42800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.052+0000 7f398df42800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:37.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.052+0000 7f398df42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 info.flags=0x17 2024-09-12T00:47:37.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.052+0000 7f398df42800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 to cache LRU end 2024-09-12T00:47:37.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.052+0000 7f398df42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:37.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.052+0000 7f398df42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:37.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.052+0000 7f398df42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 2024-09-12T00:47:37.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.057+0000 7f398df42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 info.flags=0x17 2024-09-12T00:47:37.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.057+0000 7f398df42800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 to cache LRU end 2024-09-12T00:47:37.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.057+0000 7f398df42800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:37.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.057+0000 7f398df42800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25, ofs0, ns] 2024-09-12T00:47:37.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.057+0000 7f386d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398940 cookie 94416795284176 notifier 6320 bl.length()=939 2024-09-12T00:47:37.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.057+0000 7f386d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 info.flags=0x17 2024-09-12T00:47:37.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.057+0000 7f386d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 to cache LRU end 2024-09-12T00:47:37.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.057+0000 7f386d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:37.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.060+0000 7f398df42800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): orig_sources= new_sources= 2024-09-12T00:47:37.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.060+0000 7f398df42800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): potential sources added=[] removed=[] 2024-09-12T00:47:37.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.060+0000 7f398df42800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): orig_dests= new_dests= 2024-09-12T00:47:37.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.060+0000 7f398df42800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): potential dests added=[] removed=[] 2024-09-12T00:47:37.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.060+0000 7f398df42800 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:47:37.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.060+0000 7f398df42800 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:47:37.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.062+0000 7f383b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:37.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.064+0000 7f398df42800 20 remove_watcher() i=0 2024-09-12T00:47:37.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.064+0000 7f398df42800 2 removed watcher, disabling cache 2024-09-12T00:47:37.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.065+0000 7f398df42800 20 remove_watcher() i=1 2024-09-12T00:47:37.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.066+0000 7f398df42800 20 remove_watcher() i=2 2024-09-12T00:47:37.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.067+0000 7f398df42800 20 remove_watcher() i=3 2024-09-12T00:47:37.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.068+0000 7f398df42800 20 remove_watcher() i=4 2024-09-12T00:47:37.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.069+0000 7f398df42800 20 remove_watcher() i=5 2024-09-12T00:47:37.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.070+0000 7f398df42800 20 remove_watcher() i=6 2024-09-12T00:47:37.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.071+0000 7f398df42800 20 remove_watcher() i=7 2024-09-12T00:47:37.084 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:47:37.113 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:37.114 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:37.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.153+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.155+0000 7f534af21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.155+0000 7f534af21800 20 realm 2024-09-12T00:47:37.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.155+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.155+0000 7f534af21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.155+0000 7f534af21800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:37.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.155+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.155+0000 7f534af21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.155+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.156+0000 7f534af21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:37.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.156+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.156+0000 7f534af21800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:37.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.156+0000 7f534af21800 20 searching for the correct realm 2024-09-12T00:47:37.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.158+0000 7f5346c0c640 0 -- 172.21.15.19:0/724403101 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55a976478380 msgr2=0x55a97647a770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:37.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.161+0000 7f534740d640 0 -- 172.21.15.19:0/724403101 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x55a976478380 msgr2=0x7f53380300b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:37.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.368+0000 7f534af21800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:37.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.368+0000 7f534af21800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:37.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.368+0000 7f534af21800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:37.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.368+0000 7f534af21800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:37.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.368+0000 7f534af21800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:37.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.368+0000 7f534af21800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:37.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.368+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.368+0000 7f534af21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.368+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.368+0000 7f534af21800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:37.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.368+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:37.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 20 zone default found 2024-09-12T00:47:37.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 4 Realm: () 2024-09-12T00:47:37.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:37.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:37.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:37.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 20 zonegroup default 2024-09-12T00:47:37.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.369+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.370+0000 7f534af21800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.370+0000 7f534af21800 20 started sync module instance, tier type = 2024-09-12T00:47:37.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.370+0000 7f534af21800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:37.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.379+0000 7f534af21800 20 add_watcher() i=0 2024-09-12T00:47:37.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.379+0000 7f534af21800 20 add_watcher() i=1 2024-09-12T00:47:37.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.379+0000 7f534af21800 20 add_watcher() i=2 2024-09-12T00:47:37.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.379+0000 7f534af21800 20 add_watcher() i=3 2024-09-12T00:47:37.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.379+0000 7f534af21800 20 add_watcher() i=4 2024-09-12T00:47:37.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.379+0000 7f534af21800 20 add_watcher() i=5 2024-09-12T00:47:37.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.379+0000 7f534af21800 20 add_watcher() i=6 2024-09-12T00:47:37.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.380+0000 7f534af21800 20 add_watcher() i=7 2024-09-12T00:47:37.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.380+0000 7f534af21800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:37.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.382+0000 7f51fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:37.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.382+0000 7f534af21800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:37.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.382+0000 7f534af21800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:37.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.382+0000 7f534af21800 5 note: GC not initialized 2024-09-12T00:47:37.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.382+0000 7f5177fff640 20 reqs_thread_entry: start 2024-09-12T00:47:37.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.382+0000 7f534af21800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:37.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.382+0000 7f534af21800 20 Filter name: none 2024-09-12T00:47:37.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.383+0000 7f5175ffb640 20 reqs_thread_entry: start 2024-09-12T00:47:37.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.383+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.383+0000 7f534af21800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:37.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.383+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.383+0000 7f534af21800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:47:37.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.384+0000 7f534af21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:37.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.384+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.384+0000 7f534af21800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:37.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.384+0000 7f534af21800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.384+0000 7f534af21800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:47:37.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.384+0000 7f534af21800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:37.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.386+0000 7f51fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:37.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.388+0000 7f534af21800 20 remove_watcher() i=0 2024-09-12T00:47:37.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.388+0000 7f534af21800 2 removed watcher, disabling cache 2024-09-12T00:47:37.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.389+0000 7f534af21800 20 remove_watcher() i=1 2024-09-12T00:47:37.390 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.391+0000 7f534af21800 20 remove_watcher() i=2 2024-09-12T00:47:37.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.392+0000 7f534af21800 20 remove_watcher() i=3 2024-09-12T00:47:37.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.393+0000 7f534af21800 20 remove_watcher() i=4 2024-09-12T00:47:37.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.394+0000 7f534af21800 20 remove_watcher() i=5 2024-09-12T00:47:37.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.395+0000 7f534af21800 20 remove_watcher() i=6 2024-09-12T00:47:37.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.396+0000 7f534af21800 20 remove_watcher() i=7 2024-09-12T00:47:37.406 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:37.407 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:37.407 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-trim-reshard-log-entries id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:47:37.407 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:37.409 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:37.410 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:37.441 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:37.441 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:37.499 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:47:37.531 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:37.532 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:37.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.571+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.572+0000 7f1470230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.572+0000 7f1470230800 20 realm 2024-09-12T00:47:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.572+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.572+0000 7f1470230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.572+0000 7f1470230800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.572+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.573+0000 7f1470230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.573+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.573+0000 7f1470230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:37.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.573+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.574+0000 7f1470230800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:37.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.574+0000 7f1470230800 20 searching for the correct realm 2024-09-12T00:47:37.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.577+0000 7f1463fff640 0 -- 172.21.15.19:0/1889475995 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f1454086b50 msgr2=0x7f1454096350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:37.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.782+0000 7f146bdcd640 0 -- 172.21.15.19:0/1889475995 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5599bfa890f0 msgr2=0x5599bfa8b560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:37.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.786+0000 7f1470230800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:37.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.786+0000 7f1470230800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:37.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.786+0000 7f1470230800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:37.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.786+0000 7f1470230800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:37.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.786+0000 7f1470230800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:37.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.786+0000 7f1470230800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:37.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.786+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.786+0000 7f1470230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.786+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:37.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:37.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 20 zone default found 2024-09-12T00:47:37.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 4 Realm: () 2024-09-12T00:47:37.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:37.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:37.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:37.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 20 zonegroup default 2024-09-12T00:47:37.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.787+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.788+0000 7f1470230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.788+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.788+0000 7f1470230800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.788+0000 7f1470230800 20 started sync module instance, tier type = 2024-09-12T00:47:37.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.788+0000 7f1470230800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:37.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.797+0000 7f1470230800 20 add_watcher() i=0 2024-09-12T00:47:37.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.797+0000 7f1470230800 20 add_watcher() i=1 2024-09-12T00:47:37.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.797+0000 7f1470230800 20 add_watcher() i=2 2024-09-12T00:47:37.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.797+0000 7f1470230800 20 add_watcher() i=3 2024-09-12T00:47:37.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.797+0000 7f1470230800 20 add_watcher() i=4 2024-09-12T00:47:37.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.797+0000 7f1470230800 20 add_watcher() i=5 2024-09-12T00:47:37.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.797+0000 7f1470230800 20 add_watcher() i=6 2024-09-12T00:47:37.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.798+0000 7f1470230800 20 add_watcher() i=7 2024-09-12T00:47:37.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.798+0000 7f1470230800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:37.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.800+0000 7f1321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:37.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.800+0000 7f1470230800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:37.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.800+0000 7f1470230800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:37.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.800+0000 7f1470230800 5 note: GC not initialized 2024-09-12T00:47:37.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.800+0000 7f1320fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:37.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.800+0000 7f1470230800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:37.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.800+0000 7f1470230800 20 Filter name: none 2024-09-12T00:47:37.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f129a7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:37.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:47:37.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:37.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:47:37.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:47:37.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 : miss 2024-09-12T00:47:37.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:47:37.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 info.flags=0x17 2024-09-12T00:47:37.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 to cache LRU end 2024-09-12T00:47:37.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:37.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:37.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.801+0000 7f1470230800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 2024-09-12T00:47:37.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.803+0000 7f1470230800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:47:37.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.812+0000 7f1470230800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 info.flags=0x17 2024-09-12T00:47:37.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.812+0000 7f1470230800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 to cache LRU end 2024-09-12T00:47:37.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.812+0000 7f1470230800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:37.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.812+0000 7f1470230800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25, ofs0, ns] 2024-09-12T00:47:37.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.812+0000 7f134e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398941 cookie 94118833920976 notifier 6353 bl.length()=939 2024-09-12T00:47:37.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.813+0000 7f134e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 info.flags=0x17 2024-09-12T00:47:37.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.813+0000 7f134e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 to cache LRU end 2024-09-12T00:47:37.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.813+0000 7f134e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:37.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.814+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): orig_sources= new_sources= 2024-09-12T00:47:37.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.814+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): potential sources added=[] removed=[] 2024-09-12T00:47:37.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.814+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): orig_dests= new_dests= 2024-09-12T00:47:37.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.814+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): potential dests added=[] removed=[] 2024-09-12T00:47:37.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.0 2024-09-12T00:47:37.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.0 2024-09-12T00:47:37.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.1 2024-09-12T00:47:37.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.1 2024-09-12T00:47:37.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.2 2024-09-12T00:47:37.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.2 2024-09-12T00:47:37.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.3 2024-09-12T00:47:37.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.3 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.4 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.4 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.5 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.5 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.6 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.6 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.7 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.7 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.8 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.8 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.9 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.9 2024-09-12T00:47:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.10 2024-09-12T00:47:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.10 2024-09-12T00:47:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.11 2024-09-12T00:47:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2.11 2024-09-12T00:47:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.0 2024-09-12T00:47:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.819+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.1 2024-09-12T00:47:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.820+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2 2024-09-12T00:47:37.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.821+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.3 2024-09-12T00:47:37.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.821+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.4 2024-09-12T00:47:37.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.821+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.5 2024-09-12T00:47:37.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.822+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.6 2024-09-12T00:47:37.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.823+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.7 2024-09-12T00:47:37.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.823+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.8 2024-09-12T00:47:37.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.824+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.9 2024-09-12T00:47:37.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.824+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.10 2024-09-12T00:47:37.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.828+0000 7f1470230800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:37.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.828+0000 7f1470230800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 2024-09-12T00:47:37.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.829+0000 7f1470230800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 info.flags=0x17 2024-09-12T00:47:37.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.829+0000 7f1470230800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 to cache LRU end 2024-09-12T00:47:37.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.829+0000 7f1470230800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:37.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.829+0000 7f1470230800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25, ofs0, ns] 2024-09-12T00:47:37.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.830+0000 7f134effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398942 cookie 94118833920976 notifier 6353 bl.length()=939 2024-09-12T00:47:37.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.830+0000 7f134effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 info.flags=0x17 2024-09-12T00:47:37.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.830+0000 7f134effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 to cache LRU end 2024-09-12T00:47:37.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.830+0000 7f134effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:37.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.832+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): orig_sources= new_sources= 2024-09-12T00:47:37.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.832+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): potential sources added=[] removed=[] 2024-09-12T00:47:37.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.832+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): orig_dests= new_dests= 2024-09-12T00:47:37.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.832+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): potential dests added=[] removed=[] 2024-09-12T00:47:37.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.834+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.0 2024-09-12T00:47:37.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.834+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.1 2024-09-12T00:47:37.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.835+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.2 2024-09-12T00:47:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.835+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.3 2024-09-12T00:47:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.836+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.4 2024-09-12T00:47:37.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.836+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.5 2024-09-12T00:47:37.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.837+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.6 2024-09-12T00:47:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.837+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.7 2024-09-12T00:47:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.837+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.8 2024-09-12T00:47:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.838+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.9 2024-09-12T00:47:37.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.838+0000 7f1470230800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25.10 2024-09-12T00:47:37.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.839+0000 7f1470230800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:37.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.839+0000 7f1470230800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 2024-09-12T00:47:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.840+0000 7f1470230800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 info.flags=0x17 2024-09-12T00:47:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.840+0000 7f1470230800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 to cache LRU end 2024-09-12T00:47:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.840+0000 7f1470230800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.840+0000 7f1470230800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25, ofs0, ns] 2024-09-12T00:47:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.840+0000 7f134e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398943 cookie 94118833920976 notifier 6353 bl.length()=907 2024-09-12T00:47:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.840+0000 7f134e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 info.flags=0x17 2024-09-12T00:47:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.840+0000 7f134e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 to cache LRU end 2024-09-12T00:47:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.840+0000 7f134e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:37.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.842+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): orig_sources= new_sources= 2024-09-12T00:47:37.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.842+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): potential sources added=[] removed=[] 2024-09-12T00:47:37.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.842+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): orig_dests= new_dests= 2024-09-12T00:47:37.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.842+0000 7f1470230800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25]): potential dests added=[] removed=[] 2024-09-12T00:47:37.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.844+0000 7f1470230800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:47:37.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.846+0000 7f1321fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:37.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.849+0000 7f1470230800 20 remove_watcher() i=0 2024-09-12T00:47:37.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.849+0000 7f1470230800 2 removed watcher, disabling cache 2024-09-12T00:47:37.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.850+0000 7f1470230800 20 remove_watcher() i=1 2024-09-12T00:47:37.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.851+0000 7f1470230800 20 remove_watcher() i=2 2024-09-12T00:47:37.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.852+0000 7f1470230800 20 remove_watcher() i=3 2024-09-12T00:47:37.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.853+0000 7f1470230800 20 remove_watcher() i=4 2024-09-12T00:47:37.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.854+0000 7f1470230800 20 remove_watcher() i=5 2024-09-12T00:47:37.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.855+0000 7f1470230800 20 remove_watcher() i=6 2024-09-12T00:47:37.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.856+0000 7f1470230800 20 remove_watcher() i=7 2024-09-12T00:47:37.868 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:47:37.897 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:37.898 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:37.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.939+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.940+0000 7fa380735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.940+0000 7fa380735800 20 realm 2024-09-12T00:47:37.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.940+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.940+0000 7fa380735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.940+0000 7fa380735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:37.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.940+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.940+0000 7fa380735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.940+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.941+0000 7fa380735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:37.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.941+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.942+0000 7fa380735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:37.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.942+0000 7fa380735800 20 searching for the correct realm 2024-09-12T00:47:37.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.945+0000 7fa37bbc2640 0 -- 172.21.15.19:0/1439382663 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fa370063070 msgr2=0x7fa370063960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:37.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.949+0000 7fa37cbc4640 0 -- 172.21.15.19:0/1439382663 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55c75bd594a0 msgr2=0x55c75bd5b8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:37.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.953+0000 7fa380735800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:37.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.953+0000 7fa380735800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:37.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.953+0000 7fa380735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:37.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.953+0000 7fa380735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:37.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.953+0000 7fa380735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:37.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.953+0000 7fa380735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:37.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.953+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.953+0000 7fa380735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.953+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:37.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:37.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 20 zone default found 2024-09-12T00:47:37.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 4 Realm: () 2024-09-12T00:47:37.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:37.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:37.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:37.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 20 zonegroup default 2024-09-12T00:47:37.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.954+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.955+0000 7fa380735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:37.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.955+0000 7fa380735800 20 started sync module instance, tier type = 2024-09-12T00:47:37.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.955+0000 7fa380735800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:37.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.963+0000 7fa380735800 20 add_watcher() i=0 2024-09-12T00:47:37.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.963+0000 7fa380735800 20 add_watcher() i=1 2024-09-12T00:47:37.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.963+0000 7fa380735800 20 add_watcher() i=2 2024-09-12T00:47:37.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.963+0000 7fa380735800 20 add_watcher() i=3 2024-09-12T00:47:37.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.963+0000 7fa380735800 20 add_watcher() i=4 2024-09-12T00:47:37.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.963+0000 7fa380735800 20 add_watcher() i=5 2024-09-12T00:47:37.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.963+0000 7fa380735800 20 add_watcher() i=6 2024-09-12T00:47:37.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.964+0000 7fa380735800 20 add_watcher() i=7 2024-09-12T00:47:37.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.964+0000 7fa380735800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:37.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.966+0000 7fa232fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:37.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.966+0000 7fa380735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:37.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.966+0000 7fa380735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:37.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.966+0000 7fa380735800 5 note: GC not initialized 2024-09-12T00:47:37.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.966+0000 7fa231fdb640 20 reqs_thread_entry: start 2024-09-12T00:47:37.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.966+0000 7fa380735800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:37.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.967+0000 7fa380735800 20 Filter name: none 2024-09-12T00:47:37.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.967+0000 7fa1a37fe640 20 reqs_thread_entry: start 2024-09-12T00:47:37.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.967+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.967+0000 7fa380735800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:37.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.967+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.968+0000 7fa380735800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:37.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.968+0000 7fa380735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:37.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.968+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.968+0000 7fa380735800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:37.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.968+0000 7fa380735800 20 rados->read ofs=0 len=0 2024-09-12T00:47:37.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.968+0000 7fa380735800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:37.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.968+0000 7fa380735800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:37.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.970+0000 7fa232fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:37.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.972+0000 7fa380735800 20 remove_watcher() i=0 2024-09-12T00:47:37.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.972+0000 7fa380735800 2 removed watcher, disabling cache 2024-09-12T00:47:37.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.973+0000 7fa380735800 20 remove_watcher() i=1 2024-09-12T00:47:37.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.975+0000 7fa380735800 20 remove_watcher() i=2 2024-09-12T00:47:37.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.976+0000 7fa380735800 20 remove_watcher() i=3 2024-09-12T00:47:37.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.976+0000 7fa380735800 20 remove_watcher() i=4 2024-09-12T00:47:37.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.978+0000 7fa380735800 20 remove_watcher() i=5 2024-09-12T00:47:37.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.979+0000 7fa380735800 20 remove_watcher() i=6 2024-09-12T00:47:37.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:37.980+0000 7fa380735800 20 remove_watcher() i=7 2024-09-12T00:47:37.990 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:37.990 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:37.991 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-trim-reshard-log-entries id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:47:37.991 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:37.993 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:37.993 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.014 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.014 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.203 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.203 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.343 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:47:38.344 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:38.344 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.344 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.392 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.393 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.449 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.449 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.483 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.483 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.518 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.518 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.551 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.552 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.585 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.586 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.620 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.620 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.655 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.656 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.689 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.689 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.725 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.725 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.758 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.759 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.794 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.794 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.827 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.828 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.861 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.862 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.896 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.896 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.930 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.930 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.965 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.965 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:38.999 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:38.999 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:39.033 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:39.033 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:39.067 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:39.067 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:39.101 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:39.101 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:39.136 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:47:39.165 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:39.165 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:39.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.204+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.206+0000 7fd20172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.206+0000 7fd20172c800 20 realm 2024-09-12T00:47:39.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.206+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.206+0000 7fd20172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.206+0000 7fd20172c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:39.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.206+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.206+0000 7fd20172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.206+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.207+0000 7fd20172c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:39.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.207+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.207+0000 7fd20172c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:39.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.207+0000 7fd20172c800 20 searching for the correct realm 2024-09-12T00:47:39.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.210+0000 7fd1fccd9640 0 -- 172.21.15.19:0/2148220650 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fd1f400b040 msgr2=0x7fd1f402d410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:39.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.415+0000 7fd1fdcdb640 0 -- 172.21.15.19:0/2148220650 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55aee0c8cc30 msgr2=0x55aee0c8f0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:39.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.419+0000 7fd20172c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:39.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.419+0000 7fd20172c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:39.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.419+0000 7fd20172c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:39.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.419+0000 7fd20172c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:39.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.419+0000 7fd20172c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:39.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.419+0000 7fd20172c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:39.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 20 zone default found 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 4 Realm: () 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 20 zonegroup default 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.420+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.421+0000 7fd20172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.421+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.421+0000 7fd20172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.421+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.421+0000 7fd20172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.421+0000 7fd20172c800 20 started sync module instance, tier type = 2024-09-12T00:47:39.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.421+0000 7fd20172c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:39.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.430+0000 7fd20172c800 20 add_watcher() i=0 2024-09-12T00:47:39.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.430+0000 7fd20172c800 20 add_watcher() i=1 2024-09-12T00:47:39.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.430+0000 7fd20172c800 20 add_watcher() i=2 2024-09-12T00:47:39.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.430+0000 7fd20172c800 20 add_watcher() i=3 2024-09-12T00:47:39.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.430+0000 7fd20172c800 20 add_watcher() i=4 2024-09-12T00:47:39.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.430+0000 7fd20172c800 20 add_watcher() i=5 2024-09-12T00:47:39.430 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.430+0000 7fd20172c800 20 add_watcher() i=6 2024-09-12T00:47:39.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.431+0000 7fd20172c800 20 add_watcher() i=7 2024-09-12T00:47:39.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.431+0000 7fd20172c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:39.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.433+0000 7fd0b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:39.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.434+0000 7fd20172c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:39.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.434+0000 7fd20172c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:39.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.434+0000 7fd20172c800 5 note: GC not initialized 2024-09-12T00:47:39.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.434+0000 7fd0b27e4640 20 reqs_thread_entry: start 2024-09-12T00:47:39.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.434+0000 7fd20172c800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:39.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.434+0000 7fd20172c800 20 Filter name: none 2024-09-12T00:47:39.434 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.434+0000 7fd023fff640 20 reqs_thread_entry: start 2024-09-12T00:47:39.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.434+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.435+0000 7fd20172c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:39.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.435+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.436+0000 7fd20172c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:39.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.436+0000 7fd20172c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:39.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.436+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.436+0000 7fd20172c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:39.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.436+0000 7fd20172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.436+0000 7fd20172c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:39.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.436+0000 7fd20172c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:39.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.438+0000 7fd0b37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:39.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.441+0000 7fd20172c800 20 remove_watcher() i=0 2024-09-12T00:47:39.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.441+0000 7fd20172c800 2 removed watcher, disabling cache 2024-09-12T00:47:39.442 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.442+0000 7fd20172c800 20 remove_watcher() i=1 2024-09-12T00:47:39.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.443+0000 7fd20172c800 20 remove_watcher() i=2 2024-09-12T00:47:39.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.444+0000 7fd20172c800 20 remove_watcher() i=3 2024-09-12T00:47:39.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.445+0000 7fd20172c800 20 remove_watcher() i=4 2024-09-12T00:47:39.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.447+0000 7fd20172c800 20 remove_watcher() i=5 2024-09-12T00:47:39.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.448+0000 7fd20172c800 20 remove_watcher() i=6 2024-09-12T00:47:39.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.449+0000 7fd20172c800 20 remove_watcher() i=7 2024-09-12T00:47:39.459 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:39.459 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:39.460 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-trim-reshard-log-entries id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:47:39.460 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:39.461 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:47:39.499 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:39.499 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:39.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.538+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.540+0000 7fc9b172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.540+0000 7fc9b172c800 20 realm 2024-09-12T00:47:39.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.540+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.540+0000 7fc9b172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.540+0000 7fc9b172c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:39.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.540+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.540+0000 7fc9b172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.540+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.541+0000 7fc9b172c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:39.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.541+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.541+0000 7fc9b172c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:39.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.541+0000 7fc9b172c800 20 searching for the correct realm 2024-09-12T00:47:39.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.545+0000 7fc9adc57640 0 -- 172.21.15.19:0/1319907879 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7fc998018470 msgr2=0x7fc998018890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:39.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.548+0000 7fc9ad456640 0 -- 172.21.15.19:0/1319907879 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fc9a8074030 msgr2=0x7fc9a80a8410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:39.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.551+0000 7fc9b172c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:39.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.551+0000 7fc9b172c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:39.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.551+0000 7fc9b172c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:39.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.551+0000 7fc9b172c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:39.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.551+0000 7fc9b172c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:39.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.551+0000 7fc9b172c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:39.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.551+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.551+0000 7fc9b172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.551+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:39.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:39.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 20 zone default found 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 4 Realm: () 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 20 zonegroup default 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.552+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.553+0000 7fc9b172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.553+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.553+0000 7fc9b172c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.553+0000 7fc9b172c800 20 started sync module instance, tier type = 2024-09-12T00:47:39.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.553+0000 7fc9b172c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:39.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.562+0000 7fc9b172c800 20 add_watcher() i=0 2024-09-12T00:47:39.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.562+0000 7fc9b172c800 20 add_watcher() i=1 2024-09-12T00:47:39.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.562+0000 7fc9b172c800 20 add_watcher() i=2 2024-09-12T00:47:39.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.562+0000 7fc9b172c800 20 add_watcher() i=3 2024-09-12T00:47:39.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.562+0000 7fc9b172c800 20 add_watcher() i=4 2024-09-12T00:47:39.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.562+0000 7fc9b172c800 20 add_watcher() i=5 2024-09-12T00:47:39.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.562+0000 7fc9b172c800 20 add_watcher() i=6 2024-09-12T00:47:39.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.563+0000 7fc9b172c800 20 add_watcher() i=7 2024-09-12T00:47:39.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.563+0000 7fc9b172c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:39.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.564+0000 7fc8637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:39.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.565+0000 7fc9b172c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:39.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.565+0000 7fc9b172c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:39.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.565+0000 7fc9b172c800 5 note: GC not initialized 2024-09-12T00:47:39.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.565+0000 7fc8627e4640 20 reqs_thread_entry: start 2024-09-12T00:47:39.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.565+0000 7fc9b172c800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:39.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.565+0000 7fc9b172c800 20 Filter name: none 2024-09-12T00:47:39.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.565+0000 7fc7d3fff640 20 reqs_thread_entry: start 2024-09-12T00:47:39.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.565+0000 7fc9b172c800 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:47:39.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.565+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.566+0000 7fc9b172c800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:39.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.566+0000 7fc9b172c800 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:47:39.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.566+0000 7fc9b172c800 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:47:39.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.566+0000 7fc9b172c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 : miss 2024-09-12T00:47:39.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.566+0000 7fc9b172c800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.566+0000 7fc9b172c800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:39.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.566+0000 7fc9b172c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 info.flags=0x17 2024-09-12T00:47:39.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.566+0000 7fc9b172c800 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 to cache LRU end 2024-09-12T00:47:39.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.566+0000 7fc9b172c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:39.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.566+0000 7fc9b172c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:39.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.566+0000 7fc9b172c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 2024-09-12T00:47:39.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.571+0000 7fc9b172c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 info.flags=0x17 2024-09-12T00:47:39.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.571+0000 7fc9b172c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 to cache LRU end 2024-09-12T00:47:39.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.571+0000 7fc9b172c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:39.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.571+0000 7fc9b172c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26, ofs0, ns] 2024-09-12T00:47:39.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.571+0000 7fc87ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398946 cookie 93966791568112 notifier 6407 bl.length()=939 2024-09-12T00:47:39.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.571+0000 7fc87ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 info.flags=0x17 2024-09-12T00:47:39.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.571+0000 7fc87ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 to cache LRU end 2024-09-12T00:47:39.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.571+0000 7fc87ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:39.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.573+0000 7fc9b172c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26]): orig_sources= new_sources= 2024-09-12T00:47:39.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.573+0000 7fc9b172c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26]): potential sources added=[] removed=[] 2024-09-12T00:47:39.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.573+0000 7fc9b172c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26]): orig_dests= new_dests= 2024-09-12T00:47:39.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.573+0000 7fc9b172c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26]): potential dests added=[] removed=[] 2024-09-12T00:47:39.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.573+0000 7fc9b172c800 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:47:39.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.573+0000 7fc9b172c800 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:47:39.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.0 2024-09-12T00:47:39.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.0 2024-09-12T00:47:39.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.1 2024-09-12T00:47:39.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.1 2024-09-12T00:47:39.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.2 2024-09-12T00:47:39.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.2 2024-09-12T00:47:39.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.3 2024-09-12T00:47:39.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.3 2024-09-12T00:47:39.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.4 2024-09-12T00:47:39.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.4 2024-09-12T00:47:39.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.5 2024-09-12T00:47:39.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.5 2024-09-12T00:47:39.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.6 2024-09-12T00:47:39.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.6 2024-09-12T00:47:39.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.7 2024-09-12T00:47:39.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.7 2024-09-12T00:47:39.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.8 2024-09-12T00:47:39.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.8 2024-09-12T00:47:39.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.9 2024-09-12T00:47:39.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.9 2024-09-12T00:47:39.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.10 2024-09-12T00:47:39.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.10 2024-09-12T00:47:39.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.11 2024-09-12T00:47:39.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1.11 2024-09-12T00:47:39.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.575+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.0 2024-09-12T00:47:39.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.576+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.1 2024-09-12T00:47:39.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.576+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.2 2024-09-12T00:47:39.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.577+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.3 2024-09-12T00:47:39.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.578+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.4 2024-09-12T00:47:39.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.578+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.5 2024-09-12T00:47:39.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.579+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.6 2024-09-12T00:47:39.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.579+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.7 2024-09-12T00:47:39.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.579+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.8 2024-09-12T00:47:39.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.580+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.9 2024-09-12T00:47:39.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.581+0000 7fc9b172c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26.10 2024-09-12T00:47:39.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.584+0000 7fc9b172c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:47:39.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.584+0000 7fc9b172c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 2024-09-12T00:47:39.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.585+0000 7fc9b172c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 info.flags=0x17 2024-09-12T00:47:39.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.585+0000 7fc9b172c800 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 to cache LRU end 2024-09-12T00:47:39.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.585+0000 7fc9b172c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:39.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.585+0000 7fc9b172c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26, ofs0, ns] 2024-09-12T00:47:39.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.585+0000 7fc87ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398947 cookie 93966791568112 notifier 6407 bl.length()=907 2024-09-12T00:47:39.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.585+0000 7fc87ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 info.flags=0x17 2024-09-12T00:47:39.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.585+0000 7fc87ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 to cache LRU end 2024-09-12T00:47:39.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.585+0000 7fc87ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:39.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.587+0000 7fc9b172c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26]): orig_sources= new_sources= 2024-09-12T00:47:39.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.587+0000 7fc9b172c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26]): potential sources added=[] removed=[] 2024-09-12T00:47:39.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.587+0000 7fc9b172c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26]): orig_dests= new_dests= 2024-09-12T00:47:39.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.587+0000 7fc9b172c800 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26]): potential dests added=[] removed=[] 2024-09-12T00:47:39.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.589+0000 7fc9b172c800 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:47:39.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.591+0000 7fc8637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:39.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.593+0000 7fc9b172c800 20 remove_watcher() i=0 2024-09-12T00:47:39.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.593+0000 7fc9b172c800 2 removed watcher, disabling cache 2024-09-12T00:47:39.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.594+0000 7fc9b172c800 20 remove_watcher() i=1 2024-09-12T00:47:39.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.595+0000 7fc9b172c800 20 remove_watcher() i=2 2024-09-12T00:47:39.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.596+0000 7fc9b172c800 20 remove_watcher() i=3 2024-09-12T00:47:39.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.597+0000 7fc9b172c800 20 remove_watcher() i=4 2024-09-12T00:47:39.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.598+0000 7fc9b172c800 20 remove_watcher() i=5 2024-09-12T00:47:39.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.599+0000 7fc9b172c800 20 remove_watcher() i=6 2024-09-12T00:47:39.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.600+0000 7fc9b172c800 20 remove_watcher() i=7 2024-09-12T00:47:39.613 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:47:39.642 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:39.642 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:39.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.681+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.683+0000 7f8085b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.683+0000 7f8085b31800 20 realm 2024-09-12T00:47:39.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.683+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.683+0000 7f8085b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.683+0000 7f8085b31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:39.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.683+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.684+0000 7f8085b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.684+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.684+0000 7f8085b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:39.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.684+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.685+0000 7f8085b31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:39.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.685+0000 7f8085b31800 20 searching for the correct realm 2024-09-12T00:47:39.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.688+0000 7f8082077640 0 -- 172.21.15.19:0/3609080162 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7f807808b040 msgr2=0x7f8078064410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:39.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.691+0000 7f8081876640 0 -- 172.21.15.19:0/3609080162 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f807c0781a0 msgr2=0x7f807c0095e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:39.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.695+0000 7f8085b31800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:39.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.695+0000 7f8085b31800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:39.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.695+0000 7f8085b31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:39.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.695+0000 7f8085b31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:39.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.695+0000 7f8085b31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:39.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.695+0000 7f8085b31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:39.696 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.695+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:39.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:39.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 20 zone default found 2024-09-12T00:47:39.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 4 Realm: () 2024-09-12T00:47:39.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:39.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:39.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:39.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 20 zonegroup default 2024-09-12T00:47:39.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.696+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.697+0000 7f8085b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.697+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.697+0000 7f8085b31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:39.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.697+0000 7f8085b31800 20 started sync module instance, tier type = 2024-09-12T00:47:39.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.697+0000 7f8085b31800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:39.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.706+0000 7f8085b31800 20 add_watcher() i=0 2024-09-12T00:47:39.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.706+0000 7f8085b31800 20 add_watcher() i=1 2024-09-12T00:47:39.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.706+0000 7f8085b31800 20 add_watcher() i=2 2024-09-12T00:47:39.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.706+0000 7f8085b31800 20 add_watcher() i=3 2024-09-12T00:47:39.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.706+0000 7f8085b31800 20 add_watcher() i=4 2024-09-12T00:47:39.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.706+0000 7f8085b31800 20 add_watcher() i=5 2024-09-12T00:47:39.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.706+0000 7f8085b31800 20 add_watcher() i=6 2024-09-12T00:47:39.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.707+0000 7f8085b31800 20 add_watcher() i=7 2024-09-12T00:47:39.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.707+0000 7f8085b31800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:39.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.708+0000 7f7f337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:39.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.709+0000 7f8085b31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:39.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.709+0000 7f8085b31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:39.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.709+0000 7f8085b31800 5 note: GC not initialized 2024-09-12T00:47:39.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.709+0000 7f7f327fc640 20 reqs_thread_entry: start 2024-09-12T00:47:39.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.709+0000 7f8085b31800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:39.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.709+0000 7f8085b31800 20 Filter name: none 2024-09-12T00:47:39.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.709+0000 7f7ea3fff640 20 reqs_thread_entry: start 2024-09-12T00:47:39.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.709+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.710+0000 7f8085b31800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:39.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.710+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.711+0000 7f8085b31800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:39.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.711+0000 7f8085b31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:39.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.711+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.711+0000 7f8085b31800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:39.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.711+0000 7f8085b31800 20 rados->read ofs=0 len=0 2024-09-12T00:47:39.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.711+0000 7f8085b31800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:39.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.711+0000 7f8085b31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:39.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.713+0000 7f7f337fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:39.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.715+0000 7f8085b31800 20 remove_watcher() i=0 2024-09-12T00:47:39.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.715+0000 7f8085b31800 2 removed watcher, disabling cache 2024-09-12T00:47:39.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.716+0000 7f8085b31800 20 remove_watcher() i=1 2024-09-12T00:47:39.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.717+0000 7f8085b31800 20 remove_watcher() i=2 2024-09-12T00:47:39.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.718+0000 7f8085b31800 20 remove_watcher() i=3 2024-09-12T00:47:39.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.719+0000 7f8085b31800 20 remove_watcher() i=4 2024-09-12T00:47:39.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.720+0000 7f8085b31800 20 remove_watcher() i=5 2024-09-12T00:47:39.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.721+0000 7f8085b31800 20 remove_watcher() i=6 2024-09-12T00:47:39.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:39.722+0000 7f8085b31800 20 remove_watcher() i=7 2024-09-12T00:47:39.732 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:39.733 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:39.733 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-trim-reshard-log-entries id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:47:39.733 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:39.735 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:39.735 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:39.756 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:39.756 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:39.954 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:39.955 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.093 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:47:40.093 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:40.094 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.094 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.143 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.143 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.201 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.201 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.238 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.238 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.271 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.271 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.306 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.306 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.340 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.340 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.375 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.375 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.408 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.408 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.443 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.444 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.478 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.479 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.517 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.517 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.551 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.551 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.585 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.585 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.618 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.619 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.653 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.653 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.688 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.688 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.722 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.722 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.755 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.755 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.790 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.791 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.823 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.824 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.856 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:40.856 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:40.892 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:47:40.921 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:40.922 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:40.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.960+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:40.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.962+0000 7fc22032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:40.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.962+0000 7fc22032e800 20 realm 2024-09-12T00:47:40.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.962+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:40.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.962+0000 7fc22032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:40.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.962+0000 7fc22032e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:40.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.962+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:40.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.962+0000 7fc22032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:40.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.962+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:40.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.963+0000 7fc22032e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:40.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.963+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:40.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.963+0000 7fc22032e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:40.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.963+0000 7fc22032e800 20 searching for the correct realm 2024-09-12T00:47:40.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:40.966+0000 7fc21b8dc640 0 -- 172.21.15.19:0/3726837455 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc2100b7c20 msgr2=0x7fc2100cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:41.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.171+0000 7fc21c8de640 0 -- 172.21.15.19:0/3726837455 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x555e6bfdab50 msgr2=0x555e6bfdcfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:41.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.175+0000 7fc22032e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:41.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.175+0000 7fc22032e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:41.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.175+0000 7fc22032e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:41.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.175+0000 7fc22032e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:41.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.175+0000 7fc22032e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:41.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.175+0000 7fc22032e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:41.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.176+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.176+0000 7fc22032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.176+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.176+0000 7fc22032e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:41.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.176+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 20 zone default found 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 4 Realm: () 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 20 zonegroup default 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.177+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.178+0000 7fc22032e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.178+0000 7fc22032e800 20 started sync module instance, tier type = 2024-09-12T00:47:41.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.178+0000 7fc22032e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:41.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.187+0000 7fc22032e800 20 add_watcher() i=0 2024-09-12T00:47:41.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.187+0000 7fc22032e800 20 add_watcher() i=1 2024-09-12T00:47:41.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.187+0000 7fc22032e800 20 add_watcher() i=2 2024-09-12T00:47:41.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.187+0000 7fc22032e800 20 add_watcher() i=3 2024-09-12T00:47:41.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.187+0000 7fc22032e800 20 add_watcher() i=4 2024-09-12T00:47:41.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.187+0000 7fc22032e800 20 add_watcher() i=5 2024-09-12T00:47:41.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.187+0000 7fc22032e800 20 add_watcher() i=6 2024-09-12T00:47:41.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.188+0000 7fc22032e800 20 add_watcher() i=7 2024-09-12T00:47:41.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.188+0000 7fc22032e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:41.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.189+0000 7fc0d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:41.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.190+0000 7fc22032e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:41.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.190+0000 7fc22032e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:41.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.190+0000 7fc22032e800 5 note: GC not initialized 2024-09-12T00:47:41.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.190+0000 7fc0d17e2640 20 reqs_thread_entry: start 2024-09-12T00:47:41.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.190+0000 7fc22032e800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:41.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.190+0000 7fc22032e800 20 Filter name: none 2024-09-12T00:47:41.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.190+0000 7fc042ffd640 20 reqs_thread_entry: start 2024-09-12T00:47:41.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.190+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.191+0000 7fc22032e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:41.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.191+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.191+0000 7fc22032e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:41.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.191+0000 7fc22032e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:41.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.191+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.192+0000 7fc22032e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:41.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.192+0000 7fc22032e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.192+0000 7fc22032e800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:41.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.192+0000 7fc22032e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:41.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.194+0000 7fc0d27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:41.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.197+0000 7fc22032e800 20 remove_watcher() i=0 2024-09-12T00:47:41.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.197+0000 7fc22032e800 2 removed watcher, disabling cache 2024-09-12T00:47:41.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.198+0000 7fc22032e800 20 remove_watcher() i=1 2024-09-12T00:47:41.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.199+0000 7fc22032e800 20 remove_watcher() i=2 2024-09-12T00:47:41.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.200+0000 7fc22032e800 20 remove_watcher() i=3 2024-09-12T00:47:41.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.201+0000 7fc22032e800 20 remove_watcher() i=4 2024-09-12T00:47:41.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.202+0000 7fc22032e800 20 remove_watcher() i=5 2024-09-12T00:47:41.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.203+0000 7fc22032e800 20 remove_watcher() i=6 2024-09-12T00:47:41.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.204+0000 7fc22032e800 20 remove_watcher() i=7 2024-09-12T00:47:41.216 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.216 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:41.216 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-trim-reshard-log-entries id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:47:41.216 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.218 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:47:41.252 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:41.252 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:41.293 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.293+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.294+0000 7fc863a11800 20 realm 2024-09-12T00:47:41.294 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.294+0000 7fc863a11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:41.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.295+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:41.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.295+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.295+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:41.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.295+0000 7fc863a11800 20 searching for the correct realm 2024-09-12T00:47:41.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.297+0000 7fc85f148640 0 -- 172.21.15.19:0/3708065929 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55eb73790380 msgr2=0x55eb73792770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:41.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.301+0000 7fc85f949640 0 -- 172.21.15.19:0/3708065929 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x55eb73790380 msgr2=0x7fc850060450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:41.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:41.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:41.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:41.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:41.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:41.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:41.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.509+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.509+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.509+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:41.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:41.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 20 zone default found 2024-09-12T00:47:41.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 4 Realm: () 2024-09-12T00:47:41.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:41.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:41.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:41.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 20 zonegroup default 2024-09-12T00:47:41.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.511+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.511+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.511+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.511+0000 7fc863a11800 20 started sync module instance, tier type = 2024-09-12T00:47:41.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.511+0000 7fc863a11800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:41.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=0 2024-09-12T00:47:41.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=1 2024-09-12T00:47:41.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=2 2024-09-12T00:47:41.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=3 2024-09-12T00:47:41.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=4 2024-09-12T00:47:41.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=5 2024-09-12T00:47:41.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=6 2024-09-12T00:47:41.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.521+0000 7fc863a11800 20 add_watcher() i=7 2024-09-12T00:47:41.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.521+0000 7fc863a11800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:41.523 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.523+0000 7fc715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:41.523 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.523+0000 7fc863a11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:41.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.523+0000 7fc863a11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:41.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.523+0000 7fc863a11800 5 note: GC not initialized 2024-09-12T00:47:41.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.524+0000 7fc714fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:41.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.524+0000 7fc863a11800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:41.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.524+0000 7fc863a11800 20 Filter name: none 2024-09-12T00:47:41.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.524+0000 7fc68e7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:41.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.524+0000 7fc863a11800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:47:41.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.524+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.524+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:41.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.524+0000 7fc863a11800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:47:41.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.524+0000 7fc863a11800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:47:41.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.524+0000 7fc863a11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 : miss 2024-09-12T00:47:41.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.524+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.525+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:41.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.525+0000 7fc863a11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:47:41.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.525+0000 7fc863a11800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:47:41.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.525+0000 7fc863a11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:41.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.525+0000 7fc863a11800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:41.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.525+0000 7fc863a11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 2024-09-12T00:47:41.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.530+0000 7fc863a11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:47:41.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.530+0000 7fc863a11800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:47:41.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.530+0000 7fc863a11800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:41.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.530+0000 7fc863a11800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27, ofs0, ns] 2024-09-12T00:47:41.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398950 cookie 94469743035296 notifier 6458 bl.length()=939 2024-09-12T00:47:41.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:47:41.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:47:41.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:41.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_sources= new_sources= 2024-09-12T00:47:41.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential sources added=[] removed=[] 2024-09-12T00:47:41.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_dests= new_dests= 2024-09-12T00:47:41.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential dests added=[] removed=[] 2024-09-12T00:47:41.532 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc863a11800 time 2024-09-12T00:47:41.534133+0000 2024-09-12T00:47:41.532 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc864b8c71a] 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc864b8c8d8] 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eb72214641] 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd884de) [0x55eb727274de] 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55eb7222431d] 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc863829590] 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.533+0000 7fc863a11800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc863a11800 time 2024-09-12T00:47:41.534133+0000 2024-09-12T00:47:41.533 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc864b8c71a] 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc864b8c8d8] 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eb72214641] 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd884de) [0x55eb727274de] 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55eb7222431d] 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc863829590] 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:47:41.534 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fc863a11800 thread_name:radosgw-admin 2024-09-12T00:47:41.549 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:41.549 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc86383e6f0] 2024-09-12T00:47:41.549 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc86388b99c] 2024-09-12T00:47:41.549 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc864b8c774] 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc864b8c8d8] 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eb72214641] 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd884de) [0x55eb727274de] 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55eb7222431d] 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc863829590] 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.534+0000 7fc863a11800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fc863a11800 thread_name:radosgw-admin 2024-09-12T00:47:41.550 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc86383e6f0] 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc86388b99c] 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc864b8c774] 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc864b8c8d8] 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eb72214641] 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd884de) [0x55eb727274de] 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55eb7222431d] 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc863829590] 2024-09-12T00:47:41.551 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 asok(0x55eb73482630) unregister_commands rotate-key 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:47:41.276+0000 7fc863a11800 10 monclient: build_initial_monmap 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:47:41.276+0000 7fc863a11800 1 build_initial for_mkfs: 0 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:47:41.276+0000 7fc863a11800 10 monclient: monmap: 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:41.552 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding auth protocol: cephx 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding auth protocol: cephx 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding auth protocol: cephx 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.553 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:47:41.276+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:47:41.276+0000 7fc863a11800 1 librados: starting msgr at 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:47:41.276+0000 7fc863a11800 1 librados: starting objecter 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 asok(0x55eb73482630) register_command objecter_requests hook 0x55eb736cfa30 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:47:41.277+0000 7fc863a11800 1 librados: setting wanted keys 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:47:41.277+0000 7fc863a11800 1 librados: calling monclient init 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient: init 2024-09-12T00:47:41.554 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding auth protocol: cephx 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding auth protocol: cephx 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding auth protocol: cephx 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.555 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:47:41.277+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:47:41.277+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 asok(0x55eb73482630) register_command rotate-key hook 0x55eb736a1328 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-b con 0x55eb736cb090 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-c con 0x55eb736cba10 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-a con 0x7fc84c003bd0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.556 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): authenticate will time out at 2127.780534s 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): get_auth_request con 0x55eb736cba10 auth_method 0 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): get_auth_request con 0x7fc84c003bd0 auth_method 0 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): get_auth_request con 0x55eb736cb090 auth_method 0 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.557 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): handle_auth_done global_id 6449 payload 824 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient: _finish_hunting 0 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:47:41.277+0000 7fc856947640 1 monclient: found mon.noname-c 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.558 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: dump: 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: _finish_auth 0 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: _check_auth_tickets 2024-09-12T00:47:41.559 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: dump: 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.560 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:47:41.278+0000 7fc863a11800 5 monclient: authenticate success, global_id 6449 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:47:41.278+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:47:41.278+0000 7fc74d60a640 4 set_mon_vals no callback set 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:47:41.278+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:47:41.278+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:47:41.278+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:47:41.278+0000 7fc863a11800 1 librados: init done 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:47:41.280+0000 7fc74be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:47:41.280+0000 7fc74be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:47:41.280+0000 7fc74be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:47:41.280+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc744076470 auth_method 0 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:47:41.280+0000 7fc85f949640 10 monclient: get_auth_request con 0x55eb736c9cf0 auth_method 0 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:47:41.281+0000 7fc85f148640 10 monclient: get_auth_request con 0x55eb736ed6a0 auth_method 0 2024-09-12T00:47:41.561 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:47:41.283+0000 7fc856947640 10 monclient: get_auth_request con 0x55eb736f2730 auth_method 0 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:47:41.283+0000 7fc863a11800 10 monclient: build_initial_monmap 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:47:41.283+0000 7fc863a11800 1 build_initial for_mkfs: 0 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:47:41.283+0000 7fc863a11800 10 monclient: monmap: 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding auth protocol: cephx 2024-09-12T00:47:41.562 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding auth protocol: cephx 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding auth protocol: cephx 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.563 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:47:41.284+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 asok(0x55eb73482630) register_command objecter_requests cmddesc objecter_requests hook 0x55eb736fa0c0 EEXIST 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient: init 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding auth protocol: cephx 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding auth protocol: cephx 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding auth protocol: cephx 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.564 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:47:41.284+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:47:41.284+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 asok(0x55eb73482630) register_command rotate-key cmddesc rotate-key hook 0x55eb736f5790 EEXIST 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-a con 0x55eb7371ddb0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-c con 0x55eb73720080 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-b con 0x55eb7371c580 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.565 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): authenticate will time out at 2127.787968s 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): get_auth_request con 0x55eb73720080 auth_method 0 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): get_auth_request con 0x55eb7371ddb0 auth_method 0 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): get_auth_request con 0x55eb7371c580 auth_method 0 2024-09-12T00:47:41.566 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): handle_auth_done global_id 6452 payload 824 2024-09-12T00:47:41.567 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient: _finish_hunting 0 2024-09-12T00:47:41.572 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:47:41.285+0000 7fc856947640 1 monclient: found mon.noname-c 2024-09-12T00:47:41.572 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.572 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.572 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:41.572 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: dump: 2024-09-12T00:47:41.572 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.572 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.572 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.572 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.573 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.573 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.573 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.573 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.573 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.573 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.573 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: _finish_auth 0 2024-09-12T00:47:41.573 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: _check_auth_tickets 2024-09-12T00:47:41.573 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:47:41.285+0000 7fc863a11800 5 monclient: authenticate success, global_id 6452 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:47:41.285+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:47:41.285+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: dump: 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.574 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:47:41.285+0000 7fc86014a640 4 set_mon_vals no callback set 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:47:41.285+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:47:41.285+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:47:41.287+0000 7fc749602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:47:41.287+0000 7fc749602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:47:41.287+0000 7fc749602640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:47:41.287+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc738076380 auth_method 0 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:47:41.287+0000 7fc863a11800 10 monclient: get_monmap_and_config 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:47:41.287+0000 7fc863a11800 10 monclient: build_initial_monmap 2024-09-12T00:47:41.575 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:47:41.287+0000 7fc863a11800 1 build_initial for_mkfs: 0 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:47:41.287+0000 7fc863a11800 10 monclient: monmap: 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding auth protocol: cephx 2024-09-12T00:47:41.576 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding auth protocol: cephx 2024-09-12T00:47:41.577 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding auth protocol: cephx 2024-09-12T00:47:41.577 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.577 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.577 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.577 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.577 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.577 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.577 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.577 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.577 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.577 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:47:41.287+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient: init 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding auth protocol: cephx 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding auth protocol: cephx 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding auth protocol: cephx 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.578 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:47:41.288+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:47:41.288+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 asok(0x55eb73482630) register_command rotate-key cmddesc rotate-key hook 0x7fff45084f08 EEXIST 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-c con 0x55eb73771c80 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-a con 0x55eb737415b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-b con 0x55eb7373f440 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:41.579 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): authenticate will time out at 2127.791694s 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): get_auth_request con 0x55eb737415b0 auth_method 0 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): get_auth_request con 0x55eb73771c80 auth_method 0 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.580 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:47:41.288+0000 7fc85f949640 10 monclient(hunting): get_auth_request con 0x55eb7373f440 auth_method 0 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:47:41.288+0000 7fc85f949640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:47:41.288+0000 7fc85f949640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:47:41.288+0000 7fc85f949640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): handle_auth_done global_id 6858 payload 274 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:47:41.289+0000 7fc856947640 10 monclient: _finish_hunting 0 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:47:41.289+0000 7fc856947640 1 monclient: found mon.noname-a 2024-09-12T00:47:41.581 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:47:41.289+0000 7fc856947640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: dump: 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.582 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: _finish_auth 0 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: dump: 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.583 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 monclient: authenticate success, global_id 6858 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:47:41.289+0000 7fc863a11800 10 monclient: get_monmap_and_config success 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:47:41.289+0000 7fc863a11800 4 set_mon_vals no callback set 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:47:41.289+0000 7fc863a11800 10 monclient: shutdown 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:47:41.289+0000 7fc863a11800 10 monclient: build_initial_monmap 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:47:41.289+0000 7fc863a11800 1 build_initial for_mkfs: 0 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:47:41.289+0000 7fc863a11800 10 monclient: monmap: 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:41.584 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding auth protocol: cephx 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding auth protocol: cephx 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding auth protocol: cephx 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.585 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:47:41.290+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:47:41.290+0000 7fc863a11800 1 librados: starting msgr at 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:47:41.290+0000 7fc863a11800 1 librados: starting objecter 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 asok(0x55eb73482630) register_command objecter_requests cmddesc objecter_requests hook 0x55eb7371e430 EEXIST 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:47:41.290+0000 7fc863a11800 1 librados: setting wanted keys 2024-09-12T00:47:41.586 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:47:41.290+0000 7fc863a11800 1 librados: calling monclient init 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient: init 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding auth protocol: cephx 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding auth protocol: cephx 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding auth protocol: cephx 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.587 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:47:41.290+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:47:41.290+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 asok(0x55eb73482630) register_command rotate-key cmddesc rotate-key hook 0x55eb73735ca8 EEXIST 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-a con 0x55eb7373f440 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-c con 0x55eb737415b0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-b con 0x55eb73771c80 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.588 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): authenticate will time out at 2127.793974s 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): get_auth_request con 0x55eb7373f440 auth_method 0 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): get_auth_request con 0x55eb737415b0 auth_method 0 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.589 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): get_auth_request con 0x55eb73771c80 auth_method 0 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): handle_auth_done global_id 6458 payload 824 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient: _finish_hunting 0 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:47:41.291+0000 7fc856947640 1 monclient: found mon.noname-c 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.590 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: dump: 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: _finish_auth 0 2024-09-12T00:47:41.591 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: _check_auth_tickets 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: dump: 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.592 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:47:41.291+0000 7fc863a11800 5 monclient: authenticate success, global_id 6458 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:47:41.291+0000 7fc742ffd640 4 set_mon_vals no callback set 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:47:41.291+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:47:41.291+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:47:41.291+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:47:41.291+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:47:41.291+0000 7fc863a11800 1 librados: init done 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:47:41.291+0000 7fc863a11800 5 asok(0x55eb73482630) register_command cr dump hook 0x55eb73778988 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:47:41.293+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:47:41.293+0000 7fc7417fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:47:41.293+0000 7fc7417fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:47:41.293+0000 7fc7417fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.593 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:47:41.293+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc728076470 auth_method 0 2024-09-12T00:47:41.594 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:47:41.293+0000 7fc85f949640 10 monclient: get_auth_request con 0x55eb7378c080 auth_method 0 2024-09-12T00:47:41.594 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.594 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 realm 2024-09-12T00:47:41.594 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.594 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.594 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:47:41.294+0000 7fc863a11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:41.594 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.594 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.594 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.594 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:47:41.295+0000 7fc85f148640 10 monclient: get_auth_request con 0x55eb73790380 auth_method 0 2024-09-12T00:47:41.594 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:47:41.295+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:47:41.295+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:47:41.295+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:47:41.295+0000 7fc863a11800 20 searching for the correct realm 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:47:41.296+0000 7fc856947640 10 monclient: get_auth_request con 0x55eb737954f0 auth_method 0 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:47:41.296+0000 7fc85f949640 10 monclient: get_auth_request con 0x7fc84809d570 auth_method 0 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:47:41.297+0000 7fc85f148640 0 -- 172.21.15.19:0/3708065929 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55eb73790380 msgr2=0x55eb73792770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:47:41.297+0000 7fc7417fa640 1 client.6458.objecter ms_handle_reset 0x55eb73790380 session 0x55eb7378f200 osd.1 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:47:41.298+0000 7fc7417fa640 10 monclient: _renew_subs 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:47:41.298+0000 7fc7417fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:47:41.298+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc850018030 auth_method 0 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:47:41.298+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc728086790 auth_method 0 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:47:41.299+0000 7fc856947640 10 monclient: get_auth_request con 0x7fc84805f680 auth_method 0 2024-09-12T00:47:41.595 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:47:41.301+0000 7fc85f949640 10 monclient: get_auth_request con 0x55eb73790380 auth_method 0 2024-09-12T00:47:41.596 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:47:41.301+0000 7fc85f949640 0 -- 172.21.15.19:0/3708065929 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x55eb73790380 msgr2=0x7fc850060450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:41.596 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:47:41.503+0000 7fc85f949640 10 monclient: get_auth_request con 0x55eb73790380 auth_method 0 2024-09-12T00:47:41.596 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:47:41.504+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc858083040 auth_method 0 2024-09-12T00:47:41.596 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:41.597 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 zone default found 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:47:41.510+0000 7fc863a11800 4 Realm: () 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:47:41.510+0000 7fc863a11800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:47:41.510+0000 7fc863a11800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:47:41.510+0000 7fc863a11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 zonegroup default 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:47:41.511+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:47:41.511+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:47:41.511+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:47:41.511+0000 7fc863a11800 20 started sync module instance, tier type = 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:47:41.511+0000 7fc863a11800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:41.598 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=0 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=1 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=2 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=3 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=4 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=5 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=6 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:47:41.521+0000 7fc863a11800 20 add_watcher() i=7 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:47:41.521+0000 7fc863a11800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding auth protocol: cephx 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding auth protocol: cephx 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding auth protocol: cephx 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.599 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:47:41.523+0000 7fc715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:47:41.523+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:47:41.523+0000 7fc863a11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:41.600 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:47:41.523+0000 7fc863a11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 asok(0x55eb73482630) register_command cache list hook 0x55eb737788f0 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 asok(0x55eb73482630) register_command cache inspect hook 0x55eb737788f0 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 asok(0x55eb73482630) register_command cache erase hook 0x55eb737788f0 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 asok(0x55eb73482630) register_command cache zap hook 0x55eb737788f0 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 note: GC not initialized 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:47:41.524+0000 7fc714fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:47:41.524+0000 7fc863a11800 5 asok(0x55eb73482630) register_command sync trace show hook 0x7fc84807b070 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:47:41.524+0000 7fc863a11800 5 asok(0x55eb73482630) register_command sync trace history hook 0x7fc84807b070 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:47:41.524+0000 7fc863a11800 5 asok(0x55eb73482630) register_command sync trace active hook 0x7fc84807b070 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:47:41.524+0000 7fc863a11800 5 asok(0x55eb73482630) register_command sync trace active_short hook 0x7fc84807b070 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:47:41.524+0000 7fc863a11800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:47:41.524+0000 7fc863a11800 20 Filter name: none 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:47:41.524+0000 7fc68e7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:41.601 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:47:41.524+0000 7fc863a11800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:47:41.524+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:47:41.524+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:47:41.524+0000 7fc863a11800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:47:41.524+0000 7fc863a11800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:47:41.524+0000 7fc863a11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 : miss 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:47:41.524+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:47:41.525+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:47:41.525+0000 7fc863a11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:47:41.525+0000 7fc863a11800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:47:41.525+0000 7fc863a11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:47:41.525+0000 7fc863a11800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:47:41.525+0000 7fc863a11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 2024-09-12T00:47:41.602 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:47:41.530+0000 7fc863a11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:47:41.603 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:47:41.530+0000 7fc863a11800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:47:41.603 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:47:41.530+0000 7fc863a11800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:41.603 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:47:41.530+0000 7fc863a11800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27, ofs0, ns] 2024-09-12T00:47:41.603 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398950 cookie 94469743035296 notifier 6458 bl.length()=939 2024-09-12T00:47:41.603 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:47:41.603 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:47:41.603 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:41.603 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_sources= new_sources= 2024-09-12T00:47:41.603 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential sources added=[] removed=[] 2024-09-12T00:47:41.603 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_dests= new_dests= 2024-09-12T00:47:41.603 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential dests added=[] removed=[] 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:47:41.533+0000 7fc863a11800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc863a11800 time 2024-09-12T00:47:41.534133+0000 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc864b8c71a] 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc864b8c8d8] 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eb72214641] 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd884de) [0x55eb727274de] 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55eb7222431d] 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc863829590] 2024-09-12T00:47:41.604 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:47:41.534+0000 7fc863a11800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fc863a11800 thread_name:radosgw-admin 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc86383e6f0] 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc86388b99c] 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc864b8c774] 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc864b8c8d8] 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eb72214641] 2024-09-12T00:47:41.605 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd884de) [0x55eb727274de] 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55eb7222431d] 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc863829590] 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:47:41.606 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:47:41.607 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:47:41.608 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:47:41.609 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:47:41.610 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:47:41.611 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:47:41.611 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:47:41.611 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:47:41.611 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:47:41.611 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:47:41.611 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:47:41.611 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:47:41.611 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:47:41.611 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:47:41.611 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:47:41.612 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:47:41.612 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:47:41.612 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:47:41.612 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:47:41.612 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:47:41.612 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:47:41.612 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:47:41.612 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:47:41.612 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:47:41.612 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:47:41.612 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc68e7fc640 / http_manager 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc714fe1640 / http_manager 2024-09-12T00:47:41.613 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc715fe3640 / rgw_dt_lg_renew 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc7417fa640 / ms_dispatch 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc742ffd640 / io_context_pool 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc749602640 / ms_dispatch 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc74be07640 / ms_dispatch 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc74d60a640 / io_context_pool 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc856947640 / msgr-worker-2 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc85f148640 / msgr-worker-1 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc85f949640 / msgr-worker-0 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc86014a640 / io_context_pool 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc863a11800 / radosgw-admin 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:47:41.614 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.106389.log 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 asok(0x55eb73482630) unregister_commands rotate-key 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:47:41.276+0000 7fc863a11800 10 monclient: build_initial_monmap 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:47:41.276+0000 7fc863a11800 1 build_initial for_mkfs: 0 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:47:41.276+0000 7fc863a11800 10 monclient: monmap: 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.615 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding auth protocol: cephx 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding auth protocol: cephx 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding auth protocol: cephx 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.616 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: crc 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 AuthRegistry(0x55eb736a6d40) adding con mode: secure 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:47:41.276+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:47:41.276+0000 7fc863a11800 1 librados: starting msgr at 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:47:41.276+0000 7fc863a11800 1 librados: starting objecter 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:47:41.276+0000 7fc863a11800 5 asok(0x55eb73482630) register_command objecter_requests hook 0x55eb736cfa30 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:47:41.277+0000 7fc863a11800 1 librados: setting wanted keys 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:47:41.277+0000 7fc863a11800 1 librados: calling monclient init 2024-09-12T00:47:41.617 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient: init 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding auth protocol: cephx 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding auth protocol: cephx 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding auth protocol: cephx 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.618 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: crc 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 AuthRegistry(0x55eb736a11e0) adding con mode: secure 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:47:41.277+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:47:41.277+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:47:41.277+0000 7fc863a11800 5 asok(0x55eb73482630) register_command rotate-key hook 0x55eb736a1328 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-b con 0x55eb736cb090 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-c con 0x55eb736cba10 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-a con 0x7fc84c003bd0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.619 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:47:41.277+0000 7fc863a11800 10 monclient(hunting): authenticate will time out at 2127.780534s 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): get_auth_request con 0x55eb736cba10 auth_method 0 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): get_auth_request con 0x7fc84c003bd0 auth_method 0 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): get_auth_request con 0x55eb736cb090 auth_method 0 2024-09-12T00:47:41.620 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:47:41.277+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:47:41.277+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient(hunting): handle_auth_done global_id 6449 payload 824 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient: _finish_hunting 0 2024-09-12T00:47:41.621 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:47:41.277+0000 7fc856947640 1 monclient: found mon.noname-c 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:47:41.277+0000 7fc856947640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: dump: 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.622 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: _finish_auth 0 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: _check_auth_tickets 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:47:41.278+0000 7fc74be07640 10 monclient: dump: 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.623 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:47:41.278+0000 7fc863a11800 5 monclient: authenticate success, global_id 6449 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:47:41.278+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:47:41.278+0000 7fc74d60a640 4 set_mon_vals no callback set 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:47:41.278+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:47:41.278+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:47:41.278+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:47:41.278+0000 7fc863a11800 1 librados: init done 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:47:41.280+0000 7fc74be07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:47:41.280+0000 7fc74be07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:47:41.280+0000 7fc74be07640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.624 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:47:41.280+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc744076470 auth_method 0 2024-09-12T00:47:41.625 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:47:41.280+0000 7fc85f949640 10 monclient: get_auth_request con 0x55eb736c9cf0 auth_method 0 2024-09-12T00:47:41.625 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:47:41.281+0000 7fc85f148640 10 monclient: get_auth_request con 0x55eb736ed6a0 auth_method 0 2024-09-12T00:47:41.625 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:47:41.283+0000 7fc856947640 10 monclient: get_auth_request con 0x55eb736f2730 auth_method 0 2024-09-12T00:47:41.625 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:47:41.283+0000 7fc863a11800 10 monclient: build_initial_monmap 2024-09-12T00:47:41.625 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:47:41.283+0000 7fc863a11800 1 build_initial for_mkfs: 0 2024-09-12T00:47:41.625 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:47:41.283+0000 7fc863a11800 10 monclient: monmap: 2024-09-12T00:47:41.625 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:41.625 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:41.625 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding auth protocol: cephx 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding auth protocol: cephx 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding auth protocol: cephx 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.626 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: crc 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:47:41.283+0000 7fc863a11800 5 AuthRegistry(0x55eb736f66b0) adding con mode: secure 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:47:41.284+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 asok(0x55eb73482630) register_command objecter_requests cmddesc objecter_requests hook 0x55eb736fa0c0 EEXIST 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient: init 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding auth protocol: cephx 2024-09-12T00:47:41.627 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding auth protocol: cephx 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding auth protocol: cephx 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.628 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: crc 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 AuthRegistry(0x55eb736f5648) adding con mode: secure 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:47:41.284+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:47:41.284+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:47:41.284+0000 7fc863a11800 5 asok(0x55eb73482630) register_command rotate-key cmddesc rotate-key hook 0x55eb736f5790 EEXIST 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-a con 0x55eb7371ddb0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-c con 0x55eb73720080 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-b con 0x55eb7371c580 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.629 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:47:41.284+0000 7fc863a11800 10 monclient(hunting): authenticate will time out at 2127.787968s 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): get_auth_request con 0x55eb73720080 auth_method 0 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): get_auth_request con 0x55eb7371ddb0 auth_method 0 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): get_auth_request con 0x55eb7371c580 auth_method 0 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.630 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:47:41.285+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:47:41.285+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient(hunting): handle_auth_done global_id 6452 payload 824 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient: _finish_hunting 0 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:47:41.285+0000 7fc856947640 1 monclient: found mon.noname-c 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:47:41.285+0000 7fc856947640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.631 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: dump: 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.632 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: _finish_auth 0 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: _check_auth_tickets 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:47:41.285+0000 7fc863a11800 5 monclient: authenticate success, global_id 6452 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:47:41.285+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:47:41.285+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:47:41.285+0000 7fc749602640 10 monclient: dump: 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.633 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:47:41.285+0000 7fc86014a640 4 set_mon_vals no callback set 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:47:41.285+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:47:41.285+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:47:41.287+0000 7fc749602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:47:41.287+0000 7fc749602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:47:41.287+0000 7fc749602640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:47:41.287+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc738076380 auth_method 0 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:47:41.287+0000 7fc863a11800 10 monclient: get_monmap_and_config 2024-09-12T00:47:41.634 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:47:41.287+0000 7fc863a11800 10 monclient: build_initial_monmap 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:47:41.287+0000 7fc863a11800 1 build_initial for_mkfs: 0 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:47:41.287+0000 7fc863a11800 10 monclient: monmap: 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.635 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding auth protocol: cephx 2024-09-12T00:47:41.636 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding auth protocol: cephx 2024-09-12T00:47:41.636 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding auth protocol: cephx 2024-09-12T00:47:41.636 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.636 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.636 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.636 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.636 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.636 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.636 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.636 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.636 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: crc 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:47:41.287+0000 7fc863a11800 5 AuthRegistry(0x55eb7373d6a0) adding con mode: secure 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:47:41.287+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient: init 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding auth protocol: cephx 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding auth protocol: cephx 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding auth protocol: cephx 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.637 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: crc 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 AuthRegistry(0x7fff45084dc0) adding con mode: secure 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:47:41.288+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:47:41.288+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:47:41.288+0000 7fc863a11800 5 asok(0x55eb73482630) register_command rotate-key cmddesc rotate-key hook 0x7fff45084f08 EEXIST 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-c con 0x55eb73771c80 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:41.638 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-a con 0x55eb737415b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-b con 0x55eb7373f440 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:47:41.288+0000 7fc863a11800 10 monclient(hunting): authenticate will time out at 2127.791694s 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): get_auth_request con 0x55eb737415b0 auth_method 0 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): get_auth_request con 0x55eb73771c80 auth_method 0 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.639 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:47:41.288+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:47:41.288+0000 7fc85f949640 10 monclient(hunting): get_auth_request con 0x55eb7373f440 auth_method 0 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:47:41.288+0000 7fc85f949640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:47:41.288+0000 7fc85f949640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:47:41.288+0000 7fc85f949640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:47:41.288+0000 7fc856947640 10 monclient(hunting): handle_auth_done global_id 6858 payload 274 2024-09-12T00:47:41.640 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:47:41.289+0000 7fc856947640 10 monclient: _finish_hunting 0 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:47:41.289+0000 7fc856947640 1 monclient: found mon.noname-a 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:47:41.289+0000 7fc856947640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: dump: 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.641 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: _finish_auth 0 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:47:41.289+0000 7fc742ffd640 10 monclient: dump: 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.642 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 monclient: authenticate success, global_id 6858 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:47:41.289+0000 7fc863a11800 10 monclient: get_monmap_and_config success 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:47:41.289+0000 7fc863a11800 4 set_mon_vals no callback set 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:47:41.289+0000 7fc863a11800 10 monclient: shutdown 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:47:41.289+0000 7fc863a11800 10 monclient: build_initial_monmap 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:47:41.289+0000 7fc863a11800 1 build_initial for_mkfs: 0 2024-09-12T00:47:41.643 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:47:41.289+0000 7fc863a11800 10 monclient: monmap: 2024-09-12T00:47:41.644 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:47:41.644 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:47:41.644 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:47:41.644 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:47:41.644 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:47:41.644 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.644 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:47:41.644 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:47:41.644 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:47:41.644 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.644 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding auth protocol: cephx 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding auth protocol: cephx 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding auth protocol: cephx 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.645 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:47:41.289+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: crc 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73557c50) adding con mode: secure 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:47:41.290+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:47:41.290+0000 7fc863a11800 1 librados: starting msgr at 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:47:41.290+0000 7fc863a11800 1 librados: starting objecter 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 asok(0x55eb73482630) register_command objecter_requests cmddesc objecter_requests hook 0x55eb7371e430 EEXIST 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:47:41.290+0000 7fc863a11800 1 librados: setting wanted keys 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:47:41.290+0000 7fc863a11800 1 librados: calling monclient init 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient: init 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding auth protocol: cephx 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding auth protocol: cephx 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding auth protocol: cephx 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.646 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: crc 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 AuthRegistry(0x55eb73735b60) adding con mode: secure 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:47:41.290+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:47:41.290+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.647 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:47:41.290+0000 7fc863a11800 5 asok(0x55eb73482630) register_command rotate-key cmddesc rotate-key hook 0x55eb73735ca8 EEXIST 2024-09-12T00:47:41.648 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient: _reopen_session rank -1 2024-09-12T00:47:41.648 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:47:41.648 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-a con 0x55eb7373f440 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:47:41.648 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-c con 0x55eb737415b0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:47:41.648 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): picked mon.noname-b con 0x55eb73771c80 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:47:41.648 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.648 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.648 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): start opening mon connection 2024-09-12T00:47:41.648 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): _renew_subs 2024-09-12T00:47:41.648 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:47:41.290+0000 7fc863a11800 10 monclient(hunting): authenticate will time out at 2127.793974s 2024-09-12T00:47:41.648 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): get_auth_request con 0x55eb7373f440 auth_method 0 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): get_auth_request con 0x55eb737415b0 auth_method 0 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.649 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:47:41.291+0000 7fc85f148640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): get_auth_request con 0x55eb73771c80 auth_method 0 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:47:41.291+0000 7fc85f949640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient(hunting): handle_auth_done global_id 6458 payload 824 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient: _finish_hunting 0 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:47:41.291+0000 7fc856947640 1 monclient: found mon.noname-c 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:47:41.291+0000 7fc856947640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.650 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: dump: 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: _finish_auth 0 2024-09-12T00:47:41.651 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: _check_auth_tickets 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:47:41.291+0000 7fc7417fa640 10 monclient: dump: 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:47:41.652 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:47:41.291+0000 7fc863a11800 5 monclient: authenticate success, global_id 6458 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:47:41.291+0000 7fc742ffd640 4 set_mon_vals no callback set 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:47:41.291+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:47:41.291+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:47:41.291+0000 7fc863a11800 10 monclient: _renew_subs 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:47:41.291+0000 7fc863a11800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:47:41.291+0000 7fc863a11800 1 librados: init done 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:47:41.291+0000 7fc863a11800 5 asok(0x55eb73482630) register_command cr dump hook 0x55eb73778988 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:47:41.293+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:47:41.293+0000 7fc7417fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:47:41.293+0000 7fc7417fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:47:41.293+0000 7fc7417fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:47:41.293+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc728076470 auth_method 0 2024-09-12T00:47:41.653 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:47:41.293+0000 7fc85f949640 10 monclient: get_auth_request con 0x55eb7378c080 auth_method 0 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 realm 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:47:41.294+0000 7fc863a11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:47:41.294+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:47:41.295+0000 7fc85f148640 10 monclient: get_auth_request con 0x55eb73790380 auth_method 0 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:47:41.295+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:47:41.295+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:47:41.295+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:41.654 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:47:41.295+0000 7fc863a11800 20 searching for the correct realm 2024-09-12T00:47:41.655 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:47:41.296+0000 7fc856947640 10 monclient: get_auth_request con 0x55eb737954f0 auth_method 0 2024-09-12T00:47:41.655 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:47:41.296+0000 7fc85f949640 10 monclient: get_auth_request con 0x7fc84809d570 auth_method 0 2024-09-12T00:47:41.655 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:47:41.297+0000 7fc85f148640 0 -- 172.21.15.19:0/3708065929 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55eb73790380 msgr2=0x55eb73792770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:41.655 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:47:41.297+0000 7fc7417fa640 1 client.6458.objecter ms_handle_reset 0x55eb73790380 session 0x55eb7378f200 osd.1 2024-09-12T00:47:41.655 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:47:41.298+0000 7fc7417fa640 10 monclient: _renew_subs 2024-09-12T00:47:41.655 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:47:41.298+0000 7fc7417fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:47:41.655 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:47:41.298+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc850018030 auth_method 0 2024-09-12T00:47:41.655 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:47:41.298+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc728086790 auth_method 0 2024-09-12T00:47:41.655 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:47:41.299+0000 7fc856947640 10 monclient: get_auth_request con 0x7fc84805f680 auth_method 0 2024-09-12T00:47:41.655 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:47:41.301+0000 7fc85f949640 10 monclient: get_auth_request con 0x55eb73790380 auth_method 0 2024-09-12T00:47:41.655 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:47:41.301+0000 7fc85f949640 0 -- 172.21.15.19:0/3708065929 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x55eb73790380 msgr2=0x7fc850060450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:47:41.503+0000 7fc85f949640 10 monclient: get_auth_request con 0x55eb73790380 auth_method 0 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:47:41.504+0000 7fc85f148640 10 monclient: get_auth_request con 0x7fc858083040 auth_method 0 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:47:41.509+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:41.656 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 zone default found 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:47:41.510+0000 7fc863a11800 4 Realm: () 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:47:41.510+0000 7fc863a11800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:47:41.510+0000 7fc863a11800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:47:41.510+0000 7fc863a11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 zonegroup default 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:47:41.510+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:47:41.511+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:47:41.511+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:47:41.511+0000 7fc863a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.657 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:47:41.511+0000 7fc863a11800 20 started sync module instance, tier type = 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:47:41.511+0000 7fc863a11800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=0 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=1 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=2 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=3 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=4 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=5 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:47:41.520+0000 7fc863a11800 20 add_watcher() i=6 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:47:41.521+0000 7fc863a11800 20 add_watcher() i=7 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:47:41.521+0000 7fc863a11800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding auth protocol: cephx 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding auth protocol: cephx 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding auth protocol: cephx 2024-09-12T00:47:41.658 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: crc 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 AuthRegistry(0x7fff450852a0) adding con mode: secure 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:47:41.523+0000 7fc715fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:47:41.523+0000 7fc863a11800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:47:41.523+0000 7fc863a11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:41.659 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:47:41.523+0000 7fc863a11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 asok(0x55eb73482630) register_command cache list hook 0x55eb737788f0 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 asok(0x55eb73482630) register_command cache inspect hook 0x55eb737788f0 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 asok(0x55eb73482630) register_command cache erase hook 0x55eb737788f0 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 asok(0x55eb73482630) register_command cache zap hook 0x55eb737788f0 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:47:41.523+0000 7fc863a11800 5 note: GC not initialized 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:47:41.524+0000 7fc714fe1640 20 reqs_thread_entry: start 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:47:41.524+0000 7fc863a11800 5 asok(0x55eb73482630) register_command sync trace show hook 0x7fc84807b070 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:47:41.524+0000 7fc863a11800 5 asok(0x55eb73482630) register_command sync trace history hook 0x7fc84807b070 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:47:41.524+0000 7fc863a11800 5 asok(0x55eb73482630) register_command sync trace active hook 0x7fc84807b070 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:47:41.524+0000 7fc863a11800 5 asok(0x55eb73482630) register_command sync trace active_short hook 0x7fc84807b070 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:47:41.524+0000 7fc863a11800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:47:41.524+0000 7fc863a11800 20 Filter name: none 2024-09-12T00:47:41.660 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:47:41.524+0000 7fc68e7fc640 20 reqs_thread_entry: start 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:47:41.524+0000 7fc863a11800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:47:41.524+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:47:41.524+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:47:41.524+0000 7fc863a11800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:47:41.524+0000 7fc863a11800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:47:41.524+0000 7fc863a11800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 : miss 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:47:41.524+0000 7fc863a11800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:47:41.525+0000 7fc863a11800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:47:41.525+0000 7fc863a11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:47:41.525+0000 7fc863a11800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:47:41.525+0000 7fc863a11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:47:41.525+0000 7fc863a11800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:47:41.525+0000 7fc863a11800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 2024-09-12T00:47:41.661 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:47:41.530+0000 7fc863a11800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:47:41.530+0000 7fc863a11800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:47:41.530+0000 7fc863a11800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:47:41.530+0000 7fc863a11800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27, ofs0, ns] 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398950 cookie 94469743035296 notifier 6458 bl.length()=939 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:47:41.530+0000 7fc742ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_sources= new_sources= 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential sources added=[] removed=[] 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_dests= new_dests= 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:47:41.532+0000 7fc863a11800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential dests added=[] removed=[] 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:47:41.533+0000 7fc863a11800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc863a11800 time 2024-09-12T00:47:41.534133+0000 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:47:41.662 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc864b8c71a] 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc864b8c8d8] 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eb72214641] 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd884de) [0x55eb727274de] 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55eb7222431d] 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc863829590] 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:47:41.534+0000 7fc863a11800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fc863a11800 thread_name:radosgw-admin 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.663 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc86383e6f0] 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc86388b99c] 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc864b8c774] 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc864b8c8d8] 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55eb72214641] 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd884de) [0x55eb727274de] 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55eb7222431d] 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc863829590] 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:47:41.664 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:47:41.665 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:47:41.666 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:47:41.667 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:47:41.668 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:47:41.669 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:47:41.670 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc68e7fc640 / http_manager 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc714fe1640 / http_manager 2024-09-12T00:47:41.671 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc715fe3640 / rgw_dt_lg_renew 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc7417fa640 / ms_dispatch 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc742ffd640 / io_context_pool 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc749602640 / ms_dispatch 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc74be07640 / ms_dispatch 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc74d60a640 / io_context_pool 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc856947640 / msgr-worker-2 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc85f148640 / msgr-worker-1 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc85f949640 / msgr-worker-0 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc86014a640 / io_context_pool 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc863a11800 / radosgw-admin 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:47:41.535884Z_e1541a07-c856-4e23-a74d-bdcfc6c172c9/log 2024-09-12T00:47:41.672 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:47:41.673 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:47:41.674 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:41.674 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:41.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.613+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.615+0000 7fed5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.615+0000 7fed5260e800 20 realm 2024-09-12T00:47:41.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.615+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.616+0000 7fed5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.616+0000 7fed5260e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:41.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.616+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.616+0000 7fed5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.616+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.617+0000 7fed5260e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:41.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.617+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.617+0000 7fed5260e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:41.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.617+0000 7fed5260e800 20 searching for the correct realm 2024-09-12T00:47:41.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.620+0000 7fed4d56a640 0 -- 172.21.15.19:0/2745921657 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fed44043900 msgr2=0x7fed4400d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:47:41.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.825+0000 7fed4e56c640 0 -- 172.21.15.19:0/2745921657 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5644311047b0 msgr2=0x564431106c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:41.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.829+0000 7fed5260e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:41.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.829+0000 7fed5260e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:41.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.829+0000 7fed5260e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:41.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.829+0000 7fed5260e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:41.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.829+0000 7fed5260e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:41.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.829+0000 7fed5260e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:41.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.829+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.829+0000 7fed5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.829+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:41.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:41.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 20 zone default found 2024-09-12T00:47:41.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 4 Realm: () 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 20 zonegroup default 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.830+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.831+0000 7fed5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.831+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.831+0000 7fed5260e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.831+0000 7fed5260e800 20 started sync module instance, tier type = 2024-09-12T00:47:41.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.831+0000 7fed5260e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:41.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.842+0000 7fed5260e800 20 add_watcher() i=0 2024-09-12T00:47:41.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.842+0000 7fed5260e800 20 add_watcher() i=1 2024-09-12T00:47:41.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.842+0000 7fed5260e800 20 add_watcher() i=2 2024-09-12T00:47:41.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.842+0000 7fed5260e800 20 add_watcher() i=3 2024-09-12T00:47:41.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.842+0000 7fed5260e800 20 add_watcher() i=4 2024-09-12T00:47:41.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.842+0000 7fed5260e800 20 add_watcher() i=5 2024-09-12T00:47:41.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.842+0000 7fed5260e800 20 add_watcher() i=6 2024-09-12T00:47:41.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.843+0000 7fed5260e800 20 add_watcher() i=7 2024-09-12T00:47:41.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.843+0000 7fed5260e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:41.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.845+0000 7febf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:41.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.845+0000 7fed5260e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:41.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.845+0000 7fed5260e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:41.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.845+0000 7fed5260e800 5 note: GC not initialized 2024-09-12T00:47:41.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.846+0000 7febf67fc640 20 reqs_thread_entry: start 2024-09-12T00:47:41.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.846+0000 7fed5260e800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:41.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.846+0000 7fed5260e800 20 Filter name: none 2024-09-12T00:47:41.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.846+0000 7feb6ffff640 20 reqs_thread_entry: start 2024-09-12T00:47:41.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.846+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.846+0000 7fed5260e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:41.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.846+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.847+0000 7fed5260e800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:47:41.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.847+0000 7fed5260e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:41.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.847+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.847+0000 7fed5260e800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:41.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.847+0000 7fed5260e800 20 rados->read ofs=0 len=0 2024-09-12T00:47:41.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.847+0000 7fed5260e800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:47:41.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.847+0000 7fed5260e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:47:41.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.849+0000 7febf77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:41.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.851+0000 7fed5260e800 20 remove_watcher() i=0 2024-09-12T00:47:41.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.851+0000 7fed5260e800 2 removed watcher, disabling cache 2024-09-12T00:47:41.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.852+0000 7fed5260e800 20 remove_watcher() i=1 2024-09-12T00:47:41.853 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.853+0000 7fed5260e800 20 remove_watcher() i=2 2024-09-12T00:47:41.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.855+0000 7fed5260e800 20 remove_watcher() i=3 2024-09-12T00:47:41.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.856+0000 7fed5260e800 20 remove_watcher() i=4 2024-09-12T00:47:41.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.857+0000 7fed5260e800 20 remove_watcher() i=5 2024-09-12T00:47:41.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.858+0000 7fed5260e800 20 remove_watcher() i=6 2024-09-12T00:47:41.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:41.859+0000 7fed5260e800 20 remove_watcher() i=7 2024-09-12T00:47:41.870 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.870 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:47:41.870 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-trim-reshard-log-entries id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:47:41.871 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:47:41.872 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:41.872 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:41.902 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:47:41.902 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:47:41.960 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:47:41.992 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:47:41.992 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:47:42.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.031+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.033+0000 7fcf66a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.033+0000 7fcf66a10800 20 realm 2024-09-12T00:47:42.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.033+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.033+0000 7fcf66a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.033+0000 7fcf66a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:47:42.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.033+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.033+0000 7fcf66a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.033+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.034+0000 7fcf66a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:42.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.034+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.035+0000 7fcf66a10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:47:42.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.035+0000 7fcf66a10800 20 searching for the correct realm 2024-09-12T00:47:42.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.038+0000 7fcf61979640 0 -- 172.21.15.19:0/79639771 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fcf5808b950 msgr2=0x7fcf5808a3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:42.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.244+0000 7fcf61979640 0 -- 172.21.15.19:0/79639771 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5643ae2a1040 msgr2=0x5643ae2a34c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:47:42.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.248+0000 7fcf66a10800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:47:42.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.248+0000 7fcf66a10800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:47:42.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.248+0000 7fcf66a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:47:42.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.248+0000 7fcf66a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:47:42.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.248+0000 7fcf66a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:47:42.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.248+0000 7fcf66a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:47:42.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.248+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.248+0000 7fcf66a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.248+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:47:42.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:47:42.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 20 zone default found 2024-09-12T00:47:42.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 4 Realm: () 2024-09-12T00:47:42.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:47:42.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:47:42.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:47:42.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 20 zonegroup default 2024-09-12T00:47:42.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.249+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.250+0000 7fcf66a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.250+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.250+0000 7fcf66a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:47:42.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.250+0000 7fcf66a10800 20 started sync module instance, tier type = 2024-09-12T00:47:42.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.250+0000 7fcf66a10800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:47:42.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.259+0000 7fcf66a10800 20 add_watcher() i=0 2024-09-12T00:47:42.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.259+0000 7fcf66a10800 20 add_watcher() i=1 2024-09-12T00:47:42.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.259+0000 7fcf66a10800 20 add_watcher() i=2 2024-09-12T00:47:42.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.259+0000 7fcf66a10800 20 add_watcher() i=3 2024-09-12T00:47:42.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.259+0000 7fcf66a10800 20 add_watcher() i=4 2024-09-12T00:47:42.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.259+0000 7fcf66a10800 20 add_watcher() i=5 2024-09-12T00:47:42.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.259+0000 7fcf66a10800 20 add_watcher() i=6 2024-09-12T00:47:42.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.260+0000 7fcf66a10800 20 add_watcher() i=7 2024-09-12T00:47:42.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.260+0000 7fcf66a10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:47:42.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.262+0000 7fce18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:42.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.262+0000 7fcf66a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:47:42.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.262+0000 7fcf66a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:47:42.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.262+0000 7fcf66a10800 5 note: GC not initialized 2024-09-12T00:47:42.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.262+0000 7fcd937fe640 20 reqs_thread_entry: start 2024-09-12T00:47:42.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.262+0000 7fcf66a10800 20 init_complete bucket index max shards: 11 2024-09-12T00:47:42.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.262+0000 7fcf66a10800 20 Filter name: none 2024-09-12T00:47:42.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcd917fa640 20 reqs_thread_entry: start 2024-09-12T00:47:42.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:47:42.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:47:42.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:47:42.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:47:42.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 : miss 2024-09-12T00:47:42.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 20 rados->read ofs=0 len=0 2024-09-12T00:47:42.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:47:42.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:47:42.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:47:42.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:47:42.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:47:42.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.263+0000 7fcf66a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 2024-09-12T00:47:42.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.265+0000 7fcf66a10800 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to be held by another RGW process; skipping for now 2024-09-12T00:47:42.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.265+0000 7fce18fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:47:42.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.268+0000 7fcf66a10800 20 remove_watcher() i=0 2024-09-12T00:47:42.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.268+0000 7fcf66a10800 2 removed watcher, disabling cache 2024-09-12T00:47:42.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.269+0000 7fcf66a10800 20 remove_watcher() i=1 2024-09-12T00:47:42.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.270+0000 7fcf66a10800 20 remove_watcher() i=2 2024-09-12T00:47:42.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.271+0000 7fcf66a10800 20 remove_watcher() i=3 2024-09-12T00:47:42.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.272+0000 7fcf66a10800 20 remove_watcher() i=4 2024-09-12T00:47:42.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.273+0000 7fcf66a10800 20 remove_watcher() i=5 2024-09-12T00:47:42.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.274+0000 7fcf66a10800 20 remove_watcher() i=6 2024-09-12T00:47:42.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:47:42.275+0000 7fcf66a10800 20 remove_watcher() i=7 2024-09-12T00:47:42.286 INFO:tasks.workunit.client.0.smithi019.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:48:12.302 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:48:12.339 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:12.339 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:12.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.387+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.388+0000 7fe54b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.388+0000 7fe54b935800 20 realm 2024-09-12T00:48:12.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.388+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.388+0000 7fe54b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.388+0000 7fe54b935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:12.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.388+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.389+0000 7fe54b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.389+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.389+0000 7fe54b935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:12.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.390+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.390+0000 7fe54b935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:12.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.390+0000 7fe54b935800 20 searching for the correct realm 2024-09-12T00:48:12.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.394+0000 7fe546ee3640 0 -- 172.21.15.19:0/3029856174 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fe53c0aebf0 msgr2=0x7fe53c0d89e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:12.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.601+0000 7fe547ee5640 0 -- 172.21.15.19:0/3029856174 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5578001ff1b0 msgr2=0x557800201600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:12.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.606+0000 7fe54b935800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:12.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.606+0000 7fe54b935800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:12.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.606+0000 7fe54b935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:12.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.606+0000 7fe54b935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:12.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.606+0000 7fe54b935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:12.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.606+0000 7fe54b935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:12.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.606+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:12.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 20 zone default found 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 4 Realm: () 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 20 zonegroup default 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.607+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.608+0000 7fe54b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.608+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.608+0000 7fe54b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.608+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.608+0000 7fe54b935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.608+0000 7fe54b935800 20 started sync module instance, tier type = 2024-09-12T00:48:12.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.608+0000 7fe54b935800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:12.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.624+0000 7fe54b935800 20 add_watcher() i=0 2024-09-12T00:48:12.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.624+0000 7fe54b935800 20 add_watcher() i=1 2024-09-12T00:48:12.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.624+0000 7fe54b935800 20 add_watcher() i=2 2024-09-12T00:48:12.622 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.624+0000 7fe54b935800 20 add_watcher() i=3 2024-09-12T00:48:12.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.624+0000 7fe54b935800 20 add_watcher() i=4 2024-09-12T00:48:12.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.624+0000 7fe54b935800 20 add_watcher() i=5 2024-09-12T00:48:12.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.624+0000 7fe54b935800 20 add_watcher() i=6 2024-09-12T00:48:12.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.625+0000 7fe54b935800 20 add_watcher() i=7 2024-09-12T00:48:12.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.625+0000 7fe54b935800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:12.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.627+0000 7fe3fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:12.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.627+0000 7fe54b935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:12.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.627+0000 7fe54b935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:12.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.627+0000 7fe54b935800 5 note: GC not initialized 2024-09-12T00:48:12.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.627+0000 7fe3fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:48:12.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.627+0000 7fe54b935800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:12.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.627+0000 7fe54b935800 20 Filter name: none 2024-09-12T00:48:12.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.628+0000 7fe3767fc640 20 reqs_thread_entry: start 2024-09-12T00:48:12.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.628+0000 7fe54b935800 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:48:12.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.628+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.628+0000 7fe54b935800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:48:12.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.628+0000 7fe54b935800 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:48:12.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.628+0000 7fe54b935800 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:48:12.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.628+0000 7fe54b935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 : miss 2024-09-12T00:48:12.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.628+0000 7fe54b935800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.629+0000 7fe54b935800 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:48:12.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.629+0000 7fe54b935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:48:12.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.629+0000 7fe54b935800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:48:12.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.629+0000 7fe54b935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:12.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.629+0000 7fe54b935800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:12.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.629+0000 7fe54b935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 2024-09-12T00:48:12.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.630+0000 7fe54b935800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:48:12.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.637+0000 7fe54b935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:48:12.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.637+0000 7fe54b935800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:48:12.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.637+0000 7fe54b935800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:12.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.637+0000 7fe54b935800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27, ofs0, ns] 2024-09-12T00:48:12.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.638+0000 7fe42a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398951 cookie 93973886595808 notifier 6509 bl.length()=939 2024-09-12T00:48:12.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.638+0000 7fe42a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:48:12.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.638+0000 7fe42a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:48:12.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.638+0000 7fe42a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:12.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.640+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_sources= new_sources= 2024-09-12T00:48:12.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.640+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential sources added=[] removed=[] 2024-09-12T00:48:12.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.640+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_dests= new_dests= 2024-09-12T00:48:12.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.640+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential dests added=[] removed=[] 2024-09-12T00:48:12.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.0 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.0 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.1 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.1 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.2 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.2 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.3 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.3 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.4 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.4 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.5 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.5 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.6 2024-09-12T00:48:12.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.6 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.7 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.7 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.8 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.8 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.9 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.9 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.10 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.10 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.11 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2.11 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.644+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.0 2024-09-12T00:48:12.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.645+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.1 2024-09-12T00:48:12.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.645+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2 2024-09-12T00:48:12.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.646+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.3 2024-09-12T00:48:12.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.646+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.4 2024-09-12T00:48:12.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.647+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.5 2024-09-12T00:48:12.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.648+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.6 2024-09-12T00:48:12.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.648+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.7 2024-09-12T00:48:12.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.649+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.8 2024-09-12T00:48:12.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.649+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.9 2024-09-12T00:48:12.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.650+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.10 2024-09-12T00:48:12.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.654+0000 7fe54b935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:12.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.654+0000 7fe54b935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 2024-09-12T00:48:12.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.655+0000 7fe54b935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:48:12.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.655+0000 7fe54b935800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:48:12.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.655+0000 7fe54b935800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:12.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.655+0000 7fe54b935800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27, ofs0, ns] 2024-09-12T00:48:12.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.656+0000 7fe42a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398952 cookie 93973886595808 notifier 6509 bl.length()=939 2024-09-12T00:48:12.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.656+0000 7fe42a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:48:12.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.656+0000 7fe42a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:48:12.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.656+0000 7fe42a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:12.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.658+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_sources= new_sources= 2024-09-12T00:48:12.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.658+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential sources added=[] removed=[] 2024-09-12T00:48:12.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.658+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_dests= new_dests= 2024-09-12T00:48:12.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.658+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential dests added=[] removed=[] 2024-09-12T00:48:12.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.660+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.0 2024-09-12T00:48:12.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.660+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.1 2024-09-12T00:48:12.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.661+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.2 2024-09-12T00:48:12.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.661+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.3 2024-09-12T00:48:12.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.662+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.4 2024-09-12T00:48:12.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.662+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.5 2024-09-12T00:48:12.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.662+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.6 2024-09-12T00:48:12.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.662+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.7 2024-09-12T00:48:12.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.663+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.8 2024-09-12T00:48:12.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.663+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.9 2024-09-12T00:48:12.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.664+0000 7fe54b935800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27.10 2024-09-12T00:48:12.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.664+0000 7fe54b935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:12.663 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.664+0000 7fe54b935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 2024-09-12T00:48:12.664 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.665+0000 7fe54b935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:48:12.664 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.665+0000 7fe54b935800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:48:12.664 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.665+0000 7fe54b935800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:12.664 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.665+0000 7fe54b935800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27, ofs0, ns] 2024-09-12T00:48:12.664 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.666+0000 7fe42affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398953 cookie 93973886595808 notifier 6509 bl.length()=907 2024-09-12T00:48:12.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.666+0000 7fe42affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 info.flags=0x17 2024-09-12T00:48:12.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.666+0000 7fe42affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 to cache LRU end 2024-09-12T00:48:12.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.666+0000 7fe42affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:12.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.667+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_sources= new_sources= 2024-09-12T00:48:12.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.667+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential sources added=[] removed=[] 2024-09-12T00:48:12.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.667+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): orig_dests= new_dests= 2024-09-12T00:48:12.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.667+0000 7fe54b935800 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27]): potential dests added=[] removed=[] 2024-09-12T00:48:12.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.670+0000 7fe54b935800 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:48:12.670 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.672+0000 7fe3fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:12.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.674+0000 7fe54b935800 20 remove_watcher() i=0 2024-09-12T00:48:12.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.674+0000 7fe54b935800 2 removed watcher, disabling cache 2024-09-12T00:48:12.673 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.675+0000 7fe54b935800 20 remove_watcher() i=1 2024-09-12T00:48:12.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.676+0000 7fe54b935800 20 remove_watcher() i=2 2024-09-12T00:48:12.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.677+0000 7fe54b935800 20 remove_watcher() i=3 2024-09-12T00:48:12.677 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.678+0000 7fe54b935800 20 remove_watcher() i=4 2024-09-12T00:48:12.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.679+0000 7fe54b935800 20 remove_watcher() i=5 2024-09-12T00:48:12.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.680+0000 7fe54b935800 20 remove_watcher() i=6 2024-09-12T00:48:12.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.681+0000 7fe54b935800 20 remove_watcher() i=7 2024-09-12T00:48:12.693 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:48:12.723 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:12.723 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:12.762 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.763+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.765+0000 7f9a3b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.765+0000 7f9a3b698800 20 realm 2024-09-12T00:48:12.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.765+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.766+0000 7f9a3b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.766+0000 7f9a3b698800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:12.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.766+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.766+0000 7f9a3b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.766+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.766+0000 7f9a3b698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:12.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.766+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.767+0000 7f9a3b698800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:12.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.767+0000 7f9a3b698800 20 searching for the correct realm 2024-09-12T00:48:12.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.771+0000 7f9a39182640 0 -- 172.21.15.19:0/3850051272 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f9a2c06d070 msgr2=0x7f9a2c0acb40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:12.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.774+0000 7f9a39182640 0 -- 172.21.15.19:0/3850051272 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55c104ee2c90 msgr2=0x55c104ee5080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:12.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.778+0000 7f9a3b698800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:12.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.778+0000 7f9a3b698800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:12.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.778+0000 7f9a3b698800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:12.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.778+0000 7f9a3b698800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:12.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.778+0000 7f9a3b698800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:12.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.778+0000 7f9a3b698800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:12.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.778+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.778+0000 7f9a3b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.778+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.778+0000 7f9a3b698800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:12.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.778+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 20 zone default found 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 4 Realm: () 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 20 zonegroup default 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:12.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 20 started sync module instance, tier type = 2024-09-12T00:48:12.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.779+0000 7f9a3b698800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:12.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.788+0000 7f9a3b698800 20 add_watcher() i=0 2024-09-12T00:48:12.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.788+0000 7f9a3b698800 20 add_watcher() i=1 2024-09-12T00:48:12.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.788+0000 7f9a3b698800 20 add_watcher() i=2 2024-09-12T00:48:12.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.788+0000 7f9a3b698800 20 add_watcher() i=3 2024-09-12T00:48:12.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.788+0000 7f9a3b698800 20 add_watcher() i=4 2024-09-12T00:48:12.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.788+0000 7f9a3b698800 20 add_watcher() i=5 2024-09-12T00:48:12.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.788+0000 7f9a3b698800 20 add_watcher() i=6 2024-09-12T00:48:12.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.789+0000 7f9a3b698800 20 add_watcher() i=7 2024-09-12T00:48:12.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.789+0000 7f9a3b698800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:12.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.791+0000 7f98effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:12.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.791+0000 7f9a3b698800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:12.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.791+0000 7f9a3b698800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:12.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.791+0000 7f9a3b698800 5 note: GC not initialized 2024-09-12T00:48:12.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.791+0000 7f98eefe5640 20 reqs_thread_entry: start 2024-09-12T00:48:12.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.791+0000 7f9a3b698800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:12.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.792+0000 7f9a3b698800 20 Filter name: none 2024-09-12T00:48:12.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.792+0000 7f98ecfe1640 20 reqs_thread_entry: start 2024-09-12T00:48:12.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.792+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.792+0000 7f9a3b698800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:48:12.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.792+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.793+0000 7f9a3b698800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:48:12.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.793+0000 7f9a3b698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:12.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.793+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.793+0000 7f9a3b698800 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:48:12.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.793+0000 7f9a3b698800 20 rados->read ofs=0 len=0 2024-09-12T00:48:12.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.793+0000 7f9a3b698800 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:48:12.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.793+0000 7f9a3b698800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:12.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.795+0000 7f98effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:12.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.798+0000 7f9a3b698800 20 remove_watcher() i=0 2024-09-12T00:48:12.796 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.798+0000 7f9a3b698800 2 removed watcher, disabling cache 2024-09-12T00:48:12.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.799+0000 7f9a3b698800 20 remove_watcher() i=1 2024-09-12T00:48:12.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.800+0000 7f9a3b698800 20 remove_watcher() i=2 2024-09-12T00:48:12.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.801+0000 7f9a3b698800 20 remove_watcher() i=3 2024-09-12T00:48:12.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.802+0000 7f9a3b698800 20 remove_watcher() i=4 2024-09-12T00:48:12.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.803+0000 7f9a3b698800 20 remove_watcher() i=5 2024-09-12T00:48:12.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.804+0000 7f9a3b698800 20 remove_watcher() i=6 2024-09-12T00:48:12.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:12.805+0000 7f9a3b698800 20 remove_watcher() i=7 2024-09-12T00:48:12.814 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:12.814 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:12.814 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-trim-reshard-log-entries id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:48:12.814 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:12.817 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:12.817 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:12.838 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:12.838 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.037 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.037 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.176 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:48:13.176 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:13.177 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.177 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.227 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.227 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.284 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.285 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.322 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.322 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.355 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.355 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.389 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.389 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.423 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.423 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.457 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.457 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.491 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.491 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.525 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.526 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.559 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.559 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.594 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.594 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.628 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.628 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.662 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.662 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.695 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.695 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.729 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.729 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.762 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.762 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.796 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.796 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.829 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.830 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.863 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.863 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.897 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.898 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.931 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:13.932 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:13.965 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:48:13.995 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:13.995 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:14.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.035+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.037+0000 7f8742a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.037+0000 7f8742a14800 20 realm 2024-09-12T00:48:14.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.037+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.037+0000 7f8742a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.037+0000 7f8742a14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:14.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.037+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.037+0000 7f8742a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.037+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.038+0000 7f8742a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:14.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.038+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.038+0000 7f8742a14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:14.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.038+0000 7f8742a14800 20 searching for the correct realm 2024-09-12T00:48:14.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.042+0000 7f873d8ca640 0 -- 172.21.15.19:0/2740248917 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f87340e11a0 msgr2=0x7f87340cd130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:14.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.248+0000 7f873e8cc640 0 -- 172.21.15.19:0/2740248917 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55f298159f70 msgr2=0x55f29815c3e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:14.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:14.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:14.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:14.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:14.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:14.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:14.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:14.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 zone default found 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 4 Realm: () 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 zonegroup default 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.252+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.253+0000 7f8742a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.253+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.253+0000 7f8742a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.253+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.254+0000 7f8742a14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.254+0000 7f8742a14800 20 started sync module instance, tier type = 2024-09-12T00:48:14.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.254+0000 7f8742a14800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:14.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.263+0000 7f8742a14800 20 add_watcher() i=0 2024-09-12T00:48:14.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.263+0000 7f8742a14800 20 add_watcher() i=1 2024-09-12T00:48:14.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.263+0000 7f8742a14800 20 add_watcher() i=2 2024-09-12T00:48:14.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.263+0000 7f8742a14800 20 add_watcher() i=3 2024-09-12T00:48:14.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.263+0000 7f8742a14800 20 add_watcher() i=4 2024-09-12T00:48:14.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.263+0000 7f8742a14800 20 add_watcher() i=5 2024-09-12T00:48:14.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.263+0000 7f8742a14800 20 add_watcher() i=6 2024-09-12T00:48:14.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.264+0000 7f8742a14800 20 add_watcher() i=7 2024-09-12T00:48:14.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.264+0000 7f8742a14800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:14.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.266+0000 7f85f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:14.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.266+0000 7f8742a14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:14.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.266+0000 7f8742a14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:14.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.266+0000 7f8742a14800 5 note: GC not initialized 2024-09-12T00:48:14.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.267+0000 7f856f7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:14.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.267+0000 7f8742a14800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:14.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.267+0000 7f8742a14800 20 Filter name: none 2024-09-12T00:48:14.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.267+0000 7f856d7fa640 20 reqs_thread_entry: start 2024-09-12T00:48:14.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.267+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.267+0000 7f8742a14800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:14.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.267+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.268+0000 7f8742a14800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:14.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.268+0000 7f8742a14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:14.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.268+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.269+0000 7f8742a14800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:14.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.269+0000 7f8742a14800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.269+0000 7f8742a14800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:14.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.269+0000 7f8742a14800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:14.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.271+0000 7f85f4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:14.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.273+0000 7f8742a14800 20 remove_watcher() i=0 2024-09-12T00:48:14.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.273+0000 7f8742a14800 2 removed watcher, disabling cache 2024-09-12T00:48:14.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.274+0000 7f8742a14800 20 remove_watcher() i=1 2024-09-12T00:48:14.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.275+0000 7f8742a14800 20 remove_watcher() i=2 2024-09-12T00:48:14.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.276+0000 7f8742a14800 20 remove_watcher() i=3 2024-09-12T00:48:14.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.277+0000 7f8742a14800 20 remove_watcher() i=4 2024-09-12T00:48:14.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.278+0000 7f8742a14800 20 remove_watcher() i=5 2024-09-12T00:48:14.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.279+0000 7f8742a14800 20 remove_watcher() i=6 2024-09-12T00:48:14.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.279+0000 7f8742a14800 20 remove_watcher() i=7 2024-09-12T00:48:14.289 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:14.289 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:14.289 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-block-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:48:14.290 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:14.291 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:48:14.326 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:14.327 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:14.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.367+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.368+0000 7f3aaa52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.368+0000 7f3aaa52e800 20 realm 2024-09-12T00:48:14.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.368+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.368+0000 7f3aaa52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.368+0000 7f3aaa52e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:14.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.368+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.369+0000 7f3aaa52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.369+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.369+0000 7f3aaa52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:14.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.369+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.370+0000 7f3aaa52e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:14.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.370+0000 7f3aaa52e800 20 searching for the correct realm 2024-09-12T00:48:14.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.373+0000 7f3a9dadc640 0 -- 172.21.15.19:0/9759893 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3a900633d0 msgr2=0x7f3a90063830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:14.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.580+0000 7f3aa6ade640 0 -- 172.21.15.19:0/9759893 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x557aee752140 msgr2=0x557aee754570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:14.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.584+0000 7f3aaa52e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:14.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.584+0000 7f3aaa52e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:14.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.584+0000 7f3aaa52e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:14.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.584+0000 7f3aaa52e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:14.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.584+0000 7f3aaa52e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:14.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.584+0000 7f3aaa52e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:14.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.584+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.584+0000 7f3aaa52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.584+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.584 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.584+0000 7f3aaa52e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.584+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 20 zone default found 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 4 Realm: () 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 20 zonegroup default 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.585+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.586+0000 7f3aaa52e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.586+0000 7f3aaa52e800 20 started sync module instance, tier type = 2024-09-12T00:48:14.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.586+0000 7f3aaa52e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:14.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.594+0000 7f3aaa52e800 20 add_watcher() i=0 2024-09-12T00:48:14.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.594+0000 7f3aaa52e800 20 add_watcher() i=1 2024-09-12T00:48:14.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.594+0000 7f3aaa52e800 20 add_watcher() i=2 2024-09-12T00:48:14.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.594+0000 7f3aaa52e800 20 add_watcher() i=3 2024-09-12T00:48:14.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.594+0000 7f3aaa52e800 20 add_watcher() i=4 2024-09-12T00:48:14.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.594+0000 7f3aaa52e800 20 add_watcher() i=5 2024-09-12T00:48:14.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.594+0000 7f3aaa52e800 20 add_watcher() i=6 2024-09-12T00:48:14.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.595+0000 7f3aaa52e800 20 add_watcher() i=7 2024-09-12T00:48:14.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.595+0000 7f3aaa52e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:14.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.596+0000 7f395cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:14.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.596+0000 7f3aaa52e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:14.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.596+0000 7f3aaa52e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:14.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f3aaa52e800 5 note: GC not initialized 2024-09-12T00:48:14.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f38d77fe640 20 reqs_thread_entry: start 2024-09-12T00:48:14.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f3aaa52e800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:14.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f3aaa52e800 20 Filter name: none 2024-09-12T00:48:14.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f38d57fa640 20 reqs_thread_entry: start 2024-09-12T00:48:14.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f3aaa52e800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:48:14.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f3aaa52e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:14.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f3aaa52e800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:48:14.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f3aaa52e800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:48:14.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f3aaa52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 : miss 2024-09-12T00:48:14.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.597+0000 7f3aaa52e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.598+0000 7f3aaa52e800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:14.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.598+0000 7f3aaa52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:14.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.598+0000 7f3aaa52e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:14.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.598+0000 7f3aaa52e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:14.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.598+0000 7f3aaa52e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:14.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.598+0000 7f3aaa52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 2024-09-12T00:48:14.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.603+0000 7f3aaa52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:14.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.603+0000 7f3aaa52e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:14.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.603+0000 7f3aaa52e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:14.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.603+0000 7f3aaa52e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28, ofs0, ns] 2024-09-12T00:48:14.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.603+0000 7f3989ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398956 cookie 93986475095712 notifier 6966 bl.length()=915 2024-09-12T00:48:14.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.603+0000 7f3989ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:14.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.603+0000 7f3989ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:14.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.603+0000 7f3989ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:14.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.605+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_sources= new_sources= 2024-09-12T00:48:14.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.605+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential sources added=[] removed=[] 2024-09-12T00:48:14.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.605+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_dests= new_dests= 2024-09-12T00:48:14.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.605+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential dests added=[] removed=[] 2024-09-12T00:48:14.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.0 2024-09-12T00:48:14.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.0 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.1 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.1 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.2 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.2 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.3 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.3 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.4 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.4 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.5 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.5 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.6 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.6 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.7 2024-09-12T00:48:14.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.7 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.8 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.8 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.9 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.9 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.10 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.10 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.11 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.11 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.609+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.0 2024-09-12T00:48:14.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.610+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1 2024-09-12T00:48:14.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.610+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.2 2024-09-12T00:48:14.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.611+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.3 2024-09-12T00:48:14.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.611+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.4 2024-09-12T00:48:14.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.612+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.5 2024-09-12T00:48:14.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.612+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.6 2024-09-12T00:48:14.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.613+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.7 2024-09-12T00:48:14.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.613+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.8 2024-09-12T00:48:14.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.614+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.9 2024-09-12T00:48:14.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.614+0000 7f3aaa52e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.10 2024-09-12T00:48:14.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.617+0000 7f3aaa52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:14.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.617+0000 7f3aaa52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 2024-09-12T00:48:14.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.618+0000 7f3aaa52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:14.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.618+0000 7f3aaa52e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:14.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.618+0000 7f3aaa52e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:14.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.618+0000 7f3aaa52e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28, ofs0, ns] 2024-09-12T00:48:14.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.619+0000 7f39897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398957 cookie 93986475095712 notifier 6966 bl.length()=915 2024-09-12T00:48:14.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.619+0000 7f39897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:14.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.619+0000 7f39897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:14.618 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.619+0000 7f39897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:14.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.620+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_sources= new_sources= 2024-09-12T00:48:14.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.620+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential sources added=[] removed=[] 2024-09-12T00:48:14.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.620+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_dests= new_dests= 2024-09-12T00:48:14.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.620+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential dests added=[] removed=[] 2024-09-12T00:48:14.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.620+0000 7f3aaa52e800 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:48:14.620 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.620+0000 7f3aaa52e800 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:48:14.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.625+0000 7f3aaa52e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:14.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.625+0000 7f3aaa52e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 2024-09-12T00:48:14.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.626+0000 7f3aaa52e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:14.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.626+0000 7f3aaa52e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:14.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.626+0000 7f3aaa52e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:14.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.626+0000 7f3aaa52e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28, ofs0, ns] 2024-09-12T00:48:14.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.626+0000 7f3989ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398958 cookie 93986475095712 notifier 6966 bl.length()=883 2024-09-12T00:48:14.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.626+0000 7f3989ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:14.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.626+0000 7f3989ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:14.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.626+0000 7f3989ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:14.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.628+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_sources= new_sources= 2024-09-12T00:48:14.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.628+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential sources added=[] removed=[] 2024-09-12T00:48:14.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.628+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_dests= new_dests= 2024-09-12T00:48:14.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.628+0000 7f3aaa52e800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential dests added=[] removed=[] 2024-09-12T00:48:14.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.630+0000 7f3aaa52e800 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:48:14.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.632+0000 7f395cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:14.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.634+0000 7f3aaa52e800 20 remove_watcher() i=0 2024-09-12T00:48:14.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.634+0000 7f3aaa52e800 2 removed watcher, disabling cache 2024-09-12T00:48:14.634 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.635+0000 7f3aaa52e800 20 remove_watcher() i=1 2024-09-12T00:48:14.635 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.636+0000 7f3aaa52e800 20 remove_watcher() i=2 2024-09-12T00:48:14.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.638+0000 7f3aaa52e800 20 remove_watcher() i=3 2024-09-12T00:48:14.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.639+0000 7f3aaa52e800 20 remove_watcher() i=4 2024-09-12T00:48:14.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.640+0000 7f3aaa52e800 20 remove_watcher() i=5 2024-09-12T00:48:14.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.640+0000 7f3aaa52e800 20 remove_watcher() i=6 2024-09-12T00:48:14.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.641+0000 7f3aaa52e800 20 remove_watcher() i=7 2024-09-12T00:48:14.653 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:48:14.682 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:14.682 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:14.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.722+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.724+0000 7f219df17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.724+0000 7f219df17800 20 realm 2024-09-12T00:48:14.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.724+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.724+0000 7f219df17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.724+0000 7f219df17800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:14.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.724+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.724+0000 7f219df17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.724+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.725+0000 7f219df17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:14.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.725+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.726+0000 7f219df17800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:14.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.726+0000 7f219df17800 20 searching for the correct realm 2024-09-12T00:48:14.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.729+0000 7f219b200640 0 -- 172.21.15.19:0/3810696604 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f2190087130 msgr2=0x7f2190090380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:14.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.934+0000 7f219c202640 0 -- 172.21.15.19:0/3810696604 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55f0be6fc630 msgr2=0x55f0be6feaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:14.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.938+0000 7f219df17800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:14.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.938+0000 7f219df17800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:14.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.938+0000 7f219df17800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:14.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.938+0000 7f219df17800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:14.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.938+0000 7f219df17800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:14.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.938+0000 7f219df17800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:14.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.938+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:14.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:14.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 20 zone default found 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 4 Realm: () 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 20 zonegroup default 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.939+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.940+0000 7f219df17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.940+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.940+0000 7f219df17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.940+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.940+0000 7f219df17800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.940+0000 7f219df17800 20 started sync module instance, tier type = 2024-09-12T00:48:14.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.940+0000 7f219df17800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:14.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.949+0000 7f219df17800 20 add_watcher() i=0 2024-09-12T00:48:14.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.949+0000 7f219df17800 20 add_watcher() i=1 2024-09-12T00:48:14.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.949+0000 7f219df17800 20 add_watcher() i=2 2024-09-12T00:48:14.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.949+0000 7f219df17800 20 add_watcher() i=3 2024-09-12T00:48:14.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.949+0000 7f219df17800 20 add_watcher() i=4 2024-09-12T00:48:14.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.949+0000 7f219df17800 20 add_watcher() i=5 2024-09-12T00:48:14.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.949+0000 7f219df17800 20 add_watcher() i=6 2024-09-12T00:48:14.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.950+0000 7f219df17800 20 add_watcher() i=7 2024-09-12T00:48:14.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.950+0000 7f219df17800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:14.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.952+0000 7f2051fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.952+0000 7f219df17800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.952+0000 7f219df17800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.952+0000 7f219df17800 5 note: GC not initialized 2024-09-12T00:48:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.952+0000 7f2050fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.952+0000 7f219df17800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.952+0000 7f219df17800 20 Filter name: none 2024-09-12T00:48:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.953+0000 7f1fca7fc640 20 reqs_thread_entry: start 2024-09-12T00:48:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.953+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.953+0000 7f219df17800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.953+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.954+0000 7f219df17800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:14.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.954+0000 7f219df17800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:14.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.954+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.954+0000 7f219df17800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:14.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.954+0000 7f219df17800 20 rados->read ofs=0 len=0 2024-09-12T00:48:14.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.955+0000 7f219df17800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:14.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.955+0000 7f219df17800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:14.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.956+0000 7f2051fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:14.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.959+0000 7f219df17800 20 remove_watcher() i=0 2024-09-12T00:48:14.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.959+0000 7f219df17800 2 removed watcher, disabling cache 2024-09-12T00:48:14.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.960+0000 7f219df17800 20 remove_watcher() i=1 2024-09-12T00:48:14.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.961+0000 7f219df17800 20 remove_watcher() i=2 2024-09-12T00:48:14.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.962+0000 7f219df17800 20 remove_watcher() i=3 2024-09-12T00:48:14.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.963+0000 7f219df17800 20 remove_watcher() i=4 2024-09-12T00:48:14.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.964+0000 7f219df17800 20 remove_watcher() i=5 2024-09-12T00:48:14.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.964+0000 7f219df17800 20 remove_watcher() i=6 2024-09-12T00:48:14.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:14.965+0000 7f219df17800 20 remove_watcher() i=7 2024-09-12T00:48:14.975 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:14.975 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:14.975 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-block-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:48:14.975 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:14.977 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:14.977 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:15.007 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:15.007 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:15.066 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:48:15.098 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:15.098 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:15.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.139+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.140+0000 7feaeaa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.140+0000 7feaeaa10800 20 realm 2024-09-12T00:48:15.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.140+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.140+0000 7feaeaa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.140+0000 7feaeaa10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:15.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.140+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.141+0000 7feaeaa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.141+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.141+0000 7feaeaa10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:15.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.141+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.142+0000 7feaeaa10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:15.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.142+0000 7feaeaa10800 20 searching for the correct realm 2024-09-12T00:48:15.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.145+0000 7feae59df640 0 -- 172.21.15.19:0/1670078080 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7feadc03fb60 msgr2=0x7feadc00d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:15.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.351+0000 7feae69e1640 0 -- 172.21.15.19:0/1670078080 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x555719c37500 msgr2=0x555719c39990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:15.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.355+0000 7feaeaa10800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:15.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.355+0000 7feaeaa10800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:15.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.355+0000 7feaeaa10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:15.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.355+0000 7feaeaa10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:15.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.355+0000 7feaeaa10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:15.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.355+0000 7feaeaa10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:15.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.355+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.355+0000 7feaeaa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.355+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.355+0000 7feaeaa10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:15.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.355+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:15.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 20 zone default found 2024-09-12T00:48:15.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 4 Realm: () 2024-09-12T00:48:15.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:15.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:15.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:15.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 20 zonegroup default 2024-09-12T00:48:15.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.356+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.357+0000 7feaeaa10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.357+0000 7feaeaa10800 20 started sync module instance, tier type = 2024-09-12T00:48:15.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.357+0000 7feaeaa10800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:15.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.365+0000 7feaeaa10800 20 add_watcher() i=0 2024-09-12T00:48:15.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.365+0000 7feaeaa10800 20 add_watcher() i=1 2024-09-12T00:48:15.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.365+0000 7feaeaa10800 20 add_watcher() i=2 2024-09-12T00:48:15.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.365+0000 7feaeaa10800 20 add_watcher() i=3 2024-09-12T00:48:15.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.365+0000 7feaeaa10800 20 add_watcher() i=4 2024-09-12T00:48:15.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.365+0000 7feaeaa10800 20 add_watcher() i=5 2024-09-12T00:48:15.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.365+0000 7feaeaa10800 20 add_watcher() i=6 2024-09-12T00:48:15.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.366+0000 7feaeaa10800 20 add_watcher() i=7 2024-09-12T00:48:15.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.366+0000 7feaeaa10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:15.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.367+0000 7fe99cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:15.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.368+0000 7feaeaa10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:15.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.368+0000 7feaeaa10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:15.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.368+0000 7feaeaa10800 5 note: GC not initialized 2024-09-12T00:48:15.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.368+0000 7fe9177fe640 20 reqs_thread_entry: start 2024-09-12T00:48:15.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.368+0000 7feaeaa10800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:15.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.368+0000 7feaeaa10800 20 Filter name: none 2024-09-12T00:48:15.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.368+0000 7fe9157fa640 20 reqs_thread_entry: start 2024-09-12T00:48:15.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.368+0000 7feaeaa10800 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:48:15.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.368+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.369+0000 7feaeaa10800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:15.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.369+0000 7feaeaa10800 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:48:15.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.369+0000 7feaeaa10800 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:48:15.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.369+0000 7feaeaa10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 : miss 2024-09-12T00:48:15.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.369+0000 7feaeaa10800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.369+0000 7feaeaa10800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:15.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.369+0000 7feaeaa10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:15.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.369+0000 7feaeaa10800 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:15.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.369+0000 7feaeaa10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:15.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.369+0000 7feaeaa10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:15.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.369+0000 7feaeaa10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 2024-09-12T00:48:15.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.374+0000 7feaeaa10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:15.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.374+0000 7feaeaa10800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:15.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.374+0000 7feaeaa10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:15.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.374+0000 7feaeaa10800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28, ofs0, ns] 2024-09-12T00:48:15.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.374+0000 7fe9c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398959 cookie 93832582825968 notifier 7008 bl.length()=915 2024-09-12T00:48:15.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.374+0000 7fe9c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:15.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.374+0000 7fe9c97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:15.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.374+0000 7fe9c97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:15.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.376+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_sources= new_sources= 2024-09-12T00:48:15.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.376+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential sources added=[] removed=[] 2024-09-12T00:48:15.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.376+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_dests= new_dests= 2024-09-12T00:48:15.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.376+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential dests added=[] removed=[] 2024-09-12T00:48:15.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.0 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.0 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.1 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.1 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.2 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.2 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.3 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.3 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.4 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.4 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.5 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.5 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.6 2024-09-12T00:48:15.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.6 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.7 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.7 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.8 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.8 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.9 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.9 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.10 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.10 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.11 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1.11 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.380+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.0 2024-09-12T00:48:15.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.381+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1 2024-09-12T00:48:15.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.381+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.2 2024-09-12T00:48:15.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.382+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.3 2024-09-12T00:48:15.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.382+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.4 2024-09-12T00:48:15.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.383+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.5 2024-09-12T00:48:15.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.383+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.6 2024-09-12T00:48:15.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.384+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.7 2024-09-12T00:48:15.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.385+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.8 2024-09-12T00:48:15.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.385+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.9 2024-09-12T00:48:15.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.386+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.10 2024-09-12T00:48:15.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.389+0000 7feaeaa10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:15.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.389+0000 7feaeaa10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 2024-09-12T00:48:15.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.390+0000 7feaeaa10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:15.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.390+0000 7feaeaa10800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:15.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.390+0000 7feaeaa10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:15.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.390+0000 7feaeaa10800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28, ofs0, ns] 2024-09-12T00:48:15.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.390+0000 7fe9c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398960 cookie 93832582825968 notifier 7008 bl.length()=915 2024-09-12T00:48:15.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.390+0000 7fe9c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:15.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.390+0000 7fe9c97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:15.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.390+0000 7fe9c97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:15.390 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.392+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_sources= new_sources= 2024-09-12T00:48:15.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.392+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential sources added=[] removed=[] 2024-09-12T00:48:15.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.392+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_dests= new_dests= 2024-09-12T00:48:15.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.392+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential dests added=[] removed=[] 2024-09-12T00:48:15.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.394+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.0 2024-09-12T00:48:15.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.395+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.1 2024-09-12T00:48:15.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.395+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.2 2024-09-12T00:48:15.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.395+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.3 2024-09-12T00:48:15.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.396+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.4 2024-09-12T00:48:15.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.396+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.5 2024-09-12T00:48:15.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.397+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.6 2024-09-12T00:48:15.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.397+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.7 2024-09-12T00:48:15.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.397+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.8 2024-09-12T00:48:15.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.398+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.9 2024-09-12T00:48:15.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.398+0000 7feaeaa10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28.10 2024-09-12T00:48:15.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.398+0000 7feaeaa10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:15.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.398+0000 7feaeaa10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 2024-09-12T00:48:15.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.400+0000 7feaeaa10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:15.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.400+0000 7feaeaa10800 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:15.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.400+0000 7feaeaa10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:15.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.400+0000 7feaeaa10800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28, ofs0, ns] 2024-09-12T00:48:15.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.400+0000 7fe9c97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398961 cookie 93832582825968 notifier 7008 bl.length()=883 2024-09-12T00:48:15.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.400+0000 7fe9c97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 info.flags=0x17 2024-09-12T00:48:15.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.400+0000 7fe9c97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 to cache LRU end 2024-09-12T00:48:15.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.400+0000 7fe9c97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:15.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.401+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_sources= new_sources= 2024-09-12T00:48:15.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.401+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential sources added=[] removed=[] 2024-09-12T00:48:15.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.401+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): orig_dests= new_dests= 2024-09-12T00:48:15.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.401+0000 7feaeaa10800 20 handle_bi_update(): bucket=:error-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28]): potential dests added=[] removed=[] 2024-09-12T00:48:15.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.404+0000 7feaeaa10800 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:48:15.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.406+0000 7fe99cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:15.406 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.408+0000 7feaeaa10800 20 remove_watcher() i=0 2024-09-12T00:48:15.406 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.408+0000 7feaeaa10800 2 removed watcher, disabling cache 2024-09-12T00:48:15.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.409+0000 7feaeaa10800 20 remove_watcher() i=1 2024-09-12T00:48:15.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.410+0000 7feaeaa10800 20 remove_watcher() i=2 2024-09-12T00:48:15.409 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.411+0000 7feaeaa10800 20 remove_watcher() i=3 2024-09-12T00:48:15.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.412+0000 7feaeaa10800 20 remove_watcher() i=4 2024-09-12T00:48:15.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.413+0000 7feaeaa10800 20 remove_watcher() i=5 2024-09-12T00:48:15.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.414+0000 7feaeaa10800 20 remove_watcher() i=6 2024-09-12T00:48:15.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.415+0000 7feaeaa10800 20 remove_watcher() i=7 2024-09-12T00:48:15.426 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:48:15.455 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:15.455 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:15.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.495+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.497+0000 7f8cea5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.497+0000 7f8cea5a9800 20 realm 2024-09-12T00:48:15.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.497+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.497+0000 7f8cea5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.497+0000 7f8cea5a9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:15.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.497+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.498+0000 7f8cea5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.498+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.498+0000 7f8cea5a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:15.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.498+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.498+0000 7f8cea5a9800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:15.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.499+0000 7f8cea5a9800 20 searching for the correct realm 2024-09-12T00:48:15.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.502+0000 7f8cdf892640 0 -- 172.21.15.19:0/230664171 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f8cd0072690 msgr2=0x7f8cd0029aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:15.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.708+0000 7f8ce8894640 0 -- 172.21.15.19:0/230664171 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x563beb1567c0 msgr2=0x563beb158bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:15.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.712+0000 7f8cea5a9800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:15.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.712+0000 7f8cea5a9800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:15.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.712+0000 7f8cea5a9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:15.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.712+0000 7f8cea5a9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:15.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.712+0000 7f8cea5a9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:15.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.712+0000 7f8cea5a9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:15.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.712+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.712+0000 7f8cea5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.712+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.712+0000 7f8cea5a9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:15.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.712+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:15.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 20 zone default found 2024-09-12T00:48:15.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 4 Realm: () 2024-09-12T00:48:15.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:15.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:15.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:15.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 20 zonegroup default 2024-09-12T00:48:15.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.713+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.714+0000 7f8cea5a9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:15.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.714+0000 7f8cea5a9800 20 started sync module instance, tier type = 2024-09-12T00:48:15.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.714+0000 7f8cea5a9800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:15.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.722+0000 7f8cea5a9800 20 add_watcher() i=0 2024-09-12T00:48:15.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.722+0000 7f8cea5a9800 20 add_watcher() i=1 2024-09-12T00:48:15.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.722+0000 7f8cea5a9800 20 add_watcher() i=2 2024-09-12T00:48:15.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.722+0000 7f8cea5a9800 20 add_watcher() i=3 2024-09-12T00:48:15.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.722+0000 7f8cea5a9800 20 add_watcher() i=4 2024-09-12T00:48:15.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.722+0000 7f8cea5a9800 20 add_watcher() i=5 2024-09-12T00:48:15.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.722+0000 7f8cea5a9800 20 add_watcher() i=6 2024-09-12T00:48:15.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.723+0000 7f8cea5a9800 20 add_watcher() i=7 2024-09-12T00:48:15.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.723+0000 7f8cea5a9800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:15.723 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.725+0000 7f8b9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:15.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.725+0000 7f8cea5a9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:15.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.725+0000 7f8cea5a9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:15.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.725+0000 7f8cea5a9800 5 note: GC not initialized 2024-09-12T00:48:15.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.725+0000 7f8b9dfdb640 20 reqs_thread_entry: start 2024-09-12T00:48:15.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.726+0000 7f8cea5a9800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:15.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.726+0000 7f8cea5a9800 20 Filter name: none 2024-09-12T00:48:15.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.726+0000 7f8b0f7fe640 20 reqs_thread_entry: start 2024-09-12T00:48:15.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.726+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.726+0000 7f8cea5a9800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:15.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.726+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.727+0000 7f8cea5a9800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:15.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.727+0000 7f8cea5a9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:15.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.727+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.727+0000 7f8cea5a9800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:15.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.727+0000 7f8cea5a9800 20 rados->read ofs=0 len=0 2024-09-12T00:48:15.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.727+0000 7f8cea5a9800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:15.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.727+0000 7f8cea5a9800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:15.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.729+0000 7f8b9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:15.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.731+0000 7f8cea5a9800 20 remove_watcher() i=0 2024-09-12T00:48:15.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.731+0000 7f8cea5a9800 2 removed watcher, disabling cache 2024-09-12T00:48:15.731 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.732+0000 7f8cea5a9800 20 remove_watcher() i=1 2024-09-12T00:48:15.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.733+0000 7f8cea5a9800 20 remove_watcher() i=2 2024-09-12T00:48:15.733 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.734+0000 7f8cea5a9800 20 remove_watcher() i=3 2024-09-12T00:48:15.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.735+0000 7f8cea5a9800 20 remove_watcher() i=4 2024-09-12T00:48:15.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.736+0000 7f8cea5a9800 20 remove_watcher() i=5 2024-09-12T00:48:15.736 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.737+0000 7f8cea5a9800 20 remove_watcher() i=6 2024-09-12T00:48:15.737 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:15.738+0000 7f8cea5a9800 20 remove_watcher() i=7 2024-09-12T00:48:15.748 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:15.748 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:15.748 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-block-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:48:15.748 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:15.750 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:15.750 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:15.771 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:15.772 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:15.959 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:15.960 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.096 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:48:16.096 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:16.097 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.097 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.146 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.146 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.203 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.203 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.240 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.240 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.275 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.275 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.310 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.311 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.343 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.343 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.378 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.378 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.411 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.412 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.446 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.446 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.480 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.481 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.517 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.517 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.552 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.552 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.586 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.587 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.620 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.620 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.654 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.654 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.689 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.689 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.723 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.723 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.757 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.757 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.792 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.792 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.827 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.827 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.859 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:16.859 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:16.899 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:48:16.928 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:16.928 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:16.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.968+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.970+0000 7fccc5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.970+0000 7fccc5946800 20 realm 2024-09-12T00:48:16.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.970+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.970+0000 7fccc5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.970+0000 7fccc5946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:16.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.970+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.970+0000 7fccc5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:16.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.970+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.971+0000 7fccc5946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:16.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.971+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:16.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.971+0000 7fccc5946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:16.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.971+0000 7fccc5946800 20 searching for the correct realm 2024-09-12T00:48:16.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:16.974+0000 7fccc2c36640 0 -- 172.21.15.19:0/3675614015 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fccb80a39b0 msgr2=0x7fccb80d3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:17.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.179+0000 7fccc3c38640 0 -- 172.21.15.19:0/3675614015 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5565c3720260 msgr2=0x5565c3722670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:17.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.184+0000 7fccc5946800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:17.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.184+0000 7fccc5946800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:17.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.184+0000 7fccc5946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:17.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.184+0000 7fccc5946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:17.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.184+0000 7fccc5946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:17.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.184+0000 7fccc5946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:17.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.184+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.184+0000 7fccc5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.184+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.184+0000 7fccc5946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:17.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.184+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:17.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 20 zone default found 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 4 Realm: () 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 20 zonegroup default 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 20 started sync module instance, tier type = 2024-09-12T00:48:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.185+0000 7fccc5946800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:17.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.194+0000 7fccc5946800 20 add_watcher() i=0 2024-09-12T00:48:17.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.194+0000 7fccc5946800 20 add_watcher() i=1 2024-09-12T00:48:17.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.194+0000 7fccc5946800 20 add_watcher() i=2 2024-09-12T00:48:17.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.194+0000 7fccc5946800 20 add_watcher() i=3 2024-09-12T00:48:17.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.194+0000 7fccc5946800 20 add_watcher() i=4 2024-09-12T00:48:17.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.194+0000 7fccc5946800 20 add_watcher() i=5 2024-09-12T00:48:17.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.194+0000 7fccc5946800 20 add_watcher() i=6 2024-09-12T00:48:17.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.195+0000 7fccc5946800 20 add_watcher() i=7 2024-09-12T00:48:17.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.195+0000 7fccc5946800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:17.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.197+0000 7fcb79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:17.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.197+0000 7fccc5946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:17.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.197+0000 7fccc5946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:17.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.197+0000 7fccc5946800 5 note: GC not initialized 2024-09-12T00:48:17.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.197+0000 7fcb78fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:17.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.197+0000 7fccc5946800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:17.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.197+0000 7fccc5946800 20 Filter name: none 2024-09-12T00:48:17.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.198+0000 7fcaf27fc640 20 reqs_thread_entry: start 2024-09-12T00:48:17.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.198+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.199+0000 7fccc5946800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:17.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.199+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.199+0000 7fccc5946800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:17.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.199+0000 7fccc5946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:17.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.199+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.200+0000 7fccc5946800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:17.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.200+0000 7fccc5946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.200+0000 7fccc5946800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:17.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.200+0000 7fccc5946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:17.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.202+0000 7fcb79fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:17.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.204+0000 7fccc5946800 20 remove_watcher() i=0 2024-09-12T00:48:17.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.204+0000 7fccc5946800 2 removed watcher, disabling cache 2024-09-12T00:48:17.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.205+0000 7fccc5946800 20 remove_watcher() i=1 2024-09-12T00:48:17.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.206+0000 7fccc5946800 20 remove_watcher() i=2 2024-09-12T00:48:17.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.207+0000 7fccc5946800 20 remove_watcher() i=3 2024-09-12T00:48:17.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.208+0000 7fccc5946800 20 remove_watcher() i=4 2024-09-12T00:48:17.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.209+0000 7fccc5946800 20 remove_watcher() i=5 2024-09-12T00:48:17.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.210+0000 7fccc5946800 20 remove_watcher() i=6 2024-09-12T00:48:17.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.211+0000 7fccc5946800 20 remove_watcher() i=7 2024-09-12T00:48:17.220 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.221 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:17.221 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-block-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:48:17.221 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.222 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:48:17.257 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:17.257 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:17.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.297+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.299+0000 7f7de112c800 20 realm 2024-09-12T00:48:17.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.299+0000 7f7de112c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:17.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.300+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:17.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.300+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.300+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:17.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.300+0000 7f7de112c800 20 searching for the correct realm 2024-09-12T00:48:17.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.303+0000 7f7ddc64e640 0 -- 172.21.15.19:0/1479534080 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f7dd0091b40 msgr2=0x7f7dd0078920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:17.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.508+0000 7f7ddd650640 0 -- 172.21.15.19:0/1479534080 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5644aa114160 msgr2=0x5644aa1165f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:17.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:17.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:17.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:17.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:17.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:17.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:17.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:17.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:17.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 20 zone default found 2024-09-12T00:48:17.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 4 Realm: () 2024-09-12T00:48:17.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:17.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:17.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:17.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 20 zonegroup default 2024-09-12T00:48:17.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.514+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.514+0000 7f7de112c800 20 started sync module instance, tier type = 2024-09-12T00:48:17.514 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.514+0000 7f7de112c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:17.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=0 2024-09-12T00:48:17.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=1 2024-09-12T00:48:17.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=2 2024-09-12T00:48:17.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=3 2024-09-12T00:48:17.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=4 2024-09-12T00:48:17.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=5 2024-09-12T00:48:17.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=6 2024-09-12T00:48:17.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=7 2024-09-12T00:48:17.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.523+0000 7f7de112c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:17.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.525+0000 7f7c92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:17.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.526+0000 7f7de112c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:17.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.526+0000 7f7de112c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:17.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.526+0000 7f7de112c800 5 note: GC not initialized 2024-09-12T00:48:17.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.526+0000 7f7c91fe3640 20 reqs_thread_entry: start 2024-09-12T00:48:17.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.526+0000 7f7de112c800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:17.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.526+0000 7f7de112c800 20 Filter name: none 2024-09-12T00:48:17.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.526+0000 7f7c037fe640 20 reqs_thread_entry: start 2024-09-12T00:48:17.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.526+0000 7f7de112c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:48:17.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.526+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.527+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:17.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.527+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:48:17.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.527+0000 7f7de112c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:48:17.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.527+0000 7f7de112c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 : miss 2024-09-12T00:48:17.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.527+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.527+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:17.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.527+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.527+0000 7f7de112c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.527+0000 7f7de112c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:17.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.527+0000 7f7de112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.528+0000 7f7de112c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 2024-09-12T00:48:17.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.533+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.533+0000 7f7de112c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.533+0000 7f7de112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.533+0000 7f7de112c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29, ofs0, ns] 2024-09-12T00:48:17.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398964 cookie 94852911090096 notifier 6644 bl.length()=915 2024-09-12T00:48:17.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_sources= new_sources= 2024-09-12T00:48:17.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential sources added=[] removed=[] 2024-09-12T00:48:17.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_dests= new_dests= 2024-09-12T00:48:17.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential dests added=[] removed=[] 2024-09-12T00:48:17.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.0 2024-09-12T00:48:17.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.0 2024-09-12T00:48:17.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.1 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.1 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.2 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.2 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.3 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.3 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.4 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.4 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.5 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.5 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.6 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.6 2024-09-12T00:48:17.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.7 2024-09-12T00:48:17.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.7 2024-09-12T00:48:17.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.8 2024-09-12T00:48:17.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.8 2024-09-12T00:48:17.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.9 2024-09-12T00:48:17.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.9 2024-09-12T00:48:17.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.10 2024-09-12T00:48:17.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.10 2024-09-12T00:48:17.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.11 2024-09-12T00:48:17.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.11 2024-09-12T00:48:17.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.0 2024-09-12T00:48:17.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.541+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1 2024-09-12T00:48:17.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.541+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2 2024-09-12T00:48:17.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.542+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.3 2024-09-12T00:48:17.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.542+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.4 2024-09-12T00:48:17.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.542+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.5 2024-09-12T00:48:17.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.543+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.6 2024-09-12T00:48:17.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.543+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.7 2024-09-12T00:48:17.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.544+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.8 2024-09-12T00:48:17.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.544+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.9 2024-09-12T00:48:17.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.545+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.10 2024-09-12T00:48:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.548+0000 7f7de112c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.548+0000 7f7de112c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 2024-09-12T00:48:17.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.549+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.549+0000 7f7de112c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.549+0000 7f7de112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.549+0000 7f7de112c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29, ofs0, ns] 2024-09-12T00:48:17.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398965 cookie 94852911090096 notifier 6644 bl.length()=915 2024-09-12T00:48:17.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_sources= new_sources= 2024-09-12T00:48:17.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential sources added=[] removed=[] 2024-09-12T00:48:17.551 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7de112c800 time 2024-09-12T00:48:17.552871+0000 2024-09-12T00:48:17.551 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:17.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_dests= new_dests= 2024-09-12T00:48:17.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential dests added=[] removed=[] 2024-09-12T00:48:17.552 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:17.552 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7de298c71a] 2024-09-12T00:48:17.552 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7de298c8d8] 2024-09-12T00:48:17.552 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644a77d3641] 2024-09-12T00:48:17.552 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5644a77e2582] 2024-09-12T00:48:17.552 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5644a77e33e4] 2024-09-12T00:48:17.552 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:48:17.552 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7de1629590] 2024-09-12T00:48:17.552 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:48:17.552 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:48:17.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.553+0000 7f7de112c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7de112c800 time 2024-09-12T00:48:17.552871+0000 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7de298c71a] 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7de298c8d8] 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644a77d3641] 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5644a77e2582] 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5644a77e33e4] 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7de1629590] 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.553 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:48:17.554 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f7de112c800 thread_name:radosgw-admin 2024-09-12T00:48:17.568 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:17.568 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7de163e6f0] 2024-09-12T00:48:17.568 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7de168b99c] 2024-09-12T00:48:17.568 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7de298c774] 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7de298c8d8] 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644a77d3641] 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5644a77e2582] 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5644a77e33e4] 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7de1629590] 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.553+0000 7f7de112c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:17.569 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f7de112c800 thread_name:radosgw-admin 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7de163e6f0] 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7de168b99c] 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7de298c774] 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7de298c8d8] 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644a77d3641] 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5644a77e2582] 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5644a77e33e4] 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:48:17.570 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7de1629590] 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:48:17.281+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:48:17.281+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:48:17.281+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:48:17.281+0000 7f7de112c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:48:17.281+0000 7f7de112c800 10 monclient(hunting): authenticate will time out at 2163.783814s 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request con 0x5644a9ee1180 auth_method 0 2024-09-12T00:48:17.571 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:48:17.281+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request con 0x5644a9f65710 auth_method 0 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:48:17.281+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:48:17.281+0000 7f7ddc64e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:48:17.281+0000 7f7ddc64e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): get_auth_request con 0x5644a9f6f200 auth_method 0 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.572 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:48:17.282+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:48:17.282+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:48:17.282+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:48:17.282+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_done global_id 7056 payload 824 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:48:17.282+0000 7f7ddce4f640 10 monclient: _finish_hunting 0 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:48:17.282+0000 7f7ddce4f640 1 monclient: found mon.noname-a 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:48:17.282+0000 7f7ddce4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:17.573 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: dump: 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: _finish_auth 0 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: _check_auth_tickets 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:17.574 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: dump: 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.575 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:48:17.282+0000 7f7de112c800 5 monclient: authenticate success, global_id 7056 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:48:17.282+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:48:17.282+0000 7f7de112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:48:17.282+0000 7f7ccae0d640 4 set_mon_vals no callback set 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:48:17.282+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:48:17.282+0000 7f7de112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:48:17.282+0000 7f7de112c800 1 librados: init done 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:48:17.284+0000 7f7cc960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:48:17.284+0000 7f7cc960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:48:17.284+0000 7f7cc960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:48:17.285+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x7f7cc4076470 auth_method 0 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:48:17.285+0000 7f7ddd650640 10 monclient: get_auth_request con 0x5644aa0518f0 auth_method 0 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:48:17.285+0000 7f7ddce4f640 10 monclient: get_auth_request con 0x5644aa0748e0 auth_method 0 2024-09-12T00:48:17.576 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:48:17.287+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x5644aa079970 auth_method 0 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:48:17.287+0000 7f7de112c800 10 monclient: build_initial_monmap 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:48:17.287+0000 7f7de112c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:48:17.287+0000 7f7de112c800 10 monclient: monmap: 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:17.577 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding auth protocol: cephx 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding auth protocol: cephx 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding auth protocol: cephx 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.578 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:48:17.288+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command objecter_requests cmddesc objecter_requests hook 0x5644aa080ee0 EEXIST 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient: init 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding auth protocol: cephx 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding auth protocol: cephx 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding auth protocol: cephx 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.579 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:48:17.288+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:48:17.288+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command rotate-key cmddesc rotate-key hook 0x5644aa07cae0 EEXIST 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:48:17.580 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-a con 0x5644aa0ab070 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-c con 0x5644aa0a5af0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-b con 0x5644aa0a66c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): authenticate will time out at 2163.790971s 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request con 0x5644aa0ab070 auth_method 0 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.581 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request con 0x5644aa0a5af0 auth_method 0 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): get_auth_request con 0x5644aa0a66c0 auth_method 0 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.582 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_done global_id 7059 payload 824 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient: _finish_hunting 0 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 1 monclient: found mon.noname-a 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: dump: 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.583 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: _finish_auth 0 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: _check_auth_tickets 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:17.584 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: dump: 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:48:17.289+0000 7f7de112c800 5 monclient: authenticate success, global_id 7059 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:48:17.289+0000 7f7ddde51640 4 set_mon_vals no callback set 2024-09-12T00:48:17.585 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:48:17.289+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:48:17.289+0000 7f7de112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:48:17.289+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:48:17.289+0000 7f7de112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:48:17.291+0000 7f7cc27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:48:17.291+0000 7f7cc27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:48:17.291+0000 7f7cc27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:48:17.291+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x7f7cb40763b0 auth_method 0 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:48:17.291+0000 7f7de112c800 10 monclient: get_monmap_and_config 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:48:17.291+0000 7f7de112c800 10 monclient: build_initial_monmap 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:48:17.291+0000 7f7de112c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:48:17.291+0000 7f7de112c800 10 monclient: monmap: 2024-09-12T00:48:17.586 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:17.587 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:17.587 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:17.587 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:17.587 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:17.587 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.587 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:17.587 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:17.587 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:17.587 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.587 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding auth protocol: cephx 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding auth protocol: cephx 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding auth protocol: cephx 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.588 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:48:17.292+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient: init 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding auth protocol: cephx 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding auth protocol: cephx 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding auth protocol: cephx 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.589 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:48:17.292+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:48:17.292+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command rotate-key cmddesc rotate-key hook 0x7ffde52fa4d8 EEXIST 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-a con 0x5644aa0fa7d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:17.590 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-b con 0x5644aa0f4d70 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-c con 0x5644aa0ca610 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): authenticate will time out at 2163.794751s 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): get_auth_request con 0x5644aa0ca610 auth_method 0 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request con 0x5644aa0fa7d0 auth_method 0 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.591 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:48:17.292+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request con 0x5644aa0f4d70 auth_method 0 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:48:17.292+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:48:17.292+0000 7f7ddc64e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:48:17.292+0000 7f7ddc64e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:48:17.293+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:48:17.293+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.592 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:48:17.293+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:48:17.293+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_done global_id 7062 payload 274 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:48:17.293+0000 7f7ddce4f640 10 monclient: _finish_hunting 0 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:48:17.293+0000 7f7ddce4f640 1 monclient: found mon.noname-a 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:48:17.293+0000 7f7ddce4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: dump: 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.593 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: _finish_auth 0 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:48:17.293+0000 7f7de112c800 5 monclient: authenticate success, global_id 7062 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:48:17.293+0000 7f7de112c800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:48:17.293+0000 7f7de112c800 4 set_mon_vals no callback set 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: dump: 2024-09-12T00:48:17.594 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:48:17.293+0000 7f7de112c800 10 monclient: shutdown 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:48:17.294+0000 7f7de112c800 10 monclient: build_initial_monmap 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:48:17.294+0000 7f7de112c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:48:17.294+0000 7f7de112c800 10 monclient: monmap: 2024-09-12T00:48:17.595 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding auth protocol: cephx 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding auth protocol: cephx 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding auth protocol: cephx 2024-09-12T00:48:17.596 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.597 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:48:17.294+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:48:17.294+0000 7f7de112c800 1 librados: starting msgr at 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:48:17.294+0000 7f7de112c800 1 librados: starting objecter 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command objecter_requests cmddesc objecter_requests hook 0x5644aa0c96a0 EEXIST 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:48:17.294+0000 7f7de112c800 1 librados: setting wanted keys 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:48:17.294+0000 7f7de112c800 1 librados: calling monclient init 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:48:17.294+0000 7f7de112c800 10 monclient: init 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding auth protocol: cephx 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding auth protocol: cephx 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding auth protocol: cephx 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.598 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:48:17.294+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:48:17.295+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:48:17.295+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command rotate-key cmddesc rotate-key hook 0x5644a9eb3fe8 EEXIST 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-c con 0x5644aa0ca610 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:17.599 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-b con 0x5644aa0f4d70 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-a con 0x5644aa0fa7d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): authenticate will time out at 2163.797232s 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request con 0x5644aa0ca610 auth_method 0 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): get_auth_request con 0x5644aa0fa7d0 auth_method 0 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.600 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:48:17.295+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request con 0x5644aa0f4d70 auth_method 0 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:48:17.295+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:48:17.295+0000 7f7ddc64e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:48:17.295+0000 7f7ddc64e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_done global_id 6644 payload 824 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient: _finish_hunting 0 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 1 monclient: found mon.noname-c 2024-09-12T00:48:17.601 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: dump: 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.602 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: _finish_auth 0 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: _check_auth_tickets 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:48:17.295+0000 7f7de112c800 5 monclient: authenticate success, global_id 6644 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: dump: 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.603 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:48:17.295+0000 7f7cb3fff640 4 set_mon_vals no callback set 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:48:17.296+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:48:17.296+0000 7f7de112c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:48:17.296+0000 7f7de112c800 1 librados: init done 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:48:17.296+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command cr dump hook 0x5644aa0cb9d8 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:48:17.297+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:48:17.298+0000 7f7cb27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:48:17.298+0000 7f7cb27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:48:17.298+0000 7f7cb27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.604 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:48:17.298+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x7f7ca8076470 auth_method 0 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:48:17.298+0000 7f7ddd650640 10 monclient: get_auth_request con 0x5644aa114160 auth_method 0 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 realm 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:48:17.299+0000 7f7de112c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:48:17.299+0000 7f7ddce4f640 10 monclient: get_auth_request con 0x5644aa1183c0 auth_method 0 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:48:17.300+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:48:17.300+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.605 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:48:17.300+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:48:17.300+0000 7f7de112c800 20 searching for the correct realm 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:48:17.300+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x5644aa11d660 auth_method 0 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:48:17.301+0000 7f7ddd650640 10 monclient: get_auth_request con 0x7f7dd0090040 auth_method 0 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:48:17.302+0000 7f7ddce4f640 10 monclient: get_auth_request con 0x7f7dcc044030 auth_method 0 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:48:17.303+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x7f7dd0091b40 auth_method 0 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:48:17.303+0000 7f7ddc64e640 0 -- 172.21.15.19:0/1479534080 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f7dd0091b40 msgr2=0x7f7dd0078920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:48:17.504+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x7f7dd0091b40 auth_method 0 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:48:17.506+0000 7f7ddd650640 10 monclient: get_auth_request con 0x7f7dcc082650 auth_method 0 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:48:17.507+0000 7f7ddce4f640 10 monclient: get_auth_request con 0x7f7dd4017070 auth_method 0 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:48:17.508+0000 7f7ddd650640 0 -- 172.21.15.19:0/1479534080 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5644aa114160 msgr2=0x5644aa1165f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:48:17.508+0000 7f7cb27fc640 1 client.6644.objecter ms_handle_reset 0x5644aa114160 session 0x5644aa113a50 osd.6 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:48:17.508+0000 7f7cb27fc640 10 monclient: _renew_subs 2024-09-12T00:48:17.606 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:48:17.508+0000 7f7cb27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:48:17.508+0000 7f7ddd650640 10 monclient: get_auth_request con 0x7f7ca8086710 auth_method 0 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.607 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 zone default found 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:48:17.513+0000 7f7de112c800 4 Realm: () 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:48:17.513+0000 7f7de112c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:48:17.513+0000 7f7de112c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:48:17.513+0000 7f7de112c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 zonegroup default 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:48:17.514+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.608 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:48:17.514+0000 7f7de112c800 20 started sync module instance, tier type = 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:48:17.514+0000 7f7de112c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=0 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=1 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=2 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=3 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=4 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=5 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=6 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=7 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:48:17.523+0000 7f7de112c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding auth protocol: cephx 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding auth protocol: cephx 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding auth protocol: cephx 2024-09-12T00:48:17.609 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:48:17.525+0000 7f7c92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:17.610 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:48:17.526+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:48:17.526+0000 7f7de112c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:48:17.526+0000 7f7de112c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command cache list hook 0x5644aa0c7e50 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command cache inspect hook 0x5644aa0c7e50 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command cache erase hook 0x5644aa0c7e50 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command cache zap hook 0x5644aa0c7e50 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 note: GC not initialized 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:48:17.526+0000 7f7c91fe3640 20 reqs_thread_entry: start 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command sync trace show hook 0x7f7dcc079070 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command sync trace history hook 0x7f7dcc079070 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command sync trace active hook 0x7f7dcc079070 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command sync trace active_short hook 0x7f7dcc079070 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:48:17.526+0000 7f7de112c800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:17.611 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:48:17.526+0000 7f7de112c800 20 Filter name: none 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:48:17.526+0000 7f7c037fe640 20 reqs_thread_entry: start 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:48:17.526+0000 7f7de112c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:48:17.526+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:48:17.527+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 : miss 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:48:17.527+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:48:17.527+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:17.612 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:48:17.528+0000 7f7de112c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:48:17.533+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:48:17.533+0000 7f7de112c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:48:17.533+0000 7f7de112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:48:17.533+0000 7f7de112c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29, ofs0, ns] 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398964 cookie 94852911090096 notifier 6644 bl.length()=915 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_sources= new_sources= 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential sources added=[] removed=[] 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_dests= new_dests= 2024-09-12T00:48:17.613 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential dests added=[] removed=[] 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.0 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.0 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.1 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.1 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.2 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.2 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.3 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.3 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.4 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.4 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.5 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.5 2024-09-12T00:48:17.614 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.6 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.6 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.7 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.7 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.8 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.8 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.9 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.9 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.10 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.10 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.11 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.11 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.0 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:48:17.541+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1 2024-09-12T00:48:17.615 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:48:17.541+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:48:17.542+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.3 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:48:17.542+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.4 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:48:17.542+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.5 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:48:17.543+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.6 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:48:17.543+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.7 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:48:17.544+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.8 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:48:17.544+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.9 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:48:17.545+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.10 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:48:17.548+0000 7f7de112c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:48:17.548+0000 7f7de112c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:48:17.549+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:48:17.549+0000 7f7de112c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.616 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:48:17.549+0000 7f7de112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:48:17.549+0000 7f7de112c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29, ofs0, ns] 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398965 cookie 94852911090096 notifier 6644 bl.length()=915 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_sources= new_sources= 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential sources added=[] removed=[] 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_dests= new_dests= 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential dests added=[] removed=[] 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:48:17.553+0000 7f7de112c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7de112c800 time 2024-09-12T00:48:17.552871+0000 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:17.617 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7de298c71a] 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7de298c8d8] 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644a77d3641] 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5644a77e2582] 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5644a77e33e4] 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7de1629590] 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:48:17.553+0000 7f7de112c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f7de112c800 thread_name:radosgw-admin 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7de163e6f0] 2024-09-12T00:48:17.618 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7de168b99c] 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7de298c774] 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7de298c8d8] 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644a77d3641] 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5644a77e2582] 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5644a77e33e4] 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7de1629590] 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:48:17.619 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:48:17.620 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:48:17.621 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:48:17.622 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:48:17.623 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:48:17.624 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:48:17.625 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7c037fe640 / http_manager 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7c91fe3640 / http_manager 2024-09-12T00:48:17.626 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7c92fe5640 / rgw_dt_lg_renew 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7cb27fc640 / ms_dispatch 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7cb37fe640 / io_context_pool 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7cb3fff640 / io_context_pool 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7cc27fc640 / ms_dispatch 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7cc960a640 / ms_dispatch 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7ccae0d640 / io_context_pool 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7ddc64e640 / msgr-worker-2 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7ddce4f640 / msgr-worker-1 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7ddd650640 / msgr-worker-0 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7ddde51640 / io_context_pool 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7de112c800 / radosgw-admin 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:48:17.627 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.112868.log 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:48:17.281+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:48:17.281+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:48:17.281+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:48:17.281+0000 7f7de112c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:48:17.281+0000 7f7de112c800 10 monclient(hunting): authenticate will time out at 2163.783814s 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request con 0x5644a9ee1180 auth_method 0 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.628 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:48:17.281+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request con 0x5644a9f65710 auth_method 0 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:48:17.281+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:48:17.281+0000 7f7ddc64e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:48:17.281+0000 7f7ddc64e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:48:17.281+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): get_auth_request con 0x5644a9f6f200 auth_method 0 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:48:17.282+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:48:17.282+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:48:17.282+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.629 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:48:17.282+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:48:17.282+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_done global_id 7056 payload 824 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:48:17.282+0000 7f7ddce4f640 10 monclient: _finish_hunting 0 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:48:17.282+0000 7f7ddce4f640 1 monclient: found mon.noname-a 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:48:17.282+0000 7f7ddce4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: dump: 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.630 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: _finish_auth 0 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: _check_auth_tickets 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:17.631 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:48:17.282+0000 7f7cc960a640 10 monclient: dump: 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:48:17.282+0000 7f7de112c800 5 monclient: authenticate success, global_id 7056 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:48:17.282+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.632 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:48:17.282+0000 7f7de112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:48:17.282+0000 7f7ccae0d640 4 set_mon_vals no callback set 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:48:17.282+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:48:17.282+0000 7f7de112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:48:17.282+0000 7f7de112c800 1 librados: init done 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:48:17.284+0000 7f7cc960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:48:17.284+0000 7f7cc960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:48:17.284+0000 7f7cc960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:48:17.285+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x7f7cc4076470 auth_method 0 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:48:17.285+0000 7f7ddd650640 10 monclient: get_auth_request con 0x5644aa0518f0 auth_method 0 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:48:17.285+0000 7f7ddce4f640 10 monclient: get_auth_request con 0x5644aa0748e0 auth_method 0 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:48:17.287+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x5644aa079970 auth_method 0 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:48:17.287+0000 7f7de112c800 10 monclient: build_initial_monmap 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:48:17.287+0000 7f7de112c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:17.633 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:48:17.287+0000 7f7de112c800 10 monclient: monmap: 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding auth protocol: cephx 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding auth protocol: cephx 2024-09-12T00:48:17.634 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding auth protocol: cephx 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: crc 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:48:17.287+0000 7f7de112c800 5 AuthRegistry(0x5644aa07daa0) adding con mode: secure 2024-09-12T00:48:17.635 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:48:17.288+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command objecter_requests cmddesc objecter_requests hook 0x5644aa080ee0 EEXIST 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient: init 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding auth protocol: cephx 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding auth protocol: cephx 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding auth protocol: cephx 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.636 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: crc 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 AuthRegistry(0x5644aa07c998) adding con mode: secure 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:48:17.288+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:48:17.288+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:48:17.288+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command rotate-key cmddesc rotate-key hook 0x5644aa07cae0 EEXIST 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-a con 0x5644aa0ab070 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-c con 0x5644aa0a5af0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-b con 0x5644aa0a66c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:17.637 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:48:17.288+0000 7f7de112c800 10 monclient(hunting): authenticate will time out at 2163.790971s 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request con 0x5644aa0ab070 auth_method 0 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request con 0x5644aa0a5af0 auth_method 0 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): get_auth_request con 0x5644aa0a66c0 auth_method 0 2024-09-12T00:48:17.638 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:48:17.289+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:48:17.289+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_done global_id 7059 payload 824 2024-09-12T00:48:17.639 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient: _finish_hunting 0 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 1 monclient: found mon.noname-a 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:48:17.289+0000 7f7ddce4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: dump: 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.640 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: _finish_auth 0 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: _check_auth_tickets 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:48:17.289+0000 7f7cc27fc640 10 monclient: dump: 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.641 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:48:17.289+0000 7f7de112c800 5 monclient: authenticate success, global_id 7059 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:48:17.289+0000 7f7ddde51640 4 set_mon_vals no callback set 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:48:17.289+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:48:17.289+0000 7f7de112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:48:17.289+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:48:17.289+0000 7f7de112c800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:48:17.291+0000 7f7cc27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:48:17.291+0000 7f7cc27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:48:17.291+0000 7f7cc27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.642 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:48:17.291+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x7f7cb40763b0 auth_method 0 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:48:17.291+0000 7f7de112c800 10 monclient: get_monmap_and_config 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:48:17.291+0000 7f7de112c800 10 monclient: build_initial_monmap 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:48:17.291+0000 7f7de112c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:48:17.291+0000 7f7de112c800 10 monclient: monmap: 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:17.643 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding auth protocol: cephx 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding auth protocol: cephx 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding auth protocol: cephx 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.644 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: crc 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:48:17.291+0000 7f7de112c800 5 AuthRegistry(0x5644aa0c6280) adding con mode: secure 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:48:17.292+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient: init 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding auth protocol: cephx 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding auth protocol: cephx 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding auth protocol: cephx 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.645 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: crc 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa390) adding con mode: secure 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:48:17.292+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:48:17.292+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:48:17.292+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command rotate-key cmddesc rotate-key hook 0x7ffde52fa4d8 EEXIST 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-a con 0x5644aa0fa7d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:17.646 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-b con 0x5644aa0f4d70 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-c con 0x5644aa0ca610 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:48:17.292+0000 7f7de112c800 10 monclient(hunting): authenticate will time out at 2163.794751s 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): get_auth_request con 0x5644aa0ca610 auth_method 0 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request con 0x5644aa0fa7d0 auth_method 0 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.647 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:48:17.292+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request con 0x5644aa0f4d70 auth_method 0 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:48:17.292+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:48:17.292+0000 7f7ddc64e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:48:17.292+0000 7f7ddc64e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:48:17.292+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:48:17.292+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:48:17.293+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:48:17.293+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.648 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:48:17.293+0000 7f7ddc64e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:48:17.293+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_done global_id 7062 payload 274 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:48:17.293+0000 7f7ddce4f640 10 monclient: _finish_hunting 0 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:48:17.293+0000 7f7ddce4f640 1 monclient: found mon.noname-a 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:48:17.293+0000 7f7ddce4f640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: dump: 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.649 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: _finish_auth 0 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: _check_auth_tickets 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:48:17.293+0000 7f7de112c800 5 monclient: authenticate success, global_id 7062 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:48:17.293+0000 7f7de112c800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:48:17.293+0000 7f7de112c800 4 set_mon_vals no callback set 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:17.650 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:48:17.293+0000 7f7cb3fff640 10 monclient: dump: 2024-09-12T00:48:17.651 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.651 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.651 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.651 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.651 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.651 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.651 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.651 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.651 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.652 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.652 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:48:17.293+0000 7f7de112c800 10 monclient: shutdown 2024-09-12T00:48:17.652 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:48:17.294+0000 7f7de112c800 10 monclient: build_initial_monmap 2024-09-12T00:48:17.652 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:48:17.294+0000 7f7de112c800 1 build_initial for_mkfs: 0 2024-09-12T00:48:17.652 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:48:17.294+0000 7f7de112c800 10 monclient: monmap: 2024-09-12T00:48:17.652 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:17.652 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:17.652 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:17.652 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding auth protocol: cephx 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding auth protocol: cephx 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding auth protocol: cephx 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.653 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: crc 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644aa0f5d30) adding con mode: secure 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:48:17.294+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:48:17.294+0000 7f7de112c800 1 librados: starting msgr at 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:48:17.294+0000 7f7de112c800 1 librados: starting objecter 2024-09-12T00:48:17.654 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command objecter_requests cmddesc objecter_requests hook 0x5644aa0c96a0 EEXIST 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:48:17.294+0000 7f7de112c800 1 librados: setting wanted keys 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:48:17.294+0000 7f7de112c800 1 librados: calling monclient init 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:48:17.294+0000 7f7de112c800 10 monclient: init 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding auth protocol: cephx 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding auth protocol: cephx 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding auth protocol: cephx 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.655 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: crc 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:48:17.294+0000 7f7de112c800 5 AuthRegistry(0x5644a9eb3ea0) adding con mode: secure 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:48:17.294+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:48:17.295+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:48:17.295+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command rotate-key cmddesc rotate-key hook 0x5644a9eb3fe8 EEXIST 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-c con 0x5644aa0ca610 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-b con 0x5644aa0f4d70 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:17.656 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): picked mon.noname-a con 0x5644aa0fa7d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient(hunting): authenticate will time out at 2163.797232s 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request con 0x5644aa0ca610 auth_method 0 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): get_auth_request con 0x5644aa0fa7d0 auth_method 0 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.657 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:48:17.295+0000 7f7ddd650640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:48:17.295+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request con 0x5644aa0f4d70 auth_method 0 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:48:17.295+0000 7f7ddc64e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:48:17.295+0000 7f7ddc64e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:48:17.295+0000 7f7ddc64e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient(hunting): handle_auth_done global_id 6644 payload 824 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient: _finish_hunting 0 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 1 monclient: found mon.noname-c 2024-09-12T00:48:17.658 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:48:17.295+0000 7f7ddce4f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: dump: 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.659 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: _finish_auth 0 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: _check_auth_tickets 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:48:17.295+0000 7f7de112c800 5 monclient: authenticate success, global_id 6644 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:48:17.295+0000 7f7de112c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:48:17.295+0000 7f7cb27fc640 10 monclient: dump: 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:17.660 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:48:17.295+0000 7f7cb3fff640 4 set_mon_vals no callback set 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:48:17.296+0000 7f7de112c800 10 monclient: _renew_subs 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:48:17.296+0000 7f7de112c800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:48:17.296+0000 7f7de112c800 1 librados: init done 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:48:17.296+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command cr dump hook 0x5644aa0cb9d8 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:48:17.297+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:48:17.298+0000 7f7cb27fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:48:17.298+0000 7f7cb27fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.661 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:48:17.298+0000 7f7cb27fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:48:17.298+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x7f7ca8076470 auth_method 0 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:48:17.298+0000 7f7ddd650640 10 monclient: get_auth_request con 0x5644aa114160 auth_method 0 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 realm 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:48:17.299+0000 7f7de112c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:48:17.299+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:48:17.299+0000 7f7ddce4f640 10 monclient: get_auth_request con 0x5644aa1183c0 auth_method 0 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:48:17.300+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:48:17.300+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.662 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:48:17.300+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:48:17.300+0000 7f7de112c800 20 searching for the correct realm 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:48:17.300+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x5644aa11d660 auth_method 0 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:48:17.301+0000 7f7ddd650640 10 monclient: get_auth_request con 0x7f7dd0090040 auth_method 0 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:48:17.302+0000 7f7ddce4f640 10 monclient: get_auth_request con 0x7f7dcc044030 auth_method 0 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:48:17.303+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x7f7dd0091b40 auth_method 0 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:48:17.303+0000 7f7ddc64e640 0 -- 172.21.15.19:0/1479534080 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f7dd0091b40 msgr2=0x7f7dd0078920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:48:17.504+0000 7f7ddc64e640 10 monclient: get_auth_request con 0x7f7dd0091b40 auth_method 0 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:48:17.506+0000 7f7ddd650640 10 monclient: get_auth_request con 0x7f7dcc082650 auth_method 0 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:48:17.507+0000 7f7ddce4f640 10 monclient: get_auth_request con 0x7f7dd4017070 auth_method 0 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:48:17.508+0000 7f7ddd650640 0 -- 172.21.15.19:0/1479534080 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5644aa114160 msgr2=0x5644aa1165f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:48:17.508+0000 7f7cb27fc640 1 client.6644.objecter ms_handle_reset 0x5644aa114160 session 0x5644aa113a50 osd.6 2024-09-12T00:48:17.663 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:48:17.508+0000 7f7cb27fc640 10 monclient: _renew_subs 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:48:17.508+0000 7f7cb27fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:48:17.508+0000 7f7ddd650640 10 monclient: get_auth_request con 0x7f7ca8086710 auth_method 0 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:48:17.512+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.664 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 zone default found 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:48:17.513+0000 7f7de112c800 4 Realm: () 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:48:17.513+0000 7f7de112c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:48:17.513+0000 7f7de112c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:48:17.513+0000 7f7de112c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 zonegroup default 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:48:17.513+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:48:17.514+0000 7f7de112c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.665 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:48:17.514+0000 7f7de112c800 20 started sync module instance, tier type = 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:48:17.514+0000 7f7de112c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=0 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=1 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=2 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=3 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=4 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=5 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=6 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:48:17.523+0000 7f7de112c800 20 add_watcher() i=7 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:48:17.523+0000 7f7de112c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding auth protocol: cephx 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding auth protocol: cephx 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding auth protocol: cephx 2024-09-12T00:48:17.666 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: crc 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:48:17.525+0000 7f7de112c800 5 AuthRegistry(0x7ffde52fa870) adding con mode: secure 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:48:17.525+0000 7f7c92fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:17.667 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:48:17.526+0000 7f7de112c800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:48:17.526+0000 7f7de112c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:48:17.526+0000 7f7de112c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command cache list hook 0x5644aa0c7e50 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command cache inspect hook 0x5644aa0c7e50 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command cache erase hook 0x5644aa0c7e50 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command cache zap hook 0x5644aa0c7e50 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 note: GC not initialized 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:48:17.526+0000 7f7c91fe3640 20 reqs_thread_entry: start 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command sync trace show hook 0x7f7dcc079070 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command sync trace history hook 0x7f7dcc079070 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command sync trace active hook 0x7f7dcc079070 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:48:17.526+0000 7f7de112c800 5 asok(0x5644a9e0a630) register_command sync trace active_short hook 0x7f7dcc079070 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:48:17.526+0000 7f7de112c800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:17.668 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:48:17.526+0000 7f7de112c800 20 Filter name: none 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:48:17.526+0000 7f7c037fe640 20 reqs_thread_entry: start 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:48:17.526+0000 7f7de112c800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:48:17.526+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:48:17.527+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 : miss 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:48:17.527+0000 7f7de112c800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:48:17.527+0000 7f7de112c800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:17.669 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:48:17.527+0000 7f7de112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:48:17.528+0000 7f7de112c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:48:17.533+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:48:17.533+0000 7f7de112c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:48:17.533+0000 7f7de112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:48:17.533+0000 7f7de112c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29, ofs0, ns] 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398964 cookie 94852911090096 notifier 6644 bl.length()=915 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:48:17.534+0000 7f7cb37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_sources= new_sources= 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential sources added=[] removed=[] 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_dests= new_dests= 2024-09-12T00:48:17.670 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:48:17.535+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential dests added=[] removed=[] 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.0 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.0 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.1 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.1 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.2 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.2 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.3 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.3 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.4 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.4 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.5 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.5 2024-09-12T00:48:17.671 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.6 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.6 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.7 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.7 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.8 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.8 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.9 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.9 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.10 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.10 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:48:17.540+0000 7f7de112c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.11 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1.11 2024-09-12T00:48:17.672 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:48:17.540+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.0 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:48:17.541+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:48:17.541+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:48:17.542+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.3 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:48:17.542+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.4 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:48:17.542+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.5 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:48:17.543+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.6 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:48:17.543+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.7 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:48:17.544+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.8 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:48:17.544+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.9 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:48:17.545+0000 7f7de112c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.10 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:48:17.548+0000 7f7de112c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:48:17.548+0000 7f7de112c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 2024-09-12T00:48:17.673 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:48:17.549+0000 7f7de112c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:48:17.549+0000 7f7de112c800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:48:17.549+0000 7f7de112c800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:48:17.549+0000 7f7de112c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29, ofs0, ns] 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398965 cookie 94852911090096 notifier 6644 bl.length()=915 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:48:17.550+0000 7f7cb3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_sources= new_sources= 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential sources added=[] removed=[] 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_dests= new_dests= 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:48:17.552+0000 7f7de112c800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential dests added=[] removed=[] 2024-09-12T00:48:17.674 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:48:17.553+0000 7f7de112c800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7de112c800 time 2024-09-12T00:48:17.552871+0000 2024-09-12T00:48:17.675 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:17.675 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.675 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:17.675 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f7de298c71a] 2024-09-12T00:48:17.675 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7de298c8d8] 2024-09-12T00:48:17.675 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644a77d3641] 2024-09-12T00:48:17.675 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5644a77e2582] 2024-09-12T00:48:17.676 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5644a77e33e4] 2024-09-12T00:48:17.676 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:48:17.676 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f7de1629590] 2024-09-12T00:48:17.676 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:48:17.676 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:48:17.676 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.676 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:48:17.553+0000 7f7de112c800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:17.676 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f7de112c800 thread_name:radosgw-admin 2024-09-12T00:48:17.676 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.676 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:17.676 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f7de163e6f0] 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f7de168b99c] 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f7de298c774] 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f7de298c8d8] 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5644a77d3641] 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e82) [0x5644a77e2582] 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x5644a77e33e4] 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f7de1629590] 2024-09-12T00:48:17.677 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:48:17.678 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:48:17.679 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:48:17.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:48:17.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:48:17.682 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:48:17.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7c037fe640 / http_manager 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7c91fe3640 / http_manager 2024-09-12T00:48:17.684 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7c92fe5640 / rgw_dt_lg_renew 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7cb27fc640 / ms_dispatch 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7cb37fe640 / io_context_pool 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7cb3fff640 / io_context_pool 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7cc27fc640 / ms_dispatch 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7cc960a640 / ms_dispatch 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7ccae0d640 / io_context_pool 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7ddc64e640 / msgr-worker-2 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7ddce4f640 / msgr-worker-1 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7ddd650640 / msgr-worker-0 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7ddde51640 / io_context_pool 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: 7f7de112c800 / radosgw-admin 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:48:17.685 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:48:17.554631Z_2db94f3d-f272-47d3-a53e-e0100b5af81c/log 2024-09-12T00:48:17.689 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:48:17.689 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:48:17.690 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:17.690 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:17.690 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.631+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.633+0000 7fc587128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.633+0000 7fc587128800 20 realm 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.633+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.633+0000 7fc587128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.633+0000 7fc587128800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.633+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.634+0000 7fc587128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.634+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.634+0000 7fc587128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.634+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.634+0000 7fc587128800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.634+0000 7fc587128800 20 searching for the correct realm 2024-09-12T00:48:17.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.638+0000 7fc58266e640 0 -- 172.21.15.19:0/121022074 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc57806b8b0 msgr2=0x7fc57809a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:17.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.844+0000 7fc583670640 0 -- 172.21.15.19:0/121022074 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x56047b36c1a0 msgr2=0x56047b36e590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:17.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.848+0000 7fc587128800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:17.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.848+0000 7fc587128800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:17.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.848+0000 7fc587128800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:17.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.848+0000 7fc587128800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:17.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.848+0000 7fc587128800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:17.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.848+0000 7fc587128800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:17.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.848+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.848+0000 7fc587128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.848+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.848+0000 7fc587128800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:17.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.848+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:17.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 20 zone default found 2024-09-12T00:48:17.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 4 Realm: () 2024-09-12T00:48:17.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:17.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:17.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:17.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 20 zonegroup default 2024-09-12T00:48:17.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.849 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.849+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.850+0000 7fc587128800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:17.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.850+0000 7fc587128800 20 started sync module instance, tier type = 2024-09-12T00:48:17.850 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.850+0000 7fc587128800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:17.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.859+0000 7fc587128800 20 add_watcher() i=0 2024-09-12T00:48:17.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.859+0000 7fc587128800 20 add_watcher() i=1 2024-09-12T00:48:17.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.859+0000 7fc587128800 20 add_watcher() i=2 2024-09-12T00:48:17.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.859+0000 7fc587128800 20 add_watcher() i=3 2024-09-12T00:48:17.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.859+0000 7fc587128800 20 add_watcher() i=4 2024-09-12T00:48:17.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.859+0000 7fc587128800 20 add_watcher() i=5 2024-09-12T00:48:17.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.859+0000 7fc587128800 20 add_watcher() i=6 2024-09-12T00:48:17.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.860+0000 7fc587128800 20 add_watcher() i=7 2024-09-12T00:48:17.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.860+0000 7fc587128800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:17.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.862+0000 7fc4397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:17.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.862+0000 7fc587128800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:17.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.862+0000 7fc587128800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:17.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.862+0000 7fc587128800 5 note: GC not initialized 2024-09-12T00:48:17.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.863+0000 7fc3b3fff640 20 reqs_thread_entry: start 2024-09-12T00:48:17.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.863+0000 7fc587128800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:17.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.863+0000 7fc587128800 20 Filter name: none 2024-09-12T00:48:17.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.863+0000 7fc3b1ffb640 20 reqs_thread_entry: start 2024-09-12T00:48:17.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.863+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.863+0000 7fc587128800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:17.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.863+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.864+0000 7fc587128800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:48:17.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.864+0000 7fc587128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:17.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.864+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.864+0000 7fc587128800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:17.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.864+0000 7fc587128800 20 rados->read ofs=0 len=0 2024-09-12T00:48:17.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.865+0000 7fc587128800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:48:17.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.865+0000 7fc587128800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:17.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.867+0000 7fc4397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:17.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.869+0000 7fc587128800 20 remove_watcher() i=0 2024-09-12T00:48:17.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.869+0000 7fc587128800 2 removed watcher, disabling cache 2024-09-12T00:48:17.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.870+0000 7fc587128800 20 remove_watcher() i=1 2024-09-12T00:48:17.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.871+0000 7fc587128800 20 remove_watcher() i=2 2024-09-12T00:48:17.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.872+0000 7fc587128800 20 remove_watcher() i=3 2024-09-12T00:48:17.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.873+0000 7fc587128800 20 remove_watcher() i=4 2024-09-12T00:48:17.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.874+0000 7fc587128800 20 remove_watcher() i=5 2024-09-12T00:48:17.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.875+0000 7fc587128800 20 remove_watcher() i=6 2024-09-12T00:48:17.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:17.876+0000 7fc587128800 20 remove_watcher() i=7 2024-09-12T00:48:17.886 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.886 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:17.886 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-block-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:48:17.886 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:17.888 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:17.888 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:17.919 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:17.919 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:17.977 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:48:18.009 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:18.009 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:18.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.050+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.051+0000 7fbaa780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.051+0000 7fbaa780e800 20 realm 2024-09-12T00:48:18.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.051+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.051+0000 7fbaa780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.051+0000 7fbaa780e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:18.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.051+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.052+0000 7fbaa780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.052+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.052+0000 7fbaa780e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:18.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.052+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.053+0000 7fbaa780e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:18.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.053+0000 7fbaa780e800 20 searching for the correct realm 2024-09-12T00:48:18.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.057+0000 7fbaa365a640 0 -- 172.21.15.19:0/1671906638 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7fba9802c040 msgr2=0x7fba9801c560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:18.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.060+0000 7fbaa2e59640 0 -- 172.21.15.19:0/1671906638 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fba9c04b070 msgr2=0x7fba9c068b10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:18.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.063+0000 7fbaa780e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:18.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.063+0000 7fbaa780e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:18.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.063+0000 7fbaa780e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:18.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.063+0000 7fbaa780e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:18.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.063+0000 7fbaa780e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:18.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.063+0000 7fbaa780e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:18.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.063+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:18.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:18.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 20 zone default found 2024-09-12T00:48:18.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 4 Realm: () 2024-09-12T00:48:18.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:18.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:18.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:18.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 20 zonegroup default 2024-09-12T00:48:18.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.064+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.065+0000 7fbaa780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.065+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.065+0000 7fbaa780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.065+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.065+0000 7fbaa780e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:18.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.065+0000 7fbaa780e800 20 started sync module instance, tier type = 2024-09-12T00:48:18.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.065+0000 7fbaa780e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:18.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.074+0000 7fbaa780e800 20 add_watcher() i=0 2024-09-12T00:48:18.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.074+0000 7fbaa780e800 20 add_watcher() i=1 2024-09-12T00:48:18.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.074+0000 7fbaa780e800 20 add_watcher() i=2 2024-09-12T00:48:18.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.074+0000 7fbaa780e800 20 add_watcher() i=3 2024-09-12T00:48:18.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.074+0000 7fbaa780e800 20 add_watcher() i=4 2024-09-12T00:48:18.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.074+0000 7fbaa780e800 20 add_watcher() i=5 2024-09-12T00:48:18.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.074+0000 7fbaa780e800 20 add_watcher() i=6 2024-09-12T00:48:18.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.075+0000 7fbaa780e800 20 add_watcher() i=7 2024-09-12T00:48:18.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.075+0000 7fbaa780e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:18.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.076+0000 7fb9597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:18.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.077+0000 7fbaa780e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:18.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.077+0000 7fbaa780e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:18.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.077+0000 7fbaa780e800 5 note: GC not initialized 2024-09-12T00:48:18.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.077+0000 7fb8d3fff640 20 reqs_thread_entry: start 2024-09-12T00:48:18.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.077+0000 7fbaa780e800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:18.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.077+0000 7fbaa780e800 20 Filter name: none 2024-09-12T00:48:18.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.077+0000 7fb8d1ffb640 20 reqs_thread_entry: start 2024-09-12T00:48:18.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.077+0000 7fbaa780e800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:48:18.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.077+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.078+0000 7fbaa780e800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:18.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.078+0000 7fbaa780e800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:48:18.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.078+0000 7fbaa780e800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:48:18.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.078+0000 7fbaa780e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 : miss 2024-09-12T00:48:18.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.078+0000 7fbaa780e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:18.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.078+0000 7fbaa780e800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:48:18.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.078+0000 7fbaa780e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:18.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.078+0000 7fbaa780e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:18.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.078+0000 7fbaa780e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:18.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.078+0000 7fbaa780e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:18.078 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.078+0000 7fbaa780e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 2024-09-12T00:48:18.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.079+0000 7fbaa780e800 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to be held by another RGW process; skipping for now 2024-09-12T00:48:18.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.080+0000 7fb9597e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:18.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.083+0000 7fbaa780e800 20 remove_watcher() i=0 2024-09-12T00:48:18.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.083+0000 7fbaa780e800 2 removed watcher, disabling cache 2024-09-12T00:48:18.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.084+0000 7fbaa780e800 20 remove_watcher() i=1 2024-09-12T00:48:18.083 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.085+0000 7fbaa780e800 20 remove_watcher() i=2 2024-09-12T00:48:18.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.086+0000 7fbaa780e800 20 remove_watcher() i=3 2024-09-12T00:48:18.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.087+0000 7fbaa780e800 20 remove_watcher() i=4 2024-09-12T00:48:18.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.088+0000 7fbaa780e800 20 remove_watcher() i=5 2024-09-12T00:48:18.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.089+0000 7fbaa780e800 20 remove_watcher() i=6 2024-09-12T00:48:18.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:18.090+0000 7fbaa780e800 20 remove_watcher() i=7 2024-09-12T00:48:18.099 INFO:tasks.workunit.client.0.smithi019.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:48:48.115 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:48:48.152 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:48.152 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:48.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.200+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.202+0000 7f1345a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.202+0000 7f1345a2f800 20 realm 2024-09-12T00:48:48.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.202+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.202+0000 7f1345a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.202+0000 7f1345a2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:48.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.202+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.203+0000 7f1345a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.203+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.204+0000 7f1345a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.204+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.204+0000 7f1345a2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:48.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.204+0000 7f1345a2f800 20 searching for the correct realm 2024-09-12T00:48:48.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.206+0000 7f1343520640 0 -- 172.21.15.19:0/808786698 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x563088bba7b0 msgr2=0x563088bbcbc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.210+0000 7f1343d21640 0 -- 172.21.15.19:0/808786698 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x563088bba7b0 msgr2=0x7f13340aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.419+0000 7f1345a2f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:48.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.419+0000 7f1345a2f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:48.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.419+0000 7f1345a2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:48.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.419+0000 7f1345a2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:48.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.419+0000 7f1345a2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.419+0000 7f1345a2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.419+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.420+0000 7f1345a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.420+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.420+0000 7f1345a2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.420+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.421+0000 7f1345a2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:48.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.421+0000 7f1345a2f800 20 zone default found 2024-09-12T00:48:48.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.421+0000 7f1345a2f800 4 Realm: () 2024-09-12T00:48:48.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.421+0000 7f1345a2f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:48.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.421+0000 7f1345a2f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:48.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.421+0000 7f1345a2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:48.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.421+0000 7f1345a2f800 20 zonegroup default 2024-09-12T00:48:48.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.421+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.421+0000 7f1345a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.421+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.422+0000 7f1345a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.422+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.422+0000 7f1345a2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.422+0000 7f1345a2f800 20 started sync module instance, tier type = 2024-09-12T00:48:48.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.422+0000 7f1345a2f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:48.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.433+0000 7f1345a2f800 20 add_watcher() i=0 2024-09-12T00:48:48.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.433+0000 7f1345a2f800 20 add_watcher() i=1 2024-09-12T00:48:48.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.433+0000 7f1345a2f800 20 add_watcher() i=2 2024-09-12T00:48:48.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.433+0000 7f1345a2f800 20 add_watcher() i=3 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.433+0000 7f1345a2f800 20 add_watcher() i=4 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.433+0000 7f1345a2f800 20 add_watcher() i=5 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.433+0000 7f1345a2f800 20 add_watcher() i=6 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.434+0000 7f1345a2f800 20 add_watcher() i=7 2024-09-12T00:48:48.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.434+0000 7f1345a2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.436+0000 7f11f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.436+0000 7f1345a2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.436+0000 7f1345a2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:48.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.436+0000 7f1345a2f800 5 note: GC not initialized 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.436+0000 7f11f8fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.436+0000 7f1345a2f800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.436+0000 7f1345a2f800 20 Filter name: none 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.437+0000 7f11727fc640 20 reqs_thread_entry: start 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.437+0000 7f1345a2f800 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.437+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.437+0000 7f1345a2f800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.437+0000 7f1345a2f800 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:48:48.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.437+0000 7f1345a2f800 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:48:48.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.437+0000 7f1345a2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 : miss 2024-09-12T00:48:48.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.437+0000 7f1345a2f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.438+0000 7f1345a2f800 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:48:48.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.438+0000 7f1345a2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:48.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.438+0000 7f1345a2f800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:48.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.438+0000 7f1345a2f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:48.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.438+0000 7f1345a2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:48.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.438+0000 7f1345a2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 2024-09-12T00:48:48.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.439+0000 7f1345a2f800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:48:48.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.448+0000 7f1345a2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:48.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.448+0000 7f1345a2f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:48.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.448+0000 7f1345a2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:48.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.448+0000 7f1345a2f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29, ofs0, ns] 2024-09-12T00:48:48.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.449+0000 7f12267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398966 cookie 94766452458416 notifier 7122 bl.length()=915 2024-09-12T00:48:48.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.449+0000 7f12267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:48.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.449+0000 7f12267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:48.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.449+0000 7f12267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:48.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.451+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_sources= new_sources= 2024-09-12T00:48:48.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.451+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential sources added=[] removed=[] 2024-09-12T00:48:48.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.451+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_dests= new_dests= 2024-09-12T00:48:48.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.451+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential dests added=[] removed=[] 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.0 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.0 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.1 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.1 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.2 2024-09-12T00:48:48.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.2 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.3 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.3 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.4 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.4 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.5 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.5 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.6 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.6 2024-09-12T00:48:48.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.7 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.7 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.8 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.8 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.9 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.9 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.10 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.10 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.11 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2.11 2024-09-12T00:48:48.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.457+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.0 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.458+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.458+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.459+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.3 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.460+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.4 2024-09-12T00:48:48.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.460+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.5 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.461+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.6 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.461+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.7 2024-09-12T00:48:48.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.462+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.8 2024-09-12T00:48:48.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.462+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.9 2024-09-12T00:48:48.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.463+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.10 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.467+0000 7f1345a2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:48.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.467+0000 7f1345a2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.468+0000 7f1345a2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.468+0000 7f1345a2f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.468+0000 7f1345a2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.468+0000 7f1345a2f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29, ofs0, ns] 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.468+0000 7f12267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398967 cookie 94766452458416 notifier 7122 bl.length()=915 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.468+0000 7f12267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:48.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.468+0000 7f12267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:48.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.468+0000 7f12267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.470+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_sources= new_sources= 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.470+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential sources added=[] removed=[] 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.470+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_dests= new_dests= 2024-09-12T00:48:48.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.470+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential dests added=[] removed=[] 2024-09-12T00:48:48.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.474+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.0 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.474+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.1 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.474+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.2 2024-09-12T00:48:48.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.475+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.3 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.475+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.4 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.475+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.5 2024-09-12T00:48:48.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.476+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.6 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.476+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.7 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.477+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.8 2024-09-12T00:48:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.477+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.9 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.477+0000 7f1345a2f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29.10 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.478+0000 7f1345a2f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:48.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.478+0000 7f1345a2f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.479+0000 7f1345a2f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.479+0000 7f1345a2f800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.479+0000 7f1345a2f800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:48.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.479+0000 7f1345a2f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29, ofs0, ns] 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.480+0000 7f1226ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398968 cookie 94766452458416 notifier 7122 bl.length()=883 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.480+0000 7f1226ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 info.flags=0x17 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.480+0000 7f1226ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 to cache LRU end 2024-09-12T00:48:48.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.480+0000 7f1226ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.481+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_sources= new_sources= 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.481+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential sources added=[] removed=[] 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.481+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): orig_dests= new_dests= 2024-09-12T00:48:48.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.481+0000 7f1345a2f800 20 handle_bi_update(): bucket=:abort-at-block-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29]): potential dests added=[] removed=[] 2024-09-12T00:48:48.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.484+0000 7f1345a2f800 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:48:48.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.487+0000 7f11f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.489+0000 7f1345a2f800 20 remove_watcher() i=0 2024-09-12T00:48:48.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.489+0000 7f1345a2f800 2 removed watcher, disabling cache 2024-09-12T00:48:48.489 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.490+0000 7f1345a2f800 20 remove_watcher() i=1 2024-09-12T00:48:48.490 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.491+0000 7f1345a2f800 20 remove_watcher() i=2 2024-09-12T00:48:48.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.493+0000 7f1345a2f800 20 remove_watcher() i=3 2024-09-12T00:48:48.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.494+0000 7f1345a2f800 20 remove_watcher() i=4 2024-09-12T00:48:48.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.495+0000 7f1345a2f800 20 remove_watcher() i=5 2024-09-12T00:48:48.495 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.496+0000 7f1345a2f800 20 remove_watcher() i=6 2024-09-12T00:48:48.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.497+0000 7f1345a2f800 20 remove_watcher() i=7 2024-09-12T00:48:48.512 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:48.542 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:48.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.584+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.586+0000 7fd0ed72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.586+0000 7fd0ed72b800 20 realm 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.586+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.586+0000 7fd0ed72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.586+0000 7fd0ed72b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.586+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.586+0000 7fd0ed72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.586+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.587+0000 7fd0ed72b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.587+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.587+0000 7fd0ed72b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:48.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.588+0000 7fd0ed72b800 20 searching for the correct realm 2024-09-12T00:48:48.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.591+0000 7fd0e8c72640 0 -- 172.21.15.19:0/558628470 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fd0e00d3250 msgr2=0x7fd0e00d3950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.796+0000 7fd0e9c74640 0 -- 172.21.15.19:0/558628470 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55bf3f682ca0 msgr2=0x55bf3f685110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.801+0000 7fd0ed72b800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.801+0000 7fd0ed72b800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.801+0000 7fd0ed72b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.801+0000 7fd0ed72b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.801+0000 7fd0ed72b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.801+0000 7fd0ed72b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.801+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.801+0000 7fd0ed72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.801+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:48.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 20 zone default found 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 4 Realm: () 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 20 zonegroup default 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.802+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.803+0000 7fd0ed72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.803+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.803+0000 7fd0ed72b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:48.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.803+0000 7fd0ed72b800 20 started sync module instance, tier type = 2024-09-12T00:48:48.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.803+0000 7fd0ed72b800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:48.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.812+0000 7fd0ed72b800 20 add_watcher() i=0 2024-09-12T00:48:48.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.812+0000 7fd0ed72b800 20 add_watcher() i=1 2024-09-12T00:48:48.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.812+0000 7fd0ed72b800 20 add_watcher() i=2 2024-09-12T00:48:48.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.812+0000 7fd0ed72b800 20 add_watcher() i=3 2024-09-12T00:48:48.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.812+0000 7fd0ed72b800 20 add_watcher() i=4 2024-09-12T00:48:48.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.812+0000 7fd0ed72b800 20 add_watcher() i=5 2024-09-12T00:48:48.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.812+0000 7fd0ed72b800 20 add_watcher() i=6 2024-09-12T00:48:48.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.813+0000 7fd0ed72b800 20 add_watcher() i=7 2024-09-12T00:48:48.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.813+0000 7fd0ed72b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:48.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.815+0000 7fcf9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.816+0000 7fd0ed72b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:48.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.816+0000 7fd0ed72b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:48.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.816+0000 7fd0ed72b800 5 note: GC not initialized 2024-09-12T00:48:48.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.816+0000 7fcf9efe5640 20 reqs_thread_entry: start 2024-09-12T00:48:48.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.816+0000 7fd0ed72b800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:48.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.816+0000 7fd0ed72b800 20 Filter name: none 2024-09-12T00:48:48.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.816+0000 7fcf9cfe1640 20 reqs_thread_entry: start 2024-09-12T00:48:48.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.816+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.817+0000 7fd0ed72b800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:48.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.817+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.817+0000 7fd0ed72b800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:48.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.817+0000 7fd0ed72b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:48.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.817+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.818+0000 7fd0ed72b800 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:48:48.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.818+0000 7fd0ed72b800 20 rados->read ofs=0 len=0 2024-09-12T00:48:48.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.818+0000 7fd0ed72b800 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:48:48.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.818+0000 7fd0ed72b800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:48.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.820+0000 7fcf9ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:48.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.822+0000 7fd0ed72b800 20 remove_watcher() i=0 2024-09-12T00:48:48.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.822+0000 7fd0ed72b800 2 removed watcher, disabling cache 2024-09-12T00:48:48.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.823+0000 7fd0ed72b800 20 remove_watcher() i=1 2024-09-12T00:48:48.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.824+0000 7fd0ed72b800 20 remove_watcher() i=2 2024-09-12T00:48:48.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.825+0000 7fd0ed72b800 20 remove_watcher() i=3 2024-09-12T00:48:48.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.826+0000 7fd0ed72b800 20 remove_watcher() i=4 2024-09-12T00:48:48.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.828+0000 7fd0ed72b800 20 remove_watcher() i=5 2024-09-12T00:48:48.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.829+0000 7fd0ed72b800 20 remove_watcher() i=6 2024-09-12T00:48:48.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:48.830+0000 7fd0ed72b800 20 remove_watcher() i=7 2024-09-12T00:48:48.840 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:48.840 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:48.840 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-block-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:48:48.840 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:48.843 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:48.843 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:48.862 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:48.862 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.053 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.053 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.191 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:48:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:49.192 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.193 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.239 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.296 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.296 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.334 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.334 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.368 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.368 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.402 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.402 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.436 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.437 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.470 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.470 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.502 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.502 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.536 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.537 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.570 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.571 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.604 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.604 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.639 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.639 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.674 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.674 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.707 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.707 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.741 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.742 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.775 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.775 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.809 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.809 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.842 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.842 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.876 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.876 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.910 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.910 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.944 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:49.944 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:49.978 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:48:50.008 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:50.008 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:50.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.048+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.050+0000 7f9e7372f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.050+0000 7f9e7372f800 20 realm 2024-09-12T00:48:50.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.050+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.050+0000 7f9e7372f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.050+0000 7f9e7372f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:50.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.050+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.050+0000 7f9e7372f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.050+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.051+0000 7f9e7372f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:50.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.051+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.051+0000 7f9e7372f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:50.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.051+0000 7f9e7372f800 20 searching for the correct realm 2024-09-12T00:48:50.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.055+0000 7f9e6ec19640 0 -- 172.21.15.19:0/1651588430 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f9e58038400 msgr2=0x7f9e58038880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:50.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.260+0000 7f9e6fc1b640 0 -- 172.21.15.19:0/1651588430 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55647be87e60 msgr2=0x55647be8a2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:50.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.265+0000 7f9e7372f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:50.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.265+0000 7f9e7372f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:50.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.265+0000 7f9e7372f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:50.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.265+0000 7f9e7372f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:50.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.265+0000 7f9e7372f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:50.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.265+0000 7f9e7372f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:50.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.265+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.265+0000 7f9e7372f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.265+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.266+0000 7f9e7372f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:50.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.266+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.266+0000 7f9e7372f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:50.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.266+0000 7f9e7372f800 20 zone default found 2024-09-12T00:48:50.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.266+0000 7f9e7372f800 4 Realm: () 2024-09-12T00:48:50.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.266+0000 7f9e7372f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:50.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.266+0000 7f9e7372f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:50.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.266+0000 7f9e7372f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:50.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.266+0000 7f9e7372f800 20 zonegroup default 2024-09-12T00:48:50.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.266+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.267+0000 7f9e7372f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.267+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.267+0000 7f9e7372f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.267+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.267+0000 7f9e7372f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.267+0000 7f9e7372f800 20 started sync module instance, tier type = 2024-09-12T00:48:50.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.267+0000 7f9e7372f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:50.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.276+0000 7f9e7372f800 20 add_watcher() i=0 2024-09-12T00:48:50.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.276+0000 7f9e7372f800 20 add_watcher() i=1 2024-09-12T00:48:50.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.276+0000 7f9e7372f800 20 add_watcher() i=2 2024-09-12T00:48:50.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.276+0000 7f9e7372f800 20 add_watcher() i=3 2024-09-12T00:48:50.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.276+0000 7f9e7372f800 20 add_watcher() i=4 2024-09-12T00:48:50.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.276+0000 7f9e7372f800 20 add_watcher() i=5 2024-09-12T00:48:50.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.276+0000 7f9e7372f800 20 add_watcher() i=6 2024-09-12T00:48:50.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.276+0000 7f9e7372f800 20 add_watcher() i=7 2024-09-12T00:48:50.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.276+0000 7f9e7372f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:50.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.278+0000 7f9d25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:50.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.279+0000 7f9e7372f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:50.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.279+0000 7f9e7372f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:50.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.279+0000 7f9e7372f800 5 note: GC not initialized 2024-09-12T00:48:50.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.279+0000 7f9d24fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:50.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.279+0000 7f9e7372f800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:50.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.279+0000 7f9e7372f800 20 Filter name: none 2024-09-12T00:48:50.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.279+0000 7f9c9e7fc640 20 reqs_thread_entry: start 2024-09-12T00:48:50.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.279+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.280+0000 7f9e7372f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:50.280 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.280+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.281+0000 7f9e7372f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:50.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.281+0000 7f9e7372f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:50.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.281+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.281+0000 7f9e7372f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:50.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.281+0000 7f9e7372f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.281+0000 7f9e7372f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:50.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.281+0000 7f9e7372f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:50.282 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.283+0000 7f9d25fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:50.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.285+0000 7f9e7372f800 20 remove_watcher() i=0 2024-09-12T00:48:50.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.285+0000 7f9e7372f800 2 removed watcher, disabling cache 2024-09-12T00:48:50.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.286+0000 7f9e7372f800 20 remove_watcher() i=1 2024-09-12T00:48:50.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.288+0000 7f9e7372f800 20 remove_watcher() i=2 2024-09-12T00:48:50.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.289+0000 7f9e7372f800 20 remove_watcher() i=3 2024-09-12T00:48:50.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.290+0000 7f9e7372f800 20 remove_watcher() i=4 2024-09-12T00:48:50.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.291+0000 7f9e7372f800 20 remove_watcher() i=5 2024-09-12T00:48:50.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.292+0000 7f9e7372f800 20 remove_watcher() i=6 2024-09-12T00:48:50.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.293+0000 7f9e7372f800 20 remove_watcher() i=7 2024-09-12T00:48:50.304 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:50.304 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:50.304 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-commit-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:48:50.304 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:50.306 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:48:50.341 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:50.341 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:50.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.381+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.383+0000 7fc6bd735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.383+0000 7fc6bd735800 20 realm 2024-09-12T00:48:50.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.383+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.383+0000 7fc6bd735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.383+0000 7fc6bd735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:50.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.383+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.383+0000 7fc6bd735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.383+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.384+0000 7fc6bd735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:50.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.384+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.384+0000 7fc6bd735800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:50.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.384+0000 7fc6bd735800 20 searching for the correct realm 2024-09-12T00:48:50.386 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.387+0000 7fc6b3fff640 0 -- 172.21.15.19:0/3840154563 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc6a4087900 msgr2=0x7fc6a40860c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:50.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.592+0000 7fc6b9c22640 0 -- 172.21.15.19:0/3840154563 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x556966497c30 msgr2=0x55696649a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:50.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.596+0000 7fc6bd735800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:50.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.596+0000 7fc6bd735800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:50.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.596+0000 7fc6bd735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:50.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.596+0000 7fc6bd735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:50.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.596+0000 7fc6bd735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:50.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.596+0000 7fc6bd735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:50.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.596+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:50.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 20 zone default found 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 4 Realm: () 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 20 zonegroup default 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.597+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.598+0000 7fc6bd735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.598+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.598+0000 7fc6bd735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.598+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.598+0000 7fc6bd735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.598+0000 7fc6bd735800 20 started sync module instance, tier type = 2024-09-12T00:48:50.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.598+0000 7fc6bd735800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:50.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.607+0000 7fc6bd735800 20 add_watcher() i=0 2024-09-12T00:48:50.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.607+0000 7fc6bd735800 20 add_watcher() i=1 2024-09-12T00:48:50.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.607+0000 7fc6bd735800 20 add_watcher() i=2 2024-09-12T00:48:50.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.607+0000 7fc6bd735800 20 add_watcher() i=3 2024-09-12T00:48:50.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.607+0000 7fc6bd735800 20 add_watcher() i=4 2024-09-12T00:48:50.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.607+0000 7fc6bd735800 20 add_watcher() i=5 2024-09-12T00:48:50.606 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.607+0000 7fc6bd735800 20 add_watcher() i=6 2024-09-12T00:48:50.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.608+0000 7fc6bd735800 20 add_watcher() i=7 2024-09-12T00:48:50.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.608+0000 7fc6bd735800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:50.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.610+0000 7fc56f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:50.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.611+0000 7fc6bd735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:50.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.611+0000 7fc6bd735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:50.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.611+0000 7fc6bd735800 5 note: GC not initialized 2024-09-12T00:48:50.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.611+0000 7fc56e7e4640 20 reqs_thread_entry: start 2024-09-12T00:48:50.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.611+0000 7fc6bd735800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:50.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.611+0000 7fc6bd735800 20 Filter name: none 2024-09-12T00:48:50.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.611+0000 7fc4dffff640 20 reqs_thread_entry: start 2024-09-12T00:48:50.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.611+0000 7fc6bd735800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:48:50.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.611+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.612+0000 7fc6bd735800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:50.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.612+0000 7fc6bd735800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:48:50.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.612+0000 7fc6bd735800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:48:50.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.612+0000 7fc6bd735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 : miss 2024-09-12T00:48:50.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.612+0000 7fc6bd735800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.613+0000 7fc6bd735800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:50.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.613+0000 7fc6bd735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:50.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.613+0000 7fc6bd735800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:50.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.613+0000 7fc6bd735800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:50.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.613+0000 7fc6bd735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:50.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.613+0000 7fc6bd735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 2024-09-12T00:48:50.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.618+0000 7fc6bd735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:50.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.618+0000 7fc6bd735800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:50.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.618+0000 7fc6bd735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:50.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.618+0000 7fc6bd735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30, ofs0, ns] 2024-09-12T00:48:50.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.618+0000 7fc58bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398880 cookie 93911176069312 notifier 7179 bl.length()=931 2024-09-12T00:48:50.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.618+0000 7fc58bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:50.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.618+0000 7fc58bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:50.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.618+0000 7fc58bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:50.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.620+0000 7fc6bd735800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): orig_sources= new_sources= 2024-09-12T00:48:50.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.620+0000 7fc6bd735800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): potential sources added=[] removed=[] 2024-09-12T00:48:50.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.620+0000 7fc6bd735800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): orig_dests= new_dests= 2024-09-12T00:48:50.619 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.620+0000 7fc6bd735800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): potential dests added=[] removed=[] 2024-09-12T00:48:50.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.0 2024-09-12T00:48:50.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.0 2024-09-12T00:48:50.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.1 2024-09-12T00:48:50.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.1 2024-09-12T00:48:50.623 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.2 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.2 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.3 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.3 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.4 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.4 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.5 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.5 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.6 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.6 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.7 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.7 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.8 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.8 2024-09-12T00:48:50.624 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.9 2024-09-12T00:48:50.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.9 2024-09-12T00:48:50.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.10 2024-09-12T00:48:50.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.10 2024-09-12T00:48:50.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.11 2024-09-12T00:48:50.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1.11 2024-09-12T00:48:50.625 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.624+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.0 2024-09-12T00:48:50.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.625+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1 2024-09-12T00:48:50.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.625+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2 2024-09-12T00:48:50.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.626+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.3 2024-09-12T00:48:50.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.626+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.4 2024-09-12T00:48:50.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.627+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.5 2024-09-12T00:48:50.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.627+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.6 2024-09-12T00:48:50.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.628+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.7 2024-09-12T00:48:50.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.628+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.8 2024-09-12T00:48:50.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.629+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.9 2024-09-12T00:48:50.628 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.630+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.10 2024-09-12T00:48:50.634 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.636+0000 7fc6bd735800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:50.635 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.636+0000 7fc6bd735800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 2024-09-12T00:48:50.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.637+0000 7fc6bd735800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:50.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.637+0000 7fc6bd735800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:50.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.637+0000 7fc6bd735800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:50.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.637+0000 7fc6bd735800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30, ofs0, ns] 2024-09-12T00:48:50.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.638+0000 7fc58bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398881 cookie 93911176069312 notifier 7179 bl.length()=931 2024-09-12T00:48:50.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.638+0000 7fc58bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:50.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.638+0000 7fc58bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:50.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.638+0000 7fc58bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:50.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.639+0000 7fc6bd735800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): orig_sources= new_sources= 2024-09-12T00:48:50.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.639+0000 7fc6bd735800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): potential sources added=[] removed=[] 2024-09-12T00:48:50.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.639+0000 7fc6bd735800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): orig_dests= new_dests= 2024-09-12T00:48:50.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.639+0000 7fc6bd735800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): potential dests added=[] removed=[] 2024-09-12T00:48:50.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.641+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.0 2024-09-12T00:48:50.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.642+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1 2024-09-12T00:48:50.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.642+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2 2024-09-12T00:48:50.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.642+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.3 2024-09-12T00:48:50.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.643+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.4 2024-09-12T00:48:50.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.643+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.5 2024-09-12T00:48:50.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.643+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.6 2024-09-12T00:48:50.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.644+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.7 2024-09-12T00:48:50.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.644+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.8 2024-09-12T00:48:50.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.644+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.9 2024-09-12T00:48:50.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.645+0000 7fc6bd735800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.10 2024-09-12T00:48:50.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.645+0000 7fc6bd735800 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:48:50.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.645+0000 7fc6bd735800 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:48:50.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.652+0000 7fc56f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:50.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.654+0000 7fc6bd735800 20 remove_watcher() i=0 2024-09-12T00:48:50.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.654+0000 7fc6bd735800 2 removed watcher, disabling cache 2024-09-12T00:48:50.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.655+0000 7fc6bd735800 20 remove_watcher() i=1 2024-09-12T00:48:50.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.656+0000 7fc6bd735800 20 remove_watcher() i=2 2024-09-12T00:48:50.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.657+0000 7fc6bd735800 20 remove_watcher() i=3 2024-09-12T00:48:50.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.658+0000 7fc6bd735800 20 remove_watcher() i=4 2024-09-12T00:48:50.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.659+0000 7fc6bd735800 20 remove_watcher() i=5 2024-09-12T00:48:50.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.660+0000 7fc6bd735800 20 remove_watcher() i=6 2024-09-12T00:48:50.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.661+0000 7fc6bd735800 20 remove_watcher() i=7 2024-09-12T00:48:50.673 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:48:50.702 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:50.702 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:50.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.742+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.744+0000 7f1d23b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.744+0000 7f1d23b46800 20 realm 2024-09-12T00:48:50.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.744+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.745+0000 7f1d23b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.745+0000 7f1d23b46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:50.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.745+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.745+0000 7f1d23b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.745+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.746+0000 7f1d23b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:50.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.746+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.746+0000 7f1d23b46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:50.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.746+0000 7f1d23b46800 20 searching for the correct realm 2024-09-12T00:48:50.747 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.749+0000 7f1d20e36640 0 -- 172.21.15.19:0/3384012888 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f1d18032bf0 msgr2=0x7f1d1801d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:50.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.954+0000 7f1d20e36640 0 -- 172.21.15.19:0/3384012888 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5640960c34b0 msgr2=0x5640960c5970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:50.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.958+0000 7f1d23b46800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:50.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.958+0000 7f1d23b46800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:50.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.958+0000 7f1d23b46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:50.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.958+0000 7f1d23b46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:50.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.958+0000 7f1d23b46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:50.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.958+0000 7f1d23b46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:50.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.958+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.958+0000 7f1d23b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.958+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:50.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:50.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 20 zone default found 2024-09-12T00:48:50.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 4 Realm: () 2024-09-12T00:48:50.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:50.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:50.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:50.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 20 zonegroup default 2024-09-12T00:48:50.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.959+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.960+0000 7f1d23b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.960+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.960+0000 7f1d23b46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:50.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.960+0000 7f1d23b46800 20 started sync module instance, tier type = 2024-09-12T00:48:50.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.960+0000 7f1d23b46800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:50.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.969+0000 7f1d23b46800 20 add_watcher() i=0 2024-09-12T00:48:50.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.969+0000 7f1d23b46800 20 add_watcher() i=1 2024-09-12T00:48:50.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.969+0000 7f1d23b46800 20 add_watcher() i=2 2024-09-12T00:48:50.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.969+0000 7f1d23b46800 20 add_watcher() i=3 2024-09-12T00:48:50.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.969+0000 7f1d23b46800 20 add_watcher() i=4 2024-09-12T00:48:50.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.969+0000 7f1d23b46800 20 add_watcher() i=5 2024-09-12T00:48:50.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.969+0000 7f1d23b46800 20 add_watcher() i=6 2024-09-12T00:48:50.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.970+0000 7f1d23b46800 20 add_watcher() i=7 2024-09-12T00:48:50.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.970+0000 7f1d23b46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:50.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.971+0000 7f1bd7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:50.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.972+0000 7f1d23b46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:50.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.972+0000 7f1d23b46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:50.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.972+0000 7f1d23b46800 5 note: GC not initialized 2024-09-12T00:48:50.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.972+0000 7f1bd6fe5640 20 reqs_thread_entry: start 2024-09-12T00:48:50.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.972+0000 7f1d23b46800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:50.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.972+0000 7f1d23b46800 20 Filter name: none 2024-09-12T00:48:50.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.972+0000 7f1bd4fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:50.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.972+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.973+0000 7f1d23b46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:50.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.973+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.973+0000 7f1d23b46800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:48:50.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.973+0000 7f1d23b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:50.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.973+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.974+0000 7f1d23b46800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:50.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.974+0000 7f1d23b46800 20 rados->read ofs=0 len=0 2024-09-12T00:48:50.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.974+0000 7f1d23b46800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:48:50.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.974+0000 7f1d23b46800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:50.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.976+0000 7f1bd7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:50.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.978+0000 7f1d23b46800 20 remove_watcher() i=0 2024-09-12T00:48:50.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.978+0000 7f1d23b46800 2 removed watcher, disabling cache 2024-09-12T00:48:50.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.979+0000 7f1d23b46800 20 remove_watcher() i=1 2024-09-12T00:48:50.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.980+0000 7f1d23b46800 20 remove_watcher() i=2 2024-09-12T00:48:50.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.981+0000 7f1d23b46800 20 remove_watcher() i=3 2024-09-12T00:48:50.981 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.982+0000 7f1d23b46800 20 remove_watcher() i=4 2024-09-12T00:48:50.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.983+0000 7f1d23b46800 20 remove_watcher() i=5 2024-09-12T00:48:50.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.984+0000 7f1d23b46800 20 remove_watcher() i=6 2024-09-12T00:48:50.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:50.985+0000 7f1d23b46800 20 remove_watcher() i=7 2024-09-12T00:48:50.995 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:50.996 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:50.996 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-commit-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:48:50.996 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:50.997 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:50.997 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:51.027 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:51.028 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:51.086 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:48:51.118 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:51.118 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:51.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.159+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.160+0000 7fa607e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.160+0000 7fa607e0e800 20 realm 2024-09-12T00:48:51.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.160+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.160+0000 7fa607e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.160+0000 7fa607e0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:51.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.160+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.161+0000 7fa607e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.161+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.160 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.161+0000 7fa607e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:51.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.161+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.161+0000 7fa607e0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:51.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.162+0000 7fa607e0e800 20 searching for the correct realm 2024-09-12T00:48:51.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.165+0000 7fa6034cb640 0 -- 172.21.15.19:0/2641832333 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7fa5f406b1c0 msgr2=0x7fa5f4061090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:51.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.169+0000 7fa6034cb640 0 -- 172.21.15.19:0/2641832333 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fa5fc029060 msgr2=0x7fa5fc062f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:51.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.172+0000 7fa607e0e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:51.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.172+0000 7fa607e0e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:51.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.172+0000 7fa607e0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:51.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.172+0000 7fa607e0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:51.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.172+0000 7fa607e0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:51.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.172+0000 7fa607e0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:51.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:51.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:51.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 20 zone default found 2024-09-12T00:48:51.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 4 Realm: () 2024-09-12T00:48:51.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:51.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:51.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:51.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 20 zonegroup default 2024-09-12T00:48:51.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.173+0000 7fa607e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.174+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.174+0000 7fa607e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.174+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.174+0000 7fa607e0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.174+0000 7fa607e0e800 20 started sync module instance, tier type = 2024-09-12T00:48:51.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.174+0000 7fa607e0e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:51.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.182+0000 7fa607e0e800 20 add_watcher() i=0 2024-09-12T00:48:51.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.182+0000 7fa607e0e800 20 add_watcher() i=1 2024-09-12T00:48:51.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.182+0000 7fa607e0e800 20 add_watcher() i=2 2024-09-12T00:48:51.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.182+0000 7fa607e0e800 20 add_watcher() i=3 2024-09-12T00:48:51.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.182+0000 7fa607e0e800 20 add_watcher() i=4 2024-09-12T00:48:51.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.182+0000 7fa607e0e800 20 add_watcher() i=5 2024-09-12T00:48:51.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.182+0000 7fa607e0e800 20 add_watcher() i=6 2024-09-12T00:48:51.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.183+0000 7fa607e0e800 20 add_watcher() i=7 2024-09-12T00:48:51.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.183+0000 7fa607e0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:51.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.185+0000 7fa4b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:51.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.185+0000 7fa607e0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:51.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.185+0000 7fa607e0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:51.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.185+0000 7fa607e0e800 5 note: GC not initialized 2024-09-12T00:48:51.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.185+0000 7fa4b8fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:51.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.186+0000 7fa607e0e800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:51.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.186+0000 7fa607e0e800 20 Filter name: none 2024-09-12T00:48:51.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.186+0000 7fa4327fc640 20 reqs_thread_entry: start 2024-09-12T00:48:51.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.186+0000 7fa607e0e800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:48:51.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.186+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.186+0000 7fa607e0e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:51.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.186+0000 7fa607e0e800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:48:51.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.186+0000 7fa607e0e800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:48:51.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.186+0000 7fa607e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 : miss 2024-09-12T00:48:51.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.186+0000 7fa607e0e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.187+0000 7fa607e0e800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:48:51.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.187+0000 7fa607e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:51.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.187+0000 7fa607e0e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:51.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.187+0000 7fa607e0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:51.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.187+0000 7fa607e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:51.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.187+0000 7fa607e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 2024-09-12T00:48:51.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.188+0000 7fa607e0e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:48:51.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.194+0000 7fa607e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:51.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.194+0000 7fa607e0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:51.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.194+0000 7fa607e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:51.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.194+0000 7fa607e0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30, ofs0, ns] 2024-09-12T00:48:51.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.194+0000 7fa4e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398882 cookie 94383625569392 notifier 6770 bl.length()=931 2024-09-12T00:48:51.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.194+0000 7fa4e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:51.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.194+0000 7fa4e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:51.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.194+0000 7fa4e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:51.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.196+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): orig_sources= new_sources= 2024-09-12T00:48:51.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.196+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): potential sources added=[] removed=[] 2024-09-12T00:48:51.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.196+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): orig_dests= new_dests= 2024-09-12T00:48:51.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.196+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): potential dests added=[] removed=[] 2024-09-12T00:48:51.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.0 2024-09-12T00:48:51.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.0 2024-09-12T00:48:51.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.1 2024-09-12T00:48:51.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.1 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.2 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.2 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.3 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.3 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.4 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.4 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.5 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.5 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.6 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.6 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.7 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.7 2024-09-12T00:48:51.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.8 2024-09-12T00:48:51.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.8 2024-09-12T00:48:51.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.9 2024-09-12T00:48:51.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.9 2024-09-12T00:48:51.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.10 2024-09-12T00:48:51.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.10 2024-09-12T00:48:51.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.11 2024-09-12T00:48:51.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2.11 2024-09-12T00:48:51.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.200+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.0 2024-09-12T00:48:51.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.201+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1 2024-09-12T00:48:51.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.201+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2 2024-09-12T00:48:51.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.202+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.3 2024-09-12T00:48:51.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.202+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.4 2024-09-12T00:48:51.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.202+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.5 2024-09-12T00:48:51.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.203+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.6 2024-09-12T00:48:51.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.203+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.7 2024-09-12T00:48:51.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.204+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.8 2024-09-12T00:48:51.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.204+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.9 2024-09-12T00:48:51.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.205+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.10 2024-09-12T00:48:51.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.208+0000 7fa607e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:51.207 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.208+0000 7fa607e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 2024-09-12T00:48:51.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.209+0000 7fa607e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:51.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.209+0000 7fa607e0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:51.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.209+0000 7fa607e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:51.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.209+0000 7fa607e0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30, ofs0, ns] 2024-09-12T00:48:51.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.209+0000 7fa4e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398883 cookie 94383625569392 notifier 6770 bl.length()=931 2024-09-12T00:48:51.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.209+0000 7fa4e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:51.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.209+0000 7fa4e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:51.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.209+0000 7fa4e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:51.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.211+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): orig_sources= new_sources= 2024-09-12T00:48:51.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.211+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): potential sources added=[] removed=[] 2024-09-12T00:48:51.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.211+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): orig_dests= new_dests= 2024-09-12T00:48:51.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.211+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): potential dests added=[] removed=[] 2024-09-12T00:48:51.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.213+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.0 2024-09-12T00:48:51.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.214+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.1 2024-09-12T00:48:51.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.214+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.2 2024-09-12T00:48:51.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.214+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.3 2024-09-12T00:48:51.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.215+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.4 2024-09-12T00:48:51.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.215+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.5 2024-09-12T00:48:51.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.215+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.6 2024-09-12T00:48:51.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.215+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.7 2024-09-12T00:48:51.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.216+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.8 2024-09-12T00:48:51.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.216+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.9 2024-09-12T00:48:51.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.217+0000 7fa607e0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30.10 2024-09-12T00:48:51.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.217+0000 7fa607e0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:51.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.217+0000 7fa607e0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 2024-09-12T00:48:51.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.218+0000 7fa607e0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:51.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.218+0000 7fa607e0e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:51.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.218+0000 7fa607e0e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:51.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.218+0000 7fa607e0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30, ofs0, ns] 2024-09-12T00:48:51.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.219+0000 7fa4e6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398884 cookie 94383625569392 notifier 6770 bl.length()=899 2024-09-12T00:48:51.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.219+0000 7fa4e6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 info.flags=0x17 2024-09-12T00:48:51.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.219+0000 7fa4e6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 to cache LRU end 2024-09-12T00:48:51.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.219+0000 7fa4e6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:51.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.222+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): orig_sources= new_sources= 2024-09-12T00:48:51.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.222+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): potential sources added=[] removed=[] 2024-09-12T00:48:51.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.222+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): orig_dests= new_dests= 2024-09-12T00:48:51.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.222+0000 7fa607e0e800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30]): potential dests added=[] removed=[] 2024-09-12T00:48:51.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.224+0000 7fa607e0e800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:48:51.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.228+0000 7fa4b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:51.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.230+0000 7fa607e0e800 20 remove_watcher() i=0 2024-09-12T00:48:51.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.230+0000 7fa607e0e800 2 removed watcher, disabling cache 2024-09-12T00:48:51.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.230+0000 7fa607e0e800 20 remove_watcher() i=1 2024-09-12T00:48:51.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.231+0000 7fa607e0e800 20 remove_watcher() i=2 2024-09-12T00:48:51.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.232+0000 7fa607e0e800 20 remove_watcher() i=3 2024-09-12T00:48:51.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.233+0000 7fa607e0e800 20 remove_watcher() i=4 2024-09-12T00:48:51.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.234+0000 7fa607e0e800 20 remove_watcher() i=5 2024-09-12T00:48:51.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.235+0000 7fa607e0e800 20 remove_watcher() i=6 2024-09-12T00:48:51.235 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.236+0000 7fa607e0e800 20 remove_watcher() i=7 2024-09-12T00:48:51.248 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:48:51.277 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:51.278 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:51.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.318+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.320+0000 7f05bd82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.320+0000 7f05bd82f800 20 realm 2024-09-12T00:48:51.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.320+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.320+0000 7f05bd82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.320+0000 7f05bd82f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:51.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.320+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.321+0000 7f05bd82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.321+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.321+0000 7f05bd82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:51.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.321+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.322+0000 7f05bd82f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:51.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.322+0000 7f05bd82f800 20 searching for the correct realm 2024-09-12T00:48:51.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.325+0000 7f05bab18640 0 -- 172.21.15.19:0/2381968723 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f05b0071890 msgr2=0x7f05b00979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:51.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.531+0000 7f05bbb1a640 0 -- 172.21.15.19:0/2381968723 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55675d5465c0 msgr2=0x55675d5489d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:51.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.535+0000 7f05bd82f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:51.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.535+0000 7f05bd82f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:51.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.535+0000 7f05bd82f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:51.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.535+0000 7f05bd82f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:51.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.535+0000 7f05bd82f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:51.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.535+0000 7f05bd82f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:51.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.535+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.535+0000 7f05bd82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.535+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.535+0000 7f05bd82f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:51.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.535+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:51.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 20 zone default found 2024-09-12T00:48:51.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 4 Realm: () 2024-09-12T00:48:51.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:51.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:51.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:51.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 20 zonegroup default 2024-09-12T00:48:51.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.536+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.537+0000 7f05bd82f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:51.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.537+0000 7f05bd82f800 20 started sync module instance, tier type = 2024-09-12T00:48:51.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.537+0000 7f05bd82f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:51.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.545+0000 7f05bd82f800 20 add_watcher() i=0 2024-09-12T00:48:51.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.546+0000 7f05bd82f800 20 add_watcher() i=1 2024-09-12T00:48:51.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.546+0000 7f05bd82f800 20 add_watcher() i=2 2024-09-12T00:48:51.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.546+0000 7f05bd82f800 20 add_watcher() i=3 2024-09-12T00:48:51.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.546+0000 7f05bd82f800 20 add_watcher() i=4 2024-09-12T00:48:51.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.546+0000 7f05bd82f800 20 add_watcher() i=5 2024-09-12T00:48:51.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.546+0000 7f05bd82f800 20 add_watcher() i=6 2024-09-12T00:48:51.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.546+0000 7f05bd82f800 20 add_watcher() i=7 2024-09-12T00:48:51.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.546+0000 7f05bd82f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:51.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.548+0000 7f0471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:51.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.549+0000 7f05bd82f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:51.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.549+0000 7f05bd82f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:51.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.549+0000 7f05bd82f800 5 note: GC not initialized 2024-09-12T00:48:51.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.549+0000 7f0470fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:51.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.549+0000 7f05bd82f800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:51.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.549+0000 7f05bd82f800 20 Filter name: none 2024-09-12T00:48:51.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.549+0000 7f03ea7fc640 20 reqs_thread_entry: start 2024-09-12T00:48:51.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.549+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.550+0000 7f05bd82f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:51.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.550+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.551+0000 7f05bd82f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:51.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.551+0000 7f05bd82f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:51.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.551+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.551+0000 7f05bd82f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:51.550 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.551+0000 7f05bd82f800 20 rados->read ofs=0 len=0 2024-09-12T00:48:51.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.551+0000 7f05bd82f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:51.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.551+0000 7f05bd82f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:51.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.553+0000 7f0471fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:51.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.555+0000 7f05bd82f800 20 remove_watcher() i=0 2024-09-12T00:48:51.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.555+0000 7f05bd82f800 2 removed watcher, disabling cache 2024-09-12T00:48:51.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.557+0000 7f05bd82f800 20 remove_watcher() i=1 2024-09-12T00:48:51.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.558+0000 7f05bd82f800 20 remove_watcher() i=2 2024-09-12T00:48:51.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.559+0000 7f05bd82f800 20 remove_watcher() i=3 2024-09-12T00:48:51.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.560+0000 7f05bd82f800 20 remove_watcher() i=4 2024-09-12T00:48:51.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.561+0000 7f05bd82f800 20 remove_watcher() i=5 2024-09-12T00:48:51.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.561+0000 7f05bd82f800 20 remove_watcher() i=6 2024-09-12T00:48:51.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:51.562+0000 7f05bd82f800 20 remove_watcher() i=7 2024-09-12T00:48:51.572 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:51.573 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:51.573 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-commit-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:48:51.573 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:51.575 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:51.575 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:51.595 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:51.596 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:51.787 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:51.787 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:51.924 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:48:51.924 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:51.925 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:51.925 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:51.973 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:51.974 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.030 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.030 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.062 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.062 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.096 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.096 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.129 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.129 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.164 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.164 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.199 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.199 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.231 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.231 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.266 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.266 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.299 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.300 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.333 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.333 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.367 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.367 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.401 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.401 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.435 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.435 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.469 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.469 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.502 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.502 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.536 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.536 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.570 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.570 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.603 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.603 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.638 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.638 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.674 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:52.674 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:52.709 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:48:52.738 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:52.738 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:52.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.777+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.778 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.779+0000 7f2da3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:52.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.779+0000 7f2da3946800 20 realm 2024-09-12T00:48:52.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.779+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.780+0000 7f2da3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:52.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.780+0000 7f2da3946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:52.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.780+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.780+0000 7f2da3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:52.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.780+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.781+0000 7f2da3946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:52.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.781+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.781+0000 7f2da3946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:52.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.781+0000 7f2da3946800 20 searching for the correct realm 2024-09-12T00:48:52.784 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.786+0000 7f2da1437640 0 -- 172.21.15.19:0/629212479 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f2d9408b030 msgr2=0x7f2d9408b410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:52.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.789+0000 7f2da1437640 0 -- 172.21.15.19:0/629212479 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55919720ce20 msgr2=0x55919720f2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:52.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.792+0000 7f2da3946800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:52.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.792+0000 7f2da3946800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:52.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.792+0000 7f2da3946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:52.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.792+0000 7f2da3946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:52.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.792+0000 7f2da3946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:52.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.792+0000 7f2da3946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:52.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.792+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:52.792 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:52.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:52.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 20 zone default found 2024-09-12T00:48:52.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 4 Realm: () 2024-09-12T00:48:52.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:52.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:52.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:52.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 20 zonegroup default 2024-09-12T00:48:52.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:52.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.793+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.794+0000 7f2da3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:52.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.794+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.794+0000 7f2da3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:52.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.794+0000 7f2da3946800 20 started sync module instance, tier type = 2024-09-12T00:48:52.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.794+0000 7f2da3946800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:52.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.802+0000 7f2da3946800 20 add_watcher() i=0 2024-09-12T00:48:52.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.802+0000 7f2da3946800 20 add_watcher() i=1 2024-09-12T00:48:52.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.802+0000 7f2da3946800 20 add_watcher() i=2 2024-09-12T00:48:52.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.802+0000 7f2da3946800 20 add_watcher() i=3 2024-09-12T00:48:52.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.802+0000 7f2da3946800 20 add_watcher() i=4 2024-09-12T00:48:52.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.802+0000 7f2da3946800 20 add_watcher() i=5 2024-09-12T00:48:52.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.802+0000 7f2da3946800 20 add_watcher() i=6 2024-09-12T00:48:52.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.803+0000 7f2da3946800 20 add_watcher() i=7 2024-09-12T00:48:52.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.803+0000 7f2da3946800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:52.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.805+0000 7f2c577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:52.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.806+0000 7f2da3946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:52.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.806+0000 7f2da3946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:52.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.806+0000 7f2da3946800 5 note: GC not initialized 2024-09-12T00:48:52.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.806+0000 7f2c567e4640 20 reqs_thread_entry: start 2024-09-12T00:48:52.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.806+0000 7f2da3946800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:52.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.806+0000 7f2da3946800 20 Filter name: none 2024-09-12T00:48:52.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.806+0000 7f2bc7fff640 20 reqs_thread_entry: start 2024-09-12T00:48:52.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.806+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.807+0000 7f2da3946800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:52.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.807+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.807+0000 7f2da3946800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:52.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.807+0000 7f2da3946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:52.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.807+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.808+0000 7f2da3946800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:52.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.808+0000 7f2da3946800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.808+0000 7f2da3946800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:52.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.808+0000 7f2da3946800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:52.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.810+0000 7f2c577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:52.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.812+0000 7f2da3946800 20 remove_watcher() i=0 2024-09-12T00:48:52.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.812+0000 7f2da3946800 2 removed watcher, disabling cache 2024-09-12T00:48:52.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.813+0000 7f2da3946800 20 remove_watcher() i=1 2024-09-12T00:48:52.812 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.813+0000 7f2da3946800 20 remove_watcher() i=2 2024-09-12T00:48:52.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.814+0000 7f2da3946800 20 remove_watcher() i=3 2024-09-12T00:48:52.814 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.816+0000 7f2da3946800 20 remove_watcher() i=4 2024-09-12T00:48:52.815 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.817+0000 7f2da3946800 20 remove_watcher() i=5 2024-09-12T00:48:52.816 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.818+0000 7f2da3946800 20 remove_watcher() i=6 2024-09-12T00:48:52.817 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.818+0000 7f2da3946800 20 remove_watcher() i=7 2024-09-12T00:48:52.828 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:52.829 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:52.829 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-commit-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:48:52.829 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:52.830 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:48:52.867 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:52.867 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:52.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.908+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.910+0000 7f0e8fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:52.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.910+0000 7f0e8fc87800 20 realm 2024-09-12T00:48:52.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.910+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.910+0000 7f0e8fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:52.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.910+0000 7f0e8fc87800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:52.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.910+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.910+0000 7f0e8fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:52.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.910+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.911+0000 7f0e8fc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:52.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.911+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:52.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.911+0000 7f0e8fc87800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:52.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.912+0000 7f0e8fc87800 20 searching for the correct realm 2024-09-12T00:48:52.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:52.915+0000 7f0e8cf70640 0 -- 172.21.15.19:0/3730135392 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f0e840822e0 msgr2=0x7f0e8407a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:53.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.120+0000 7f0e8d771640 0 -- 172.21.15.19:0/3730135392 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f0e8806a040 msgr2=0x7f0e880843f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:53.124 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.125+0000 7f0e8fc87800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:53.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.125+0000 7f0e8fc87800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:53.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.125+0000 7f0e8fc87800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:53.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.125+0000 7f0e8fc87800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:53.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.125+0000 7f0e8fc87800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:53.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.125+0000 7f0e8fc87800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:53.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.125+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.125+0000 7f0e8fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:53.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.125+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:53.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 20 zone default found 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 4 Realm: () 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 20 zonegroup default 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.126+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.127+0000 7f0e8fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.127+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.127+0000 7f0e8fc87800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.127+0000 7f0e8fc87800 20 started sync module instance, tier type = 2024-09-12T00:48:53.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.127+0000 7f0e8fc87800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:53.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.136+0000 7f0e8fc87800 20 add_watcher() i=0 2024-09-12T00:48:53.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.136+0000 7f0e8fc87800 20 add_watcher() i=1 2024-09-12T00:48:53.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.136+0000 7f0e8fc87800 20 add_watcher() i=2 2024-09-12T00:48:53.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.136+0000 7f0e8fc87800 20 add_watcher() i=3 2024-09-12T00:48:53.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.136+0000 7f0e8fc87800 20 add_watcher() i=4 2024-09-12T00:48:53.135 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.136+0000 7f0e8fc87800 20 add_watcher() i=5 2024-09-12T00:48:53.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.136+0000 7f0e8fc87800 20 add_watcher() i=6 2024-09-12T00:48:53.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.137+0000 7f0e8fc87800 20 add_watcher() i=7 2024-09-12T00:48:53.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.137+0000 7f0e8fc87800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:53.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.139+0000 7f0d437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.140+0000 7f0e8fc87800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.140+0000 7f0e8fc87800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.140+0000 7f0e8fc87800 5 note: GC not initialized 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.140+0000 7f0d427e4640 20 reqs_thread_entry: start 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.140+0000 7f0e8fc87800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.140+0000 7f0e8fc87800 20 Filter name: none 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.140+0000 7f0cb3fff640 20 reqs_thread_entry: start 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.140+0000 7f0e8fc87800 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.140+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.141+0000 7f0e8fc87800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.141+0000 7f0e8fc87800 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.141+0000 7f0e8fc87800 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:48:53.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.141+0000 7f0e8fc87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 : miss 2024-09-12T00:48:53.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.141+0000 7f0e8fc87800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.141+0000 7f0e8fc87800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:53.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.141+0000 7f0e8fc87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 info.flags=0x17 2024-09-12T00:48:53.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.141+0000 7f0e8fc87800 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 to cache LRU end 2024-09-12T00:48:53.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.141+0000 7f0e8fc87800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:53.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.141+0000 7f0e8fc87800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:53.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.141+0000 7f0e8fc87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 2024-09-12T00:48:53.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.147+0000 7f0e8fc87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 info.flags=0x17 2024-09-12T00:48:53.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.147+0000 7f0e8fc87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 to cache LRU end 2024-09-12T00:48:53.145 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.147+0000 7f0e8fc87800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:53.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.147+0000 7f0e8fc87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31, ofs0, ns] 2024-09-12T00:48:53.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.147+0000 7f0d70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398887 cookie 93963309801824 notifier 6815 bl.length()=931 2024-09-12T00:48:53.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.147+0000 7f0d70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 info.flags=0x17 2024-09-12T00:48:53.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.147+0000 7f0d70ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 to cache LRU end 2024-09-12T00:48:53.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.147+0000 7f0d70ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:53.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.149+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): orig_sources= new_sources= 2024-09-12T00:48:53.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.149+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): potential sources added=[] removed=[] 2024-09-12T00:48:53.147 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.149+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): orig_dests= new_dests= 2024-09-12T00:48:53.148 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.149+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): potential dests added=[] removed=[] 2024-09-12T00:48:53.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.0 2024-09-12T00:48:53.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.0 2024-09-12T00:48:53.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.1 2024-09-12T00:48:53.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.1 2024-09-12T00:48:53.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.2 2024-09-12T00:48:53.152 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.2 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.3 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.3 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.4 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.4 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.5 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.5 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.6 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.6 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.7 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.7 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.8 2024-09-12T00:48:53.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.8 2024-09-12T00:48:53.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.9 2024-09-12T00:48:53.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.9 2024-09-12T00:48:53.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.10 2024-09-12T00:48:53.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.10 2024-09-12T00:48:53.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.11 2024-09-12T00:48:53.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1.11 2024-09-12T00:48:53.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.0 2024-09-12T00:48:53.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.153+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1 2024-09-12T00:48:53.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.154+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.2 2024-09-12T00:48:53.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.154+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.3 2024-09-12T00:48:53.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.155+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.4 2024-09-12T00:48:53.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.155+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.5 2024-09-12T00:48:53.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.156+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.6 2024-09-12T00:48:53.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.156+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.7 2024-09-12T00:48:53.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.156+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.8 2024-09-12T00:48:53.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.157+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.9 2024-09-12T00:48:53.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.158+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.10 2024-09-12T00:48:53.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.160+0000 7f0e8fc87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:53.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.160+0000 7f0e8fc87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 2024-09-12T00:48:53.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.162+0000 7f0e8fc87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 info.flags=0x17 2024-09-12T00:48:53.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.162+0000 7f0e8fc87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 to cache LRU end 2024-09-12T00:48:53.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.162+0000 7f0e8fc87800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:53.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.162+0000 7f0e8fc87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31, ofs0, ns] 2024-09-12T00:48:53.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.162+0000 7f0d70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398888 cookie 93963309801824 notifier 6815 bl.length()=931 2024-09-12T00:48:53.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.162+0000 7f0d70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 info.flags=0x17 2024-09-12T00:48:53.161 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.162+0000 7f0d70ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 to cache LRU end 2024-09-12T00:48:53.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.162+0000 7f0d70ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:53.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.164+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): orig_sources= new_sources= 2024-09-12T00:48:53.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.164+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): potential sources added=[] removed=[] 2024-09-12T00:48:53.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.164+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): orig_dests= new_dests= 2024-09-12T00:48:53.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.164+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): potential dests added=[] removed=[] 2024-09-12T00:48:53.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.166+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.0 2024-09-12T00:48:53.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.166+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.1 2024-09-12T00:48:53.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.166+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.2 2024-09-12T00:48:53.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.167+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.3 2024-09-12T00:48:53.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.167+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.4 2024-09-12T00:48:53.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.167+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.5 2024-09-12T00:48:53.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.168+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.6 2024-09-12T00:48:53.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.168+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.7 2024-09-12T00:48:53.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.168+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.8 2024-09-12T00:48:53.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.169+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.9 2024-09-12T00:48:53.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.169+0000 7f0e8fc87800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31.10 2024-09-12T00:48:53.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.169+0000 7f0e8fc87800 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:48:53.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.169+0000 7f0e8fc87800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:53.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.169+0000 7f0e8fc87800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 2024-09-12T00:48:53.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.171+0000 7f0e8fc87800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 info.flags=0x17 2024-09-12T00:48:53.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.171+0000 7f0e8fc87800 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 to cache LRU end 2024-09-12T00:48:53.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.171+0000 7f0e8fc87800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:53.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.171+0000 7f0e8fc87800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31, ofs0, ns] 2024-09-12T00:48:53.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.171+0000 7f0d70ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398889 cookie 93963309801824 notifier 6815 bl.length()=899 2024-09-12T00:48:53.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.171+0000 7f0d70ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 info.flags=0x17 2024-09-12T00:48:53.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.171+0000 7f0d70ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 to cache LRU end 2024-09-12T00:48:53.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.171+0000 7f0d70ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:53.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.173+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): orig_sources= new_sources= 2024-09-12T00:48:53.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.173+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): potential sources added=[] removed=[] 2024-09-12T00:48:53.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.173+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): orig_dests= new_dests= 2024-09-12T00:48:53.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.173+0000 7f0e8fc87800 20 handle_bi_update(): bucket=:error-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31]): potential dests added=[] removed=[] 2024-09-12T00:48:53.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.175+0000 7f0e8fc87800 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:48:53.175 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.177+0000 7f0d437e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:53.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.179+0000 7f0e8fc87800 20 remove_watcher() i=0 2024-09-12T00:48:53.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.179+0000 7f0e8fc87800 2 removed watcher, disabling cache 2024-09-12T00:48:53.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.180+0000 7f0e8fc87800 20 remove_watcher() i=1 2024-09-12T00:48:53.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.181+0000 7f0e8fc87800 20 remove_watcher() i=2 2024-09-12T00:48:53.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.182+0000 7f0e8fc87800 20 remove_watcher() i=3 2024-09-12T00:48:53.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.183+0000 7f0e8fc87800 20 remove_watcher() i=4 2024-09-12T00:48:53.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.184+0000 7f0e8fc87800 20 remove_watcher() i=5 2024-09-12T00:48:53.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.185+0000 7f0e8fc87800 20 remove_watcher() i=6 2024-09-12T00:48:53.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.186+0000 7f0e8fc87800 20 remove_watcher() i=7 2024-09-12T00:48:53.198 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:48:53.227 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:53.228 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:53.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.268+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.270+0000 7fd0b2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:53.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.270+0000 7fd0b2546800 20 realm 2024-09-12T00:48:53.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.270+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.270+0000 7fd0b2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:53.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.270+0000 7fd0b2546800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:53.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.270+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.270+0000 7fd0b2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:53.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.270+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.271+0000 7fd0b2546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:53.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.271+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.271+0000 7fd0b2546800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:53.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.271+0000 7fd0b2546800 20 searching for the correct realm 2024-09-12T00:48:53.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.274+0000 7fd0af836640 0 -- 172.21.15.19:0/3243120263 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fd0a4093b60 msgr2=0x7fd0a4068f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:53.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.479+0000 7fd0b0838640 0 -- 172.21.15.19:0/3243120263 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55f271e80860 msgr2=0x55f271e82c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:53.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.484+0000 7fd0b2546800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:53.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.484+0000 7fd0b2546800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:53.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.484+0000 7fd0b2546800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:53.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.484+0000 7fd0b2546800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:53.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.484+0000 7fd0b2546800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:53.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.484+0000 7fd0b2546800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:53.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.484+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.484+0000 7fd0b2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:53.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.484+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.484+0000 7fd0b2546800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:53.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.484+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:53.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 20 zone default found 2024-09-12T00:48:53.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 4 Realm: () 2024-09-12T00:48:53.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:53.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:53.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:53.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 20 zonegroup default 2024-09-12T00:48:53.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:53.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:53.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:53.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.485+0000 7fd0b2546800 20 started sync module instance, tier type = 2024-09-12T00:48:53.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.486+0000 7fd0b2546800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:53.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.494+0000 7fd0b2546800 20 add_watcher() i=0 2024-09-12T00:48:53.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.494+0000 7fd0b2546800 20 add_watcher() i=1 2024-09-12T00:48:53.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.494+0000 7fd0b2546800 20 add_watcher() i=2 2024-09-12T00:48:53.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.494+0000 7fd0b2546800 20 add_watcher() i=3 2024-09-12T00:48:53.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.494+0000 7fd0b2546800 20 add_watcher() i=4 2024-09-12T00:48:53.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.494+0000 7fd0b2546800 20 add_watcher() i=5 2024-09-12T00:48:53.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.494+0000 7fd0b2546800 20 add_watcher() i=6 2024-09-12T00:48:53.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.495+0000 7fd0b2546800 20 add_watcher() i=7 2024-09-12T00:48:53.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.495+0000 7fd0b2546800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:53.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.497+0000 7fcf66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:53.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.498+0000 7fd0b2546800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:53.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.498+0000 7fd0b2546800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:53.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.498+0000 7fd0b2546800 5 note: GC not initialized 2024-09-12T00:48:53.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.498+0000 7fcf65fdb640 20 reqs_thread_entry: start 2024-09-12T00:48:53.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.498+0000 7fd0b2546800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:53.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.498+0000 7fd0b2546800 20 Filter name: none 2024-09-12T00:48:53.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.498+0000 7fced77fe640 20 reqs_thread_entry: start 2024-09-12T00:48:53.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.498+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.499+0000 7fd0b2546800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:53.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.499+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.499+0000 7fd0b2546800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:53.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.499+0000 7fd0b2546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:53.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.499+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.499+0000 7fd0b2546800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:53.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.499+0000 7fd0b2546800 20 rados->read ofs=0 len=0 2024-09-12T00:48:53.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.500+0000 7fd0b2546800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:53.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.500+0000 7fd0b2546800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:53.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.502+0000 7fcf66fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:53.503 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.504+0000 7fd0b2546800 20 remove_watcher() i=0 2024-09-12T00:48:53.503 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.504+0000 7fd0b2546800 2 removed watcher, disabling cache 2024-09-12T00:48:53.504 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.505+0000 7fd0b2546800 20 remove_watcher() i=1 2024-09-12T00:48:53.505 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.506+0000 7fd0b2546800 20 remove_watcher() i=2 2024-09-12T00:48:53.506 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.507+0000 7fd0b2546800 20 remove_watcher() i=3 2024-09-12T00:48:53.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.508+0000 7fd0b2546800 20 remove_watcher() i=4 2024-09-12T00:48:53.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.509+0000 7fd0b2546800 20 remove_watcher() i=5 2024-09-12T00:48:53.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.510+0000 7fd0b2546800 20 remove_watcher() i=6 2024-09-12T00:48:53.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:53.511+0000 7fd0b2546800 20 remove_watcher() i=7 2024-09-12T00:48:53.521 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:53.521 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:53.521 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-commit-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:48:53.521 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:53.523 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:53.523 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:53.544 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:53.544 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:53.747 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:53.747 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:53.883 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:48:53.883 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:53.884 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:53.885 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:53.934 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:53.934 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:53.991 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:53.992 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.029 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.029 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.066 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.066 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.100 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.100 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.134 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.134 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.168 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.168 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.202 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.202 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.236 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.236 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.271 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.271 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.305 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.305 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.339 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.339 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.372 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.372 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.407 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.407 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.441 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.441 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.474 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.474 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.507 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.507 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.541 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.541 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.579 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.580 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.614 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.614 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.647 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:54.647 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:48:54.681 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:48:54.710 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:54.710 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:54.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.750+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.752+0000 7f18bed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:54.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.752+0000 7f18bed39800 20 realm 2024-09-12T00:48:54.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.752+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.752+0000 7f18bed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:54.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.752+0000 7f18bed39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:54.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.752+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.752+0000 7f18bed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:54.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.752+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.753+0000 7f18bed39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:54.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.753+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.753+0000 7f18bed39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:54.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.753+0000 7f18bed39800 20 searching for the correct realm 2024-09-12T00:48:54.755 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.756+0000 7f18ba1c6640 0 -- 172.21.15.19:0/691702228 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f18b0077bf0 msgr2=0x7f18b005fa20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:54.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.961+0000 7f18bb1c8640 0 -- 172.21.15.19:0/691702228 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x557f7597ced0 msgr2=0x557f7597f390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.965+0000 7f18bed39800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.965+0000 7f18bed39800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.965+0000 7f18bed39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.965+0000 7f18bed39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.965+0000 7f18bed39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.965+0000 7f18bed39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.965+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.965+0000 7f18bed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.965+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:54.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 20 zone default found 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 4 Realm: () 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 20 zonegroup default 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.966+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.967+0000 7f18bed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.967+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.967+0000 7f18bed39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.967+0000 7f18bed39800 20 started sync module instance, tier type = 2024-09-12T00:48:54.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.967+0000 7f18bed39800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:54.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.976+0000 7f18bed39800 20 add_watcher() i=0 2024-09-12T00:48:54.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.976+0000 7f18bed39800 20 add_watcher() i=1 2024-09-12T00:48:54.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.976+0000 7f18bed39800 20 add_watcher() i=2 2024-09-12T00:48:54.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.976+0000 7f18bed39800 20 add_watcher() i=3 2024-09-12T00:48:54.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.976+0000 7f18bed39800 20 add_watcher() i=4 2024-09-12T00:48:54.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.976+0000 7f18bed39800 20 add_watcher() i=5 2024-09-12T00:48:54.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.976+0000 7f18bed39800 20 add_watcher() i=6 2024-09-12T00:48:54.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.976+0000 7f18bed39800 20 add_watcher() i=7 2024-09-12T00:48:54.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.977+0000 7f18bed39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:54.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.978+0000 7f17717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:54.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.978+0000 7f18bed39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:54.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.978+0000 7f18bed39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:54.979 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.978+0000 7f18bed39800 5 note: GC not initialized 2024-09-12T00:48:54.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.979+0000 7f16ebfff640 20 reqs_thread_entry: start 2024-09-12T00:48:54.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.979+0000 7f18bed39800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:54.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.979+0000 7f18bed39800 20 Filter name: none 2024-09-12T00:48:54.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.979+0000 7f16e9ffb640 20 reqs_thread_entry: start 2024-09-12T00:48:54.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.979+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.980+0000 7f18bed39800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:54.981 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.980+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.980+0000 7f18bed39800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:54.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.980+0000 7f18bed39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:54.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.980+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.981+0000 7f18bed39800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:54.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.981+0000 7f18bed39800 20 rados->read ofs=0 len=0 2024-09-12T00:48:54.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.981+0000 7f18bed39800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:54.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.981+0000 7f18bed39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:54.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.983+0000 7f17717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:54.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.985+0000 7f18bed39800 20 remove_watcher() i=0 2024-09-12T00:48:54.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.985+0000 7f18bed39800 2 removed watcher, disabling cache 2024-09-12T00:48:54.985 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.986+0000 7f18bed39800 20 remove_watcher() i=1 2024-09-12T00:48:54.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.987+0000 7f18bed39800 20 remove_watcher() i=2 2024-09-12T00:48:54.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.988+0000 7f18bed39800 20 remove_watcher() i=3 2024-09-12T00:48:54.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.989+0000 7f18bed39800 20 remove_watcher() i=4 2024-09-12T00:48:54.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.990+0000 7f18bed39800 20 remove_watcher() i=5 2024-09-12T00:48:54.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.991+0000 7f18bed39800 20 remove_watcher() i=6 2024-09-12T00:48:54.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:54.992+0000 7f18bed39800 20 remove_watcher() i=7 2024-09-12T00:48:55.002 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.003 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:55.003 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-commit-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:48:55.003 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.004 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:48:55.039 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:55.039 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:55.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.080+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.082+0000 7f70d852e800 20 realm 2024-09-12T00:48:55.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.082+0000 7f70d852e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:55.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.083+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:55.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.083+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.083+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:55.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.083+0000 7f70d852e800 20 searching for the correct realm 2024-09-12T00:48:55.083 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.085+0000 7f70d3adc640 0 -- 172.21.15.19:0/2823092400 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x556f9541b750 msgr2=0x556f9541dc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:55.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.088+0000 7f70d4ade640 0 -- 172.21.15.19:0/2823092400 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7f70c40d3040 msgr2=0x7f70c40557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:55.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:55.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:55.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:55.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:55.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:55.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:55.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.296+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:55.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:55.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 20 zone default found 2024-09-12T00:48:55.297 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 4 Realm: () 2024-09-12T00:48:55.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:55.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:55.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:55.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 20 zonegroup default 2024-09-12T00:48:55.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.299+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.299+0000 7f70d852e800 20 started sync module instance, tier type = 2024-09-12T00:48:55.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.299+0000 7f70d852e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:55.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=0 2024-09-12T00:48:55.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=1 2024-09-12T00:48:55.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=2 2024-09-12T00:48:55.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=3 2024-09-12T00:48:55.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=4 2024-09-12T00:48:55.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=5 2024-09-12T00:48:55.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=6 2024-09-12T00:48:55.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.308+0000 7f70d852e800 20 add_watcher() i=7 2024-09-12T00:48:55.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.308+0000 7f70d852e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:55.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.310+0000 7f6f8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:55.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.310+0000 7f70d852e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:55.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.310+0000 7f70d852e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:55.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.310+0000 7f70d852e800 5 note: GC not initialized 2024-09-12T00:48:55.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.310+0000 7f6f897e2640 20 reqs_thread_entry: start 2024-09-12T00:48:55.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.311+0000 7f70d852e800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:55.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.311+0000 7f70d852e800 20 Filter name: none 2024-09-12T00:48:55.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.311+0000 7f6efaffd640 20 reqs_thread_entry: start 2024-09-12T00:48:55.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.311+0000 7f70d852e800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:48:55.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.311+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.311+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:55.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.311+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:48:55.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.311+0000 7f70d852e800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:48:55.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.311+0000 7f70d852e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 : miss 2024-09-12T00:48:55.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.311+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.312+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:55.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.312+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.312+0000 7f70d852e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.312+0000 7f70d852e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:55.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.312+0000 7f70d852e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.312+0000 7f70d852e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 2024-09-12T00:48:55.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.317+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.317+0000 7f70d852e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.317+0000 7f70d852e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.317+0000 7f70d852e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32, ofs0, ns] 2024-09-12T00:48:55.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398946 cookie 93937733894384 notifier 7332 bl.length()=931 2024-09-12T00:48:55.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_sources= new_sources= 2024-09-12T00:48:55.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential sources added=[] removed=[] 2024-09-12T00:48:55.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_dests= new_dests= 2024-09-12T00:48:55.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential dests added=[] removed=[] 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.0 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.0 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.1 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.1 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.2 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.2 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.3 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.3 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.4 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.4 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.5 2024-09-12T00:48:55.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.5 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.6 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.6 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.7 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.7 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.8 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.8 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.9 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.9 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.10 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.10 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.11 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.11 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.0 2024-09-12T00:48:55.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1 2024-09-12T00:48:55.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.326+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.2 2024-09-12T00:48:55.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.326+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.3 2024-09-12T00:48:55.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.327+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.4 2024-09-12T00:48:55.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.327+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.5 2024-09-12T00:48:55.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.327+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.6 2024-09-12T00:48:55.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.328+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.7 2024-09-12T00:48:55.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.328+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.8 2024-09-12T00:48:55.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.329+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.9 2024-09-12T00:48:55.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.329+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.10 2024-09-12T00:48:55.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.333+0000 7f70d852e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:55.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.333+0000 7f70d852e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 2024-09-12T00:48:55.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.334+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.334+0000 7f70d852e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.334+0000 7f70d852e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.334+0000 7f70d852e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32, ofs0, ns] 2024-09-12T00:48:55.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398947 cookie 93937733894384 notifier 7332 bl.length()=931 2024-09-12T00:48:55.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_sources= new_sources= 2024-09-12T00:48:55.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential sources added=[] removed=[] 2024-09-12T00:48:55.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_dests= new_dests= 2024-09-12T00:48:55.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential dests added=[] removed=[] 2024-09-12T00:48:55.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.339+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.0 2024-09-12T00:48:55.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.339+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1 2024-09-12T00:48:55.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.339+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.2 2024-09-12T00:48:55.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.340+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.3 2024-09-12T00:48:55.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.340+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.4 2024-09-12T00:48:55.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.340+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.5 2024-09-12T00:48:55.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.6 2024-09-12T00:48:55.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.7 2024-09-12T00:48:55.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.8 2024-09-12T00:48:55.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.9 2024-09-12T00:48:55.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.342+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.10 2024-09-12T00:48:55.341 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f70d852e800 time 2024-09-12T00:48:55.343401+0000 2024-09-12T00:48:55.341 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:55.341 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f70d9d8c71a] 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f70d9d8c8d8] 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f92abf641] 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556f92acf637] 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f70d8a29590] 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.343+0000 7f70d852e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f70d852e800 time 2024-09-12T00:48:55.343401+0000 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:55.342 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f70d9d8c71a] 2024-09-12T00:48:55.343 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f70d9d8c8d8] 2024-09-12T00:48:55.343 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f92abf641] 2024-09-12T00:48:55.343 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556f92acf637] 2024-09-12T00:48:55.343 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:48:55.343 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f70d8a29590] 2024-09-12T00:48:55.343 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:48:55.343 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:48:55.343 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.343 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:48:55.343 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f70d852e800 thread_name:radosgw-admin 2024-09-12T00:48:55.362 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:55.362 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f70d8a3e6f0] 2024-09-12T00:48:55.362 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f70d8a8b99c] 2024-09-12T00:48:55.362 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:48:55.362 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:48:55.362 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f70d9d8c774] 2024-09-12T00:48:55.362 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f70d9d8c8d8] 2024-09-12T00:48:55.362 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f92abf641] 2024-09-12T00:48:55.362 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556f92acf637] 2024-09-12T00:48:55.362 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f70d8a29590] 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.344+0000 7f70d852e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f70d852e800 thread_name:radosgw-admin 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f70d8a3e6f0] 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f70d8a8b99c] 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:48:55.363 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f70d9d8c774] 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f70d9d8c8d8] 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f92abf641] 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556f92acf637] 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f70d8a29590] 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:48:55.065+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): get_auth_request con 0x556f95337880 auth_method 0 2024-09-12T00:48:55.364 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:48:55.065+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:48:55.065+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:48:55.065+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:48:55.065+0000 7f70d42dd640 10 monclient(hunting): handle_auth_done global_id 7323 payload 824 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:48:55.065+0000 7f70d42dd640 10 monclient: _finish_hunting 0 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:48:55.065+0000 7f70d42dd640 1 monclient: found mon.noname-a 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:48:55.065+0000 7f70d42dd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.365 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: dump: 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.366 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: _finish_auth 0 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: dump: 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.367 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:48:55.065+0000 7f70d852e800 5 monclient: authenticate success, global_id 7323 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:48:55.065+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:48:55.065+0000 7f6fc260c640 4 set_mon_vals no callback set 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:48:55.065+0000 7f70d852e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:48:55.065+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:48:55.065+0000 7f70d852e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:48:55.065+0000 7f70d852e800 1 librados: init done 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:48:55.067+0000 7f6fc0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:48:55.067+0000 7f6fc0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:48:55.067+0000 7f6fc0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:48:55.067+0000 7f70d3adc640 10 monclient: get_auth_request con 0x7f6fbc076470 auth_method 0 2024-09-12T00:48:55.368 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:48:55.068+0000 7f70d4ade640 10 monclient: get_auth_request con 0x556f95370ca0 auth_method 0 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:48:55.068+0000 7f70d42dd640 10 monclient: get_auth_request con 0x556f9537c470 auth_method 0 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:48:55.070+0000 7f70d3adc640 10 monclient: get_auth_request con 0x556f9537fcd0 auth_method 0 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:48:55.070+0000 7f70d852e800 10 monclient: build_initial_monmap 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:48:55.070+0000 7f70d852e800 1 build_initial for_mkfs: 0 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:48:55.070+0000 7f70d852e800 10 monclient: monmap: 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:55.369 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding auth protocol: cephx 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding auth protocol: cephx 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding auth protocol: cephx 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.370 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:48:55.071+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 asok(0x556f95110630) register_command objecter_requests cmddesc objecter_requests hook 0x556f95388c50 EEXIST 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:48:55.071+0000 7f70d852e800 10 monclient: init 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding auth protocol: cephx 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding auth protocol: cephx 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding auth protocol: cephx 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.371 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:48:55.071+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:48:55.071+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:48:55.072+0000 7f70d852e800 5 asok(0x556f95110630) register_command rotate-key cmddesc rotate-key hook 0x556f95384840 EEXIST 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:48:55.372 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-a con 0x556f953acf70 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-b con 0x556f953ad350 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-c con 0x556f953abc80 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): authenticate will time out at 2201.574080s 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): get_auth_request con 0x556f953acf70 auth_method 0 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): get_auth_request con 0x556f953abc80 auth_method 0 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.373 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): get_auth_request con 0x556f953ad350 auth_method 0 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.374 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): handle_auth_done global_id 6857 payload 824 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient: _finish_hunting 0 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:48:55.072+0000 7f70d4ade640 1 monclient: found mon.noname-c 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: dump: 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.375 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.376 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.376 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.376 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.376 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:48:55.376 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:48:55.376 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:55.376 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.376 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:55.376 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: dump: 2024-09-12T00:48:55.376 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.376 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.377 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.377 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.377 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.377 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.377 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.377 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.377 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.377 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.377 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:48:55.072+0000 7f70d852e800 5 monclient: authenticate success, global_id 6857 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:48:55.072+0000 7f70d52df640 4 set_mon_vals no callback set 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:48:55.074+0000 7f6fb9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:48:55.074+0000 7f6fb9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:48:55.074+0000 7f6fb9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:48:55.075+0000 7f70d42dd640 10 monclient: get_auth_request con 0x7f6fac076380 auth_method 0 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:48:55.075+0000 7f70d852e800 10 monclient: get_monmap_and_config 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:48:55.075+0000 7f70d852e800 10 monclient: build_initial_monmap 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:48:55.075+0000 7f70d852e800 1 build_initial for_mkfs: 0 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:48:55.075+0000 7f70d852e800 10 monclient: monmap: 2024-09-12T00:48:55.378 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding auth protocol: cephx 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding auth protocol: cephx 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding auth protocol: cephx 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.379 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:48:55.075+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.380 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:48:55.075+0000 7f70d852e800 10 monclient: init 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding auth protocol: cephx 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding auth protocol: cephx 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding auth protocol: cephx 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.381 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:48:55.075+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:48:55.076+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:48:55.076+0000 7f70d852e800 5 asok(0x556f95110630) register_command rotate-key cmddesc rotate-key hook 0x7ffc31331b28 EEXIST 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-c con 0x556f954013f0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-a con 0x556f953d2340 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-b con 0x556f953fcc90 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.382 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.383 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:55.383 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): authenticate will time out at 2201.578170s 2024-09-12T00:48:55.383 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): get_auth_request con 0x556f954013f0 auth_method 0 2024-09-12T00:48:55.383 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.383 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.383 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.383 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): get_auth_request con 0x556f953d2340 auth_method 0 2024-09-12T00:48:55.383 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.383 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.383 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): get_auth_request con 0x556f953fcc90 auth_method 0 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.384 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): handle_auth_done global_id 6860 payload 274 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient: _finish_hunting 0 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:48:55.076+0000 7f70d42dd640 1 monclient: found mon.noname-c 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: dump: 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.385 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: _finish_auth 0 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: dump: 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.386 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.387 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.387 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.387 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.387 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.387 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.387 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.387 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.387 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.388 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:48:55.076+0000 7f70d852e800 5 monclient: authenticate success, global_id 6860 2024-09-12T00:48:55.388 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:55.388 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:48:55.076+0000 7f70d852e800 4 set_mon_vals no callback set 2024-09-12T00:48:55.388 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:48:55.077+0000 7f70d852e800 10 monclient: shutdown 2024-09-12T00:48:55.388 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:48:55.077+0000 7f70d852e800 10 monclient: build_initial_monmap 2024-09-12T00:48:55.388 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:48:55.077+0000 7f70d852e800 1 build_initial for_mkfs: 0 2024-09-12T00:48:55.388 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:48:55.077+0000 7f70d852e800 10 monclient: monmap: 2024-09-12T00:48:55.388 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:55.388 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:55.388 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:55.388 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding auth protocol: cephx 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding auth protocol: cephx 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding auth protocol: cephx 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.389 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:48:55.077+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:48:55.077+0000 7f70d852e800 1 librados: starting msgr at 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:48:55.077+0000 7f70d852e800 1 librados: starting objecter 2024-09-12T00:48:55.390 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 asok(0x556f95110630) register_command objecter_requests cmddesc objecter_requests hook 0x556f953fcc50 EEXIST 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:48:55.077+0000 7f70d852e800 1 librados: setting wanted keys 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:48:55.077+0000 7f70d852e800 1 librados: calling monclient init 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:48:55.077+0000 7f70d852e800 10 monclient: init 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding auth protocol: cephx 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding auth protocol: cephx 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding auth protocol: cephx 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.391 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.392 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.392 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.392 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.392 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.392 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:48:55.078+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.392 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:48:55.078+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.392 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:48:55.078+0000 7f70d852e800 5 asok(0x556f95110630) register_command rotate-key cmddesc rotate-key hook 0x556f953c1978 EEXIST 2024-09-12T00:48:55.392 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:55.392 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:48:55.392 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-b con 0x556f953d2340 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:55.392 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-c con 0x556f953fcc90 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-a con 0x556f954013f0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): authenticate will time out at 2201.580415s 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): get_auth_request con 0x556f953fcc90 auth_method 0 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): get_auth_request con 0x556f954013f0 auth_method 0 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.393 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.394 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.394 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): get_auth_request con 0x556f953d2340 auth_method 0 2024-09-12T00:48:55.394 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.394 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.394 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.394 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.394 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.394 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.394 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.394 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.395 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.395 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.395 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.395 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.395 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): handle_auth_done global_id 7332 payload 824 2024-09-12T00:48:55.395 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient: _finish_hunting 0 2024-09-12T00:48:55.395 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:48:55.078+0000 7f70d4ade640 1 monclient: found mon.noname-a 2024-09-12T00:48:55.395 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.395 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.395 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:55.395 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: dump: 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:48:55.396 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:48:55.397 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:48:55.079+0000 7f70d852e800 5 monclient: authenticate success, global_id 7332 2024-09-12T00:48:55.397 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:48:55.079+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.397 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:48:55.079+0000 7f70d852e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.397 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:55.397 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.397 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:55.397 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: dump: 2024-09-12T00:48:55.398 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.398 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.398 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.398 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.398 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.398 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.398 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.398 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.398 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.398 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.398 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:48:55.079+0000 7f6fab7fe640 4 set_mon_vals no callback set 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:48:55.079+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:48:55.079+0000 7f70d852e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:48:55.079+0000 7f70d852e800 1 librados: init done 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:48:55.079+0000 7f70d852e800 5 asok(0x556f95110630) register_command cr dump hook 0x556f953f7318 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:48:55.080+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:48:55.081+0000 7f6fa9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:48:55.081+0000 7f6fa9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:48:55.081+0000 7f6fa9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:48:55.081+0000 7f70d42dd640 10 monclient: get_auth_request con 0x7f6f9c0764a0 auth_method 0 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:48:55.081+0000 7f70d3adc640 10 monclient: get_auth_request con 0x556f9541b750 auth_method 0 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 realm 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.399 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:48:55.082+0000 7f70d852e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:48:55.082+0000 7f70d42dd640 10 monclient: get_auth_request con 0x556f9541f9e0 auth_method 0 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:48:55.083+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:48:55.083+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:48:55.083+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:48:55.083+0000 7f70d852e800 20 searching for the correct realm 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:48:55.083+0000 7f70d3adc640 10 monclient: get_auth_request con 0x556f95424c60 auth_method 0 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:48:55.084+0000 7f70d4ade640 10 monclient: get_auth_request con 0x7f70c8039040 auth_method 0 2024-09-12T00:48:55.400 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:48:55.085+0000 7f70d3adc640 0 -- 172.21.15.19:0/2823092400 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x556f9541b750 msgr2=0x556f9541dc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:48:55.085+0000 7f6fa9ffb640 1 client.7332.objecter ms_handle_reset 0x556f9541b750 session 0x556f9541b040 osd.6 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:48:55.085+0000 7f6fa9ffb640 10 monclient: _renew_subs 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:48:55.085+0000 7f6fa9ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:48:55.085+0000 7f70d3adc640 10 monclient: get_auth_request con 0x7f6f9c0867c0 auth_method 0 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:48:55.085+0000 7f70d42dd640 10 monclient: get_auth_request con 0x7f70c40ab030 auth_method 0 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:48:55.086+0000 7f70d3adc640 10 monclient: get_auth_request con 0x7f70c8028420 auth_method 0 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:48:55.088+0000 7f70d4ade640 0 -- 172.21.15.19:0/2823092400 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7f70c40d3040 msgr2=0x7f70c40557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:48:55.290+0000 7f70d4ade640 10 monclient: get_auth_request con 0x7f70c40d3040 auth_method 0 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:48:55.291+0000 7f70d42dd640 10 monclient: get_auth_request con 0x7f70cc01f040 auth_method 0 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:55.401 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 zone default found 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:48:55.298+0000 7f70d852e800 4 Realm: () 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:48:55.298+0000 7f70d852e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:55.402 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:48:55.298+0000 7f70d852e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:48:55.298+0000 7f70d852e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 zonegroup default 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:48:55.299+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:48:55.299+0000 7f70d852e800 20 started sync module instance, tier type = 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:48:55.299+0000 7f70d852e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=0 2024-09-12T00:48:55.403 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=1 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=2 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=3 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=4 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=5 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=6 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:48:55.308+0000 7f70d852e800 20 add_watcher() i=7 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:48:55.308+0000 7f70d852e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding auth protocol: cephx 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding auth protocol: cephx 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding auth protocol: cephx 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.404 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:48:55.310+0000 7f6f8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:48:55.310+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.405 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:48:55.310+0000 7f70d852e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:48:55.310+0000 7f70d852e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 asok(0x556f95110630) register_command cache list hook 0x556f953eb800 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 asok(0x556f95110630) register_command cache inspect hook 0x556f953eb800 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 asok(0x556f95110630) register_command cache erase hook 0x556f953eb800 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 asok(0x556f95110630) register_command cache zap hook 0x556f953eb800 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 note: GC not initialized 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:48:55.310+0000 7f6f897e2640 20 reqs_thread_entry: start 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:48:55.311+0000 7f70d852e800 5 asok(0x556f95110630) register_command sync trace show hook 0x7f70cc004e40 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:48:55.311+0000 7f70d852e800 5 asok(0x556f95110630) register_command sync trace history hook 0x7f70cc004e40 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:48:55.311+0000 7f70d852e800 5 asok(0x556f95110630) register_command sync trace active hook 0x7f70cc004e40 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:48:55.311+0000 7f70d852e800 5 asok(0x556f95110630) register_command sync trace active_short hook 0x7f70cc004e40 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:48:55.311+0000 7f70d852e800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:55.406 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:48:55.311+0000 7f70d852e800 20 Filter name: none 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:48:55.311+0000 7f6efaffd640 20 reqs_thread_entry: start 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:48:55.311+0000 7f70d852e800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:48:55.311+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:48:55.311+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:48:55.311+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:48:55.311+0000 7f70d852e800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:48:55.311+0000 7f70d852e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 : miss 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:48:55.311+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:48:55.312+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:48:55.312+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:48:55.312+0000 7f70d852e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:48:55.312+0000 7f70d852e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:48:55.312+0000 7f70d852e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.407 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:48:55.312+0000 7f70d852e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 2024-09-12T00:48:55.408 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:48:55.317+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.408 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:48:55.317+0000 7f70d852e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.408 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:48:55.317+0000 7f70d852e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.408 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:48:55.317+0000 7f70d852e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32, ofs0, ns] 2024-09-12T00:48:55.408 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398946 cookie 93937733894384 notifier 7332 bl.length()=931 2024-09-12T00:48:55.408 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_sources= new_sources= 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential sources added=[] removed=[] 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_dests= new_dests= 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential dests added=[] removed=[] 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.0 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.0 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.1 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.1 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.2 2024-09-12T00:48:55.409 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.2 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.3 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.3 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.4 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.4 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.5 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.5 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.6 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.6 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.7 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.7 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.8 2024-09-12T00:48:55.410 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.8 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.9 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.9 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.10 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.10 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.11 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.11 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.0 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:48:55.326+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.2 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:48:55.326+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.3 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:48:55.327+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.4 2024-09-12T00:48:55.411 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:48:55.327+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.5 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:48:55.327+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.6 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:48:55.328+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.7 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:48:55.328+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.8 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:48:55.329+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.9 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:48:55.329+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.10 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:48:55.333+0000 7f70d852e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:48:55.333+0000 7f70d852e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:48:55.334+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:48:55.334+0000 7f70d852e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:48:55.334+0000 7f70d852e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:48:55.334+0000 7f70d852e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32, ofs0, ns] 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398947 cookie 93937733894384 notifier 7332 bl.length()=931 2024-09-12T00:48:55.412 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_sources= new_sources= 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential sources added=[] removed=[] 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_dests= new_dests= 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential dests added=[] removed=[] 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:48:55.336+0000 7f6fa9ffb640 1 client.7332.objecter ms_handle_reset 0x7f70c8039040 session 0x7f70c8030040 osd.2 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:48:55.337+0000 7f70d4ade640 10 monclient: get_auth_request con 0x556f9541b750 auth_method 0 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:48:55.339+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.0 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:48:55.339+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:48:55.339+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.2 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:48:55.340+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.3 2024-09-12T00:48:55.413 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:48:55.340+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.4 2024-09-12T00:48:55.414 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:48:55.340+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.5 2024-09-12T00:48:55.415 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.6 2024-09-12T00:48:55.415 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.7 2024-09-12T00:48:55.415 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.8 2024-09-12T00:48:55.415 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.9 2024-09-12T00:48:55.415 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:48:55.342+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.10 2024-09-12T00:48:55.415 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:48:55.343+0000 7f70d852e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f70d852e800 time 2024-09-12T00:48:55.343401+0000 2024-09-12T00:48:55.415 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:55.415 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.415 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:55.415 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f70d9d8c71a] 2024-09-12T00:48:55.415 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f70d9d8c8d8] 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f92abf641] 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556f92acf637] 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f70d8a29590] 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:48:55.344+0000 7f70d852e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f70d852e800 thread_name:radosgw-admin 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f70d8a3e6f0] 2024-09-12T00:48:55.416 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f70d8a8b99c] 2024-09-12T00:48:55.417 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:48:55.417 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:48:55.417 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f70d9d8c774] 2024-09-12T00:48:55.417 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f70d9d8c8d8] 2024-09-12T00:48:55.417 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f92abf641] 2024-09-12T00:48:55.417 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556f92acf637] 2024-09-12T00:48:55.417 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:48:55.417 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f70d8a29590] 2024-09-12T00:48:55.417 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:48:55.417 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:48:55.418 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:48:55.419 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:48:55.420 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:48:55.420 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:48:55.420 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:48:55.420 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:48:55.420 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:48:55.420 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:48:55.420 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:48:55.420 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:48:55.421 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:48:55.421 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:48:55.421 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:48:55.421 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:48:55.421 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:48:55.421 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:48:55.421 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:48:55.421 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:48:55.422 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:48:55.422 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:48:55.422 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:48:55.422 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:48:55.422 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:48:55.422 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:48:55.422 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:48:55.422 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:48:55.423 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:48:55.423 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:48:55.423 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:48:55.423 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:48:55.423 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:48:55.423 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:48:55.423 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:48:55.423 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:48:55.424 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:48:55.424 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:48:55.424 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:48:55.424 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:48:55.424 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:48:55.424 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:48:55.424 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:48:55.425 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:48:55.425 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:48:55.425 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:48:55.425 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:48:55.425 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:48:55.425 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:48:55.425 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:48:55.425 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:48:55.425 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:48:55.426 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:48:55.426 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:48:55.426 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:48:55.426 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:48:55.426 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:48:55.426 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:48:55.426 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:48:55.426 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:48:55.427 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:48:55.427 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:48:55.427 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:48:55.427 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:48:55.427 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:48:55.427 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:48:55.427 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:48:55.427 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:48:55.428 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:48:55.428 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:48:55.428 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:48:55.428 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:48:55.428 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:48:55.428 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:48:55.428 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:48:55.428 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:48:55.429 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6efaffd640 / http_manager 2024-09-12T00:48:55.429 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6f897e2640 / http_manager 2024-09-12T00:48:55.429 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6f8a7e4640 / rgw_dt_lg_renew 2024-09-12T00:48:55.429 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6fa9ffb640 / ms_dispatch 2024-09-12T00:48:55.429 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6fab7fe640 / io_context_pool 2024-09-12T00:48:55.429 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6fb9ffb640 / ms_dispatch 2024-09-12T00:48:55.429 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6fc0e09640 / ms_dispatch 2024-09-12T00:48:55.429 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6fc260c640 / io_context_pool 2024-09-12T00:48:55.430 INFO:tasks.workunit.client.0.smithi019.stderr: 7f70d3adc640 / msgr-worker-2 2024-09-12T00:48:55.430 INFO:tasks.workunit.client.0.smithi019.stderr: 7f70d42dd640 / msgr-worker-1 2024-09-12T00:48:55.430 INFO:tasks.workunit.client.0.smithi019.stderr: 7f70d4ade640 / msgr-worker-0 2024-09-12T00:48:55.430 INFO:tasks.workunit.client.0.smithi019.stderr: 7f70d52df640 / io_context_pool 2024-09-12T00:48:55.430 INFO:tasks.workunit.client.0.smithi019.stderr: 7f70d852e800 / radosgw-admin 2024-09-12T00:48:55.430 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:48:55.430 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:48:55.430 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.121115.log 2024-09-12T00:48:55.431 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:48:55.431 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:48:55.431 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:48:55.065+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.431 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): get_auth_request con 0x556f95337880 auth_method 0 2024-09-12T00:48:55.431 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.431 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.431 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.431 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:48:55.065+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.432 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:48:55.065+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.432 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:48:55.065+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.432 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.432 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.432 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:48:55.065+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.432 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:48:55.065+0000 7f70d42dd640 10 monclient(hunting): handle_auth_done global_id 7323 payload 824 2024-09-12T00:48:55.432 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:48:55.065+0000 7f70d42dd640 10 monclient: _finish_hunting 0 2024-09-12T00:48:55.433 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:48:55.065+0000 7f70d42dd640 1 monclient: found mon.noname-a 2024-09-12T00:48:55.433 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:48:55.065+0000 7f70d42dd640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.433 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.433 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:55.433 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: dump: 2024-09-12T00:48:55.433 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: _finish_auth 0 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: _check_auth_tickets 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:55.434 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:48:55.065+0000 7f6fc0e09640 10 monclient: dump: 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:48:55.065+0000 7f70d852e800 5 monclient: authenticate success, global_id 7323 2024-09-12T00:48:55.435 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:48:55.065+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:48:55.065+0000 7f6fc260c640 4 set_mon_vals no callback set 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:48:55.065+0000 7f70d852e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:48:55.065+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:48:55.065+0000 7f70d852e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:48:55.065+0000 7f70d852e800 1 librados: init done 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:48:55.067+0000 7f6fc0e09640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:48:55.067+0000 7f6fc0e09640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:48:55.067+0000 7f6fc0e09640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:48:55.067+0000 7f70d3adc640 10 monclient: get_auth_request con 0x7f6fbc076470 auth_method 0 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:48:55.068+0000 7f70d4ade640 10 monclient: get_auth_request con 0x556f95370ca0 auth_method 0 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:48:55.068+0000 7f70d42dd640 10 monclient: get_auth_request con 0x556f9537c470 auth_method 0 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:48:55.070+0000 7f70d3adc640 10 monclient: get_auth_request con 0x556f9537fcd0 auth_method 0 2024-09-12T00:48:55.436 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:48:55.070+0000 7f70d852e800 10 monclient: build_initial_monmap 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:48:55.070+0000 7f70d852e800 1 build_initial for_mkfs: 0 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:48:55.070+0000 7f70d852e800 10 monclient: monmap: 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:55.437 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding auth protocol: cephx 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding auth protocol: cephx 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding auth protocol: cephx 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.438 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: crc 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:48:55.070+0000 7f70d852e800 5 AuthRegistry(0x556f95385760) adding con mode: secure 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:48:55.071+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 asok(0x556f95110630) register_command objecter_requests cmddesc objecter_requests hook 0x556f95388c50 EEXIST 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:48:55.071+0000 7f70d852e800 10 monclient: init 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding auth protocol: cephx 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding auth protocol: cephx 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding auth protocol: cephx 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.439 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: crc 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:48:55.071+0000 7f70d852e800 5 AuthRegistry(0x556f953846f8) adding con mode: secure 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:48:55.071+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:48:55.071+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:48:55.072+0000 7f70d852e800 5 asok(0x556f95110630) register_command rotate-key cmddesc rotate-key hook 0x556f95384840 EEXIST 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:55.440 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:48:55.441 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-a con 0x556f953acf70 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:55.441 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-b con 0x556f953ad350 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:55.441 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-c con 0x556f953abc80 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:55.441 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.441 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.441 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.441 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:55.441 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient(hunting): authenticate will time out at 2201.574080s 2024-09-12T00:48:55.441 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): get_auth_request con 0x556f953acf70 auth_method 0 2024-09-12T00:48:55.441 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): get_auth_request con 0x556f953abc80 auth_method 0 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:48:55.072+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): get_auth_request con 0x556f953ad350 auth_method 0 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.442 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:48:55.072+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient(hunting): handle_auth_done global_id 6857 payload 824 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient: _finish_hunting 0 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:48:55.072+0000 7f70d4ade640 1 monclient: found mon.noname-c 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:48:55.072+0000 7f70d4ade640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:55.443 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: dump: 2024-09-12T00:48:55.444 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.444 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.444 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.444 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.444 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.444 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.444 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.444 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.444 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.444 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:48:55.072+0000 7f6fb9ffb640 10 monclient: dump: 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.445 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:48:55.072+0000 7f70d852e800 5 monclient: authenticate success, global_id 6857 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:48:55.072+0000 7f70d52df640 4 set_mon_vals no callback set 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:48:55.072+0000 7f70d852e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:48:55.074+0000 7f6fb9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:48:55.074+0000 7f6fb9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:48:55.074+0000 7f6fb9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:48:55.075+0000 7f70d42dd640 10 monclient: get_auth_request con 0x7f6fac076380 auth_method 0 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:48:55.075+0000 7f70d852e800 10 monclient: get_monmap_and_config 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:48:55.075+0000 7f70d852e800 10 monclient: build_initial_monmap 2024-09-12T00:48:55.446 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:48:55.075+0000 7f70d852e800 1 build_initial for_mkfs: 0 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:48:55.075+0000 7f70d852e800 10 monclient: monmap: 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding auth protocol: cephx 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding auth protocol: cephx 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding auth protocol: cephx 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.447 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: crc 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x556f953ccd70) adding con mode: secure 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:48:55.075+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:48:55.075+0000 7f70d852e800 10 monclient: init 2024-09-12T00:48:55.448 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding auth protocol: cephx 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding auth protocol: cephx 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding auth protocol: cephx 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.449 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: crc 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:48:55.075+0000 7f70d852e800 5 AuthRegistry(0x7ffc313319e0) adding con mode: secure 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:48:55.075+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:48:55.076+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:48:55.076+0000 7f70d852e800 5 asok(0x556f95110630) register_command rotate-key cmddesc rotate-key hook 0x7ffc31331b28 EEXIST 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-c con 0x556f954013f0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-a con 0x556f953d2340 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-b con 0x556f953fcc90 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.450 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.451 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:55.451 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient(hunting): authenticate will time out at 2201.578170s 2024-09-12T00:48:55.451 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): get_auth_request con 0x556f954013f0 auth_method 0 2024-09-12T00:48:55.451 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.451 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.451 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.451 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): get_auth_request con 0x556f953d2340 auth_method 0 2024-09-12T00:48:55.451 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.451 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.451 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.451 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): get_auth_request con 0x556f953fcc90 auth_method 0 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:48:55.076+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:48:55.076+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.452 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient(hunting): handle_auth_done global_id 6860 payload 274 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient: _finish_hunting 0 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:48:55.076+0000 7f70d42dd640 1 monclient: found mon.noname-c 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:48:55.076+0000 7f70d42dd640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: dump: 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.453 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: _finish_auth 0 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:48:55.076+0000 7f6fab7fe640 10 monclient: dump: 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.454 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:48:55.076+0000 7f70d852e800 5 monclient: authenticate success, global_id 6860 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:48:55.076+0000 7f70d852e800 10 monclient: get_monmap_and_config success 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:48:55.076+0000 7f70d852e800 4 set_mon_vals no callback set 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:48:55.077+0000 7f70d852e800 10 monclient: shutdown 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:48:55.077+0000 7f70d852e800 10 monclient: build_initial_monmap 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:48:55.077+0000 7f70d852e800 1 build_initial for_mkfs: 0 2024-09-12T00:48:55.455 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:48:55.077+0000 7f70d852e800 10 monclient: monmap: 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding auth protocol: cephx 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding auth protocol: cephx 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding auth protocol: cephx 2024-09-12T00:48:55.456 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: crc 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953f2fc0) adding con mode: secure 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:48:55.077+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:48:55.077+0000 7f70d852e800 1 librados: starting msgr at 2024-09-12T00:48:55.457 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:48:55.077+0000 7f70d852e800 1 librados: starting objecter 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 asok(0x556f95110630) register_command objecter_requests cmddesc objecter_requests hook 0x556f953fcc50 EEXIST 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:48:55.077+0000 7f70d852e800 1 librados: setting wanted keys 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:48:55.077+0000 7f70d852e800 1 librados: calling monclient init 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:48:55.077+0000 7f70d852e800 10 monclient: init 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding auth protocol: cephx 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding auth protocol: cephx 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding auth protocol: cephx 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.458 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: crc 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:48:55.077+0000 7f70d852e800 5 AuthRegistry(0x556f953c1830) adding con mode: secure 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:48:55.078+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:48:55.078+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:48:55.078+0000 7f70d852e800 5 asok(0x556f95110630) register_command rotate-key cmddesc rotate-key hook 0x556f953c1978 EEXIST 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient: _reopen_session rank -1 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:48:55.459 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-b con 0x556f953d2340 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-c con 0x556f953fcc90 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): picked mon.noname-a con 0x556f954013f0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): _renew_subs 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:48:55.078+0000 7f70d852e800 10 monclient(hunting): authenticate will time out at 2201.580415s 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): get_auth_request con 0x556f953fcc90 auth_method 0 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): get_auth_request con 0x556f954013f0 auth_method 0 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.460 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): get_auth_request con 0x556f953d2340 auth_method 0 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:48:55.078+0000 7f70d3adc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:48:55.461 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:48:55.078+0000 7f70d42dd640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient(hunting): handle_auth_done global_id 7332 payload 824 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient: _finish_hunting 0 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:48:55.078+0000 7f70d4ade640 1 monclient: found mon.noname-a 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:48:55.078+0000 7f70d4ade640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: dump: 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.462 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: _finish_auth 0 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:48:55.079+0000 7f70d852e800 5 monclient: authenticate success, global_id 7332 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:48:55.079+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:48:55.079+0000 7f70d852e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:48:55.079+0000 7f6fa9ffb640 10 monclient: dump: 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:48:55.463 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:48:55.079+0000 7f6fab7fe640 4 set_mon_vals no callback set 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:48:55.079+0000 7f70d852e800 10 monclient: _renew_subs 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:48:55.079+0000 7f70d852e800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:48:55.079+0000 7f70d852e800 1 librados: init done 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:48:55.079+0000 7f70d852e800 5 asok(0x556f95110630) register_command cr dump hook 0x556f953f7318 2024-09-12T00:48:55.464 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:48:55.080+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:48:55.081+0000 7f6fa9ffb640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:48:55.081+0000 7f6fa9ffb640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:48:55.081+0000 7f6fa9ffb640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:48:55.081+0000 7f70d42dd640 10 monclient: get_auth_request con 0x7f6f9c0764a0 auth_method 0 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:48:55.081+0000 7f70d3adc640 10 monclient: get_auth_request con 0x556f9541b750 auth_method 0 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 realm 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:48:55.082+0000 7f70d852e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:48:55.082+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.465 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:48:55.082+0000 7f70d42dd640 10 monclient: get_auth_request con 0x556f9541f9e0 auth_method 0 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:48:55.083+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:48:55.083+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:48:55.083+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:48:55.083+0000 7f70d852e800 20 searching for the correct realm 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:48:55.083+0000 7f70d3adc640 10 monclient: get_auth_request con 0x556f95424c60 auth_method 0 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:48:55.084+0000 7f70d4ade640 10 monclient: get_auth_request con 0x7f70c8039040 auth_method 0 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:48:55.085+0000 7f70d3adc640 0 -- 172.21.15.19:0/2823092400 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x556f9541b750 msgr2=0x556f9541dc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:48:55.085+0000 7f6fa9ffb640 1 client.7332.objecter ms_handle_reset 0x556f9541b750 session 0x556f9541b040 osd.6 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:48:55.085+0000 7f6fa9ffb640 10 monclient: _renew_subs 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:48:55.085+0000 7f6fa9ffb640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:48:55.085+0000 7f70d3adc640 10 monclient: get_auth_request con 0x7f6f9c0867c0 auth_method 0 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:48:55.085+0000 7f70d42dd640 10 monclient: get_auth_request con 0x7f70c40ab030 auth_method 0 2024-09-12T00:48:55.466 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:48:55.086+0000 7f70d3adc640 10 monclient: get_auth_request con 0x7f70c8028420 auth_method 0 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:48:55.088+0000 7f70d4ade640 0 -- 172.21.15.19:0/2823092400 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7f70c40d3040 msgr2=0x7f70c40557c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:48:55.290+0000 7f70d4ade640 10 monclient: get_auth_request con 0x7f70c40d3040 auth_method 0 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:48:55.291+0000 7f70d42dd640 10 monclient: get_auth_request con 0x7f70cc01f040 auth_method 0 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:48:55.296+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:48:55.297+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.467 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 zone default found 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:48:55.298+0000 7f70d852e800 4 Realm: () 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:48:55.298+0000 7f70d852e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:48:55.298+0000 7f70d852e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:48:55.298+0000 7f70d852e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 zonegroup default 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:48:55.298+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.468 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:48:55.299+0000 7f70d852e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:48:55.299+0000 7f70d852e800 20 started sync module instance, tier type = 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:48:55.299+0000 7f70d852e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=0 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=1 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=2 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=3 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=4 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=5 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:48:55.307+0000 7f70d852e800 20 add_watcher() i=6 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:48:55.308+0000 7f70d852e800 20 add_watcher() i=7 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:48:55.308+0000 7f70d852e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding auth protocol: cephx 2024-09-12T00:48:55.469 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding auth protocol: cephx 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding auth protocol: cephx 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: crc 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:48:55.310+0000 7f6f8a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:55.470 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 AuthRegistry(0x7ffc31331ec0) adding con mode: secure 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:48:55.310+0000 7f70d852e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:48:55.310+0000 7f70d852e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:48:55.310+0000 7f70d852e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 asok(0x556f95110630) register_command cache list hook 0x556f953eb800 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 asok(0x556f95110630) register_command cache inspect hook 0x556f953eb800 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 asok(0x556f95110630) register_command cache erase hook 0x556f953eb800 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 asok(0x556f95110630) register_command cache zap hook 0x556f953eb800 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:48:55.310+0000 7f70d852e800 5 note: GC not initialized 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:48:55.310+0000 7f6f897e2640 20 reqs_thread_entry: start 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:48:55.311+0000 7f70d852e800 5 asok(0x556f95110630) register_command sync trace show hook 0x7f70cc004e40 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:48:55.311+0000 7f70d852e800 5 asok(0x556f95110630) register_command sync trace history hook 0x7f70cc004e40 2024-09-12T00:48:55.471 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:48:55.311+0000 7f70d852e800 5 asok(0x556f95110630) register_command sync trace active hook 0x7f70cc004e40 2024-09-12T00:48:55.472 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:48:55.311+0000 7f70d852e800 5 asok(0x556f95110630) register_command sync trace active_short hook 0x7f70cc004e40 2024-09-12T00:48:55.472 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:48:55.311+0000 7f70d852e800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:55.472 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:48:55.311+0000 7f70d852e800 20 Filter name: none 2024-09-12T00:48:55.472 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:48:55.311+0000 7f6efaffd640 20 reqs_thread_entry: start 2024-09-12T00:48:55.472 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:48:55.311+0000 7f70d852e800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:48:55.472 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:48:55.311+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.472 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:48:55.311+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:48:55.311+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:48:55.311+0000 7f70d852e800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:48:55.311+0000 7f70d852e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 : miss 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:48:55.311+0000 7f70d852e800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:48:55.312+0000 7f70d852e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:48:55.312+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:48:55.312+0000 7f70d852e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:48:55.312+0000 7f70d852e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:48:55.312+0000 7f70d852e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:48:55.312+0000 7f70d852e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:48:55.317+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:48:55.317+0000 7f70d852e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.473 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:48:55.317+0000 7f70d852e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:48:55.317+0000 7f70d852e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32, ofs0, ns] 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398946 cookie 93937733894384 notifier 7332 bl.length()=931 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:48:55.317+0000 7f6fab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_sources= new_sources= 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential sources added=[] removed=[] 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_dests= new_dests= 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:48:55.319+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential dests added=[] removed=[] 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.0 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.0 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.1 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.1 2024-09-12T00:48:55.474 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.2 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.2 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.3 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.3 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.4 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.4 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.5 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.5 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.6 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.6 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.7 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.7 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.8 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.8 2024-09-12T00:48:55.475 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.9 2024-09-12T00:48:55.476 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.9 2024-09-12T00:48:55.476 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.10 2024-09-12T00:48:55.476 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.10 2024-09-12T00:48:55.476 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:48:55.325+0000 7f70d852e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.11 2024-09-12T00:48:55.476 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.11 2024-09-12T00:48:55.476 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.0 2024-09-12T00:48:55.476 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:48:55.325+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1 2024-09-12T00:48:55.476 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:48:55.326+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.2 2024-09-12T00:48:55.476 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:48:55.326+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.3 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:48:55.327+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.4 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:48:55.327+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.5 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:48:55.327+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.6 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:48:55.328+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.7 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:48:55.328+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.8 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:48:55.329+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.9 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:48:55.329+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.10 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:48:55.333+0000 7f70d852e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:48:55.333+0000 7f70d852e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:48:55.334+0000 7f70d852e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:48:55.334+0000 7f70d852e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:48:55.334+0000 7f70d852e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.477 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:48:55.334+0000 7f70d852e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32, ofs0, ns] 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398947 cookie 93937733894384 notifier 7332 bl.length()=931 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:48:55.334+0000 7f6fab7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_sources= new_sources= 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential sources added=[] removed=[] 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_dests= new_dests= 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:48:55.336+0000 7f70d852e800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential dests added=[] removed=[] 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:48:55.336+0000 7f6fa9ffb640 1 client.7332.objecter ms_handle_reset 0x7f70c8039040 session 0x7f70c8030040 osd.2 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:48:55.337+0000 7f70d4ade640 10 monclient: get_auth_request con 0x556f9541b750 auth_method 0 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:48:55.339+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.0 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:48:55.339+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1 2024-09-12T00:48:55.478 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:48:55.339+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.2 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:48:55.340+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.3 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:48:55.340+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.4 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:48:55.340+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.5 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.6 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.7 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.8 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:48:55.341+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.9 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:48:55.342+0000 7f70d852e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.10 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:48:55.343+0000 7f70d852e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f70d852e800 time 2024-09-12T00:48:55.343401+0000 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:55.479 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f70d9d8c71a] 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f70d9d8c8d8] 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f92abf641] 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556f92acf637] 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f70d8a29590] 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:48:55.344+0000 7f70d852e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f70d852e800 thread_name:radosgw-admin 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.480 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f70d8a3e6f0] 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f70d8a8b99c] 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f70d9d8c774] 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f70d9d8c8d8] 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x556f92abf641] 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x427) [0x556f92acf637] 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f70d8a29590] 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:48:55.481 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:48:55.482 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:48:55.483 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:48:55.483 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:48:55.483 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:48:55.483 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:48:55.483 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:48:55.484 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:48:55.484 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:48:55.484 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:48:55.484 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:48:55.484 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:48:55.484 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:48:55.485 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:48:55.485 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:48:55.485 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:48:55.485 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:48:55.485 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:48:55.485 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:48:55.486 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:48:55.486 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:48:55.486 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:48:55.486 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:48:55.486 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:48:55.486 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:48:55.486 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:48:55.487 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:48:55.487 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:48:55.487 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:48:55.487 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:48:55.487 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:48:55.487 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:48:55.487 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:48:55.487 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:48:55.488 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:48:55.488 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:48:55.488 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:48:55.488 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:48:55.488 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:48:55.488 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:48:55.489 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:48:55.489 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:48:55.489 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:48:55.489 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:48:55.489 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:48:55.489 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:48:55.489 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:48:55.490 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:48:55.490 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:48:55.490 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:48:55.490 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:48:55.490 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:48:55.490 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:48:55.491 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:48:55.491 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:48:55.491 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:48:55.491 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:48:55.491 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:48:55.491 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:48:55.491 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:48:55.491 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:48:55.492 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6efaffd640 / http_manager 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6f897e2640 / http_manager 2024-09-12T00:48:55.493 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6f8a7e4640 / rgw_dt_lg_renew 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6fa9ffb640 / ms_dispatch 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6fab7fe640 / io_context_pool 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6fb9ffb640 / ms_dispatch 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6fc0e09640 / ms_dispatch 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: 7f6fc260c640 / io_context_pool 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: 7f70d3adc640 / msgr-worker-2 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: 7f70d42dd640 / msgr-worker-1 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: 7f70d4ade640 / msgr-worker-0 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: 7f70d52df640 / io_context_pool 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: 7f70d852e800 / radosgw-admin 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:48:55.344816Z_122e2d52-8d63-4dc3-a0a8-36e44d9935cd/log 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:48:55.494 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:48:55.496 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:48:55.496 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:48:55.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.422+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.424+0000 7f6807942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.424+0000 7f6807942800 20 realm 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.424+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.424+0000 7f6807942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.424+0000 7f6807942800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.424+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.424+0000 7f6807942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.424+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.425+0000 7f6807942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.425+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.425+0000 7f6807942800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.425+0000 7f6807942800 20 searching for the correct realm 2024-09-12T00:48:55.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.428+0000 7f67fae85640 0 -- 172.21.15.19:0/97262388 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f67ec029030 msgr2=0x7f67ec06baa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:48:55.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.633+0000 7f67fae85640 0 -- 172.21.15.19:0/97262388 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5565b3a18690 msgr2=0x5565b3a1aae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:48:55.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.637+0000 7f6807942800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:48:55.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.637+0000 7f6807942800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:48:55.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.637+0000 7f6807942800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:48:55.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.637+0000 7f6807942800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:48:55.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.637+0000 7f6807942800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:48:55.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.637+0000 7f6807942800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:48:55.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.637+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.637+0000 7f6807942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.637 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.637+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:48:55.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:48:55.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 20 zone default found 2024-09-12T00:48:55.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 4 Realm: () 2024-09-12T00:48:55.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:48:55.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:48:55.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:48:55.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 20 zonegroup default 2024-09-12T00:48:55.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.638+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.639+0000 7f6807942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.639+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.639+0000 7f6807942800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:48:55.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.639+0000 7f6807942800 20 started sync module instance, tier type = 2024-09-12T00:48:55.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.639+0000 7f6807942800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:48:55.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.648+0000 7f6807942800 20 add_watcher() i=0 2024-09-12T00:48:55.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.648+0000 7f6807942800 20 add_watcher() i=1 2024-09-12T00:48:55.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.648+0000 7f6807942800 20 add_watcher() i=2 2024-09-12T00:48:55.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.648+0000 7f6807942800 20 add_watcher() i=3 2024-09-12T00:48:55.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.648+0000 7f6807942800 20 add_watcher() i=4 2024-09-12T00:48:55.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.648+0000 7f6807942800 20 add_watcher() i=5 2024-09-12T00:48:55.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.648+0000 7f6807942800 20 add_watcher() i=6 2024-09-12T00:48:55.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.649+0000 7f6807942800 20 add_watcher() i=7 2024-09-12T00:48:55.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.649+0000 7f6807942800 2 all 8 watchers are set, enabling cache 2024-09-12T00:48:55.649 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.650+0000 7f66b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:55.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.651+0000 7f6807942800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:48:55.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.651+0000 7f6807942800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:48:55.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.651+0000 7f6807942800 5 note: GC not initialized 2024-09-12T00:48:55.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.651+0000 7f66b8fe1640 20 reqs_thread_entry: start 2024-09-12T00:48:55.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.651+0000 7f6807942800 20 init_complete bucket index max shards: 11 2024-09-12T00:48:55.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.651+0000 7f6807942800 20 Filter name: none 2024-09-12T00:48:55.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.651+0000 7f66327fc640 20 reqs_thread_entry: start 2024-09-12T00:48:55.650 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.651+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.651 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.652+0000 7f6807942800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:55.651 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.652+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.651 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.652+0000 7f6807942800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:48:55.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.652+0000 7f6807942800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:55.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.652+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.653+0000 7f6807942800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:48:55.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.653+0000 7f6807942800 20 rados->read ofs=0 len=0 2024-09-12T00:48:55.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.653+0000 7f6807942800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:48:55.652 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.653+0000 7f6807942800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:48:55.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.655+0000 7f66b9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:48:55.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.658+0000 7f6807942800 20 remove_watcher() i=0 2024-09-12T00:48:55.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.658+0000 7f6807942800 2 removed watcher, disabling cache 2024-09-12T00:48:55.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.659+0000 7f6807942800 20 remove_watcher() i=1 2024-09-12T00:48:55.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.659+0000 7f6807942800 20 remove_watcher() i=2 2024-09-12T00:48:55.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.661+0000 7f6807942800 20 remove_watcher() i=3 2024-09-12T00:48:55.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.662+0000 7f6807942800 20 remove_watcher() i=4 2024-09-12T00:48:55.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.663+0000 7f6807942800 20 remove_watcher() i=5 2024-09-12T00:48:55.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.664+0000 7f6807942800 20 remove_watcher() i=6 2024-09-12T00:48:55.663 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:48:55.665+0000 7f6807942800 20 remove_watcher() i=7 2024-09-12T00:48:55.675 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.675 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:48:55.675 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-commit-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:48:55.675 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:48:55.677 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:48:55.677 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:25.832 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:25.832 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:25.891 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:25.924 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:25.924 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:25.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.967+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.969+0000 7fb713b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.969+0000 7fb713b26800 20 realm 2024-09-12T00:49:25.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.969+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.969+0000 7fb713b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.969+0000 7fb713b26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:25.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.969+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.970+0000 7fb713b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:25.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.970+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.970+0000 7fb713b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:25.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.970+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:25.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.971+0000 7fb713b26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:25.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.971+0000 7fb713b26800 20 searching for the correct realm 2024-09-12T00:49:25.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:25.974+0000 7fb70efd8640 0 -- 172.21.15.19:0/2846494658 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fb70400e070 msgr2=0x7fb704083a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:26.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.180+0000 7fb70efd8640 0 -- 172.21.15.19:0/2846494658 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5567c942ff40 msgr2=0x5567c9432370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.185+0000 7fb713b26800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.185+0000 7fb713b26800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.185+0000 7fb713b26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.185+0000 7fb713b26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.185+0000 7fb713b26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.185+0000 7fb713b26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.185+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.185+0000 7fb713b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.185+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 20 zone default found 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 4 Realm: () 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 20 zonegroup default 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.186+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.187+0000 7fb713b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.187+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.188+0000 7fb713b26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.188+0000 7fb713b26800 20 started sync module instance, tier type = 2024-09-12T00:49:26.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.188+0000 7fb713b26800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.197+0000 7fb713b26800 20 add_watcher() i=0 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.197+0000 7fb713b26800 20 add_watcher() i=1 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.197+0000 7fb713b26800 20 add_watcher() i=2 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.197+0000 7fb713b26800 20 add_watcher() i=3 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.197+0000 7fb713b26800 20 add_watcher() i=4 2024-09-12T00:49:26.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.197+0000 7fb713b26800 20 add_watcher() i=5 2024-09-12T00:49:26.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.197+0000 7fb713b26800 20 add_watcher() i=6 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.199+0000 7fb713b26800 20 add_watcher() i=7 2024-09-12T00:49:26.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.199+0000 7fb713b26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:26.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.201+0000 7fb5c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.202+0000 7fb713b26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.202+0000 7fb713b26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.202+0000 7fb713b26800 5 note: GC not initialized 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.202+0000 7fb5c4fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.202+0000 7fb713b26800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.202+0000 7fb713b26800 20 Filter name: none 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.202+0000 7fb53e7fc640 20 reqs_thread_entry: start 2024-09-12T00:49:26.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.202+0000 7fb713b26800 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.202+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.203+0000 7fb713b26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.203+0000 7fb713b26800 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:49:26.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.203+0000 7fb713b26800 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.203+0000 7fb713b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 : miss 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.203+0000 7fb713b26800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.203+0000 7fb713b26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.203+0000 7fb713b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.204+0000 7fb713b26800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.204+0000 7fb713b26800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.204+0000 7fb713b26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:26.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.204+0000 7fb713b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.209+0000 7fb713b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.209+0000 7fb713b26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.209+0000 7fb713b26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.209+0000 7fb713b26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32, ofs0, ns] 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.209+0000 7fb5f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398949 cookie 93904246654048 notifier 6899 bl.length()=931 2024-09-12T00:49:26.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.209+0000 7fb5f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.209+0000 7fb5f27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:49:26.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.209+0000 7fb5f27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.211+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_sources= new_sources= 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.211+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential sources added=[] removed=[] 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.211+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_dests= new_dests= 2024-09-12T00:49:26.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.211+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential dests added=[] removed=[] 2024-09-12T00:49:26.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.0 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.0 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.1 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.1 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.2 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.2 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.3 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.3 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.4 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.4 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.5 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.5 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.6 2024-09-12T00:49:26.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.6 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.7 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.7 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.8 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.8 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.9 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.9 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.10 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.10 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.11 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1.11 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.216+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.0 2024-09-12T00:49:26.218 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.217+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.217+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.2 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.218+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.3 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.218+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.4 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.219+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.5 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.219+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.6 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.220+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.7 2024-09-12T00:49:26.220 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.220+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.8 2024-09-12T00:49:26.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.221+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.9 2024-09-12T00:49:26.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.222+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.10 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.225+0000 7fb713b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:26.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.225+0000 7fb713b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.226+0000 7fb713b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.226+0000 7fb713b26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:49:26.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.226+0000 7fb713b26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.226+0000 7fb713b26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32, ofs0, ns] 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.227+0000 7fb5f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398950 cookie 93904246654048 notifier 6899 bl.length()=931 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.227+0000 7fb5f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.227+0000 7fb5f27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:49:26.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.227+0000 7fb5f27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.228+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_sources= new_sources= 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.228+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential sources added=[] removed=[] 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.228+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_dests= new_dests= 2024-09-12T00:49:26.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.228+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential dests added=[] removed=[] 2024-09-12T00:49:26.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.231+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.0 2024-09-12T00:49:26.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.231+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.1 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.231+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.2 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.232+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.3 2024-09-12T00:49:26.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.232+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.4 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.232+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.5 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.233+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.6 2024-09-12T00:49:26.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.233+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.7 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.234+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.8 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.234+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.9 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.234+0000 7fb713b26800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32.10 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.235+0000 7fb713b26800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:26.234 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.235+0000 7fb713b26800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.236+0000 7fb713b26800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.236+0000 7fb713b26800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.236+0000 7fb713b26800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:26.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.236+0000 7fb713b26800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32, ofs0, ns] 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.236+0000 7fb5f27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398951 cookie 93904246654048 notifier 6899 bl.length()=899 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.236+0000 7fb5f27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 info.flags=0x17 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.236+0000 7fb5f27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 to cache LRU end 2024-09-12T00:49:26.237 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.236+0000 7fb5f27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.238+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_sources= new_sources= 2024-09-12T00:49:26.238 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.238+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential sources added=[] removed=[] 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.238+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): orig_dests= new_dests= 2024-09-12T00:49:26.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.238+0000 7fb713b26800 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32]): potential dests added=[] removed=[] 2024-09-12T00:49:26.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.240+0000 7fb713b26800 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:49:26.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.242+0000 7fb5c5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.245+0000 7fb713b26800 20 remove_watcher() i=0 2024-09-12T00:49:26.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.245+0000 7fb713b26800 2 removed watcher, disabling cache 2024-09-12T00:49:26.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.246+0000 7fb713b26800 20 remove_watcher() i=1 2024-09-12T00:49:26.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.247+0000 7fb713b26800 20 remove_watcher() i=2 2024-09-12T00:49:26.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.248+0000 7fb713b26800 20 remove_watcher() i=3 2024-09-12T00:49:26.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.249+0000 7fb713b26800 20 remove_watcher() i=4 2024-09-12T00:49:26.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.250+0000 7fb713b26800 20 remove_watcher() i=5 2024-09-12T00:49:26.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.251+0000 7fb713b26800 20 remove_watcher() i=6 2024-09-12T00:49:26.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.252+0000 7fb713b26800 20 remove_watcher() i=7 2024-09-12T00:49:26.265 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:49:26.295 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:26.295 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:26.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.334+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.337+0000 7f0d1cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.337+0000 7f0d1cd2e800 20 realm 2024-09-12T00:49:26.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.337+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.337+0000 7f0d1cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.337+0000 7f0d1cd2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:26.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.337+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.337+0000 7f0d1cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.337+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.338+0000 7f0d1cd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.338+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.339+0000 7f0d1cd2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:26.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.339+0000 7f0d1cd2e800 20 searching for the correct realm 2024-09-12T00:49:26.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.341+0000 7f0d18add640 0 -- 172.21.15.19:0/838422331 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55624ff73480 msgr2=0x55624ff75890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:26.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.344+0000 7f0d192de640 0 -- 172.21.15.19:0/838422331 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x55624ff73480 msgr2=0x7f0d08032a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:26.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.553+0000 7f0d1cd2e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:26.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.553+0000 7f0d1cd2e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:26.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.553+0000 7f0d1cd2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:26.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.553+0000 7f0d1cd2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:26.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.553+0000 7f0d1cd2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:26.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.553+0000 7f0d1cd2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:26.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.553+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.553+0000 7f0d1cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.553+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.554+0000 7f0d1cd2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:26.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.554+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.554+0000 7f0d1cd2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:26.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.554+0000 7f0d1cd2e800 20 zone default found 2024-09-12T00:49:26.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.554+0000 7f0d1cd2e800 4 Realm: () 2024-09-12T00:49:26.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.554+0000 7f0d1cd2e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:26.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.554+0000 7f0d1cd2e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:26.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.554+0000 7f0d1cd2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:26.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.554+0000 7f0d1cd2e800 20 zonegroup default 2024-09-12T00:49:26.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.554+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.555+0000 7f0d1cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.555+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.555+0000 7f0d1cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.555+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.555+0000 7f0d1cd2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:26.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.555+0000 7f0d1cd2e800 20 started sync module instance, tier type = 2024-09-12T00:49:26.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.555+0000 7f0d1cd2e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:26.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.566+0000 7f0d1cd2e800 20 add_watcher() i=0 2024-09-12T00:49:26.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.566+0000 7f0d1cd2e800 20 add_watcher() i=1 2024-09-12T00:49:26.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.566+0000 7f0d1cd2e800 20 add_watcher() i=2 2024-09-12T00:49:26.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.566+0000 7f0d1cd2e800 20 add_watcher() i=3 2024-09-12T00:49:26.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.566+0000 7f0d1cd2e800 20 add_watcher() i=4 2024-09-12T00:49:26.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.566+0000 7f0d1cd2e800 20 add_watcher() i=5 2024-09-12T00:49:26.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.566+0000 7f0d1cd2e800 20 add_watcher() i=6 2024-09-12T00:49:26.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.568+0000 7f0d1cd2e800 20 add_watcher() i=7 2024-09-12T00:49:26.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.568+0000 7f0d1cd2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:26.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.569+0000 7f0bcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:26.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.569+0000 7f0d1cd2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:26.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.569+0000 7f0d1cd2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:26.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.569+0000 7f0d1cd2e800 5 note: GC not initialized 2024-09-12T00:49:26.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.570+0000 7f0bcdfe3640 20 reqs_thread_entry: start 2024-09-12T00:49:26.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.570+0000 7f0d1cd2e800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:26.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.570+0000 7f0d1cd2e800 20 Filter name: none 2024-09-12T00:49:26.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.570+0000 7f0b3f7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:26.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.570+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.570+0000 7f0d1cd2e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:49:26.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.570+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.571+0000 7f0d1cd2e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:49:26.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.571+0000 7f0d1cd2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:26.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.571+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.572+0000 7f0d1cd2e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:49:26.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.572+0000 7f0d1cd2e800 20 rados->read ofs=0 len=0 2024-09-12T00:49:26.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.572+0000 7f0d1cd2e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:49:26.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.572+0000 7f0d1cd2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:26.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.574+0000 7f0bcefe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:26.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.576+0000 7f0d1cd2e800 20 remove_watcher() i=0 2024-09-12T00:49:26.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.576+0000 7f0d1cd2e800 2 removed watcher, disabling cache 2024-09-12T00:49:26.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.577+0000 7f0d1cd2e800 20 remove_watcher() i=1 2024-09-12T00:49:26.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.578+0000 7f0d1cd2e800 20 remove_watcher() i=2 2024-09-12T00:49:26.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.579+0000 7f0d1cd2e800 20 remove_watcher() i=3 2024-09-12T00:49:26.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.580+0000 7f0d1cd2e800 20 remove_watcher() i=4 2024-09-12T00:49:26.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.582+0000 7f0d1cd2e800 20 remove_watcher() i=5 2024-09-12T00:49:26.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.583+0000 7f0d1cd2e800 20 remove_watcher() i=6 2024-09-12T00:49:26.584 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:26.584+0000 7f0d1cd2e800 20 remove_watcher() i=7 2024-09-12T00:49:26.595 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:26.595 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:49:26.595 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-commit-target-layout id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:49:26.595 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:26.597 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:26.598 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:26.619 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:26.619 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:26.813 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:26.813 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:26.951 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:49:26.951 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:26.952 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:26.952 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.001 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.001 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.058 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.058 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.105 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.105 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.136 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.136 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.170 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.170 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.204 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.204 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.237 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.238 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.274 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.274 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.308 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.309 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.376 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.376 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.409 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.409 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.443 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.443 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.476 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.476 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.512 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.513 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.543 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.543 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.577 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.577 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.612 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.612 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.646 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.646 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.679 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.680 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.716 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.716 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.749 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:27.749 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:27.783 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:49:27.812 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:27.812 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:27.852 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.852+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:27.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.854+0000 7f43aa92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:27.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.854+0000 7f43aa92c800 20 realm 2024-09-12T00:49:27.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.854+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:27.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.855+0000 7f43aa92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:27.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.855+0000 7f43aa92c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:27.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.855+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:27.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.855+0000 7f43aa92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:27.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.855+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:27.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.856+0000 7f43aa92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:27.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.856+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:27.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.856+0000 7f43aa92c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:27.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.856+0000 7f43aa92c800 20 searching for the correct realm 2024-09-12T00:49:27.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:27.859+0000 7f43a5e55640 0 -- 172.21.15.19:0/3665126450 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f439c0c5be0 msgr2=0x7f439c0ac950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:28.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.064+0000 7f43a5e55640 0 -- 172.21.15.19:0/3665126450 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55798e904ae0 msgr2=0x55798e906f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:28.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.068+0000 7f43aa92c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:28.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.068+0000 7f43aa92c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:28.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.068+0000 7f43aa92c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:28.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.068+0000 7f43aa92c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:28.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.068+0000 7f43aa92c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:28.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.068+0000 7f43aa92c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:28.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.068+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:28.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:28.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 20 zone default found 2024-09-12T00:49:28.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 4 Realm: () 2024-09-12T00:49:28.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:28.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:28.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:28.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 20 zonegroup default 2024-09-12T00:49:28.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.069+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.070+0000 7f43aa92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.070+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.070+0000 7f43aa92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.070+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.070+0000 7f43aa92c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.070+0000 7f43aa92c800 20 started sync module instance, tier type = 2024-09-12T00:49:28.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.070+0000 7f43aa92c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:28.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.079+0000 7f43aa92c800 20 add_watcher() i=0 2024-09-12T00:49:28.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.079+0000 7f43aa92c800 20 add_watcher() i=1 2024-09-12T00:49:28.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.079+0000 7f43aa92c800 20 add_watcher() i=2 2024-09-12T00:49:28.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.079+0000 7f43aa92c800 20 add_watcher() i=3 2024-09-12T00:49:28.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.079+0000 7f43aa92c800 20 add_watcher() i=4 2024-09-12T00:49:28.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.079+0000 7f43aa92c800 20 add_watcher() i=5 2024-09-12T00:49:28.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.079+0000 7f43aa92c800 20 add_watcher() i=6 2024-09-12T00:49:28.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.080+0000 7f43aa92c800 20 add_watcher() i=7 2024-09-12T00:49:28.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.080+0000 7f43aa92c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:28.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.082+0000 7f425cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:28.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.082+0000 7f43aa92c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:28.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.082+0000 7f43aa92c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:28.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.082+0000 7f43aa92c800 5 note: GC not initialized 2024-09-12T00:49:28.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.082+0000 7f41d77fe640 20 reqs_thread_entry: start 2024-09-12T00:49:28.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.082+0000 7f43aa92c800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:28.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.083+0000 7f43aa92c800 20 Filter name: none 2024-09-12T00:49:28.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.083+0000 7f41d57fa640 20 reqs_thread_entry: start 2024-09-12T00:49:28.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.083+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.083+0000 7f43aa92c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:28.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.083+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.084+0000 7f43aa92c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:28.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.084+0000 7f43aa92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:28.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.084+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.084+0000 7f43aa92c800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:28.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.084+0000 7f43aa92c800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.085+0000 7f43aa92c800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:28.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.085+0000 7f43aa92c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:28.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.086+0000 7f425cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:28.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.088+0000 7f43aa92c800 20 remove_watcher() i=0 2024-09-12T00:49:28.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.088+0000 7f43aa92c800 2 removed watcher, disabling cache 2024-09-12T00:49:28.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.089+0000 7f43aa92c800 20 remove_watcher() i=1 2024-09-12T00:49:28.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.090+0000 7f43aa92c800 20 remove_watcher() i=2 2024-09-12T00:49:28.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.091+0000 7f43aa92c800 20 remove_watcher() i=3 2024-09-12T00:49:28.092 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.093+0000 7f43aa92c800 20 remove_watcher() i=4 2024-09-12T00:49:28.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.093+0000 7f43aa92c800 20 remove_watcher() i=5 2024-09-12T00:49:28.094 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.095+0000 7f43aa92c800 20 remove_watcher() i=6 2024-09-12T00:49:28.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.096+0000 7f43aa92c800 20 remove_watcher() i=7 2024-09-12T00:49:28.106 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:28.107 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:49:28.107 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-do-reshard id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:49:28.107 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:28.108 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:49:28.143 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:28.143 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:28.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.183+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.184+0000 7f2d09742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.184+0000 7f2d09742800 20 realm 2024-09-12T00:49:28.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.184+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.185+0000 7f2d09742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.185+0000 7f2d09742800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:28.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.185+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.185+0000 7f2d09742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.185+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.186+0000 7f2d09742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:28.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.186+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.186+0000 7f2d09742800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:28.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.186+0000 7f2d09742800 20 searching for the correct realm 2024-09-12T00:49:28.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.191+0000 7f2d04c85640 0 -- 172.21.15.19:0/2714460918 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f2cfc06cb80 msgr2=0x7f2cfc0a2a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:28.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.397+0000 7f2d05c87640 0 -- 172.21.15.19:0/2714460918 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5650230472b0 msgr2=0x565023049700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:28.401 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.401+0000 7f2d09742800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:28.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.401+0000 7f2d09742800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:28.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.401+0000 7f2d09742800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:28.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.401+0000 7f2d09742800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:28.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.401+0000 7f2d09742800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:28.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.401+0000 7f2d09742800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:28.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.401+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.401+0000 7f2d09742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.401+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.401+0000 7f2d09742800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:28.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.401+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:28.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 20 zone default found 2024-09-12T00:49:28.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 4 Realm: () 2024-09-12T00:49:28.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:28.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:28.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:28.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 20 zonegroup default 2024-09-12T00:49:28.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.402+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.403+0000 7f2d09742800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.403+0000 7f2d09742800 20 started sync module instance, tier type = 2024-09-12T00:49:28.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.403+0000 7f2d09742800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:28.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.411+0000 7f2d09742800 20 add_watcher() i=0 2024-09-12T00:49:28.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.411+0000 7f2d09742800 20 add_watcher() i=1 2024-09-12T00:49:28.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.411+0000 7f2d09742800 20 add_watcher() i=2 2024-09-12T00:49:28.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.411+0000 7f2d09742800 20 add_watcher() i=3 2024-09-12T00:49:28.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.411+0000 7f2d09742800 20 add_watcher() i=4 2024-09-12T00:49:28.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.411+0000 7f2d09742800 20 add_watcher() i=5 2024-09-12T00:49:28.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.411+0000 7f2d09742800 20 add_watcher() i=6 2024-09-12T00:49:28.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.412+0000 7f2d09742800 20 add_watcher() i=7 2024-09-12T00:49:28.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.412+0000 7f2d09742800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:28.414 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.414+0000 7f2bbb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:28.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.414+0000 7f2d09742800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:28.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.415+0000 7f2d09742800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:28.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.415+0000 7f2d09742800 5 note: GC not initialized 2024-09-12T00:49:28.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.415+0000 7f2bba7e4640 20 reqs_thread_entry: start 2024-09-12T00:49:28.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.415+0000 7f2d09742800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:28.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.415+0000 7f2d09742800 20 Filter name: none 2024-09-12T00:49:28.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.415+0000 7f2b2bfff640 20 reqs_thread_entry: start 2024-09-12T00:49:28.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.415+0000 7f2d09742800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:49:28.415 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.415+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.416+0000 7f2d09742800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:28.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.416+0000 7f2d09742800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:49:28.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.416+0000 7f2d09742800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:49:28.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.416+0000 7f2d09742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 : miss 2024-09-12T00:49:28.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.416+0000 7f2d09742800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.416+0000 7f2d09742800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:28.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.416+0000 7f2d09742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:28.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.416+0000 7f2d09742800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:28.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.416+0000 7f2d09742800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:28.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.416+0000 7f2d09742800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:28.417 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.416+0000 7f2d09742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 2024-09-12T00:49:28.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.421+0000 7f2d09742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:28.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.421+0000 7f2d09742800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:28.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.421+0000 7f2d09742800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:28.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.421+0000 7f2d09742800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33, ofs0, ns] 2024-09-12T00:49:28.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.422+0000 7f2be8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398971 cookie 94902184931040 notifier 7422 bl.length()=911 2024-09-12T00:49:28.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.422+0000 7f2be8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:28.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.422+0000 7f2be8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:28.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.422+0000 7f2be8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:28.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.423+0000 7f2d09742800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): orig_sources= new_sources= 2024-09-12T00:49:28.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.423+0000 7f2d09742800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): potential sources added=[] removed=[] 2024-09-12T00:49:28.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.423+0000 7f2d09742800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): orig_dests= new_dests= 2024-09-12T00:49:28.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.423+0000 7f2d09742800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): potential dests added=[] removed=[] 2024-09-12T00:49:28.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.428+0000 7f2d09742800 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:49:28.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.435+0000 7f2d09742800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:28.435 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.435+0000 7f2d09742800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 2024-09-12T00:49:28.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.436+0000 7f2d09742800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:28.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.436+0000 7f2d09742800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:28.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.436+0000 7f2d09742800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:28.436 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.436+0000 7f2d09742800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33, ofs0, ns] 2024-09-12T00:49:28.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.437+0000 7f2be8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398972 cookie 94902184931040 notifier 7422 bl.length()=879 2024-09-12T00:49:28.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.437+0000 7f2be8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:28.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.437+0000 7f2be8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:28.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.437+0000 7f2be8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:28.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.438+0000 7f2d09742800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): orig_sources= new_sources= 2024-09-12T00:49:28.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.438+0000 7f2d09742800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): potential sources added=[] removed=[] 2024-09-12T00:49:28.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.438+0000 7f2d09742800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): orig_dests= new_dests= 2024-09-12T00:49:28.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.438+0000 7f2d09742800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): potential dests added=[] removed=[] 2024-09-12T00:49:28.438 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.438+0000 7f2d09742800 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:49:28.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.440+0000 7f2bbb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:28.442 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.442+0000 7f2d09742800 20 remove_watcher() i=0 2024-09-12T00:49:28.442 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.442+0000 7f2d09742800 2 removed watcher, disabling cache 2024-09-12T00:49:28.443 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.444+0000 7f2d09742800 20 remove_watcher() i=1 2024-09-12T00:49:28.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.445+0000 7f2d09742800 20 remove_watcher() i=2 2024-09-12T00:49:28.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.446+0000 7f2d09742800 20 remove_watcher() i=3 2024-09-12T00:49:28.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.448+0000 7f2d09742800 20 remove_watcher() i=4 2024-09-12T00:49:28.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.449+0000 7f2d09742800 20 remove_watcher() i=5 2024-09-12T00:49:28.449 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.450+0000 7f2d09742800 20 remove_watcher() i=6 2024-09-12T00:49:28.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.450+0000 7f2d09742800 20 remove_watcher() i=7 2024-09-12T00:49:28.462 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:49:28.492 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:28.492 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:28.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.531+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.534+0000 7fa0b8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.534+0000 7fa0b8d2a800 20 realm 2024-09-12T00:49:28.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.534+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.534+0000 7fa0b8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.534+0000 7fa0b8d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:28.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.534+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.534+0000 7fa0b8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.534+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.535+0000 7fa0b8d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:28.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.535+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.535+0000 7fa0b8d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:28.535 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.535+0000 7fa0b8d2a800 20 searching for the correct realm 2024-09-12T00:49:28.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.538+0000 7fa0b4aad640 0 -- 172.21.15.19:0/1824264975 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7fa0a4077660 msgr2=0x7fa0a4090050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:28.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.541+0000 7fa0b4aad640 0 -- 172.21.15.19:0/1824264975 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fa0ac032460 msgr2=0x7fa0ac0328a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:49:28.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.748+0000 7fa0b8d2a800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:28.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.748+0000 7fa0b8d2a800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:28.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.748+0000 7fa0b8d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:28.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.748+0000 7fa0b8d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:28.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.748+0000 7fa0b8d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:28.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.748+0000 7fa0b8d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:28.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.749+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.749+0000 7fa0b8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.749+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.749+0000 7fa0b8d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:28.750 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.749+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:28.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 20 zone default found 2024-09-12T00:49:28.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 4 Realm: () 2024-09-12T00:49:28.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:28.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:28.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:28.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 20 zonegroup default 2024-09-12T00:49:28.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.750+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.751+0000 7fa0b8d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.751+0000 7fa0b8d2a800 20 started sync module instance, tier type = 2024-09-12T00:49:28.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.751+0000 7fa0b8d2a800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:28.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.760+0000 7fa0b8d2a800 20 add_watcher() i=0 2024-09-12T00:49:28.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.760+0000 7fa0b8d2a800 20 add_watcher() i=1 2024-09-12T00:49:28.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.760+0000 7fa0b8d2a800 20 add_watcher() i=2 2024-09-12T00:49:28.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.760+0000 7fa0b8d2a800 20 add_watcher() i=3 2024-09-12T00:49:28.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.760+0000 7fa0b8d2a800 20 add_watcher() i=4 2024-09-12T00:49:28.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.760+0000 7fa0b8d2a800 20 add_watcher() i=5 2024-09-12T00:49:28.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.760+0000 7fa0b8d2a800 20 add_watcher() i=6 2024-09-12T00:49:28.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.761+0000 7fa0b8d2a800 20 add_watcher() i=7 2024-09-12T00:49:28.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.761+0000 7fa0b8d2a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:28.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.762+0000 7f9f6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:28.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.763+0000 7fa0b8d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:28.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.763+0000 7fa0b8d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:28.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.763+0000 7fa0b8d2a800 5 note: GC not initialized 2024-09-12T00:49:28.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.763+0000 7f9f69fe3640 20 reqs_thread_entry: start 2024-09-12T00:49:28.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.763+0000 7fa0b8d2a800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:28.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.763+0000 7fa0b8d2a800 20 Filter name: none 2024-09-12T00:49:28.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.763+0000 7f9edb7fe640 20 reqs_thread_entry: start 2024-09-12T00:49:28.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.763+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.764+0000 7fa0b8d2a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:28.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.764+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.764 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.765+0000 7fa0b8d2a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:28.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.765+0000 7fa0b8d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:28.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.765+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.765+0000 7fa0b8d2a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:28.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.765+0000 7fa0b8d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.765 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.766+0000 7fa0b8d2a800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:28.766 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.766+0000 7fa0b8d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:28.767 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.767+0000 7f9f6afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:28.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.769+0000 7fa0b8d2a800 20 remove_watcher() i=0 2024-09-12T00:49:28.769 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.769+0000 7fa0b8d2a800 2 removed watcher, disabling cache 2024-09-12T00:49:28.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.771+0000 7fa0b8d2a800 20 remove_watcher() i=1 2024-09-12T00:49:28.771 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.772+0000 7fa0b8d2a800 20 remove_watcher() i=2 2024-09-12T00:49:28.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.773+0000 7fa0b8d2a800 20 remove_watcher() i=3 2024-09-12T00:49:28.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.774+0000 7fa0b8d2a800 20 remove_watcher() i=4 2024-09-12T00:49:28.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.775+0000 7fa0b8d2a800 20 remove_watcher() i=5 2024-09-12T00:49:28.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.776+0000 7fa0b8d2a800 20 remove_watcher() i=6 2024-09-12T00:49:28.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.777+0000 7fa0b8d2a800 20 remove_watcher() i=7 2024-09-12T00:49:28.787 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:28.787 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:49:28.787 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-do-reshard id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:49:28.788 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:28.789 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:28.789 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:28.820 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:28.820 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:28.877 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:28.910 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:28.910 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:28.950 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.950+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.951+0000 7fb9467ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.951+0000 7fb9467ab800 20 realm 2024-09-12T00:49:28.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.951+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.952+0000 7fb9467ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.952+0000 7fb9467ab800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:28.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.952+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.952+0000 7fb9467ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:28.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.952+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.953+0000 7fb9467ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:28.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.953+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:28.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.953+0000 7fb9467ab800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:28.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.953+0000 7fb9467ab800 20 searching for the correct realm 2024-09-12T00:49:28.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:28.957+0000 7fb93ba94640 0 -- 172.21.15.19:0/70419286 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fb92c0448d0 msgr2=0x7fb92c0393a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:29.162 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.162+0000 7fb944a96640 0 -- 172.21.15.19:0/70419286 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55f20cfcf920 msgr2=0x55f20cfd1de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:29.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.167+0000 7fb9467ab800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:29.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.167+0000 7fb9467ab800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:29.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.167+0000 7fb9467ab800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:29.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.167+0000 7fb9467ab800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:29.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.167+0000 7fb9467ab800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:29.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.167+0000 7fb9467ab800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:29.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.167+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.167+0000 7fb9467ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:29.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.167+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:29.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 20 zone default found 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 4 Realm: () 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 20 zonegroup default 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.168+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.169+0000 7fb9467ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:29.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.169+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.169+0000 7fb9467ab800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:29.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.169+0000 7fb9467ab800 20 started sync module instance, tier type = 2024-09-12T00:49:29.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.169+0000 7fb9467ab800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:29.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.178+0000 7fb9467ab800 20 add_watcher() i=0 2024-09-12T00:49:29.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.178+0000 7fb9467ab800 20 add_watcher() i=1 2024-09-12T00:49:29.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.178+0000 7fb9467ab800 20 add_watcher() i=2 2024-09-12T00:49:29.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.178+0000 7fb9467ab800 20 add_watcher() i=3 2024-09-12T00:49:29.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.178+0000 7fb9467ab800 20 add_watcher() i=4 2024-09-12T00:49:29.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.178+0000 7fb9467ab800 20 add_watcher() i=5 2024-09-12T00:49:29.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.178+0000 7fb9467ab800 20 add_watcher() i=6 2024-09-12T00:49:29.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.179+0000 7fb9467ab800 20 add_watcher() i=7 2024-09-12T00:49:29.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.179+0000 7fb9467ab800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:29.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.181+0000 7fb7fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:29.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.181+0000 7fb9467ab800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:29.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.181+0000 7fb9467ab800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:29.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.181+0000 7fb9467ab800 5 note: GC not initialized 2024-09-12T00:49:29.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.182+0000 7fb7f97e2640 20 reqs_thread_entry: start 2024-09-12T00:49:29.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.182+0000 7fb9467ab800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:29.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.182+0000 7fb9467ab800 20 Filter name: none 2024-09-12T00:49:29.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.182+0000 7fb76affd640 20 reqs_thread_entry: start 2024-09-12T00:49:29.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.182+0000 7fb9467ab800 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:49:29.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.182+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.182+0000 7fb9467ab800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:29.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.182+0000 7fb9467ab800 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:49:29.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.183+0000 7fb9467ab800 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:49:29.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.183+0000 7fb9467ab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 : miss 2024-09-12T00:49:29.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.183+0000 7fb9467ab800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.183+0000 7fb9467ab800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:29.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.183+0000 7fb9467ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:29.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.183+0000 7fb9467ab800 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:29.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.183+0000 7fb9467ab800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:29.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.183+0000 7fb9467ab800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:29.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.183+0000 7fb9467ab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 2024-09-12T00:49:29.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.188+0000 7fb9467ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:29.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.188+0000 7fb9467ab800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:29.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.188+0000 7fb9467ab800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:29.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.188+0000 7fb9467ab800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33, ofs0, ns] 2024-09-12T00:49:29.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.188+0000 7fb822ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398973 cookie 94498088406368 notifier 6980 bl.length()=911 2024-09-12T00:49:29.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.188+0000 7fb822ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:29.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.188+0000 7fb822ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:29.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.188+0000 7fb822ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:29.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.190+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): orig_sources= new_sources= 2024-09-12T00:49:29.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.190+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): potential sources added=[] removed=[] 2024-09-12T00:49:29.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.190+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): orig_dests= new_dests= 2024-09-12T00:49:29.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.190+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): potential dests added=[] removed=[] 2024-09-12T00:49:29.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.0 2024-09-12T00:49:29.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.0 2024-09-12T00:49:29.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.1 2024-09-12T00:49:29.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.1 2024-09-12T00:49:29.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.2 2024-09-12T00:49:29.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.2 2024-09-12T00:49:29.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.3 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.3 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.4 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.4 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.5 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.5 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.6 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.6 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.7 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.7 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.8 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.8 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.9 2024-09-12T00:49:29.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.9 2024-09-12T00:49:29.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.10 2024-09-12T00:49:29.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.10 2024-09-12T00:49:29.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.11 2024-09-12T00:49:29.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1.11 2024-09-12T00:49:29.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.194+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.0 2024-09-12T00:49:29.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.195+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1 2024-09-12T00:49:29.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.195+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.2 2024-09-12T00:49:29.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.196+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.3 2024-09-12T00:49:29.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.196+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.4 2024-09-12T00:49:29.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.197+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.5 2024-09-12T00:49:29.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.197+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.6 2024-09-12T00:49:29.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.198+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.7 2024-09-12T00:49:29.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.198+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.8 2024-09-12T00:49:29.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.199+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.9 2024-09-12T00:49:29.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.199+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.10 2024-09-12T00:49:29.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.202+0000 7fb9467ab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:29.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.202+0000 7fb9467ab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 2024-09-12T00:49:29.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.204+0000 7fb9467ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:29.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.204+0000 7fb9467ab800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:29.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.204+0000 7fb9467ab800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:29.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.204+0000 7fb9467ab800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33, ofs0, ns] 2024-09-12T00:49:29.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.204+0000 7fb8237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398974 cookie 94498088406368 notifier 6980 bl.length()=911 2024-09-12T00:49:29.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.204+0000 7fb8237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:29.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.204+0000 7fb8237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:29.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.204+0000 7fb8237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:29.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.206+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): orig_sources= new_sources= 2024-09-12T00:49:29.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.206+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): potential sources added=[] removed=[] 2024-09-12T00:49:29.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.206+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): orig_dests= new_dests= 2024-09-12T00:49:29.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.206+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): potential dests added=[] removed=[] 2024-09-12T00:49:29.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.208+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.0 2024-09-12T00:49:29.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.209+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.1 2024-09-12T00:49:29.208 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.209+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.2 2024-09-12T00:49:29.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.209+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.3 2024-09-12T00:49:29.209 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.210+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.4 2024-09-12T00:49:29.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.210+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.5 2024-09-12T00:49:29.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.210+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.6 2024-09-12T00:49:29.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.210+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.7 2024-09-12T00:49:29.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.211+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.8 2024-09-12T00:49:29.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.211+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.9 2024-09-12T00:49:29.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.211+0000 7fb9467ab800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33.10 2024-09-12T00:49:29.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.212+0000 7fb9467ab800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:49:29.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.212+0000 7fb9467ab800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 2024-09-12T00:49:29.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.213+0000 7fb9467ab800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:29.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.213+0000 7fb9467ab800 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:29.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.213+0000 7fb9467ab800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:29.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.213+0000 7fb9467ab800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33, ofs0, ns] 2024-09-12T00:49:29.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.213+0000 7fb8237fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398975 cookie 94498088406368 notifier 6980 bl.length()=879 2024-09-12T00:49:29.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.213+0000 7fb8237fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 info.flags=0x17 2024-09-12T00:49:29.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.213+0000 7fb8237fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 to cache LRU end 2024-09-12T00:49:29.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.213+0000 7fb8237fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:29.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.215+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): orig_sources= new_sources= 2024-09-12T00:49:29.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.215+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): potential sources added=[] removed=[] 2024-09-12T00:49:29.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.215+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): orig_dests= new_dests= 2024-09-12T00:49:29.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.215+0000 7fb9467ab800 20 handle_bi_update(): bucket=:error-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33]): potential dests added=[] removed=[] 2024-09-12T00:49:29.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.217+0000 7fb9467ab800 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:49:29.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.219+0000 7fb7fa7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:29.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.222+0000 7fb9467ab800 20 remove_watcher() i=0 2024-09-12T00:49:29.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.222+0000 7fb9467ab800 2 removed watcher, disabling cache 2024-09-12T00:49:29.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.223+0000 7fb9467ab800 20 remove_watcher() i=1 2024-09-12T00:49:29.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.224+0000 7fb9467ab800 20 remove_watcher() i=2 2024-09-12T00:49:29.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.225+0000 7fb9467ab800 20 remove_watcher() i=3 2024-09-12T00:49:29.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.226+0000 7fb9467ab800 20 remove_watcher() i=4 2024-09-12T00:49:29.226 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.227+0000 7fb9467ab800 20 remove_watcher() i=5 2024-09-12T00:49:29.227 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.228+0000 7fb9467ab800 20 remove_watcher() i=6 2024-09-12T00:49:29.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.229+0000 7fb9467ab800 20 remove_watcher() i=7 2024-09-12T00:49:29.241 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:49:29.270 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:29.271 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:29.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.311+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.313+0000 7f0956c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:29.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.313+0000 7f0956c0f800 20 realm 2024-09-12T00:49:29.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.313+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.313+0000 7f0956c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:29.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.313+0000 7f0956c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:29.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.313+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.313+0000 7f0956c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:29.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.313+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.314+0000 7f0956c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:29.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.314+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.314+0000 7f0956c0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:29.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.314+0000 7f0956c0f800 20 searching for the correct realm 2024-09-12T00:49:29.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.318+0000 7f0949b91640 0 -- 172.21.15.19:0/3968479353 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f093c01c910 msgr2=0x7f093c01e420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:29.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.321+0000 7f0952392640 0 -- 172.21.15.19:0/3968479353 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f094c061040 msgr2=0x7f094c0bcb30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:29.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.325+0000 7f0956c0f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:29.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.325+0000 7f0956c0f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:29.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:29.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:29.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:29.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:29.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:29.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:29.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:29.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 zone default found 2024-09-12T00:49:29.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 4 Realm: () 2024-09-12T00:49:29.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:29.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:29.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:29.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 zonegroup default 2024-09-12T00:49:29.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.326+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.327+0000 7f0956c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:29.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.327+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.327+0000 7f0956c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:29.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.327+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.327+0000 7f0956c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:29.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.327+0000 7f0956c0f800 20 started sync module instance, tier type = 2024-09-12T00:49:29.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.327+0000 7f0956c0f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:29.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.336+0000 7f0956c0f800 20 add_watcher() i=0 2024-09-12T00:49:29.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.336+0000 7f0956c0f800 20 add_watcher() i=1 2024-09-12T00:49:29.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.336+0000 7f0956c0f800 20 add_watcher() i=2 2024-09-12T00:49:29.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.336+0000 7f0956c0f800 20 add_watcher() i=3 2024-09-12T00:49:29.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.336+0000 7f0956c0f800 20 add_watcher() i=4 2024-09-12T00:49:29.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.336+0000 7f0956c0f800 20 add_watcher() i=5 2024-09-12T00:49:29.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.336+0000 7f0956c0f800 20 add_watcher() i=6 2024-09-12T00:49:29.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.337+0000 7f0956c0f800 20 add_watcher() i=7 2024-09-12T00:49:29.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.337+0000 7f0956c0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:29.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.339+0000 7f0808fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:29.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.339+0000 7f0956c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:29.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.339+0000 7f0956c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:29.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.339+0000 7f0956c0f800 5 note: GC not initialized 2024-09-12T00:49:29.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.339+0000 7f07837fe640 20 reqs_thread_entry: start 2024-09-12T00:49:29.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.339+0000 7f0956c0f800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:29.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.339+0000 7f0956c0f800 20 Filter name: none 2024-09-12T00:49:29.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.339+0000 7f07817fa640 20 reqs_thread_entry: start 2024-09-12T00:49:29.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.340+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.340+0000 7f0956c0f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:29.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.340+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.341+0000 7f0956c0f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:29.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.341+0000 7f0956c0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:29.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.341+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.341+0000 7f0956c0f800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:29.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.341+0000 7f0956c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:49:29.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.342+0000 7f0956c0f800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:29.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.342+0000 7f0956c0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:29.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.344+0000 7f0808fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:29.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.346+0000 7f0956c0f800 20 remove_watcher() i=0 2024-09-12T00:49:29.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.346+0000 7f0956c0f800 2 removed watcher, disabling cache 2024-09-12T00:49:29.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.347+0000 7f0956c0f800 20 remove_watcher() i=1 2024-09-12T00:49:29.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.348+0000 7f0956c0f800 20 remove_watcher() i=2 2024-09-12T00:49:29.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.349+0000 7f0956c0f800 20 remove_watcher() i=3 2024-09-12T00:49:29.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.350+0000 7f0956c0f800 20 remove_watcher() i=4 2024-09-12T00:49:29.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.351+0000 7f0956c0f800 20 remove_watcher() i=5 2024-09-12T00:49:29.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.352+0000 7f0956c0f800 20 remove_watcher() i=6 2024-09-12T00:49:29.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:29.353+0000 7f0956c0f800 20 remove_watcher() i=7 2024-09-12T00:49:29.364 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:29.364 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:49:29.364 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-do-reshard id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:49:29.364 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:29.366 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:29.366 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:29.384 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:29.384 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:29.611 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:29.611 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:29.749 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:49:29.749 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:29.750 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:29.750 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:29.801 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:29.801 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:29.858 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:29.858 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:29.896 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:29.896 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:29.931 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:29.931 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:29.966 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:29.966 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.000 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.000 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.034 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.034 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.067 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.067 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.101 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.101 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.139 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.140 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.173 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.173 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.207 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.207 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.241 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.241 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.292 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.292 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.327 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.327 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.361 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.362 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.395 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.396 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.430 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.430 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.464 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.464 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.499 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.499 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.533 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:30.533 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:30.567 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:49:30.597 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:30.597 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:30.636 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.637+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.639+0000 7f8f56326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:30.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.639+0000 7f8f56326800 20 realm 2024-09-12T00:49:30.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.639+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.639+0000 7f8f56326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:30.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.639+0000 7f8f56326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:30.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.639+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.639+0000 7f8f56326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:30.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.639+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.639 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.640+0000 7f8f56326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:30.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.640+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.640+0000 7f8f56326800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:30.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.640+0000 7f8f56326800 20 searching for the correct realm 2024-09-12T00:49:30.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.644+0000 7f8f5184a640 0 -- 172.21.15.19:0/875899781 >> [v2:172.21.15.135:6800/2991448734,v1:172.21.15.135:6801/2991448734] conn(0x56408eda1240 msgr2=0x56408eda3630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:30.647 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.647+0000 7f8f5204b640 0 -- 172.21.15.19:0/875899781 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f8f4c07db70 msgr2=0x7f8f4c06bab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:30.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.854+0000 7f8f56326800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:30.854 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.854+0000 7f8f56326800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.854+0000 7f8f56326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.854+0000 7f8f56326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.854+0000 7f8f56326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.854+0000 7f8f56326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.854+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.854+0000 7f8f56326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.854+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.854+0000 7f8f56326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.854+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 20 zone default found 2024-09-12T00:49:30.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 4 Realm: () 2024-09-12T00:49:30.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:30.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:30.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:30.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 20 zonegroup default 2024-09-12T00:49:30.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:30.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:30.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.855+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.856+0000 7f8f56326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:30.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.856+0000 7f8f56326800 20 started sync module instance, tier type = 2024-09-12T00:49:30.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.856+0000 7f8f56326800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:30.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.867+0000 7f8f56326800 20 add_watcher() i=0 2024-09-12T00:49:30.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.867+0000 7f8f56326800 20 add_watcher() i=1 2024-09-12T00:49:30.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.867+0000 7f8f56326800 20 add_watcher() i=2 2024-09-12T00:49:30.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.867+0000 7f8f56326800 20 add_watcher() i=3 2024-09-12T00:49:30.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.867+0000 7f8f56326800 20 add_watcher() i=4 2024-09-12T00:49:30.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.867+0000 7f8f56326800 20 add_watcher() i=5 2024-09-12T00:49:30.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.867+0000 7f8f56326800 20 add_watcher() i=6 2024-09-12T00:49:30.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.869+0000 7f8f56326800 20 add_watcher() i=7 2024-09-12T00:49:30.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.869+0000 7f8f56326800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:30.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.870+0000 7f8e08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:30.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.871+0000 7f8f56326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:30.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.871+0000 7f8f56326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:30.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.871+0000 7f8f56326800 5 note: GC not initialized 2024-09-12T00:49:30.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.871+0000 7f8d837fe640 20 reqs_thread_entry: start 2024-09-12T00:49:30.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.871+0000 7f8f56326800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:30.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.871+0000 7f8f56326800 20 Filter name: none 2024-09-12T00:49:30.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.871+0000 7f8d817fa640 20 reqs_thread_entry: start 2024-09-12T00:49:30.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.871+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.872+0000 7f8f56326800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:30.873 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.872+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.873+0000 7f8f56326800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:30.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.873+0000 7f8f56326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:30.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.873+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.873+0000 7f8f56326800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:30.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.873+0000 7f8f56326800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.874+0000 7f8f56326800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:30.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.874+0000 7f8f56326800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:30.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.876+0000 7f8e08fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:30.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.878+0000 7f8f56326800 20 remove_watcher() i=0 2024-09-12T00:49:30.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.878+0000 7f8f56326800 2 removed watcher, disabling cache 2024-09-12T00:49:30.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.879+0000 7f8f56326800 20 remove_watcher() i=1 2024-09-12T00:49:30.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.880+0000 7f8f56326800 20 remove_watcher() i=2 2024-09-12T00:49:30.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.881+0000 7f8f56326800 20 remove_watcher() i=3 2024-09-12T00:49:30.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.882+0000 7f8f56326800 20 remove_watcher() i=4 2024-09-12T00:49:30.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.883+0000 7f8f56326800 20 remove_watcher() i=5 2024-09-12T00:49:30.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.884+0000 7f8f56326800 20 remove_watcher() i=6 2024-09-12T00:49:30.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.885+0000 7f8f56326800 20 remove_watcher() i=7 2024-09-12T00:49:30.895 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:30.896 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:49:30.896 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-do-reshard id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:49:30.896 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:30.897 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:49:30.932 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:30.932 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:30.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.972+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.974+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:30.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.974+0000 7f0403775800 20 realm 2024-09-12T00:49:30.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.974+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.974+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:30.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.974+0000 7f0403775800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:30.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.974+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.974+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:30.974 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.974+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.975+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:30.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.975+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:30.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.975+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:30.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.975+0000 7f0403775800 20 searching for the correct realm 2024-09-12T00:49:30.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:30.978+0000 7f0400a5e640 0 -- 172.21.15.19:0/1445722994 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f03f806d480 msgr2=0x7f03f806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:31.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.184+0000 7f0400a5e640 0 -- 172.21.15.19:0/1445722994 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x558febe48700 msgr2=0x558febe4ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:31.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:31.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:31.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:31.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:31.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:31.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:31.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.188+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.188+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.188+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:31.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:31.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 20 zone default found 2024-09-12T00:49:31.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 4 Realm: () 2024-09-12T00:49:31.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:31.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:31.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:31.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 20 zonegroup default 2024-09-12T00:49:31.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.190+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.190+0000 7f0403775800 20 started sync module instance, tier type = 2024-09-12T00:49:31.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.190+0000 7f0403775800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:31.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=0 2024-09-12T00:49:31.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=1 2024-09-12T00:49:31.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=2 2024-09-12T00:49:31.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=3 2024-09-12T00:49:31.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=4 2024-09-12T00:49:31.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=5 2024-09-12T00:49:31.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=6 2024-09-12T00:49:31.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.202+0000 7f0403775800 20 add_watcher() i=7 2024-09-12T00:49:31.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.202+0000 7f0403775800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:31.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.203+0000 7f02b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:31.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.203+0000 7f0403775800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:31.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.203+0000 7f0403775800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:31.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.203+0000 7f0403775800 5 note: GC not initialized 2024-09-12T00:49:31.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.204+0000 7f02b6fe5640 20 reqs_thread_entry: start 2024-09-12T00:49:31.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.204+0000 7f0403775800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:31.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.204+0000 7f0403775800 20 Filter name: none 2024-09-12T00:49:31.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.204+0000 7f02b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:31.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.204+0000 7f0403775800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:49:31.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.204+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.204+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:31.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.204+0000 7f0403775800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:49:31.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.204+0000 7f0403775800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:49:31.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.204+0000 7f0403775800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 : miss 2024-09-12T00:49:31.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.204+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.205+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:31.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.205+0000 7f0403775800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:49:31.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.205+0000 7f0403775800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:49:31.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.205+0000 7f0403775800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:31.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.205+0000 7f0403775800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:31.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.205+0000 7f0403775800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 2024-09-12T00:49:31.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.210+0000 7f0403775800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:49:31.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.210+0000 7f0403775800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:49:31.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.210+0000 7f0403775800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:31.210 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.210+0000 7f0403775800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34, ofs0, ns] 2024-09-12T00:49:31.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398979 cookie 94076626371392 notifier 7518 bl.length()=911 2024-09-12T00:49:31.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:49:31.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:49:31.211 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:31.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_sources= new_sources= 2024-09-12T00:49:31.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential sources added=[] removed=[] 2024-09-12T00:49:31.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_dests= new_dests= 2024-09-12T00:49:31.212 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential dests added=[] removed=[] 2024-09-12T00:49:31.216 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0403775800 time 2024-09-12T00:49:31.218910+0000 2024-09-12T00:49:31.216 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:31.217 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:31.218 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0406d8c71a] 2024-09-12T00:49:31.218 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0406d8c8d8] 2024-09-12T00:49:31.218 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558feacf5641] 2024-09-12T00:49:31.218 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558fead0538a] 2024-09-12T00:49:31.218 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:49:31.218 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0405a29590] 2024-09-12T00:49:31.219 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:49:31.219 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:49:31.219 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.217+0000 7f0403775800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0403775800 time 2024-09-12T00:49:31.218910+0000 2024-09-12T00:49:31.219 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:31.219 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.219 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:31.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0406d8c71a] 2024-09-12T00:49:31.220 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0406d8c8d8] 2024-09-12T00:49:31.220 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558feacf5641] 2024-09-12T00:49:31.220 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558fead0538a] 2024-09-12T00:49:31.220 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:49:31.220 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0405a29590] 2024-09-12T00:49:31.220 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:49:31.220 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:49:31.220 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.220 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:49:31.221 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f0403775800 thread_name:radosgw-admin 2024-09-12T00:49:31.238 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:31.238 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0405a3e6f0] 2024-09-12T00:49:31.238 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0405a8b99c] 2024-09-12T00:49:31.238 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:49:31.239 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:49:31.239 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0406d8c774] 2024-09-12T00:49:31.239 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0406d8c8d8] 2024-09-12T00:49:31.239 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558feacf5641] 2024-09-12T00:49:31.239 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558fead0538a] 2024-09-12T00:49:31.239 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:49:31.239 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0405a29590] 2024-09-12T00:49:31.239 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:49:31.239 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:49:31.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.218+0000 7f0403775800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:31.239 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f0403775800 thread_name:radosgw-admin 2024-09-12T00:49:31.240 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.240 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:31.240 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0405a3e6f0] 2024-09-12T00:49:31.240 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0405a8b99c] 2024-09-12T00:49:31.240 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:49:31.240 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:49:31.240 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0406d8c774] 2024-09-12T00:49:31.240 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0406d8c8d8] 2024-09-12T00:49:31.241 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558feacf5641] 2024-09-12T00:49:31.241 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558fead0538a] 2024-09-12T00:49:31.241 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:49:31.241 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0405a29590] 2024-09-12T00:49:31.241 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:49:31.241 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:49:31.241 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:31.242 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.242 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:49:31.242 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:49:30.955+0000 7f0403775800 10 monclient: monmap: 2024-09-12T00:49:31.242 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:49:31.242 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:31.243 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:49:31.243 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:49:31.243 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:31.243 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.243 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:49:31.243 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:49:31.244 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:49:31.244 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.244 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding auth protocol: cephx 2024-09-12T00:49:31.244 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding auth protocol: cephx 2024-09-12T00:49:31.244 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding auth protocol: cephx 2024-09-12T00:49:31.245 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.245 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.245 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.245 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.245 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.246 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.246 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.246 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.246 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.246 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.247 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.247 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.247 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:49:30.955+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.247 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:49:30.955+0000 7f0403775800 1 librados: starting msgr at 2024-09-12T00:49:31.247 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:49:30.955+0000 7f0403775800 1 librados: starting objecter 2024-09-12T00:49:31.247 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:49:30.955+0000 7f0403775800 5 asok(0x558febb3d630) register_command objecter_requests hook 0x558febd602a0 2024-09-12T00:49:31.248 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:49:30.955+0000 7f0403775800 1 librados: setting wanted keys 2024-09-12T00:49:31.248 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:49:30.955+0000 7f0403775800 1 librados: calling monclient init 2024-09-12T00:49:31.248 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:49:30.955+0000 7f0403775800 10 monclient: init 2024-09-12T00:49:31.248 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding auth protocol: cephx 2024-09-12T00:49:31.248 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding auth protocol: cephx 2024-09-12T00:49:31.249 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding auth protocol: cephx 2024-09-12T00:49:31.249 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.249 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.249 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.249 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.250 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.250 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.250 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.250 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.250 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.251 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.251 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.251 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.251 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:49:30.955+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.251 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:49:30.956+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.251 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:49:30.956+0000 7f0403775800 5 asok(0x558febb3d630) register_command rotate-key hook 0x558febd5c558 2024-09-12T00:49:31.252 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:31.252 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:49:31.252 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): picked mon.noname-c con 0x558febbe8880 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:49:31.252 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): picked mon.noname-b con 0x558febc08de0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:49:31.252 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): picked mon.noname-a con 0x558febc12640 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:49:31.253 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.253 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.253 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.253 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:31.253 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): authenticate will time out at 2237.459273s 2024-09-12T00:49:31.253 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): get_auth_request con 0x558febbe8880 auth_method 0 2024-09-12T00:49:31.253 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.253 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.254 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.254 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): get_auth_request con 0x558febc12640 auth_method 0 2024-09-12T00:49:31.254 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.254 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.254 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.254 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): get_auth_request con 0x558febc08de0 auth_method 0 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.255 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): handle_auth_done global_id 7022 payload 824 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient: _finish_hunting 0 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:49:30.956+0000 7f040125f640 1 monclient: found mon.noname-c 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: dump: 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.256 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.257 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.257 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.257 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.257 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.257 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: _finish_auth 0 2024-09-12T00:49:31.257 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: _check_auth_tickets 2024-09-12T00:49:31.257 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:31.257 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.257 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: dump: 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.258 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:49:30.956+0000 7f0403775800 5 monclient: authenticate success, global_id 7022 2024-09-12T00:49:31.259 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.259 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:49:30.956+0000 7f02ef606640 4 set_mon_vals no callback set 2024-09-12T00:49:31.259 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:49:31.259 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:49:30.957+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.259 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:49:30.957+0000 7f0403775800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:49:31.259 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:49:30.957+0000 7f0403775800 1 librados: init done 2024-09-12T00:49:31.259 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:49:30.959+0000 7f02ede03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:31.259 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:49:30.959+0000 7f02ede03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.259 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:49:30.959+0000 7f02ede03640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.259 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:49:30.959+0000 7f0400a5e640 10 monclient: get_auth_request con 0x7f02e8076470 auth_method 0 2024-09-12T00:49:31.260 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:49:30.959+0000 7f0401a60640 10 monclient: get_auth_request con 0x558febd85630 auth_method 0 2024-09-12T00:49:31.260 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:49:30.960+0000 7f040125f640 10 monclient: get_auth_request con 0x558febda8d10 auth_method 0 2024-09-12T00:49:31.260 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:49:30.961+0000 7f0400a5e640 10 monclient: get_auth_request con 0x558febdac590 auth_method 0 2024-09-12T00:49:31.260 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:49:30.962+0000 7f0403775800 10 monclient: build_initial_monmap 2024-09-12T00:49:31.260 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:49:30.962+0000 7f0403775800 1 build_initial for_mkfs: 0 2024-09-12T00:49:31.260 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:49:30.962+0000 7f0403775800 10 monclient: monmap: 2024-09-12T00:49:31.260 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:49:31.260 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:31.260 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:49:31.260 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:49:31.260 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding auth protocol: cephx 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding auth protocol: cephx 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding auth protocol: cephx 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.261 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:49:30.962+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:49:30.962+0000 7f0403775800 5 asok(0x558febb3d630) register_command objecter_requests cmddesc objecter_requests hook 0x558febdb59b0 EEXIST 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:49:30.962+0000 7f0403775800 10 monclient: init 2024-09-12T00:49:31.262 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding auth protocol: cephx 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding auth protocol: cephx 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding auth protocol: cephx 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.263 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:49:30.963+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:49:30.963+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:49:30.963+0000 7f0403775800 5 asok(0x558febb3d630) register_command rotate-key cmddesc rotate-key hook 0x558febdb10c0 EEXIST 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): picked mon.noname-b con 0x558febdd96a0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): picked mon.noname-c con 0x558febddb970 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): picked mon.noname-a con 0x558febdd7e70 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.264 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): authenticate will time out at 2237.466502s 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): get_auth_request con 0x558febdd7e70 auth_method 0 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): get_auth_request con 0x558febddb970 auth_method 0 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): get_auth_request con 0x558febdd96a0 auth_method 0 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.265 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.266 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.266 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.266 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.266 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.266 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.266 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.266 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.266 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.267 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.267 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): handle_auth_done global_id 7512 payload 824 2024-09-12T00:49:31.267 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient: _finish_hunting 0 2024-09-12T00:49:31.267 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:49:30.963+0000 7f0401a60640 1 monclient: found mon.noname-a 2024-09-12T00:49:31.267 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.268 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.268 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:31.268 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: dump: 2024-09-12T00:49:31.268 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.268 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.269 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.269 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.269 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.269 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.269 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.269 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.270 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.270 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.270 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:49:31.270 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:49:31.270 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:31.271 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.271 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:31.271 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: dump: 2024-09-12T00:49:31.271 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.271 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.271 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.272 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.272 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.272 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.272 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.272 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.273 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.273 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.273 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:49:30.964+0000 7f0403775800 5 monclient: authenticate success, global_id 7512 2024-09-12T00:49:31.273 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:49:30.964+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.273 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:49:30.964+0000 7f0402261640 4 set_mon_vals no callback set 2024-09-12T00:49:31.274 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:49:30.964+0000 7f0403775800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.274 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:49:30.964+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.274 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:49:30.964+0000 7f0403775800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.274 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:49:30.966+0000 7f02e6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:31.274 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:49:30.966+0000 7f02e6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.274 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:49:30.966+0000 7f02e6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:49:30.966+0000 7f040125f640 10 monclient: get_auth_request con 0x7f02dc076380 auth_method 0 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:49:30.966+0000 7f0403775800 10 monclient: get_monmap_and_config 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:49:30.966+0000 7f0403775800 10 monclient: build_initial_monmap 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:49:30.966+0000 7f0403775800 1 build_initial for_mkfs: 0 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:49:30.966+0000 7f0403775800 10 monclient: monmap: 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:49:31.275 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:49:31.276 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.276 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding auth protocol: cephx 2024-09-12T00:49:31.276 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding auth protocol: cephx 2024-09-12T00:49:31.276 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding auth protocol: cephx 2024-09-12T00:49:31.276 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.276 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.276 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.276 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.276 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.276 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:49:30.967+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient: init 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding auth protocol: cephx 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding auth protocol: cephx 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding auth protocol: cephx 2024-09-12T00:49:31.277 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:49:30.967+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:49:30.967+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.278 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:49:30.967+0000 7f0403775800 5 asok(0x558febb3d630) register_command rotate-key cmddesc rotate-key hook 0x7ffce75cf788 EEXIST 2024-09-12T00:49:31.279 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:31.279 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:49:31.279 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): picked mon.noname-c con 0x558febe2db70 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:49:31.279 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): picked mon.noname-b con 0x558febdfd6d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:49:31.279 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): picked mon.noname-a con 0x558febdfa600 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:49:31.279 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.279 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.279 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.279 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:31.279 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): authenticate will time out at 2237.470859s 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:49:30.967+0000 7f040125f640 10 monclient(hunting): get_auth_request con 0x558febe2db70 auth_method 0 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:49:30.967+0000 7f040125f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:49:30.967+0000 7f040125f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:49:30.967+0000 7f040125f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:49:30.967+0000 7f0401a60640 10 monclient(hunting): get_auth_request con 0x558febdfa600 auth_method 0 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:49:30.967+0000 7f0401a60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:49:30.967+0000 7f0401a60640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:49:30.967+0000 7f0401a60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:49:30.968+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:49:30.968+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:49:30.968+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.280 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.281 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.281 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.281 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): get_auth_request con 0x558febdfd6d0 auth_method 0 2024-09-12T00:49:31.281 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.281 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.281 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.281 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.281 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.281 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.281 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient(hunting): handle_auth_done global_id 7515 payload 274 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient: _finish_hunting 0 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:49:30.968+0000 7f0401a60640 1 monclient: found mon.noname-a 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: dump: 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.282 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: dump: 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.283 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:49:30.968+0000 7f0403775800 5 monclient: authenticate success, global_id 7515 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:49:30.968+0000 7f0403775800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:49:30.968+0000 7f0403775800 4 set_mon_vals no callback set 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:49:30.968+0000 7f0403775800 10 monclient: shutdown 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:49:30.969+0000 7f0403775800 10 monclient: build_initial_monmap 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:49:30.969+0000 7f0403775800 1 build_initial for_mkfs: 0 2024-09-12T00:49:31.284 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:49:30.969+0000 7f0403775800 10 monclient: monmap: 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding auth protocol: cephx 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding auth protocol: cephx 2024-09-12T00:49:31.285 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding auth protocol: cephx 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:49:30.969+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.286 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:49:30.969+0000 7f0403775800 1 librados: starting msgr at 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:49:30.969+0000 7f0403775800 1 librados: starting objecter 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:49:30.969+0000 7f0403775800 5 asok(0x558febb3d630) register_command objecter_requests cmddesc objecter_requests hook 0x558febdfe510 EEXIST 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:49:30.969+0000 7f0403775800 1 librados: setting wanted keys 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:49:30.969+0000 7f0403775800 1 librados: calling monclient init 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:49:30.969+0000 7f0403775800 10 monclient: init 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding auth protocol: cephx 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding auth protocol: cephx 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding auth protocol: cephx 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.287 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:49:30.969+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:49:30.970+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:49:30.970+0000 7f0403775800 5 asok(0x558febb3d630) register_command rotate-key cmddesc rotate-key hook 0x558febdf1598 EEXIST 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:49:31.288 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): picked mon.noname-c con 0x558febdfa600 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): picked mon.noname-b con 0x558febdfd6d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): picked mon.noname-a con 0x558febe2db70 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): authenticate will time out at 2237.473143s 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): get_auth_request con 0x558febe2db70 auth_method 0 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): get_auth_request con 0x558febdfa600 auth_method 0 2024-09-12T00:49:31.289 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.290 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.290 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.290 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.290 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.290 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.290 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.290 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.290 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.290 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): get_auth_request con 0x558febdfd6d0 auth_method 0 2024-09-12T00:49:31.291 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.291 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.291 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.291 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.291 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.291 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.291 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): handle_auth_done global_id 7518 payload 824 2024-09-12T00:49:31.291 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient: _finish_hunting 0 2024-09-12T00:49:31.291 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:49:30.970+0000 7f0401a60640 1 monclient: found mon.noname-a 2024-09-12T00:49:31.291 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.291 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: dump: 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.292 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:49:31.293 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:49:31.293 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:31.293 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.293 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:31.293 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: dump: 2024-09-12T00:49:31.293 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.293 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:49:30.970+0000 7f0403775800 5 monclient: authenticate success, global_id 7518 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:49:30.970+0000 7f02e4ff9640 4 set_mon_vals no callback set 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.294 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:49:30.970+0000 7f0403775800 1 librados: init done 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:49:30.970+0000 7f0403775800 5 asok(0x558febb3d630) register_command cr dump hook 0x558febe27dc8 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:49:30.972+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:49:30.973+0000 7f02d2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:49:30.973+0000 7f02d2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:49:30.973+0000 7f02d2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:49:30.973+0000 7f040125f640 10 monclient: get_auth_request con 0x7f02cc076470 auth_method 0 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:49:30.973+0000 7f0400a5e640 10 monclient: get_auth_request con 0x558febe48700 auth_method 0 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:49:30.974+0000 7f0403775800 20 realm 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.295 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:49:30.974+0000 7f0403775800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:49:30.974+0000 7f040125f640 10 monclient: get_auth_request con 0x558febe4ca50 auth_method 0 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:49:30.975+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:49:30.975+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:49:30.975+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:49:30.975+0000 7f0403775800 20 searching for the correct realm 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:49:30.975+0000 7f0400a5e640 10 monclient: get_auth_request con 0x558febe51b60 auth_method 0 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:49:30.976+0000 7f0401a60640 10 monclient: get_auth_request con 0x7f03f8056980 auth_method 0 2024-09-12T00:49:31.296 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:49:30.977+0000 7f040125f640 10 monclient: get_auth_request con 0x7f03f405f850 auth_method 0 2024-09-12T00:49:31.297 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:49:30.978+0000 7f0400a5e640 10 monclient: get_auth_request con 0x7f03f806d480 auth_method 0 2024-09-12T00:49:31.297 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:49:30.978+0000 7f0400a5e640 0 -- 172.21.15.19:0/1445722994 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f03f806d480 msgr2=0x7f03f806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:31.297 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:49:31.180+0000 7f0400a5e640 10 monclient: get_auth_request con 0x7f03f806d480 auth_method 0 2024-09-12T00:49:31.297 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:49:31.182+0000 7f0401a60640 10 monclient: get_auth_request con 0x7f03f40762c0 auth_method 0 2024-09-12T00:49:31.297 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:49:31.183+0000 7f040125f640 10 monclient: get_auth_request con 0x7f03fc023020 auth_method 0 2024-09-12T00:49:31.297 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:49:31.184+0000 7f0400a5e640 0 -- 172.21.15.19:0/1445722994 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x558febe48700 msgr2=0x558febe4ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:31.297 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:49:31.184+0000 7f02d2ffd640 1 client.7518.objecter ms_handle_reset 0x558febe48700 session 0x558febe48080 osd.6 2024-09-12T00:49:31.297 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:49:31.184+0000 7f02d2ffd640 10 monclient: _renew_subs 2024-09-12T00:49:31.297 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:49:31.184+0000 7f02d2ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.297 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:49:31.184+0000 7f0400a5e640 10 monclient: get_auth_request con 0x7f02cc086790 auth_method 0 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:49:31.188+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:49:31.188+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:49:31.188+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:31.298 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:49:31.189+0000 7f0403775800 20 zone default found 2024-09-12T00:49:31.299 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:49:31.189+0000 7f0403775800 4 Realm: () 2024-09-12T00:49:31.299 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:49:31.189+0000 7f0403775800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:31.299 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:49:31.189+0000 7f0403775800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:31.299 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:49:31.189+0000 7f0403775800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:31.299 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:49:31.189+0000 7f0403775800 20 zonegroup default 2024-09-12T00:49:31.299 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.299 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.299 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:49:31.190+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:49:31.190+0000 7f0403775800 20 started sync module instance, tier type = 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:49:31.190+0000 7f0403775800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=0 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=1 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=2 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=3 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=4 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=5 2024-09-12T00:49:31.300 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=6 2024-09-12T00:49:31.301 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:49:31.202+0000 7f0403775800 20 add_watcher() i=7 2024-09-12T00:49:31.301 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:49:31.202+0000 7f0403775800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:31.301 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding auth protocol: cephx 2024-09-12T00:49:31.301 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding auth protocol: cephx 2024-09-12T00:49:31.301 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding auth protocol: cephx 2024-09-12T00:49:31.301 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.301 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.301 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.302 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.302 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.302 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.302 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:49:31.203+0000 7f02b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:31.302 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.302 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.302 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.302 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.302 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.302 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.302 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:49:31.203+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.303 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:49:31.203+0000 7f0403775800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:31.303 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:49:31.203+0000 7f0403775800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:31.303 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:49:31.203+0000 7f0403775800 5 asok(0x558febb3d630) register_command cache list hook 0x558febe1e250 2024-09-12T00:49:31.303 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:49:31.203+0000 7f0403775800 5 asok(0x558febb3d630) register_command cache inspect hook 0x558febe1e250 2024-09-12T00:49:31.303 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:49:31.203+0000 7f0403775800 5 asok(0x558febb3d630) register_command cache erase hook 0x558febe1e250 2024-09-12T00:49:31.303 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:49:31.203+0000 7f0403775800 5 asok(0x558febb3d630) register_command cache zap hook 0x558febe1e250 2024-09-12T00:49:31.303 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:49:31.203+0000 7f0403775800 5 note: GC not initialized 2024-09-12T00:49:31.304 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:49:31.204+0000 7f02b6fe5640 20 reqs_thread_entry: start 2024-09-12T00:49:31.304 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:49:31.204+0000 7f0403775800 5 asok(0x558febb3d630) register_command sync trace show hook 0x7f03fc01c070 2024-09-12T00:49:31.304 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:49:31.204+0000 7f0403775800 5 asok(0x558febb3d630) register_command sync trace history hook 0x7f03fc01c070 2024-09-12T00:49:31.304 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:49:31.204+0000 7f0403775800 5 asok(0x558febb3d630) register_command sync trace active hook 0x7f03fc01c070 2024-09-12T00:49:31.304 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:49:31.204+0000 7f0403775800 5 asok(0x558febb3d630) register_command sync trace active_short hook 0x7f03fc01c070 2024-09-12T00:49:31.304 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:49:31.204+0000 7f0403775800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:31.304 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:49:31.204+0000 7f0403775800 20 Filter name: none 2024-09-12T00:49:31.305 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:49:31.204+0000 7f02b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:31.305 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:49:31.204+0000 7f0403775800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:49:31.305 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:49:31.204+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.305 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:49:31.204+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:31.305 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:49:31.204+0000 7f0403775800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:49:31.305 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:49:31.204+0000 7f0403775800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:49:31.305 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:49:31.204+0000 7f0403775800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 : miss 2024-09-12T00:49:31.305 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:49:31.204+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.305 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:49:31.205+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:31.305 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:49:31.205+0000 7f0403775800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:49:31.205+0000 7f0403775800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:49:31.205+0000 7f0403775800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:49:31.205+0000 7f0403775800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:49:31.205+0000 7f0403775800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:49:31.210+0000 7f0403775800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:49:31.210+0000 7f0403775800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:49:31.210+0000 7f0403775800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:49:31.210+0000 7f0403775800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34, ofs0, ns] 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398979 cookie 94076626371392 notifier 7518 bl.length()=911 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:31.306 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_sources= new_sources= 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential sources added=[] removed=[] 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_dests= new_dests= 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential dests added=[] removed=[] 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:49:31.217+0000 7f0403775800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0403775800 time 2024-09-12T00:49:31.218910+0000 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0406d8c71a] 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0406d8c8d8] 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558feacf5641] 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558fead0538a] 2024-09-12T00:49:31.307 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0405a29590] 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:49:31.218+0000 7f0403775800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f0403775800 thread_name:radosgw-admin 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0405a3e6f0] 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0405a8b99c] 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:49:31.308 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0406d8c774] 2024-09-12T00:49:31.309 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0406d8c8d8] 2024-09-12T00:49:31.309 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558feacf5641] 2024-09-12T00:49:31.309 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558fead0538a] 2024-09-12T00:49:31.309 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:49:31.309 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0405a29590] 2024-09-12T00:49:31.309 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:49:31.310 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:49:31.310 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:31.310 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.310 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:49:31.310 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:49:31.310 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:49:31.310 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:49:31.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:49:31.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:49:31.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:49:31.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:49:31.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:49:31.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:49:31.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:49:31.311 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:49:31.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:49:31.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:49:31.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:49:31.313 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:49:31.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:49:31.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:49:31.313 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:49:31.313 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:49:31.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:49:31.313 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:49:31.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:49:31.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:49:31.314 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:49:31.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:49:31.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:49:31.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:49:31.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:49:31.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:49:31.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:49:31.314 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:49:31.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:49:31.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:49:31.315 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:49:31.316 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:49:31.317 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02b4fe1640 / http_manager 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02b6fe5640 / http_manager 2024-09-12T00:49:31.318 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02b7fe7640 / rgw_dt_lg_renew 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02d2ffd640 / ms_dispatch 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02e4ff9640 / io_context_pool 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02e6ffd640 / ms_dispatch 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02ede03640 / ms_dispatch 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02ef606640 / io_context_pool 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0400a5e640 / msgr-worker-2 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: 7f040125f640 / msgr-worker-1 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0401a60640 / msgr-worker-0 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0402261640 / io_context_pool 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0403775800 / radosgw-admin 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.127006.log 2024-09-12T00:49:31.319 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:49:30.955+0000 7f0403775800 10 monclient: monmap: 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.320 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding auth protocol: cephx 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding auth protocol: cephx 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding auth protocol: cephx 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.321 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: crc 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd61ff0) adding con mode: secure 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:49:30.955+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:49:30.955+0000 7f0403775800 1 librados: starting msgr at 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:49:30.955+0000 7f0403775800 1 librados: starting objecter 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:49:30.955+0000 7f0403775800 5 asok(0x558febb3d630) register_command objecter_requests hook 0x558febd602a0 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:49:30.955+0000 7f0403775800 1 librados: setting wanted keys 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:49:30.955+0000 7f0403775800 1 librados: calling monclient init 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:49:30.955+0000 7f0403775800 10 monclient: init 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding auth protocol: cephx 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding auth protocol: cephx 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding auth protocol: cephx 2024-09-12T00:49:31.322 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.323 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.323 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.323 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.323 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.323 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.323 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.323 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.323 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.323 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.323 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: crc 2024-09-12T00:49:31.324 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:49:30.955+0000 7f0403775800 5 AuthRegistry(0x558febd5c410) adding con mode: secure 2024-09-12T00:49:31.324 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:49:30.955+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.324 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:49:30.956+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.324 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:49:30.956+0000 7f0403775800 5 asok(0x558febb3d630) register_command rotate-key hook 0x558febd5c558 2024-09-12T00:49:31.324 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:31.324 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:49:31.324 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): picked mon.noname-c con 0x558febbe8880 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:49:31.324 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): picked mon.noname-b con 0x558febc08de0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:49:31.324 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): picked mon.noname-a con 0x558febc12640 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:49:31.324 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.324 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient(hunting): authenticate will time out at 2237.459273s 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): get_auth_request con 0x558febbe8880 auth_method 0 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): get_auth_request con 0x558febc12640 auth_method 0 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.325 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:49:30.956+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): get_auth_request con 0x558febc08de0 auth_method 0 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:49:30.956+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient(hunting): handle_auth_done global_id 7022 payload 824 2024-09-12T00:49:31.326 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient: _finish_hunting 0 2024-09-12T00:49:31.327 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:49:30.956+0000 7f040125f640 1 monclient: found mon.noname-c 2024-09-12T00:49:31.327 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:49:30.956+0000 7f040125f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:49:31.327 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.327 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:49:31.327 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: dump: 2024-09-12T00:49:31.327 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.327 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.327 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.327 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.327 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.327 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.328 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.328 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.328 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.328 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.328 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: _finish_auth 0 2024-09-12T00:49:31.328 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: _check_auth_tickets 2024-09-12T00:49:31.328 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:31.328 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.328 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:49:31.329 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:49:30.956+0000 7f02ede03640 10 monclient: dump: 2024-09-12T00:49:31.329 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.329 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.329 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.329 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.329 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.330 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.330 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.330 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.330 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.330 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.330 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:49:30.956+0000 7f0403775800 5 monclient: authenticate success, global_id 7022 2024-09-12T00:49:31.330 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.330 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:49:30.956+0000 7f02ef606640 4 set_mon_vals no callback set 2024-09-12T00:49:31.331 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:49:30.956+0000 7f0403775800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:49:31.331 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:49:30.957+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.331 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:49:30.957+0000 7f0403775800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:49:31.331 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:49:30.957+0000 7f0403775800 1 librados: init done 2024-09-12T00:49:31.331 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:49:30.959+0000 7f02ede03640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:31.331 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:49:30.959+0000 7f02ede03640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.331 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:49:30.959+0000 7f02ede03640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.331 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:49:30.959+0000 7f0400a5e640 10 monclient: get_auth_request con 0x7f02e8076470 auth_method 0 2024-09-12T00:49:31.331 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:49:30.959+0000 7f0401a60640 10 monclient: get_auth_request con 0x558febd85630 auth_method 0 2024-09-12T00:49:31.332 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:49:30.960+0000 7f040125f640 10 monclient: get_auth_request con 0x558febda8d10 auth_method 0 2024-09-12T00:49:31.332 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:49:30.961+0000 7f0400a5e640 10 monclient: get_auth_request con 0x558febdac590 auth_method 0 2024-09-12T00:49:31.332 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:49:30.962+0000 7f0403775800 10 monclient: build_initial_monmap 2024-09-12T00:49:31.332 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:49:30.962+0000 7f0403775800 1 build_initial for_mkfs: 0 2024-09-12T00:49:31.332 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:49:30.962+0000 7f0403775800 10 monclient: monmap: 2024-09-12T00:49:31.332 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:49:31.332 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:31.332 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:49:31.332 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:49:31.333 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:31.333 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.333 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:49:31.333 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:49:31.333 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:49:31.333 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.333 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding auth protocol: cephx 2024-09-12T00:49:31.333 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding auth protocol: cephx 2024-09-12T00:49:31.333 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding auth protocol: cephx 2024-09-12T00:49:31.333 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.333 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.334 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.334 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.334 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.334 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.334 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.334 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.334 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: crc 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb1fe0) adding con mode: secure 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:49:30.962+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:49:30.962+0000 7f0403775800 5 asok(0x558febb3d630) register_command objecter_requests cmddesc objecter_requests hook 0x558febdb59b0 EEXIST 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:49:30.962+0000 7f0403775800 10 monclient: init 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding auth protocol: cephx 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding auth protocol: cephx 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding auth protocol: cephx 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.335 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.336 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.336 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.336 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.336 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.336 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.336 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.336 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.336 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: crc 2024-09-12T00:49:31.336 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:49:30.962+0000 7f0403775800 5 AuthRegistry(0x558febdb0f78) adding con mode: secure 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:49:30.963+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:49:30.963+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:49:30.963+0000 7f0403775800 5 asok(0x558febb3d630) register_command rotate-key cmddesc rotate-key hook 0x558febdb10c0 EEXIST 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): picked mon.noname-b con 0x558febdd96a0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): picked mon.noname-c con 0x558febddb970 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): picked mon.noname-a con 0x558febdd7e70 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:31.337 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:49:30.963+0000 7f0403775800 10 monclient(hunting): authenticate will time out at 2237.466502s 2024-09-12T00:49:31.338 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): get_auth_request con 0x558febdd7e70 auth_method 0 2024-09-12T00:49:31.338 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.338 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.338 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.338 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): get_auth_request con 0x558febddb970 auth_method 0 2024-09-12T00:49:31.338 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.338 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.338 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.338 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): get_auth_request con 0x558febdd96a0 auth_method 0 2024-09-12T00:49:31.338 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.338 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.339 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.339 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.339 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.339 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.339 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.339 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.339 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:49:30.963+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.339 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.340 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.340 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:49:30.963+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.340 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient(hunting): handle_auth_done global_id 7512 payload 824 2024-09-12T00:49:31.340 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient: _finish_hunting 0 2024-09-12T00:49:31.340 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:49:30.963+0000 7f0401a60640 1 monclient: found mon.noname-a 2024-09-12T00:49:31.340 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:49:30.963+0000 7f0401a60640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.340 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.340 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:31.341 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: dump: 2024-09-12T00:49:31.341 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.341 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.341 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.341 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.341 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.341 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.341 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.342 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.342 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.342 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.342 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:49:31.342 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:49:31.342 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:31.342 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.342 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:31.343 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:49:30.964+0000 7f02e6ffd640 10 monclient: dump: 2024-09-12T00:49:31.343 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.343 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.343 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.343 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.343 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.343 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.343 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.343 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.344 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.344 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.344 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:49:30.964+0000 7f0403775800 5 monclient: authenticate success, global_id 7512 2024-09-12T00:49:31.344 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:49:30.964+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.344 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:49:30.964+0000 7f0402261640 4 set_mon_vals no callback set 2024-09-12T00:49:31.344 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:49:30.964+0000 7f0403775800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.344 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:49:30.964+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.345 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:49:30.964+0000 7f0403775800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.345 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:49:30.966+0000 7f02e6ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:31.345 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:49:30.966+0000 7f02e6ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.345 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:49:30.966+0000 7f02e6ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.345 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:49:30.966+0000 7f040125f640 10 monclient: get_auth_request con 0x7f02dc076380 auth_method 0 2024-09-12T00:49:31.345 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:49:30.966+0000 7f0403775800 10 monclient: get_monmap_and_config 2024-09-12T00:49:31.345 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:49:30.966+0000 7f0403775800 10 monclient: build_initial_monmap 2024-09-12T00:49:31.346 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:49:30.966+0000 7f0403775800 1 build_initial for_mkfs: 0 2024-09-12T00:49:31.346 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:49:30.966+0000 7f0403775800 10 monclient: monmap: 2024-09-12T00:49:31.346 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:49:31.346 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:31.346 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:49:31.346 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:49:31.346 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:31.346 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.347 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:49:31.347 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:49:31.347 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:49:31.347 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.347 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding auth protocol: cephx 2024-09-12T00:49:31.347 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding auth protocol: cephx 2024-09-12T00:49:31.347 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding auth protocol: cephx 2024-09-12T00:49:31.348 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.348 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.348 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.348 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.348 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.348 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.348 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.348 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.349 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.349 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.349 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: crc 2024-09-12T00:49:31.349 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:49:30.966+0000 7f0403775800 5 AuthRegistry(0x558febdf9620) adding con mode: secure 2024-09-12T00:49:31.349 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:49:30.967+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.349 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient: init 2024-09-12T00:49:31.349 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding auth protocol: cephx 2024-09-12T00:49:31.349 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding auth protocol: cephx 2024-09-12T00:49:31.350 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding auth protocol: cephx 2024-09-12T00:49:31.350 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.350 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.350 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.350 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.350 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.350 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.350 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.351 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.351 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.351 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.351 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: crc 2024-09-12T00:49:31.351 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:49:30.967+0000 7f0403775800 5 AuthRegistry(0x7ffce75cf640) adding con mode: secure 2024-09-12T00:49:31.351 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:49:30.967+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.351 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:49:30.967+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.351 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:49:30.967+0000 7f0403775800 5 asok(0x558febb3d630) register_command rotate-key cmddesc rotate-key hook 0x7ffce75cf788 EEXIST 2024-09-12T00:49:31.351 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:31.352 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:49:31.352 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): picked mon.noname-c con 0x558febe2db70 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:49:31.352 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): picked mon.noname-b con 0x558febdfd6d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:49:31.352 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): picked mon.noname-a con 0x558febdfa600 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:49:31.352 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.352 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.352 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.353 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:31.353 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:49:30.967+0000 7f0403775800 10 monclient(hunting): authenticate will time out at 2237.470859s 2024-09-12T00:49:31.353 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:49:30.967+0000 7f040125f640 10 monclient(hunting): get_auth_request con 0x558febe2db70 auth_method 0 2024-09-12T00:49:31.353 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:49:30.967+0000 7f040125f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.353 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:49:30.967+0000 7f040125f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.353 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:49:30.967+0000 7f040125f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.353 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:49:30.967+0000 7f0401a60640 10 monclient(hunting): get_auth_request con 0x558febdfa600 auth_method 0 2024-09-12T00:49:31.353 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:49:30.967+0000 7f0401a60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.354 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:49:30.967+0000 7f0401a60640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.354 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:49:30.967+0000 7f0401a60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.354 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:49:30.968+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.354 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:49:30.968+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.354 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:49:30.968+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.354 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.354 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.355 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.355 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): get_auth_request con 0x558febdfd6d0 auth_method 0 2024-09-12T00:49:31.355 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.355 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.355 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.355 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.355 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.355 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:49:30.968+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient(hunting): handle_auth_done global_id 7515 payload 274 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient: _finish_hunting 0 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:49:30.968+0000 7f0401a60640 1 monclient: found mon.noname-a 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:49:30.968+0000 7f0401a60640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: dump: 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.356 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.357 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.357 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.357 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.357 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.357 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.357 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: _finish_auth 0 2024-09-12T00:49:31.357 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:49:31.357 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:31.357 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.357 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:31.357 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:49:30.968+0000 7f02e4ff9640 10 monclient: dump: 2024-09-12T00:49:31.358 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.358 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.358 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.358 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.358 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.358 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.359 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.359 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.359 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.359 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.359 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:49:30.968+0000 7f0403775800 5 monclient: authenticate success, global_id 7515 2024-09-12T00:49:31.360 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:49:30.968+0000 7f0403775800 10 monclient: get_monmap_and_config success 2024-09-12T00:49:31.360 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:49:30.968+0000 7f0403775800 4 set_mon_vals no callback set 2024-09-12T00:49:31.360 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:49:30.968+0000 7f0403775800 10 monclient: shutdown 2024-09-12T00:49:31.360 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:49:30.969+0000 7f0403775800 10 monclient: build_initial_monmap 2024-09-12T00:49:31.360 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:49:30.969+0000 7f0403775800 1 build_initial for_mkfs: 0 2024-09-12T00:49:31.361 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:49:30.969+0000 7f0403775800 10 monclient: monmap: 2024-09-12T00:49:31.361 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:49:31.361 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:49:31.361 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:49:31.361 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:49:31.362 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:49:31.362 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.362 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:49:31.362 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:49:31.362 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:49:31.363 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.363 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding auth protocol: cephx 2024-09-12T00:49:31.363 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding auth protocol: cephx 2024-09-12T00:49:31.363 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding auth protocol: cephx 2024-09-12T00:49:31.363 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.363 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.364 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.364 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.364 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.364 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.364 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.365 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.365 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.365 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.365 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: crc 2024-09-12T00:49:31.365 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdfb1a0) adding con mode: secure 2024-09-12T00:49:31.365 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:49:30.969+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.365 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:49:30.969+0000 7f0403775800 1 librados: starting msgr at 2024-09-12T00:49:31.366 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:49:30.969+0000 7f0403775800 1 librados: starting objecter 2024-09-12T00:49:31.366 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:49:30.969+0000 7f0403775800 5 asok(0x558febb3d630) register_command objecter_requests cmddesc objecter_requests hook 0x558febdfe510 EEXIST 2024-09-12T00:49:31.366 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:49:30.969+0000 7f0403775800 1 librados: setting wanted keys 2024-09-12T00:49:31.366 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:49:30.969+0000 7f0403775800 1 librados: calling monclient init 2024-09-12T00:49:31.366 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:49:30.969+0000 7f0403775800 10 monclient: init 2024-09-12T00:49:31.366 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding auth protocol: cephx 2024-09-12T00:49:31.366 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding auth protocol: cephx 2024-09-12T00:49:31.366 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding auth protocol: cephx 2024-09-12T00:49:31.366 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.366 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.367 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.367 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.367 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.367 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.367 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.367 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.367 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.367 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.367 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: crc 2024-09-12T00:49:31.368 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:49:30.969+0000 7f0403775800 5 AuthRegistry(0x558febdf1450) adding con mode: secure 2024-09-12T00:49:31.368 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:49:30.969+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.368 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:49:30.970+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.368 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:49:30.970+0000 7f0403775800 5 asok(0x558febb3d630) register_command rotate-key cmddesc rotate-key hook 0x558febdf1598 EEXIST 2024-09-12T00:49:31.368 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _reopen_session rank -1 2024-09-12T00:49:31.368 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:49:31.368 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): picked mon.noname-c con 0x558febdfa600 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:49:31.369 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): picked mon.noname-b con 0x558febdfd6d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:49:31.369 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): picked mon.noname-a con 0x558febe2db70 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:49:31.369 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.369 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.369 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): start opening mon connection 2024-09-12T00:49:31.369 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): _renew_subs 2024-09-12T00:49:31.369 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient(hunting): authenticate will time out at 2237.473143s 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): get_auth_request con 0x558febe2db70 auth_method 0 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): get_auth_request con 0x558febdfa600 auth_method 0 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.370 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:49:30.970+0000 7f040125f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): get_auth_request con 0x558febdfd6d0 auth_method 0 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:49:30.970+0000 7f0400a5e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient(hunting): handle_auth_done global_id 7518 payload 824 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient: _finish_hunting 0 2024-09-12T00:49:31.371 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:49:30.970+0000 7f0401a60640 1 monclient: found mon.noname-a 2024-09-12T00:49:31.372 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:49:30.970+0000 7f0401a60640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.372 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.372 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:49:31.372 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: dump: 2024-09-12T00:49:31.372 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.373 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.373 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.373 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.373 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.373 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.374 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.374 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.374 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.374 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.374 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:49:31.375 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:49:31.375 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:49:31.375 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:49:31.375 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:49:31.375 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:49:30.970+0000 7f02d2ffd640 10 monclient: dump: 2024-09-12T00:49:31.376 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:49:31.376 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:49:31.376 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.376 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:49:31.376 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:49:31.377 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:49:31.377 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:49:31.377 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:49:31.377 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:49:31.377 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.377 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:49:30.970+0000 7f0403775800 5 monclient: authenticate success, global_id 7518 2024-09-12T00:49:31.377 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.377 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:49:30.970+0000 7f02e4ff9640 4 set_mon_vals no callback set 2024-09-12T00:49:31.377 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.377 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _renew_subs 2024-09-12T00:49:31.378 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:49:30.970+0000 7f0403775800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.378 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:49:30.970+0000 7f0403775800 1 librados: init done 2024-09-12T00:49:31.378 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:49:30.970+0000 7f0403775800 5 asok(0x558febb3d630) register_command cr dump hook 0x558febe27dc8 2024-09-12T00:49:31.378 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:49:30.972+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.378 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:49:30.973+0000 7f02d2ffd640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:49:31.378 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:49:30.973+0000 7f02d2ffd640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.378 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:49:30.973+0000 7f02d2ffd640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:49:31.379 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:49:30.973+0000 7f040125f640 10 monclient: get_auth_request con 0x7f02cc076470 auth_method 0 2024-09-12T00:49:31.379 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:49:30.973+0000 7f0400a5e640 10 monclient: get_auth_request con 0x558febe48700 auth_method 0 2024-09-12T00:49:31.379 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.379 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:49:30.974+0000 7f0403775800 20 realm 2024-09-12T00:49:31.379 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.379 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.379 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:49:30.974+0000 7f0403775800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:31.379 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:49:30.974+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:49:30.974+0000 7f040125f640 10 monclient: get_auth_request con 0x558febe4ca50 auth_method 0 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:49:30.975+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:49:30.975+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:49:30.975+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:49:30.975+0000 7f0403775800 20 searching for the correct realm 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:49:30.975+0000 7f0400a5e640 10 monclient: get_auth_request con 0x558febe51b60 auth_method 0 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:49:30.976+0000 7f0401a60640 10 monclient: get_auth_request con 0x7f03f8056980 auth_method 0 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:49:30.977+0000 7f040125f640 10 monclient: get_auth_request con 0x7f03f405f850 auth_method 0 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:49:30.978+0000 7f0400a5e640 10 monclient: get_auth_request con 0x7f03f806d480 auth_method 0 2024-09-12T00:49:31.380 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:49:30.978+0000 7f0400a5e640 0 -- 172.21.15.19:0/1445722994 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f03f806d480 msgr2=0x7f03f806d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:49:31.180+0000 7f0400a5e640 10 monclient: get_auth_request con 0x7f03f806d480 auth_method 0 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:49:31.182+0000 7f0401a60640 10 monclient: get_auth_request con 0x7f03f40762c0 auth_method 0 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:49:31.183+0000 7f040125f640 10 monclient: get_auth_request con 0x7f03fc023020 auth_method 0 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:49:31.184+0000 7f0400a5e640 0 -- 172.21.15.19:0/1445722994 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x558febe48700 msgr2=0x558febe4ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:49:31.184+0000 7f02d2ffd640 1 client.7518.objecter ms_handle_reset 0x558febe48700 session 0x558febe48080 osd.6 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:49:31.184+0000 7f02d2ffd640 10 monclient: _renew_subs 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:49:31.184+0000 7f02d2ffd640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:49:31.184+0000 7f0400a5e640 10 monclient: get_auth_request con 0x7f02cc086790 auth_method 0 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:31.381 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:31.382 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:31.382 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:49:31.188+0000 7f0403775800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:31.382 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:49:31.188+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.382 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:49:31.188+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.382 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:49:31.188+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.382 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:31.382 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.382 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:31.383 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:49:31.189+0000 7f0403775800 20 zone default found 2024-09-12T00:49:31.383 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:49:31.189+0000 7f0403775800 4 Realm: () 2024-09-12T00:49:31.383 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:49:31.189+0000 7f0403775800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:31.383 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:49:31.189+0000 7f0403775800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:31.383 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:49:31.189+0000 7f0403775800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:31.383 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:49:31.189+0000 7f0403775800 20 zonegroup default 2024-09-12T00:49:31.383 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.383 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.384 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.384 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.384 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:49:31.189+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.384 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:49:31.190+0000 7f0403775800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.384 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:49:31.190+0000 7f0403775800 20 started sync module instance, tier type = 2024-09-12T00:49:31.384 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:49:31.190+0000 7f0403775800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:31.384 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=0 2024-09-12T00:49:31.384 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=1 2024-09-12T00:49:31.384 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=2 2024-09-12T00:49:31.384 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=3 2024-09-12T00:49:31.384 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=4 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=5 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:49:31.200+0000 7f0403775800 20 add_watcher() i=6 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:49:31.202+0000 7f0403775800 20 add_watcher() i=7 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:49:31.202+0000 7f0403775800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding auth protocol: cephx 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding auth protocol: cephx 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding auth protocol: cephx 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.385 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.386 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:49:31.203+0000 7f02b7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:31.386 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.386 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.386 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.386 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.386 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: crc 2024-09-12T00:49:31.386 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:49:31.203+0000 7f0403775800 5 AuthRegistry(0x7ffce75cfb20) adding con mode: secure 2024-09-12T00:49:31.386 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:49:31.203+0000 7f0403775800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:49:31.387 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:49:31.203+0000 7f0403775800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:31.387 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:49:31.203+0000 7f0403775800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:31.387 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:49:31.203+0000 7f0403775800 5 asok(0x558febb3d630) register_command cache list hook 0x558febe1e250 2024-09-12T00:49:31.387 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:49:31.203+0000 7f0403775800 5 asok(0x558febb3d630) register_command cache inspect hook 0x558febe1e250 2024-09-12T00:49:31.387 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:49:31.203+0000 7f0403775800 5 asok(0x558febb3d630) register_command cache erase hook 0x558febe1e250 2024-09-12T00:49:31.387 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:49:31.203+0000 7f0403775800 5 asok(0x558febb3d630) register_command cache zap hook 0x558febe1e250 2024-09-12T00:49:31.388 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:49:31.203+0000 7f0403775800 5 note: GC not initialized 2024-09-12T00:49:31.388 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:49:31.204+0000 7f02b6fe5640 20 reqs_thread_entry: start 2024-09-12T00:49:31.388 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:49:31.204+0000 7f0403775800 5 asok(0x558febb3d630) register_command sync trace show hook 0x7f03fc01c070 2024-09-12T00:49:31.388 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:49:31.204+0000 7f0403775800 5 asok(0x558febb3d630) register_command sync trace history hook 0x7f03fc01c070 2024-09-12T00:49:31.388 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:49:31.204+0000 7f0403775800 5 asok(0x558febb3d630) register_command sync trace active hook 0x7f03fc01c070 2024-09-12T00:49:31.389 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:49:31.204+0000 7f0403775800 5 asok(0x558febb3d630) register_command sync trace active_short hook 0x7f03fc01c070 2024-09-12T00:49:31.389 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:49:31.204+0000 7f0403775800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:31.392 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:49:31.204+0000 7f0403775800 20 Filter name: none 2024-09-12T00:49:31.392 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:49:31.204+0000 7f02b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:31.392 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:49:31.204+0000 7f0403775800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:49:31.392 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:49:31.204+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.393 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:49:31.204+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:31.393 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:49:31.204+0000 7f0403775800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:49:31.393 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:49:31.204+0000 7f0403775800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:49:31.393 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:49:31.204+0000 7f0403775800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 : miss 2024-09-12T00:49:31.393 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:49:31.204+0000 7f0403775800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.393 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:49:31.205+0000 7f0403775800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:49:31.393 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:49:31.205+0000 7f0403775800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:49:31.394 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:49:31.205+0000 7f0403775800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:49:31.394 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:49:31.205+0000 7f0403775800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:31.394 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:49:31.205+0000 7f0403775800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:31.394 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:49:31.205+0000 7f0403775800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 2024-09-12T00:49:31.394 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:49:31.210+0000 7f0403775800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:49:31.394 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:49:31.210+0000 7f0403775800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:49:31.395 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:49:31.210+0000 7f0403775800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:31.395 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:49:31.210+0000 7f0403775800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34, ofs0, ns] 2024-09-12T00:49:31.395 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398979 cookie 94076626371392 notifier 7518 bl.length()=911 2024-09-12T00:49:31.395 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:49:31.395 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:49:31.395 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:49:31.210+0000 7f02e4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:31.395 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_sources= new_sources= 2024-09-12T00:49:31.396 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential sources added=[] removed=[] 2024-09-12T00:49:31.396 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_dests= new_dests= 2024-09-12T00:49:31.396 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:49:31.212+0000 7f0403775800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential dests added=[] removed=[] 2024-09-12T00:49:31.396 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:49:31.217+0000 7f0403775800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0403775800 time 2024-09-12T00:49:31.218910+0000 2024-09-12T00:49:31.396 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:49:31.396 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.396 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:31.396 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f0406d8c71a] 2024-09-12T00:49:31.397 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0406d8c8d8] 2024-09-12T00:49:31.397 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558feacf5641] 2024-09-12T00:49:31.397 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558fead0538a] 2024-09-12T00:49:31.397 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:49:31.397 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f0405a29590] 2024-09-12T00:49:31.397 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:49:31.398 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:49:31.398 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.398 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:49:31.218+0000 7f0403775800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:49:31.398 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f0403775800 thread_name:radosgw-admin 2024-09-12T00:49:31.398 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.398 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:49:31.398 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f0405a3e6f0] 2024-09-12T00:49:31.398 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f0405a8b99c] 2024-09-12T00:49:31.399 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:49:31.399 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:49:31.399 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f0406d8c774] 2024-09-12T00:49:31.399 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f0406d8c8d8] 2024-09-12T00:49:31.399 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x558feacf5641] 2024-09-12T00:49:31.399 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x558fead0538a] 2024-09-12T00:49:31.399 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:49:31.399 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f0405a29590] 2024-09-12T00:49:31.400 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:49:31.400 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:49:31.400 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:49:31.400 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.400 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:49:31.400 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:49:31.400 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:49:31.400 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:49:31.401 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:49:31.401 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:49:31.401 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:49:31.401 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:49:31.401 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:49:31.401 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:49:31.401 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:49:31.401 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:49:31.402 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:49:31.402 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:49:31.402 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:49:31.402 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:49:31.402 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:49:31.402 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:49:31.402 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:49:31.403 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:49:31.403 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:49:31.403 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:49:31.403 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:49:31.403 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:49:31.403 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:49:31.403 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:49:31.403 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:49:31.404 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:49:31.404 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:49:31.404 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:49:31.404 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:49:31.404 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:49:31.404 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:49:31.404 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:49:31.404 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:49:31.405 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:49:31.405 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:49:31.405 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:49:31.405 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:49:31.405 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:49:31.405 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:49:31.405 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:49:31.406 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:49:31.406 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:49:31.406 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:49:31.406 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:49:31.406 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:49:31.406 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:49:31.406 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:49:31.406 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:49:31.407 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:49:31.407 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:49:31.407 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:49:31.407 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:49:31.407 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:49:31.407 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:49:31.407 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:49:31.407 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:49:31.408 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:49:31.408 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:49:31.408 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:49:31.408 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:49:31.408 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:49:31.408 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:49:31.408 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:49:31.409 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:49:31.410 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02b4fe1640 / http_manager 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02b6fe5640 / http_manager 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02b7fe7640 / rgw_dt_lg_renew 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02d2ffd640 / ms_dispatch 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02e4ff9640 / io_context_pool 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02e6ffd640 / ms_dispatch 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02ede03640 / ms_dispatch 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 7f02ef606640 / io_context_pool 2024-09-12T00:49:31.411 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0400a5e640 / msgr-worker-2 2024-09-12T00:49:31.412 INFO:tasks.workunit.client.0.smithi019.stderr: 7f040125f640 / msgr-worker-1 2024-09-12T00:49:31.412 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0401a60640 / msgr-worker-0 2024-09-12T00:49:31.412 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0402261640 / io_context_pool 2024-09-12T00:49:31.412 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0403775800 / radosgw-admin 2024-09-12T00:49:31.412 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:49:31.412 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:49:31.412 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:49:31.220307Z_e0f45539-9e03-4e4f-ac68-70ae7d8cbb7e/log 2024-09-12T00:49:31.412 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:49:31.412 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:49:31.419 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:31.419 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:31.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.297+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.299+0000 7fd368014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.299+0000 7fd368014800 20 realm 2024-09-12T00:49:31.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.299+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.299+0000 7fd368014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.299+0000 7fd368014800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.299+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.300+0000 7fd368014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.300+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.300+0000 7fd368014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.300+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.301+0000 7fd368014800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.301+0000 7fd368014800 20 searching for the correct realm 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.306+0000 7fd362eca640 0 -- 172.21.15.19:0/1263285985 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5622b112b480 msgr2=0x5622b112d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.310+0000 7fd362eca640 0 -- 172.21.15.19:0/1263285985 >> [v2:172.21.15.135:6800/2991448734,v1:172.21.15.135:6801/2991448734] conn(0x5622b1134930 msgr2=0x5622b1136d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.313+0000 7fd368014800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:31.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.313+0000 7fd368014800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:31.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.313+0000 7fd368014800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:31.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.313+0000 7fd368014800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:31.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.313+0000 7fd368014800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:31.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.313+0000 7fd368014800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:31.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.313+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:31.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:31.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 20 zone default found 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 4 Realm: () 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 20 zonegroup default 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.314+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.315+0000 7fd368014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.315+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.315+0000 7fd368014800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.315+0000 7fd368014800 20 started sync module instance, tier type = 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.315+0000 7fd368014800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.328+0000 7fd368014800 20 add_watcher() i=0 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.328+0000 7fd368014800 20 add_watcher() i=1 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.328+0000 7fd368014800 20 add_watcher() i=2 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.328+0000 7fd368014800 20 add_watcher() i=3 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.328+0000 7fd368014800 20 add_watcher() i=4 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.328+0000 7fd368014800 20 add_watcher() i=5 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.328+0000 7fd368014800 20 add_watcher() i=6 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.329+0000 7fd368014800 20 add_watcher() i=7 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.329+0000 7fd368014800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.332+0000 7fd219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.332+0000 7fd368014800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:31.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.332+0000 7fd368014800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:31.424 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.332+0000 7fd368014800 5 note: GC not initialized 2024-09-12T00:49:31.424 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.332+0000 7fd218fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:31.424 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.332+0000 7fd368014800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:31.424 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.332+0000 7fd368014800 20 Filter name: none 2024-09-12T00:49:31.424 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.332+0000 7fd1927fc640 20 reqs_thread_entry: start 2024-09-12T00:49:31.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.333+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.333+0000 7fd368014800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:31.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.333+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.334+0000 7fd368014800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:49:31.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.334+0000 7fd368014800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:31.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.334+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.334+0000 7fd368014800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:31.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.334+0000 7fd368014800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.335+0000 7fd368014800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:49:31.425 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.335+0000 7fd368014800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:49:31.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.336+0000 7fd219fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:31.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.338+0000 7fd368014800 20 remove_watcher() i=0 2024-09-12T00:49:31.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.338+0000 7fd368014800 2 removed watcher, disabling cache 2024-09-12T00:49:31.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.339+0000 7fd368014800 20 remove_watcher() i=1 2024-09-12T00:49:31.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.341+0000 7fd368014800 20 remove_watcher() i=2 2024-09-12T00:49:31.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.342+0000 7fd368014800 20 remove_watcher() i=3 2024-09-12T00:49:31.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.343+0000 7fd368014800 20 remove_watcher() i=4 2024-09-12T00:49:31.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.345+0000 7fd368014800 20 remove_watcher() i=5 2024-09-12T00:49:31.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.345+0000 7fd368014800 20 remove_watcher() i=6 2024-09-12T00:49:31.427 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.346+0000 7fd368014800 20 remove_watcher() i=7 2024-09-12T00:49:31.427 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.427 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:49:31.427 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-do-reshard id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:49:31.427 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:49:31.428 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:31.428 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:31.428 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:49:31.428 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:49:31.448 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:49:31.482 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:49:31.482 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:49:31.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.523+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.524+0000 7f5e9792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.524+0000 7f5e9792a800 20 realm 2024-09-12T00:49:31.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.524+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.524+0000 7f5e9792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.525+0000 7f5e9792a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:49:31.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.525+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.525+0000 7f5e9792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.525+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.525+0000 7f5e9792a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:31.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.526+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.526+0000 7f5e9792a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:49:31.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.526+0000 7f5e9792a800 20 searching for the correct realm 2024-09-12T00:49:31.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.529+0000 7f5e92d60640 0 -- 172.21.15.19:0/3874768153 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f5e8803b430 msgr2=0x7f5e8803b8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:31.734 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.734+0000 7f5e93d62640 0 -- 172.21.15.19:0/3874768153 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x557913ba4590 msgr2=0x557913ba6a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:49:31.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:49:31.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:49:31.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:49:31.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:49:31.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:49:31.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:49:31.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:49:31.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:49:31.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 zone default found 2024-09-12T00:49:31.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 4 Realm: () 2024-09-12T00:49:31.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:49:31.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:49:31.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:49:31.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 zonegroup default 2024-09-12T00:49:31.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.739+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.740+0000 7f5e9792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.740+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.740+0000 7f5e9792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.740+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.740+0000 7f5e9792a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:49:31.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.740+0000 7f5e9792a800 20 started sync module instance, tier type = 2024-09-12T00:49:31.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.740+0000 7f5e9792a800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:49:31.748 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.749+0000 7f5e9792a800 20 add_watcher() i=0 2024-09-12T00:49:31.748 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.749+0000 7f5e9792a800 20 add_watcher() i=1 2024-09-12T00:49:31.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.749+0000 7f5e9792a800 20 add_watcher() i=2 2024-09-12T00:49:31.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.749+0000 7f5e9792a800 20 add_watcher() i=3 2024-09-12T00:49:31.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.749+0000 7f5e9792a800 20 add_watcher() i=4 2024-09-12T00:49:31.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.749+0000 7f5e9792a800 20 add_watcher() i=5 2024-09-12T00:49:31.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.749+0000 7f5e9792a800 20 add_watcher() i=6 2024-09-12T00:49:31.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.749+0000 7f5e9792a800 20 add_watcher() i=7 2024-09-12T00:49:31.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.749+0000 7f5e9792a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:49:31.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.751+0000 7f5d49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:31.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.751+0000 7f5e9792a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:49:31.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.751+0000 7f5e9792a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:49:31.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.751+0000 7f5e9792a800 5 note: GC not initialized 2024-09-12T00:49:31.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.752+0000 7f5d48fe1640 20 reqs_thread_entry: start 2024-09-12T00:49:31.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.752+0000 7f5e9792a800 20 init_complete bucket index max shards: 11 2024-09-12T00:49:31.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.752+0000 7f5e9792a800 20 Filter name: none 2024-09-12T00:49:31.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.752+0000 7f5cc27fc640 20 reqs_thread_entry: start 2024-09-12T00:49:31.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.752+0000 7f5e9792a800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:49:31.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.752+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.752+0000 7f5e9792a800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:49:31.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.752+0000 7f5e9792a800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:49:31.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.752+0000 7f5e9792a800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:49:31.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.752+0000 7f5e9792a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 : miss 2024-09-12T00:49:31.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.752+0000 7f5e9792a800 20 rados->read ofs=0 len=0 2024-09-12T00:49:31.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.753+0000 7f5e9792a800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:49:31.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.753+0000 7f5e9792a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:49:31.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.753+0000 7f5e9792a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:49:31.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.753+0000 7f5e9792a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:49:31.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.753+0000 7f5e9792a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:49:31.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.753+0000 7f5e9792a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 2024-09-12T00:49:31.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.754+0000 7f5e9792a800 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to be held by another RGW process; skipping for now 2024-09-12T00:49:31.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.755+0000 7f5d49fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:49:31.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.757+0000 7f5e9792a800 20 remove_watcher() i=0 2024-09-12T00:49:31.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.757+0000 7f5e9792a800 2 removed watcher, disabling cache 2024-09-12T00:49:31.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.758+0000 7f5e9792a800 20 remove_watcher() i=1 2024-09-12T00:49:31.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.759+0000 7f5e9792a800 20 remove_watcher() i=2 2024-09-12T00:49:31.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.760+0000 7f5e9792a800 20 remove_watcher() i=3 2024-09-12T00:49:31.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.761+0000 7f5e9792a800 20 remove_watcher() i=4 2024-09-12T00:49:31.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.762+0000 7f5e9792a800 20 remove_watcher() i=5 2024-09-12T00:49:31.762 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.763+0000 7f5e9792a800 20 remove_watcher() i=6 2024-09-12T00:49:31.763 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:49:31.764+0000 7f5e9792a800 20 remove_watcher() i=7 2024-09-12T00:49:31.774 INFO:tasks.workunit.client.0.smithi019.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:50:01.792 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:01.828 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:01.828 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:01.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.875+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.877+0000 7f3a7b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.877+0000 7f3a7b125800 20 realm 2024-09-12T00:50:01.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.877+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.877+0000 7f3a7b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.877+0000 7f3a7b125800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:01.876 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.877+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.877+0000 7f3a7b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.877+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.878+0000 7f3a7b125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:01.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.878+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.878+0000 7f3a7b125800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:01.877 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.878+0000 7f3a7b125800 20 searching for the correct realm 2024-09-12T00:50:01.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.882+0000 7f3a765ad640 0 -- 172.21.15.19:0/586816638 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3a6c00fbd0 msgr2=0x7f3a6c059a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:01.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.887+0000 7f3a775af640 0 -- 172.21.15.19:0/586816638 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55834f4458b0 msgr2=0x55834f447cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:01.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.892+0000 7f3a7b125800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:01.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.892+0000 7f3a7b125800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:01.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.892+0000 7f3a7b125800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:01.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.892+0000 7f3a7b125800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:01.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.892+0000 7f3a7b125800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:01.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.892+0000 7f3a7b125800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:01.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.892+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.892+0000 7f3a7b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.892+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.892+0000 7f3a7b125800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:01.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.892+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:01.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 20 zone default found 2024-09-12T00:50:01.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 4 Realm: () 2024-09-12T00:50:01.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:01.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:01.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:01.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 20 zonegroup default 2024-09-12T00:50:01.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.893+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.894+0000 7f3a7b125800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:01.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.894+0000 7f3a7b125800 20 started sync module instance, tier type = 2024-09-12T00:50:01.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.894+0000 7f3a7b125800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.903+0000 7f3a7b125800 20 add_watcher() i=0 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.903+0000 7f3a7b125800 20 add_watcher() i=1 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.903+0000 7f3a7b125800 20 add_watcher() i=2 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.903+0000 7f3a7b125800 20 add_watcher() i=3 2024-09-12T00:50:01.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.903+0000 7f3a7b125800 20 add_watcher() i=4 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.903+0000 7f3a7b125800 20 add_watcher() i=5 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.903+0000 7f3a7b125800 20 add_watcher() i=6 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.905+0000 7f3a7b125800 20 add_watcher() i=7 2024-09-12T00:50:01.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.905+0000 7f3a7b125800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:01.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.906+0000 7f392d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:01.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.907+0000 7f3a7b125800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:01.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.907+0000 7f3a7b125800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:01.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.907+0000 7f3a7b125800 5 note: GC not initialized 2024-09-12T00:50:01.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.907+0000 7f38a7fff640 20 reqs_thread_entry: start 2024-09-12T00:50:01.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.907+0000 7f3a7b125800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:01.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.907+0000 7f3a7b125800 20 Filter name: none 2024-09-12T00:50:01.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.907+0000 7f38a5ffb640 20 reqs_thread_entry: start 2024-09-12T00:50:01.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.907+0000 7f3a7b125800 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:50:01.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.907+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.908+0000 7f3a7b125800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.908+0000 7f3a7b125800 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:50:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.908+0000 7f3a7b125800 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:50:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.908+0000 7f3a7b125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 : miss 2024-09-12T00:50:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.908+0000 7f3a7b125800 20 rados->read ofs=0 len=0 2024-09-12T00:50:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.909+0000 7f3a7b125800 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:50:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.909+0000 7f3a7b125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:50:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.909+0000 7f3a7b125800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:50:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.909+0000 7f3a7b125800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:01.908 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.909+0000 7f3a7b125800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.909+0000 7f3a7b125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 2024-09-12T00:50:01.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.910+0000 7f3a7b125800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:50:01.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.917+0000 7f3a7b125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:50:01.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.917+0000 7f3a7b125800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:50:01.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.917+0000 7f3a7b125800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.917+0000 7f3a7b125800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34, ofs0, ns] 2024-09-12T00:50:01.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.918+0000 7f3959ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398980 cookie 94022459008992 notifier 7572 bl.length()=911 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.918+0000 7f3959ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.918+0000 7f3959ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.918+0000 7f3959ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.920+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_sources= new_sources= 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.920+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential sources added=[] removed=[] 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.920+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_dests= new_dests= 2024-09-12T00:50:01.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.920+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential dests added=[] removed=[] 2024-09-12T00:50:01.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.0 2024-09-12T00:50:01.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.0 2024-09-12T00:50:01.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.1 2024-09-12T00:50:01.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.1 2024-09-12T00:50:01.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.2 2024-09-12T00:50:01.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.2 2024-09-12T00:50:01.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.3 2024-09-12T00:50:01.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.3 2024-09-12T00:50:01.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.4 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.4 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.5 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.5 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.6 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.6 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.7 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.7 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.8 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.8 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.9 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.9 2024-09-12T00:50:01.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.10 2024-09-12T00:50:01.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.10 2024-09-12T00:50:01.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.11 2024-09-12T00:50:01.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2.11 2024-09-12T00:50:01.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.0 2024-09-12T00:50:01.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.1 2024-09-12T00:50:01.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.928+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2 2024-09-12T00:50:01.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.929+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.3 2024-09-12T00:50:01.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.929+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.4 2024-09-12T00:50:01.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.930+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.5 2024-09-12T00:50:01.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.931+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.6 2024-09-12T00:50:01.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.932+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.7 2024-09-12T00:50:01.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.932+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.8 2024-09-12T00:50:01.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.933+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.9 2024-09-12T00:50:01.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.934+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.10 2024-09-12T00:50:01.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.937+0000 7f3a7b125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:01.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.937+0000 7f3a7b125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 2024-09-12T00:50:01.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.938+0000 7f3a7b125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:50:01.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.938+0000 7f3a7b125800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:50:01.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.938+0000 7f3a7b125800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.938+0000 7f3a7b125800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34, ofs0, ns] 2024-09-12T00:50:01.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.939+0000 7f395a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398981 cookie 94022459008992 notifier 7572 bl.length()=911 2024-09-12T00:50:01.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.939+0000 7f395a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:50:01.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.939+0000 7f395a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:50:01.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.939+0000 7f395a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.941+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_sources= new_sources= 2024-09-12T00:50:01.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.941+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential sources added=[] removed=[] 2024-09-12T00:50:01.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.941+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_dests= new_dests= 2024-09-12T00:50:01.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.941+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential dests added=[] removed=[] 2024-09-12T00:50:01.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.943+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.0 2024-09-12T00:50:01.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.943+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.1 2024-09-12T00:50:01.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.944+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.2 2024-09-12T00:50:01.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.944+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.3 2024-09-12T00:50:01.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.944+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.4 2024-09-12T00:50:01.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.945+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.5 2024-09-12T00:50:01.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.945+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.6 2024-09-12T00:50:01.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.945+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.7 2024-09-12T00:50:01.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.946+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.8 2024-09-12T00:50:01.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.946+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.9 2024-09-12T00:50:01.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.946+0000 7f3a7b125800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34.10 2024-09-12T00:50:01.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.947+0000 7f3a7b125800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:01.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.947+0000 7f3a7b125800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 2024-09-12T00:50:01.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.948+0000 7f3a7b125800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:50:01.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.948+0000 7f3a7b125800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:50:01.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.948+0000 7f3a7b125800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.948+0000 7f3a7b125800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34, ofs0, ns] 2024-09-12T00:50:01.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.948+0000 7f3959ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398982 cookie 94022459008992 notifier 7572 bl.length()=879 2024-09-12T00:50:01.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.948+0000 7f3959ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 info.flags=0x17 2024-09-12T00:50:01.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.948+0000 7f3959ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 to cache LRU end 2024-09-12T00:50:01.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.948+0000 7f3959ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:01.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.950+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_sources= new_sources= 2024-09-12T00:50:01.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.950+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential sources added=[] removed=[] 2024-09-12T00:50:01.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.950+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): orig_dests= new_dests= 2024-09-12T00:50:01.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.950+0000 7f3a7b125800 20 handle_bi_update(): bucket=:abort-at-do-reshard[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34]): potential dests added=[] removed=[] 2024-09-12T00:50:01.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.952+0000 7f3a7b125800 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:50:01.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.954+0000 7f392d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:01.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.956+0000 7f3a7b125800 20 remove_watcher() i=0 2024-09-12T00:50:01.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.956+0000 7f3a7b125800 2 removed watcher, disabling cache 2024-09-12T00:50:01.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.957+0000 7f3a7b125800 20 remove_watcher() i=1 2024-09-12T00:50:01.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.958+0000 7f3a7b125800 20 remove_watcher() i=2 2024-09-12T00:50:01.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.959+0000 7f3a7b125800 20 remove_watcher() i=3 2024-09-12T00:50:01.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.960+0000 7f3a7b125800 20 remove_watcher() i=4 2024-09-12T00:50:01.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.962+0000 7f3a7b125800 20 remove_watcher() i=5 2024-09-12T00:50:01.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.963+0000 7f3a7b125800 20 remove_watcher() i=6 2024-09-12T00:50:01.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:01.964+0000 7f3a7b125800 20 remove_watcher() i=7 2024-09-12T00:50:01.976 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:50:02.004 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:02.005 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:02.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.045+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.047+0000 7f467ff39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.047+0000 7f467ff39800 20 realm 2024-09-12T00:50:02.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.047+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.048+0000 7f467ff39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.048+0000 7f467ff39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:02.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.048+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.048+0000 7f467ff39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.048+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.048+0000 7f467ff39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:02.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.048+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.049+0000 7f467ff39800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:02.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.049+0000 7f467ff39800 20 searching for the correct realm 2024-09-12T00:50:02.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.052+0000 7f467b3c6640 0 -- 172.21.15.19:0/1909557006 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f466405fa10 msgr2=0x7f46640676a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:02.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.258+0000 7f467c3c8640 0 -- 172.21.15.19:0/1909557006 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55eee593a170 msgr2=0x55eee593c5e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:02.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.262+0000 7f467ff39800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:02.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.262+0000 7f467ff39800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:02.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.262+0000 7f467ff39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:02.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.262+0000 7f467ff39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:02.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.262+0000 7f467ff39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:02.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.262+0000 7f467ff39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:02.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.262+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.262+0000 7f467ff39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.262+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.263+0000 7f467ff39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:02.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.263+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.263+0000 7f467ff39800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:02.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.263+0000 7f467ff39800 20 zone default found 2024-09-12T00:50:02.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.263+0000 7f467ff39800 4 Realm: () 2024-09-12T00:50:02.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.263+0000 7f467ff39800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:02.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.263+0000 7f467ff39800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:02.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.263+0000 7f467ff39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:02.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.263+0000 7f467ff39800 20 zonegroup default 2024-09-12T00:50:02.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.263+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.264+0000 7f467ff39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.264+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.264+0000 7f467ff39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.264+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.264+0000 7f467ff39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:02.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.264+0000 7f467ff39800 20 started sync module instance, tier type = 2024-09-12T00:50:02.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.264+0000 7f467ff39800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:02.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.273+0000 7f467ff39800 20 add_watcher() i=0 2024-09-12T00:50:02.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.273+0000 7f467ff39800 20 add_watcher() i=1 2024-09-12T00:50:02.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.273+0000 7f467ff39800 20 add_watcher() i=2 2024-09-12T00:50:02.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.273+0000 7f467ff39800 20 add_watcher() i=3 2024-09-12T00:50:02.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.273+0000 7f467ff39800 20 add_watcher() i=4 2024-09-12T00:50:02.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.273+0000 7f467ff39800 20 add_watcher() i=5 2024-09-12T00:50:02.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.273+0000 7f467ff39800 20 add_watcher() i=6 2024-09-12T00:50:02.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.274+0000 7f467ff39800 20 add_watcher() i=7 2024-09-12T00:50:02.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.274+0000 7f467ff39800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:02.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.276+0000 7f4531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:02.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.277+0000 7f467ff39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:02.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.277+0000 7f467ff39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:02.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.277+0000 7f467ff39800 5 note: GC not initialized 2024-09-12T00:50:02.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.277+0000 7f4530fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:02.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.277+0000 7f467ff39800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:02.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.277+0000 7f467ff39800 20 Filter name: none 2024-09-12T00:50:02.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.277+0000 7f44aa7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:02.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.277+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.278+0000 7f467ff39800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:02.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.278+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.277 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.278+0000 7f467ff39800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:02.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.278+0000 7f467ff39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:02.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.278+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.279+0000 7f467ff39800 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:50:02.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.279+0000 7f467ff39800 20 rados->read ofs=0 len=0 2024-09-12T00:50:02.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.279+0000 7f467ff39800 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:50:02.278 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.279+0000 7f467ff39800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:02.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.281+0000 7f4531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:02.282 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.283+0000 7f467ff39800 20 remove_watcher() i=0 2024-09-12T00:50:02.282 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.283+0000 7f467ff39800 2 removed watcher, disabling cache 2024-09-12T00:50:02.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.284+0000 7f467ff39800 20 remove_watcher() i=1 2024-09-12T00:50:02.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.285+0000 7f467ff39800 20 remove_watcher() i=2 2024-09-12T00:50:02.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.287+0000 7f467ff39800 20 remove_watcher() i=3 2024-09-12T00:50:02.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.288+0000 7f467ff39800 20 remove_watcher() i=4 2024-09-12T00:50:02.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.289+0000 7f467ff39800 20 remove_watcher() i=5 2024-09-12T00:50:02.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.290+0000 7f467ff39800 20 remove_watcher() i=6 2024-09-12T00:50:02.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:02.291+0000 7f467ff39800 20 remove_watcher() i=7 2024-09-12T00:50:02.301 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:02.301 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:02.301 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-do-reshard id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:50:02.302 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:02.304 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.304 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:02.322 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.322 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:02.516 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.516 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:02.654 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:50:02.654 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:02.655 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.655 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:02.705 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.705 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:02.763 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.763 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:02.801 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.801 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:02.835 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.835 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:02.869 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.869 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:02.903 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.904 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:02.938 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.938 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:02.972 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:02.972 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.011 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.011 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.047 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.048 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.082 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.083 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.117 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.117 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.151 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.151 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.185 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.185 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.219 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.220 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.254 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.254 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.288 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.289 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.323 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.323 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.357 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.357 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.391 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.391 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.426 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:03.426 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:03.462 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:50:03.491 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:03.491 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:03.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.532+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.533+0000 7f6807610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.533+0000 7f6807610800 20 realm 2024-09-12T00:50:03.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.533+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.534+0000 7f6807610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.534+0000 7f6807610800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:03.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.534+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.534+0000 7f6807610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.533 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.534+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.535+0000 7f6807610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.535+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.535+0000 7f6807610800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:03.534 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.535+0000 7f6807610800 20 searching for the correct realm 2024-09-12T00:50:03.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.538+0000 7f68025df640 0 -- 172.21.15.19:0/3494563434 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f67f8026040 msgr2=0x7f67f80849e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:03.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.542+0000 7f68035e1640 0 -- 172.21.15.19:0/3494563434 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x560d124e79d0 msgr2=0x560d124e9e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:03.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.545+0000 7f6807610800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:03.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.545+0000 7f6807610800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:03.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.545+0000 7f6807610800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:03.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.545+0000 7f6807610800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:03.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.545+0000 7f6807610800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:03.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.545+0000 7f6807610800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:03.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.545+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:03.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 20 zone default found 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 4 Realm: () 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 20 zonegroup default 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.546+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.547+0000 7f6807610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.547+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.547+0000 7f6807610800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.547+0000 7f6807610800 20 started sync module instance, tier type = 2024-09-12T00:50:03.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.547+0000 7f6807610800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:03.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.555+0000 7f6807610800 20 add_watcher() i=0 2024-09-12T00:50:03.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.555+0000 7f6807610800 20 add_watcher() i=1 2024-09-12T00:50:03.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.555+0000 7f6807610800 20 add_watcher() i=2 2024-09-12T00:50:03.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.555+0000 7f6807610800 20 add_watcher() i=3 2024-09-12T00:50:03.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.555+0000 7f6807610800 20 add_watcher() i=4 2024-09-12T00:50:03.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.555+0000 7f6807610800 20 add_watcher() i=5 2024-09-12T00:50:03.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.555+0000 7f6807610800 20 add_watcher() i=6 2024-09-12T00:50:03.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.556+0000 7f6807610800 20 add_watcher() i=7 2024-09-12T00:50:03.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.556+0000 7f6807610800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:03.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.558+0000 7f66b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.558+0000 7f6807610800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:03.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.558+0000 7f6807610800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:03.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.558+0000 7f6807610800 5 note: GC not initialized 2024-09-12T00:50:03.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.558+0000 7f6633fff640 20 reqs_thread_entry: start 2024-09-12T00:50:03.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.558+0000 7f6807610800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:03.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.558+0000 7f6807610800 20 Filter name: none 2024-09-12T00:50:03.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.558+0000 7f6631ffb640 20 reqs_thread_entry: start 2024-09-12T00:50:03.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.558+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.559+0000 7f6807610800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:03.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.559+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.560+0000 7f6807610800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:03.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.560+0000 7f6807610800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:03.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.560+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.560+0000 7f6807610800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:03.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.560+0000 7f6807610800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.560+0000 7f6807610800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:03.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.560+0000 7f6807610800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:03.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.562+0000 7f66b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.564+0000 7f6807610800 20 remove_watcher() i=0 2024-09-12T00:50:03.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.564+0000 7f6807610800 2 removed watcher, disabling cache 2024-09-12T00:50:03.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.565+0000 7f6807610800 20 remove_watcher() i=1 2024-09-12T00:50:03.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.566+0000 7f6807610800 20 remove_watcher() i=2 2024-09-12T00:50:03.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.567+0000 7f6807610800 20 remove_watcher() i=3 2024-09-12T00:50:03.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.568+0000 7f6807610800 20 remove_watcher() i=4 2024-09-12T00:50:03.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.569+0000 7f6807610800 20 remove_watcher() i=5 2024-09-12T00:50:03.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.570+0000 7f6807610800 20 remove_watcher() i=6 2024-09-12T00:50:03.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.570+0000 7f6807610800 20 remove_watcher() i=7 2024-09-12T00:50:03.581 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:03.581 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:03.581 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-logrecord-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:50:03.581 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:03.582 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:50:03.617 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:03.617 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:03.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.658+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.660+0000 7fe9d3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.660+0000 7fe9d3a13800 20 realm 2024-09-12T00:50:03.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.660+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.660+0000 7fe9d3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.660+0000 7fe9d3a13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:03.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.660+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.660+0000 7fe9d3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.660+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.661+0000 7fe9d3a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.661+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.661+0000 7fe9d3a13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:03.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.661+0000 7fe9d3a13800 20 searching for the correct realm 2024-09-12T00:50:03.664 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.665+0000 7fe9ce947640 0 -- 172.21.15.19:0/3787090548 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fe9c406ea20 msgr2=0x7fe9c406c8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:03.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.669+0000 7fe9ce947640 0 -- 172.21.15.19:0/3787090548 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55c239f284c0 msgr2=0x55c239f2a930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:03.671 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:03.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:03.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:03.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:03.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:03.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:03.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.673 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.673 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 zone default found 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 4 Realm: () 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 zonegroup default 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.673+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.674+0000 7fe9d3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.674+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.674+0000 7fe9d3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.674+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.674+0000 7fe9d3a13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.674+0000 7fe9d3a13800 20 started sync module instance, tier type = 2024-09-12T00:50:03.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.674+0000 7fe9d3a13800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:03.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.683+0000 7fe9d3a13800 20 add_watcher() i=0 2024-09-12T00:50:03.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.683+0000 7fe9d3a13800 20 add_watcher() i=1 2024-09-12T00:50:03.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.683+0000 7fe9d3a13800 20 add_watcher() i=2 2024-09-12T00:50:03.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.683+0000 7fe9d3a13800 20 add_watcher() i=3 2024-09-12T00:50:03.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.683+0000 7fe9d3a13800 20 add_watcher() i=4 2024-09-12T00:50:03.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.683+0000 7fe9d3a13800 20 add_watcher() i=5 2024-09-12T00:50:03.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.683+0000 7fe9d3a13800 20 add_watcher() i=6 2024-09-12T00:50:03.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.683+0000 7fe9d3a13800 20 add_watcher() i=7 2024-09-12T00:50:03.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.683+0000 7fe9d3a13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:03.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.685+0000 7fe885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.686+0000 7fe9d3a13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:03.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.686+0000 7fe9d3a13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:03.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.686+0000 7fe9d3a13800 5 note: GC not initialized 2024-09-12T00:50:03.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.686+0000 7fe884fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:03.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.686+0000 7fe9d3a13800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:03.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.686+0000 7fe9d3a13800 20 Filter name: none 2024-09-12T00:50:03.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.686+0000 7fe7fe7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:03.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.686+0000 7fe9d3a13800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:50:03.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.686+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.687+0000 7fe9d3a13800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:03.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.687+0000 7fe9d3a13800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:50:03.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.687+0000 7fe9d3a13800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:50:03.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.687+0000 7fe9d3a13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 : miss 2024-09-12T00:50:03.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.687+0000 7fe9d3a13800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.688+0000 7fe9d3a13800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:03.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.688+0000 7fe9d3a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:03.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.688+0000 7fe9d3a13800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:03.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.688+0000 7fe9d3a13800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:03.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.688+0000 7fe9d3a13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:03.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.688+0000 7fe9d3a13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 2024-09-12T00:50:03.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.693+0000 7fe9d3a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:03.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.693+0000 7fe9d3a13800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:03.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.693+0000 7fe9d3a13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:03.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.693+0000 7fe9d3a13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35, ofs0, ns] 2024-09-12T00:50:03.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.693+0000 7fe8b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398956 cookie 94292684262624 notifier 7136 bl.length()=923 2024-09-12T00:50:03.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.693+0000 7fe8b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:03.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.693+0000 7fe8b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:03.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.693+0000 7fe8b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:03.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.694+0000 7fe9d3a13800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): orig_sources= new_sources= 2024-09-12T00:50:03.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.694+0000 7fe9d3a13800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): potential sources added=[] removed=[] 2024-09-12T00:50:03.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.694+0000 7fe9d3a13800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): orig_dests= new_dests= 2024-09-12T00:50:03.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.694+0000 7fe9d3a13800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): potential dests added=[] removed=[] 2024-09-12T00:50:03.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.697+0000 7fe9d3a13800 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:50:03.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.697+0000 7fe9d3a13800 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:50:03.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.701+0000 7fe9d3a13800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:03.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.701+0000 7fe9d3a13800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 2024-09-12T00:50:03.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.703+0000 7fe9d3a13800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:03.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.703+0000 7fe9d3a13800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:03.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.703+0000 7fe9d3a13800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:03.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.703+0000 7fe9d3a13800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35, ofs0, ns] 2024-09-12T00:50:03.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.703+0000 7fe8b27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398957 cookie 94292684262624 notifier 7136 bl.length()=891 2024-09-12T00:50:03.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.703+0000 7fe8b27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:03.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.703+0000 7fe8b27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:03.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.703+0000 7fe8b27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:03.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.704+0000 7fe9d3a13800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): orig_sources= new_sources= 2024-09-12T00:50:03.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.704+0000 7fe9d3a13800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): potential sources added=[] removed=[] 2024-09-12T00:50:03.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.704+0000 7fe9d3a13800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): orig_dests= new_dests= 2024-09-12T00:50:03.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.704+0000 7fe9d3a13800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): potential dests added=[] removed=[] 2024-09-12T00:50:03.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.706+0000 7fe885fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:03.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.708+0000 7fe9d3a13800 20 remove_watcher() i=0 2024-09-12T00:50:03.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.708+0000 7fe9d3a13800 2 removed watcher, disabling cache 2024-09-12T00:50:03.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.709+0000 7fe9d3a13800 20 remove_watcher() i=1 2024-09-12T00:50:03.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.711+0000 7fe9d3a13800 20 remove_watcher() i=2 2024-09-12T00:50:03.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.712+0000 7fe9d3a13800 20 remove_watcher() i=3 2024-09-12T00:50:03.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.713+0000 7fe9d3a13800 20 remove_watcher() i=4 2024-09-12T00:50:03.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.714+0000 7fe9d3a13800 20 remove_watcher() i=5 2024-09-12T00:50:03.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.715+0000 7fe9d3a13800 20 remove_watcher() i=6 2024-09-12T00:50:03.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.716+0000 7fe9d3a13800 20 remove_watcher() i=7 2024-09-12T00:50:03.727 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:50:03.758 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:03.758 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:03.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.798+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.800+0000 7f5f17f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.800+0000 7f5f17f42800 20 realm 2024-09-12T00:50:03.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.800+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.800+0000 7f5f17f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.800+0000 7f5f17f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:03.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.800+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.800+0000 7f5f17f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:03.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.800+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.801+0000 7f5f17f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:03.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.801+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:03.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.801+0000 7f5f17f42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:03.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.801+0000 7f5f17f42800 20 searching for the correct realm 2024-09-12T00:50:03.803 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:03.804+0000 7f5f0bfff640 0 -- 172.21.15.19:0/974755077 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f5efc08a280 msgr2=0x7f5efc071040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.009+0000 7f5f14487640 0 -- 172.21.15.19:0/974755077 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55bf13d59a40 msgr2=0x55bf13d5be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.013+0000 7f5f17f42800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:04.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.013+0000 7f5f17f42800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:04.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.013+0000 7f5f17f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:04.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.013+0000 7f5f17f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:04.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.013+0000 7f5f17f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:04.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.013+0000 7f5f17f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:04.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.013+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:04.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 20 zone default found 2024-09-12T00:50:04.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 4 Realm: () 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 20 zonegroup default 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.014+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.015+0000 7f5f17f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.015+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.015+0000 7f5f17f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.015+0000 7f5f17f42800 20 started sync module instance, tier type = 2024-09-12T00:50:04.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.015+0000 7f5f17f42800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:04.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.024+0000 7f5f17f42800 20 add_watcher() i=0 2024-09-12T00:50:04.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.024+0000 7f5f17f42800 20 add_watcher() i=1 2024-09-12T00:50:04.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.024+0000 7f5f17f42800 20 add_watcher() i=2 2024-09-12T00:50:04.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.024+0000 7f5f17f42800 20 add_watcher() i=3 2024-09-12T00:50:04.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.024+0000 7f5f17f42800 20 add_watcher() i=4 2024-09-12T00:50:04.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.024+0000 7f5f17f42800 20 add_watcher() i=5 2024-09-12T00:50:04.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.024+0000 7f5f17f42800 20 add_watcher() i=6 2024-09-12T00:50:04.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.026+0000 7f5f17f42800 20 add_watcher() i=7 2024-09-12T00:50:04.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.026+0000 7f5f17f42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:04.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.027+0000 7f5dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.028+0000 7f5f17f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.028+0000 7f5f17f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.028+0000 7f5f17f42800 5 note: GC not initialized 2024-09-12T00:50:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.028+0000 7f5dc8fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.028+0000 7f5f17f42800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.028+0000 7f5f17f42800 20 Filter name: none 2024-09-12T00:50:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.028+0000 7f5d427fc640 20 reqs_thread_entry: start 2024-09-12T00:50:04.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.028+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.029+0000 7f5f17f42800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:04.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.029+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.029+0000 7f5f17f42800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:04.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.029+0000 7f5f17f42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:04.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.029+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.030+0000 7f5f17f42800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:04.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.030+0000 7f5f17f42800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.030+0000 7f5f17f42800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:04.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.030+0000 7f5f17f42800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:04.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.032+0000 7f5dc9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.034+0000 7f5f17f42800 20 remove_watcher() i=0 2024-09-12T00:50:04.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.034+0000 7f5f17f42800 2 removed watcher, disabling cache 2024-09-12T00:50:04.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.035+0000 7f5f17f42800 20 remove_watcher() i=1 2024-09-12T00:50:04.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.036+0000 7f5f17f42800 20 remove_watcher() i=2 2024-09-12T00:50:04.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.037+0000 7f5f17f42800 20 remove_watcher() i=3 2024-09-12T00:50:04.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.038+0000 7f5f17f42800 20 remove_watcher() i=4 2024-09-12T00:50:04.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.039+0000 7f5f17f42800 20 remove_watcher() i=5 2024-09-12T00:50:04.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.040+0000 7f5f17f42800 20 remove_watcher() i=6 2024-09-12T00:50:04.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.042+0000 7f5f17f42800 20 remove_watcher() i=7 2024-09-12T00:50:04.051 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:04.052 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:04.052 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-logrecord-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:50:04.052 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:04.053 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:04.054 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:04.083 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:04.083 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:04.143 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:04.175 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:04.175 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:04.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.216+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.217+0000 7fe657640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.217+0000 7fe657640800 20 realm 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.217+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.217+0000 7fe657640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.217+0000 7fe657640800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.217+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.217+0000 7fe657640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.217+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.218+0000 7fe657640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.218+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.218+0000 7fe657640800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:04.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.218+0000 7fe657640800 20 searching for the correct realm 2024-09-12T00:50:04.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.222+0000 7fe655932640 0 -- 172.21.15.19:0/2840654722 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7fe64c0e9c20 msgr2=0x7fe64c0649e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.226+0000 7fe655131640 0 -- 172.21.15.19:0/2840654722 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fe65001e440 msgr2=0x7fe65001e880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 zone default found 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 4 Realm: () 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 zonegroup default 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.230+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.231+0000 7fe657640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.231+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.231+0000 7fe657640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.231+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.231+0000 7fe657640800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.231+0000 7fe657640800 20 started sync module instance, tier type = 2024-09-12T00:50:04.232 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.231+0000 7fe657640800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.240+0000 7fe657640800 20 add_watcher() i=0 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.240+0000 7fe657640800 20 add_watcher() i=1 2024-09-12T00:50:04.239 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.240+0000 7fe657640800 20 add_watcher() i=2 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.240+0000 7fe657640800 20 add_watcher() i=3 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.240+0000 7fe657640800 20 add_watcher() i=4 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.240+0000 7fe657640800 20 add_watcher() i=5 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.240+0000 7fe657640800 20 add_watcher() i=6 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.241+0000 7fe657640800 20 add_watcher() i=7 2024-09-12T00:50:04.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.241+0000 7fe657640800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:04.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.243+0000 7fe50bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.243+0000 7fe657640800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.243+0000 7fe657640800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.243+0000 7fe657640800 5 note: GC not initialized 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.243+0000 7fe50afe5640 20 reqs_thread_entry: start 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.244+0000 7fe657640800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.244+0000 7fe657640800 20 Filter name: none 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.244+0000 7fe508fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:04.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.244+0000 7fe657640800 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:50:04.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.244+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.244+0000 7fe657640800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.244+0000 7fe657640800 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.244+0000 7fe657640800 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.244+0000 7fe657640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 : miss 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.244+0000 7fe657640800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.245+0000 7fe657640800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.245+0000 7fe657640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.245+0000 7fe657640800 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.245+0000 7fe657640800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:04.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.245+0000 7fe657640800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.245+0000 7fe657640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.250+0000 7fe657640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.250+0000 7fe657640800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.250+0000 7fe657640800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.250+0000 7fe657640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35, ofs0, ns] 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.251+0000 7fe527fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398958 cookie 94465755955648 notifier 7662 bl.length()=923 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.251+0000 7fe527fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.251+0000 7fe527fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:04.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.251+0000 7fe527fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.252+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): orig_sources= new_sources= 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.252+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): potential sources added=[] removed=[] 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.252+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): orig_dests= new_dests= 2024-09-12T00:50:04.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.252+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): potential dests added=[] removed=[] 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.0 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.0 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.1 2024-09-12T00:50:04.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.1 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.2 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.2 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.3 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.3 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.4 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.4 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.5 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.5 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.6 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.6 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.7 2024-09-12T00:50:04.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.7 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.8 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.8 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.9 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.9 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.10 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.10 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.11 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1.11 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.257+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.0 2024-09-12T00:50:04.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.258+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1 2024-09-12T00:50:04.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.258+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.2 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.259+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.3 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.259+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.4 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.260+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.5 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.261+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.6 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.261+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.7 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.261+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.8 2024-09-12T00:50:04.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.262+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.9 2024-09-12T00:50:04.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.262+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.10 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.265+0000 7fe657640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:04.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.265+0000 7fe657640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.267+0000 7fe657640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.267+0000 7fe657640800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:04.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.267+0000 7fe657640800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.267+0000 7fe657640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35, ofs0, ns] 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.267+0000 7fe538ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398959 cookie 94465755955648 notifier 7662 bl.length()=923 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.267+0000 7fe538ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.267+0000 7fe538ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:04.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.267+0000 7fe538ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.269+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): orig_sources= new_sources= 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.269+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): potential sources added=[] removed=[] 2024-09-12T00:50:04.267 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.269+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): orig_dests= new_dests= 2024-09-12T00:50:04.268 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.269+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): potential dests added=[] removed=[] 2024-09-12T00:50:04.269 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.271+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.0 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.271+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.1 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.272+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.2 2024-09-12T00:50:04.270 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.272+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.3 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.272+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.4 2024-09-12T00:50:04.271 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.273+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.5 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.273+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.6 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.273+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.7 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.273+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.8 2024-09-12T00:50:04.272 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.274+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.9 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.274+0000 7fe657640800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35.10 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.274+0000 7fe657640800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:04.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.274+0000 7fe657640800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 2024-09-12T00:50:04.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.276+0000 7fe657640800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.276+0000 7fe657640800 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.276+0000 7fe657640800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.276+0000 7fe657640800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35, ofs0, ns] 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.276+0000 7fe527fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398960 cookie 94465755955648 notifier 7662 bl.length()=891 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.276+0000 7fe527fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 info.flags=0x17 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.276+0000 7fe527fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 to cache LRU end 2024-09-12T00:50:04.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.276+0000 7fe527fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.277+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): orig_sources= new_sources= 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.277+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): potential sources added=[] removed=[] 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.277+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): orig_dests= new_dests= 2024-09-12T00:50:04.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.277+0000 7fe657640800 20 handle_bi_update(): bucket=:error-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35]): potential dests added=[] removed=[] 2024-09-12T00:50:04.279 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.280+0000 7fe657640800 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:50:04.281 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.282+0000 7fe50bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.284+0000 7fe657640800 20 remove_watcher() i=0 2024-09-12T00:50:04.283 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.284+0000 7fe657640800 2 removed watcher, disabling cache 2024-09-12T00:50:04.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.285+0000 7fe657640800 20 remove_watcher() i=1 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.286+0000 7fe657640800 20 remove_watcher() i=2 2024-09-12T00:50:04.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.287+0000 7fe657640800 20 remove_watcher() i=3 2024-09-12T00:50:04.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.288+0000 7fe657640800 20 remove_watcher() i=4 2024-09-12T00:50:04.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.289+0000 7fe657640800 20 remove_watcher() i=5 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.290+0000 7fe657640800 20 remove_watcher() i=6 2024-09-12T00:50:04.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.291+0000 7fe657640800 20 remove_watcher() i=7 2024-09-12T00:50:04.303 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:50:04.332 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:04.332 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:04.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.372+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.374+0000 7f5db792d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.374+0000 7f5db792d800 20 realm 2024-09-12T00:50:04.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.374+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.374+0000 7f5db792d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.374+0000 7f5db792d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:04.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.374+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.374+0000 7f5db792d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.374+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.375+0000 7f5db792d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.375+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.376+0000 7f5db792d800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:04.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.376+0000 7f5db792d800 20 searching for the correct realm 2024-09-12T00:50:04.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.379+0000 7f5db2e75640 0 -- 172.21.15.19:0/3176576021 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f5da8016400 msgr2=0x7f5da8016860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.584+0000 7f5db2e75640 0 -- 172.21.15.19:0/3176576021 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x559a708c6ad0 msgr2=0x559a708c8f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:04.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.588+0000 7f5db792d800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:04.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.588+0000 7f5db792d800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:04.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.588+0000 7f5db792d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:04.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.588+0000 7f5db792d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:04.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.588+0000 7f5db792d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:04.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.588+0000 7f5db792d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:04.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.588+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.588+0000 7f5db792d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.588+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 20 zone default found 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 4 Realm: () 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 20 zonegroup default 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.589+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.590+0000 7f5db792d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:04.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.590+0000 7f5db792d800 20 started sync module instance, tier type = 2024-09-12T00:50:04.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.590+0000 7f5db792d800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.598+0000 7f5db792d800 20 add_watcher() i=0 2024-09-12T00:50:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.598+0000 7f5db792d800 20 add_watcher() i=1 2024-09-12T00:50:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.598+0000 7f5db792d800 20 add_watcher() i=2 2024-09-12T00:50:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.598+0000 7f5db792d800 20 add_watcher() i=3 2024-09-12T00:50:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.598+0000 7f5db792d800 20 add_watcher() i=4 2024-09-12T00:50:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.598+0000 7f5db792d800 20 add_watcher() i=5 2024-09-12T00:50:04.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.598+0000 7f5db792d800 20 add_watcher() i=6 2024-09-12T00:50:04.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.599+0000 7f5db792d800 20 add_watcher() i=7 2024-09-12T00:50:04.598 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.599+0000 7f5db792d800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:04.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.602+0000 7f5c69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.602+0000 7f5db792d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.602+0000 7f5db792d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.602+0000 7f5db792d800 5 note: GC not initialized 2024-09-12T00:50:04.601 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.602+0000 7f5c68fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:04.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.602+0000 7f5db792d800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:04.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.602+0000 7f5db792d800 20 Filter name: none 2024-09-12T00:50:04.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.603+0000 7f5be27fc640 20 reqs_thread_entry: start 2024-09-12T00:50:04.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.603+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.603+0000 7f5db792d800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:04.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.603+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.604+0000 7f5db792d800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:04.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.604+0000 7f5db792d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:04.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.604+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.604+0000 7f5db792d800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:04.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.604+0000 7f5db792d800 20 rados->read ofs=0 len=0 2024-09-12T00:50:04.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.605+0000 7f5db792d800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:04.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.605+0000 7f5db792d800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:04.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.607+0000 7f5c69fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:04.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.609+0000 7f5db792d800 20 remove_watcher() i=0 2024-09-12T00:50:04.607 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.609+0000 7f5db792d800 2 removed watcher, disabling cache 2024-09-12T00:50:04.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.610+0000 7f5db792d800 20 remove_watcher() i=1 2024-09-12T00:50:04.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.611+0000 7f5db792d800 20 remove_watcher() i=2 2024-09-12T00:50:04.610 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.612+0000 7f5db792d800 20 remove_watcher() i=3 2024-09-12T00:50:04.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.613+0000 7f5db792d800 20 remove_watcher() i=4 2024-09-12T00:50:04.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.614+0000 7f5db792d800 20 remove_watcher() i=5 2024-09-12T00:50:04.613 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.614+0000 7f5db792d800 20 remove_watcher() i=6 2024-09-12T00:50:04.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:04.615+0000 7f5db792d800 20 remove_watcher() i=7 2024-09-12T00:50:04.625 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:04.625 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:04.626 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-logrecord-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:50:04.626 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:04.628 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:04.628 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:04.649 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:04.649 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:04.838 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:04.839 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:04.983 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:50:04.984 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:04.985 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:04.985 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.034 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.034 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.091 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.091 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.130 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.130 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.165 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.165 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.202 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.202 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.236 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.237 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.271 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.271 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.304 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.305 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.338 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.339 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.372 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.372 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.408 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.409 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.441 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.441 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.475 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.475 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.508 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.508 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.543 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.543 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.577 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.577 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.613 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.613 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.647 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.647 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.681 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.681 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.719 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.719 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.754 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:05.754 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:05.788 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:50:05.818 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:05.818 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:05.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.858+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.860+0000 7f2ee3031800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:05.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.860+0000 7f2ee3031800 20 realm 2024-09-12T00:50:05.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.860+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.860+0000 7f2ee3031800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:05.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.860+0000 7f2ee3031800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:05.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.860+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.861+0000 7f2ee3031800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:05.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.861+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.861+0000 7f2ee3031800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:05.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.861+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:05.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.862+0000 7f2ee3031800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:05.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.862+0000 7f2ee3031800 20 searching for the correct realm 2024-09-12T00:50:05.864 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:05.865+0000 7f2eddb8a640 0 -- 172.21.15.19:0/242207647 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f2ed40e40f0 msgr2=0x7f2ed40647e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:06.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.070+0000 7f2eddb8a640 0 -- 172.21.15.19:0/242207647 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55eece52b290 msgr2=0x55eece52d6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:06.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:06.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:06.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:06.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:06.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:06.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:06.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:06.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:06.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 zone default found 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 4 Realm: () 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 zonegroup default 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.075+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.076+0000 7f2ee3031800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.076+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.076+0000 7f2ee3031800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.076+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.076+0000 7f2ee3031800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.076+0000 7f2ee3031800 20 started sync module instance, tier type = 2024-09-12T00:50:06.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.076+0000 7f2ee3031800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:06.083 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.085+0000 7f2ee3031800 20 add_watcher() i=0 2024-09-12T00:50:06.083 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.085+0000 7f2ee3031800 20 add_watcher() i=1 2024-09-12T00:50:06.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.085+0000 7f2ee3031800 20 add_watcher() i=2 2024-09-12T00:50:06.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.085+0000 7f2ee3031800 20 add_watcher() i=3 2024-09-12T00:50:06.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.085+0000 7f2ee3031800 20 add_watcher() i=4 2024-09-12T00:50:06.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.085+0000 7f2ee3031800 20 add_watcher() i=5 2024-09-12T00:50:06.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.085+0000 7f2ee3031800 20 add_watcher() i=6 2024-09-12T00:50:06.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.086+0000 7f2ee3031800 20 add_watcher() i=7 2024-09-12T00:50:06.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.086+0000 7f2ee3031800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:06.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.088+0000 7f2d94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:06.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.088+0000 7f2ee3031800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:06.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.088+0000 7f2ee3031800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:06.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.088+0000 7f2ee3031800 5 note: GC not initialized 2024-09-12T00:50:06.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.089+0000 7f2d0f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:06.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.089+0000 7f2ee3031800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:06.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.089+0000 7f2ee3031800 20 Filter name: none 2024-09-12T00:50:06.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.089+0000 7f2d0d7fa640 20 reqs_thread_entry: start 2024-09-12T00:50:06.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.089+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.090+0000 7f2ee3031800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:06.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.090+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.090+0000 7f2ee3031800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:06.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.090+0000 7f2ee3031800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:06.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.090+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.091+0000 7f2ee3031800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:06.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.091+0000 7f2ee3031800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.091+0000 7f2ee3031800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:06.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.091+0000 7f2ee3031800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:06.092 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.093+0000 7f2d94fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:06.094 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.095+0000 7f2ee3031800 20 remove_watcher() i=0 2024-09-12T00:50:06.094 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.095+0000 7f2ee3031800 2 removed watcher, disabling cache 2024-09-12T00:50:06.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.097+0000 7f2ee3031800 20 remove_watcher() i=1 2024-09-12T00:50:06.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.098+0000 7f2ee3031800 20 remove_watcher() i=2 2024-09-12T00:50:06.098 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.099+0000 7f2ee3031800 20 remove_watcher() i=3 2024-09-12T00:50:06.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.100+0000 7f2ee3031800 20 remove_watcher() i=4 2024-09-12T00:50:06.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.101+0000 7f2ee3031800 20 remove_watcher() i=5 2024-09-12T00:50:06.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.102+0000 7f2ee3031800 20 remove_watcher() i=6 2024-09-12T00:50:06.102 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.103+0000 7f2ee3031800 20 remove_watcher() i=7 2024-09-12T00:50:06.113 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.113 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:06.113 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-logrecord-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:50:06.114 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.115 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:50:06.150 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:06.150 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:06.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.190+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.191+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.191+0000 7fc85140e800 20 realm 2024-09-12T00:50:06.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.191+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.192+0000 7fc85140e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:06.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.193+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:06.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.193+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.193+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:06.192 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.193+0000 7fc85140e800 20 searching for the correct realm 2024-09-12T00:50:06.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.197+0000 7fc84c2ca640 0 -- 172.21.15.19:0/3784146426 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc84001d940 msgr2=0x7fc84002c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:06.198 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.200+0000 7fc84cacb640 0 -- 172.21.15.19:0/3784146426 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fc844064080 msgr2=0x7fc844062af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:06.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:06.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:06.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:06.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:06.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:06.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:06.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:06.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:06.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 20 zone default found 2024-09-12T00:50:06.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 4 Realm: () 2024-09-12T00:50:06.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:06.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:06.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:06.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 20 zonegroup default 2024-09-12T00:50:06.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.206+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.206+0000 7fc85140e800 20 started sync module instance, tier type = 2024-09-12T00:50:06.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.206+0000 7fc85140e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:06.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=0 2024-09-12T00:50:06.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=1 2024-09-12T00:50:06.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=2 2024-09-12T00:50:06.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=3 2024-09-12T00:50:06.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=4 2024-09-12T00:50:06.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=5 2024-09-12T00:50:06.213 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=6 2024-09-12T00:50:06.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.215+0000 7fc85140e800 20 add_watcher() i=7 2024-09-12T00:50:06.214 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.215+0000 7fc85140e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:06.215 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.216+0000 7fc702fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:06.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.217+0000 7fc85140e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:06.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.217+0000 7fc85140e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:06.216 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.217+0000 7fc85140e800 5 note: GC not initialized 2024-09-12T00:50:06.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.217+0000 7fc701fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:06.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.217+0000 7fc85140e800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:06.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.217+0000 7fc85140e800 20 Filter name: none 2024-09-12T00:50:06.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.217+0000 7fc6737fe640 20 reqs_thread_entry: start 2024-09-12T00:50:06.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.217+0000 7fc85140e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:50:06.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.217+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.218+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:06.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.218+0000 7fc85140e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:50:06.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.218+0000 7fc85140e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:50:06.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.218+0000 7fc85140e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 : miss 2024-09-12T00:50:06.217 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.218+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.218+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:06.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.218+0000 7fc85140e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:06.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.218+0000 7fc85140e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:06.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.218+0000 7fc85140e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:06.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.218+0000 7fc85140e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:06.221 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.218+0000 7fc85140e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 2024-09-12T00:50:06.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.223+0000 7fc85140e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:06.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.223+0000 7fc85140e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:06.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.223+0000 7fc85140e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:06.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.223+0000 7fc85140e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36, ofs0, ns] 2024-09-12T00:50:06.222 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 93849943831600 notifier 7220 bl.length()=923 2024-09-12T00:50:06.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:06.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:06.223 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:06.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_sources= new_sources= 2024-09-12T00:50:06.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential sources added=[] removed=[] 2024-09-12T00:50:06.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_dests= new_dests= 2024-09-12T00:50:06.224 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential dests added=[] removed=[] 2024-09-12T00:50:06.226 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc85140e800 time 2024-09-12T00:50:06.228663+0000 2024-09-12T00:50:06.226 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:06.227 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:06.227 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc85258c71a] 2024-09-12T00:50:06.227 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc85258c8d8] 2024-09-12T00:50:06.227 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b226af641] 2024-09-12T00:50:06.227 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd8854c) [0x555b22bc254c] 2024-09-12T00:50:06.227 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b226bf31d] 2024-09-12T00:50:06.227 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc851229590] 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.228+0000 7fc85140e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc85140e800 time 2024-09-12T00:50:06.228663+0000 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc85258c71a] 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc85258c8d8] 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b226af641] 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd8854c) [0x555b22bc254c] 2024-09-12T00:50:06.228 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b226bf31d] 2024-09-12T00:50:06.229 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:50:06.229 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc851229590] 2024-09-12T00:50:06.229 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:50:06.229 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:50:06.229 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.229 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:50:06.229 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fc85140e800 thread_name:radosgw-admin 2024-09-12T00:50:06.245 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:06.245 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc85123e6f0] 2024-09-12T00:50:06.245 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc85128b99c] 2024-09-12T00:50:06.246 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:50:06.246 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:50:06.246 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc85258c774] 2024-09-12T00:50:06.246 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc85258c8d8] 2024-09-12T00:50:06.246 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b226af641] 2024-09-12T00:50:06.246 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd8854c) [0x555b22bc254c] 2024-09-12T00:50:06.246 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b226bf31d] 2024-09-12T00:50:06.247 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:50:06.247 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc851229590] 2024-09-12T00:50:06.247 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:50:06.247 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:50:06.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.229+0000 7fc85140e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:06.247 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fc85140e800 thread_name:radosgw-admin 2024-09-12T00:50:06.247 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.247 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:06.248 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc85123e6f0] 2024-09-12T00:50:06.248 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc85128b99c] 2024-09-12T00:50:06.248 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:50:06.248 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:50:06.248 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc85258c774] 2024-09-12T00:50:06.248 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc85258c8d8] 2024-09-12T00:50:06.248 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b226af641] 2024-09-12T00:50:06.248 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd8854c) [0x555b22bc254c] 2024-09-12T00:50:06.248 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b226bf31d] 2024-09-12T00:50:06.248 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:50:06.248 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc851229590] 2024-09-12T00:50:06.249 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:50:06.249 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:50:06.249 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:06.249 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.249 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:50:06.249 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:50:06.173+0000 7fc85140e800 4 set_mon_vals no callback set 2024-09-12T00:50:06.249 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:50:06.173+0000 7fc85140e800 10 monclient: shutdown 2024-09-12T00:50:06.249 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:50:06.173+0000 7fc85140e800 5 asok(0x555b245ee630) unregister_commands rotate-key 2024-09-12T00:50:06.249 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:50:06.174+0000 7fc85140e800 10 monclient: build_initial_monmap 2024-09-12T00:50:06.249 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:50:06.174+0000 7fc85140e800 1 build_initial for_mkfs: 0 2024-09-12T00:50:06.249 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:50:06.174+0000 7fc85140e800 10 monclient: monmap: 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding auth protocol: cephx 2024-09-12T00:50:06.250 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding auth protocol: cephx 2024-09-12T00:50:06.251 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding auth protocol: cephx 2024-09-12T00:50:06.251 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.251 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.251 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.251 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.251 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.251 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.251 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.251 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.251 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.251 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.252 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.252 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.252 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:50:06.174+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.252 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:50:06.174+0000 7fc85140e800 1 librados: starting msgr at 2024-09-12T00:50:06.252 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:50:06.174+0000 7fc85140e800 1 librados: starting objecter 2024-09-12T00:50:06.252 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 asok(0x555b245ee630) register_command objecter_requests hook 0x555b248407e0 2024-09-12T00:50:06.252 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:50:06.174+0000 7fc85140e800 1 librados: setting wanted keys 2024-09-12T00:50:06.252 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:50:06.174+0000 7fc85140e800 1 librados: calling monclient init 2024-09-12T00:50:06.252 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:50:06.174+0000 7fc85140e800 10 monclient: init 2024-09-12T00:50:06.252 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding auth protocol: cephx 2024-09-12T00:50:06.252 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding auth protocol: cephx 2024-09-12T00:50:06.253 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding auth protocol: cephx 2024-09-12T00:50:06.253 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.253 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.253 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.253 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.253 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.253 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.253 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.253 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.254 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.254 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.254 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.254 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.254 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:50:06.174+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.254 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:50:06.174+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.254 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:50:06.175+0000 7fc85140e800 5 asok(0x555b245ee630) register_command rotate-key hook 0x555b2480ea18 2024-09-12T00:50:06.254 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:06.254 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:50:06.254 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-c con 0x555b246c6600 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:06.254 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-b con 0x555b246c69e0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-a con 0x555b247515d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): authenticate will time out at 2272.677113s 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): get_auth_request con 0x555b246c6600 auth_method 0 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request con 0x555b247515d0 auth_method 0 2024-09-12T00:50:06.255 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.256 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.256 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.256 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.256 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.256 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.256 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.256 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.256 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.256 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:50:06.175+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request con 0x555b246c69e0 auth_method 0 2024-09-12T00:50:06.256 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:50:06.175+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.256 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:50:06.175+0000 7fc84c2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:50:06.175+0000 7fc84c2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): handle_auth_done global_id 7211 payload 824 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient: _finish_hunting 0 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:50:06.175+0000 7fc84cacb640 1 monclient: found mon.noname-c 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: dump: 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.257 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: _finish_auth 0 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: _check_auth_tickets 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:06.258 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: dump: 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:50:06.175+0000 7fc85140e800 5 monclient: authenticate success, global_id 7211 2024-09-12T00:50:06.259 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.260 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:50:06.175+0000 7fc73ae0d640 4 set_mon_vals no callback set 2024-09-12T00:50:06.260 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.260 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.260 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.260 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:50:06.175+0000 7fc85140e800 1 librados: init done 2024-09-12T00:50:06.260 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:50:06.177+0000 7fc73960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:06.260 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:50:06.177+0000 7fc73960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.260 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:50:06.177+0000 7fc73960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.260 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:50:06.177+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x7fc7340764a0 auth_method 0 2024-09-12T00:50:06.260 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:50:06.178+0000 7fc84d2cc640 10 monclient: get_auth_request con 0x555b248576f0 auth_method 0 2024-09-12T00:50:06.260 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:50:06.178+0000 7fc84cacb640 10 monclient: get_auth_request con 0x555b2485a8d0 auth_method 0 2024-09-12T00:50:06.261 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:50:06.180+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x555b2485f960 auth_method 0 2024-09-12T00:50:06.261 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:50:06.180+0000 7fc85140e800 10 monclient: build_initial_monmap 2024-09-12T00:50:06.261 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:50:06.180+0000 7fc85140e800 1 build_initial for_mkfs: 0 2024-09-12T00:50:06.261 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:50:06.180+0000 7fc85140e800 10 monclient: monmap: 2024-09-12T00:50:06.261 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:06.261 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:06.261 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:06.261 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:06.261 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:06.261 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding auth protocol: cephx 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding auth protocol: cephx 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding auth protocol: cephx 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.262 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.263 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.263 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.263 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.263 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.263 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.263 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.263 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.263 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:50:06.181+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.263 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 asok(0x555b245ee630) register_command objecter_requests cmddesc objecter_requests hook 0x555b24866e20 EEXIST 2024-09-12T00:50:06.263 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:50:06.181+0000 7fc85140e800 10 monclient: init 2024-09-12T00:50:06.263 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding auth protocol: cephx 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding auth protocol: cephx 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding auth protocol: cephx 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.264 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.265 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.265 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.265 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:50:06.181+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.265 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:50:06.181+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.265 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:50:06.182+0000 7fc85140e800 5 asok(0x555b245ee630) register_command rotate-key cmddesc rotate-key hook 0x555b248629f0 EEXIST 2024-09-12T00:50:06.265 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:06.265 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:50:06.265 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-a con 0x555b2488b140 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:06.265 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-b con 0x555b2488b520 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:06.265 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-c con 0x555b24889e50 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:06.266 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.266 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.266 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.266 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:06.266 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): authenticate will time out at 2272.684063s 2024-09-12T00:50:06.266 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): get_auth_request con 0x555b2488b140 auth_method 0 2024-09-12T00:50:06.266 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.266 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.266 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.266 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request con 0x555b24889e50 auth_method 0 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request con 0x555b2488b520 auth_method 0 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.267 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.268 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.268 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.268 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.268 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.268 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_done global_id 7214 payload 824 2024-09-12T00:50:06.268 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient: _finish_hunting 0 2024-09-12T00:50:06.268 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 1 monclient: found mon.noname-c 2024-09-12T00:50:06.268 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.268 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.268 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:06.268 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: dump: 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: _finish_auth 0 2024-09-12T00:50:06.269 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: _check_auth_tickets 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: dump: 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.270 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.271 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.271 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.271 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:50:06.182+0000 7fc84dacd640 4 set_mon_vals no callback set 2024-09-12T00:50:06.271 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:50:06.182+0000 7fc85140e800 5 monclient: authenticate success, global_id 7214 2024-09-12T00:50:06.271 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.271 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.271 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.271 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.271 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:50:06.184+0000 7fc7327fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:06.271 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:50:06.184+0000 7fc7327fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.271 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:50:06.184+0000 7fc7327fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.272 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:50:06.185+0000 7fc85140e800 10 monclient: get_monmap_and_config 2024-09-12T00:50:06.272 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:50:06.185+0000 7fc85140e800 10 monclient: build_initial_monmap 2024-09-12T00:50:06.272 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:50:06.185+0000 7fc85140e800 1 build_initial for_mkfs: 0 2024-09-12T00:50:06.272 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:50:06.185+0000 7fc85140e800 10 monclient: monmap: 2024-09-12T00:50:06.272 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:06.272 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:06.272 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:06.272 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:06.272 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:06.272 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.272 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding auth protocol: cephx 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding auth protocol: cephx 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding auth protocol: cephx 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.273 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:50:06.185+0000 7fc84cacb640 10 monclient: get_auth_request con 0x7fc724076380 auth_method 0 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:50:06.185+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:50:06.185+0000 7fc85140e800 10 monclient: init 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding auth protocol: cephx 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding auth protocol: cephx 2024-09-12T00:50:06.274 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding auth protocol: cephx 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.275 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.276 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:50:06.185+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.276 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:50:06.185+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.276 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 asok(0x555b245ee630) register_command rotate-key cmddesc rotate-key hook 0x7ffc3489e598 EEXIST 2024-09-12T00:50:06.276 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:06.276 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:50:06.276 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-b con 0x555b248df4c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:06.276 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-c con 0x555b248b0410 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:06.276 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-a con 0x555b248dad60 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:06.276 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.276 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.276 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): authenticate will time out at 2272.688057s 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request con 0x555b248b0410 auth_method 0 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request con 0x555b248dad60 auth_method 0 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.277 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.278 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.278 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.278 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.278 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.278 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:50:06.186+0000 7fc84cacb640 10 monclient(hunting): get_auth_request con 0x555b248df4c0 auth_method 0 2024-09-12T00:50:06.278 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:50:06.186+0000 7fc84cacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.278 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:50:06.186+0000 7fc84cacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.278 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:50:06.186+0000 7fc84cacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.278 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_done global_id 7217 payload 274 2024-09-12T00:50:06.278 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient: _finish_hunting 0 2024-09-12T00:50:06.278 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 1 monclient: found mon.noname-c 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: dump: 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.279 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: _finish_auth 0 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: _check_auth_tickets 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: dump: 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.280 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:50:06.186+0000 7fc85140e800 5 monclient: authenticate success, global_id 7217 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:50:06.186+0000 7fc85140e800 4 set_mon_vals no callback set 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:50:06.187+0000 7fc85140e800 10 monclient: shutdown 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:50:06.187+0000 7fc85140e800 10 monclient: build_initial_monmap 2024-09-12T00:50:06.281 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:50:06.187+0000 7fc85140e800 1 build_initial for_mkfs: 0 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:50:06.187+0000 7fc85140e800 10 monclient: monmap: 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.282 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding auth protocol: cephx 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding auth protocol: cephx 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding auth protocol: cephx 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.283 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:50:06.187+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:50:06.187+0000 7fc85140e800 1 librados: starting msgr at 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:50:06.187+0000 7fc85140e800 1 librados: starting objecter 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 asok(0x555b245ee630) register_command objecter_requests cmddesc objecter_requests hook 0x555b2488cf70 EEXIST 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:50:06.187+0000 7fc85140e800 1 librados: setting wanted keys 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:50:06.187+0000 7fc85140e800 1 librados: calling monclient init 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:50:06.187+0000 7fc85140e800 10 monclient: init 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding auth protocol: cephx 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding auth protocol: cephx 2024-09-12T00:50:06.284 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding auth protocol: cephx 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.285 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.286 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:50:06.188+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.286 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:50:06.188+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.286 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:50:06.188+0000 7fc85140e800 5 asok(0x555b245ee630) register_command rotate-key cmddesc rotate-key hook 0x555b2489fb48 EEXIST 2024-09-12T00:50:06.286 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:06.286 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:50:06.286 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-c con 0x555b248b0410 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:06.286 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-b con 0x555b248dad60 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:06.286 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-a con 0x555b248df4c0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:06.286 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.286 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): authenticate will time out at 2272.690358s 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): get_auth_request con 0x555b248b0410 auth_method 0 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request con 0x555b248df4c0 auth_method 0 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.287 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request con 0x555b248dad60 auth_method 0 2024-09-12T00:50:06.288 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.288 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.288 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.288 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.288 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.288 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.288 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.288 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.288 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.288 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.288 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): handle_auth_done global_id 7220 payload 824 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient: _finish_hunting 0 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:50:06.188+0000 7fc84cacb640 1 monclient: found mon.noname-c 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: dump: 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.289 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.290 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.290 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.290 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.290 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.290 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.290 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.290 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: _finish_auth 0 2024-09-12T00:50:06.290 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: _check_auth_tickets 2024-09-12T00:50:06.290 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:06.290 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.291 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:06.291 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: dump: 2024-09-12T00:50:06.291 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.291 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.291 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.291 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.291 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.291 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.291 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.291 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.291 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.292 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.292 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:50:06.189+0000 7fc85140e800 5 monclient: authenticate success, global_id 7220 2024-09-12T00:50:06.292 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:50:06.189+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.292 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:50:06.189+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.292 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:50:06.188+0000 7fc723fff640 4 set_mon_vals no callback set 2024-09-12T00:50:06.292 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:50:06.189+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.292 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:50:06.189+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.292 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:50:06.189+0000 7fc85140e800 1 librados: init done 2024-09-12T00:50:06.292 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:50:06.189+0000 7fc85140e800 5 asok(0x555b245ee630) register_command cr dump hook 0x7fc84000ff98 2024-09-12T00:50:06.292 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:50:06.190+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.292 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:50:06.190+0000 7fc7227fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:50:06.190+0000 7fc7227fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:50:06.190+0000 7fc7227fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:50:06.191+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x7fc718076470 auth_method 0 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:50:06.191+0000 7fc84d2cc640 10 monclient: get_auth_request con 0x555b248f9060 auth_method 0 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:50:06.191+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:50:06.191+0000 7fc85140e800 20 realm 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:50:06.191+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:50:06.192+0000 7fc85140e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.293 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.294 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:50:06.192+0000 7fc84cacb640 10 monclient: get_auth_request con 0x555b248fd2f0 auth_method 0 2024-09-12T00:50:06.294 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:50:06.193+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:06.294 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:50:06.193+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.294 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:50:06.193+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:06.294 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:50:06.193+0000 7fc85140e800 20 searching for the correct realm 2024-09-12T00:50:06.294 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:50:06.193+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x555b24902590 auth_method 0 2024-09-12T00:50:06.294 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:50:06.194+0000 7fc84d2cc640 10 monclient: get_auth_request con 0x7fc840010440 auth_method 0 2024-09-12T00:50:06.294 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:50:06.195+0000 7fc84cacb640 10 monclient: get_auth_request con 0x7fc83c075060 auth_method 0 2024-09-12T00:50:06.294 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:50:06.196+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x7fc84001d940 auth_method 0 2024-09-12T00:50:06.294 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:50:06.197+0000 7fc84c2ca640 0 -- 172.21.15.19:0/3784146426 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc84001d940 msgr2=0x7fc84002c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:06.295 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:50:06.197+0000 7fc7227fc640 1 client.7220.objecter ms_handle_reset 0x7fc84001d940 session 0x7fc840036e00 osd.5 2024-09-12T00:50:06.295 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:50:06.197+0000 7fc7227fc640 10 monclient: _renew_subs 2024-09-12T00:50:06.295 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:50:06.197+0000 7fc7227fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.295 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:50:06.197+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x7fc718086710 auth_method 0 2024-09-12T00:50:06.295 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:50:06.198+0000 7fc84d2cc640 10 monclient: get_auth_request con 0x7fc83c007e80 auth_method 0 2024-09-12T00:50:06.295 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:50:06.199+0000 7fc84cacb640 10 monclient: get_auth_request con 0x7fc844064080 auth_method 0 2024-09-12T00:50:06.295 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:50:06.200+0000 7fc84cacb640 0 -- 172.21.15.19:0/3784146426 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fc844064080 msgr2=0x7fc844062af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:06.295 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:50:06.200+0000 7fc7227fc640 1 client.7220.objecter ms_handle_reset 0x7fc844064080 session 0x7fc84406d080 osd.3 2024-09-12T00:50:06.295 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:50:06.200+0000 7fc84cacb640 10 monclient: get_auth_request con 0x7fc84001d940 auth_method 0 2024-09-12T00:50:06.295 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:06.296 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:06.296 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:06.296 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:06.296 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:06.296 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:06.296 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.296 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.296 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.296 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:06.296 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.296 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:06.297 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 zone default found 2024-09-12T00:50:06.297 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:50:06.205+0000 7fc85140e800 4 Realm: () 2024-09-12T00:50:06.297 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:50:06.205+0000 7fc85140e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:06.297 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:50:06.205+0000 7fc85140e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:06.297 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:50:06.205+0000 7fc85140e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:06.297 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 zonegroup default 2024-09-12T00:50:06.297 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.297 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.297 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.297 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.298 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.298 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:50:06.206+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.298 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:50:06.206+0000 7fc85140e800 20 started sync module instance, tier type = 2024-09-12T00:50:06.298 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:50:06.206+0000 7fc85140e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:06.298 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=0 2024-09-12T00:50:06.298 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=1 2024-09-12T00:50:06.298 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=2 2024-09-12T00:50:06.298 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=3 2024-09-12T00:50:06.298 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=4 2024-09-12T00:50:06.298 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=5 2024-09-12T00:50:06.299 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=6 2024-09-12T00:50:06.299 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:50:06.215+0000 7fc85140e800 20 add_watcher() i=7 2024-09-12T00:50:06.299 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:50:06.215+0000 7fc85140e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:06.299 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding auth protocol: cephx 2024-09-12T00:50:06.299 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding auth protocol: cephx 2024-09-12T00:50:06.299 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding auth protocol: cephx 2024-09-12T00:50:06.299 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.299 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.299 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.299 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.300 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.300 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.300 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.300 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.300 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.300 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.300 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.300 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.300 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:50:06.216+0000 7fc702fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:06.300 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:50:06.217+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.300 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:50:06.217+0000 7fc85140e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:06.301 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:50:06.217+0000 7fc85140e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:06.301 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command cache list hook 0x555b248d4370 2024-09-12T00:50:06.301 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command cache inspect hook 0x555b248d4370 2024-09-12T00:50:06.301 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command cache erase hook 0x555b248d4370 2024-09-12T00:50:06.301 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command cache zap hook 0x555b248d4370 2024-09-12T00:50:06.301 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 note: GC not initialized 2024-09-12T00:50:06.301 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:50:06.217+0000 7fc701fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:06.301 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command sync trace show hook 0x7fc8400164d0 2024-09-12T00:50:06.301 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command sync trace history hook 0x7fc8400164d0 2024-09-12T00:50:06.301 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command sync trace active hook 0x7fc8400164d0 2024-09-12T00:50:06.301 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command sync trace active_short hook 0x7fc8400164d0 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:50:06.217+0000 7fc85140e800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:50:06.217+0000 7fc85140e800 20 Filter name: none 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:50:06.217+0000 7fc6737fe640 20 reqs_thread_entry: start 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:50:06.217+0000 7fc85140e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:50:06.217+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:50:06.218+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 : miss 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:50:06.218+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:50:06.218+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:06.302 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:50:06.223+0000 7fc85140e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:50:06.223+0000 7fc85140e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:50:06.223+0000 7fc85140e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:50:06.223+0000 7fc85140e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36, ofs0, ns] 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 93849943831600 notifier 7220 bl.length()=923 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:06.303 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:06.304 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_sources= new_sources= 2024-09-12T00:50:06.304 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential sources added=[] removed=[] 2024-09-12T00:50:06.304 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_dests= new_dests= 2024-09-12T00:50:06.304 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential dests added=[] removed=[] 2024-09-12T00:50:06.304 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:50:06.228+0000 7fc85140e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc85140e800 time 2024-09-12T00:50:06.228663+0000 2024-09-12T00:50:06.304 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:06.304 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.304 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:06.304 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc85258c71a] 2024-09-12T00:50:06.304 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc85258c8d8] 2024-09-12T00:50:06.304 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b226af641] 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd8854c) [0x555b22bc254c] 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b226bf31d] 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc851229590] 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:50:06.229+0000 7fc85140e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fc85140e800 thread_name:radosgw-admin 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:06.305 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc85123e6f0] 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc85128b99c] 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc85258c774] 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc85258c8d8] 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b226af641] 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd8854c) [0x555b22bc254c] 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b226bf31d] 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc851229590] 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:50:06.306 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:06.307 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:06.308 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:50:06.309 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:50:06.310 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:50:06.311 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:50:06.312 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:50:06.312 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:50:06.312 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:50:06.312 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:50:06.312 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:50:06.312 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:50:06.312 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:50:06.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:50:06.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:06.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:06.312 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:06.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:50:06.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:06.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:06.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:06.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:06.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:50:06.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:06.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:06.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:06.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:06.313 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:06.314 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:06.315 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:06.315 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc6737fe640 / http_manager 2024-09-12T00:50:06.315 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc701fe3640 / http_manager 2024-09-12T00:50:06.315 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc702fe5640 / rgw_dt_lg_renew 2024-09-12T00:50:06.315 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc7227fc640 / ms_dispatch 2024-09-12T00:50:06.315 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc723fff640 / io_context_pool 2024-09-12T00:50:06.315 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc7327fc640 / ms_dispatch 2024-09-12T00:50:06.315 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc73960a640 / ms_dispatch 2024-09-12T00:50:06.315 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc73ae0d640 / io_context_pool 2024-09-12T00:50:06.315 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc84c2ca640 / msgr-worker-2 2024-09-12T00:50:06.316 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc84cacb640 / msgr-worker-1 2024-09-12T00:50:06.316 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc84d2cc640 / msgr-worker-0 2024-09-12T00:50:06.316 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc84dacd640 / io_context_pool 2024-09-12T00:50:06.316 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc85140e800 / radosgw-admin 2024-09-12T00:50:06.316 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:50:06.316 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:50:06.316 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.133485.log 2024-09-12T00:50:06.316 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:50:06.316 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:50:06.316 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:50:06.173+0000 7fc85140e800 4 set_mon_vals no callback set 2024-09-12T00:50:06.316 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:50:06.173+0000 7fc85140e800 10 monclient: shutdown 2024-09-12T00:50:06.317 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:50:06.173+0000 7fc85140e800 5 asok(0x555b245ee630) unregister_commands rotate-key 2024-09-12T00:50:06.317 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:50:06.174+0000 7fc85140e800 10 monclient: build_initial_monmap 2024-09-12T00:50:06.317 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:50:06.174+0000 7fc85140e800 1 build_initial for_mkfs: 0 2024-09-12T00:50:06.317 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:50:06.174+0000 7fc85140e800 10 monclient: monmap: 2024-09-12T00:50:06.317 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:06.317 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:06.317 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:06.317 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:06.317 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:06.317 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.317 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:06.318 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:06.318 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:06.318 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.318 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding auth protocol: cephx 2024-09-12T00:50:06.318 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding auth protocol: cephx 2024-09-12T00:50:06.318 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding auth protocol: cephx 2024-09-12T00:50:06.318 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.318 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.318 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.318 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.319 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.319 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.319 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.319 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.319 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.319 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.319 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: crc 2024-09-12T00:50:06.319 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b24810bd0) adding con mode: secure 2024-09-12T00:50:06.319 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:50:06.174+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.319 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:50:06.174+0000 7fc85140e800 1 librados: starting msgr at 2024-09-12T00:50:06.319 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:50:06.174+0000 7fc85140e800 1 librados: starting objecter 2024-09-12T00:50:06.320 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 asok(0x555b245ee630) register_command objecter_requests hook 0x555b248407e0 2024-09-12T00:50:06.320 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:50:06.174+0000 7fc85140e800 1 librados: setting wanted keys 2024-09-12T00:50:06.320 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:50:06.174+0000 7fc85140e800 1 librados: calling monclient init 2024-09-12T00:50:06.320 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:50:06.174+0000 7fc85140e800 10 monclient: init 2024-09-12T00:50:06.320 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding auth protocol: cephx 2024-09-12T00:50:06.320 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding auth protocol: cephx 2024-09-12T00:50:06.320 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding auth protocol: cephx 2024-09-12T00:50:06.320 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.320 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.320 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.320 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: crc 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:50:06.174+0000 7fc85140e800 5 AuthRegistry(0x555b2480e8d0) adding con mode: secure 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:50:06.174+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:50:06.174+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:50:06.175+0000 7fc85140e800 5 asok(0x555b245ee630) register_command rotate-key hook 0x555b2480ea18 2024-09-12T00:50:06.321 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:06.322 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:50:06.322 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-c con 0x555b246c6600 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:06.322 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-b con 0x555b246c69e0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:06.322 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-a con 0x555b247515d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:06.322 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.322 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.322 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.322 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:06.322 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient(hunting): authenticate will time out at 2272.677113s 2024-09-12T00:50:06.322 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): get_auth_request con 0x555b246c6600 auth_method 0 2024-09-12T00:50:06.322 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.323 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.323 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.323 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request con 0x555b247515d0 auth_method 0 2024-09-12T00:50:06.323 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.323 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.323 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.323 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.323 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.323 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.323 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.323 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:50:06.175+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:50:06.175+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request con 0x555b246c69e0 auth_method 0 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:50:06.175+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:50:06.175+0000 7fc84c2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:50:06.175+0000 7fc84c2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient(hunting): handle_auth_done global_id 7211 payload 824 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient: _finish_hunting 0 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:50:06.175+0000 7fc84cacb640 1 monclient: found mon.noname-c 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:50:06.175+0000 7fc84cacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:06.324 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: dump: 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: _finish_auth 0 2024-09-12T00:50:06.325 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: _check_auth_tickets 2024-09-12T00:50:06.326 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:06.326 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.326 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:06.326 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:50:06.175+0000 7fc73960a640 10 monclient: dump: 2024-09-12T00:50:06.326 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.326 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.326 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.326 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.326 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.326 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.326 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.327 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.327 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.327 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.327 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:50:06.175+0000 7fc85140e800 5 monclient: authenticate success, global_id 7211 2024-09-12T00:50:06.327 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.327 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:50:06.175+0000 7fc73ae0d640 4 set_mon_vals no callback set 2024-09-12T00:50:06.327 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.327 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.327 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:50:06.175+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.327 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:50:06.175+0000 7fc85140e800 1 librados: init done 2024-09-12T00:50:06.328 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:50:06.177+0000 7fc73960a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:06.328 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:50:06.177+0000 7fc73960a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.328 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:50:06.177+0000 7fc73960a640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.328 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:50:06.177+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x7fc7340764a0 auth_method 0 2024-09-12T00:50:06.328 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:50:06.178+0000 7fc84d2cc640 10 monclient: get_auth_request con 0x555b248576f0 auth_method 0 2024-09-12T00:50:06.328 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:50:06.178+0000 7fc84cacb640 10 monclient: get_auth_request con 0x555b2485a8d0 auth_method 0 2024-09-12T00:50:06.328 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:50:06.180+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x555b2485f960 auth_method 0 2024-09-12T00:50:06.328 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:50:06.180+0000 7fc85140e800 10 monclient: build_initial_monmap 2024-09-12T00:50:06.329 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:50:06.180+0000 7fc85140e800 1 build_initial for_mkfs: 0 2024-09-12T00:50:06.329 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:50:06.180+0000 7fc85140e800 10 monclient: monmap: 2024-09-12T00:50:06.329 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:06.329 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:06.329 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:06.329 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:06.329 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:06.329 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.329 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding auth protocol: cephx 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding auth protocol: cephx 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding auth protocol: cephx 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.330 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.331 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.331 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.331 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.331 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.331 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: crc 2024-09-12T00:50:06.331 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:50:06.180+0000 7fc85140e800 5 AuthRegistry(0x555b248638f0) adding con mode: secure 2024-09-12T00:50:06.331 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:50:06.181+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.331 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 asok(0x555b245ee630) register_command objecter_requests cmddesc objecter_requests hook 0x555b24866e20 EEXIST 2024-09-12T00:50:06.331 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:50:06.181+0000 7fc85140e800 10 monclient: init 2024-09-12T00:50:06.331 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding auth protocol: cephx 2024-09-12T00:50:06.331 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding auth protocol: cephx 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding auth protocol: cephx 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.332 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: crc 2024-09-12T00:50:06.333 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:50:06.181+0000 7fc85140e800 5 AuthRegistry(0x555b248628a8) adding con mode: secure 2024-09-12T00:50:06.333 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:50:06.181+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.333 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:50:06.181+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.333 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:50:06.182+0000 7fc85140e800 5 asok(0x555b245ee630) register_command rotate-key cmddesc rotate-key hook 0x555b248629f0 EEXIST 2024-09-12T00:50:06.333 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:06.333 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:50:06.333 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-a con 0x555b2488b140 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:06.333 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-b con 0x555b2488b520 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:06.333 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-c con 0x555b24889e50 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:06.333 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.333 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient(hunting): authenticate will time out at 2272.684063s 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): get_auth_request con 0x555b2488b140 auth_method 0 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request con 0x555b24889e50 auth_method 0 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.334 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request con 0x555b2488b520 auth_method 0 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:50:06.182+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.335 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:50:06.182+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_done global_id 7214 payload 824 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient: _finish_hunting 0 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 1 monclient: found mon.noname-c 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:50:06.182+0000 7fc84d2cc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: dump: 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.336 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: _finish_auth 0 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: _check_auth_tickets 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:50:06.182+0000 7fc7327fc640 10 monclient: dump: 2024-09-12T00:50:06.337 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:50:06.182+0000 7fc84dacd640 4 set_mon_vals no callback set 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:50:06.182+0000 7fc85140e800 5 monclient: authenticate success, global_id 7214 2024-09-12T00:50:06.338 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:50:06.182+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:50:06.184+0000 7fc7327fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:50:06.184+0000 7fc7327fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:50:06.184+0000 7fc7327fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:50:06.185+0000 7fc85140e800 10 monclient: get_monmap_and_config 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:50:06.185+0000 7fc85140e800 10 monclient: build_initial_monmap 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:50:06.185+0000 7fc85140e800 1 build_initial for_mkfs: 0 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:50:06.185+0000 7fc85140e800 10 monclient: monmap: 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:06.339 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:06.340 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:06.340 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:06.340 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:06.340 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.340 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:06.340 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:06.340 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:06.340 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.340 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding auth protocol: cephx 2024-09-12T00:50:06.340 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding auth protocol: cephx 2024-09-12T00:50:06.340 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding auth protocol: cephx 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: crc 2024-09-12T00:50:06.341 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x555b248aaeb0) adding con mode: secure 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:50:06.185+0000 7fc84cacb640 10 monclient: get_auth_request con 0x7fc724076380 auth_method 0 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:50:06.185+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:50:06.185+0000 7fc85140e800 10 monclient: init 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding auth protocol: cephx 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding auth protocol: cephx 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding auth protocol: cephx 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.342 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: crc 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e450) adding con mode: secure 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:50:06.185+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:50:06.185+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:50:06.185+0000 7fc85140e800 5 asok(0x555b245ee630) register_command rotate-key cmddesc rotate-key hook 0x7ffc3489e598 EEXIST 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:50:06.343 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-b con 0x555b248df4c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:06.344 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-c con 0x555b248b0410 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:06.344 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-a con 0x555b248dad60 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:06.344 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.344 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.344 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.344 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:06.344 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient(hunting): authenticate will time out at 2272.688057s 2024-09-12T00:50:06.344 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request con 0x555b248b0410 auth_method 0 2024-09-12T00:50:06.344 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.344 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.344 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request con 0x555b248dad60 auth_method 0 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:50:06.186+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:50:06.186+0000 7fc84cacb640 10 monclient(hunting): get_auth_request con 0x555b248df4c0 auth_method 0 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:50:06.186+0000 7fc84cacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.345 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:50:06.186+0000 7fc84cacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:50:06.186+0000 7fc84cacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_done global_id 7217 payload 274 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient: _finish_hunting 0 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 1 monclient: found mon.noname-c 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:50:06.186+0000 7fc84c2ca640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: dump: 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.346 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: _finish_auth 0 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: _check_auth_tickets 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:06.347 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:50:06.186+0000 7fc723fff640 10 monclient: dump: 2024-09-12T00:50:06.348 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.348 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.348 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.348 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.348 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.348 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.348 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.348 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.348 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.348 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.348 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:50:06.186+0000 7fc85140e800 5 monclient: authenticate success, global_id 7217 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:50:06.186+0000 7fc85140e800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:50:06.186+0000 7fc85140e800 4 set_mon_vals no callback set 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:50:06.187+0000 7fc85140e800 10 monclient: shutdown 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:50:06.187+0000 7fc85140e800 10 monclient: build_initial_monmap 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:50:06.187+0000 7fc85140e800 1 build_initial for_mkfs: 0 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:50:06.187+0000 7fc85140e800 10 monclient: monmap: 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:06.349 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding auth protocol: cephx 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding auth protocol: cephx 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding auth protocol: cephx 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.350 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: crc 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b248db690) adding con mode: secure 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:50:06.187+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:50:06.187+0000 7fc85140e800 1 librados: starting msgr at 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:50:06.187+0000 7fc85140e800 1 librados: starting objecter 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 asok(0x555b245ee630) register_command objecter_requests cmddesc objecter_requests hook 0x555b2488cf70 EEXIST 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:50:06.187+0000 7fc85140e800 1 librados: setting wanted keys 2024-09-12T00:50:06.351 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:50:06.187+0000 7fc85140e800 1 librados: calling monclient init 2024-09-12T00:50:06.352 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:50:06.187+0000 7fc85140e800 10 monclient: init 2024-09-12T00:50:06.352 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding auth protocol: cephx 2024-09-12T00:50:06.352 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding auth protocol: cephx 2024-09-12T00:50:06.352 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding auth protocol: cephx 2024-09-12T00:50:06.352 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.352 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.352 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.352 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.352 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.352 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.352 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: crc 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:50:06.187+0000 7fc85140e800 5 AuthRegistry(0x555b2489fa00) adding con mode: secure 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:50:06.188+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:50:06.188+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:50:06.188+0000 7fc85140e800 5 asok(0x555b245ee630) register_command rotate-key cmddesc rotate-key hook 0x555b2489fb48 EEXIST 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-c con 0x555b248b0410 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:06.353 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-b con 0x555b248dad60 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): picked mon.noname-a con 0x555b248df4c0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:50:06.188+0000 7fc85140e800 10 monclient(hunting): authenticate will time out at 2272.690358s 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): get_auth_request con 0x555b248b0410 auth_method 0 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request con 0x555b248df4c0 auth_method 0 2024-09-12T00:50:06.354 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.355 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.355 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.355 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request con 0x555b248dad60 auth_method 0 2024-09-12T00:50:06.355 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:06.355 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:06.355 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:06.355 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.355 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.355 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.355 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.355 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:50:06.188+0000 7fc84d2cc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:50:06.188+0000 7fc84c2ca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient(hunting): handle_auth_done global_id 7220 payload 824 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient: _finish_hunting 0 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:50:06.188+0000 7fc84cacb640 1 monclient: found mon.noname-c 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:50:06.188+0000 7fc84cacb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: dump: 2024-09-12T00:50:06.356 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.357 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.357 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.357 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: _finish_auth 0 2024-09-12T00:50:06.357 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: _check_auth_tickets 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:50:06.188+0000 7fc7227fc640 10 monclient: dump: 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:06.358 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:50:06.189+0000 7fc85140e800 5 monclient: authenticate success, global_id 7220 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:50:06.189+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:50:06.189+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:50:06.188+0000 7fc723fff640 4 set_mon_vals no callback set 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:50:06.189+0000 7fc85140e800 10 monclient: _renew_subs 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:50:06.189+0000 7fc85140e800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:50:06.189+0000 7fc85140e800 1 librados: init done 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:50:06.189+0000 7fc85140e800 5 asok(0x555b245ee630) register_command cr dump hook 0x7fc84000ff98 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:50:06.190+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:50:06.190+0000 7fc7227fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:06.359 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:50:06.190+0000 7fc7227fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.360 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:50:06.190+0000 7fc7227fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:06.360 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:50:06.191+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x7fc718076470 auth_method 0 2024-09-12T00:50:06.360 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:50:06.191+0000 7fc84d2cc640 10 monclient: get_auth_request con 0x555b248f9060 auth_method 0 2024-09-12T00:50:06.360 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:50:06.191+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.360 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:50:06.191+0000 7fc85140e800 20 realm 2024-09-12T00:50:06.360 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:50:06.191+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.360 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.360 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:50:06.192+0000 7fc85140e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:06.360 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.360 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.360 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:50:06.192+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.361 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:50:06.192+0000 7fc84cacb640 10 monclient: get_auth_request con 0x555b248fd2f0 auth_method 0 2024-09-12T00:50:06.361 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:50:06.193+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:06.361 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:50:06.193+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.361 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:50:06.193+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:06.361 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:50:06.193+0000 7fc85140e800 20 searching for the correct realm 2024-09-12T00:50:06.361 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:50:06.193+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x555b24902590 auth_method 0 2024-09-12T00:50:06.361 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:50:06.194+0000 7fc84d2cc640 10 monclient: get_auth_request con 0x7fc840010440 auth_method 0 2024-09-12T00:50:06.361 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:50:06.195+0000 7fc84cacb640 10 monclient: get_auth_request con 0x7fc83c075060 auth_method 0 2024-09-12T00:50:06.361 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:50:06.196+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x7fc84001d940 auth_method 0 2024-09-12T00:50:06.361 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:50:06.197+0000 7fc84c2ca640 0 -- 172.21.15.19:0/3784146426 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc84001d940 msgr2=0x7fc84002c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:06.361 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:50:06.197+0000 7fc7227fc640 1 client.7220.objecter ms_handle_reset 0x7fc84001d940 session 0x7fc840036e00 osd.5 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:50:06.197+0000 7fc7227fc640 10 monclient: _renew_subs 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:50:06.197+0000 7fc7227fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:50:06.197+0000 7fc84c2ca640 10 monclient: get_auth_request con 0x7fc718086710 auth_method 0 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:50:06.198+0000 7fc84d2cc640 10 monclient: get_auth_request con 0x7fc83c007e80 auth_method 0 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:50:06.199+0000 7fc84cacb640 10 monclient: get_auth_request con 0x7fc844064080 auth_method 0 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:50:06.200+0000 7fc84cacb640 0 -- 172.21.15.19:0/3784146426 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fc844064080 msgr2=0x7fc844062af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:50:06.200+0000 7fc7227fc640 1 client.7220.objecter ms_handle_reset 0x7fc844064080 session 0x7fc84406d080 osd.3 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:50:06.200+0000 7fc84cacb640 10 monclient: get_auth_request con 0x7fc84001d940 auth_method 0 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:06.362 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:50:06.204+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 zone default found 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:50:06.205+0000 7fc85140e800 4 Realm: () 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:50:06.205+0000 7fc85140e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:06.363 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:50:06.205+0000 7fc85140e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:06.364 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:50:06.205+0000 7fc85140e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:06.364 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 zonegroup default 2024-09-12T00:50:06.364 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.364 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.364 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.364 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.364 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:50:06.205+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.364 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:50:06.206+0000 7fc85140e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.364 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:50:06.206+0000 7fc85140e800 20 started sync module instance, tier type = 2024-09-12T00:50:06.364 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:50:06.206+0000 7fc85140e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=0 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=1 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=2 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=3 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=4 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=5 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:50:06.214+0000 7fc85140e800 20 add_watcher() i=6 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:50:06.215+0000 7fc85140e800 20 add_watcher() i=7 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:50:06.215+0000 7fc85140e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding auth protocol: cephx 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding auth protocol: cephx 2024-09-12T00:50:06.365 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding auth protocol: cephx 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: crc 2024-09-12T00:50:06.366 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:50:06.216+0000 7fc85140e800 5 AuthRegistry(0x7ffc3489e930) adding con mode: secure 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:50:06.216+0000 7fc702fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:50:06.217+0000 7fc85140e800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:50:06.217+0000 7fc85140e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:50:06.217+0000 7fc85140e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command cache list hook 0x555b248d4370 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command cache inspect hook 0x555b248d4370 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command cache erase hook 0x555b248d4370 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command cache zap hook 0x555b248d4370 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 note: GC not initialized 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:50:06.217+0000 7fc701fe3640 20 reqs_thread_entry: start 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command sync trace show hook 0x7fc8400164d0 2024-09-12T00:50:06.367 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command sync trace history hook 0x7fc8400164d0 2024-09-12T00:50:06.368 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command sync trace active hook 0x7fc8400164d0 2024-09-12T00:50:06.368 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:50:06.217+0000 7fc85140e800 5 asok(0x555b245ee630) register_command sync trace active_short hook 0x7fc8400164d0 2024-09-12T00:50:06.368 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:50:06.217+0000 7fc85140e800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:06.368 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:50:06.217+0000 7fc85140e800 20 Filter name: none 2024-09-12T00:50:06.368 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:50:06.217+0000 7fc6737fe640 20 reqs_thread_entry: start 2024-09-12T00:50:06.368 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:50:06.217+0000 7fc85140e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:50:06.368 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:50:06.217+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.368 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:50:06.218+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:06.368 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:50:06.368 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:50:06.368 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 : miss 2024-09-12T00:50:06.369 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:50:06.218+0000 7fc85140e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.369 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:50:06.218+0000 7fc85140e800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:06.369 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:06.369 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:06.369 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:06.369 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:06.369 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:50:06.218+0000 7fc85140e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 2024-09-12T00:50:06.369 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:50:06.223+0000 7fc85140e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:06.369 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:50:06.223+0000 7fc85140e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:50:06.223+0000 7fc85140e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:50:06.223+0000 7fc85140e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36, ofs0, ns] 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 93849943831600 notifier 7220 bl.length()=923 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:50:06.223+0000 7fc723fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_sources= new_sources= 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential sources added=[] removed=[] 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_dests= new_dests= 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:50:06.225+0000 7fc85140e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential dests added=[] removed=[] 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:50:06.228+0000 7fc85140e800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc85140e800 time 2024-09-12T00:50:06.228663+0000 2024-09-12T00:50:06.370 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:06.371 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.371 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:06.371 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7fc85258c71a] 2024-09-12T00:50:06.371 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc85258c8d8] 2024-09-12T00:50:06.371 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b226af641] 2024-09-12T00:50:06.371 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd8854c) [0x555b22bc254c] 2024-09-12T00:50:06.371 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b226bf31d] 2024-09-12T00:50:06.371 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:50:06.371 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7fc851229590] 2024-09-12T00:50:06.371 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:50:06.372 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:50:06.372 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.372 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:50:06.229+0000 7fc85140e800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:06.372 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7fc85140e800 thread_name:radosgw-admin 2024-09-12T00:50:06.372 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.372 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:06.372 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7fc85123e6f0] 2024-09-12T00:50:06.372 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7fc85128b99c] 2024-09-12T00:50:06.373 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:50:06.373 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:50:06.373 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7fc85258c774] 2024-09-12T00:50:06.373 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7fc85258c8d8] 2024-09-12T00:50:06.373 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x555b226af641] 2024-09-12T00:50:06.373 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd8854c) [0x555b22bc254c] 2024-09-12T00:50:06.373 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x555b226bf31d] 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7fc851229590] 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:50:06.374 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:50:06.375 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:50:06.376 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:50:06.377 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:50:06.377 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:50:06.377 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:50:06.377 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:50:06.377 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:50:06.377 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:50:06.377 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:50:06.377 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:50:06.377 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:50:06.377 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:50:06.377 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:06.378 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:50:06.378 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:50:06.378 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:06.378 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:06.378 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:50:06.378 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:06.378 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:06.378 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:06.378 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:50:06.378 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:50:06.378 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:50:06.379 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:50:06.379 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:50:06.379 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:50:06.379 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:50:06.379 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:50:06.379 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:50:06.379 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:50:06.379 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:50:06.380 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:50:06.380 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:50:06.380 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:50:06.380 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:50:06.380 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:50:06.380 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:50:06.380 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:50:06.380 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:06.381 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:06.381 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:06.381 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:50:06.381 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:06.381 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:06.381 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:06.381 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:06.382 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:50:06.382 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:06.382 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:06.382 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:06.382 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:06.382 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:06.382 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:06.382 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:50:06.382 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:06.382 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:50:06.383 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:50:06.383 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:50:06.383 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:06.383 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:50:06.383 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:50:06.383 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:06.383 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:06.383 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:06.383 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:06.383 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc6737fe640 / http_manager 2024-09-12T00:50:06.383 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc701fe3640 / http_manager 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc702fe5640 / rgw_dt_lg_renew 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc7227fc640 / ms_dispatch 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc723fff640 / io_context_pool 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc7327fc640 / ms_dispatch 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc73960a640 / ms_dispatch 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc73ae0d640 / io_context_pool 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc84c2ca640 / msgr-worker-2 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc84cacb640 / msgr-worker-1 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc84d2cc640 / msgr-worker-0 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc84dacd640 / io_context_pool 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: 7fc85140e800 / radosgw-admin 2024-09-12T00:50:06.384 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:50:06.385 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:50:06.385 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:50:06.230333Z_14519350-8efc-486c-bbda-8eb27c7c6c96/log 2024-09-12T00:50:06.385 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:50:06.385 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:50:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:06.386 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.308+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.309+0000 7fbdda60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.309+0000 7fbdda60e800 20 realm 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.309+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.310+0000 7fbdda60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.310+0000 7fbdda60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.310+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.310+0000 7fbdda60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.310+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.311+0000 7fbdda60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.311+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.311+0000 7fbdda60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:06.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.311+0000 7fbdda60e800 20 searching for the correct realm 2024-09-12T00:50:06.388 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.314+0000 7fbdd556a640 0 -- 172.21.15.19:0/4181991152 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fbdcc057a00 msgr2=0x7fbdcc0da9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:06.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.520+0000 7fbdd5d6b640 0 -- 172.21.15.19:0/4181991152 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fbdd0031060 msgr2=0x7fbdd0010950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:06.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.728+0000 7fbdda60e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:06.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.728+0000 7fbdda60e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:06.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.728+0000 7fbdda60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:06.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.728+0000 7fbdda60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:06.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.728+0000 7fbdda60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:06.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.728+0000 7fbdda60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:06.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.728+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.729+0000 7fbdda60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.729+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.729+0000 7fbdda60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:06.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.729+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.729+0000 7fbdda60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:06.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.730+0000 7fbdda60e800 20 zone default found 2024-09-12T00:50:06.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.730+0000 7fbdda60e800 4 Realm: () 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.730+0000 7fbdda60e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.730+0000 7fbdda60e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.730+0000 7fbdda60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.730+0000 7fbdda60e800 20 zonegroup default 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.730+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.730+0000 7fbdda60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.730+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.730+0000 7fbdda60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.730+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.731+0000 7fbdda60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.731+0000 7fbdda60e800 20 started sync module instance, tier type = 2024-09-12T00:50:06.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.731+0000 7fbdda60e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:06.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.740+0000 7fbdda60e800 20 add_watcher() i=0 2024-09-12T00:50:06.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.740+0000 7fbdda60e800 20 add_watcher() i=1 2024-09-12T00:50:06.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.740+0000 7fbdda60e800 20 add_watcher() i=2 2024-09-12T00:50:06.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.740+0000 7fbdda60e800 20 add_watcher() i=3 2024-09-12T00:50:06.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.740+0000 7fbdda60e800 20 add_watcher() i=4 2024-09-12T00:50:06.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.740+0000 7fbdda60e800 20 add_watcher() i=5 2024-09-12T00:50:06.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.740+0000 7fbdda60e800 20 add_watcher() i=6 2024-09-12T00:50:06.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.743+0000 7fbdda60e800 20 add_watcher() i=7 2024-09-12T00:50:06.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.743+0000 7fbdda60e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:06.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.745+0000 7fbc877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:06.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.745+0000 7fbdda60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:06.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.745+0000 7fbdda60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:06.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.745+0000 7fbdda60e800 5 note: GC not initialized 2024-09-12T00:50:06.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.746+0000 7fbc867fc640 20 reqs_thread_entry: start 2024-09-12T00:50:06.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.746+0000 7fbdda60e800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:06.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.746+0000 7fbdda60e800 20 Filter name: none 2024-09-12T00:50:06.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.746+0000 7fbbf7fff640 20 reqs_thread_entry: start 2024-09-12T00:50:06.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.746+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.746+0000 7fbdda60e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:06.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.747+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.747+0000 7fbdda60e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:50:06.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.747+0000 7fbdda60e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:06.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.747+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.748+0000 7fbdda60e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:06.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.748+0000 7fbdda60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.747 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.748+0000 7fbdda60e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:50:06.747 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.748+0000 7fbdda60e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:06.748 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.750+0000 7fbc877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:06.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.753+0000 7fbdda60e800 20 remove_watcher() i=0 2024-09-12T00:50:06.751 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.753+0000 7fbdda60e800 2 removed watcher, disabling cache 2024-09-12T00:50:06.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.754+0000 7fbdda60e800 20 remove_watcher() i=1 2024-09-12T00:50:06.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.755+0000 7fbdda60e800 20 remove_watcher() i=2 2024-09-12T00:50:06.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.756+0000 7fbdda60e800 20 remove_watcher() i=3 2024-09-12T00:50:06.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.757+0000 7fbdda60e800 20 remove_watcher() i=4 2024-09-12T00:50:06.757 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.758+0000 7fbdda60e800 20 remove_watcher() i=5 2024-09-12T00:50:06.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.759+0000 7fbdda60e800 20 remove_watcher() i=6 2024-09-12T00:50:06.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.761+0000 7fbdda60e800 20 remove_watcher() i=7 2024-09-12T00:50:06.772 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.772 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:06.773 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-logrecord-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:50:06.773 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:06.774 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:06.774 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:06.806 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:06.806 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:06.865 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:06.898 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:06.898 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:06.939 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.940+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.941+0000 7f5eced2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.941+0000 7f5eced2b800 20 realm 2024-09-12T00:50:06.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.941+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.941+0000 7f5eced2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.941+0000 7f5eced2b800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:06.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.941+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.941+0000 7f5eced2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:06.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.941+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.942+0000 7f5eced2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:06.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.942+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:06.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.942+0000 7f5eced2b800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:06.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.942+0000 7f5eced2b800 20 searching for the correct realm 2024-09-12T00:50:06.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:06.945+0000 7f5eca272640 0 -- 172.21.15.19:0/1862657796 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f5ec0082300 msgr2=0x7f5ec005f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:07.151 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.152+0000 7f5ecb274640 0 -- 172.21.15.19:0/1862657796 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5643292cdb40 msgr2=0x5643292d0000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:07.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:07.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:07.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:07.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:07.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:07.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:07.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:07.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:07.156 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:07.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:07.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:07.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.157+0000 7f5eced2b800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:07.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 20 zone default found 2024-09-12T00:50:07.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 4 Realm: () 2024-09-12T00:50:07.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:07.157 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:07.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:07.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 20 zonegroup default 2024-09-12T00:50:07.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:07.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:07.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:07.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:07.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:07.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:07.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 20 started sync module instance, tier type = 2024-09-12T00:50:07.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.158+0000 7f5eced2b800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:07.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.168+0000 7f5eced2b800 20 add_watcher() i=0 2024-09-12T00:50:07.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.168+0000 7f5eced2b800 20 add_watcher() i=1 2024-09-12T00:50:07.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.168+0000 7f5eced2b800 20 add_watcher() i=2 2024-09-12T00:50:07.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.168+0000 7f5eced2b800 20 add_watcher() i=3 2024-09-12T00:50:07.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.168+0000 7f5eced2b800 20 add_watcher() i=4 2024-09-12T00:50:07.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.168+0000 7f5eced2b800 20 add_watcher() i=5 2024-09-12T00:50:07.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.168+0000 7f5eced2b800 20 add_watcher() i=6 2024-09-12T00:50:07.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.169+0000 7f5eced2b800 20 add_watcher() i=7 2024-09-12T00:50:07.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.169+0000 7f5eced2b800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:07.169 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.171+0000 7f5d817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:07.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.171+0000 7f5eced2b800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:07.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.171+0000 7f5eced2b800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:07.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.171+0000 7f5eced2b800 5 note: GC not initialized 2024-09-12T00:50:07.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.171+0000 7f5cfbfff640 20 reqs_thread_entry: start 2024-09-12T00:50:07.170 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.171+0000 7f5eced2b800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:07.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.171+0000 7f5eced2b800 20 Filter name: none 2024-09-12T00:50:07.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.172+0000 7f5cf9ffb640 20 reqs_thread_entry: start 2024-09-12T00:50:07.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.172+0000 7f5eced2b800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:50:07.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.172+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:07.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.172+0000 7f5eced2b800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:07.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.172+0000 7f5eced2b800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:50:07.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.172+0000 7f5eced2b800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:50:07.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.172+0000 7f5eced2b800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 : miss 2024-09-12T00:50:07.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.172+0000 7f5eced2b800 20 rados->read ofs=0 len=0 2024-09-12T00:50:07.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.173+0000 7f5eced2b800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:50:07.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.173+0000 7f5eced2b800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:07.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.173+0000 7f5eced2b800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:07.172 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.173+0000 7f5eced2b800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:07.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.173+0000 7f5eced2b800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:07.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.173+0000 7f5eced2b800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 2024-09-12T00:50:07.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.174+0000 7f5eced2b800 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to be held by another RGW process; skipping for now 2024-09-12T00:50:07.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.175+0000 7f5d817e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:07.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.177+0000 7f5eced2b800 20 remove_watcher() i=0 2024-09-12T00:50:07.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.177+0000 7f5eced2b800 2 removed watcher, disabling cache 2024-09-12T00:50:07.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.178+0000 7f5eced2b800 20 remove_watcher() i=1 2024-09-12T00:50:07.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.180+0000 7f5eced2b800 20 remove_watcher() i=2 2024-09-12T00:50:07.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.181+0000 7f5eced2b800 20 remove_watcher() i=3 2024-09-12T00:50:07.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.182+0000 7f5eced2b800 20 remove_watcher() i=4 2024-09-12T00:50:07.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.183+0000 7f5eced2b800 20 remove_watcher() i=5 2024-09-12T00:50:07.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.184+0000 7f5eced2b800 20 remove_watcher() i=6 2024-09-12T00:50:07.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:07.185+0000 7f5eced2b800 20 remove_watcher() i=7 2024-09-12T00:50:07.196 INFO:tasks.workunit.client.0.smithi019.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:50:37.222 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:37.260 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:37.260 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:37.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.308+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.308 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.309+0000 7fe9e460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.308 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.309+0000 7fe9e460e800 20 realm 2024-09-12T00:50:37.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.309+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.309+0000 7fe9e460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.309+0000 7fe9e460e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:37.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.309+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.310+0000 7fe9e460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.310+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.311+0000 7fe9e460e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:37.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.311+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.311+0000 7fe9e460e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:37.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.311+0000 7fe9e460e800 20 searching for the correct realm 2024-09-12T00:50:37.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.315+0000 7fe9df458640 0 -- 172.21.15.19:0/9855178 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fe9d407d920 msgr2=0x7fe9d406f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:37.519 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.521+0000 7fe9e045a640 0 -- 172.21.15.19:0/9855178 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55ec81645190 msgr2=0x55ec81647580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:37.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.526+0000 7fe9e460e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:37.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.526+0000 7fe9e460e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:37.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.526+0000 7fe9e460e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:37.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.526+0000 7fe9e460e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:37.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.526+0000 7fe9e460e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:37.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.526+0000 7fe9e460e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:37.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.526+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.526+0000 7fe9e460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.526+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.527+0000 7fe9e460e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:37.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.527+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.527+0000 7fe9e460e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:37.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.527+0000 7fe9e460e800 20 zone default found 2024-09-12T00:50:37.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.527+0000 7fe9e460e800 4 Realm: () 2024-09-12T00:50:37.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.527+0000 7fe9e460e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:37.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.527+0000 7fe9e460e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:37.527 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.527+0000 7fe9e460e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:37.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.527+0000 7fe9e460e800 20 zonegroup default 2024-09-12T00:50:37.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.527+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.528+0000 7fe9e460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.528+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.528+0000 7fe9e460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.528+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.528 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.529+0000 7fe9e460e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.529+0000 7fe9e460e800 20 started sync module instance, tier type = 2024-09-12T00:50:37.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.529+0000 7fe9e460e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:37.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.539+0000 7fe9e460e800 20 add_watcher() i=0 2024-09-12T00:50:37.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.539+0000 7fe9e460e800 20 add_watcher() i=1 2024-09-12T00:50:37.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.539+0000 7fe9e460e800 20 add_watcher() i=2 2024-09-12T00:50:37.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.539+0000 7fe9e460e800 20 add_watcher() i=3 2024-09-12T00:50:37.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.539+0000 7fe9e460e800 20 add_watcher() i=4 2024-09-12T00:50:37.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.539+0000 7fe9e460e800 20 add_watcher() i=5 2024-09-12T00:50:37.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.539+0000 7fe9e460e800 20 add_watcher() i=6 2024-09-12T00:50:37.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.540+0000 7fe9e460e800 20 add_watcher() i=7 2024-09-12T00:50:37.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.540+0000 7fe9e460e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:37.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.543+0000 7fe895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:37.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.543+0000 7fe9e460e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:37.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.543+0000 7fe9e460e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:37.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.543+0000 7fe9e460e800 5 note: GC not initialized 2024-09-12T00:50:37.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.543+0000 7fe894fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:37.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.544+0000 7fe9e460e800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:37.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.544+0000 7fe9e460e800 20 Filter name: none 2024-09-12T00:50:37.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.544+0000 7fe80e7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:37.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.544+0000 7fe9e460e800 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:50:37.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.544+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.544+0000 7fe9e460e800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:37.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.544+0000 7fe9e460e800 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:50:37.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.544+0000 7fe9e460e800 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:50:37.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.544+0000 7fe9e460e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 : miss 2024-09-12T00:50:37.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.544+0000 7fe9e460e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.545+0000 7fe9e460e800 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:50:37.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.545+0000 7fe9e460e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:37.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.545+0000 7fe9e460e800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:37.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.545+0000 7fe9e460e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:37.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.545+0000 7fe9e460e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.545+0000 7fe9e460e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 2024-09-12T00:50:37.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.546+0000 7fe9e460e800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:50:37.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.555+0000 7fe9e460e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:37.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.555+0000 7fe9e460e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:37.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.555+0000 7fe9e460e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.555+0000 7fe9e460e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36, ofs0, ns] 2024-09-12T00:50:37.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.555+0000 7fe8be7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398880 cookie 94474271482736 notifier 7274 bl.length()=923 2024-09-12T00:50:37.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.555+0000 7fe8be7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:37.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.555+0000 7fe8be7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:37.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.555+0000 7fe8be7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.557+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_sources= new_sources= 2024-09-12T00:50:37.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.557+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential sources added=[] removed=[] 2024-09-12T00:50:37.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.557+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_dests= new_dests= 2024-09-12T00:50:37.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.557+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential dests added=[] removed=[] 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.0 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.0 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.1 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.1 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.2 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.2 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.3 2024-09-12T00:50:37.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.3 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.4 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.4 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.5 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.5 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.6 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.6 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.7 2024-09-12T00:50:37.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.7 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.8 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.8 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.9 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.9 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.10 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.10 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.11 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2.11 2024-09-12T00:50:37.563 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.0 2024-09-12T00:50:37.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.562+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.1 2024-09-12T00:50:37.564 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.563+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2 2024-09-12T00:50:37.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.563+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.3 2024-09-12T00:50:37.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.564+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.4 2024-09-12T00:50:37.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.565+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.5 2024-09-12T00:50:37.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.566+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.6 2024-09-12T00:50:37.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.566+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.7 2024-09-12T00:50:37.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.567+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.8 2024-09-12T00:50:37.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.568+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.9 2024-09-12T00:50:37.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.568+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.10 2024-09-12T00:50:37.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.572+0000 7fe9e460e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:37.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.572+0000 7fe9e460e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 2024-09-12T00:50:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.574+0000 7fe9e460e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.574+0000 7fe9e460e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.574+0000 7fe9e460e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.574+0000 7fe9e460e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36, ofs0, ns] 2024-09-12T00:50:37.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.574+0000 7fe8beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398881 cookie 94474271482736 notifier 7274 bl.length()=923 2024-09-12T00:50:37.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.574+0000 7fe8beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:37.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.574+0000 7fe8beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:37.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.574+0000 7fe8beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.576+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_sources= new_sources= 2024-09-12T00:50:37.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.576+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential sources added=[] removed=[] 2024-09-12T00:50:37.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.576+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_dests= new_dests= 2024-09-12T00:50:37.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.576+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential dests added=[] removed=[] 2024-09-12T00:50:37.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.579+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.0 2024-09-12T00:50:37.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.579+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.1 2024-09-12T00:50:37.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.579+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.2 2024-09-12T00:50:37.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.580+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.3 2024-09-12T00:50:37.578 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.580+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.4 2024-09-12T00:50:37.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.580+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.5 2024-09-12T00:50:37.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.581+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.6 2024-09-12T00:50:37.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.581+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.7 2024-09-12T00:50:37.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.581+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.8 2024-09-12T00:50:37.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.582+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.9 2024-09-12T00:50:37.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.582+0000 7fe9e460e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36.10 2024-09-12T00:50:37.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.582+0000 7fe9e460e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:37.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.583+0000 7fe9e460e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 2024-09-12T00:50:37.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.584+0000 7fe9e460e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:37.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.584+0000 7fe9e460e800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:37.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.584+0000 7fe9e460e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.584+0000 7fe9e460e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36, ofs0, ns] 2024-09-12T00:50:37.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.584+0000 7fe8beffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398882 cookie 94474271482736 notifier 7274 bl.length()=891 2024-09-12T00:50:37.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.584+0000 7fe8beffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 info.flags=0x17 2024-09-12T00:50:37.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.584+0000 7fe8beffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 to cache LRU end 2024-09-12T00:50:37.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.584+0000 7fe8beffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:37.584 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.586+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_sources= new_sources= 2024-09-12T00:50:37.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.586+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential sources added=[] removed=[] 2024-09-12T00:50:37.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.586+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): orig_dests= new_dests= 2024-09-12T00:50:37.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.586+0000 7fe9e460e800 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36]): potential dests added=[] removed=[] 2024-09-12T00:50:37.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.588+0000 7fe9e460e800 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:50:37.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.590+0000 7fe895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:37.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.593+0000 7fe9e460e800 20 remove_watcher() i=0 2024-09-12T00:50:37.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.593+0000 7fe9e460e800 2 removed watcher, disabling cache 2024-09-12T00:50:37.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.594+0000 7fe9e460e800 20 remove_watcher() i=1 2024-09-12T00:50:37.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.595+0000 7fe9e460e800 20 remove_watcher() i=2 2024-09-12T00:50:37.595 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.596+0000 7fe9e460e800 20 remove_watcher() i=3 2024-09-12T00:50:37.596 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.598+0000 7fe9e460e800 20 remove_watcher() i=4 2024-09-12T00:50:37.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.599+0000 7fe9e460e800 20 remove_watcher() i=5 2024-09-12T00:50:37.599 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.600+0000 7fe9e460e800 20 remove_watcher() i=6 2024-09-12T00:50:37.600 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.601+0000 7fe9e460e800 20 remove_watcher() i=7 2024-09-12T00:50:37.614 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:50:37.644 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:37.644 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:37.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.686+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.688+0000 7f701ad15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.688+0000 7f701ad15800 20 realm 2024-09-12T00:50:37.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.688+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.688+0000 7f701ad15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.688+0000 7f701ad15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:37.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.688+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.688+0000 7f701ad15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.688+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.689+0000 7f701ad15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:37.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.689+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.689+0000 7f701ad15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:37.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.689+0000 7f701ad15800 20 searching for the correct realm 2024-09-12T00:50:37.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.693+0000 7f7017ffe640 0 -- 172.21.15.19:0/3543217814 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f700c0b0390 msgr2=0x7f700c0b1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:37.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.899+0000 7f7019000640 0 -- 172.21.15.19:0/3543217814 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5573f6dcada0 msgr2=0x5573f6dcd190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.904+0000 7f701ad15800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.904+0000 7f701ad15800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.904+0000 7f701ad15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.904+0000 7f701ad15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.904+0000 7f701ad15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.904+0000 7f701ad15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.904+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.904+0000 7f701ad15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.904+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.904+0000 7f701ad15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.904+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 20 zone default found 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 4 Realm: () 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 20 zonegroup default 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.905+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.906+0000 7f701ad15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:37.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.906+0000 7f701ad15800 20 started sync module instance, tier type = 2024-09-12T00:50:37.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.906+0000 7f701ad15800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:37.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.915+0000 7f701ad15800 20 add_watcher() i=0 2024-09-12T00:50:37.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.915+0000 7f701ad15800 20 add_watcher() i=1 2024-09-12T00:50:37.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.915+0000 7f701ad15800 20 add_watcher() i=2 2024-09-12T00:50:37.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.915+0000 7f701ad15800 20 add_watcher() i=3 2024-09-12T00:50:37.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.915+0000 7f701ad15800 20 add_watcher() i=4 2024-09-12T00:50:37.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.915+0000 7f701ad15800 20 add_watcher() i=5 2024-09-12T00:50:37.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.915+0000 7f701ad15800 20 add_watcher() i=6 2024-09-12T00:50:37.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.916+0000 7f701ad15800 20 add_watcher() i=7 2024-09-12T00:50:37.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.916+0000 7f701ad15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:37.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.918+0000 7f6ecefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:37.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.919+0000 7f701ad15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:37.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.919+0000 7f701ad15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:37.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.919+0000 7f701ad15800 5 note: GC not initialized 2024-09-12T00:50:37.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.919+0000 7f6ecdfdb640 20 reqs_thread_entry: start 2024-09-12T00:50:37.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.919+0000 7f701ad15800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:37.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.919+0000 7f701ad15800 20 Filter name: none 2024-09-12T00:50:37.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.919+0000 7f6e3f7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:37.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.919+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.919+0000 7f701ad15800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:37.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.919+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.920+0000 7f701ad15800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:37.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.920+0000 7f701ad15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:37.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.920+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.920+0000 7f701ad15800 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:50:37.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.920+0000 7f701ad15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:37.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.920+0000 7f701ad15800 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:50:37.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.921+0000 7f701ad15800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:37.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.922+0000 7f6ecefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:37.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.924+0000 7f701ad15800 20 remove_watcher() i=0 2024-09-12T00:50:37.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.924+0000 7f701ad15800 2 removed watcher, disabling cache 2024-09-12T00:50:37.924 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.925+0000 7f701ad15800 20 remove_watcher() i=1 2024-09-12T00:50:37.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.927+0000 7f701ad15800 20 remove_watcher() i=2 2024-09-12T00:50:37.926 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.928+0000 7f701ad15800 20 remove_watcher() i=3 2024-09-12T00:50:37.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.929+0000 7f701ad15800 20 remove_watcher() i=4 2024-09-12T00:50:37.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.930+0000 7f701ad15800 20 remove_watcher() i=5 2024-09-12T00:50:37.930 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.931+0000 7f701ad15800 20 remove_watcher() i=6 2024-09-12T00:50:37.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:37.932+0000 7f701ad15800 20 remove_watcher() i=7 2024-09-12T00:50:37.942 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:37.942 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:37.942 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-logrecord-writes id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:50:37.942 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:37.945 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:37.945 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:37.966 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:37.966 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.161 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.161 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.300 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:50:38.300 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:38.301 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.301 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.351 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.351 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.408 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.408 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.446 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.447 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.481 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.481 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.516 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.516 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.551 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.551 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.585 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.585 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.619 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.619 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.653 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.653 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.687 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.688 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.721 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.721 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.755 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.755 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.789 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.789 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.822 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.823 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.856 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.856 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.890 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.890 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.926 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.926 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.959 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.959 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:38.994 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:38.995 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:39.029 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.029 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:39.063 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.063 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:39.097 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:50:39.126 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:39.126 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:39.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.166+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.168+0000 7ff8e6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.168+0000 7ff8e6746800 20 realm 2024-09-12T00:50:39.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.168+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.168+0000 7ff8e6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.168+0000 7ff8e6746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:39.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.168+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.168+0000 7ff8e6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.167 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.168+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.169+0000 7ff8e6746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:39.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.169+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.169+0000 7ff8e6746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:39.168 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.169+0000 7ff8e6746800 20 searching for the correct realm 2024-09-12T00:50:39.171 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.173+0000 7ff8e3a36640 0 -- 172.21.15.19:0/1490110652 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7ff8d8009040 msgr2=0x7ff8d804d1a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:39.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.176+0000 7ff8e4237640 0 -- 172.21.15.19:0/1490110652 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7ff8dc028060 msgr2=0x7ff8dc063080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:39.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:39.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:39.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:39.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:39.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:39.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:39.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:39.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:39.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 zone default found 2024-09-12T00:50:39.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 4 Realm: () 2024-09-12T00:50:39.180 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 zonegroup default 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.180+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.181+0000 7ff8e6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.181+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.181+0000 7ff8e6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.181+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.181+0000 7ff8e6746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.181+0000 7ff8e6746800 20 started sync module instance, tier type = 2024-09-12T00:50:39.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.181+0000 7ff8e6746800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:39.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.191+0000 7ff8e6746800 20 add_watcher() i=0 2024-09-12T00:50:39.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.191+0000 7ff8e6746800 20 add_watcher() i=1 2024-09-12T00:50:39.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.191+0000 7ff8e6746800 20 add_watcher() i=2 2024-09-12T00:50:39.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.191+0000 7ff8e6746800 20 add_watcher() i=3 2024-09-12T00:50:39.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.191+0000 7ff8e6746800 20 add_watcher() i=4 2024-09-12T00:50:39.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.191+0000 7ff8e6746800 20 add_watcher() i=5 2024-09-12T00:50:39.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.191+0000 7ff8e6746800 20 add_watcher() i=6 2024-09-12T00:50:39.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.192+0000 7ff8e6746800 20 add_watcher() i=7 2024-09-12T00:50:39.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.192+0000 7ff8e6746800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:39.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.194+0000 7ff79afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:39.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.194+0000 7ff8e6746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:39.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.194+0000 7ff8e6746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:39.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.194+0000 7ff8e6746800 5 note: GC not initialized 2024-09-12T00:50:39.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.194+0000 7ff799fdb640 20 reqs_thread_entry: start 2024-09-12T00:50:39.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.194+0000 7ff8e6746800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:39.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.195+0000 7ff8e6746800 20 Filter name: none 2024-09-12T00:50:39.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.195+0000 7ff70b7fe640 20 reqs_thread_entry: start 2024-09-12T00:50:39.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.195+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.195+0000 7ff8e6746800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:39.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.195+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.196+0000 7ff8e6746800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:39.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.196+0000 7ff8e6746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:39.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.196+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.196+0000 7ff8e6746800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:39.195 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.196+0000 7ff8e6746800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.196+0000 7ff8e6746800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:39.196 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.196+0000 7ff8e6746800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:39.197 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.198+0000 7ff79afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:39.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.200+0000 7ff8e6746800 20 remove_watcher() i=0 2024-09-12T00:50:39.199 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.200+0000 7ff8e6746800 2 removed watcher, disabling cache 2024-09-12T00:50:39.200 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.201+0000 7ff8e6746800 20 remove_watcher() i=1 2024-09-12T00:50:39.201 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.202+0000 7ff8e6746800 20 remove_watcher() i=2 2024-09-12T00:50:39.202 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.203+0000 7ff8e6746800 20 remove_watcher() i=3 2024-09-12T00:50:39.203 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.204+0000 7ff8e6746800 20 remove_watcher() i=4 2024-09-12T00:50:39.204 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.205+0000 7ff8e6746800 20 remove_watcher() i=5 2024-09-12T00:50:39.205 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.206+0000 7ff8e6746800 20 remove_watcher() i=6 2024-09-12T00:50:39.206 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.207+0000 7ff8e6746800 20 remove_watcher() i=7 2024-09-12T00:50:39.217 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:39.217 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:39.217 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-change-reshard-state id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:50:39.217 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:39.219 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:50:39.253 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:39.253 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:39.293 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.294+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.296+0000 7f3dd6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.296+0000 7f3dd6a15800 20 realm 2024-09-12T00:50:39.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.296+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.296+0000 7f3dd6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.296+0000 7f3dd6a15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:39.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.296+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.296+0000 7f3dd6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.296+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.297+0000 7f3dd6a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:39.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.297+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.297+0000 7f3dd6a15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:39.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.297+0000 7f3dd6a15800 20 searching for the correct realm 2024-09-12T00:50:39.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.300+0000 7f3dd1991640 0 -- 172.21.15.19:0/2024797940 >> [v2:172.21.15.135:6800/2991448734,v1:172.21.15.135:6801/2991448734] conn(0x55ca55dc2f10 msgr2=0x55ca55dc53d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:39.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.303+0000 7f3dd2192640 0 -- 172.21.15.19:0/2024797940 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f3dcc028be0 msgr2=0x7f3dcc01c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:39.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.510+0000 7f3dd6a15800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:39.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.510+0000 7f3dd6a15800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:39.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.510+0000 7f3dd6a15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:39.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.510+0000 7f3dd6a15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:39.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.510+0000 7f3dd6a15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:39.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.510+0000 7f3dd6a15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:39.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.510+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.510+0000 7f3dd6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.510+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:39.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:39.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 20 zone default found 2024-09-12T00:50:39.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 4 Realm: () 2024-09-12T00:50:39.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:39.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:39.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:39.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 20 zonegroup default 2024-09-12T00:50:39.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.511+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.512+0000 7f3dd6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.512+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.512+0000 7f3dd6a15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.512+0000 7f3dd6a15800 20 started sync module instance, tier type = 2024-09-12T00:50:39.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.512+0000 7f3dd6a15800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:39.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.521+0000 7f3dd6a15800 20 add_watcher() i=0 2024-09-12T00:50:39.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.521+0000 7f3dd6a15800 20 add_watcher() i=1 2024-09-12T00:50:39.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.521+0000 7f3dd6a15800 20 add_watcher() i=2 2024-09-12T00:50:39.520 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.521+0000 7f3dd6a15800 20 add_watcher() i=3 2024-09-12T00:50:39.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.521+0000 7f3dd6a15800 20 add_watcher() i=4 2024-09-12T00:50:39.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.521+0000 7f3dd6a15800 20 add_watcher() i=5 2024-09-12T00:50:39.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.521+0000 7f3dd6a15800 20 add_watcher() i=6 2024-09-12T00:50:39.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.522+0000 7f3dd6a15800 20 add_watcher() i=7 2024-09-12T00:50:39.521 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.522+0000 7f3dd6a15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:39.522 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.524+0000 7f3c88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:39.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.524+0000 7f3dd6a15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:39.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.524+0000 7f3dd6a15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:39.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.524+0000 7f3dd6a15800 5 note: GC not initialized 2024-09-12T00:50:39.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.525+0000 7f3c037fe640 20 reqs_thread_entry: start 2024-09-12T00:50:39.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.525+0000 7f3dd6a15800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:39.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.525+0000 7f3dd6a15800 20 Filter name: none 2024-09-12T00:50:39.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.525+0000 7f3c017fa640 20 reqs_thread_entry: start 2024-09-12T00:50:39.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.525+0000 7f3dd6a15800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:50:39.524 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.525+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.525+0000 7f3dd6a15800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:39.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.525+0000 7f3dd6a15800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:50:39.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.525+0000 7f3dd6a15800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:50:39.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.525+0000 7f3dd6a15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 : miss 2024-09-12T00:50:39.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.525+0000 7f3dd6a15800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.525 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.526+0000 7f3dd6a15800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:39.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.526+0000 7f3dd6a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:39.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.526+0000 7f3dd6a15800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:39.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.526+0000 7f3dd6a15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:39.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.526+0000 7f3dd6a15800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:39.526 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.526+0000 7f3dd6a15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 2024-09-12T00:50:39.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.531+0000 7f3dd6a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:39.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.531+0000 7f3dd6a15800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:39.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.531+0000 7f3dd6a15800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:39.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.531+0000 7f3dd6a15800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37, ofs0, ns] 2024-09-12T00:50:39.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.531+0000 7f3cb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398965 cookie 94327512262096 notifier 7325 bl.length()=931 2024-09-12T00:50:39.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.531+0000 7f3cb57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:39.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.531+0000 7f3cb57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:39.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.531+0000 7f3cb57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:39.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.533+0000 7f3dd6a15800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): orig_sources= new_sources= 2024-09-12T00:50:39.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.533+0000 7f3dd6a15800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): potential sources added=[] removed=[] 2024-09-12T00:50:39.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.533+0000 7f3dd6a15800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): orig_dests= new_dests= 2024-09-12T00:50:39.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.533+0000 7f3dd6a15800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): potential dests added=[] removed=[] 2024-09-12T00:50:39.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.0 2024-09-12T00:50:39.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.0 2024-09-12T00:50:39.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.1 2024-09-12T00:50:39.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.1 2024-09-12T00:50:39.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.2 2024-09-12T00:50:39.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.2 2024-09-12T00:50:39.536 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.3 2024-09-12T00:50:39.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.3 2024-09-12T00:50:39.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.4 2024-09-12T00:50:39.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.4 2024-09-12T00:50:39.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.5 2024-09-12T00:50:39.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.5 2024-09-12T00:50:39.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.6 2024-09-12T00:50:39.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.6 2024-09-12T00:50:39.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.7 2024-09-12T00:50:39.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.7 2024-09-12T00:50:39.537 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.8 2024-09-12T00:50:39.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.8 2024-09-12T00:50:39.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.9 2024-09-12T00:50:39.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.9 2024-09-12T00:50:39.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.10 2024-09-12T00:50:39.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.10 2024-09-12T00:50:39.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.11 2024-09-12T00:50:39.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.11 2024-09-12T00:50:39.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.537+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.0 2024-09-12T00:50:39.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.538+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1 2024-09-12T00:50:39.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.538+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.2 2024-09-12T00:50:39.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.539+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.3 2024-09-12T00:50:39.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.539+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.4 2024-09-12T00:50:39.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.540+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.5 2024-09-12T00:50:39.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.541+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.6 2024-09-12T00:50:39.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.541+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.7 2024-09-12T00:50:39.540 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.542+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.8 2024-09-12T00:50:39.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.542+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.9 2024-09-12T00:50:39.542 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.543+0000 7f3dd6a15800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.10 2024-09-12T00:50:39.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.547+0000 7f3dd6a15800 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:50:39.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.547+0000 7f3dd6a15800 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:50:39.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.558+0000 7f3dd6a15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:39.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.559+0000 7f3dd6a15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 2024-09-12T00:50:39.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.560+0000 7f3dd6a15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:39.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.560+0000 7f3dd6a15800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:39.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.560+0000 7f3dd6a15800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:39.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.560+0000 7f3dd6a15800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37, ofs0, ns] 2024-09-12T00:50:39.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.560+0000 7f3cb57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398966 cookie 94327512262096 notifier 7325 bl.length()=899 2024-09-12T00:50:39.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.560+0000 7f3cb57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:39.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.560+0000 7f3cb57fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:39.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.560+0000 7f3cb57fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:39.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.562+0000 7f3dd6a15800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): orig_sources= new_sources= 2024-09-12T00:50:39.560 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.562+0000 7f3dd6a15800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): potential sources added=[] removed=[] 2024-09-12T00:50:39.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.562+0000 7f3dd6a15800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): orig_dests= new_dests= 2024-09-12T00:50:39.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.562+0000 7f3dd6a15800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): potential dests added=[] removed=[] 2024-09-12T00:50:39.561 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.562+0000 7f3dd6a15800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:50:39.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.564+0000 7f3c88fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:39.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.566+0000 7f3dd6a15800 20 remove_watcher() i=0 2024-09-12T00:50:39.565 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.566+0000 7f3dd6a15800 2 removed watcher, disabling cache 2024-09-12T00:50:39.566 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.567+0000 7f3dd6a15800 20 remove_watcher() i=1 2024-09-12T00:50:39.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.568+0000 7f3dd6a15800 20 remove_watcher() i=2 2024-09-12T00:50:39.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.569+0000 7f3dd6a15800 20 remove_watcher() i=3 2024-09-12T00:50:39.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.570+0000 7f3dd6a15800 20 remove_watcher() i=4 2024-09-12T00:50:39.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.571+0000 7f3dd6a15800 20 remove_watcher() i=5 2024-09-12T00:50:39.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.572+0000 7f3dd6a15800 20 remove_watcher() i=6 2024-09-12T00:50:39.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.573+0000 7f3dd6a15800 20 remove_watcher() i=7 2024-09-12T00:50:39.585 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:50:39.614 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:39.614 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:39.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.655+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.657+0000 7f3cfeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.657+0000 7f3cfeb26800 20 realm 2024-09-12T00:50:39.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.657+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.657+0000 7f3cfeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.657+0000 7f3cfeb26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:39.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.657+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.657+0000 7f3cfeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.657+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.658+0000 7f3cfeb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:39.656 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.658+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.658+0000 7f3cfeb26800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:39.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.658+0000 7f3cfeb26800 20 searching for the correct realm 2024-09-12T00:50:39.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.661+0000 7f3cfa04a640 0 -- 172.21.15.19:0/3943210790 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3cf0069a10 msgr2=0x7f3cf009f9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:39.865 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.866+0000 7f3cfb04c640 0 -- 172.21.15.19:0/3943210790 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5638b96f3b30 msgr2=0x5638b96f5f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:39.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.870+0000 7f3cfeb26800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:39.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.870+0000 7f3cfeb26800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:39.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.870+0000 7f3cfeb26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:39.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.870+0000 7f3cfeb26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:39.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.870+0000 7f3cfeb26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:39.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.870+0000 7f3cfeb26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:39.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.870+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.870+0000 7f3cfeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.870+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:39.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:39.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 20 zone default found 2024-09-12T00:50:39.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 4 Realm: () 2024-09-12T00:50:39.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:39.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:39.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:39.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 20 zonegroup default 2024-09-12T00:50:39.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.871+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.872+0000 7f3cfeb26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:39.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.872+0000 7f3cfeb26800 20 started sync module instance, tier type = 2024-09-12T00:50:39.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.872+0000 7f3cfeb26800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:39.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.880+0000 7f3cfeb26800 20 add_watcher() i=0 2024-09-12T00:50:39.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.880+0000 7f3cfeb26800 20 add_watcher() i=1 2024-09-12T00:50:39.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.880+0000 7f3cfeb26800 20 add_watcher() i=2 2024-09-12T00:50:39.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.880+0000 7f3cfeb26800 20 add_watcher() i=3 2024-09-12T00:50:39.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.880+0000 7f3cfeb26800 20 add_watcher() i=4 2024-09-12T00:50:39.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.880+0000 7f3cfeb26800 20 add_watcher() i=5 2024-09-12T00:50:39.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.881+0000 7f3cfeb26800 20 add_watcher() i=6 2024-09-12T00:50:39.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.881+0000 7f3cfeb26800 20 add_watcher() i=7 2024-09-12T00:50:39.880 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.881+0000 7f3cfeb26800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:39.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.883+0000 7f3bb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:39.882 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.883+0000 7f3cfeb26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:39.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.883+0000 7f3cfeb26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:39.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.883+0000 7f3cfeb26800 5 note: GC not initialized 2024-09-12T00:50:39.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.884+0000 7f3b2bfff640 20 reqs_thread_entry: start 2024-09-12T00:50:39.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.884+0000 7f3cfeb26800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:39.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.884+0000 7f3cfeb26800 20 Filter name: none 2024-09-12T00:50:39.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.884+0000 7f3b29ffb640 20 reqs_thread_entry: start 2024-09-12T00:50:39.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.884+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.884+0000 7f3cfeb26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:39.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.884+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.885+0000 7f3cfeb26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:39.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.885+0000 7f3cfeb26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:39.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.885+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.884 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.885+0000 7f3cfeb26800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:39.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.885+0000 7f3cfeb26800 20 rados->read ofs=0 len=0 2024-09-12T00:50:39.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.885+0000 7f3cfeb26800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:39.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.885+0000 7f3cfeb26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:39.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.887+0000 7f3bb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:39.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.889+0000 7f3cfeb26800 20 remove_watcher() i=0 2024-09-12T00:50:39.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.889+0000 7f3cfeb26800 2 removed watcher, disabling cache 2024-09-12T00:50:39.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.890+0000 7f3cfeb26800 20 remove_watcher() i=1 2024-09-12T00:50:39.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.891+0000 7f3cfeb26800 20 remove_watcher() i=2 2024-09-12T00:50:39.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.892+0000 7f3cfeb26800 20 remove_watcher() i=3 2024-09-12T00:50:39.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.893+0000 7f3cfeb26800 20 remove_watcher() i=4 2024-09-12T00:50:39.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.894+0000 7f3cfeb26800 20 remove_watcher() i=5 2024-09-12T00:50:39.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.895+0000 7f3cfeb26800 20 remove_watcher() i=6 2024-09-12T00:50:39.895 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:39.896+0000 7f3cfeb26800 20 remove_watcher() i=7 2024-09-12T00:50:39.906 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:39.906 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:39.907 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-change-reshard-state id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:50:39.907 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:39.908 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.908 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:39.939 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:39.939 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:39.998 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:40.032 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:40.032 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:40.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.072+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.075+0000 7f3775a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.075+0000 7f3775a10800 20 realm 2024-09-12T00:50:40.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.075+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.075+0000 7f3775a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.075+0000 7f3775a10800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:40.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.075+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.075+0000 7f3775a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.074 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.075+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.076+0000 7f3775a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.076+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.076+0000 7f3775a10800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:40.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.076+0000 7f3775a10800 20 searching for the correct realm 2024-09-12T00:50:40.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.078+0000 7f37719bd640 0 -- 172.21.15.19:0/292752381 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55fc2454b4c0 msgr2=0x55fc2454d8f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:40.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.081+0000 7f37711bc640 0 -- 172.21.15.19:0/292752381 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55fc2454f770 msgr2=0x55fc24551b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.087+0000 7f3775a10800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:40.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.087+0000 7f3775a10800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:40.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.087+0000 7f3775a10800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:40.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.087+0000 7f3775a10800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:40.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.087+0000 7f3775a10800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:40.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.087+0000 7f3775a10800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:40.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.087+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.087+0000 7f3775a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.087+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 20 zone default found 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 4 Realm: () 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 20 zonegroup default 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.088+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.089+0000 7f3775a10800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.089+0000 7f3775a10800 20 started sync module instance, tier type = 2024-09-12T00:50:40.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.089+0000 7f3775a10800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:40.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.097+0000 7f3775a10800 20 add_watcher() i=0 2024-09-12T00:50:40.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.097+0000 7f3775a10800 20 add_watcher() i=1 2024-09-12T00:50:40.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.097+0000 7f3775a10800 20 add_watcher() i=2 2024-09-12T00:50:40.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.097+0000 7f3775a10800 20 add_watcher() i=3 2024-09-12T00:50:40.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.097+0000 7f3775a10800 20 add_watcher() i=4 2024-09-12T00:50:40.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.097+0000 7f3775a10800 20 add_watcher() i=5 2024-09-12T00:50:40.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.097+0000 7f3775a10800 20 add_watcher() i=6 2024-09-12T00:50:40.097 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.098+0000 7f3775a10800 20 add_watcher() i=7 2024-09-12T00:50:40.097 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.098+0000 7f3775a10800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:40.098 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.099+0000 7f3622ff5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:40.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.100+0000 7f3775a10800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:40.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.100+0000 7f3775a10800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:40.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.100+0000 7f3775a10800 5 note: GC not initialized 2024-09-12T00:50:40.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.100+0000 7f3621ff3640 20 reqs_thread_entry: start 2024-09-12T00:50:40.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.100+0000 7f3775a10800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:40.099 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.100+0000 7f3775a10800 20 Filter name: none 2024-09-12T00:50:40.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.100+0000 7f35937fe640 20 reqs_thread_entry: start 2024-09-12T00:50:40.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.100+0000 7f3775a10800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:50:40.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.100+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.101+0000 7f3775a10800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:40.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.101+0000 7f3775a10800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:50:40.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.101+0000 7f3775a10800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:50:40.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.101+0000 7f3775a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 : miss 2024-09-12T00:50:40.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.101+0000 7f3775a10800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.101+0000 7f3775a10800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:40.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.101+0000 7f3775a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:40.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.101+0000 7f3775a10800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:40.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.101+0000 7f3775a10800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:40.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.101+0000 7f3775a10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.101+0000 7f3775a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 2024-09-12T00:50:40.105 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.106+0000 7f3775a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:40.105 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.106+0000 7f3775a10800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:40.105 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.106+0000 7f3775a10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.105 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.106+0000 7f3775a10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37, ofs0, ns] 2024-09-12T00:50:40.106 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.107+0000 7f3654ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398967 cookie 94541429652672 notifier 7361 bl.length()=931 2024-09-12T00:50:40.106 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.107+0000 7f3654ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:40.106 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.107+0000 7f3654ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:40.106 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.107+0000 7f3654ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.108+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): orig_sources= new_sources= 2024-09-12T00:50:40.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.108+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): potential sources added=[] removed=[] 2024-09-12T00:50:40.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.108+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): orig_dests= new_dests= 2024-09-12T00:50:40.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.108+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): potential dests added=[] removed=[] 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.0 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.0 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.1 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.1 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.2 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.2 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.3 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.3 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.4 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.4 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.5 2024-09-12T00:50:40.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.5 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.6 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.6 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.7 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.7 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.8 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.8 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.9 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.9 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.10 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.10 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.11 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1.11 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.0 2024-09-12T00:50:40.113 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.113+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1 2024-09-12T00:50:40.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.114+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.2 2024-09-12T00:50:40.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.114+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.3 2024-09-12T00:50:40.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.115+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.4 2024-09-12T00:50:40.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.115+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.5 2024-09-12T00:50:40.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.116+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.6 2024-09-12T00:50:40.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.117+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.7 2024-09-12T00:50:40.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.117+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.8 2024-09-12T00:50:40.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.117+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.9 2024-09-12T00:50:40.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.118+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.10 2024-09-12T00:50:40.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.121+0000 7f3775a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:40.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.121+0000 7f3775a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 2024-09-12T00:50:40.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.122+0000 7f3775a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:40.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.122+0000 7f3775a10800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:40.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.122+0000 7f3775a10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.122+0000 7f3775a10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37, ofs0, ns] 2024-09-12T00:50:40.122 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.123+0000 7f3643fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398968 cookie 94541429652672 notifier 7361 bl.length()=931 2024-09-12T00:50:40.122 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.123+0000 7f3643fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:40.122 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.123+0000 7f3643fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:40.122 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.123+0000 7f3643fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.124+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): orig_sources= new_sources= 2024-09-12T00:50:40.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.124+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): potential sources added=[] removed=[] 2024-09-12T00:50:40.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.124+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): orig_dests= new_dests= 2024-09-12T00:50:40.123 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.124+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): potential dests added=[] removed=[] 2024-09-12T00:50:40.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.127+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.0 2024-09-12T00:50:40.125 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.127+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.1 2024-09-12T00:50:40.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.127+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.2 2024-09-12T00:50:40.126 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.128+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.3 2024-09-12T00:50:40.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.128+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.4 2024-09-12T00:50:40.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.128+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.5 2024-09-12T00:50:40.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.128+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.6 2024-09-12T00:50:40.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.129+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.7 2024-09-12T00:50:40.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.129+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.8 2024-09-12T00:50:40.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.129+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.9 2024-09-12T00:50:40.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.130+0000 7f3775a10800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37.10 2024-09-12T00:50:40.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.130+0000 7f3775a10800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:40.129 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.130+0000 7f3775a10800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 2024-09-12T00:50:40.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.131+0000 7f3775a10800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:40.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.131+0000 7f3775a10800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:40.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.131+0000 7f3775a10800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.131+0000 7f3775a10800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37, ofs0, ns] 2024-09-12T00:50:40.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.132+0000 7f3654ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398969 cookie 94541429652672 notifier 7361 bl.length()=899 2024-09-12T00:50:40.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.132+0000 7f3654ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 info.flags=0x17 2024-09-12T00:50:40.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.132+0000 7f3654ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 to cache LRU end 2024-09-12T00:50:40.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.132+0000 7f3654ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:40.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.133+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): orig_sources= new_sources= 2024-09-12T00:50:40.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.133+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): potential sources added=[] removed=[] 2024-09-12T00:50:40.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.133+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): orig_dests= new_dests= 2024-09-12T00:50:40.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.133+0000 7f3775a10800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37]): potential dests added=[] removed=[] 2024-09-12T00:50:40.134 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.135+0000 7f3775a10800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:50:40.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.137+0000 7f3622ff5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:40.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.139+0000 7f3775a10800 20 remove_watcher() i=0 2024-09-12T00:50:40.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.139+0000 7f3775a10800 2 removed watcher, disabling cache 2024-09-12T00:50:40.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.140+0000 7f3775a10800 20 remove_watcher() i=1 2024-09-12T00:50:40.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.141+0000 7f3775a10800 20 remove_watcher() i=2 2024-09-12T00:50:40.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.142+0000 7f3775a10800 20 remove_watcher() i=3 2024-09-12T00:50:40.141 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.143+0000 7f3775a10800 20 remove_watcher() i=4 2024-09-12T00:50:40.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.144+0000 7f3775a10800 20 remove_watcher() i=5 2024-09-12T00:50:40.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.145+0000 7f3775a10800 20 remove_watcher() i=6 2024-09-12T00:50:40.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.146+0000 7f3775a10800 20 remove_watcher() i=7 2024-09-12T00:50:40.157 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:50:40.187 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:40.187 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:40.225 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.227+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.229+0000 7fb5a0139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.229+0000 7fb5a0139800 20 realm 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.229+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.229+0000 7fb5a0139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.229+0000 7fb5a0139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.229+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.229+0000 7fb5a0139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.229+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.230+0000 7fb5a0139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.230+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.230+0000 7fb5a0139800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:40.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.230+0000 7fb5a0139800 20 searching for the correct realm 2024-09-12T00:50:40.233 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.234+0000 7fb593fff640 0 -- 172.21.15.19:0/525420327 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fb584039410 msgr2=0x7fb584039870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.236 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.238+0000 7fb59c5c8640 0 -- 172.21.15.19:0/525420327 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55fc569571d0 msgr2=0x55fc56959600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.242+0000 7fb5a0139800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.242+0000 7fb5a0139800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.242+0000 7fb5a0139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.242+0000 7fb5a0139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.242+0000 7fb5a0139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.242+0000 7fb5a0139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.242+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.242+0000 7fb5a0139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.242+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.242 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.242+0000 7fb5a0139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.242+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 20 zone default found 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 4 Realm: () 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 20 zonegroup default 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 20 started sync module instance, tier type = 2024-09-12T00:50:40.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.243+0000 7fb5a0139800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.252+0000 7fb5a0139800 20 add_watcher() i=0 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.252+0000 7fb5a0139800 20 add_watcher() i=1 2024-09-12T00:50:40.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.252+0000 7fb5a0139800 20 add_watcher() i=2 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.252+0000 7fb5a0139800 20 add_watcher() i=3 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.252+0000 7fb5a0139800 20 add_watcher() i=4 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.252+0000 7fb5a0139800 20 add_watcher() i=5 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.252+0000 7fb5a0139800 20 add_watcher() i=6 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.253+0000 7fb5a0139800 20 add_watcher() i=7 2024-09-12T00:50:40.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.253+0000 7fb5a0139800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:40.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.254+0000 7fb451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.255+0000 7fb5a0139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.255+0000 7fb5a0139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.255+0000 7fb5a0139800 5 note: GC not initialized 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.255+0000 7fb450fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.255+0000 7fb5a0139800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.255+0000 7fb5a0139800 20 Filter name: none 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.255+0000 7fb3ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:40.254 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.255+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.256+0000 7fb5a0139800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.256+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.256+0000 7fb5a0139800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.256+0000 7fb5a0139800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.256+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.256+0000 7fb5a0139800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.256+0000 7fb5a0139800 20 rados->read ofs=0 len=0 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.257+0000 7fb5a0139800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:40.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.257+0000 7fb5a0139800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:40.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.259+0000 7fb451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.261+0000 7fb5a0139800 20 remove_watcher() i=0 2024-09-12T00:50:40.259 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.261+0000 7fb5a0139800 2 removed watcher, disabling cache 2024-09-12T00:50:40.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.262+0000 7fb5a0139800 20 remove_watcher() i=1 2024-09-12T00:50:40.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.263+0000 7fb5a0139800 20 remove_watcher() i=2 2024-09-12T00:50:40.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.264+0000 7fb5a0139800 20 remove_watcher() i=3 2024-09-12T00:50:40.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.264+0000 7fb5a0139800 20 remove_watcher() i=4 2024-09-12T00:50:40.264 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.266+0000 7fb5a0139800 20 remove_watcher() i=5 2024-09-12T00:50:40.265 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.266+0000 7fb5a0139800 20 remove_watcher() i=6 2024-09-12T00:50:40.266 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:40.267+0000 7fb5a0139800 20 remove_watcher() i=7 2024-09-12T00:50:40.277 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-change-reshard-state id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:50:40.278 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.280 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.298 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.490 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.490 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.626 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:50:40.627 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:40.627 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.627 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.676 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.676 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.733 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.733 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.766 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.766 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.800 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.800 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.834 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.835 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.871 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.871 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.904 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.904 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.938 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.939 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:40.972 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:40.972 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.007 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.007 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.041 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.041 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.075 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.075 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.108 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.108 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.142 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.143 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.176 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.176 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.210 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.210 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.244 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.244 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.279 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.279 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.313 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.313 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.347 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.347 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.382 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:41.382 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:41.416 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:50:41.445 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:41.445 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:41.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.486+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.488+0000 7fdd12c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:41.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.488+0000 7fdd12c98800 20 realm 2024-09-12T00:50:41.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.488+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.488+0000 7fdd12c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:41.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.488+0000 7fdd12c98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:41.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.488+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.488+0000 7fdd12c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:41.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.488+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.489+0000 7fdd12c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:41.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.489+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.489+0000 7fdd12c98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:41.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.489+0000 7fdd12c98800 20 searching for the correct realm 2024-09-12T00:50:41.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.493+0000 7fdd0ff81640 0 -- 172.21.15.19:0/3065622631 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fdd040a59e0 msgr2=0x7fdd040db7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:41.696 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.697+0000 7fdd10f83640 0 -- 172.21.15.19:0/3065622631 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5613a3991f70 msgr2=0x5613a3994380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:41.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.702+0000 7fdd12c98800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:41.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.702+0000 7fdd12c98800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:41.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.702+0000 7fdd12c98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:41.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.702+0000 7fdd12c98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:41.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.702+0000 7fdd12c98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:41.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.702+0000 7fdd12c98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:41.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.702+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.702+0000 7fdd12c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:41.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.702+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.702+0000 7fdd12c98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:41.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.702+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:41.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 20 zone default found 2024-09-12T00:50:41.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 4 Realm: () 2024-09-12T00:50:41.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:41.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:41.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:41.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 20 zonegroup default 2024-09-12T00:50:41.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:41.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:41.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.703+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.704+0000 7fdd12c98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:41.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.704+0000 7fdd12c98800 20 started sync module instance, tier type = 2024-09-12T00:50:41.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.704+0000 7fdd12c98800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:41.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.712+0000 7fdd12c98800 20 add_watcher() i=0 2024-09-12T00:50:41.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.712+0000 7fdd12c98800 20 add_watcher() i=1 2024-09-12T00:50:41.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.712+0000 7fdd12c98800 20 add_watcher() i=2 2024-09-12T00:50:41.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.712+0000 7fdd12c98800 20 add_watcher() i=3 2024-09-12T00:50:41.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.712+0000 7fdd12c98800 20 add_watcher() i=4 2024-09-12T00:50:41.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.712+0000 7fdd12c98800 20 add_watcher() i=5 2024-09-12T00:50:41.711 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.712+0000 7fdd12c98800 20 add_watcher() i=6 2024-09-12T00:50:41.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.713+0000 7fdd12c98800 20 add_watcher() i=7 2024-09-12T00:50:41.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.713+0000 7fdd12c98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:41.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.715+0000 7fdbc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:41.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.715+0000 7fdd12c98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:41.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.715+0000 7fdd12c98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:41.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.715+0000 7fdd12c98800 5 note: GC not initialized 2024-09-12T00:50:41.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.716+0000 7fdbc5fdb640 20 reqs_thread_entry: start 2024-09-12T00:50:41.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.716+0000 7fdd12c98800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:41.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.716+0000 7fdd12c98800 20 Filter name: none 2024-09-12T00:50:41.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.716+0000 7fdb377fe640 20 reqs_thread_entry: start 2024-09-12T00:50:41.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.716+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.717+0000 7fdd12c98800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:41.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.717+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.717+0000 7fdd12c98800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:41.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.717+0000 7fdd12c98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:41.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.717+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.717+0000 7fdd12c98800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:41.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.717+0000 7fdd12c98800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.718+0000 7fdd12c98800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:41.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.718+0000 7fdd12c98800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:41.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.720+0000 7fdbc6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:41.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.722+0000 7fdd12c98800 20 remove_watcher() i=0 2024-09-12T00:50:41.720 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.722+0000 7fdd12c98800 2 removed watcher, disabling cache 2024-09-12T00:50:41.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.723+0000 7fdd12c98800 20 remove_watcher() i=1 2024-09-12T00:50:41.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.724+0000 7fdd12c98800 20 remove_watcher() i=2 2024-09-12T00:50:41.724 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.725+0000 7fdd12c98800 20 remove_watcher() i=3 2024-09-12T00:50:41.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.726+0000 7fdd12c98800 20 remove_watcher() i=4 2024-09-12T00:50:41.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.727+0000 7fdd12c98800 20 remove_watcher() i=5 2024-09-12T00:50:41.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.729+0000 7fdd12c98800 20 remove_watcher() i=6 2024-09-12T00:50:41.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.730+0000 7fdd12c98800 20 remove_watcher() i=7 2024-09-12T00:50:41.739 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:41.740 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:41.740 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-change-reshard-state id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:50:41.740 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:41.742 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:50:41.778 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:41.779 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:41.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.820+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.821+0000 7f262f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:41.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.821+0000 7f262f60e800 20 realm 2024-09-12T00:50:41.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.821+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.821+0000 7f262f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:41.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.821+0000 7f262f60e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:41.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.821+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.822+0000 7f262f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:41.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.822+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.822+0000 7f262f60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:41.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.822+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:41.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.823+0000 7f262f60e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:41.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.823+0000 7f262f60e800 20 searching for the correct realm 2024-09-12T00:50:41.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:41.826+0000 7f262a56a640 0 -- 172.21.15.19:0/67402953 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f262001f920 msgr2=0x7f262002d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:42.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.032+0000 7f262a56a640 0 -- 172.21.15.19:0/67402953 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55deb8ea9d90 msgr2=0x55deb8eac250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:42.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:42.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:42.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:42.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:42.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:42.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:42.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:42.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:42.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:42.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 zone default found 2024-09-12T00:50:42.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 4 Realm: () 2024-09-12T00:50:42.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:42.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:42.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:42.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 zonegroup default 2024-09-12T00:50:42.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.037+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.038+0000 7f262f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:42.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.038+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.038+0000 7f262f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:42.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.038+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.039+0000 7f262f60e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:42.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.039+0000 7f262f60e800 20 started sync module instance, tier type = 2024-09-12T00:50:42.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.039+0000 7f262f60e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:42.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.048+0000 7f262f60e800 20 add_watcher() i=0 2024-09-12T00:50:42.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.048+0000 7f262f60e800 20 add_watcher() i=1 2024-09-12T00:50:42.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.048+0000 7f262f60e800 20 add_watcher() i=2 2024-09-12T00:50:42.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.048+0000 7f262f60e800 20 add_watcher() i=3 2024-09-12T00:50:42.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.048+0000 7f262f60e800 20 add_watcher() i=4 2024-09-12T00:50:42.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.048+0000 7f262f60e800 20 add_watcher() i=5 2024-09-12T00:50:42.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.048+0000 7f262f60e800 20 add_watcher() i=6 2024-09-12T00:50:42.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.049+0000 7f262f60e800 20 add_watcher() i=7 2024-09-12T00:50:42.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.049+0000 7f262f60e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:42.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.051+0000 7f24e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:42.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.052+0000 7f262f60e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:42.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.052+0000 7f262f60e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:42.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.052+0000 7f262f60e800 5 note: GC not initialized 2024-09-12T00:50:42.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.052+0000 7f245bfff640 20 reqs_thread_entry: start 2024-09-12T00:50:42.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.052+0000 7f262f60e800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:42.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.052+0000 7f262f60e800 20 Filter name: none 2024-09-12T00:50:42.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.052+0000 7f2459ffb640 20 reqs_thread_entry: start 2024-09-12T00:50:42.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.052+0000 7f262f60e800 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:50:42.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.052+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.053+0000 7f262f60e800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:42.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.053+0000 7f262f60e800 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:50:42.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.053+0000 7f262f60e800 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:50:42.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.053+0000 7f262f60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 : miss 2024-09-12T00:50:42.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.053+0000 7f262f60e800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.053+0000 7f262f60e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:42.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.053+0000 7f262f60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 info.flags=0x17 2024-09-12T00:50:42.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.053+0000 7f262f60e800 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 to cache LRU end 2024-09-12T00:50:42.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.053+0000 7f262f60e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:42.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.053+0000 7f262f60e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:42.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.053+0000 7f262f60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 2024-09-12T00:50:42.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.058+0000 7f262f60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 info.flags=0x17 2024-09-12T00:50:42.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.058+0000 7f262f60e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 to cache LRU end 2024-09-12T00:50:42.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.058+0000 7f262f60e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:42.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.058+0000 7f262f60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38, ofs0, ns] 2024-09-12T00:50:42.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.059+0000 7f250dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398974 cookie 94415073534624 notifier 7914 bl.length()=931 2024-09-12T00:50:42.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.059+0000 7f250dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 info.flags=0x17 2024-09-12T00:50:42.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.059+0000 7f250dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 to cache LRU end 2024-09-12T00:50:42.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.059+0000 7f250dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:42.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.060+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): orig_sources= new_sources= 2024-09-12T00:50:42.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.060+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): potential sources added=[] removed=[] 2024-09-12T00:50:42.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.060+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): orig_dests= new_dests= 2024-09-12T00:50:42.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.060+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): potential dests added=[] removed=[] 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.0 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.0 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.1 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.1 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.2 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.2 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.3 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.3 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.4 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.4 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.5 2024-09-12T00:50:42.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.5 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.6 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.6 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.7 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.7 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.8 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.8 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.9 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.9 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.10 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.10 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.11 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1.11 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.0 2024-09-12T00:50:42.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.066+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1 2024-09-12T00:50:42.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.067+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.2 2024-09-12T00:50:42.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.067+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.3 2024-09-12T00:50:42.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.068+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.4 2024-09-12T00:50:42.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.068+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.5 2024-09-12T00:50:42.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.069+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.6 2024-09-12T00:50:42.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.070+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.7 2024-09-12T00:50:42.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.070+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.8 2024-09-12T00:50:42.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.071+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.9 2024-09-12T00:50:42.072 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.072+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.10 2024-09-12T00:50:42.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.074+0000 7f262f60e800 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:50:42.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.074+0000 7f262f60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:42.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.074+0000 7f262f60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 2024-09-12T00:50:42.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.076+0000 7f262f60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 info.flags=0x17 2024-09-12T00:50:42.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.076+0000 7f262f60e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 to cache LRU end 2024-09-12T00:50:42.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.076+0000 7f262f60e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:42.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.076+0000 7f262f60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38, ofs0, ns] 2024-09-12T00:50:42.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.076+0000 7f250dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398975 cookie 94415073534624 notifier 7914 bl.length()=931 2024-09-12T00:50:42.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.076+0000 7f250dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 info.flags=0x17 2024-09-12T00:50:42.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.076+0000 7f250dffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 to cache LRU end 2024-09-12T00:50:42.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.076+0000 7f250dffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:42.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.077+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): orig_sources= new_sources= 2024-09-12T00:50:42.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.077+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): potential sources added=[] removed=[] 2024-09-12T00:50:42.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.077+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): orig_dests= new_dests= 2024-09-12T00:50:42.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.077+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): potential dests added=[] removed=[] 2024-09-12T00:50:42.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.080+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.0 2024-09-12T00:50:42.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.080+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.1 2024-09-12T00:50:42.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.081+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.2 2024-09-12T00:50:42.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.081+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.3 2024-09-12T00:50:42.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.081+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.4 2024-09-12T00:50:42.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.081+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.5 2024-09-12T00:50:42.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.082+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.6 2024-09-12T00:50:42.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.082+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.7 2024-09-12T00:50:42.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.083+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.8 2024-09-12T00:50:42.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.083+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.9 2024-09-12T00:50:42.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.083+0000 7f262f60e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38.10 2024-09-12T00:50:42.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.084+0000 7f262f60e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:50:42.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.084+0000 7f262f60e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 2024-09-12T00:50:42.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.085+0000 7f262f60e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 info.flags=0x17 2024-09-12T00:50:42.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.085+0000 7f262f60e800 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 to cache LRU end 2024-09-12T00:50:42.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.085+0000 7f262f60e800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:42.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.085+0000 7f262f60e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38, ofs0, ns] 2024-09-12T00:50:42.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.085+0000 7f250e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398976 cookie 94415073534624 notifier 7914 bl.length()=899 2024-09-12T00:50:42.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.085+0000 7f250e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 info.flags=0x17 2024-09-12T00:50:42.084 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.085+0000 7f250e7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 to cache LRU end 2024-09-12T00:50:42.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.085+0000 7f250e7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:42.085 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.087+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): orig_sources= new_sources= 2024-09-12T00:50:42.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.087+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): potential sources added=[] removed=[] 2024-09-12T00:50:42.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.087+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): orig_dests= new_dests= 2024-09-12T00:50:42.086 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.087+0000 7f262f60e800 20 handle_bi_update(): bucket=:error-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38]): potential dests added=[] removed=[] 2024-09-12T00:50:42.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.090+0000 7f262f60e800 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:50:42.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.092+0000 7f24e17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:42.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.095+0000 7f262f60e800 20 remove_watcher() i=0 2024-09-12T00:50:42.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.095+0000 7f262f60e800 2 removed watcher, disabling cache 2024-09-12T00:50:42.094 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.096+0000 7f262f60e800 20 remove_watcher() i=1 2024-09-12T00:50:42.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.097+0000 7f262f60e800 20 remove_watcher() i=2 2024-09-12T00:50:42.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.098+0000 7f262f60e800 20 remove_watcher() i=3 2024-09-12T00:50:42.097 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.099+0000 7f262f60e800 20 remove_watcher() i=4 2024-09-12T00:50:42.098 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.100+0000 7f262f60e800 20 remove_watcher() i=5 2024-09-12T00:50:42.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.101+0000 7f262f60e800 20 remove_watcher() i=6 2024-09-12T00:50:42.101 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.102+0000 7f262f60e800 20 remove_watcher() i=7 2024-09-12T00:50:42.113 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:50:42.143 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:42.143 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:42.182 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.183+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.185+0000 7f3b17325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:42.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.185+0000 7f3b17325800 20 realm 2024-09-12T00:50:42.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.185+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.185+0000 7f3b17325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:42.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.185+0000 7f3b17325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:42.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.185+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.185+0000 7f3b17325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:42.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.185+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.186+0000 7f3b17325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:42.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.186+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.186+0000 7f3b17325800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:42.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.186+0000 7f3b17325800 20 searching for the correct realm 2024-09-12T00:50:42.188 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.189+0000 7f3b127b4640 0 -- 172.21.15.19:0/980670726 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3b08074290 msgr2=0x7f3b08082aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:42.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.394+0000 7f3b137b6640 0 -- 172.21.15.19:0/980670726 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55cc6e9a6e90 msgr2=0x55cc6e9a92f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:42.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.398+0000 7f3b17325800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:42.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.398+0000 7f3b17325800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:42.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.398+0000 7f3b17325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:42.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.398+0000 7f3b17325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:42.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.398+0000 7f3b17325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:42.397 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.398+0000 7f3b17325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:42.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.398+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.398+0000 7f3b17325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:42.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.399+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.399+0000 7f3b17325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:42.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.399+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.399+0000 7f3b17325800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:42.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.399+0000 7f3b17325800 20 zone default found 2024-09-12T00:50:42.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.399+0000 7f3b17325800 4 Realm: () 2024-09-12T00:50:42.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.399+0000 7f3b17325800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:42.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.399+0000 7f3b17325800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:42.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.399+0000 7f3b17325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:42.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.399+0000 7f3b17325800 20 zonegroup default 2024-09-12T00:50:42.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.399+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.400+0000 7f3b17325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:42.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.400+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.400+0000 7f3b17325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:42.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.400+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.400+0000 7f3b17325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:42.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.400+0000 7f3b17325800 20 started sync module instance, tier type = 2024-09-12T00:50:42.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.400+0000 7f3b17325800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:42.407 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.409+0000 7f3b17325800 20 add_watcher() i=0 2024-09-12T00:50:42.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.409+0000 7f3b17325800 20 add_watcher() i=1 2024-09-12T00:50:42.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.409+0000 7f3b17325800 20 add_watcher() i=2 2024-09-12T00:50:42.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.409+0000 7f3b17325800 20 add_watcher() i=3 2024-09-12T00:50:42.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.409+0000 7f3b17325800 20 add_watcher() i=4 2024-09-12T00:50:42.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.409+0000 7f3b17325800 20 add_watcher() i=5 2024-09-12T00:50:42.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.409+0000 7f3b17325800 20 add_watcher() i=6 2024-09-12T00:50:42.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.410+0000 7f3b17325800 20 add_watcher() i=7 2024-09-12T00:50:42.408 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.410+0000 7f3b17325800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:42.410 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.411+0000 7f39c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:42.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.411+0000 7f3b17325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:42.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.411+0000 7f3b17325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:42.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.412+0000 7f3b17325800 5 note: GC not initialized 2024-09-12T00:50:42.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.412+0000 7f3943fff640 20 reqs_thread_entry: start 2024-09-12T00:50:42.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.412+0000 7f3b17325800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:42.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.412+0000 7f3b17325800 20 Filter name: none 2024-09-12T00:50:42.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.412+0000 7f3941ffb640 20 reqs_thread_entry: start 2024-09-12T00:50:42.411 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.412+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.412+0000 7f3b17325800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:42.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.412+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.413+0000 7f3b17325800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:42.412 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.413+0000 7f3b17325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:42.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.413+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.413+0000 7f3b17325800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:42.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.413+0000 7f3b17325800 20 rados->read ofs=0 len=0 2024-09-12T00:50:42.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.414+0000 7f3b17325800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:42.413 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.414+0000 7f3b17325800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:42.414 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.415+0000 7f39c97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:42.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.418+0000 7f3b17325800 20 remove_watcher() i=0 2024-09-12T00:50:42.416 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.418+0000 7f3b17325800 2 removed watcher, disabling cache 2024-09-12T00:50:42.418 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.419+0000 7f3b17325800 20 remove_watcher() i=1 2024-09-12T00:50:42.419 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.420+0000 7f3b17325800 20 remove_watcher() i=2 2024-09-12T00:50:42.420 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.422+0000 7f3b17325800 20 remove_watcher() i=3 2024-09-12T00:50:42.421 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.423+0000 7f3b17325800 20 remove_watcher() i=4 2024-09-12T00:50:42.422 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.424+0000 7f3b17325800 20 remove_watcher() i=5 2024-09-12T00:50:42.423 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.425+0000 7f3b17325800 20 remove_watcher() i=6 2024-09-12T00:50:42.424 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:42.426+0000 7f3b17325800 20 remove_watcher() i=7 2024-09-12T00:50:42.435 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:42.435 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:42.436 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: error-at-change-reshard-state id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:50:42.436 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:42.438 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:42.438 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:42.456 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:42.456 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:42.665 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:42.665 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:42.801 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:50:42.801 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:42.803 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:42.803 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:42.851 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:42.851 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:42.908 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:42.908 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:42.946 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:42.946 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:42.980 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:42.980 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.014 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.014 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.053 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.053 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.090 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.090 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.125 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.125 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.160 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.160 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.194 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.194 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.228 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.228 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.262 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.262 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.296 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.297 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.330 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.331 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.364 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.364 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.398 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.398 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.432 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.432 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.466 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.466 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.500 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.500 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.534 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.535 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.568 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:43.568 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:43.603 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:50:43.632 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:43.632 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:43.672 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.673+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.675+0000 7fcc07b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:43.674 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.675+0000 7fcc07b2f800 20 realm 2024-09-12T00:50:43.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.675+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.675+0000 7fcc07b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:43.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.676+0000 7fcc07b2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:43.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.676+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.676+0000 7fcc07b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:43.675 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.676+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.676+0000 7fcc07b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:43.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.676+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.677+0000 7fcc07b2f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:43.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.677+0000 7fcc07b2f800 20 searching for the correct realm 2024-09-12T00:50:43.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.680+0000 7fcc03075640 0 -- 172.21.15.19:0/147425095 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fcbf806a030 msgr2=0x7fcbf8099210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:43.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.886+0000 7fcc04077640 0 -- 172.21.15.19:0/147425095 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x56288a5e5fa0 msgr2=0x56288a5e83d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:43.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.890+0000 7fcc07b2f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:43.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.890+0000 7fcc07b2f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:43.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.890+0000 7fcc07b2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:43.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.890+0000 7fcc07b2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:43.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.890+0000 7fcc07b2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:43.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.890+0000 7fcc07b2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:43.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.890+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.890+0000 7fcc07b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:43.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.890+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.890+0000 7fcc07b2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:43.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.890+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:43.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 20 zone default found 2024-09-12T00:50:43.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 4 Realm: () 2024-09-12T00:50:43.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:43.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:43.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:43.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 20 zonegroup default 2024-09-12T00:50:43.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:43.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:43.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.891+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.892+0000 7fcc07b2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:43.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.892+0000 7fcc07b2f800 20 started sync module instance, tier type = 2024-09-12T00:50:43.892 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.892+0000 7fcc07b2f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:43.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.901+0000 7fcc07b2f800 20 add_watcher() i=0 2024-09-12T00:50:43.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.901+0000 7fcc07b2f800 20 add_watcher() i=1 2024-09-12T00:50:43.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.901+0000 7fcc07b2f800 20 add_watcher() i=2 2024-09-12T00:50:43.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.901+0000 7fcc07b2f800 20 add_watcher() i=3 2024-09-12T00:50:43.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.901+0000 7fcc07b2f800 20 add_watcher() i=4 2024-09-12T00:50:43.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.901+0000 7fcc07b2f800 20 add_watcher() i=5 2024-09-12T00:50:43.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.901+0000 7fcc07b2f800 20 add_watcher() i=6 2024-09-12T00:50:43.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.902+0000 7fcc07b2f800 20 add_watcher() i=7 2024-09-12T00:50:43.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.902+0000 7fcc07b2f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:43.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.904+0000 7fcab9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:43.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.904+0000 7fcc07b2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:43.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.904+0000 7fcc07b2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:43.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.904+0000 7fcc07b2f800 5 note: GC not initialized 2024-09-12T00:50:43.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.904+0000 7fcab8fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:43.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.904+0000 7fcc07b2f800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:43.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.904+0000 7fcc07b2f800 20 Filter name: none 2024-09-12T00:50:43.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.904+0000 7fca327fc640 20 reqs_thread_entry: start 2024-09-12T00:50:43.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.905+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.905+0000 7fcc07b2f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:43.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.905+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.906+0000 7fcc07b2f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:43.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.906+0000 7fcc07b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:43.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.906+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.906+0000 7fcc07b2f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:43.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.906+0000 7fcc07b2f800 20 rados->read ofs=0 len=0 2024-09-12T00:50:43.906 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.906+0000 7fcc07b2f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:43.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.906+0000 7fcc07b2f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:43.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.908+0000 7fcab9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:43.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.910+0000 7fcc07b2f800 20 remove_watcher() i=0 2024-09-12T00:50:43.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.910+0000 7fcc07b2f800 2 removed watcher, disabling cache 2024-09-12T00:50:43.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.911+0000 7fcc07b2f800 20 remove_watcher() i=1 2024-09-12T00:50:43.911 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.912+0000 7fcc07b2f800 20 remove_watcher() i=2 2024-09-12T00:50:43.912 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.913+0000 7fcc07b2f800 20 remove_watcher() i=3 2024-09-12T00:50:43.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.914+0000 7fcc07b2f800 20 remove_watcher() i=4 2024-09-12T00:50:43.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.915+0000 7fcc07b2f800 20 remove_watcher() i=5 2024-09-12T00:50:43.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.916+0000 7fcc07b2f800 20 remove_watcher() i=6 2024-09-12T00:50:43.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:43.917+0000 7fcc07b2f800 20 remove_watcher() i=7 2024-09-12T00:50:43.927 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:43.927 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:43.927 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-change-reshard-state id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:50:43.928 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:43.929 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:50:43.964 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:43.964 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:44.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.005+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.006+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.006+0000 7f3ea0615800 20 realm 2024-09-12T00:50:44.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.006+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.007+0000 7f3ea0615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:44.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.008+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:44.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.008+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.008+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:44.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.008+0000 7f3ea0615800 20 searching for the correct realm 2024-09-12T00:50:44.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.012+0000 7f3e9b591640 0 -- 172.21.15.19:0/2443635072 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3e900612d0 msgr2=0x7f3e90087a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:44.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.015+0000 7f3e9bd92640 0 -- 172.21.15.19:0/2443635072 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f3e94065380 msgr2=0x7f3e94063df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:44.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:44.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:44.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:44.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:44.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:44.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:44.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.019+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.019+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.019+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.020+0000 7f3ea0615800 20 zone default found 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.020+0000 7f3ea0615800 4 Realm: () 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.020+0000 7f3ea0615800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.020+0000 7f3ea0615800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.020+0000 7f3ea0615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.020+0000 7f3ea0615800 20 zonegroup default 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.021+0000 7f3ea0615800 20 started sync module instance, tier type = 2024-09-12T00:50:44.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.021+0000 7f3ea0615800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:44.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=0 2024-09-12T00:50:44.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=1 2024-09-12T00:50:44.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=2 2024-09-12T00:50:44.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=3 2024-09-12T00:50:44.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=4 2024-09-12T00:50:44.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=5 2024-09-12T00:50:44.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=6 2024-09-12T00:50:44.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.031+0000 7f3ea0615800 20 add_watcher() i=7 2024-09-12T00:50:44.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.031+0000 7f3ea0615800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:44.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.033+0000 7f3d51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:44.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.034+0000 7f3ea0615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:44.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.034+0000 7f3ea0615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:44.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.034+0000 7f3ea0615800 5 note: GC not initialized 2024-09-12T00:50:44.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.034+0000 7f3d50fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:44.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.034+0000 7f3ea0615800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:44.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.034+0000 7f3ea0615800 20 Filter name: none 2024-09-12T00:50:44.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.034+0000 7f3cca7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:44.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.034+0000 7f3ea0615800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:50:44.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.034+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.035+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:44.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.035+0000 7f3ea0615800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:50:44.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.035+0000 7f3ea0615800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:50:44.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.035+0000 7f3ea0615800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 : miss 2024-09-12T00:50:44.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.035+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.035+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:44.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.035+0000 7f3ea0615800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:50:44.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.035+0000 7f3ea0615800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:50:44.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.035+0000 7f3ea0615800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:44.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.035+0000 7f3ea0615800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:44.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.035+0000 7f3ea0615800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 2024-09-12T00:50:44.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.040+0000 7f3ea0615800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:50:44.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.040+0000 7f3ea0615800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:50:44.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.040+0000 7f3ea0615800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:44.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.040+0000 7f3ea0615800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39, ofs0, ns] 2024-09-12T00:50:44.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398885 cookie 94368805141296 notifier 7466 bl.length()=931 2024-09-12T00:50:44.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:50:44.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:50:44.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:44.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_sources= new_sources= 2024-09-12T00:50:44.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential sources added=[] removed=[] 2024-09-12T00:50:44.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_dests= new_dests= 2024-09-12T00:50:44.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential dests added=[] removed=[] 2024-09-12T00:50:44.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.0 2024-09-12T00:50:44.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.0 2024-09-12T00:50:44.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.1 2024-09-12T00:50:44.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.1 2024-09-12T00:50:44.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.2 2024-09-12T00:50:44.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.2 2024-09-12T00:50:44.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.3 2024-09-12T00:50:44.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.3 2024-09-12T00:50:44.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.4 2024-09-12T00:50:44.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.4 2024-09-12T00:50:44.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.5 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.5 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.6 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.6 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.7 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.7 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.8 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.8 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.9 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.9 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.10 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.10 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.11 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.11 2024-09-12T00:50:44.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.0 2024-09-12T00:50:44.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1 2024-09-12T00:50:44.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.047+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2 2024-09-12T00:50:44.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.047+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.3 2024-09-12T00:50:44.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.048+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.4 2024-09-12T00:50:44.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.048+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.5 2024-09-12T00:50:44.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.049+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.6 2024-09-12T00:50:44.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.049+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.7 2024-09-12T00:50:44.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.050+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.8 2024-09-12T00:50:44.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.050+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.9 2024-09-12T00:50:44.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.051+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.10 2024-09-12T00:50:44.052 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ea0615800 time 2024-09-12T00:50:44.054812+0000 2024-09-12T00:50:44.052 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:44.053 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:44.053 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3ea178c71a] 2024-09-12T00:50:44.053 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3ea178c8d8] 2024-09-12T00:50:44.053 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d3f17cd641] 2024-09-12T00:50:44.053 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55d3f17dc51b] 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d3f17dd3e4] 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3ea0429590] 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.054+0000 7f3ea0615800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ea0615800 time 2024-09-12T00:50:44.054812+0000 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3ea178c71a] 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3ea178c8d8] 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d3f17cd641] 2024-09-12T00:50:44.054 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55d3f17dc51b] 2024-09-12T00:50:44.055 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d3f17dd3e4] 2024-09-12T00:50:44.055 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:50:44.055 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3ea0429590] 2024-09-12T00:50:44.055 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:50:44.055 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:50:44.055 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.055 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:50:44.055 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f3ea0615800 thread_name:radosgw-admin 2024-09-12T00:50:44.075 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:44.075 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3ea043e6f0] 2024-09-12T00:50:44.075 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3ea048b99c] 2024-09-12T00:50:44.075 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:50:44.075 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:50:44.075 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3ea178c774] 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3ea178c8d8] 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d3f17cd641] 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55d3f17dc51b] 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d3f17dd3e4] 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3ea0429590] 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.055+0000 7f3ea0615800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f3ea0615800 thread_name:radosgw-admin 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:44.076 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3ea043e6f0] 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3ea048b99c] 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3ea178c774] 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3ea178c8d8] 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d3f17cd641] 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55d3f17dc51b] 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d3f17dd3e4] 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3ea0429590] 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:50:44.077 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: secure 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: crc 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: crc 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: secure 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: crc 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: secure 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: crc 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: secure 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:50:43.988+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:50:43.989+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.078 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:50:43.989+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command rotate-key hook 0x55d3f30c4658 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-b con 0x55d3f2f7b180 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-c con 0x55d3f2fff710 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-a con 0x55d3f3009d40 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): authenticate will time out at 2310.491161s 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): get_auth_request con 0x55d3f2fff710 auth_method 0 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.079 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): get_auth_request con 0x55d3f3009d40 auth_method 0 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:50:43.989+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request con 0x55d3f2f7b180 auth_method 0 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:50:43.989+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.080 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:50:43.989+0000 7f3e9bd92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:50:43.989+0000 7f3e9bd92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): handle_auth_done global_id 7457 payload 824 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient: _finish_hunting 0 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:50:43.989+0000 7f3e9b591640 1 monclient: found mon.noname-c 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: dump: 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.081 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: _finish_auth 0 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: _check_auth_tickets 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: dump: 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.082 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:50:43.989+0000 7f3ea0615800 5 monclient: authenticate success, global_id 7457 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:50:43.989+0000 7f3d89e0b640 4 set_mon_vals no callback set 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.083 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:50:43.989+0000 7f3ea0615800 1 librados: init done 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:50:43.991+0000 7f3d83fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:50:43.991+0000 7f3d83fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:50:43.991+0000 7f3d83fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:50:43.992+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3d84076470 auth_method 0 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:50:43.992+0000 7f3e9c593640 10 monclient: get_auth_request con 0x55d3f310ccf0 auth_method 0 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:50:43.992+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x55d3f310fed0 auth_method 0 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:50:43.994+0000 7f3e9b591640 10 monclient: get_auth_request con 0x55d3f3114f60 auth_method 0 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:50:43.995+0000 7f3ea0615800 10 monclient: build_initial_monmap 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:50:43.995+0000 7f3ea0615800 1 build_initial for_mkfs: 0 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:50:43.995+0000 7f3ea0615800 10 monclient: monmap: 2024-09-12T00:50:44.084 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding auth protocol: cephx 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding auth protocol: cephx 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding auth protocol: cephx 2024-09-12T00:50:44.085 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:50:43.995+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command objecter_requests cmddesc objecter_requests hook 0x55d3f311c7c0 EEXIST 2024-09-12T00:50:44.086 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:50:43.995+0000 7f3ea0615800 10 monclient: init 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding auth protocol: cephx 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding auth protocol: cephx 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding auth protocol: cephx 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.087 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.088 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.088 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:50:43.996+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.088 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:50:43.996+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.088 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:50:43.996+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command rotate-key cmddesc rotate-key hook 0x55d3f3117e30 EEXIST 2024-09-12T00:50:44.088 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:44.088 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:44.088 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-a con 0x55d3f31404b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:44.088 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-c con 0x55d3f3142780 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:44.088 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-b con 0x55d3f313ec80 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:44.088 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.089 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.089 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.089 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:44.089 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): authenticate will time out at 2310.498502s 2024-09-12T00:50:44.089 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): get_auth_request con 0x55d3f3142780 auth_method 0 2024-09-12T00:50:44.089 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.089 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.089 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.089 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request con 0x55d3f31404b0 auth_method 0 2024-09-12T00:50:44.089 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): get_auth_request con 0x55d3f313ec80 auth_method 0 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.090 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): handle_auth_done global_id 7460 payload 824 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient: _finish_hunting 0 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:50:43.996+0000 7f3e9b591640 1 monclient: found mon.noname-c 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: dump: 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.091 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: _finish_auth 0 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: _check_auth_tickets 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:44.092 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: dump: 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:50:43.997+0000 7f3ea0615800 5 monclient: authenticate success, global_id 7460 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:50:43.997+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:50:43.997+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.093 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:50:43.997+0000 7f3e9cd94640 4 set_mon_vals no callback set 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:50:43.997+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:50:43.997+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:50:43.999+0000 7f3d817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:50:43.999+0000 7f3d817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:50:43.999+0000 7f3d817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:50:43.999+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3d74076380 auth_method 0 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:50:43.999+0000 7f3ea0615800 10 monclient: get_monmap_and_config 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:50:43.999+0000 7f3ea0615800 10 monclient: build_initial_monmap 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:50:43.999+0000 7f3ea0615800 1 build_initial for_mkfs: 0 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:50:43.999+0000 7f3ea0615800 10 monclient: monmap: 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:44.094 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding auth protocol: cephx 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding auth protocol: cephx 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding auth protocol: cephx 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.095 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:50:43.999+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:50:43.999+0000 7f3ea0615800 10 monclient: init 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding auth protocol: cephx 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding auth protocol: cephx 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding auth protocol: cephx 2024-09-12T00:50:44.096 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:50:44.000+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.097 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:50:44.000+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:50:44.000+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command rotate-key cmddesc rotate-key hook 0x7ffeb48d7a18 EEXIST 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-b con 0x55d3f3194540 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-a con 0x55d3f318eae0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-c con 0x55d3f3164380 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): authenticate will time out at 2310.502474s 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): get_auth_request con 0x55d3f318eae0 auth_method 0 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.098 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): get_auth_request con 0x55d3f3164380 auth_method 0 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:50:44.000+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request con 0x55d3f3194540 auth_method 0 2024-09-12T00:50:44.099 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:50:44.000+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:50:44.000+0000 7f3e9bd92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:50:44.000+0000 7f3e9bd92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): handle_auth_done global_id 7965 payload 274 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient: _finish_hunting 0 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:50:44.000+0000 7f3e9b591640 1 monclient: found mon.noname-a 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: dump: 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.100 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: _finish_auth 0 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 monclient: authenticate success, global_id 7965 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:50:44.001+0000 7f3ea0615800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:50:44.001+0000 7f3ea0615800 4 set_mon_vals no callback set 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.101 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: dump: 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:50:44.001+0000 7f3ea0615800 10 monclient: shutdown 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:50:44.001+0000 7f3ea0615800 10 monclient: build_initial_monmap 2024-09-12T00:50:44.102 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:50:44.001+0000 7f3ea0615800 1 build_initial for_mkfs: 0 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:50:44.001+0000 7f3ea0615800 10 monclient: monmap: 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding auth protocol: cephx 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding auth protocol: cephx 2024-09-12T00:50:44.103 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding auth protocol: cephx 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:50:44.001+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.104 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:50:44.001+0000 7f3ea0615800 1 librados: starting msgr at 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:50:44.001+0000 7f3ea0615800 1 librados: starting objecter 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command objecter_requests cmddesc objecter_requests hook 0x55d3f315fc90 EEXIST 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:50:44.002+0000 7f3ea0615800 1 librados: setting wanted keys 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:50:44.002+0000 7f3ea0615800 1 librados: calling monclient init 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient: init 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding auth protocol: cephx 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding auth protocol: cephx 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding auth protocol: cephx 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.105 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:50:44.002+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:50:44.002+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command rotate-key cmddesc rotate-key hook 0x55d3f31583a8 EEXIST 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-a con 0x55d3f3164380 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-b con 0x55d3f318eae0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:44.106 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-c con 0x55d3f3194540 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): authenticate will time out at 2310.504704s 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request con 0x55d3f3164380 auth_method 0 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): get_auth_request con 0x55d3f3194540 auth_method 0 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.107 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:50:44.002+0000 7f3e9b591640 10 monclient(hunting): get_auth_request con 0x55d3f318eae0 auth_method 0 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:50:44.002+0000 7f3e9b591640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:50:44.002+0000 7f3e9b591640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:50:44.002+0000 7f3e9b591640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:50:44.003+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:50:44.003+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:50:44.003+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:50:44.003+0000 7f3e9c593640 10 monclient(hunting): handle_auth_done global_id 7466 payload 824 2024-09-12T00:50:44.108 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:50:44.003+0000 7f3e9c593640 10 monclient: _finish_hunting 0 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:50:44.003+0000 7f3e9c593640 1 monclient: found mon.noname-c 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:50:44.003+0000 7f3e9c593640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: dump: 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.109 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.110 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.110 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.110 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: _finish_auth 0 2024-09-12T00:50:44.110 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: _check_auth_tickets 2024-09-12T00:50:44.110 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:44.110 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.110 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:44.110 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: dump: 2024-09-12T00:50:44.110 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.110 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.112 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.112 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.112 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.112 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.112 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.112 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.112 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.112 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:50:44.003+0000 7f3ea0615800 5 monclient: authenticate success, global_id 7466 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:50:44.003+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:50:44.003+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:50:44.003+0000 7f3d7affd640 4 set_mon_vals no callback set 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:50:44.003+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:50:44.003+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:50:44.003+0000 7f3ea0615800 1 librados: init done 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:50:44.003+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command cr dump hook 0x55d3f315fe98 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:50:44.005+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:50:44.005+0000 7f3d797fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:50:44.005+0000 7f3d797fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:50:44.005+0000 7f3d797fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.113 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:50:44.006+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3d64076470 auth_method 0 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:50:44.006+0000 7f3e9b591640 10 monclient: get_auth_request con 0x55d3f31ae440 auth_method 0 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:50:44.006+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:50:44.006+0000 7f3ea0615800 20 realm 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:50:44.006+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:50:44.007+0000 7f3ea0615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:50:44.007+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x55d3f31b2790 auth_method 0 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:50:44.008+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:50:44.008+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:50:44.008+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:44.114 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:50:44.008+0000 7f3ea0615800 20 searching for the correct realm 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:50:44.008+0000 7f3e9b591640 10 monclient: get_auth_request con 0x55d3f31b7a50 auth_method 0 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:50:44.009+0000 7f3e9c593640 10 monclient: get_auth_request con 0x7f3e90027020 auth_method 0 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:50:44.010+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3e8c08d400 auth_method 0 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:50:44.011+0000 7f3e9b591640 10 monclient: get_auth_request con 0x7f3e900612d0 auth_method 0 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:50:44.012+0000 7f3e9b591640 0 -- 172.21.15.19:0/2443635072 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3e900612d0 msgr2=0x7f3e90087a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:50:44.012+0000 7f3d797fa640 1 client.7466.objecter ms_handle_reset 0x7f3e900612d0 session 0x7f3e90083fe0 osd.5 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:50:44.012+0000 7f3d797fa640 10 monclient: _renew_subs 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:50:44.012+0000 7f3d797fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:50:44.012+0000 7f3e9b591640 10 monclient: get_auth_request con 0x7f3d64086790 auth_method 0 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:50:44.013+0000 7f3e9c593640 10 monclient: get_auth_request con 0x7f3e8c09e930 auth_method 0 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:50:44.014+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3e94065380 auth_method 0 2024-09-12T00:50:44.115 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:50:44.015+0000 7f3e9bd92640 0 -- 172.21.15.19:0/2443635072 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f3e94065380 msgr2=0x7f3e94063df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:50:44.015+0000 7f3d797fa640 1 client.7466.objecter ms_handle_reset 0x7f3e94065380 session 0x7f3e94065120 osd.3 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:50:44.015+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3e900612d0 auth_method 0 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.116 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 zone default found 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:50:44.020+0000 7f3ea0615800 4 Realm: () 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:50:44.020+0000 7f3ea0615800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:50:44.020+0000 7f3ea0615800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:50:44.020+0000 7f3ea0615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 zonegroup default 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.117 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 started sync module instance, tier type = 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=0 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=1 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=2 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=3 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=4 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=5 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=6 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:50:44.031+0000 7f3ea0615800 20 add_watcher() i=7 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:50:44.031+0000 7f3ea0615800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding auth protocol: cephx 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding auth protocol: cephx 2024-09-12T00:50:44.118 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding auth protocol: cephx 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:50:44.033+0000 7f3d51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:44.119 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:50:44.034+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:50:44.034+0000 7f3ea0615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:50:44.034+0000 7f3ea0615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command cache list hook 0x55d3f31828d0 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command cache inspect hook 0x55d3f31828d0 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command cache erase hook 0x55d3f31828d0 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command cache zap hook 0x55d3f31828d0 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 note: GC not initialized 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:50:44.034+0000 7f3d50fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command sync trace show hook 0x7f3e90088070 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command sync trace history hook 0x7f3e90088070 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command sync trace active hook 0x7f3e90088070 2024-09-12T00:50:44.120 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command sync trace active_short hook 0x7f3e90088070 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:50:44.034+0000 7f3ea0615800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:50:44.034+0000 7f3ea0615800 20 Filter name: none 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:50:44.034+0000 7f3cca7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:50:44.034+0000 7f3ea0615800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:50:44.034+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:50:44.035+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 : miss 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:50:44.035+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:50:44.035+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:50:44.121 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:50:44.040+0000 7f3ea0615800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:50:44.040+0000 7f3ea0615800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:50:44.040+0000 7f3ea0615800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:50:44.040+0000 7f3ea0615800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39, ofs0, ns] 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398885 cookie 94368805141296 notifier 7466 bl.length()=931 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_sources= new_sources= 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential sources added=[] removed=[] 2024-09-12T00:50:44.122 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_dests= new_dests= 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential dests added=[] removed=[] 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.0 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.0 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.1 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.1 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.2 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.2 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.3 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.3 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.4 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.4 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.5 2024-09-12T00:50:44.123 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.5 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.6 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.6 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.7 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.7 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.8 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.8 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.9 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.9 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.10 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.10 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.11 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.11 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.0 2024-09-12T00:50:44.124 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:50:44.047+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:50:44.047+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.3 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:50:44.048+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.4 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:50:44.048+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.5 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:50:44.049+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.6 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:50:44.049+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.7 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:50:44.050+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.8 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:50:44.050+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.9 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:50:44.051+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.10 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:50:44.054+0000 7f3ea0615800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ea0615800 time 2024-09-12T00:50:44.054812+0000 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.125 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3ea178c71a] 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3ea178c8d8] 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d3f17cd641] 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55d3f17dc51b] 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d3f17dd3e4] 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3ea0429590] 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:50:44.055+0000 7f3ea0615800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f3ea0615800 thread_name:radosgw-admin 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.126 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3ea043e6f0] 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3ea048b99c] 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3ea178c774] 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3ea178c8d8] 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d3f17cd641] 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55d3f17dc51b] 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d3f17dd3e4] 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3ea0429590] 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:50:44.127 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:44.128 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:50:44.129 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:50:44.130 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:50:44.131 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:50:44.132 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:44.133 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:44.134 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3cca7fc640 / http_manager 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d50fe1640 / http_manager 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d51fe3640 / rgw_dt_lg_renew 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d797fa640 / ms_dispatch 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d7affd640 / io_context_pool 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d817fa640 / ms_dispatch 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d83fff640 / ms_dispatch 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d89e0b640 / io_context_pool 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3e9b591640 / msgr-worker-2 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3e9bd92640 / msgr-worker-1 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3e9c593640 / msgr-worker-0 2024-09-12T00:50:44.135 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3e9cd94640 / io_context_pool 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3ea0615800 / radosgw-admin 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.141734.log 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: secure 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: crc 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: crc 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: secure 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: crc 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: secure 2024-09-12T00:50:44.136 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: crc 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:50:43.988+0000 7f3ea0615800 5 AuthRegistry(0x55d3f30c4510) adding con mode: secure 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:50:43.988+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:50:43.989+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:50:43.989+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command rotate-key hook 0x55d3f30c4658 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-b con 0x55d3f2f7b180 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-c con 0x55d3f2fff710 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-a con 0x55d3f3009d40 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:44.137 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient(hunting): authenticate will time out at 2310.491161s 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): get_auth_request con 0x55d3f2fff710 auth_method 0 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): get_auth_request con 0x55d3f3009d40 auth_method 0 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.138 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:50:43.989+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:50:43.989+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request con 0x55d3f2f7b180 auth_method 0 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:50:43.989+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:50:43.989+0000 7f3e9bd92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:50:43.989+0000 7f3e9bd92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient(hunting): handle_auth_done global_id 7457 payload 824 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient: _finish_hunting 0 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:50:43.989+0000 7f3e9b591640 1 monclient: found mon.noname-c 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:50:43.989+0000 7f3e9b591640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: dump: 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.139 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: _finish_auth 0 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: _check_auth_tickets 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.140 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:50:43.989+0000 7f3d83fff640 10 monclient: dump: 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:50:43.989+0000 7f3ea0615800 5 monclient: authenticate success, global_id 7457 2024-09-12T00:50:44.141 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:50:43.989+0000 7f3d89e0b640 4 set_mon_vals no callback set 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:50:43.989+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:50:43.989+0000 7f3ea0615800 1 librados: init done 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:50:43.991+0000 7f3d83fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:50:43.991+0000 7f3d83fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:50:43.991+0000 7f3d83fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:50:43.992+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3d84076470 auth_method 0 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:50:43.992+0000 7f3e9c593640 10 monclient: get_auth_request con 0x55d3f310ccf0 auth_method 0 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:50:43.992+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x55d3f310fed0 auth_method 0 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:50:43.994+0000 7f3e9b591640 10 monclient: get_auth_request con 0x55d3f3114f60 auth_method 0 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:50:43.995+0000 7f3ea0615800 10 monclient: build_initial_monmap 2024-09-12T00:50:44.142 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:50:43.995+0000 7f3ea0615800 1 build_initial for_mkfs: 0 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:50:43.995+0000 7f3ea0615800 10 monclient: monmap: 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding auth protocol: cephx 2024-09-12T00:50:44.143 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding auth protocol: cephx 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding auth protocol: cephx 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.144 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: crc 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3118d50) adding con mode: secure 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:50:43.995+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command objecter_requests cmddesc objecter_requests hook 0x55d3f311c7c0 EEXIST 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:50:43.995+0000 7f3ea0615800 10 monclient: init 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding auth protocol: cephx 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding auth protocol: cephx 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding auth protocol: cephx 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.145 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: crc 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:50:43.995+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3117ce8) adding con mode: secure 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:50:43.996+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:50:43.996+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:50:43.996+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command rotate-key cmddesc rotate-key hook 0x55d3f3117e30 EEXIST 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-a con 0x55d3f31404b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-c con 0x55d3f3142780 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:44.146 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-b con 0x55d3f313ec80 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:50:43.996+0000 7f3ea0615800 10 monclient(hunting): authenticate will time out at 2310.498502s 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): get_auth_request con 0x55d3f3142780 auth_method 0 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request con 0x55d3f31404b0 auth_method 0 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.147 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): get_auth_request con 0x55d3f313ec80 auth_method 0 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:50:43.996+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.148 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:50:43.996+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient(hunting): handle_auth_done global_id 7460 payload 824 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient: _finish_hunting 0 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:50:43.996+0000 7f3e9b591640 1 monclient: found mon.noname-c 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:50:43.996+0000 7f3e9b591640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: dump: 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.149 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: _finish_auth 0 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: _check_auth_tickets 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:50:43.997+0000 7f3d817fa640 10 monclient: dump: 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.150 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:50:43.997+0000 7f3ea0615800 5 monclient: authenticate success, global_id 7460 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:50:43.997+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:50:43.997+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:50:43.997+0000 7f3e9cd94640 4 set_mon_vals no callback set 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:50:43.997+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:50:43.997+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:50:43.999+0000 7f3d817fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:44.151 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:50:43.999+0000 7f3d817fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:50:43.999+0000 7f3d817fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:50:43.999+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3d74076380 auth_method 0 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:50:43.999+0000 7f3ea0615800 10 monclient: get_monmap_and_config 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:50:43.999+0000 7f3ea0615800 10 monclient: build_initial_monmap 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:50:43.999+0000 7f3ea0615800 1 build_initial for_mkfs: 0 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:50:43.999+0000 7f3ea0615800 10 monclient: monmap: 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:44.152 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding auth protocol: cephx 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding auth protocol: cephx 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding auth protocol: cephx 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.153 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: crc 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x55d3f315ffa0) adding con mode: secure 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:50:43.999+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:50:43.999+0000 7f3ea0615800 10 monclient: init 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding auth protocol: cephx 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding auth protocol: cephx 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding auth protocol: cephx 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.154 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: crc 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:50:43.999+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d78d0) adding con mode: secure 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:50:44.000+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:50:44.000+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:50:44.000+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command rotate-key cmddesc rotate-key hook 0x7ffeb48d7a18 EEXIST 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:50:44.155 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-b con 0x55d3f3194540 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-a con 0x55d3f318eae0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-c con 0x55d3f3164380 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:50:44.000+0000 7f3ea0615800 10 monclient(hunting): authenticate will time out at 2310.502474s 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): get_auth_request con 0x55d3f318eae0 auth_method 0 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.156 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): get_auth_request con 0x55d3f3164380 auth_method 0 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:50:44.000+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:50:44.000+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request con 0x55d3f3194540 auth_method 0 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:50:44.000+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:50:44.000+0000 7f3e9bd92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:50:44.000+0000 7f3e9bd92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.157 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient(hunting): handle_auth_done global_id 7965 payload 274 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient: _finish_hunting 0 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:50:44.000+0000 7f3e9b591640 1 monclient: found mon.noname-a 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:50:44.000+0000 7f3e9b591640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: dump: 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.158 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: _finish_auth 0 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: _check_auth_tickets 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 monclient: authenticate success, global_id 7965 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:50:44.001+0000 7f3ea0615800 10 monclient: get_monmap_and_config success 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:50:44.001+0000 7f3ea0615800 4 set_mon_vals no callback set 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:50:44.001+0000 7f3d7affd640 10 monclient: dump: 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.159 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:50:44.001+0000 7f3ea0615800 10 monclient: shutdown 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:50:44.001+0000 7f3ea0615800 10 monclient: build_initial_monmap 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:50:44.001+0000 7f3ea0615800 1 build_initial for_mkfs: 0 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:50:44.001+0000 7f3ea0615800 10 monclient: monmap: 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:50:44.160 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding auth protocol: cephx 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding auth protocol: cephx 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding auth protocol: cephx 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.161 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: crc 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:50:44.001+0000 7f3ea0615800 5 AuthRegistry(0x55d3f318faa0) adding con mode: secure 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:50:44.001+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:50:44.001+0000 7f3ea0615800 1 librados: starting msgr at 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:50:44.001+0000 7f3ea0615800 1 librados: starting objecter 2024-09-12T00:50:44.162 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command objecter_requests cmddesc objecter_requests hook 0x55d3f315fc90 EEXIST 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:50:44.002+0000 7f3ea0615800 1 librados: setting wanted keys 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:50:44.002+0000 7f3ea0615800 1 librados: calling monclient init 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient: init 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding auth protocol: cephx 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding auth protocol: cephx 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding auth protocol: cephx 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.163 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: crc 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 AuthRegistry(0x55d3f3158260) adding con mode: secure 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:50:44.002+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:50:44.002+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:50:44.002+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command rotate-key cmddesc rotate-key hook 0x55d3f31583a8 EEXIST 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient: _reopen_session rank -1 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-a con 0x55d3f3164380 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-b con 0x55d3f318eae0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): picked mon.noname-c con 0x55d3f3194540 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:50:44.164 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): start opening mon connection 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): _renew_subs 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:50:44.002+0000 7f3ea0615800 10 monclient(hunting): authenticate will time out at 2310.504704s 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request con 0x55d3f3164380 auth_method 0 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): get_auth_request con 0x55d3f3194540 auth_method 0 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.165 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:50:44.002+0000 7f3e9c593640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:50:44.002+0000 7f3e9bd92640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:50:44.002+0000 7f3e9b591640 10 monclient(hunting): get_auth_request con 0x55d3f318eae0 auth_method 0 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:50:44.002+0000 7f3e9b591640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:50:44.002+0000 7f3e9b591640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:50:44.002+0000 7f3e9b591640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:50:44.003+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:50:44.003+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:50:44.003+0000 7f3e9b591640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:50:44.003+0000 7f3e9c593640 10 monclient(hunting): handle_auth_done global_id 7466 payload 824 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:50:44.003+0000 7f3e9c593640 10 monclient: _finish_hunting 0 2024-09-12T00:50:44.166 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:50:44.003+0000 7f3e9c593640 1 monclient: found mon.noname-c 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:50:44.003+0000 7f3e9c593640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: dump: 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.167 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: _finish_auth 0 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: _check_auth_tickets 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:50:44.003+0000 7f3d797fa640 10 monclient: dump: 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:50:44.168 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:50:44.003+0000 7f3ea0615800 5 monclient: authenticate success, global_id 7466 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:50:44.003+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:50:44.003+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:50:44.003+0000 7f3d7affd640 4 set_mon_vals no callback set 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:50:44.003+0000 7f3ea0615800 10 monclient: _renew_subs 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:50:44.003+0000 7f3ea0615800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:50:44.003+0000 7f3ea0615800 1 librados: init done 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:50:44.003+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command cr dump hook 0x55d3f315fe98 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:50:44.005+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:50:44.005+0000 7f3d797fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:50:44.005+0000 7f3d797fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:50:44.005+0000 7f3d797fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:50:44.169 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:50:44.006+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3d64076470 auth_method 0 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:50:44.006+0000 7f3e9b591640 10 monclient: get_auth_request con 0x55d3f31ae440 auth_method 0 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:50:44.006+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:50:44.006+0000 7f3ea0615800 20 realm 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:50:44.006+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:50:44.007+0000 7f3ea0615800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:50:44.007+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:50:44.007+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x55d3f31b2790 auth_method 0 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:50:44.008+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:50:44.008+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.170 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:50:44.008+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:50:44.008+0000 7f3ea0615800 20 searching for the correct realm 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:50:44.008+0000 7f3e9b591640 10 monclient: get_auth_request con 0x55d3f31b7a50 auth_method 0 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:50:44.009+0000 7f3e9c593640 10 monclient: get_auth_request con 0x7f3e90027020 auth_method 0 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:50:44.010+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3e8c08d400 auth_method 0 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:50:44.011+0000 7f3e9b591640 10 monclient: get_auth_request con 0x7f3e900612d0 auth_method 0 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:50:44.012+0000 7f3e9b591640 0 -- 172.21.15.19:0/2443635072 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3e900612d0 msgr2=0x7f3e90087a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:50:44.012+0000 7f3d797fa640 1 client.7466.objecter ms_handle_reset 0x7f3e900612d0 session 0x7f3e90083fe0 osd.5 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:50:44.012+0000 7f3d797fa640 10 monclient: _renew_subs 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:50:44.012+0000 7f3d797fa640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:50:44.012+0000 7f3e9b591640 10 monclient: get_auth_request con 0x7f3d64086790 auth_method 0 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:50:44.013+0000 7f3e9c593640 10 monclient: get_auth_request con 0x7f3e8c09e930 auth_method 0 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:50:44.014+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3e94065380 auth_method 0 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:50:44.015+0000 7f3e9bd92640 0 -- 172.21.15.19:0/2443635072 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f3e94065380 msgr2=0x7f3e94063df0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:44.171 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:50:44.015+0000 7f3d797fa640 1 client.7466.objecter ms_handle_reset 0x7f3e94065380 session 0x7f3e94065120 osd.3 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:50:44.015+0000 7f3e9bd92640 10 monclient: get_auth_request con 0x7f3e900612d0 auth_method 0 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:50:44.019+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:44.172 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 zone default found 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:50:44.020+0000 7f3ea0615800 4 Realm: () 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:50:44.020+0000 7f3ea0615800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:50:44.020+0000 7f3ea0615800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:50:44.020+0000 7f3ea0615800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 zonegroup default 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:50:44.020+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 started sync module instance, tier type = 2024-09-12T00:50:44.173 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:50:44.021+0000 7f3ea0615800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=0 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=1 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=2 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=3 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=4 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=5 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:50:44.030+0000 7f3ea0615800 20 add_watcher() i=6 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:50:44.031+0000 7f3ea0615800 20 add_watcher() i=7 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:50:44.031+0000 7f3ea0615800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding auth protocol: cephx 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding auth protocol: cephx 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding auth protocol: cephx 2024-09-12T00:50:44.174 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: crc 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:50:44.033+0000 7f3d51fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:50:44.033+0000 7f3ea0615800 5 AuthRegistry(0x7ffeb48d7db0) adding con mode: secure 2024-09-12T00:50:44.175 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:50:44.034+0000 7f3ea0615800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:50:44.034+0000 7f3ea0615800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:50:44.034+0000 7f3ea0615800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command cache list hook 0x55d3f31828d0 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command cache inspect hook 0x55d3f31828d0 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command cache erase hook 0x55d3f31828d0 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command cache zap hook 0x55d3f31828d0 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 note: GC not initialized 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:50:44.034+0000 7f3d50fe1640 20 reqs_thread_entry: start 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command sync trace show hook 0x7f3e90088070 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command sync trace history hook 0x7f3e90088070 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command sync trace active hook 0x7f3e90088070 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:50:44.034+0000 7f3ea0615800 5 asok(0x55d3f2ea4630) register_command sync trace active_short hook 0x7f3e90088070 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:50:44.034+0000 7f3ea0615800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:44.176 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:50:44.034+0000 7f3ea0615800 20 Filter name: none 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:50:44.034+0000 7f3cca7fc640 20 reqs_thread_entry: start 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:50:44.034+0000 7f3ea0615800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:50:44.034+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:50:44.035+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 : miss 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:50:44.035+0000 7f3ea0615800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:50:44.035+0000 7f3ea0615800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:44.177 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:50:44.035+0000 7f3ea0615800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:50:44.040+0000 7f3ea0615800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:50:44.040+0000 7f3ea0615800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:50:44.040+0000 7f3ea0615800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:50:44.040+0000 7f3ea0615800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39, ofs0, ns] 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398885 cookie 94368805141296 notifier 7466 bl.length()=931 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:50:44.040+0000 7f3d7affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_sources= new_sources= 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential sources added=[] removed=[] 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_dests= new_dests= 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:50:44.042+0000 7f3ea0615800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential dests added=[] removed=[] 2024-09-12T00:50:44.178 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.0 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.0 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.1 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.1 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.2 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.2 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.3 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.3 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.4 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.4 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.5 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.5 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.6 2024-09-12T00:50:44.179 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.6 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.7 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.7 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.8 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.8 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.9 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.9 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.10 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.10 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:50:44.046+0000 7f3ea0615800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.11 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1.11 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.0 2024-09-12T00:50:44.180 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:50:44.046+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:50:44.047+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:50:44.047+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.3 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:50:44.048+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.4 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:50:44.048+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.5 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:50:44.049+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.6 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:50:44.049+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.7 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:50:44.050+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.8 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:50:44.050+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.9 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:50:44.051+0000 7f3ea0615800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.10 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:50:44.054+0000 7f3ea0615800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f3ea0615800 time 2024-09-12T00:50:44.054812+0000 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.181 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f3ea178c71a] 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3ea178c8d8] 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d3f17cd641] 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55d3f17dc51b] 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d3f17dd3e4] 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f3ea0429590] 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:50:44.055+0000 7f3ea0615800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f3ea0615800 thread_name:radosgw-admin 2024-09-12T00:50:44.182 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f3ea043e6f0] 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f3ea048b99c] 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f3ea178c774] 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f3ea178c8d8] 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55d3f17cd641] 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55d3f17dc51b] 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55d3f17dd3e4] 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f3ea0429590] 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:50:44.183 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:50:44.184 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:50:44.185 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:50:44.186 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:50:44.187 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:50:44.188 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:50:44.189 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:50:44.190 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3cca7fc640 / http_manager 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d50fe1640 / http_manager 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d51fe3640 / rgw_dt_lg_renew 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d797fa640 / ms_dispatch 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d7affd640 / io_context_pool 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d817fa640 / ms_dispatch 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d83fff640 / ms_dispatch 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3d89e0b640 / io_context_pool 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3e9b591640 / msgr-worker-2 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3e9bd92640 / msgr-worker-1 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3e9c593640 / msgr-worker-0 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3e9cd94640 / io_context_pool 2024-09-12T00:50:44.191 INFO:tasks.workunit.client.0.smithi019.stderr: 7f3ea0615800 / radosgw-admin 2024-09-12T00:50:44.192 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:50:44.192 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:50:44.192 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:50:44.056481Z_a2f1caea-207b-4c8d-a292-b9fa86f9cfdb/log 2024-09-12T00:50:44.192 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:50:44.192 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:50:44.193 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:44.193 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:44.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.134+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.193 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.136+0000 7f34eafaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.136+0000 7f34eafaf800 20 realm 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.136+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.136+0000 7f34eafaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.136+0000 7f34eafaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.136+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.136+0000 7f34eafaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.136+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.137+0000 7f34eafaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.137+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.137+0000 7f34eafaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.137+0000 7f34eafaf800 20 searching for the correct realm 2024-09-12T00:50:44.194 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.140+0000 7f34e8298640 0 -- 172.21.15.19:0/3892822225 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f34dc09ec20 msgr2=0x7f34dc076790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:44.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.345+0000 7f34e929a640 0 -- 172.21.15.19:0/3892822225 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x564909535b00 msgr2=0x564909537ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:44.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.349+0000 7f34eafaf800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:44.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.349+0000 7f34eafaf800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:44.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.349+0000 7f34eafaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:44.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.349+0000 7f34eafaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:44.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.349+0000 7f34eafaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:44.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.349+0000 7f34eafaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:44.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.349+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.349+0000 7f34eafaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.349+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.349+0000 7f34eafaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:44.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.349+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.350+0000 7f34eafaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:44.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.350+0000 7f34eafaf800 20 zone default found 2024-09-12T00:50:44.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.350+0000 7f34eafaf800 4 Realm: () 2024-09-12T00:50:44.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.350+0000 7f34eafaf800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:44.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.350+0000 7f34eafaf800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:44.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.350+0000 7f34eafaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:44.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.350+0000 7f34eafaf800 20 zonegroup default 2024-09-12T00:50:44.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.350+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.350+0000 7f34eafaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.350+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.351+0000 7f34eafaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.351+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.351+0000 7f34eafaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.351+0000 7f34eafaf800 20 started sync module instance, tier type = 2024-09-12T00:50:44.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.351+0000 7f34eafaf800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:44.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.360+0000 7f34eafaf800 20 add_watcher() i=0 2024-09-12T00:50:44.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.360+0000 7f34eafaf800 20 add_watcher() i=1 2024-09-12T00:50:44.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.360+0000 7f34eafaf800 20 add_watcher() i=2 2024-09-12T00:50:44.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.360+0000 7f34eafaf800 20 add_watcher() i=3 2024-09-12T00:50:44.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.360+0000 7f34eafaf800 20 add_watcher() i=4 2024-09-12T00:50:44.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.360+0000 7f34eafaf800 20 add_watcher() i=5 2024-09-12T00:50:44.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.360+0000 7f34eafaf800 20 add_watcher() i=6 2024-09-12T00:50:44.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.361+0000 7f34eafaf800 20 add_watcher() i=7 2024-09-12T00:50:44.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.361+0000 7f34eafaf800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:44.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.363+0000 7f339f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:44.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.364+0000 7f34eafaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:44.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.364+0000 7f34eafaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:44.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.364+0000 7f34eafaf800 5 note: GC not initialized 2024-09-12T00:50:44.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.364+0000 7f339e7e4640 20 reqs_thread_entry: start 2024-09-12T00:50:44.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.364+0000 7f34eafaf800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:44.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.364+0000 7f34eafaf800 20 Filter name: none 2024-09-12T00:50:44.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.364+0000 7f3397fff640 20 reqs_thread_entry: start 2024-09-12T00:50:44.363 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.364+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.365+0000 7f34eafaf800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:44.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.365+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.365+0000 7f34eafaf800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:50:44.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.365+0000 7f34eafaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:44.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.365+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.365+0000 7f34eafaf800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:44.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.365+0000 7f34eafaf800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.366+0000 7f34eafaf800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:50:44.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.366+0000 7f34eafaf800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:50:44.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.367+0000 7f339f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:44.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.369+0000 7f34eafaf800 20 remove_watcher() i=0 2024-09-12T00:50:44.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.369+0000 7f34eafaf800 2 removed watcher, disabling cache 2024-09-12T00:50:44.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.371+0000 7f34eafaf800 20 remove_watcher() i=1 2024-09-12T00:50:44.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.372+0000 7f34eafaf800 20 remove_watcher() i=2 2024-09-12T00:50:44.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.373+0000 7f34eafaf800 20 remove_watcher() i=3 2024-09-12T00:50:44.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.374+0000 7f34eafaf800 20 remove_watcher() i=4 2024-09-12T00:50:44.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.375+0000 7f34eafaf800 20 remove_watcher() i=5 2024-09-12T00:50:44.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.376+0000 7f34eafaf800 20 remove_watcher() i=6 2024-09-12T00:50:44.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.377+0000 7f34eafaf800 20 remove_watcher() i=7 2024-09-12T00:50:44.387 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.387 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:50:44.387 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-change-reshard-state id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:50:44.387 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:50:44.389 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:44.389 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:44.419 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:50:44.419 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:50:44.478 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:50:44.512 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:50:44.512 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:50:44.552 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.553+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.554+0000 7ff17bd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.554+0000 7ff17bd23800 20 realm 2024-09-12T00:50:44.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.554+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.554+0000 7ff17bd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.554+0000 7ff17bd23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:50:44.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.554+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.554+0000 7ff17bd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.554+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.555+0000 7ff17bd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:44.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.555+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.555+0000 7ff17bd23800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:50:44.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.555+0000 7ff17bd23800 20 searching for the correct realm 2024-09-12T00:50:44.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.559+0000 7ff17820d640 0 -- 172.21.15.19:0/1413371810 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7ff1600709b0 msgr2=0x7ff160066930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:50:44.562 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.563+0000 7ff177a0c640 0 -- 172.21.15.19:0/1413371810 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7ff170096040 msgr2=0x7ff170060940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:50:44.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:50:44.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:50:44.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:50:44.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:50:44.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:50:44.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:50:44.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:50:44.568 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.567+0000 7ff17bd23800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:50:44.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 20 zone default found 2024-09-12T00:50:44.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 4 Realm: () 2024-09-12T00:50:44.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:50:44.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:50:44.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:50:44.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 20 zonegroup default 2024-09-12T00:50:44.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:50:44.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 20 started sync module instance, tier type = 2024-09-12T00:50:44.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.568+0000 7ff17bd23800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:50:44.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.577+0000 7ff17bd23800 20 add_watcher() i=0 2024-09-12T00:50:44.576 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.577+0000 7ff17bd23800 20 add_watcher() i=1 2024-09-12T00:50:44.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.577+0000 7ff17bd23800 20 add_watcher() i=2 2024-09-12T00:50:44.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.577+0000 7ff17bd23800 20 add_watcher() i=3 2024-09-12T00:50:44.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.577+0000 7ff17bd23800 20 add_watcher() i=4 2024-09-12T00:50:44.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.577+0000 7ff17bd23800 20 add_watcher() i=5 2024-09-12T00:50:44.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.577+0000 7ff17bd23800 20 add_watcher() i=6 2024-09-12T00:50:44.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.578+0000 7ff17bd23800 20 add_watcher() i=7 2024-09-12T00:50:44.577 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.578+0000 7ff17bd23800 2 all 8 watchers are set, enabling cache 2024-09-12T00:50:44.579 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.579+0000 7ff02dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:44.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.580+0000 7ff17bd23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:50:44.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.580+0000 7ff17bd23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:50:44.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.580+0000 7ff17bd23800 5 note: GC not initialized 2024-09-12T00:50:44.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.580+0000 7ff02cfe1640 20 reqs_thread_entry: start 2024-09-12T00:50:44.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.580+0000 7ff17bd23800 20 init_complete bucket index max shards: 11 2024-09-12T00:50:44.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.580+0000 7ff17bd23800 20 Filter name: none 2024-09-12T00:50:44.580 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.580+0000 7fefa67fc640 20 reqs_thread_entry: start 2024-09-12T00:50:44.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.580+0000 7ff17bd23800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:50:44.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.580+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.581+0000 7ff17bd23800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:50:44.581 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.581+0000 7ff17bd23800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:50:44.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.581+0000 7ff17bd23800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:50:44.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.581+0000 7ff17bd23800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 : miss 2024-09-12T00:50:44.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.581+0000 7ff17bd23800 20 rados->read ofs=0 len=0 2024-09-12T00:50:44.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.581+0000 7ff17bd23800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:50:44.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.581+0000 7ff17bd23800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:50:44.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.581+0000 7ff17bd23800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:50:44.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.581+0000 7ff17bd23800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:50:44.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.581+0000 7ff17bd23800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:50:44.582 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.581+0000 7ff17bd23800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 2024-09-12T00:50:44.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.583+0000 7ff17bd23800 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to be held by another RGW process; skipping for now 2024-09-12T00:50:44.583 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.583+0000 7ff02dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:50:44.585 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.586+0000 7ff17bd23800 20 remove_watcher() i=0 2024-09-12T00:50:44.586 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.586+0000 7ff17bd23800 2 removed watcher, disabling cache 2024-09-12T00:50:44.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.587+0000 7ff17bd23800 20 remove_watcher() i=1 2024-09-12T00:50:44.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.588+0000 7ff17bd23800 20 remove_watcher() i=2 2024-09-12T00:50:44.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.589+0000 7ff17bd23800 20 remove_watcher() i=3 2024-09-12T00:50:44.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.590+0000 7ff17bd23800 20 remove_watcher() i=4 2024-09-12T00:50:44.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.591+0000 7ff17bd23800 20 remove_watcher() i=5 2024-09-12T00:50:44.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.592+0000 7ff17bd23800 20 remove_watcher() i=6 2024-09-12T00:50:44.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:50:44.593+0000 7ff17bd23800 20 remove_watcher() i=7 2024-09-12T00:50:44.604 INFO:tasks.workunit.client.0.smithi019.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:51:14.610 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:51:14.647 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:14.647 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:14.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.695+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.697+0000 7f429352a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.697+0000 7f429352a800 20 realm 2024-09-12T00:51:14.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.697+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.697+0000 7f429352a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.697+0000 7f429352a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:14.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.697+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.697+0000 7f429352a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.697+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.698+0000 7f429352a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:14.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.698+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.699+0000 7f429352a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:14.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.699+0000 7f429352a800 20 searching for the correct realm 2024-09-12T00:51:14.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.700+0000 7f428f962640 0 -- 172.21.15.19:0/663517340 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7f42780b9020 msgr2=0x7f42780c1440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:14.905 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.906+0000 7f428f962640 0 -- 172.21.15.19:0/663517340 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x558bd95f6f20 msgr2=0x558bd95f93c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:14.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.914+0000 7f429352a800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:14.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.914+0000 7f429352a800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:14.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.914+0000 7f429352a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:14.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.914+0000 7f429352a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:14.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.914+0000 7f429352a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:14.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.914+0000 7f429352a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:14.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.914+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.915+0000 7f429352a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.915+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.915+0000 7f429352a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:14.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.915+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:14.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 20 zone default found 2024-09-12T00:51:14.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 4 Realm: () 2024-09-12T00:51:14.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:14.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:14.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:14.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 20 zonegroup default 2024-09-12T00:51:14.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.916+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.917+0000 7f429352a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:14.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.917+0000 7f429352a800 20 started sync module instance, tier type = 2024-09-12T00:51:14.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.917+0000 7f429352a800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:14.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.928+0000 7f429352a800 20 add_watcher() i=0 2024-09-12T00:51:14.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.928+0000 7f429352a800 20 add_watcher() i=1 2024-09-12T00:51:14.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.928+0000 7f429352a800 20 add_watcher() i=2 2024-09-12T00:51:14.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.928+0000 7f429352a800 20 add_watcher() i=3 2024-09-12T00:51:14.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.928+0000 7f429352a800 20 add_watcher() i=4 2024-09-12T00:51:14.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.928+0000 7f429352a800 20 add_watcher() i=5 2024-09-12T00:51:14.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.928+0000 7f429352a800 20 add_watcher() i=6 2024-09-12T00:51:14.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.929+0000 7f429352a800 20 add_watcher() i=7 2024-09-12T00:51:14.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.929+0000 7f429352a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:14.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.931+0000 7f4141fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:14.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.931+0000 7f429352a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:14.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.931+0000 7f429352a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:14.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.932+0000 7f429352a800 5 note: GC not initialized 2024-09-12T00:51:14.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.932+0000 7f4140fe1640 20 reqs_thread_entry: start 2024-09-12T00:51:14.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.932+0000 7f429352a800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:14.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.932+0000 7f429352a800 20 Filter name: none 2024-09-12T00:51:14.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.932+0000 7f40ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:51:14.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.932+0000 7f429352a800 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:51:14.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.932+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.933+0000 7f429352a800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:14.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.933+0000 7f429352a800 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:51:14.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.933+0000 7f429352a800 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:51:14.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.933+0000 7f429352a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 : miss 2024-09-12T00:51:14.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.933+0000 7f429352a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:14.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.933+0000 7f429352a800 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:51:14.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.933+0000 7f429352a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:51:14.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.933+0000 7f429352a800 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:51:14.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.933+0000 7f429352a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:14.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.933+0000 7f429352a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.933+0000 7f429352a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 2024-09-12T00:51:14.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.935+0000 7f429352a800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:51:14.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.942+0000 7f429352a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:51:14.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.942+0000 7f429352a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:51:14.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.942+0000 7f429352a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.942+0000 7f429352a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39, ofs0, ns] 2024-09-12T00:51:14.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.943+0000 7f416affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398886 cookie 94059135731424 notifier 8022 bl.length()=931 2024-09-12T00:51:14.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.943+0000 7f416affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:51:14.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.943+0000 7f416affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:51:14.943 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.943+0000 7f416affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.945+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_sources= new_sources= 2024-09-12T00:51:14.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.945+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential sources added=[] removed=[] 2024-09-12T00:51:14.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.945+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_dests= new_dests= 2024-09-12T00:51:14.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.945+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential dests added=[] removed=[] 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.0 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.0 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.1 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.1 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.2 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.2 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.3 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.3 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.4 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.4 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.5 2024-09-12T00:51:14.951 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.5 2024-09-12T00:51:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.6 2024-09-12T00:51:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.6 2024-09-12T00:51:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.7 2024-09-12T00:51:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.7 2024-09-12T00:51:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.8 2024-09-12T00:51:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.8 2024-09-12T00:51:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.9 2024-09-12T00:51:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.9 2024-09-12T00:51:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.10 2024-09-12T00:51:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.10 2024-09-12T00:51:14.952 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.11 2024-09-12T00:51:14.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2.11 2024-09-12T00:51:14.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.0 2024-09-12T00:51:14.953 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.951+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1 2024-09-12T00:51:14.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.952+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2 2024-09-12T00:51:14.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.952+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.3 2024-09-12T00:51:14.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.953+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.4 2024-09-12T00:51:14.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.953+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.5 2024-09-12T00:51:14.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.954+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.6 2024-09-12T00:51:14.954 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.955+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.7 2024-09-12T00:51:14.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.955+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.8 2024-09-12T00:51:14.955 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.956+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.9 2024-09-12T00:51:14.956 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.956+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.10 2024-09-12T00:51:14.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.960+0000 7f429352a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:14.959 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.960+0000 7f429352a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 2024-09-12T00:51:14.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.961+0000 7f429352a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:51:14.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.961+0000 7f429352a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:51:14.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.961+0000 7f429352a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.961+0000 7f429352a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39, ofs0, ns] 2024-09-12T00:51:14.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.961+0000 7f416a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398887 cookie 94059135731424 notifier 8022 bl.length()=931 2024-09-12T00:51:14.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.962+0000 7f416a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:51:14.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.962+0000 7f416a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:51:14.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.962+0000 7f416a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.963+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_sources= new_sources= 2024-09-12T00:51:14.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.963+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential sources added=[] removed=[] 2024-09-12T00:51:14.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.963+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_dests= new_dests= 2024-09-12T00:51:14.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.963+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential dests added=[] removed=[] 2024-09-12T00:51:14.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.966+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.0 2024-09-12T00:51:14.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.966+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.1 2024-09-12T00:51:14.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.967+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.2 2024-09-12T00:51:14.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.967+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.3 2024-09-12T00:51:14.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.967+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.4 2024-09-12T00:51:14.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.968+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.5 2024-09-12T00:51:14.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.968+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.6 2024-09-12T00:51:14.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.969+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.7 2024-09-12T00:51:14.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.969+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.8 2024-09-12T00:51:14.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.969+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.9 2024-09-12T00:51:14.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.970+0000 7f429352a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39.10 2024-09-12T00:51:14.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.970+0000 7f429352a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:51:14.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.970+0000 7f429352a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 2024-09-12T00:51:14.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.972+0000 7f429352a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:51:14.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.972+0000 7f429352a800 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:51:14.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.972+0000 7f429352a800 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.972+0000 7f429352a800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39, ofs0, ns] 2024-09-12T00:51:14.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.972+0000 7f416a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398888 cookie 94059135731424 notifier 8022 bl.length()=899 2024-09-12T00:51:14.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.972+0000 7f416a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 info.flags=0x17 2024-09-12T00:51:14.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.972+0000 7f416a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 to cache LRU end 2024-09-12T00:51:14.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.972+0000 7f416a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:51:14.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.974+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_sources= new_sources= 2024-09-12T00:51:14.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.974+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential sources added=[] removed=[] 2024-09-12T00:51:14.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.974+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): orig_dests= new_dests= 2024-09-12T00:51:14.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.974+0000 7f429352a800 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39]): potential dests added=[] removed=[] 2024-09-12T00:51:14.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.976+0000 7f429352a800 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:51:14.978 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.978+0000 7f4141fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:14.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.981+0000 7f429352a800 20 remove_watcher() i=0 2024-09-12T00:51:14.980 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.981+0000 7f429352a800 2 removed watcher, disabling cache 2024-09-12T00:51:14.981 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.982+0000 7f429352a800 20 remove_watcher() i=1 2024-09-12T00:51:14.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.983+0000 7f429352a800 20 remove_watcher() i=2 2024-09-12T00:51:14.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.984+0000 7f429352a800 20 remove_watcher() i=3 2024-09-12T00:51:14.985 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.986+0000 7f429352a800 20 remove_watcher() i=4 2024-09-12T00:51:14.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.987+0000 7f429352a800 20 remove_watcher() i=5 2024-09-12T00:51:14.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.988+0000 7f429352a800 20 remove_watcher() i=6 2024-09-12T00:51:14.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:14.989+0000 7f429352a800 20 remove_watcher() i=7 2024-09-12T00:51:15.002 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:51:15.033 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:15.033 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:15.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.073+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.075+0000 7f90e5c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.075+0000 7f90e5c0f800 20 realm 2024-09-12T00:51:15.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.075+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.075+0000 7f90e5c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.075+0000 7f90e5c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:15.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.075+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.075+0000 7f90e5c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.075+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.076+0000 7f90e5c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:15.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.076+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.076+0000 7f90e5c0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:15.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.077+0000 7f90e5c0f800 20 searching for the correct realm 2024-09-12T00:51:15.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.080+0000 7f90e0b47640 0 -- 172.21.15.19:0/2020690245 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f90d8028040 msgr2=0x7f90d803f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:15.284 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.284+0000 7f90e1b49640 0 -- 172.21.15.19:0/2020690245 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5592fb64fac0 msgr2=0x5592fb651f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:15.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.289+0000 7f90e5c0f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:15.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.289+0000 7f90e5c0f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:15.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.289+0000 7f90e5c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:15.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.289+0000 7f90e5c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:15.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.289+0000 7f90e5c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:15.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.289+0000 7f90e5c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:15.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.289+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.289+0000 7f90e5c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.289+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.289+0000 7f90e5c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:15.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.289+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:15.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 20 zone default found 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 4 Realm: () 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 20 zonegroup default 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.290+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.291+0000 7f90e5c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.291+0000 7f90e5c0f800 20 started sync module instance, tier type = 2024-09-12T00:51:15.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.291+0000 7f90e5c0f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:15.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.300+0000 7f90e5c0f800 20 add_watcher() i=0 2024-09-12T00:51:15.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.300+0000 7f90e5c0f800 20 add_watcher() i=1 2024-09-12T00:51:15.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.300+0000 7f90e5c0f800 20 add_watcher() i=2 2024-09-12T00:51:15.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.300+0000 7f90e5c0f800 20 add_watcher() i=3 2024-09-12T00:51:15.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.300+0000 7f90e5c0f800 20 add_watcher() i=4 2024-09-12T00:51:15.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.300+0000 7f90e5c0f800 20 add_watcher() i=5 2024-09-12T00:51:15.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.300+0000 7f90e5c0f800 20 add_watcher() i=6 2024-09-12T00:51:15.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.301+0000 7f90e5c0f800 20 add_watcher() i=7 2024-09-12T00:51:15.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.301+0000 7f90e5c0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:15.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.303+0000 7f8f977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:15.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.303+0000 7f90e5c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:15.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.303+0000 7f90e5c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:15.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.303+0000 7f90e5c0f800 5 note: GC not initialized 2024-09-12T00:51:15.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.304+0000 7f8f967e4640 20 reqs_thread_entry: start 2024-09-12T00:51:15.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.304+0000 7f90e5c0f800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:15.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.304+0000 7f90e5c0f800 20 Filter name: none 2024-09-12T00:51:15.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.304+0000 7f8f07fff640 20 reqs_thread_entry: start 2024-09-12T00:51:15.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.304+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.304+0000 7f90e5c0f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:15.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.304+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.305+0000 7f90e5c0f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:15.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.305+0000 7f90e5c0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:15.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.305+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.305+0000 7f90e5c0f800 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:51:15.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.305+0000 7f90e5c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.306+0000 7f90e5c0f800 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:51:15.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.306+0000 7f90e5c0f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:15.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.308+0000 7f8f977e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:15.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.310+0000 7f90e5c0f800 20 remove_watcher() i=0 2024-09-12T00:51:15.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.310+0000 7f90e5c0f800 2 removed watcher, disabling cache 2024-09-12T00:51:15.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.311+0000 7f90e5c0f800 20 remove_watcher() i=1 2024-09-12T00:51:15.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.312+0000 7f90e5c0f800 20 remove_watcher() i=2 2024-09-12T00:51:15.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.313+0000 7f90e5c0f800 20 remove_watcher() i=3 2024-09-12T00:51:15.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.314+0000 7f90e5c0f800 20 remove_watcher() i=4 2024-09-12T00:51:15.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.315+0000 7f90e5c0f800 20 remove_watcher() i=5 2024-09-12T00:51:15.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.316+0000 7f90e5c0f800 20 remove_watcher() i=6 2024-09-12T00:51:15.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.317+0000 7f90e5c0f800 20 remove_watcher() i=7 2024-09-12T00:51:15.328 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:15.328 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:51:15.328 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: abort-at-change-reshard-state id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:51:15.328 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:15.330 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.330 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:51:15.352 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.352 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:51:15.544 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:15.544 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:51:15.680 INFO:tasks.workunit.client.0.smithi019.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:51:15.681 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:51:15.710 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:15.711 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:15.749 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.750+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.752+0000 7fc215e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.752+0000 7fc215e13800 20 realm 2024-09-12T00:51:15.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.752+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.752+0000 7fc215e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.752+0000 7fc215e13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:15.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.752+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.752+0000 7fc215e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.752 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.752+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.753+0000 7fc215e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:15.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.753+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.753+0000 7fc215e13800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:15.753 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.754+0000 7fc215e13800 20 searching for the correct realm 2024-09-12T00:51:15.756 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.757+0000 7fc210d47640 0 -- 172.21.15.19:0/353617007 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc2080e3130 msgr2=0x7fc2080b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:15.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.961+0000 7fc210d47640 0 -- 172.21.15.19:0/353617007 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x561968349590 msgr2=0x56196834b980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:15.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.965+0000 7fc215e13800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:15.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.965+0000 7fc215e13800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:15.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.965+0000 7fc215e13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:15.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.965+0000 7fc215e13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:15.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.965+0000 7fc215e13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:15.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.965+0000 7fc215e13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:15.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.965+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.966 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:15.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:15.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 20 zone default found 2024-09-12T00:51:15.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 4 Realm: () 2024-09-12T00:51:15.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:15.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:15.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:15.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 20 zonegroup default 2024-09-12T00:51:15.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.966+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.967+0000 7fc215e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.967+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.967+0000 7fc215e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.967+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.967+0000 7fc215e13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:15.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.967+0000 7fc215e13800 20 started sync module instance, tier type = 2024-09-12T00:51:15.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.967+0000 7fc215e13800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:15.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.976+0000 7fc215e13800 20 add_watcher() i=0 2024-09-12T00:51:15.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.976+0000 7fc215e13800 20 add_watcher() i=1 2024-09-12T00:51:15.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.976+0000 7fc215e13800 20 add_watcher() i=2 2024-09-12T00:51:15.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.976+0000 7fc215e13800 20 add_watcher() i=3 2024-09-12T00:51:15.976 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.976+0000 7fc215e13800 20 add_watcher() i=4 2024-09-12T00:51:15.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.976+0000 7fc215e13800 20 add_watcher() i=5 2024-09-12T00:51:15.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.976+0000 7fc215e13800 20 add_watcher() i=6 2024-09-12T00:51:15.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.977+0000 7fc215e13800 20 add_watcher() i=7 2024-09-12T00:51:15.977 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.977+0000 7fc215e13800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:15.981 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.979+0000 7fc0c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.979+0000 7fc215e13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.979+0000 7fc215e13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.979+0000 7fc215e13800 5 note: GC not initialized 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.980+0000 7fc0c67e4640 20 reqs_thread_entry: start 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.980+0000 7fc215e13800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.980+0000 7fc215e13800 20 Filter name: none 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.980+0000 7fc037fff640 20 reqs_thread_entry: start 2024-09-12T00:51:15.982 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.980+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.980+0000 7fc215e13800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:15.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.980+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.981+0000 7fc215e13800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:15.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.981+0000 7fc215e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:15.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.981+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.981+0000 7fc215e13800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:15.983 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.981+0000 7fc215e13800 20 rados->read ofs=0 len=0 2024-09-12T00:51:15.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.981+0000 7fc215e13800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:15.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.981+0000 7fc215e13800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:15.984 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.983+0000 7fc0c77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:15.985 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.985+0000 7fc215e13800 20 remove_watcher() i=0 2024-09-12T00:51:15.985 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.985+0000 7fc215e13800 2 removed watcher, disabling cache 2024-09-12T00:51:15.986 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.986+0000 7fc215e13800 20 remove_watcher() i=1 2024-09-12T00:51:15.987 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.987+0000 7fc215e13800 20 remove_watcher() i=2 2024-09-12T00:51:15.988 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.988+0000 7fc215e13800 20 remove_watcher() i=3 2024-09-12T00:51:15.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.989+0000 7fc215e13800 20 remove_watcher() i=4 2024-09-12T00:51:15.990 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.990+0000 7fc215e13800 20 remove_watcher() i=5 2024-09-12T00:51:15.991 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.991+0000 7fc215e13800 20 remove_watcher() i=6 2024-09-12T00:51:15.992 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:15.992+0000 7fc215e13800 20 remove_watcher() i=7 2024-09-12T00:51:16.003 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.003 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:51:16.003 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: a-bucket id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:51:16.003 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.005 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:51:16.033 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:16.033 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:16.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.073+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.075+0000 7fe745619800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.075+0000 7fe745619800 20 realm 2024-09-12T00:51:16.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.075+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.075+0000 7fe745619800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.075+0000 7fe745619800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:16.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.075+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.076+0000 7fe745619800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.076+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.076+0000 7fe745619800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:16.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.076+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.077+0000 7fe745619800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:16.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.077+0000 7fe745619800 20 searching for the correct realm 2024-09-12T00:51:16.079 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.080+0000 7fe73bfff640 0 -- 172.21.15.19:0/531831488 >> [v2:172.21.15.135:6800/2991448734,v1:172.21.15.135:6801/2991448734] conn(0x563604cfd7c0 msgr2=0x563604cffbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:16.082 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.083+0000 7fe740deb640 0 -- 172.21.15.19:0/531831488 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fe73c061770 msgr2=0x7fe73c0601e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:16.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.289+0000 7fe745619800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:16.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.289+0000 7fe745619800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:16.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.289+0000 7fe745619800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:16.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.289+0000 7fe745619800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:16.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.289+0000 7fe745619800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:16.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.289+0000 7fe745619800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:16.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.289+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.289+0000 7fe745619800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.289+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:16.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:16.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 20 zone default found 2024-09-12T00:51:16.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 4 Realm: () 2024-09-12T00:51:16.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:16.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:16.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:16.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 20 zonegroup default 2024-09-12T00:51:16.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.290+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.291+0000 7fe745619800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.291+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.291+0000 7fe745619800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.291+0000 7fe745619800 20 started sync module instance, tier type = 2024-09-12T00:51:16.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.291+0000 7fe745619800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:16.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.301+0000 7fe745619800 20 add_watcher() i=0 2024-09-12T00:51:16.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.301+0000 7fe745619800 20 add_watcher() i=1 2024-09-12T00:51:16.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.301+0000 7fe745619800 20 add_watcher() i=2 2024-09-12T00:51:16.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.301+0000 7fe745619800 20 add_watcher() i=3 2024-09-12T00:51:16.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.301+0000 7fe745619800 20 add_watcher() i=4 2024-09-12T00:51:16.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.301+0000 7fe745619800 20 add_watcher() i=5 2024-09-12T00:51:16.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.301+0000 7fe745619800 20 add_watcher() i=6 2024-09-12T00:51:16.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.301+0000 7fe745619800 20 add_watcher() i=7 2024-09-12T00:51:16.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.301+0000 7fe745619800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:16.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.303+0000 7fe5f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:16.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.303+0000 7fe745619800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:16.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.303+0000 7fe745619800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:16.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.303+0000 7fe745619800 5 note: GC not initialized 2024-09-12T00:51:16.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.303+0000 7fe5f5fe3640 20 reqs_thread_entry: start 2024-09-12T00:51:16.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.304+0000 7fe745619800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:16.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.304+0000 7fe745619800 20 Filter name: none 2024-09-12T00:51:16.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.304+0000 7fe5677fe640 20 reqs_thread_entry: start 2024-09-12T00:51:16.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.304+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.304+0000 7fe745619800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:16.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.304+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.305+0000 7fe745619800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:16.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.305+0000 7fe745619800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:16.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.305+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.305+0000 7fe745619800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:16.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.305+0000 7fe745619800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.305+0000 7fe745619800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:16.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.305+0000 7fe745619800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:16.307 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.307+0000 7fe5f6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:16.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.309+0000 7fe745619800 20 remove_watcher() i=0 2024-09-12T00:51:16.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.309+0000 7fe745619800 2 removed watcher, disabling cache 2024-09-12T00:51:16.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.310+0000 7fe745619800 20 remove_watcher() i=1 2024-09-12T00:51:16.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.311+0000 7fe745619800 20 remove_watcher() i=2 2024-09-12T00:51:16.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.312+0000 7fe745619800 20 remove_watcher() i=3 2024-09-12T00:51:16.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.313+0000 7fe745619800 20 remove_watcher() i=4 2024-09-12T00:51:16.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.314+0000 7fe745619800 20 remove_watcher() i=5 2024-09-12T00:51:16.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.315+0000 7fe745619800 20 remove_watcher() i=6 2024-09-12T00:51:16.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.316+0000 7fe745619800 20 remove_watcher() i=7 2024-09-12T00:51:16.328 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:51:16.362 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:16.362 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:16.402 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.402+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.404+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.404+0000 7f8730946800 20 realm 2024-09-12T00:51:16.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.404+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.404+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.404+0000 7f8730946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:16.404 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.404+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.404+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.404+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.405+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:16.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.405+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.405+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:16.405 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.405+0000 7f8730946800 20 searching for the correct realm 2024-09-12T00:51:16.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.609+0000 7f872e437640 0 -- 172.21.15.19:0/585678288 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f872008f070 msgr2=0x7f87200689b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:16.612 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.612+0000 7f872e437640 0 -- 172.21.15.19:0/585678288 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f87280c90e0 msgr2=0x7f87280a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:16.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:16.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:16.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:16.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:16.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:16.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:16.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.819+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.820+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.820+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.820+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:16.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.820+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:16.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 20 zone default found 2024-09-12T00:51:16.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 4 Realm: () 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 20 zonegroup default 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.822+0000 7f8730946800 20 started sync module instance, tier type = 2024-09-12T00:51:16.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.822+0000 7f8730946800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:16.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=0 2024-09-12T00:51:16.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=1 2024-09-12T00:51:16.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=2 2024-09-12T00:51:16.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=3 2024-09-12T00:51:16.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=4 2024-09-12T00:51:16.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=5 2024-09-12T00:51:16.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=6 2024-09-12T00:51:16.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.836+0000 7f8730946800 20 add_watcher() i=7 2024-09-12T00:51:16.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.836+0000 7f8730946800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:16.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.837+0000 7f85e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:16.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.837+0000 7f8730946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:16.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.837+0000 7f8730946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:16.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.837+0000 7f8730946800 5 note: GC not initialized 2024-09-12T00:51:16.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.837+0000 7f855f7fe640 20 reqs_thread_entry: start 2024-09-12T00:51:16.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.837+0000 7f8730946800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:16.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.837+0000 7f8730946800 20 Filter name: none 2024-09-12T00:51:16.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.838+0000 7f855d7fa640 20 reqs_thread_entry: start 2024-09-12T00:51:16.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.838+0000 7f8730946800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:51:16.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.838+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.838+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:16.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.838+0000 7f8730946800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:51:16.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.838+0000 7f8730946800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:51:16.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.838+0000 7f8730946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:51:16.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.838+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.839+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:16.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.839+0000 7f8730946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:16.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.839+0000 7f8730946800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:16.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.839+0000 7f8730946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:16.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.839+0000 7f8730946800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:16.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.839+0000 7f8730946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:51:16.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.845+0000 7f8730946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:16.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.845+0000 7f8730946800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:16.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.845+0000 7f8730946800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:16.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.845+0000 7f8730946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:51:16.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398979 cookie 93826182412688 notifier 7583 bl.length()=827 2024-09-12T00:51:16.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:16.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:16.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:16.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:51:16.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:51:16.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:51:16.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:51:16.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.0 2024-09-12T00:51:16.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.0 2024-09-12T00:51:16.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.1 2024-09-12T00:51:16.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.1 2024-09-12T00:51:16.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.2 2024-09-12T00:51:16.855 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.2 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.3 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.3 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.4 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.4 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.5 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.5 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.6 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.6 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.7 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.7 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.8 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.8 2024-09-12T00:51:16.856 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.9 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.9 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.10 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.10 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.11 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.11 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.12 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.12 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.13 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.13 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:16.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:16.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.856+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:16.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.856+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:16.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.857+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:16.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.857+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:16.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.857+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:16.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.857+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:16.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.858+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:16.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.858+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:16.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.858+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:16.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.858+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:16.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.859+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:16.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.859+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:16.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.860+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:16.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.860+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:16.861 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.861+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:16.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.861+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:16.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.861+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:16.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.861+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:16.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.862+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:16.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.862+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:16.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.862+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:16.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.862+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:16.864 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8730946800 time 2024-09-12T00:51:16.866785+0000 2024-09-12T00:51:16.864 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:16.865 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:16.865 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8733f8c71a] 2024-09-12T00:51:16.865 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8733f8c8d8] 2024-09-12T00:51:16.865 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55559b46f641] 2024-09-12T00:51:16.865 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55559b47e51b] 2024-09-12T00:51:16.865 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55559b47f3e4] 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8732c29590] 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.865+0000 7f8730946800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8730946800 time 2024-09-12T00:51:16.866785+0000 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8733f8c71a] 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8733f8c8d8] 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55559b46f641] 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55559b47e51b] 2024-09-12T00:51:16.866 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55559b47f3e4] 2024-09-12T00:51:16.867 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:51:16.867 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8732c29590] 2024-09-12T00:51:16.867 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:51:16.867 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:51:16.867 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.867 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:51:16.867 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f8730946800 thread_name:radosgw-admin 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8732c3e6f0] 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8732c8b99c] 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8733f8c774] 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8733f8c8d8] 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55559b46f641] 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55559b47e51b] 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55559b47f3e4] 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:51:16.882 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8732c29590] 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.866+0000 7f8730946800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f8730946800 thread_name:radosgw-admin 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8732c3e6f0] 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8732c8b99c] 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8733f8c774] 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8733f8c8d8] 2024-09-12T00:51:16.883 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55559b46f641] 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55559b47e51b] 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55559b47f3e4] 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8732c29590] 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:51:16.386+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:51:16.386+0000 7f8730946800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:51:16.386+0000 7f8730946800 10 monclient(hunting): authenticate will time out at 2342.889737s 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): get_auth_request con 0x55559c21d180 auth_method 0 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.884 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): get_auth_request con 0x55559c2a1710 auth_method 0 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:51:16.387+0000 7f872ec38640 10 monclient(hunting): get_auth_request con 0x55559c2abd40 auth_method 0 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:51:16.387+0000 7f872ec38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.885 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:51:16.387+0000 7f872ec38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:51:16.387+0000 7f872ec38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:51:16.387+0000 7f872e437640 10 monclient(hunting): handle_auth_done global_id 8085 payload 824 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:51:16.387+0000 7f872e437640 10 monclient: _finish_hunting 0 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:51:16.387+0000 7f872e437640 1 monclient: found mon.noname-a 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:51:16.387+0000 7f872e437640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: dump: 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.886 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: _finish_auth 0 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: _check_auth_tickets 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:51:16.387+0000 7f8730946800 5 monclient: authenticate success, global_id 8085 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:51:16.387+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:51:16.387+0000 7f8730946800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: dump: 2024-09-12T00:51:16.887 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:51:16.387+0000 7f861c608640 4 set_mon_vals no callback set 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:51:16.387+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:51:16.387+0000 7f8730946800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.888 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:51:16.387+0000 7f8730946800 1 librados: init done 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:51:16.389+0000 7f861ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:51:16.389+0000 7f861ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:51:16.389+0000 7f861ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:51:16.389+0000 7f872dc36640 10 monclient: get_auth_request con 0x7f86140764a0 auth_method 0 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:51:16.390+0000 7f872ec38640 10 monclient: get_auth_request con 0x55559c38e110 auth_method 0 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:51:16.390+0000 7f872e437640 10 monclient: get_auth_request con 0x55559c3b09a0 auth_method 0 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:51:16.392+0000 7f872dc36640 10 monclient: get_auth_request con 0x55559c3b4200 auth_method 0 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:51:16.393+0000 7f8730946800 10 monclient: build_initial_monmap 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:51:16.393+0000 7f8730946800 1 build_initial for_mkfs: 0 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:51:16.393+0000 7f8730946800 10 monclient: monmap: 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:16.889 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding auth protocol: cephx 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding auth protocol: cephx 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding auth protocol: cephx 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.890 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:51:16.393+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:51:16.393+0000 7f8730946800 5 asok(0x55559c146630) register_command objecter_requests cmddesc objecter_requests hook 0x55559c3bd690 EEXIST 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:51:16.393+0000 7f8730946800 10 monclient: init 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding auth protocol: cephx 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding auth protocol: cephx 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding auth protocol: cephx 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.891 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:51:16.393+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:51:16.394+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.892 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:51:16.394+0000 7f8730946800 5 asok(0x55559c146630) register_command rotate-key cmddesc rotate-key hook 0x55559c3b8d20 EEXIST 2024-09-12T00:51:16.893 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:16.893 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:51:16.893 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): picked mon.noname-b con 0x55559c3e72d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:16.893 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): picked mon.noname-c con 0x55559c3dfcc0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:16.893 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): picked mon.noname-a con 0x55559c3e27d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:16.893 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.893 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.893 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): authenticate will time out at 2342.897165s 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): get_auth_request con 0x55559c3e27d0 auth_method 0 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): get_auth_request con 0x55559c3dfcc0 auth_method 0 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): get_auth_request con 0x55559c3e72d0 auth_method 0 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.894 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): handle_auth_done global_id 8088 payload 824 2024-09-12T00:51:16.895 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient: _finish_hunting 0 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:51:16.394+0000 7f872ec38640 1 monclient: found mon.noname-a 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: dump: 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.896 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.897 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.897 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.897 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.897 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: _finish_auth 0 2024-09-12T00:51:16.897 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: _check_auth_tickets 2024-09-12T00:51:16.897 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:51:16.394+0000 7f8730946800 5 monclient: authenticate success, global_id 8088 2024-09-12T00:51:16.897 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.897 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.897 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:16.897 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.898 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:16.898 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: dump: 2024-09-12T00:51:16.898 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.898 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.898 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.898 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.899 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.899 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.899 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.899 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.899 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.899 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.899 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:51:16.394+0000 7f872f439640 4 set_mon_vals no callback set 2024-09-12T00:51:16.899 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:51:16.395+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.900 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:51:16.395+0000 7f8730946800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.900 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:51:16.396+0000 7f8613fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:16.900 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:51:16.396+0000 7f8613fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.900 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:51:16.396+0000 7f8613fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.900 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:51:16.397+0000 7f872e437640 10 monclient: get_auth_request con 0x7f86080763b0 auth_method 0 2024-09-12T00:51:16.900 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:51:16.397+0000 7f8730946800 10 monclient: get_monmap_and_config 2024-09-12T00:51:16.900 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:51:16.397+0000 7f8730946800 10 monclient: build_initial_monmap 2024-09-12T00:51:16.900 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:51:16.397+0000 7f8730946800 1 build_initial for_mkfs: 0 2024-09-12T00:51:16.900 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:51:16.397+0000 7f8730946800 10 monclient: monmap: 2024-09-12T00:51:16.900 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:16.900 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:16.901 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:16.901 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:16.901 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:16.901 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.901 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:16.901 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:16.901 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:16.901 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.901 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding auth protocol: cephx 2024-09-12T00:51:16.901 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding auth protocol: cephx 2024-09-12T00:51:16.901 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding auth protocol: cephx 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.902 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.903 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:51:16.397+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.903 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:51:16.397+0000 7f8730946800 10 monclient: init 2024-09-12T00:51:16.903 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding auth protocol: cephx 2024-09-12T00:51:16.903 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding auth protocol: cephx 2024-09-12T00:51:16.903 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding auth protocol: cephx 2024-09-12T00:51:16.903 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.903 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:51:16.397+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.904 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:51:16.398+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.905 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:51:16.398+0000 7f8730946800 5 asok(0x55559c146630) register_command rotate-key cmddesc rotate-key hook 0x7ffc736354c8 EEXIST 2024-09-12T00:51:16.905 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:16.905 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:51:16.905 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): picked mon.noname-b con 0x55559c4368a0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:16.905 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): picked mon.noname-c con 0x55559c4078e0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:16.905 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): picked mon.noname-a con 0x55559c430e80 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:16.906 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.906 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.906 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.906 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:16.906 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): authenticate will time out at 2342.901209s 2024-09-12T00:51:16.907 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): get_auth_request con 0x55559c4078e0 auth_method 0 2024-09-12T00:51:16.907 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.907 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.907 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.907 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): get_auth_request con 0x55559c430e80 auth_method 0 2024-09-12T00:51:16.907 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.907 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.907 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.908 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): get_auth_request con 0x55559c4368a0 auth_method 0 2024-09-12T00:51:16.908 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.908 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.908 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.908 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.908 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.909 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.909 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.909 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.909 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.909 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.909 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.909 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.909 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): handle_auth_done global_id 8091 payload 274 2024-09-12T00:51:16.910 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient: _finish_hunting 0 2024-09-12T00:51:16.910 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:51:16.398+0000 7f872ec38640 1 monclient: found mon.noname-a 2024-09-12T00:51:16.910 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.910 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.910 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:16.910 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: dump: 2024-09-12T00:51:16.911 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.911 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.911 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.911 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.911 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.911 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.911 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.912 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.912 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.912 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.912 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: _finish_auth 0 2024-09-12T00:51:16.912 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:51:16.912 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:51:16.398+0000 7f8730946800 5 monclient: authenticate success, global_id 8091 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: dump: 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.913 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.914 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.914 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.914 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:16.914 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:51:16.398+0000 7f8730946800 4 set_mon_vals no callback set 2024-09-12T00:51:16.914 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:51:16.399+0000 7f8730946800 10 monclient: shutdown 2024-09-12T00:51:16.914 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:51:16.399+0000 7f8730946800 10 monclient: build_initial_monmap 2024-09-12T00:51:16.914 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:51:16.399+0000 7f8730946800 1 build_initial for_mkfs: 0 2024-09-12T00:51:16.914 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:51:16.399+0000 7f8730946800 10 monclient: monmap: 2024-09-12T00:51:16.914 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:16.914 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:16.914 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding auth protocol: cephx 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding auth protocol: cephx 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding auth protocol: cephx 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.915 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:51:16.399+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:51:16.399+0000 7f8730946800 1 librados: starting msgr at 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:51:16.399+0000 7f8730946800 1 librados: starting objecter 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:51:16.399+0000 7f8730946800 5 asok(0x55559c146630) register_command objecter_requests cmddesc objecter_requests hook 0x55559c430cb0 EEXIST 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:51:16.400+0000 7f8730946800 1 librados: setting wanted keys 2024-09-12T00:51:16.916 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:51:16.400+0000 7f8730946800 1 librados: calling monclient init 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient: init 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding auth protocol: cephx 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding auth protocol: cephx 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding auth protocol: cephx 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.917 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:51:16.400+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:51:16.400+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:51:16.400+0000 7f8730946800 5 asok(0x55559c146630) register_command rotate-key cmddesc rotate-key hook 0x55559c1effe8 EEXIST 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): picked mon.noname-c con 0x55559c4078e0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): picked mon.noname-b con 0x55559c430e80 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): picked mon.noname-a con 0x55559c4368a0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.918 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): authenticate will time out at 2342.903576s 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): get_auth_request con 0x55559c4078e0 auth_method 0 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): get_auth_request con 0x55559c4368a0 auth_method 0 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.919 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:51:16.400+0000 7f872dc36640 10 monclient(hunting): get_auth_request con 0x55559c430e80 auth_method 0 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:51:16.400+0000 7f872dc36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:51:16.400+0000 7f872dc36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:51:16.400+0000 7f872dc36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): handle_auth_done global_id 7583 payload 824 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient: _finish_hunting 0 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:51:16.400+0000 7f872e437640 1 monclient: found mon.noname-c 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: dump: 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.920 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.921 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.921 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.921 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.921 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.921 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.921 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.921 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.921 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: _finish_auth 0 2024-09-12T00:51:16.922 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: _check_auth_tickets 2024-09-12T00:51:16.922 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:16.922 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:51:16.401+0000 7f8730946800 5 monclient: authenticate success, global_id 7583 2024-09-12T00:51:16.922 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:51:16.401+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.922 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:51:16.401+0000 7f8730946800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:16.922 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:51:16.401+0000 7f8611ffb640 4 set_mon_vals no callback set 2024-09-12T00:51:16.922 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.922 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:16.922 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: dump: 2024-09-12T00:51:16.922 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:51:16.401+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:51:16.401+0000 7f8730946800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:51:16.401+0000 7f8730946800 1 librados: init done 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:51:16.401+0000 7f8730946800 5 asok(0x55559c146630) register_command cr dump hook 0x55559c42fb08 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:51:16.402+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.923 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:51:16.403+0000 7f85fffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:51:16.403+0000 7f85fffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:51:16.403+0000 7f85fffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:51:16.403+0000 7f872dc36640 10 monclient: get_auth_request con 0x7f85f8076470 auth_method 0 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:51:16.403+0000 7f872ec38640 10 monclient: get_auth_request con 0x55559c450790 auth_method 0 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:51:16.404+0000 7f8730946800 20 realm 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:51:16.404+0000 7f8730946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:51:16.404+0000 7f872e437640 10 monclient: get_auth_request con 0x55559c454ac0 auth_method 0 2024-09-12T00:51:16.924 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:51:16.405+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:51:16.405+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:51:16.405+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:51:16.405+0000 7f8730946800 20 searching for the correct realm 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:51:16.406+0000 7f872dc36640 10 monclient: get_auth_request con 0x55559c459be0 auth_method 0 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:51:16.406+0000 7f872ec38640 10 monclient: get_auth_request con 0x7f8724045040 auth_method 0 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:51:16.408+0000 7f872e437640 10 monclient: get_auth_request con 0x7f872008f070 auth_method 0 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:51:16.609+0000 7f872e437640 10 monclient: get_auth_request con 0x7f872008f070 auth_method 0 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:51:16.609+0000 7f872e437640 0 -- 172.21.15.19:0/585678288 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f872008f070 msgr2=0x7f87200689b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:51:16.609+0000 7f85fffff640 1 client.7583.objecter ms_handle_reset 0x7f872008f070 session 0x7f8720005040 osd.0 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:51:16.609+0000 7f85fffff640 10 monclient: _renew_subs 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:51:16.609+0000 7f85fffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:51:16.609+0000 7f872e437640 10 monclient: get_auth_request con 0x7f85f8086810 auth_method 0 2024-09-12T00:51:16.925 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:51:16.610+0000 7f872dc36640 10 monclient: get_auth_request con 0x7f8724038040 auth_method 0 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:51:16.612+0000 7f872ec38640 10 monclient: get_auth_request con 0x7f8720083170 auth_method 0 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:51:16.612+0000 7f872e437640 0 -- 172.21.15.19:0/585678288 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f87280c90e0 msgr2=0x7f87280a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:51:16.814+0000 7f872e437640 10 monclient: get_auth_request con 0x7f87280c90e0 auth_method 0 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:51:16.819+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:51:16.820+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.926 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:51:16.820+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:51:16.820+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:51:16.820+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:51:16.821+0000 7f8730946800 20 zone default found 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:51:16.821+0000 7f8730946800 4 Realm: () 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:51:16.821+0000 7f8730946800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:51:16.821+0000 7f8730946800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:51:16.821+0000 7f8730946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:51:16.821+0000 7f8730946800 20 zonegroup default 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.927 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:51:16.822+0000 7f8730946800 20 started sync module instance, tier type = 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:51:16.822+0000 7f8730946800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=0 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=1 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=2 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=3 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=4 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=5 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=6 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:51:16.836+0000 7f8730946800 20 add_watcher() i=7 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:51:16.836+0000 7f8730946800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding auth protocol: cephx 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding auth protocol: cephx 2024-09-12T00:51:16.928 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding auth protocol: cephx 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.929 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:51:16.837+0000 7f85e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:16.930 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:51:16.837+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.930 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:51:16.837+0000 7f8730946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:16.930 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:51:16.837+0000 7f8730946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:16.930 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command cache list hook 0x55559c405350 2024-09-12T00:51:16.930 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command cache inspect hook 0x55559c405350 2024-09-12T00:51:16.930 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command cache erase hook 0x55559c405350 2024-09-12T00:51:16.930 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command cache zap hook 0x55559c405350 2024-09-12T00:51:16.930 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:51:16.837+0000 7f8730946800 5 note: GC not initialized 2024-09-12T00:51:16.930 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:51:16.837+0000 7f855f7fe640 20 reqs_thread_entry: start 2024-09-12T00:51:16.930 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command sync trace show hook 0x7f8720010050 2024-09-12T00:51:16.930 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command sync trace history hook 0x7f8720010050 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command sync trace active hook 0x7f8720010050 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command sync trace active_short hook 0x7f8720010050 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:51:16.837+0000 7f8730946800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:51:16.837+0000 7f8730946800 20 Filter name: none 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:51:16.838+0000 7f855d7fa640 20 reqs_thread_entry: start 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:51:16.838+0000 7f8730946800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:51:16.838+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:51:16.838+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:51:16.838+0000 7f8730946800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:51:16.838+0000 7f8730946800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:51:16.838+0000 7f8730946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:51:16.931 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:51:16.838+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.932 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:51:16.839+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:16.932 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:51:16.839+0000 7f8730946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:16.932 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:51:16.839+0000 7f8730946800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:16.932 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:51:16.839+0000 7f8730946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:16.932 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:51:16.839+0000 7f8730946800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:16.932 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:51:16.839+0000 7f8730946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:51:16.932 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:51:16.845+0000 7f8730946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:16.932 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:51:16.845+0000 7f8730946800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:16.932 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:51:16.845+0000 7f8730946800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:16.932 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:51:16.845+0000 7f8730946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:51:16.932 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398979 cookie 93826182412688 notifier 7583 bl.length()=827 2024-09-12T00:51:16.933 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:16.933 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:16.933 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:16.933 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:51:16.933 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:51:16.933 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:51:16.933 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:51:16.933 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.0 2024-09-12T00:51:16.933 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.0 2024-09-12T00:51:16.933 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.1 2024-09-12T00:51:16.933 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.1 2024-09-12T00:51:16.934 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.2 2024-09-12T00:51:16.934 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.2 2024-09-12T00:51:16.934 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.3 2024-09-12T00:51:16.934 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.3 2024-09-12T00:51:16.934 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.4 2024-09-12T00:51:16.934 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.4 2024-09-12T00:51:16.934 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.5 2024-09-12T00:51:16.934 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.5 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.6 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.6 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.7 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.7 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.8 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.8 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.9 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.9 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.10 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.10 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.11 2024-09-12T00:51:16.935 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.11 2024-09-12T00:51:16.936 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.12 2024-09-12T00:51:16.936 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.12 2024-09-12T00:51:16.936 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.13 2024-09-12T00:51:16.936 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.13 2024-09-12T00:51:16.936 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:16.936 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:16.936 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:16.936 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:16.936 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:51:16.856+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:16.937 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:51:16.856+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:16.937 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:51:16.857+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:16.937 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:51:16.857+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:16.937 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:51:16.857+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:16.937 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:51:16.857+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:16.937 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:51:16.858+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:16.937 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:51:16.858+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:16.937 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:51:16.858+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:16.937 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:51:16.858+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:16.937 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:51:16.859+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:16.937 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:51:16.859+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:51:16.860+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:51:16.860+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:51:16.861+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:51:16.861+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:51:16.861+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:51:16.861+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:51:16.862+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:51:16.862+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:51:16.862+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:51:16.862+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:51:16.865+0000 7f8730946800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8730946800 time 2024-09-12T00:51:16.866785+0000 2024-09-12T00:51:16.938 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8733f8c71a] 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8733f8c8d8] 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55559b46f641] 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55559b47e51b] 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55559b47f3e4] 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8732c29590] 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:51:16.939 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.940 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:51:16.866+0000 7f8730946800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:16.940 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f8730946800 thread_name:radosgw-admin 2024-09-12T00:51:16.940 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.940 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:16.940 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8732c3e6f0] 2024-09-12T00:51:16.940 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8732c8b99c] 2024-09-12T00:51:16.940 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:51:16.940 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:51:16.940 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8733f8c774] 2024-09-12T00:51:16.940 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8733f8c8d8] 2024-09-12T00:51:16.941 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55559b46f641] 2024-09-12T00:51:16.941 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55559b47e51b] 2024-09-12T00:51:16.941 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55559b47f3e4] 2024-09-12T00:51:16.941 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:51:16.941 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8732c29590] 2024-09-12T00:51:16.941 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:51:16.941 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:51:16.941 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:16.941 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.941 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:16.942 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:51:16.943 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:16.944 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:51:16.944 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:51:16.944 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:51:16.944 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:51:16.944 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:51:16.944 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:51:16.944 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:51:16.944 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:51:16.944 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:51:16.944 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:51:16.944 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:16.945 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:51:16.946 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:51:16.947 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:51:16.948 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:16.949 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:16.949 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:16.949 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:16.949 INFO:tasks.workunit.client.0.smithi019.stderr: 7f855d7fa640 / http_manager 2024-09-12T00:51:16.949 INFO:tasks.workunit.client.0.smithi019.stderr: 7f855f7fe640 / http_manager 2024-09-12T00:51:16.949 INFO:tasks.workunit.client.0.smithi019.stderr: 7f85e4fe1640 / rgw_dt_lg_renew 2024-09-12T00:51:16.949 INFO:tasks.workunit.client.0.smithi019.stderr: 7f85fffff640 / ms_dispatch 2024-09-12T00:51:16.949 INFO:tasks.workunit.client.0.smithi019.stderr: 7f86117fa640 / io_context_pool 2024-09-12T00:51:16.949 INFO:tasks.workunit.client.0.smithi019.stderr: 7f8611ffb640 / io_context_pool 2024-09-12T00:51:16.949 INFO:tasks.workunit.client.0.smithi019.stderr: 7f8613fff640 / ms_dispatch 2024-09-12T00:51:16.949 INFO:tasks.workunit.client.0.smithi019.stderr: 7f861ae05640 / ms_dispatch 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr: 7f861c608640 / io_context_pool 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr: 7f872dc36640 / msgr-worker-2 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr: 7f872e437640 / msgr-worker-1 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr: 7f872ec38640 / msgr-worker-0 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr: 7f872f439640 / io_context_pool 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr: 7f8730946800 / radosgw-admin 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.145857.log 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:51:16.386+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.950 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:51:16.386+0000 7f8730946800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:51:16.386+0000 7f8730946800 10 monclient(hunting): authenticate will time out at 2342.889737s 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): get_auth_request con 0x55559c21d180 auth_method 0 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): get_auth_request con 0x55559c2a1710 auth_method 0 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:51:16.386+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.951 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.952 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:51:16.386+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.952 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:51:16.387+0000 7f872ec38640 10 monclient(hunting): get_auth_request con 0x55559c2abd40 auth_method 0 2024-09-12T00:51:16.952 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:51:16.387+0000 7f872ec38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.952 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:51:16.387+0000 7f872ec38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.952 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:51:16.387+0000 7f872ec38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.952 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:51:16.387+0000 7f872e437640 10 monclient(hunting): handle_auth_done global_id 8085 payload 824 2024-09-12T00:51:16.952 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:51:16.387+0000 7f872e437640 10 monclient: _finish_hunting 0 2024-09-12T00:51:16.952 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:51:16.387+0000 7f872e437640 1 monclient: found mon.noname-a 2024-09-12T00:51:16.952 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:51:16.387+0000 7f872e437640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.953 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.953 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:16.953 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: dump: 2024-09-12T00:51:16.953 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.953 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.953 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.953 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.953 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.954 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.954 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.954 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.954 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.954 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.954 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: _finish_auth 0 2024-09-12T00:51:16.954 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: _check_auth_tickets 2024-09-12T00:51:16.954 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:51:16.387+0000 7f8730946800 5 monclient: authenticate success, global_id 8085 2024-09-12T00:51:16.954 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:51:16.387+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.954 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:51:16.387+0000 7f8730946800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:51:16.387+0000 7f861ae05640 10 monclient: dump: 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.955 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:51:16.387+0000 7f861c608640 4 set_mon_vals no callback set 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:51:16.387+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:51:16.387+0000 7f8730946800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:51:16.387+0000 7f8730946800 1 librados: init done 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:51:16.389+0000 7f861ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:51:16.389+0000 7f861ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:51:16.389+0000 7f861ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:51:16.389+0000 7f872dc36640 10 monclient: get_auth_request con 0x7f86140764a0 auth_method 0 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:51:16.390+0000 7f872ec38640 10 monclient: get_auth_request con 0x55559c38e110 auth_method 0 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:51:16.390+0000 7f872e437640 10 monclient: get_auth_request con 0x55559c3b09a0 auth_method 0 2024-09-12T00:51:16.956 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:51:16.392+0000 7f872dc36640 10 monclient: get_auth_request con 0x55559c3b4200 auth_method 0 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:51:16.393+0000 7f8730946800 10 monclient: build_initial_monmap 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:51:16.393+0000 7f8730946800 1 build_initial for_mkfs: 0 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:51:16.393+0000 7f8730946800 10 monclient: monmap: 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.957 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding auth protocol: cephx 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding auth protocol: cephx 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding auth protocol: cephx 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.958 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: crc 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b9c20) adding con mode: secure 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:51:16.393+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:51:16.393+0000 7f8730946800 5 asok(0x55559c146630) register_command objecter_requests cmddesc objecter_requests hook 0x55559c3bd690 EEXIST 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:51:16.393+0000 7f8730946800 10 monclient: init 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding auth protocol: cephx 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding auth protocol: cephx 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding auth protocol: cephx 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.959 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: crc 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:51:16.393+0000 7f8730946800 5 AuthRegistry(0x55559c3b8bd8) adding con mode: secure 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:51:16.393+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:51:16.394+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:51:16.394+0000 7f8730946800 5 asok(0x55559c146630) register_command rotate-key cmddesc rotate-key hook 0x55559c3b8d20 EEXIST 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): picked mon.noname-b con 0x55559c3e72d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): picked mon.noname-c con 0x55559c3dfcc0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): picked mon.noname-a con 0x55559c3e27d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.960 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient(hunting): authenticate will time out at 2342.897165s 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): get_auth_request con 0x55559c3e27d0 auth_method 0 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): get_auth_request con 0x55559c3dfcc0 auth_method 0 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): get_auth_request con 0x55559c3e72d0 auth_method 0 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.961 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:51:16.394+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:51:16.394+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient(hunting): handle_auth_done global_id 8088 payload 824 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient: _finish_hunting 0 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:51:16.394+0000 7f872ec38640 1 monclient: found mon.noname-a 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:51:16.394+0000 7f872ec38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.962 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: dump: 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: _finish_auth 0 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: _check_auth_tickets 2024-09-12T00:51:16.963 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:51:16.394+0000 7f8730946800 5 monclient: authenticate success, global_id 8088 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:51:16.394+0000 7f8730946800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:51:16.394+0000 7f8613fff640 10 monclient: dump: 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.964 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:51:16.394+0000 7f872f439640 4 set_mon_vals no callback set 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:51:16.395+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:51:16.395+0000 7f8730946800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:51:16.396+0000 7f8613fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:51:16.396+0000 7f8613fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:51:16.396+0000 7f8613fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:51:16.397+0000 7f872e437640 10 monclient: get_auth_request con 0x7f86080763b0 auth_method 0 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:51:16.397+0000 7f8730946800 10 monclient: get_monmap_and_config 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:51:16.397+0000 7f8730946800 10 monclient: build_initial_monmap 2024-09-12T00:51:16.965 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:51:16.397+0000 7f8730946800 1 build_initial for_mkfs: 0 2024-09-12T00:51:16.966 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:51:16.397+0000 7f8730946800 10 monclient: monmap: 2024-09-12T00:51:16.966 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:16.966 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:16.966 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:16.966 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:16.966 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:16.966 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.966 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding auth protocol: cephx 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding auth protocol: cephx 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding auth protocol: cephx 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.967 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: crc 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x55559c402400) adding con mode: secure 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:51:16.397+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:51:16.397+0000 7f8730946800 10 monclient: init 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding auth protocol: cephx 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding auth protocol: cephx 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding auth protocol: cephx 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.968 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.969 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.969 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.969 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.969 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.969 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.969 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.969 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: crc 2024-09-12T00:51:16.970 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:51:16.397+0000 7f8730946800 5 AuthRegistry(0x7ffc73635380) adding con mode: secure 2024-09-12T00:51:16.970 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:51:16.397+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.970 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:51:16.398+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.970 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:51:16.398+0000 7f8730946800 5 asok(0x55559c146630) register_command rotate-key cmddesc rotate-key hook 0x7ffc736354c8 EEXIST 2024-09-12T00:51:16.970 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:16.970 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:51:16.970 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): picked mon.noname-b con 0x55559c4368a0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:16.970 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): picked mon.noname-c con 0x55559c4078e0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:16.970 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): picked mon.noname-a con 0x55559c430e80 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient(hunting): authenticate will time out at 2342.901209s 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): get_auth_request con 0x55559c4078e0 auth_method 0 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): get_auth_request con 0x55559c430e80 auth_method 0 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.971 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): get_auth_request con 0x55559c4368a0 auth_method 0 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:51:16.398+0000 7f872dc36640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.972 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.973 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:51:16.398+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.973 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient(hunting): handle_auth_done global_id 8091 payload 274 2024-09-12T00:51:16.973 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient: _finish_hunting 0 2024-09-12T00:51:16.973 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:51:16.398+0000 7f872ec38640 1 monclient: found mon.noname-a 2024-09-12T00:51:16.973 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:51:16.398+0000 7f872ec38640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:51:16.973 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.973 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:16.973 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: dump: 2024-09-12T00:51:16.973 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.973 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.973 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.974 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.974 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.974 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.974 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.974 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.974 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.974 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.974 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: _finish_auth 0 2024-09-12T00:51:16.974 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:51:16.974 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:51:16.398+0000 7f8730946800 5 monclient: authenticate success, global_id 8091 2024-09-12T00:51:16.974 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:51:16.398+0000 7f8611ffb640 10 monclient: dump: 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.975 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:51:16.398+0000 7f8730946800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:51:16.398+0000 7f8730946800 4 set_mon_vals no callback set 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:51:16.399+0000 7f8730946800 10 monclient: shutdown 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:51:16.399+0000 7f8730946800 10 monclient: build_initial_monmap 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:51:16.399+0000 7f8730946800 1 build_initial for_mkfs: 0 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:51:16.399+0000 7f8730946800 10 monclient: monmap: 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:16.976 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding auth protocol: cephx 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding auth protocol: cephx 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding auth protocol: cephx 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.977 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: crc 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:51:16.399+0000 7f8730946800 5 AuthRegistry(0x55559c407070) adding con mode: secure 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:51:16.399+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:51:16.399+0000 7f8730946800 1 librados: starting msgr at 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:51:16.399+0000 7f8730946800 1 librados: starting objecter 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:51:16.399+0000 7f8730946800 5 asok(0x55559c146630) register_command objecter_requests cmddesc objecter_requests hook 0x55559c430cb0 EEXIST 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:51:16.400+0000 7f8730946800 1 librados: setting wanted keys 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:51:16.400+0000 7f8730946800 1 librados: calling monclient init 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient: init 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding auth protocol: cephx 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding auth protocol: cephx 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding auth protocol: cephx 2024-09-12T00:51:16.978 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: crc 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:51:16.400+0000 7f8730946800 5 AuthRegistry(0x55559c1efea0) adding con mode: secure 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:51:16.400+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:51:16.400+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.979 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:51:16.400+0000 7f8730946800 5 asok(0x55559c146630) register_command rotate-key cmddesc rotate-key hook 0x55559c1effe8 EEXIST 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): picked mon.noname-c con 0x55559c4078e0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): picked mon.noname-b con 0x55559c430e80 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): picked mon.noname-a con 0x55559c4368a0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:51:16.400+0000 7f8730946800 10 monclient(hunting): authenticate will time out at 2342.903576s 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): get_auth_request con 0x55559c4078e0 auth_method 0 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.980 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): get_auth_request con 0x55559c4368a0 auth_method 0 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:51:16.400+0000 7f872ec38640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:51:16.400+0000 7f872dc36640 10 monclient(hunting): get_auth_request con 0x55559c430e80 auth_method 0 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:51:16.400+0000 7f872dc36640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:51:16.400+0000 7f872dc36640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:16.981 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:51:16.400+0000 7f872dc36640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient(hunting): handle_auth_done global_id 7583 payload 824 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient: _finish_hunting 0 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:51:16.400+0000 7f872e437640 1 monclient: found mon.noname-c 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:51:16.400+0000 7f872e437640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: dump: 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.982 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: _finish_auth 0 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: _check_auth_tickets 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:51:16.401+0000 7f8730946800 5 monclient: authenticate success, global_id 7583 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:51:16.401+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:51:16.401+0000 7f8730946800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:51:16.401+0000 7f8611ffb640 4 set_mon_vals no callback set 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:51:16.401+0000 7f85fffff640 10 monclient: dump: 2024-09-12T00:51:16.983 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:51:16.401+0000 7f8730946800 10 monclient: _renew_subs 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:51:16.401+0000 7f8730946800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:51:16.401+0000 7f8730946800 1 librados: init done 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:51:16.401+0000 7f8730946800 5 asok(0x55559c146630) register_command cr dump hook 0x55559c42fb08 2024-09-12T00:51:16.984 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:51:16.402+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:51:16.403+0000 7f85fffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:51:16.403+0000 7f85fffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:51:16.403+0000 7f85fffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:51:16.403+0000 7f872dc36640 10 monclient: get_auth_request con 0x7f85f8076470 auth_method 0 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:51:16.403+0000 7f872ec38640 10 monclient: get_auth_request con 0x55559c450790 auth_method 0 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:51:16.404+0000 7f8730946800 20 realm 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:51:16.404+0000 7f8730946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:51:16.404+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.985 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:51:16.404+0000 7f872e437640 10 monclient: get_auth_request con 0x55559c454ac0 auth_method 0 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:51:16.405+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:51:16.405+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:51:16.405+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:51:16.405+0000 7f8730946800 20 searching for the correct realm 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:51:16.406+0000 7f872dc36640 10 monclient: get_auth_request con 0x55559c459be0 auth_method 0 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:51:16.406+0000 7f872ec38640 10 monclient: get_auth_request con 0x7f8724045040 auth_method 0 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:51:16.408+0000 7f872e437640 10 monclient: get_auth_request con 0x7f872008f070 auth_method 0 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:51:16.609+0000 7f872e437640 10 monclient: get_auth_request con 0x7f872008f070 auth_method 0 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:51:16.609+0000 7f872e437640 0 -- 172.21.15.19:0/585678288 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f872008f070 msgr2=0x7f87200689b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:51:16.609+0000 7f85fffff640 1 client.7583.objecter ms_handle_reset 0x7f872008f070 session 0x7f8720005040 osd.0 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:51:16.609+0000 7f85fffff640 10 monclient: _renew_subs 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:51:16.609+0000 7f85fffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:16.986 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:51:16.609+0000 7f872e437640 10 monclient: get_auth_request con 0x7f85f8086810 auth_method 0 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:51:16.610+0000 7f872dc36640 10 monclient: get_auth_request con 0x7f8724038040 auth_method 0 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:51:16.612+0000 7f872ec38640 10 monclient: get_auth_request con 0x7f8720083170 auth_method 0 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:51:16.612+0000 7f872e437640 0 -- 172.21.15.19:0/585678288 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f87280c90e0 msgr2=0x7f87280a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:51:16.814+0000 7f872e437640 10 monclient: get_auth_request con 0x7f87280c90e0 auth_method 0 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:51:16.819+0000 7f8730946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:51:16.819+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:51:16.820+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:51:16.820+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.987 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:51:16.820+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:51:16.820+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:51:16.821+0000 7f8730946800 20 zone default found 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:51:16.821+0000 7f8730946800 4 Realm: () 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:51:16.821+0000 7f8730946800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:51:16.821+0000 7f8730946800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:51:16.821+0000 7f8730946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:51:16.821+0000 7f8730946800 20 zonegroup default 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.988 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.989 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.989 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:51:16.821+0000 7f8730946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:16.989 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:51:16.822+0000 7f8730946800 20 started sync module instance, tier type = 2024-09-12T00:51:16.989 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:51:16.822+0000 7f8730946800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:16.989 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=0 2024-09-12T00:51:16.989 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=1 2024-09-12T00:51:16.989 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=2 2024-09-12T00:51:16.989 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=3 2024-09-12T00:51:16.990 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=4 2024-09-12T00:51:16.990 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=5 2024-09-12T00:51:16.990 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:51:16.833+0000 7f8730946800 20 add_watcher() i=6 2024-09-12T00:51:16.990 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:51:16.836+0000 7f8730946800 20 add_watcher() i=7 2024-09-12T00:51:16.990 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:51:16.836+0000 7f8730946800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:16.990 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding auth protocol: cephx 2024-09-12T00:51:16.990 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding auth protocol: cephx 2024-09-12T00:51:16.991 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding auth protocol: cephx 2024-09-12T00:51:16.991 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.991 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.991 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.991 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.991 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.992 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.992 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.992 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.992 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.992 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.992 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: crc 2024-09-12T00:51:16.992 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:51:16.837+0000 7f8730946800 5 AuthRegistry(0x7ffc73635860) adding con mode: secure 2024-09-12T00:51:16.993 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:51:16.837+0000 7f85e4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:16.993 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:51:16.837+0000 7f8730946800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:16.993 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:51:16.837+0000 7f8730946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:16.993 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:51:16.837+0000 7f8730946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:16.993 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command cache list hook 0x55559c405350 2024-09-12T00:51:16.994 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command cache inspect hook 0x55559c405350 2024-09-12T00:51:16.994 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command cache erase hook 0x55559c405350 2024-09-12T00:51:16.994 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command cache zap hook 0x55559c405350 2024-09-12T00:51:16.994 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:51:16.837+0000 7f8730946800 5 note: GC not initialized 2024-09-12T00:51:16.994 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:51:16.837+0000 7f855f7fe640 20 reqs_thread_entry: start 2024-09-12T00:51:16.994 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command sync trace show hook 0x7f8720010050 2024-09-12T00:51:16.995 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command sync trace history hook 0x7f8720010050 2024-09-12T00:51:16.995 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command sync trace active hook 0x7f8720010050 2024-09-12T00:51:16.995 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:51:16.837+0000 7f8730946800 5 asok(0x55559c146630) register_command sync trace active_short hook 0x7f8720010050 2024-09-12T00:51:16.995 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:51:16.837+0000 7f8730946800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:16.995 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:51:16.837+0000 7f8730946800 20 Filter name: none 2024-09-12T00:51:16.995 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:51:16.838+0000 7f855d7fa640 20 reqs_thread_entry: start 2024-09-12T00:51:16.996 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:51:16.838+0000 7f8730946800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:51:16.996 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:51:16.838+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.996 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:51:16.838+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:16.996 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:51:16.838+0000 7f8730946800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:51:16.996 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:51:16.838+0000 7f8730946800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:51:16.996 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:51:16.838+0000 7f8730946800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:51:16.997 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:51:16.838+0000 7f8730946800 20 rados->read ofs=0 len=0 2024-09-12T00:51:16.997 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:51:16.839+0000 7f8730946800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:16.997 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:51:16.839+0000 7f8730946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:16.997 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:51:16.839+0000 7f8730946800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:16.997 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:51:16.839+0000 7f8730946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:16.997 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:51:16.839+0000 7f8730946800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:16.997 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:51:16.839+0000 7f8730946800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:51:16.998 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:51:16.845+0000 7f8730946800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:16.998 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:51:16.845+0000 7f8730946800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:16.998 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:51:16.845+0000 7f8730946800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:16.998 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:51:16.845+0000 7f8730946800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:51:16.998 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398979 cookie 93826182412688 notifier 7583 bl.length()=827 2024-09-12T00:51:16.998 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:16.999 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:16.999 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:51:16.846+0000 7f86117fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:16.999 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:51:16.999 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:51:16.999 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:51:16.999 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:51:16.848+0000 7f8730946800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:51:17.000 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.0 2024-09-12T00:51:17.000 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.0 2024-09-12T00:51:17.000 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.1 2024-09-12T00:51:17.000 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.1 2024-09-12T00:51:17.000 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.2 2024-09-12T00:51:17.001 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.2 2024-09-12T00:51:17.001 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.3 2024-09-12T00:51:17.001 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.3 2024-09-12T00:51:17.001 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.4 2024-09-12T00:51:17.001 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.4 2024-09-12T00:51:17.001 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.5 2024-09-12T00:51:17.002 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.5 2024-09-12T00:51:17.002 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.6 2024-09-12T00:51:17.002 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.6 2024-09-12T00:51:17.002 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.7 2024-09-12T00:51:17.002 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.7 2024-09-12T00:51:17.003 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.8 2024-09-12T00:51:17.003 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.8 2024-09-12T00:51:17.003 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.9 2024-09-12T00:51:17.003 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.9 2024-09-12T00:51:17.003 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.10 2024-09-12T00:51:17.003 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.10 2024-09-12T00:51:17.003 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.11 2024-09-12T00:51:17.004 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.11 2024-09-12T00:51:17.004 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.12 2024-09-12T00:51:17.004 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.12 2024-09-12T00:51:17.004 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.13 2024-09-12T00:51:17.004 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.13 2024-09-12T00:51:17.004 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:17.005 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:17.005 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:51:16.855+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:17.005 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:51:16.855+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:17.005 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:51:16.856+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:17.005 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:51:16.856+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:17.005 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:51:16.857+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:17.006 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:51:16.857+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:17.006 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:51:16.857+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:17.006 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:51:16.857+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:17.006 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:51:16.858+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:17.006 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:51:16.858+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:17.006 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:51:16.858+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:17.006 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:51:16.858+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:17.006 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:51:16.859+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:51:16.859+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:51:16.860+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:51:16.860+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:51:16.861+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:51:16.861+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:51:16.861+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:51:16.861+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:51:16.862+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:51:16.862+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:51:16.862+0000 7f8730946800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:51:16.862+0000 7f8730946800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:51:16.865+0000 7f8730946800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f8730946800 time 2024-09-12T00:51:16.866785+0000 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:17.007 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f8733f8c71a] 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8733f8c8d8] 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55559b46f641] 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55559b47e51b] 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55559b47f3e4] 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f8732c29590] 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:51:16.866+0000 7f8730946800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f8730946800 thread_name:radosgw-admin 2024-09-12T00:51:17.008 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f8732c3e6f0] 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f8732c8b99c] 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f8733f8c774] 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f8733f8c8d8] 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55559b46f641] 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x1e1b) [0x55559b47e51b] 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x1d4) [0x55559b47f3e4] 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:51:17.009 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f8732c29590] 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:17.010 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:17.011 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:17.011 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:51:17.011 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:51:17.011 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:51:17.011 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:51:17.011 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:51:17.011 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:51:17.011 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:51:17.011 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:17.011 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:51:17.012 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:17.013 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:51:17.014 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:51:17.015 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:51:17.016 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: 7f855d7fa640 / http_manager 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: 7f855f7fe640 / http_manager 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: 7f85e4fe1640 / rgw_dt_lg_renew 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: 7f85fffff640 / ms_dispatch 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: 7f86117fa640 / io_context_pool 2024-09-12T00:51:17.017 INFO:tasks.workunit.client.0.smithi019.stderr: 7f8611ffb640 / io_context_pool 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr: 7f8613fff640 / ms_dispatch 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr: 7f861ae05640 / ms_dispatch 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr: 7f861c608640 / io_context_pool 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr: 7f872dc36640 / msgr-worker-2 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr: 7f872e437640 / msgr-worker-1 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr: 7f872ec38640 / msgr-worker-0 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr: 7f872f439640 / io_context_pool 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr: 7f8730946800 / radosgw-admin 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:51:16.868455Z_fa4ff390-d470-48cd-930f-6da805c30501/log 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:51:17.018 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:51:17.020 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:17.020 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:17.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.947+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.949+0000 7f6271d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.949+0000 7f6271d2a800 20 realm 2024-09-12T00:51:17.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.949+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.949+0000 7f6271d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.949+0000 7f6271d2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:17.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.949+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.950+0000 7f6271d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.950+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.950+0000 7f6271d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:17.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.950+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.951+0000 7f6271d2a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:17.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.951+0000 7f6271d2a800 20 searching for the correct realm 2024-09-12T00:51:17.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:16.954+0000 7f626524e640 0 -- 172.21.15.19:0/3282786070 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f62580b3bb0 msgr2=0x7f62580647d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:17.159 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.159+0000 7f626e250640 0 -- 172.21.15.19:0/3282786070 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55fecbc95c10 msgr2=0x55fecbc980b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:17.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.163+0000 7f6271d2a800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:17.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.163+0000 7f6271d2a800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:17.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.163+0000 7f6271d2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:17.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.163+0000 7f6271d2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:17.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.163+0000 7f6271d2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:17.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.163+0000 7f6271d2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:17.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.163+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.163 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.163+0000 7f6271d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.163+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.163+0000 7f6271d2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:17.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.163+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:17.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 20 zone default found 2024-09-12T00:51:17.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 4 Realm: () 2024-09-12T00:51:17.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:17.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:17.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:17.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 20 zonegroup default 2024-09-12T00:51:17.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.165 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.164+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.165+0000 7f6271d2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.165+0000 7f6271d2a800 20 started sync module instance, tier type = 2024-09-12T00:51:17.166 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.165+0000 7f6271d2a800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:17.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.174+0000 7f6271d2a800 20 add_watcher() i=0 2024-09-12T00:51:17.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.174+0000 7f6271d2a800 20 add_watcher() i=1 2024-09-12T00:51:17.173 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.174+0000 7f6271d2a800 20 add_watcher() i=2 2024-09-12T00:51:17.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.174+0000 7f6271d2a800 20 add_watcher() i=3 2024-09-12T00:51:17.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.174+0000 7f6271d2a800 20 add_watcher() i=4 2024-09-12T00:51:17.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.174+0000 7f6271d2a800 20 add_watcher() i=5 2024-09-12T00:51:17.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.174+0000 7f6271d2a800 20 add_watcher() i=6 2024-09-12T00:51:17.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.176+0000 7f6271d2a800 20 add_watcher() i=7 2024-09-12T00:51:17.174 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.176+0000 7f6271d2a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:17.176 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.177+0000 7f611f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:17.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.177+0000 7f6271d2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:17.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.177+0000 7f6271d2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:17.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.177+0000 7f6271d2a800 5 note: GC not initialized 2024-09-12T00:51:17.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.177+0000 7f611e7fc640 20 reqs_thread_entry: start 2024-09-12T00:51:17.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.177+0000 7f6271d2a800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:17.177 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.177+0000 7f6271d2a800 20 Filter name: none 2024-09-12T00:51:17.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.177+0000 7f608ffff640 20 reqs_thread_entry: start 2024-09-12T00:51:17.178 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.177+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.178+0000 7f6271d2a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:17.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.178+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.178+0000 7f6271d2a800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:51:17.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.178+0000 7f6271d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:17.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.178+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.179+0000 7f6271d2a800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:17.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.179+0000 7f6271d2a800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.179+0000 7f6271d2a800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:51:17.179 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.179+0000 7f6271d2a800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:17.181 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.181+0000 7f611f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:17.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.183+0000 7f6271d2a800 20 remove_watcher() i=0 2024-09-12T00:51:17.183 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.183+0000 7f6271d2a800 2 removed watcher, disabling cache 2024-09-12T00:51:17.184 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.184+0000 7f6271d2a800 20 remove_watcher() i=1 2024-09-12T00:51:17.185 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.186+0000 7f6271d2a800 20 remove_watcher() i=2 2024-09-12T00:51:17.186 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.187+0000 7f6271d2a800 20 remove_watcher() i=3 2024-09-12T00:51:17.187 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.188+0000 7f6271d2a800 20 remove_watcher() i=4 2024-09-12T00:51:17.189 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.189+0000 7f6271d2a800 20 remove_watcher() i=5 2024-09-12T00:51:17.190 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.190+0000 7f6271d2a800 20 remove_watcher() i=6 2024-09-12T00:51:17.191 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.191+0000 7f6271d2a800 20 remove_watcher() i=7 2024-09-12T00:51:17.205 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:17.205 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:51:17.240 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:51:17.271 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:17.271 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:17.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.312+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.314+0000 7f0ac9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.314+0000 7f0ac9e98800 20 realm 2024-09-12T00:51:17.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.314+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.314+0000 7f0ac9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.314+0000 7f0ac9e98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:17.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.314+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.314+0000 7f0ac9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.314+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.315+0000 7f0ac9e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:17.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.315+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.316+0000 7f0ac9e98800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:17.315 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.316+0000 7f0ac9e98800 20 searching for the correct realm 2024-09-12T00:51:17.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.318+0000 7f0ac7982640 0 -- 172.21.15.19:0/3904199479 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x557dcfa0e0c0 msgr2=0x557dcfa104f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:17.320 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.321+0000 7f0ac8183640 0 -- 172.21.15.19:0/3904199479 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x557dcfa0e0c0 msgr2=0x7f0ab80c6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.528+0000 7f0ac9e98800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.528+0000 7f0ac9e98800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.528+0000 7f0ac9e98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.528+0000 7f0ac9e98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.528+0000 7f0ac9e98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.528+0000 7f0ac9e98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.528+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.528+0000 7f0ac9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.528+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.528+0000 7f0ac9e98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.528+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.529 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:17.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 20 zone default found 2024-09-12T00:51:17.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 4 Realm: () 2024-09-12T00:51:17.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:17.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:17.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:17.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 20 zonegroup default 2024-09-12T00:51:17.530 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.531 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.529+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.530+0000 7f0ac9e98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:17.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.530+0000 7f0ac9e98800 20 started sync module instance, tier type = 2024-09-12T00:51:17.532 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.530+0000 7f0ac9e98800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:17.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.539+0000 7f0ac9e98800 20 add_watcher() i=0 2024-09-12T00:51:17.538 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.539+0000 7f0ac9e98800 20 add_watcher() i=1 2024-09-12T00:51:17.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.539+0000 7f0ac9e98800 20 add_watcher() i=2 2024-09-12T00:51:17.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.539+0000 7f0ac9e98800 20 add_watcher() i=3 2024-09-12T00:51:17.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.539+0000 7f0ac9e98800 20 add_watcher() i=4 2024-09-12T00:51:17.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.539+0000 7f0ac9e98800 20 add_watcher() i=5 2024-09-12T00:51:17.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.539+0000 7f0ac9e98800 20 add_watcher() i=6 2024-09-12T00:51:17.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.541+0000 7f0ac9e98800 20 add_watcher() i=7 2024-09-12T00:51:17.539 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.541+0000 7f0ac9e98800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:17.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.542+0000 7f097dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:17.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.542+0000 7f0ac9e98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:17.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.542+0000 7f0ac9e98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:17.543 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.542+0000 7f0ac9e98800 5 note: GC not initialized 2024-09-12T00:51:17.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.542+0000 7f097cfe1640 20 reqs_thread_entry: start 2024-09-12T00:51:17.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.542+0000 7f0ac9e98800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:17.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.542+0000 7f0ac9e98800 20 Filter name: none 2024-09-12T00:51:17.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.542+0000 7f08f67fc640 20 reqs_thread_entry: start 2024-09-12T00:51:17.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.542+0000 7f0ac9e98800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:51:17.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.542+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:17.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:51:17.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:51:17.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:51:17.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 20 rados->read ofs=0 len=0 2024-09-12T00:51:17.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:51:17.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:17.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:17.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:17.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:17.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:51:17.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:17.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.543+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:17.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.544+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:17.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.544+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:17.546 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.544+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.544+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.544+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.544+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.545+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.545+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.545+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.545+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.546+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.546+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.546+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.546+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:17.547 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.546+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:17.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.546+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:17.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.547+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:17.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.547+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:17.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.548+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:17.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.548+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:17.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.548+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:17.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.548+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:17.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.548+0000 7f0ac9e98800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:17.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.548+0000 7f0ac9e98800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:17.549 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.549+0000 7f097dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:17.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.552+0000 7f0ac9e98800 20 remove_watcher() i=0 2024-09-12T00:51:17.551 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.552+0000 7f0ac9e98800 2 removed watcher, disabling cache 2024-09-12T00:51:17.553 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.553+0000 7f0ac9e98800 20 remove_watcher() i=1 2024-09-12T00:51:17.554 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.554+0000 7f0ac9e98800 20 remove_watcher() i=2 2024-09-12T00:51:17.555 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.556+0000 7f0ac9e98800 20 remove_watcher() i=3 2024-09-12T00:51:17.556 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.557+0000 7f0ac9e98800 20 remove_watcher() i=4 2024-09-12T00:51:17.557 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.558+0000 7f0ac9e98800 20 remove_watcher() i=5 2024-09-12T00:51:17.558 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.558+0000 7f0ac9e98800 20 remove_watcher() i=6 2024-09-12T00:51:17.559 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:17.559+0000 7f0ac9e98800 20 remove_watcher() i=7 2024-09-12T00:51:47.598 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:51:47.630 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:47.630 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:47.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.677+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.680+0000 7f161bb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:47.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.680+0000 7f161bb24800 20 realm 2024-09-12T00:51:47.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.680+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.680+0000 7f161bb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:47.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.680+0000 7f161bb24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:47.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.680+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.680+0000 7f161bb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:47.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.680+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.681+0000 7f161bb24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:47.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.681+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.682+0000 7f161bb24800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:47.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.682+0000 7f161bb24800 20 searching for the correct realm 2024-09-12T00:51:47.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.685+0000 7f1617067640 0 -- 172.21.15.19:0/3862530662 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f160c068350 msgr2=0x7f160c07f8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:47.890 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.891+0000 7f1617067640 0 -- 172.21.15.19:0/3862530662 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55bd48f8f390 msgr2=0x55bd48f91830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:47.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.897+0000 7f161bb24800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:47.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.897+0000 7f161bb24800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:47.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.897+0000 7f161bb24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:47.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.897+0000 7f161bb24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:47.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.897+0000 7f161bb24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:47.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.897+0000 7f161bb24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:47.896 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.897+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.897+0000 7f161bb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:47.897 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.897+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.898+0000 7f161bb24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.898+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.898+0000 7f161bb24800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.898+0000 7f161bb24800 20 zone default found 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.898+0000 7f161bb24800 4 Realm: () 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.898+0000 7f161bb24800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.898+0000 7f161bb24800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.898+0000 7f161bb24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.898+0000 7f161bb24800 20 zonegroup default 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.898+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.899+0000 7f161bb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:47.898 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.899+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.899+0000 7f161bb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:47.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.899+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.900+0000 7f161bb24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:47.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.900+0000 7f161bb24800 20 started sync module instance, tier type = 2024-09-12T00:51:47.899 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.900+0000 7f161bb24800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:47.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.911+0000 7f161bb24800 20 add_watcher() i=0 2024-09-12T00:51:47.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.911+0000 7f161bb24800 20 add_watcher() i=1 2024-09-12T00:51:47.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.911+0000 7f161bb24800 20 add_watcher() i=2 2024-09-12T00:51:47.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.911+0000 7f161bb24800 20 add_watcher() i=3 2024-09-12T00:51:47.909 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.911+0000 7f161bb24800 20 add_watcher() i=4 2024-09-12T00:51:47.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.911+0000 7f161bb24800 20 add_watcher() i=5 2024-09-12T00:51:47.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.911+0000 7f161bb24800 20 add_watcher() i=6 2024-09-12T00:51:47.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.912+0000 7f161bb24800 20 add_watcher() i=7 2024-09-12T00:51:47.910 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.912+0000 7f161bb24800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:47.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.914+0000 7f14cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:47.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.914+0000 7f161bb24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:47.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.914+0000 7f161bb24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:47.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.914+0000 7f161bb24800 5 note: GC not initialized 2024-09-12T00:51:47.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.914+0000 7f14ccfe1640 20 reqs_thread_entry: start 2024-09-12T00:51:47.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.914+0000 7f161bb24800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:47.913 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.914+0000 7f161bb24800 20 Filter name: none 2024-09-12T00:51:47.914 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.915+0000 7f14467fc640 20 reqs_thread_entry: start 2024-09-12T00:51:47.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.915+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.915+0000 7f161bb24800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:47.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.915+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.916+0000 7f161bb24800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:51:47.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.916+0000 7f161bb24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:47.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.916+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.916+0000 7f161bb24800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:47.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.916+0000 7f161bb24800 20 rados->read ofs=0 len=0 2024-09-12T00:51:47.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.916+0000 7f161bb24800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:51:47.915 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.916+0000 7f161bb24800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:47.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.919+0000 7f14cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:47.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.921+0000 7f161bb24800 20 remove_watcher() i=0 2024-09-12T00:51:47.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.921+0000 7f161bb24800 2 removed watcher, disabling cache 2024-09-12T00:51:47.921 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.922+0000 7f161bb24800 20 remove_watcher() i=1 2024-09-12T00:51:47.922 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.924+0000 7f161bb24800 20 remove_watcher() i=2 2024-09-12T00:51:47.923 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.925+0000 7f161bb24800 20 remove_watcher() i=3 2024-09-12T00:51:47.925 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.926+0000 7f161bb24800 20 remove_watcher() i=4 2024-09-12T00:51:47.926 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.927+0000 7f161bb24800 20 remove_watcher() i=5 2024-09-12T00:51:47.927 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.928+0000 7f161bb24800 20 remove_watcher() i=6 2024-09-12T00:51:47.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:47.930+0000 7f161bb24800 20 remove_watcher() i=7 2024-09-12T00:51:47.944 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:47.944 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:51:48.044 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:51:48.073 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:48.074 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:48.114 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.116+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.117+0000 7f865b137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.117+0000 7f865b137800 20 realm 2024-09-12T00:51:48.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.117+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.117+0000 7f865b137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.117+0000 7f865b137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:48.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.117+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.118+0000 7f865b137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.118+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.119+0000 7f865b137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:48.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.119+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.119+0000 7f865b137800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:48.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.119+0000 7f865b137800 20 searching for the correct realm 2024-09-12T00:51:48.121 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.123+0000 7f8656620640 0 -- 172.21.15.19:0/12547172 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f864c06af90 msgr2=0x7f864c09a0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:48.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.329+0000 7f8656620640 0 -- 172.21.15.19:0/12547172 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x561d52d13b90 msgr2=0x561d52d16030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:48.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.333+0000 7f865b137800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:48.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.333+0000 7f865b137800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:48.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.333+0000 7f865b137800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:48.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.333+0000 7f865b137800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:48.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.333+0000 7f865b137800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:48.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.333+0000 7f865b137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:48.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.333+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.333+0000 7f865b137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.333+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:48.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:48.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 20 zone default found 2024-09-12T00:51:48.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 4 Realm: () 2024-09-12T00:51:48.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:48.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:48.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:48.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 20 zonegroup default 2024-09-12T00:51:48.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.334+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.335+0000 7f865b137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.335+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.335+0000 7f865b137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.335+0000 7f865b137800 20 started sync module instance, tier type = 2024-09-12T00:51:48.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.335+0000 7f865b137800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:48.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.344+0000 7f865b137800 20 add_watcher() i=0 2024-09-12T00:51:48.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.344+0000 7f865b137800 20 add_watcher() i=1 2024-09-12T00:51:48.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.344+0000 7f865b137800 20 add_watcher() i=2 2024-09-12T00:51:48.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.344+0000 7f865b137800 20 add_watcher() i=3 2024-09-12T00:51:48.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.344+0000 7f865b137800 20 add_watcher() i=4 2024-09-12T00:51:48.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.344+0000 7f865b137800 20 add_watcher() i=5 2024-09-12T00:51:48.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.344+0000 7f865b137800 20 add_watcher() i=6 2024-09-12T00:51:48.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.345+0000 7f865b137800 20 add_watcher() i=7 2024-09-12T00:51:48.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.345+0000 7f865b137800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:48.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.347+0000 7f850d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:48.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.347+0000 7f865b137800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.347+0000 7f865b137800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.347+0000 7f865b137800 5 note: GC not initialized 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.347+0000 7f8487fff640 20 reqs_thread_entry: start 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.347+0000 7f865b137800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.347+0000 7f865b137800 20 Filter name: none 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.347+0000 7f8485ffb640 20 reqs_thread_entry: start 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:51:48.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:51:48.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.348+0000 7f865b137800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.349+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.349+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.349+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.349+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.349+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:48.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.349+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:48.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.350+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:48.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.350+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:48.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.350+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:48.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.350+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:48.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.350+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:48.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.350+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:48.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.351+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:48.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.351+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:48.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.351+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:48.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.351+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:48.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.351+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:48.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.351+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:48.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.352+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:48.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.352+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:48.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.352+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:48.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.352+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:48.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.352+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:48.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.352+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:48.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.353+0000 7f865b137800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:48.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.353+0000 7f865b137800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:48.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.354+0000 7f850d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:48.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.357+0000 7f865b137800 20 remove_watcher() i=0 2024-09-12T00:51:48.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.357+0000 7f865b137800 2 removed watcher, disabling cache 2024-09-12T00:51:48.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.358+0000 7f865b137800 20 remove_watcher() i=1 2024-09-12T00:51:48.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.359+0000 7f865b137800 20 remove_watcher() i=2 2024-09-12T00:51:48.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.360+0000 7f865b137800 20 remove_watcher() i=3 2024-09-12T00:51:48.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.361+0000 7f865b137800 20 remove_watcher() i=4 2024-09-12T00:51:48.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.362+0000 7f865b137800 20 remove_watcher() i=5 2024-09-12T00:51:48.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.363+0000 7f865b137800 20 remove_watcher() i=6 2024-09-12T00:51:48.362 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.364+0000 7f865b137800 20 remove_watcher() i=7 2024-09-12T00:51:48.375 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:51:48.404 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:48.404 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:48.444 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.446+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.448+0000 7fc8bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.448+0000 7fc8bd240800 20 realm 2024-09-12T00:51:48.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.448+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.448+0000 7fc8bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.448+0000 7fc8bd240800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:48.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.448+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.448+0000 7fc8bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.448+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.449+0000 7fc8bd240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:48.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.449+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.449+0000 7fc8bd240800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:48.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.449+0000 7fc8bd240800 20 searching for the correct realm 2024-09-12T00:51:48.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.453+0000 7fc8ba529640 0 -- 172.21.15.19:0/4286080965 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc8b007a450 msgr2=0x7fc8b007a8d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:48.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.456+0000 7fc8bad2a640 0 -- 172.21.15.19:0/4286080965 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fc8b402f070 msgr2=0x7fc8b4065c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:48.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.460+0000 7fc8bd240800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:48.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.460+0000 7fc8bd240800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:48.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.460+0000 7fc8bd240800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:48.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.460+0000 7fc8bd240800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:48.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.460+0000 7fc8bd240800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:48.459 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.460+0000 7fc8bd240800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:48.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.460+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:48.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:48.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 20 zone default found 2024-09-12T00:51:48.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 4 Realm: () 2024-09-12T00:51:48.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:48.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:48.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:48.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 20 zonegroup default 2024-09-12T00:51:48.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.461+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.462+0000 7fc8bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.462+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.462+0000 7fc8bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.462+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.462+0000 7fc8bd240800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.462+0000 7fc8bd240800 20 started sync module instance, tier type = 2024-09-12T00:51:48.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.462+0000 7fc8bd240800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:48.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.471+0000 7fc8bd240800 20 add_watcher() i=0 2024-09-12T00:51:48.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.471+0000 7fc8bd240800 20 add_watcher() i=1 2024-09-12T00:51:48.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.471+0000 7fc8bd240800 20 add_watcher() i=2 2024-09-12T00:51:48.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.471+0000 7fc8bd240800 20 add_watcher() i=3 2024-09-12T00:51:48.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.471+0000 7fc8bd240800 20 add_watcher() i=4 2024-09-12T00:51:48.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.471+0000 7fc8bd240800 20 add_watcher() i=5 2024-09-12T00:51:48.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.471+0000 7fc8bd240800 20 add_watcher() i=6 2024-09-12T00:51:48.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.472+0000 7fc8bd240800 20 add_watcher() i=7 2024-09-12T00:51:48.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.472+0000 7fc8bd240800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:48.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.473+0000 7fc7717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:48.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.474+0000 7fc8bd240800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:48.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.474+0000 7fc8bd240800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:48.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.474+0000 7fc8bd240800 5 note: GC not initialized 2024-09-12T00:51:48.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.474+0000 7fc6ebfff640 20 reqs_thread_entry: start 2024-09-12T00:51:48.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.474+0000 7fc8bd240800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:48.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.474+0000 7fc8bd240800 20 Filter name: none 2024-09-12T00:51:48.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.474+0000 7fc6e9ffb640 20 reqs_thread_entry: start 2024-09-12T00:51:48.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.475+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.475+0000 7fc8bd240800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.475+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.475+0000 7fc8bd240800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.475+0000 7fc8bd240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.475+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.476+0000 7fc8bd240800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.476+0000 7fc8bd240800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.476+0000 7fc8bd240800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:48.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.476+0000 7fc8bd240800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:48.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.478+0000 7fc7717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:48.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.480+0000 7fc8bd240800 20 remove_watcher() i=0 2024-09-12T00:51:48.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.480+0000 7fc8bd240800 2 removed watcher, disabling cache 2024-09-12T00:51:48.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.481+0000 7fc8bd240800 20 remove_watcher() i=1 2024-09-12T00:51:48.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.482+0000 7fc8bd240800 20 remove_watcher() i=2 2024-09-12T00:51:48.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.483+0000 7fc8bd240800 20 remove_watcher() i=3 2024-09-12T00:51:48.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.484+0000 7fc8bd240800 20 remove_watcher() i=4 2024-09-12T00:51:48.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.485+0000 7fc8bd240800 20 remove_watcher() i=5 2024-09-12T00:51:48.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.486+0000 7fc8bd240800 20 remove_watcher() i=6 2024-09-12T00:51:48.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.487+0000 7fc8bd240800 20 remove_watcher() i=7 2024-09-12T00:51:48.496 INFO:tasks.workunit.client.0.smithi019.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:51:48.498 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:51:48.528 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:48.528 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:48.567 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.568+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.570+0000 7f188200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.569 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.570+0000 7f188200f800 20 realm 2024-09-12T00:51:48.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.570+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.570+0000 7f188200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.570+0000 7f188200f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:48.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.570+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.571+0000 7f188200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.571+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.570 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.571+0000 7f188200f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:48.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.571+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.572+0000 7f188200f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:48.571 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.572+0000 7f188200f800 20 searching for the correct realm 2024-09-12T00:51:48.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.575+0000 7f187cf21640 0 -- 172.21.15.19:0/501642677 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f1874029c20 msgr2=0x7f18740857d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:48.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.781+0000 7f187df23640 0 -- 172.21.15.19:0/501642677 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55b779010b70 msgr2=0x55b779012fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:48.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.785+0000 7f188200f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:48.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.785+0000 7f188200f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:48.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.785+0000 7f188200f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:48.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.785+0000 7f188200f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.785+0000 7f188200f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.785+0000 7f188200f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.785+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.785+0000 7f188200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.785+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 20 zone default found 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 4 Realm: () 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 20 zonegroup default 2024-09-12T00:51:48.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.786+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.787+0000 7f188200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.787+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.787+0000 7f188200f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.787+0000 7f188200f800 20 started sync module instance, tier type = 2024-09-12T00:51:48.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.787+0000 7f188200f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:48.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.795+0000 7f188200f800 20 add_watcher() i=0 2024-09-12T00:51:48.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.795+0000 7f188200f800 20 add_watcher() i=1 2024-09-12T00:51:48.794 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.795+0000 7f188200f800 20 add_watcher() i=2 2024-09-12T00:51:48.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.795+0000 7f188200f800 20 add_watcher() i=3 2024-09-12T00:51:48.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.795+0000 7f188200f800 20 add_watcher() i=4 2024-09-12T00:51:48.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.795+0000 7f188200f800 20 add_watcher() i=5 2024-09-12T00:51:48.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.796+0000 7f188200f800 20 add_watcher() i=6 2024-09-12T00:51:48.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.797+0000 7f188200f800 20 add_watcher() i=7 2024-09-12T00:51:48.795 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.797+0000 7f188200f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:48.797 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.798+0000 7f17337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:48.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.799+0000 7f188200f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:48.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.799+0000 7f188200f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:48.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.799+0000 7f188200f800 5 note: GC not initialized 2024-09-12T00:51:48.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.799+0000 7f17327e4640 20 reqs_thread_entry: start 2024-09-12T00:51:48.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.799+0000 7f188200f800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:48.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.799+0000 7f188200f800 20 Filter name: none 2024-09-12T00:51:48.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.799+0000 7f16a3fff640 20 reqs_thread_entry: start 2024-09-12T00:51:48.798 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.799+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.800+0000 7f188200f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.800+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.800+0000 7f188200f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.800+0000 7f188200f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.800+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.800+0000 7f188200f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.800+0000 7f188200f800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.801+0000 7f188200f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:48.800 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.801+0000 7f188200f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:48.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.803+0000 7f17337e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:48.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.805+0000 7f188200f800 20 remove_watcher() i=0 2024-09-12T00:51:48.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.805+0000 7f188200f800 2 removed watcher, disabling cache 2024-09-12T00:51:48.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.806+0000 7f188200f800 20 remove_watcher() i=1 2024-09-12T00:51:48.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.807+0000 7f188200f800 20 remove_watcher() i=2 2024-09-12T00:51:48.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.808+0000 7f188200f800 20 remove_watcher() i=3 2024-09-12T00:51:48.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.809+0000 7f188200f800 20 remove_watcher() i=4 2024-09-12T00:51:48.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.810+0000 7f188200f800 20 remove_watcher() i=5 2024-09-12T00:51:48.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.811+0000 7f188200f800 20 remove_watcher() i=6 2024-09-12T00:51:48.811 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.812+0000 7f188200f800 20 remove_watcher() i=7 2024-09-12T00:51:48.823 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:48.823 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:51:48.823 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: a-bucket id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T00:51:48.823 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:48.824 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:51:48.861 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:48.861 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:48.900 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.902+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.903+0000 7f28a9d35800 20 realm 2024-09-12T00:51:48.902 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.903+0000 7f28a9d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:48.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:48.903 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:48.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:48.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.905+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:48.904 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.905+0000 7f28a9d35800 20 searching for the correct realm 2024-09-12T00:51:48.907 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:48.908+0000 7f28a5220640 0 -- 172.21.15.19:0/4089949170 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f289c098790 msgr2=0x7f289c023730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:49.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.113+0000 7f28a5220640 0 -- 172.21.15.19:0/4089949170 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x559c2b4233d0 msgr2=0x559c2b425840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:49.116 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:49.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:49.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:49.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:49.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:49.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:49.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:49.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 20 zone default found 2024-09-12T00:51:49.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 4 Realm: () 2024-09-12T00:51:49.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:49.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:49.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:49.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 20 zonegroup default 2024-09-12T00:51:49.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.120+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.120+0000 7f28a9d35800 20 started sync module instance, tier type = 2024-09-12T00:51:49.120 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.120+0000 7f28a9d35800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:49.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=0 2024-09-12T00:51:49.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=1 2024-09-12T00:51:49.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=2 2024-09-12T00:51:49.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=3 2024-09-12T00:51:49.127 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=4 2024-09-12T00:51:49.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=5 2024-09-12T00:51:49.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=6 2024-09-12T00:51:49.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.129+0000 7f28a9d35800 20 add_watcher() i=7 2024-09-12T00:51:49.128 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.130+0000 7f28a9d35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:49.130 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.131+0000 7f2757fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:49.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.132+0000 7f28a9d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:49.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.132+0000 7f28a9d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:49.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.132+0000 7f28a9d35800 5 note: GC not initialized 2024-09-12T00:51:49.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.132+0000 7f2756ffd640 20 reqs_thread_entry: start 2024-09-12T00:51:49.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.132+0000 7f28a9d35800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:49.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.132+0000 7f28a9d35800 20 Filter name: none 2024-09-12T00:51:49.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.132+0000 7f2754ff9640 20 reqs_thread_entry: start 2024-09-12T00:51:49.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.132+0000 7f28a9d35800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:51:49.131 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.132+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.133+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:49.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.133+0000 7f28a9d35800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:51:49.132 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.133+0000 7f28a9d35800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:51:49.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.133+0000 7f28a9d35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:51:49.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.133+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.133+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:49.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.133+0000 7f28a9d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:49.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.133+0000 7f28a9d35800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:49.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.133+0000 7f28a9d35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:49.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.133+0000 7f28a9d35800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:49.133 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.133+0000 7f28a9d35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:51:49.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.138+0000 7f28a9d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:49.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.138+0000 7f28a9d35800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:49.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.138+0000 7f28a9d35800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:49.137 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.138+0000 7f28a9d35800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:51:49.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398981 cookie 94129229023040 notifier 8226 bl.length()=827 2024-09-12T00:51:49.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:49.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:49.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:49.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:51:49.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:51:49.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:51:49.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:51:49.144 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f28a9d35800 time 2024-09-12T00:51:49.146943+0000 2024-09-12T00:51:49.144 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:49.145 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:49.145 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f28ab38c71a] 2024-09-12T00:51:49.145 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f28ab38c8d8] 2024-09-12T00:51:49.145 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c2922e641] 2024-09-12T00:51:49.145 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559c2923e38a] 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f28aa029590] 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.146+0000 7f28a9d35800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f28a9d35800 time 2024-09-12T00:51:49.146943+0000 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f28ab38c71a] 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f28ab38c8d8] 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c2922e641] 2024-09-12T00:51:49.146 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559c2923e38a] 2024-09-12T00:51:49.147 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:51:49.147 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f28aa029590] 2024-09-12T00:51:49.147 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:51:49.147 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:51:49.147 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.147 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:51:49.147 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f28a9d35800 thread_name:radosgw-admin 2024-09-12T00:51:49.163 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:49.163 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f28aa03e6f0] 2024-09-12T00:51:49.163 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f28aa08b99c] 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f28ab38c774] 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f28ab38c8d8] 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c2922e641] 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559c2923e38a] 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f28aa029590] 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.147+0000 7f28a9d35800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:49.164 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f28a9d35800 thread_name:radosgw-admin 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f28aa03e6f0] 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f28aa08b99c] 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f28ab38c774] 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f28ab38c8d8] 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c2922e641] 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559c2923e38a] 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:51:49.165 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f28aa029590] 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:51:48.882+0000 7f2793e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:51:48.882+0000 7f2793e07640 10 monclient: dump: 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.166 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:51:48.882+0000 7f28a9d35800 5 monclient: authenticate success, global_id 8214 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:51:48.882+0000 7f28a9d35800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:51:48.882+0000 7f28a9d35800 4 set_mon_vals no callback set 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:51:48.883+0000 7f28a9d35800 10 monclient: shutdown 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 asok(0x559c2b118630) unregister_commands rotate-key 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:51:48.883+0000 7f28a9d35800 10 monclient: build_initial_monmap 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:51:48.883+0000 7f28a9d35800 1 build_initial for_mkfs: 0 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:51:48.883+0000 7f28a9d35800 10 monclient: monmap: 2024-09-12T00:51:49.167 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding auth protocol: cephx 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding auth protocol: cephx 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding auth protocol: cephx 2024-09-12T00:51:49.168 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:51:48.883+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:51:48.883+0000 7f28a9d35800 1 librados: starting msgr at 2024-09-12T00:51:49.169 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:51:48.883+0000 7f28a9d35800 1 librados: starting objecter 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command objecter_requests hook 0x559c2b33d410 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:51:48.884+0000 7f28a9d35800 1 librados: setting wanted keys 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:51:48.884+0000 7f28a9d35800 1 librados: calling monclient init 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient: init 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding auth protocol: cephx 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding auth protocol: cephx 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding auth protocol: cephx 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.170 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:51:48.884+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:51:48.884+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command rotate-key hook 0x559c2b3385d8 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-a con 0x559c2b1c35e0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-c con 0x559c2b27e4b0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:49.171 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-b con 0x559c2b33f3a0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:49.172 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.172 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.172 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.172 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:49.172 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): authenticate will time out at 2375.386608s 2024-09-12T00:51:49.172 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): get_auth_request con 0x559c2b27e4b0 auth_method 0 2024-09-12T00:51:49.172 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.172 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.172 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): get_auth_request con 0x559c2b1c35e0 auth_method 0 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:51:48.884+0000 7f28a6222640 10 monclient(hunting): get_auth_request con 0x559c2b33f3a0 auth_method 0 2024-09-12T00:51:49.173 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:51:48.884+0000 7f28a6222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:51:48.884+0000 7f28a6222640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:51:48.884+0000 7f28a6222640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): handle_auth_done global_id 7691 payload 824 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient: _finish_hunting 0 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:51:48.885+0000 7f28a5220640 1 monclient: found mon.noname-c 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:51:48.885+0000 7f28a5220640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: dump: 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.174 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: _finish_auth 0 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: _check_auth_tickets 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:51:48.885+0000 7f28a9d35800 5 monclient: authenticate success, global_id 7691 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:51:48.885+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:51:48.885+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:49.175 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: dump: 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:51:48.885+0000 7f2793e07640 4 set_mon_vals no callback set 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:51:48.885+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:51:48.885+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.176 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:51:48.885+0000 7f28a9d35800 1 librados: init done 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:51:48.887+0000 7f2792604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:51:48.887+0000 7f2792604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:51:48.887+0000 7f2792604640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:51:48.887+0000 7f28a5a21640 10 monclient: get_auth_request con 0x7f278c076470 auth_method 0 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:51:48.887+0000 7f28a6222640 10 monclient: get_auth_request con 0x559c2b3614f0 auth_method 0 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:51:48.888+0000 7f28a5a21640 10 monclient: get_auth_request con 0x559c2b384100 auth_method 0 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:51:48.890+0000 7f28a5220640 10 monclient: get_auth_request con 0x559c2b389690 auth_method 0 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:51:48.890+0000 7f28a9d35800 10 monclient: build_initial_monmap 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:51:48.890+0000 7f28a9d35800 1 build_initial for_mkfs: 0 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:51:48.890+0000 7f28a9d35800 10 monclient: monmap: 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:49.177 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding auth protocol: cephx 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding auth protocol: cephx 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding auth protocol: cephx 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.178 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:51:48.891+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command objecter_requests cmddesc objecter_requests hook 0x559c2b390ef0 EEXIST 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient: init 2024-09-12T00:51:49.179 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding auth protocol: cephx 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding auth protocol: cephx 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding auth protocol: cephx 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.180 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:51:48.891+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:51:48.891+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command rotate-key cmddesc rotate-key hook 0x559c2b38c5d0 EEXIST 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-c con 0x559c2b3b4be0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-b con 0x559c2b3b6eb0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-a con 0x559c2b3b33b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.181 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): authenticate will time out at 2375.393934s 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): get_auth_request con 0x559c2b3b4be0 auth_method 0 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): get_auth_request con 0x559c2b3b33b0 auth_method 0 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): get_auth_request con 0x559c2b3b6eb0 auth_method 0 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.182 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): handle_auth_done global_id 7694 payload 824 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient: _finish_hunting 0 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:51:48.892+0000 7f28a5a21640 1 monclient: found mon.noname-c 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.183 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: dump: 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.184 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: dump: 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.185 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:51:48.892+0000 7f28a9d35800 5 monclient: authenticate success, global_id 7694 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:51:48.892+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:51:48.892+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:51:48.892+0000 7f28a6a23640 4 set_mon_vals no callback set 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:51:48.892+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:51:48.892+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:51:48.895+0000 7f278b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:51:48.895+0000 7f278b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:51:48.895+0000 7f278b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:51:48.895+0000 7f28a5220640 10 monclient: get_auth_request con 0x7f2780076380 auth_method 0 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:51:48.895+0000 7f28a9d35800 10 monclient: get_monmap_and_config 2024-09-12T00:51:49.186 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:51:48.895+0000 7f28a9d35800 10 monclient: build_initial_monmap 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:51:48.895+0000 7f28a9d35800 1 build_initial for_mkfs: 0 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:51:48.896+0000 7f28a9d35800 10 monclient: monmap: 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding auth protocol: cephx 2024-09-12T00:51:49.187 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding auth protocol: cephx 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding auth protocol: cephx 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.188 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:51:48.896+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:51:48.896+0000 7f28a9d35800 10 monclient: init 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding auth protocol: cephx 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding auth protocol: cephx 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding auth protocol: cephx 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.189 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:51:48.896+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:51:48.896+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command rotate-key cmddesc rotate-key hook 0x7ffcfea96b28 EEXIST 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:51:48.896+0000 7f28a9d35800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-a con 0x559c2b409090 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-c con 0x559c2b3f99e0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-b con 0x559c2b4044c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.190 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): authenticate will time out at 2375.399057s 2024-09-12T00:51:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): get_auth_request con 0x559c2b3f99e0 auth_method 0 2024-09-12T00:51:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): get_auth_request con 0x559c2b409090 auth_method 0 2024-09-12T00:51:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.191 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): get_auth_request con 0x559c2b4044c0 auth_method 0 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.192 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): handle_auth_done global_id 7697 payload 274 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient: _finish_hunting 0 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:51:48.897+0000 7f28a5220640 1 monclient: found mon.noname-c 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: dump: 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.193 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: _finish_auth 0 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: _check_auth_tickets 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: dump: 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.194 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:51:48.897+0000 7f28a9d35800 5 monclient: authenticate success, global_id 7697 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:51:48.897+0000 7f28a9d35800 4 set_mon_vals no callback set 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:51:48.898+0000 7f28a9d35800 10 monclient: shutdown 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:51:48.898+0000 7f28a9d35800 10 monclient: build_initial_monmap 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:51:48.898+0000 7f28a9d35800 1 build_initial for_mkfs: 0 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:51:48.898+0000 7f28a9d35800 10 monclient: monmap: 2024-09-12T00:51:49.195 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding auth protocol: cephx 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding auth protocol: cephx 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding auth protocol: cephx 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.196 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:51:48.898+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:51:48.898+0000 7f28a9d35800 1 librados: starting msgr at 2024-09-12T00:51:49.197 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:51:48.898+0000 7f28a9d35800 1 librados: starting objecter 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command objecter_requests cmddesc objecter_requests hook 0x559c2b4040f0 EEXIST 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:51:48.898+0000 7f28a9d35800 1 librados: setting wanted keys 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:51:48.898+0000 7f28a9d35800 1 librados: calling monclient init 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:51:48.898+0000 7f28a9d35800 10 monclient: init 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding auth protocol: cephx 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding auth protocol: cephx 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding auth protocol: cephx 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.198 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:51:48.899+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:51:48.899+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command rotate-key cmddesc rotate-key hook 0x559c2b3ccad8 EEXIST 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:49.199 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-c con 0x559c2b3f99e0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-b con 0x559c2b4044c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-a con 0x559c2b409090 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): authenticate will time out at 2375.401559s 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): get_auth_request con 0x559c2b3f99e0 auth_method 0 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.200 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): get_auth_request con 0x559c2b409090 auth_method 0 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): handle_auth_done global_id 8226 payload 824 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient: _finish_hunting 0 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:51:48.899+0000 7f28a6222640 1 monclient: found mon.noname-a 2024-09-12T00:51:49.201 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:51:48.899+0000 7f28a5220640 10 monclient: get_auth_request con 0x559c2b4044c0 auth_method 0 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: dump: 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.202 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:51:48.900+0000 7f28a9d35800 5 monclient: authenticate success, global_id 8226 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:51:48.900+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:51:48.900+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: dump: 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.203 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:51:48.900+0000 7f27897fa640 4 set_mon_vals no callback set 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:51:48.900+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:51:48.900+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:49.204 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:51:48.900+0000 7f28a9d35800 1 librados: init done 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:51:48.900+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command cr dump hook 0x559c2b3fe9e8 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:51:48.902+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:51:48.902+0000 7f27777fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:51:48.902+0000 7f27777fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:51:48.902+0000 7f27777fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:51:48.902+0000 7f28a5a21640 10 monclient: get_auth_request con 0x7f2770076470 auth_method 0 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:51:48.903+0000 7f28a5220640 10 monclient: get_auth_request con 0x559c2b4233d0 auth_method 0 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:51:48.903+0000 7f28a9d35800 20 realm 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.205 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:51:48.903+0000 7f28a9d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:51:48.904+0000 7f28a5a21640 10 monclient: get_auth_request con 0x559c2b4275c0 auth_method 0 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:51:48.905+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:51:48.905+0000 7f28a9d35800 20 searching for the correct realm 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:51:48.905+0000 7f28a5220640 10 monclient: get_auth_request con 0x559c2b42c7f0 auth_method 0 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:51:48.906+0000 7f28a6222640 10 monclient: get_auth_request con 0x7f289c061170 auth_method 0 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:51:48.907+0000 7f28a5a21640 10 monclient: get_auth_request con 0x7f2898085060 auth_method 0 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:51:48.908+0000 7f28a5220640 10 monclient: get_auth_request con 0x7f289c098790 auth_method 0 2024-09-12T00:51:49.206 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:51:48.908+0000 7f28a5220640 0 -- 172.21.15.19:0/4089949170 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f289c098790 msgr2=0x7f289c023730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:51:49.109+0000 7f28a5220640 10 monclient: get_auth_request con 0x7f289c098790 auth_method 0 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:51:49.112+0000 7f28a6222640 10 monclient: get_auth_request con 0x7f2898061040 auth_method 0 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:51:49.113+0000 7f28a5a21640 10 monclient: get_auth_request con 0x7f28a001f040 auth_method 0 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:51:49.113+0000 7f28a5220640 0 -- 172.21.15.19:0/4089949170 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x559c2b4233d0 msgr2=0x559c2b425840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:51:49.114+0000 7f27777fe640 1 client.8226.objecter ms_handle_reset 0x559c2b4233d0 session 0x559c2b422d50 osd.6 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:51:49.114+0000 7f27777fe640 10 monclient: _renew_subs 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:51:49.114+0000 7f27777fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:51:49.114+0000 7f28a5220640 10 monclient: get_auth_request con 0x7f2770086710 auth_method 0 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:49.207 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 zone default found 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:51:49.119+0000 7f28a9d35800 4 Realm: () 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:51:49.119+0000 7f28a9d35800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:51:49.119+0000 7f28a9d35800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:51:49.119+0000 7f28a9d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 zonegroup default 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.208 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:51:49.120+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:51:49.120+0000 7f28a9d35800 20 started sync module instance, tier type = 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:51:49.120+0000 7f28a9d35800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=0 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=1 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=2 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=3 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=4 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=5 2024-09-12T00:51:49.209 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=6 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:51:49.129+0000 7f28a9d35800 20 add_watcher() i=7 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:51:49.130+0000 7f28a9d35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding auth protocol: cephx 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding auth protocol: cephx 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding auth protocol: cephx 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:51:49.131+0000 7f2757fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.210 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:51:49.132+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:51:49.132+0000 7f28a9d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:51:49.132+0000 7f28a9d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command cache list hook 0x559c2b3ff280 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command cache inspect hook 0x559c2b3ff280 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command cache erase hook 0x559c2b3ff280 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command cache zap hook 0x559c2b3ff280 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 note: GC not initialized 2024-09-12T00:51:49.211 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:51:49.132+0000 7f2756ffd640 20 reqs_thread_entry: start 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command sync trace show hook 0x7f2898004e20 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command sync trace history hook 0x7f2898004e20 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command sync trace active hook 0x7f2898004e20 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command sync trace active_short hook 0x7f2898004e20 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:51:49.132+0000 7f28a9d35800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:51:49.132+0000 7f28a9d35800 20 Filter name: none 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:51:49.132+0000 7f2754ff9640 20 reqs_thread_entry: start 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:51:49.132+0000 7f28a9d35800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:51:49.132+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:51:49.133+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:51:49.212 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:51:49.133+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:51:49.133+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:51:49.138+0000 7f28a9d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:51:49.138+0000 7f28a9d35800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:51:49.138+0000 7f28a9d35800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:51:49.138+0000 7f28a9d35800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:51:49.213 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398981 cookie 94129229023040 notifier 8226 bl.length()=827 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:51:49.146+0000 7f28a9d35800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f28a9d35800 time 2024-09-12T00:51:49.146943+0000 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f28ab38c71a] 2024-09-12T00:51:49.214 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f28ab38c8d8] 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c2922e641] 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559c2923e38a] 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f28aa029590] 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:51:49.147+0000 7f28a9d35800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f28a9d35800 thread_name:radosgw-admin 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f28aa03e6f0] 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f28aa08b99c] 2024-09-12T00:51:49.215 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f28ab38c774] 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f28ab38c8d8] 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c2922e641] 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559c2923e38a] 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f28aa029590] 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:51:49.216 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:51:49.217 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:51:49.218 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:49.219 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:51:49.220 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:49.221 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:49.222 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 7f2754ff9640 / http_manager 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 7f2756ffd640 / http_manager 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 7f2757fff640 / rgw_dt_lg_renew 2024-09-12T00:51:49.223 INFO:tasks.workunit.client.0.smithi019.stderr: 7f27777fe640 / ms_dispatch 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: 7f27897fa640 / io_context_pool 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: 7f278b7fe640 / ms_dispatch 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: 7f2792604640 / ms_dispatch 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: 7f2793e07640 / io_context_pool 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: 7f28a5220640 / msgr-worker-2 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: 7f28a5a21640 / msgr-worker-1 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: 7f28a6222640 / msgr-worker-0 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: 7f28a6a23640 / io_context_pool 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: 7f28a9d35800 / radosgw-admin 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.149980.log 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:51:49.224 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:51:48.882+0000 7f2793e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:51:48.882+0000 7f2793e07640 10 monclient: dump: 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.225 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:51:48.882+0000 7f28a9d35800 5 monclient: authenticate success, global_id 8214 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:51:48.882+0000 7f28a9d35800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:51:48.882+0000 7f28a9d35800 4 set_mon_vals no callback set 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:51:48.883+0000 7f28a9d35800 10 monclient: shutdown 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 asok(0x559c2b118630) unregister_commands rotate-key 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:51:48.883+0000 7f28a9d35800 10 monclient: build_initial_monmap 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:51:48.883+0000 7f28a9d35800 1 build_initial for_mkfs: 0 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:51:48.883+0000 7f28a9d35800 10 monclient: monmap: 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:49.226 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding auth protocol: cephx 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding auth protocol: cephx 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding auth protocol: cephx 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.227 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: crc 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 AuthRegistry(0x559c2b33a790) adding con mode: secure 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:51:48.883+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:51:48.883+0000 7f28a9d35800 1 librados: starting msgr at 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:51:48.883+0000 7f28a9d35800 1 librados: starting objecter 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:51:48.883+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command objecter_requests hook 0x559c2b33d410 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:51:48.884+0000 7f28a9d35800 1 librados: setting wanted keys 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:51:48.884+0000 7f28a9d35800 1 librados: calling monclient init 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient: init 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding auth protocol: cephx 2024-09-12T00:51:49.228 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding auth protocol: cephx 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding auth protocol: cephx 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: crc 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 AuthRegistry(0x559c2b338490) adding con mode: secure 2024-09-12T00:51:49.229 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:51:48.884+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:51:48.884+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:51:48.884+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command rotate-key hook 0x559c2b3385d8 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-a con 0x559c2b1c35e0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-c con 0x559c2b27e4b0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-b con 0x559c2b33f3a0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:51:48.884+0000 7f28a9d35800 10 monclient(hunting): authenticate will time out at 2375.386608s 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): get_auth_request con 0x559c2b27e4b0 auth_method 0 2024-09-12T00:51:49.230 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): get_auth_request con 0x559c2b1c35e0 auth_method 0 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:51:48.884+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.231 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:51:48.884+0000 7f28a6222640 10 monclient(hunting): get_auth_request con 0x559c2b33f3a0 auth_method 0 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:51:48.884+0000 7f28a6222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:51:48.884+0000 7f28a6222640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:51:48.884+0000 7f28a6222640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient(hunting): handle_auth_done global_id 7691 payload 824 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:51:48.884+0000 7f28a5220640 10 monclient: _finish_hunting 0 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:51:48.885+0000 7f28a5220640 1 monclient: found mon.noname-c 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:51:48.885+0000 7f28a5220640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: dump: 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.232 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: _finish_auth 0 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: _check_auth_tickets 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:51:48.885+0000 7f28a9d35800 5 monclient: authenticate success, global_id 7691 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:51:48.885+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:51:48.885+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.233 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:51:48.885+0000 7f2792604640 10 monclient: dump: 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.234 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:51:48.885+0000 7f2793e07640 4 set_mon_vals no callback set 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:51:48.885+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:51:48.885+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:51:48.885+0000 7f28a9d35800 1 librados: init done 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:51:48.887+0000 7f2792604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:51:48.887+0000 7f2792604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:51:48.887+0000 7f2792604640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:51:48.887+0000 7f28a5a21640 10 monclient: get_auth_request con 0x7f278c076470 auth_method 0 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:51:48.887+0000 7f28a6222640 10 monclient: get_auth_request con 0x559c2b3614f0 auth_method 0 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:51:48.888+0000 7f28a5a21640 10 monclient: get_auth_request con 0x559c2b384100 auth_method 0 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:51:48.890+0000 7f28a5220640 10 monclient: get_auth_request con 0x559c2b389690 auth_method 0 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:51:48.890+0000 7f28a9d35800 10 monclient: build_initial_monmap 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:51:48.890+0000 7f28a9d35800 1 build_initial for_mkfs: 0 2024-09-12T00:51:49.235 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:51:48.890+0000 7f28a9d35800 10 monclient: monmap: 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding auth protocol: cephx 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding auth protocol: cephx 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding auth protocol: cephx 2024-09-12T00:51:49.236 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: crc 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:51:48.890+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38d590) adding con mode: secure 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:51:48.891+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.237 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command objecter_requests cmddesc objecter_requests hook 0x559c2b390ef0 EEXIST 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient: init 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding auth protocol: cephx 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding auth protocol: cephx 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding auth protocol: cephx 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.238 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: crc 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 AuthRegistry(0x559c2b38c488) adding con mode: secure 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:51:48.891+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:51:48.891+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:51:48.891+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command rotate-key cmddesc rotate-key hook 0x559c2b38c5d0 EEXIST 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-c con 0x559c2b3b4be0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-b con 0x559c2b3b6eb0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-a con 0x559c2b3b33b0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.239 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:51:48.891+0000 7f28a9d35800 10 monclient(hunting): authenticate will time out at 2375.393934s 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): get_auth_request con 0x559c2b3b4be0 auth_method 0 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): get_auth_request con 0x559c2b3b33b0 auth_method 0 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): get_auth_request con 0x559c2b3b6eb0 auth_method 0 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.240 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:51:48.892+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:51:48.892+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient(hunting): handle_auth_done global_id 7694 payload 824 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient: _finish_hunting 0 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:51:48.892+0000 7f28a5a21640 1 monclient: found mon.noname-c 2024-09-12T00:51:49.241 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:51:48.892+0000 7f28a5a21640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.242 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.242 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:49.242 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: dump: 2024-09-12T00:51:49.242 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.242 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.242 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.242 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.242 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.242 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.242 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.242 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:51:48.892+0000 7f278b7fe640 10 monclient: dump: 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.243 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:51:48.892+0000 7f28a9d35800 5 monclient: authenticate success, global_id 7694 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:51:48.892+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:51:48.892+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:51:48.892+0000 7f28a6a23640 4 set_mon_vals no callback set 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:51:48.892+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:51:48.892+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:51:48.895+0000 7f278b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:49.244 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:51:48.895+0000 7f278b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:51:48.895+0000 7f278b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:51:48.895+0000 7f28a5220640 10 monclient: get_auth_request con 0x7f2780076380 auth_method 0 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:51:48.895+0000 7f28a9d35800 10 monclient: get_monmap_and_config 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:51:48.895+0000 7f28a9d35800 10 monclient: build_initial_monmap 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:51:48.895+0000 7f28a9d35800 1 build_initial for_mkfs: 0 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:51:48.896+0000 7f28a9d35800 10 monclient: monmap: 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:49.245 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding auth protocol: cephx 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding auth protocol: cephx 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding auth protocol: cephx 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.246 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: crc 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d4a70) adding con mode: secure 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:51:48.896+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:51:48.896+0000 7f28a9d35800 10 monclient: init 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding auth protocol: cephx 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding auth protocol: cephx 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding auth protocol: cephx 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.247 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: crc 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea969e0) adding con mode: secure 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:51:48.896+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:51:48.896+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:51:48.896+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command rotate-key cmddesc rotate-key hook 0x7ffcfea96b28 EEXIST 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:51:48.896+0000 7f28a9d35800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:49.248 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-a con 0x559c2b409090 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-c con 0x559c2b3f99e0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-b con 0x559c2b4044c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient(hunting): authenticate will time out at 2375.399057s 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): get_auth_request con 0x559c2b3f99e0 auth_method 0 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): get_auth_request con 0x559c2b409090 auth_method 0 2024-09-12T00:51:49.249 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): get_auth_request con 0x559c2b4044c0 auth_method 0 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:51:48.897+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.250 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:51:48.897+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient(hunting): handle_auth_done global_id 7697 payload 274 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient: _finish_hunting 0 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:51:48.897+0000 7f28a5220640 1 monclient: found mon.noname-c 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:51:48.897+0000 7f28a5220640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: dump: 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.251 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.252 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.252 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.252 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.252 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.252 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.252 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: _finish_auth 0 2024-09-12T00:51:49.252 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: _check_auth_tickets 2024-09-12T00:51:49.252 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:49.252 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.252 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:51:49.252 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:51:48.897+0000 7f27897fa640 10 monclient: dump: 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:51:48.897+0000 7f28a9d35800 5 monclient: authenticate success, global_id 7697 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:51:48.897+0000 7f28a9d35800 10 monclient: get_monmap_and_config success 2024-09-12T00:51:49.253 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:51:48.897+0000 7f28a9d35800 4 set_mon_vals no callback set 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:51:48.898+0000 7f28a9d35800 10 monclient: shutdown 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:51:48.898+0000 7f28a9d35800 10 monclient: build_initial_monmap 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:51:48.898+0000 7f28a9d35800 1 build_initial for_mkfs: 0 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:51:48.898+0000 7f28a9d35800 10 monclient: monmap: 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:51:49.254 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding auth protocol: cephx 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding auth protocol: cephx 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding auth protocol: cephx 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.255 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: crc 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3d9820) adding con mode: secure 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:51:48.898+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:51:48.898+0000 7f28a9d35800 1 librados: starting msgr at 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:51:48.898+0000 7f28a9d35800 1 librados: starting objecter 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command objecter_requests cmddesc objecter_requests hook 0x559c2b4040f0 EEXIST 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:51:48.898+0000 7f28a9d35800 1 librados: setting wanted keys 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:51:48.898+0000 7f28a9d35800 1 librados: calling monclient init 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:51:48.898+0000 7f28a9d35800 10 monclient: init 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:51:48.898+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding auth protocol: cephx 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding auth protocol: cephx 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding auth protocol: cephx 2024-09-12T00:51:49.256 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: crc 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 AuthRegistry(0x559c2b3cc990) adding con mode: secure 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:51:48.899+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.257 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:51:48.899+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:51:48.899+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command rotate-key cmddesc rotate-key hook 0x559c2b3ccad8 EEXIST 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient: _reopen_session rank -1 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-c con 0x559c2b3f99e0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-b con 0x559c2b4044c0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): picked mon.noname-a con 0x559c2b409090 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): start opening mon connection 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): _renew_subs 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:51:48.899+0000 7f28a9d35800 10 monclient(hunting): authenticate will time out at 2375.401559s 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): get_auth_request con 0x559c2b3f99e0 auth_method 0 2024-09-12T00:51:49.258 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): get_auth_request con 0x559c2b409090 auth_method 0 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:51:48.899+0000 7f28a5a21640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:51:49.259 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient(hunting): handle_auth_done global_id 8226 payload 824 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient: _finish_hunting 0 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:51:48.899+0000 7f28a6222640 1 monclient: found mon.noname-a 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:51:48.899+0000 7f28a6222640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:51:48.899+0000 7f28a5220640 10 monclient: get_auth_request con 0x559c2b4044c0 auth_method 0 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: dump: 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.260 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: _finish_auth 0 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: _check_auth_tickets 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:51:48.900+0000 7f28a9d35800 5 monclient: authenticate success, global_id 8226 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:51:48.900+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:51:48.900+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:51:49.261 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:51:48.900+0000 7f27777fe640 10 monclient: dump: 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:51:48.900+0000 7f27897fa640 4 set_mon_vals no callback set 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:51:48.900+0000 7f28a9d35800 10 monclient: _renew_subs 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:51:48.900+0000 7f28a9d35800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:49.262 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:51:48.900+0000 7f28a9d35800 1 librados: init done 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:51:48.900+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command cr dump hook 0x559c2b3fe9e8 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:51:48.902+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:51:48.902+0000 7f27777fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:51:48.902+0000 7f27777fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:51:48.902+0000 7f27777fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:51:48.902+0000 7f28a5a21640 10 monclient: get_auth_request con 0x7f2770076470 auth_method 0 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:51:48.903+0000 7f28a5220640 10 monclient: get_auth_request con 0x559c2b4233d0 auth_method 0 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:51:48.903+0000 7f28a9d35800 20 realm 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:51:48.903+0000 7f28a9d35800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:49.263 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:51:48.903+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:51:48.904+0000 7f28a5a21640 10 monclient: get_auth_request con 0x559c2b4275c0 auth_method 0 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:51:48.904+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:51:48.905+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:51:48.905+0000 7f28a9d35800 20 searching for the correct realm 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:51:48.905+0000 7f28a5220640 10 monclient: get_auth_request con 0x559c2b42c7f0 auth_method 0 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:51:48.906+0000 7f28a6222640 10 monclient: get_auth_request con 0x7f289c061170 auth_method 0 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:51:48.907+0000 7f28a5a21640 10 monclient: get_auth_request con 0x7f2898085060 auth_method 0 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:51:48.908+0000 7f28a5220640 10 monclient: get_auth_request con 0x7f289c098790 auth_method 0 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:51:48.908+0000 7f28a5220640 0 -- 172.21.15.19:0/4089949170 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f289c098790 msgr2=0x7f289c023730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:49.264 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:51:49.109+0000 7f28a5220640 10 monclient: get_auth_request con 0x7f289c098790 auth_method 0 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:51:49.112+0000 7f28a6222640 10 monclient: get_auth_request con 0x7f2898061040 auth_method 0 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:51:49.113+0000 7f28a5a21640 10 monclient: get_auth_request con 0x7f28a001f040 auth_method 0 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:51:49.113+0000 7f28a5220640 0 -- 172.21.15.19:0/4089949170 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x559c2b4233d0 msgr2=0x559c2b425840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:51:49.114+0000 7f27777fe640 1 client.8226.objecter ms_handle_reset 0x559c2b4233d0 session 0x559c2b422d50 osd.6 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:51:49.114+0000 7f27777fe640 10 monclient: _renew_subs 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:51:49.114+0000 7f27777fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:51:49.114+0000 7f28a5220640 10 monclient: get_auth_request con 0x7f2770086710 auth_method 0 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:49.265 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:51:49.118+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 zone default found 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:51:49.119+0000 7f28a9d35800 4 Realm: () 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:51:49.119+0000 7f28a9d35800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:51:49.119+0000 7f28a9d35800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:51:49.119+0000 7f28a9d35800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 zonegroup default 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.266 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:51:49.119+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:51:49.120+0000 7f28a9d35800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:51:49.120+0000 7f28a9d35800 20 started sync module instance, tier type = 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:51:49.120+0000 7f28a9d35800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=0 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=1 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=2 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=3 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=4 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=5 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:51:49.128+0000 7f28a9d35800 20 add_watcher() i=6 2024-09-12T00:51:49.267 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:51:49.129+0000 7f28a9d35800 20 add_watcher() i=7 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:51:49.130+0000 7f28a9d35800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding auth protocol: cephx 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding auth protocol: cephx 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding auth protocol: cephx 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:51:49.131+0000 7f2757fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.268 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: crc 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:51:49.131+0000 7f28a9d35800 5 AuthRegistry(0x7ffcfea96ec0) adding con mode: secure 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:51:49.132+0000 7f28a9d35800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:51:49.132+0000 7f28a9d35800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:51:49.132+0000 7f28a9d35800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command cache list hook 0x559c2b3ff280 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command cache inspect hook 0x559c2b3ff280 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command cache erase hook 0x559c2b3ff280 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command cache zap hook 0x559c2b3ff280 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 note: GC not initialized 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:51:49.132+0000 7f2756ffd640 20 reqs_thread_entry: start 2024-09-12T00:51:49.269 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command sync trace show hook 0x7f2898004e20 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command sync trace history hook 0x7f2898004e20 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command sync trace active hook 0x7f2898004e20 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:51:49.132+0000 7f28a9d35800 5 asok(0x559c2b118630) register_command sync trace active_short hook 0x7f2898004e20 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:51:49.132+0000 7f28a9d35800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:51:49.132+0000 7f28a9d35800 20 Filter name: none 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:51:49.132+0000 7f2754ff9640 20 reqs_thread_entry: start 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:51:49.132+0000 7f28a9d35800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:51:49.132+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:51:49.133+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:51:49.270 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:51:49.133+0000 7f28a9d35800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:51:49.133+0000 7f28a9d35800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:51:49.133+0000 7f28a9d35800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:51:49.138+0000 7f28a9d35800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:51:49.138+0000 7f28a9d35800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:51:49.138+0000 7f28a9d35800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:51:49.138+0000 7f28a9d35800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398981 cookie 94129229023040 notifier 8226 bl.length()=827 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:49.271 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:51:49.139+0000 7f27897fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:51:49.140+0000 7f28a9d35800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:51:49.146+0000 7f28a9d35800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f28a9d35800 time 2024-09-12T00:51:49.146943+0000 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f28ab38c71a] 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f28ab38c8d8] 2024-09-12T00:51:49.272 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c2922e641] 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559c2923e38a] 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f28aa029590] 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:51:49.147+0000 7f28a9d35800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f28a9d35800 thread_name:radosgw-admin 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f28aa03e6f0] 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f28aa08b99c] 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:51:49.273 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f28ab38c774] 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f28ab38c8d8] 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559c2922e641] 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x559c2923e38a] 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f28aa029590] 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:51:49.274 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:51:49.275 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:51:49.276 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:51:49.277 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:51:49.278 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:51:49.279 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:51:49.280 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:51:49.281 INFO:tasks.workunit.client.0.smithi019.stderr: 7f2754ff9640 / http_manager 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f2756ffd640 / http_manager 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f2757fff640 / rgw_dt_lg_renew 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f27777fe640 / ms_dispatch 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f27897fa640 / io_context_pool 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f278b7fe640 / ms_dispatch 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f2792604640 / ms_dispatch 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f2793e07640 / io_context_pool 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f28a5220640 / msgr-worker-2 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f28a5a21640 / msgr-worker-1 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f28a6222640 / msgr-worker-0 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f28a6a23640 / io_context_pool 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: 7f28a9d35800 / radosgw-admin 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:51:49.282 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:51:49.283 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:51:49.148401Z_2b02bd23-6b53-4548-8016-1f69e577795a/log 2024-09-12T00:51:49.283 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:51:49.283 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:51:49.283 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:49.283 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:49.426 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.427+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.429+0000 7f4a1952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.429+0000 7f4a1952c800 20 realm 2024-09-12T00:51:49.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.429+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.429+0000 7f4a1952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.429+0000 7f4a1952c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:49.428 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.429+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.430+0000 7f4a1952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.430+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.430+0000 7f4a1952c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.430+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.431+0000 7f4a1952c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:49.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.431+0000 7f4a1952c800 20 searching for the correct realm 2024-09-12T00:51:49.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.434+0000 7f4a14a4e640 0 -- 172.21.15.19:0/1106007358 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f4a0c02d070 msgr2=0x7f4a0c0848d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:51:49.638 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.640+0000 7f4a15a50640 0 -- 172.21.15.19:0/1106007358 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55dcf90d29e0 msgr2=0x55dcf90d4e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:49.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.644+0000 7f4a1952c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:49.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.644+0000 7f4a1952c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:49.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.644+0000 7f4a1952c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:49.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.644+0000 7f4a1952c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:49.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.644+0000 7f4a1952c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:49.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.644+0000 7f4a1952c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:49.643 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.644+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.644+0000 7f4a1952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.644+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:49.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 20 zone default found 2024-09-12T00:51:49.644 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 4 Realm: () 2024-09-12T00:51:49.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:49.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:49.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:49.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 20 zonegroup default 2024-09-12T00:51:49.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.645 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.645+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.646+0000 7f4a1952c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.646+0000 7f4a1952c800 20 started sync module instance, tier type = 2024-09-12T00:51:49.646 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.646+0000 7f4a1952c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:49.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.654+0000 7f4a1952c800 20 add_watcher() i=0 2024-09-12T00:51:49.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.654+0000 7f4a1952c800 20 add_watcher() i=1 2024-09-12T00:51:49.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.654+0000 7f4a1952c800 20 add_watcher() i=2 2024-09-12T00:51:49.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.654+0000 7f4a1952c800 20 add_watcher() i=3 2024-09-12T00:51:49.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.654+0000 7f4a1952c800 20 add_watcher() i=4 2024-09-12T00:51:49.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.654+0000 7f4a1952c800 20 add_watcher() i=5 2024-09-12T00:51:49.653 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.654+0000 7f4a1952c800 20 add_watcher() i=6 2024-09-12T00:51:49.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.655+0000 7f4a1952c800 20 add_watcher() i=7 2024-09-12T00:51:49.654 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.655+0000 7f4a1952c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:49.655 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.657+0000 7f48cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:49.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.657+0000 7f4a1952c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:49.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.657+0000 7f4a1952c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:49.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.657+0000 7f4a1952c800 5 note: GC not initialized 2024-09-12T00:51:49.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.657+0000 7f48cafe5640 20 reqs_thread_entry: start 2024-09-12T00:51:49.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.658+0000 7f4a1952c800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:49.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.658+0000 7f4a1952c800 20 Filter name: none 2024-09-12T00:51:49.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.658+0000 7f48c8fe1640 20 reqs_thread_entry: start 2024-09-12T00:51:49.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.658+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.658+0000 7f4a1952c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:49.657 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.658+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.659+0000 7f4a1952c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:51:49.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.659+0000 7f4a1952c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:49.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.659+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.658 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.659+0000 7f4a1952c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:49.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.659+0000 7f4a1952c800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.659+0000 7f4a1952c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:51:49.659 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.659+0000 7f4a1952c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:51:49.660 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.661+0000 7f48cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:49.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.663+0000 7f4a1952c800 20 remove_watcher() i=0 2024-09-12T00:51:49.662 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.663+0000 7f4a1952c800 2 removed watcher, disabling cache 2024-09-12T00:51:49.663 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.664+0000 7f4a1952c800 20 remove_watcher() i=1 2024-09-12T00:51:49.664 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.665+0000 7f4a1952c800 20 remove_watcher() i=2 2024-09-12T00:51:49.665 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.666+0000 7f4a1952c800 20 remove_watcher() i=3 2024-09-12T00:51:49.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.667+0000 7f4a1952c800 20 remove_watcher() i=4 2024-09-12T00:51:49.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.668+0000 7f4a1952c800 20 remove_watcher() i=5 2024-09-12T00:51:49.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.669+0000 7f4a1952c800 20 remove_watcher() i=6 2024-09-12T00:51:49.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.670+0000 7f4a1952c800 20 remove_watcher() i=7 2024-09-12T00:51:49.682 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:51:49.683 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:51:49.718 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:51:49.747 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:51:49.747 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:51:49.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.788+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.789+0000 7f1b09d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.789+0000 7f1b09d46800 20 realm 2024-09-12T00:51:49.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.789+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.790+0000 7f1b09d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.790+0000 7f1b09d46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:51:49.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.790+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.790+0000 7f1b09d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:49.789 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.790+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.791+0000 7f1b09d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:49.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.791+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:49.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.791+0000 7f1b09d46800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:51:49.790 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.791+0000 7f1b09d46800 20 searching for the correct realm 2024-09-12T00:51:49.793 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:49.795+0000 7f1b07036640 0 -- 172.21.15.19:0/3600771179 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f1afc02eb60 msgr2=0x7f1afc03c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:50.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.001+0000 7f1b07036640 0 -- 172.21.15.19:0/3600771179 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55c25da73b40 msgr2=0x55c25da75fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:51:50.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.005+0000 7f1b09d46800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:51:50.004 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.005+0000 7f1b09d46800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:51:50.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.005+0000 7f1b09d46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:51:50.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.005+0000 7f1b09d46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:51:50.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.005+0000 7f1b09d46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:51:50.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.005+0000 7f1b09d46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:51:50.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.005+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:50.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:50.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:50.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:51:50.005 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:50.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:51:50.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 20 zone default found 2024-09-12T00:51:50.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 4 Realm: () 2024-09-12T00:51:50.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:51:50.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:51:50.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:51:50.008 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 20 zonegroup default 2024-09-12T00:51:50.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.006+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:50.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.007+0000 7f1b09d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:50.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.007+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:50.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.007+0000 7f1b09d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:50.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.007+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:50.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.007+0000 7f1b09d46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:51:50.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.007+0000 7f1b09d46800 20 started sync module instance, tier type = 2024-09-12T00:51:50.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.007+0000 7f1b09d46800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:51:50.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.016+0000 7f1b09d46800 20 add_watcher() i=0 2024-09-12T00:51:50.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.016+0000 7f1b09d46800 20 add_watcher() i=1 2024-09-12T00:51:50.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.016+0000 7f1b09d46800 20 add_watcher() i=2 2024-09-12T00:51:50.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.016+0000 7f1b09d46800 20 add_watcher() i=3 2024-09-12T00:51:50.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.016+0000 7f1b09d46800 20 add_watcher() i=4 2024-09-12T00:51:50.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.016+0000 7f1b09d46800 20 add_watcher() i=5 2024-09-12T00:51:50.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.017+0000 7f1b09d46800 20 add_watcher() i=6 2024-09-12T00:51:50.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.017+0000 7f1b09d46800 20 add_watcher() i=7 2024-09-12T00:51:50.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.017+0000 7f1b09d46800 2 all 8 watchers are set, enabling cache 2024-09-12T00:51:50.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.019+0000 7f19bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:50.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.020+0000 7f1b09d46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:51:50.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.020+0000 7f1b09d46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:51:50.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.020+0000 7f1b09d46800 5 note: GC not initialized 2024-09-12T00:51:50.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.020+0000 7f19bcfe1640 20 reqs_thread_entry: start 2024-09-12T00:51:50.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.020+0000 7f1b09d46800 20 init_complete bucket index max shards: 11 2024-09-12T00:51:50.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.020+0000 7f1b09d46800 20 Filter name: none 2024-09-12T00:51:50.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.020+0000 7f19367fc640 20 reqs_thread_entry: start 2024-09-12T00:51:50.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.020+0000 7f1b09d46800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:51:50.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.020+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:50.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:51:50.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:51:50.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 20 rados->read ofs=0 len=0 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.021+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.022+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:50.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.022+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:51:50.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.022+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:50.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.022+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:51:50.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.023+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:50.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.023+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:51:50.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.023+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:50.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.023+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:51:50.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.023+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:50.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.023+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:51:50.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.024+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:50.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.024+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:51:50.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.024+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:50.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.024+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:51:50.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.024+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:50.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.024+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:51:50.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.025+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:50.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.025+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:51:50.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.025+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:50.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.025+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:51:50.024 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.025+0000 7f1b09d46800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:50.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.025+0000 7f1b09d46800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:51:50.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.027+0000 7f19bdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:51:50.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.029+0000 7f1b09d46800 20 remove_watcher() i=0 2024-09-12T00:51:50.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.029+0000 7f1b09d46800 2 removed watcher, disabling cache 2024-09-12T00:51:50.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.030+0000 7f1b09d46800 20 remove_watcher() i=1 2024-09-12T00:51:50.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.031+0000 7f1b09d46800 20 remove_watcher() i=2 2024-09-12T00:51:50.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.032+0000 7f1b09d46800 20 remove_watcher() i=3 2024-09-12T00:51:50.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.033+0000 7f1b09d46800 20 remove_watcher() i=4 2024-09-12T00:51:50.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.034+0000 7f1b09d46800 20 remove_watcher() i=5 2024-09-12T00:51:50.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.035+0000 7f1b09d46800 20 remove_watcher() i=6 2024-09-12T00:51:50.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:51:50.036+0000 7f1b09d46800 20 remove_watcher() i=7 2024-09-12T00:52:20.067 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:52:20.105 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:20.105 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:20.151 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.153+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.154+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.154+0000 7f0017f42800 20 realm 2024-09-12T00:52:20.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.154+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.153 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.155+0000 7f0017f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:20.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.156+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.154 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.156+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.156+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:20.155 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.156+0000 7f0017f42800 20 searching for the correct realm 2024-09-12T00:52:20.158 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.160+0000 7f000b485640 0 -- 172.21.15.19:0/2150316242 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7efffc01b400 msgr2=0x7efffc01b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.364 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.365+0000 7f0013c86640 0 -- 172.21.15.19:0/2150316242 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f000c09e060 msgr2=0x7f000c0183d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:52:20.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:52:20.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:20.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:20.572 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:20.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:20.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.573+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.573+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.573+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.573 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:20.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.574+0000 7f0017f42800 20 zone default found 2024-09-12T00:52:20.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.574+0000 7f0017f42800 4 Realm: () 2024-09-12T00:52:20.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.574+0000 7f0017f42800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:52:20.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.574+0000 7f0017f42800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:52:20.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.574+0000 7f0017f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:20.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.574+0000 7f0017f42800 20 zonegroup default 2024-09-12T00:52:20.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.574 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.576+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.576+0000 7f0017f42800 20 started sync module instance, tier type = 2024-09-12T00:52:20.575 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.576+0000 7f0017f42800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:52:20.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=0 2024-09-12T00:52:20.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=1 2024-09-12T00:52:20.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=2 2024-09-12T00:52:20.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=3 2024-09-12T00:52:20.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=4 2024-09-12T00:52:20.587 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=5 2024-09-12T00:52:20.588 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=6 2024-09-12T00:52:20.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.590+0000 7f0017f42800 20 add_watcher() i=7 2024-09-12T00:52:20.589 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.590+0000 7f0017f42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:20.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.592+0000 7efec9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:20.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.592+0000 7f0017f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:20.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.592+0000 7f0017f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:20.591 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.592+0000 7f0017f42800 5 note: GC not initialized 2024-09-12T00:52:20.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.592+0000 7efec8fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:20.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.592+0000 7f0017f42800 20 init_complete bucket index max shards: 11 2024-09-12T00:52:20.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.593+0000 7f0017f42800 20 Filter name: none 2024-09-12T00:52:20.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.593+0000 7efe427fc640 20 reqs_thread_entry: start 2024-09-12T00:52:20.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.593+0000 7f0017f42800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:20.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.593+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.593+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:20.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.593+0000 7f0017f42800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:20.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.593+0000 7f0017f42800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:20.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.593+0000 7f0017f42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:52:20.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.593+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.594+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:20.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.594+0000 7f0017f42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:20.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.594+0000 7f0017f42800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:20.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.594+0000 7f0017f42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:20.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.594+0000 7f0017f42800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:20.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.594+0000 7f0017f42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:52:20.594 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.596+0000 7f0017f42800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:52:20.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.604+0000 7f0017f42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:20.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.604+0000 7f0017f42800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:20.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.604+0000 7f0017f42800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:20.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.604+0000 7f0017f42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:52:20.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398982 cookie 94004469751568 notifier 8277 bl.length()=827 2024-09-12T00:52:20.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:20.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:20.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:20.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:52:20.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:52:20.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:52:20.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:52:20.609 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0017f42800 time 2024-09-12T00:52:20.611799+0000 2024-09-12T00:52:20.609 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:20.610 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:20.610 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f001978c71a] 2024-09-12T00:52:20.610 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f001978c8d8] 2024-09-12T00:52:20.610 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f1d592641] 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd8854c) [0x557f1daa554c] 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557f1d5a231d] 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0018429590] 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.611+0000 7f0017f42800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0017f42800 time 2024-09-12T00:52:20.611799+0000 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f001978c71a] 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f001978c8d8] 2024-09-12T00:52:20.611 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f1d592641] 2024-09-12T00:52:20.612 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd8854c) [0x557f1daa554c] 2024-09-12T00:52:20.612 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557f1d5a231d] 2024-09-12T00:52:20.612 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:52:20.612 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0018429590] 2024-09-12T00:52:20.612 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:52:20.612 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:52:20.612 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.612 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:52:20.612 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f0017f42800 thread_name:radosgw-admin 2024-09-12T00:52:20.628 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:20.628 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f001843e6f0] 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f001848b99c] 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f001978c774] 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f001978c8d8] 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f1d592641] 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd8854c) [0x557f1daa554c] 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557f1d5a231d] 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0018429590] 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:52:20.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.612+0000 7f0017f42800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:20.630 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f0017f42800 thread_name:radosgw-admin 2024-09-12T00:52:20.630 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.630 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:20.630 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f001843e6f0] 2024-09-12T00:52:20.630 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f001848b99c] 2024-09-12T00:52:20.630 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:52:20.630 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:52:20.630 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f001978c774] 2024-09-12T00:52:20.630 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f001978c8d8] 2024-09-12T00:52:20.630 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f1d592641] 2024-09-12T00:52:20.630 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd8854c) [0x557f1daa554c] 2024-09-12T00:52:20.631 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557f1d5a231d] 2024-09-12T00:52:20.631 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:52:20.631 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0018429590] 2024-09-12T00:52:20.631 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:52:20.631 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:52:20.631 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:20.631 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.631 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:52:20.631 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding auth protocol: cephx 2024-09-12T00:52:20.631 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding auth protocol: cephx 2024-09-12T00:52:20.631 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:52:20.133+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.632 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:52:20.133+0000 7f0017f42800 1 librados: starting msgr at 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:52:20.133+0000 7f0017f42800 1 librados: starting objecter 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command objecter_requests hook 0x557f1ef806a0 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:52:20.133+0000 7f0017f42800 1 librados: setting wanted keys 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:52:20.133+0000 7f0017f42800 1 librados: calling monclient init 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:52:20.133+0000 7f0017f42800 10 monclient: init 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding auth protocol: cephx 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding auth protocol: cephx 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding auth protocol: cephx 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.633 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:52:20.134+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:52:20.134+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command rotate-key hook 0x557f1ef7d7f8 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:20.634 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-b con 0x557f1ee09880 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-c con 0x557f1ee29de0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-a con 0x557f1eec6fd0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): authenticate will time out at 2406.636570s 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): get_auth_request con 0x557f1eec6fd0 auth_method 0 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): get_auth_request con 0x557f1ee29de0 auth_method 0 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.635 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): get_auth_request con 0x557f1ee09880 auth_method 0 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.636 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): handle_auth_done global_id 8268 payload 824 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient: _finish_hunting 0 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:52:20.134+0000 7f0014487640 1 monclient: found mon.noname-a 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:52:20.135+0000 7f0014487640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: dump: 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.637 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: _finish_auth 0 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: _check_auth_tickets 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: dump: 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.638 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:52:20.135+0000 7f0017f42800 5 monclient: authenticate success, global_id 8268 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:52:20.135+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:52:20.135+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:52:20.135+0000 7eff01e0b640 4 set_mon_vals no callback set 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:52:20.135+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:52:20.135+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:52:20.135+0000 7f0017f42800 1 librados: init done 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:52:20.137+0000 7efefbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:52:20.137+0000 7efefbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:52:20.137+0000 7efefbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.639 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:52:20.137+0000 7f0013c86640 10 monclient: get_auth_request con 0x7efefc0764a0 auth_method 0 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:52:20.138+0000 7f000b485640 10 monclient: get_auth_request con 0x557f1efc0960 auth_method 0 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:52:20.139+0000 7f0013c86640 10 monclient: get_auth_request con 0x557f1efca070 auth_method 0 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:52:20.140+0000 7f000b485640 10 monclient: get_auth_request con 0x557f1efcd8d0 auth_method 0 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:52:20.141+0000 7f0017f42800 10 monclient: build_initial_monmap 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:52:20.141+0000 7f0017f42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:52:20.141+0000 7f0017f42800 10 monclient: monmap: 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:20.640 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding auth protocol: cephx 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding auth protocol: cephx 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding auth protocol: cephx 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.641 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:52:20.141+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command objecter_requests cmddesc objecter_requests hook 0x557f1efd6d40 EEXIST 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient: init 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding auth protocol: cephx 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding auth protocol: cephx 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding auth protocol: cephx 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.642 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:52:20.142+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:52:20.142+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command rotate-key cmddesc rotate-key hook 0x557f1efd2460 EEXIST 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-a con 0x557f1effaa30 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-c con 0x557f1effcd00 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-b con 0x557f1eff9200 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.643 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): authenticate will time out at 2406.644816s 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:52:20.142+0000 7f000b485640 10 monclient(hunting): get_auth_request con 0x557f1effcd00 auth_method 0 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:52:20.142+0000 7f000b485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:52:20.142+0000 7f000b485640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:52:20.142+0000 7f000b485640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:52:20.142+0000 7f0013c86640 10 monclient(hunting): get_auth_request con 0x557f1effaa30 auth_method 0 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:52:20.142+0000 7f0013c86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:52:20.142+0000 7f0013c86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:52:20.142+0000 7f0013c86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): get_auth_request con 0x557f1eff9200 auth_method 0 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.644 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:52:20.143+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:52:20.143+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:52:20.143+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient(hunting): handle_auth_done global_id 8271 payload 824 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient: _finish_hunting 0 2024-09-12T00:52:20.645 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:52:20.143+0000 7f0013c86640 1 monclient: found mon.noname-a 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: dump: 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.646 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.647 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.647 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: _finish_auth 0 2024-09-12T00:52:20.647 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: _check_auth_tickets 2024-09-12T00:52:20.647 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:20.647 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.647 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:20.647 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: dump: 2024-09-12T00:52:20.648 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.648 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.648 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.648 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.648 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.648 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.648 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.649 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.649 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.649 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.649 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:52:20.143+0000 7f0017f42800 5 monclient: authenticate success, global_id 8271 2024-09-12T00:52:20.649 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:52:20.143+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.650 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:52:20.143+0000 7f0014c88640 4 set_mon_vals no callback set 2024-09-12T00:52:20.650 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:52:20.143+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.650 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:52:20.143+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.650 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:52:20.143+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.650 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:52:20.146+0000 7efef97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:20.650 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:52:20.146+0000 7efef97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.650 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:52:20.146+0000 7efef97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.650 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:52:20.146+0000 7f000b485640 10 monclient: get_auth_request con 0x7efeec076380 auth_method 0 2024-09-12T00:52:20.650 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:52:20.146+0000 7f0017f42800 10 monclient: get_monmap_and_config 2024-09-12T00:52:20.650 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:52:20.146+0000 7f0017f42800 10 monclient: build_initial_monmap 2024-09-12T00:52:20.650 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:52:20.146+0000 7f0017f42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:52:20.146+0000 7f0017f42800 10 monclient: monmap: 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding auth protocol: cephx 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding auth protocol: cephx 2024-09-12T00:52:20.651 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding auth protocol: cephx 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.652 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:52:20.146+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:52:20.146+0000 7f0017f42800 10 monclient: init 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding auth protocol: cephx 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding auth protocol: cephx 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding auth protocol: cephx 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.653 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:52:20.147+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:52:20.147+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:52:20.147+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command rotate-key cmddesc rotate-key hook 0x7ffc30bf27b8 EEXIST 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-b con 0x557f1f04eec0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-c con 0x557f1f04a3c0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-a con 0x557f1f040830 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.654 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): authenticate will time out at 2406.649564s 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): get_auth_request con 0x557f1f040830 auth_method 0 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): get_auth_request con 0x557f1f04a3c0 auth_method 0 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.655 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): get_auth_request con 0x557f1f04eec0 auth_method 0 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): handle_auth_done global_id 8274 payload 274 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient: _finish_hunting 0 2024-09-12T00:52:20.656 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:52:20.147+0000 7f0014487640 1 monclient: found mon.noname-a 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: dump: 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.657 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: dump: 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.658 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:52:20.148+0000 7f0017f42800 5 monclient: authenticate success, global_id 8274 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:52:20.148+0000 7f0017f42800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:52:20.148+0000 7f0017f42800 4 set_mon_vals no callback set 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:52:20.148+0000 7f0017f42800 10 monclient: shutdown 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:52:20.149+0000 7f0017f42800 10 monclient: build_initial_monmap 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:52:20.149+0000 7f0017f42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:20.659 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:52:20.149+0000 7f0017f42800 10 monclient: monmap: 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding auth protocol: cephx 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding auth protocol: cephx 2024-09-12T00:52:20.660 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding auth protocol: cephx 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.661 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:52:20.149+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:52:20.149+0000 7f0017f42800 1 librados: starting msgr at 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:52:20.149+0000 7f0017f42800 1 librados: starting objecter 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command objecter_requests cmddesc objecter_requests hook 0x557f1f01d330 EEXIST 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:52:20.149+0000 7f0017f42800 1 librados: setting wanted keys 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:52:20.149+0000 7f0017f42800 1 librados: calling monclient init 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:52:20.149+0000 7f0017f42800 10 monclient: init 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding auth protocol: cephx 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding auth protocol: cephx 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding auth protocol: cephx 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.662 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:52:20.149+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:52:20.150+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:52:20.150+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command rotate-key cmddesc rotate-key hook 0x557f1f012928 EEXIST 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:20.663 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-b con 0x557f1f040830 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-c con 0x557f1f04a3c0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-a con 0x557f1f04eec0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): authenticate will time out at 2406.652219s 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): get_auth_request con 0x557f1f04eec0 auth_method 0 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.664 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): get_auth_request con 0x557f1f040830 auth_method 0 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): get_auth_request con 0x557f1f04a3c0 auth_method 0 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.665 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): handle_auth_done global_id 8277 payload 824 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient: _finish_hunting 0 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:52:20.150+0000 7f0014487640 1 monclient: found mon.noname-a 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: dump: 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.666 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: _finish_auth 0 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: _check_auth_tickets 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:52:20.150+0000 7f0017f42800 5 monclient: authenticate success, global_id 8277 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:52:20.151+0000 7efef17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:52:20.151+0000 7efef17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:52:20.151+0000 7efef17fa640 10 monclient: dump: 2024-09-12T00:52:20.667 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:52:20.151+0000 7efef2ffd640 4 set_mon_vals no callback set 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:52:20.151+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:52:20.151+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:52:20.151+0000 7f0017f42800 1 librados: init done 2024-09-12T00:52:20.668 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:52:20.151+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command cr dump hook 0x7f000c05ef88 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:52:20.153+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:52:20.153+0000 7efef17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:52:20.153+0000 7efef17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:52:20.153+0000 7efef17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:52:20.153+0000 7f0013c86640 10 monclient: get_auth_request con 0x7efedc076470 auth_method 0 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:52:20.154+0000 7f000b485640 10 monclient: get_auth_request con 0x557f1f068940 auth_method 0 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:52:20.154+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:52:20.154+0000 7f0017f42800 20 realm 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:52:20.154+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:52:20.155+0000 7f0017f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.669 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:52:20.155+0000 7f0013c86640 10 monclient: get_auth_request con 0x557f1f06ccb0 auth_method 0 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:52:20.156+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:52:20.156+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:52:20.156+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:52:20.156+0000 7f0017f42800 20 searching for the correct realm 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:52:20.156+0000 7f000b485640 10 monclient: get_auth_request con 0x557f1f071a60 auth_method 0 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:52:20.157+0000 7f0014487640 10 monclient: get_auth_request con 0x7efffc029070 auth_method 0 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:52:20.158+0000 7f0013c86640 10 monclient: get_auth_request con 0x7f000407b800 auth_method 0 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:52:20.160+0000 7f000b485640 10 monclient: get_auth_request con 0x7efffc01b400 auth_method 0 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:52:20.160+0000 7f000b485640 0 -- 172.21.15.19:0/2150316242 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7efffc01b400 msgr2=0x7efffc01b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:52:20.361+0000 7f000b485640 10 monclient: get_auth_request con 0x7efffc01b400 auth_method 0 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:52:20.363+0000 7efef17fa640 1 client.8277.objecter ms_handle_reset 0x557f1f06ccb0 session 0x557f1f06bb00 osd.1 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:52:20.363+0000 7efef17fa640 10 monclient: _renew_subs 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:52:20.363+0000 7efef17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.670 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:52:20.363+0000 7f0013c86640 10 monclient: get_auth_request con 0x7efedc0867f0 auth_method 0 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:52:20.364+0000 7f0014487640 10 monclient: get_auth_request con 0x7f000407bc20 auth_method 0 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:52:20.365+0000 7f0013c86640 10 monclient: get_auth_request con 0x7f000c09e060 auth_method 0 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:52:20.365+0000 7f0013c86640 0 -- 172.21.15.19:0/2150316242 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f000c09e060 msgr2=0x7f000c0183d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:52:20.566+0000 7f0013c86640 10 monclient: get_auth_request con 0x7f000c09e060 auth_method 0 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.671 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 zone default found 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:52:20.574+0000 7f0017f42800 4 Realm: () 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:52:20.574+0000 7f0017f42800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:52:20.574+0000 7f0017f42800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:52:20.574+0000 7f0017f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 zonegroup default 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:52:20.576+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:52:20.576+0000 7f0017f42800 20 started sync module instance, tier type = 2024-09-12T00:52:20.672 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:52:20.576+0000 7f0017f42800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=0 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=1 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=2 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=3 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=4 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=5 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=6 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:52:20.590+0000 7f0017f42800 20 add_watcher() i=7 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:52:20.590+0000 7f0017f42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding auth protocol: cephx 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding auth protocol: cephx 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding auth protocol: cephx 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.673 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:52:20.592+0000 7efec9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:52:20.592+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:52:20.592+0000 7f0017f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:52:20.592+0000 7f0017f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:20.674 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command cache list hook 0x557f1f045ea0 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command cache inspect hook 0x557f1f045ea0 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command cache erase hook 0x557f1f045ea0 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command cache zap hook 0x557f1f045ea0 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 note: GC not initialized 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:52:20.592+0000 7efec8fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command sync trace show hook 0x7efffc0025c0 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command sync trace history hook 0x7efffc0025c0 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command sync trace active hook 0x7efffc0025c0 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command sync trace active_short hook 0x7efffc0025c0 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:52:20.592+0000 7f0017f42800 20 init_complete bucket index max shards: 11 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:52:20.593+0000 7f0017f42800 20 Filter name: none 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:52:20.593+0000 7efe427fc640 20 reqs_thread_entry: start 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:52:20.593+0000 7f0017f42800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:20.675 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:52:20.593+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:52:20.593+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:52:20.593+0000 7f0017f42800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:52:20.593+0000 7f0017f42800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:52:20.593+0000 7f0017f42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:52:20.593+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:52:20.594+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:52:20.594+0000 7f0017f42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:52:20.594+0000 7f0017f42800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:52:20.594+0000 7f0017f42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:52:20.594+0000 7f0017f42800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:52:20.594+0000 7f0017f42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:52:20.596+0000 7f0017f42800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:52:20.604+0000 7f0017f42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:20.676 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:52:20.604+0000 7f0017f42800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:52:20.604+0000 7f0017f42800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:52:20.604+0000 7f0017f42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398982 cookie 94004469751568 notifier 8277 bl.length()=827 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:52:20.611+0000 7f0017f42800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0017f42800 time 2024-09-12T00:52:20.611799+0000 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:20.677 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f001978c71a] 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f001978c8d8] 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f1d592641] 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd8854c) [0x557f1daa554c] 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557f1d5a231d] 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0018429590] 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:52:20.612+0000 7f0017f42800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f0017f42800 thread_name:radosgw-admin 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:20.678 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f001843e6f0] 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f001848b99c] 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f001978c774] 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f001978c8d8] 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f1d592641] 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd8854c) [0x557f1daa554c] 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557f1d5a231d] 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0018429590] 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:20.679 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:52:20.680 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:52:20.681 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:20.682 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:52:20.683 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:20.684 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:52:20.685 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 7efe427fc640 / http_manager 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 7efec8fe1640 / http_manager 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 7efec9fe3640 / rgw_dt_lg_renew 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 7efef17fa640 / ms_dispatch 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 7efef2ffd640 / io_context_pool 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 7efef97fa640 / ms_dispatch 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 7efefbfff640 / ms_dispatch 2024-09-12T00:52:20.686 INFO:tasks.workunit.client.0.smithi019.stderr: 7eff01e0b640 / io_context_pool 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: 7f000b485640 / msgr-worker-2 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0013c86640 / msgr-worker-1 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0014487640 / msgr-worker-0 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0014c88640 / io_context_pool 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0017f42800 / radosgw-admin 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.151747.log 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding auth protocol: cephx 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding auth protocol: cephx 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.687 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: crc 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef84080) adding con mode: secure 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:52:20.133+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:52:20.133+0000 7f0017f42800 1 librados: starting msgr at 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:52:20.133+0000 7f0017f42800 1 librados: starting objecter 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command objecter_requests hook 0x557f1ef806a0 2024-09-12T00:52:20.688 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:52:20.133+0000 7f0017f42800 1 librados: setting wanted keys 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:52:20.133+0000 7f0017f42800 1 librados: calling monclient init 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:52:20.133+0000 7f0017f42800 10 monclient: init 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding auth protocol: cephx 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding auth protocol: cephx 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding auth protocol: cephx 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:52:20.133+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.689 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: crc 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 AuthRegistry(0x557f1ef7d6b0) adding con mode: secure 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:52:20.134+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:52:20.134+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:52:20.134+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command rotate-key hook 0x557f1ef7d7f8 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-b con 0x557f1ee09880 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-c con 0x557f1ee29de0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-a con 0x557f1eec6fd0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:20.690 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:52:20.134+0000 7f0017f42800 10 monclient(hunting): authenticate will time out at 2406.636570s 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): get_auth_request con 0x557f1eec6fd0 auth_method 0 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): get_auth_request con 0x557f1ee29de0 auth_method 0 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): get_auth_request con 0x557f1ee09880 auth_method 0 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.691 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:52:20.134+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:52:20.134+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient(hunting): handle_auth_done global_id 8268 payload 824 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:52:20.134+0000 7f0014487640 10 monclient: _finish_hunting 0 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:52:20.134+0000 7f0014487640 1 monclient: found mon.noname-a 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:52:20.135+0000 7f0014487640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: dump: 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.692 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: _finish_auth 0 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: _check_auth_tickets 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:52:20.135+0000 7efefbfff640 10 monclient: dump: 2024-09-12T00:52:20.693 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:52:20.135+0000 7f0017f42800 5 monclient: authenticate success, global_id 8268 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:52:20.135+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:52:20.135+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:52:20.135+0000 7eff01e0b640 4 set_mon_vals no callback set 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:52:20.135+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.694 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:52:20.135+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:52:20.135+0000 7f0017f42800 1 librados: init done 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:52:20.137+0000 7efefbfff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:52:20.137+0000 7efefbfff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:52:20.137+0000 7efefbfff640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:52:20.137+0000 7f0013c86640 10 monclient: get_auth_request con 0x7efefc0764a0 auth_method 0 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:52:20.138+0000 7f000b485640 10 monclient: get_auth_request con 0x557f1efc0960 auth_method 0 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:52:20.139+0000 7f0013c86640 10 monclient: get_auth_request con 0x557f1efca070 auth_method 0 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:52:20.140+0000 7f000b485640 10 monclient: get_auth_request con 0x557f1efcd8d0 auth_method 0 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:52:20.141+0000 7f0017f42800 10 monclient: build_initial_monmap 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:52:20.141+0000 7f0017f42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:52:20.141+0000 7f0017f42800 10 monclient: monmap: 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:20.695 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding auth protocol: cephx 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding auth protocol: cephx 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding auth protocol: cephx 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.696 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: crc 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:52:20.141+0000 7f0017f42800 5 AuthRegistry(0x557f1efd3420) adding con mode: secure 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:52:20.141+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command objecter_requests cmddesc objecter_requests hook 0x557f1efd6d40 EEXIST 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient: init 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding auth protocol: cephx 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding auth protocol: cephx 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding auth protocol: cephx 2024-09-12T00:52:20.697 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: crc 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 AuthRegistry(0x557f1efd2318) adding con mode: secure 2024-09-12T00:52:20.698 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:52:20.142+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:52:20.142+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:52:20.142+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command rotate-key cmddesc rotate-key hook 0x557f1efd2460 EEXIST 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-a con 0x557f1effaa30 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-c con 0x557f1effcd00 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-b con 0x557f1eff9200 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:52:20.142+0000 7f0017f42800 10 monclient(hunting): authenticate will time out at 2406.644816s 2024-09-12T00:52:20.699 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:52:20.142+0000 7f000b485640 10 monclient(hunting): get_auth_request con 0x557f1effcd00 auth_method 0 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:52:20.142+0000 7f000b485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:52:20.142+0000 7f000b485640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:52:20.142+0000 7f000b485640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:52:20.142+0000 7f0013c86640 10 monclient(hunting): get_auth_request con 0x557f1effaa30 auth_method 0 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:52:20.142+0000 7f0013c86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:52:20.142+0000 7f0013c86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:52:20.142+0000 7f0013c86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): get_auth_request con 0x557f1eff9200 auth_method 0 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:52:20.143+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.700 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:52:20.143+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:52:20.143+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:52:20.143+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient(hunting): handle_auth_done global_id 8271 payload 824 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient: _finish_hunting 0 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:52:20.143+0000 7f0013c86640 1 monclient: found mon.noname-a 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:52:20.143+0000 7f0013c86640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.701 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.704 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:20.704 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: dump: 2024-09-12T00:52:20.704 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.704 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.704 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.704 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.704 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.704 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.704 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: _finish_auth 0 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: _check_auth_tickets 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:52:20.143+0000 7efef97fa640 10 monclient: dump: 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.705 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:52:20.143+0000 7f0017f42800 5 monclient: authenticate success, global_id 8271 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:52:20.143+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:52:20.143+0000 7f0014c88640 4 set_mon_vals no callback set 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:52:20.143+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:52:20.143+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:52:20.143+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:52:20.146+0000 7efef97fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:20.706 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:52:20.146+0000 7efef97fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:52:20.146+0000 7efef97fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:52:20.146+0000 7f000b485640 10 monclient: get_auth_request con 0x7efeec076380 auth_method 0 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:52:20.146+0000 7f0017f42800 10 monclient: get_monmap_and_config 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:52:20.146+0000 7f0017f42800 10 monclient: build_initial_monmap 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:52:20.146+0000 7f0017f42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:52:20.146+0000 7f0017f42800 10 monclient: monmap: 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:20.707 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding auth protocol: cephx 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding auth protocol: cephx 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding auth protocol: cephx 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.708 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: crc 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x557f1f01a870) adding con mode: secure 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:52:20.146+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:52:20.146+0000 7f0017f42800 10 monclient: init 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding auth protocol: cephx 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding auth protocol: cephx 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding auth protocol: cephx 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.709 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: crc 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:52:20.146+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2670) adding con mode: secure 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:52:20.147+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:52:20.147+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:52:20.147+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command rotate-key cmddesc rotate-key hook 0x7ffc30bf27b8 EEXIST 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-b con 0x557f1f04eec0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:20.710 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-c con 0x557f1f04a3c0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-a con 0x557f1f040830 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:52:20.147+0000 7f0017f42800 10 monclient(hunting): authenticate will time out at 2406.649564s 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): get_auth_request con 0x557f1f040830 auth_method 0 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): get_auth_request con 0x557f1f04a3c0 auth_method 0 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.711 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): get_auth_request con 0x557f1f04eec0 auth_method 0 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:52:20.147+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:52:20.147+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.712 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient(hunting): handle_auth_done global_id 8274 payload 274 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient: _finish_hunting 0 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:52:20.147+0000 7f0014487640 1 monclient: found mon.noname-a 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:52:20.147+0000 7f0014487640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: dump: 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.713 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: _finish_auth 0 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:52:20.148+0000 7efef2ffd640 10 monclient: dump: 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.714 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:52:20.148+0000 7f0017f42800 5 monclient: authenticate success, global_id 8274 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:52:20.148+0000 7f0017f42800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:52:20.148+0000 7f0017f42800 4 set_mon_vals no callback set 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:52:20.148+0000 7f0017f42800 10 monclient: shutdown 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:52:20.149+0000 7f0017f42800 10 monclient: build_initial_monmap 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:52:20.149+0000 7f0017f42800 1 build_initial for_mkfs: 0 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:52:20.149+0000 7f0017f42800 10 monclient: monmap: 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:20.715 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding auth protocol: cephx 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding auth protocol: cephx 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding auth protocol: cephx 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.716 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: crc 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f040ce0) adding con mode: secure 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:52:20.149+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:52:20.149+0000 7f0017f42800 1 librados: starting msgr at 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:52:20.149+0000 7f0017f42800 1 librados: starting objecter 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command objecter_requests cmddesc objecter_requests hook 0x557f1f01d330 EEXIST 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:52:20.149+0000 7f0017f42800 1 librados: setting wanted keys 2024-09-12T00:52:20.717 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:52:20.149+0000 7f0017f42800 1 librados: calling monclient init 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:52:20.149+0000 7f0017f42800 10 monclient: init 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding auth protocol: cephx 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding auth protocol: cephx 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding auth protocol: cephx 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.718 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: crc 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:52:20.149+0000 7f0017f42800 5 AuthRegistry(0x557f1f0127e0) adding con mode: secure 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:52:20.149+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:52:20.150+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:52:20.150+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command rotate-key cmddesc rotate-key hook 0x557f1f012928 EEXIST 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-b con 0x557f1f040830 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-c con 0x557f1f04a3c0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): picked mon.noname-a con 0x557f1f04eec0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.719 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient(hunting): authenticate will time out at 2406.652219s 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): get_auth_request con 0x557f1f04eec0 auth_method 0 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): get_auth_request con 0x557f1f040830 auth_method 0 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): get_auth_request con 0x557f1f04a3c0 auth_method 0 2024-09-12T00:52:20.720 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:52:20.150+0000 7f0013c86640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:52:20.150+0000 7f000b485640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient(hunting): handle_auth_done global_id 8277 payload 824 2024-09-12T00:52:20.721 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient: _finish_hunting 0 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:52:20.150+0000 7f0014487640 1 monclient: found mon.noname-a 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:52:20.150+0000 7f0014487640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: dump: 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.722 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: _finish_auth 0 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: _check_auth_tickets 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:52:20.150+0000 7f0017f42800 5 monclient: authenticate success, global_id 8277 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:52:20.150+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:52:20.150+0000 7efef17fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:52:20.151+0000 7efef17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:52:20.151+0000 7efef17fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:52:20.151+0000 7efef17fa640 10 monclient: dump: 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.723 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:52:20.151+0000 7efef2ffd640 4 set_mon_vals no callback set 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:52:20.151+0000 7f0017f42800 10 monclient: _renew_subs 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:52:20.151+0000 7f0017f42800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:52:20.151+0000 7f0017f42800 1 librados: init done 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:52:20.151+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command cr dump hook 0x7f000c05ef88 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:52:20.153+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:52:20.153+0000 7efef17fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:20.724 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:52:20.153+0000 7efef17fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:52:20.153+0000 7efef17fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:52:20.153+0000 7f0013c86640 10 monclient: get_auth_request con 0x7efedc076470 auth_method 0 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:52:20.154+0000 7f000b485640 10 monclient: get_auth_request con 0x557f1f068940 auth_method 0 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:52:20.154+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:52:20.154+0000 7f0017f42800 20 realm 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:52:20.154+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:52:20.155+0000 7f0017f42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:52:20.155+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:52:20.155+0000 7f0013c86640 10 monclient: get_auth_request con 0x557f1f06ccb0 auth_method 0 2024-09-12T00:52:20.725 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:52:20.156+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:52:20.156+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:52:20.156+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:52:20.156+0000 7f0017f42800 20 searching for the correct realm 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:52:20.156+0000 7f000b485640 10 monclient: get_auth_request con 0x557f1f071a60 auth_method 0 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:52:20.157+0000 7f0014487640 10 monclient: get_auth_request con 0x7efffc029070 auth_method 0 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:52:20.158+0000 7f0013c86640 10 monclient: get_auth_request con 0x7f000407b800 auth_method 0 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:52:20.160+0000 7f000b485640 10 monclient: get_auth_request con 0x7efffc01b400 auth_method 0 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:52:20.160+0000 7f000b485640 0 -- 172.21.15.19:0/2150316242 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7efffc01b400 msgr2=0x7efffc01b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:52:20.361+0000 7f000b485640 10 monclient: get_auth_request con 0x7efffc01b400 auth_method 0 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:52:20.363+0000 7efef17fa640 1 client.8277.objecter ms_handle_reset 0x557f1f06ccb0 session 0x557f1f06bb00 osd.1 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:52:20.363+0000 7efef17fa640 10 monclient: _renew_subs 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:52:20.363+0000 7efef17fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:52:20.363+0000 7f0013c86640 10 monclient: get_auth_request con 0x7efedc0867f0 auth_method 0 2024-09-12T00:52:20.726 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:52:20.364+0000 7f0014487640 10 monclient: get_auth_request con 0x7f000407bc20 auth_method 0 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:52:20.365+0000 7f0013c86640 10 monclient: get_auth_request con 0x7f000c09e060 auth_method 0 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:52:20.365+0000 7f0013c86640 0 -- 172.21.15.19:0/2150316242 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f000c09e060 msgr2=0x7f000c0183d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:52:20.566+0000 7f0013c86640 10 monclient: get_auth_request con 0x7f000c09e060 auth_method 0 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:52:20.573+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.727 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 zone default found 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:52:20.574+0000 7f0017f42800 4 Realm: () 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:52:20.574+0000 7f0017f42800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:52:20.574+0000 7f0017f42800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:52:20.574+0000 7f0017f42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 zonegroup default 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:52:20.574+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:52:20.575+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:52:20.576+0000 7f0017f42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.728 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:52:20.576+0000 7f0017f42800 20 started sync module instance, tier type = 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:52:20.576+0000 7f0017f42800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=0 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=1 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=2 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=3 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=4 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=5 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:52:20.588+0000 7f0017f42800 20 add_watcher() i=6 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:52:20.590+0000 7f0017f42800 20 add_watcher() i=7 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:52:20.590+0000 7f0017f42800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding auth protocol: cephx 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding auth protocol: cephx 2024-09-12T00:52:20.729 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding auth protocol: cephx 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: crc 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 AuthRegistry(0x7ffc30bf2b50) adding con mode: secure 2024-09-12T00:52:20.730 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:52:20.592+0000 7efec9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:52:20.592+0000 7f0017f42800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:52:20.592+0000 7f0017f42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:52:20.592+0000 7f0017f42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command cache list hook 0x557f1f045ea0 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command cache inspect hook 0x557f1f045ea0 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command cache erase hook 0x557f1f045ea0 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command cache zap hook 0x557f1f045ea0 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 note: GC not initialized 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:52:20.592+0000 7efec8fe1640 20 reqs_thread_entry: start 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command sync trace show hook 0x7efffc0025c0 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command sync trace history hook 0x7efffc0025c0 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command sync trace active hook 0x7efffc0025c0 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:52:20.592+0000 7f0017f42800 5 asok(0x557f1ed5e630) register_command sync trace active_short hook 0x7efffc0025c0 2024-09-12T00:52:20.731 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:52:20.592+0000 7f0017f42800 20 init_complete bucket index max shards: 11 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:52:20.593+0000 7f0017f42800 20 Filter name: none 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:52:20.593+0000 7efe427fc640 20 reqs_thread_entry: start 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:52:20.593+0000 7f0017f42800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:52:20.593+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:52:20.593+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:52:20.593+0000 7f0017f42800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:52:20.593+0000 7f0017f42800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:52:20.593+0000 7f0017f42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:52:20.593+0000 7f0017f42800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:52:20.594+0000 7f0017f42800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:52:20.594+0000 7f0017f42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:52:20.594+0000 7f0017f42800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:20.732 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:52:20.594+0000 7f0017f42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:52:20.594+0000 7f0017f42800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:52:20.594+0000 7f0017f42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:52:20.596+0000 7f0017f42800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:52:20.604+0000 7f0017f42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:52:20.604+0000 7f0017f42800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:52:20.604+0000 7f0017f42800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:52:20.604+0000 7f0017f42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398982 cookie 94004469751568 notifier 8277 bl.length()=827 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:52:20.605+0000 7efef2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:52:20.733 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:52:20.607+0000 7f0017f42800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:52:20.611+0000 7f0017f42800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0017f42800 time 2024-09-12T00:52:20.611799+0000 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f001978c71a] 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f001978c8d8] 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f1d592641] 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: 4: radosgw-admin(+0xd8854c) [0x557f1daa554c] 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557f1d5a231d] 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: 6: main() 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: 7: /lib64/libc.so.6(+0x29590) [0x7f0018429590] 2024-09-12T00:52:20.734 INFO:tasks.workunit.client.0.smithi019.stderr: 8: __libc_start_main() 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: 9: _start() 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:52:20.612+0000 7f0017f42800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f0017f42800 thread_name:radosgw-admin 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f001843e6f0] 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f001848b99c] 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f001978c774] 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f001978c8d8] 2024-09-12T00:52:20.735 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x557f1d592641] 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: 8: radosgw-admin(+0xd8854c) [0x557f1daa554c] 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x557f1d5a231d] 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: 10: main() 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: 11: /lib64/libc.so.6(+0x29590) [0x7f0018429590] 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: 12: __libc_start_main() 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: 13: _start() 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:52:20.736 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:52:20.737 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:52:20.738 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:20.739 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:52:20.740 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:52:20.741 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:52:20.742 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7efe427fc640 / http_manager 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7efec8fe1640 / http_manager 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7efec9fe3640 / rgw_dt_lg_renew 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7efef17fa640 / ms_dispatch 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7efef2ffd640 / io_context_pool 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7efef97fa640 / ms_dispatch 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7efefbfff640 / ms_dispatch 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7eff01e0b640 / io_context_pool 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7f000b485640 / msgr-worker-2 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0013c86640 / msgr-worker-1 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0014487640 / msgr-worker-0 2024-09-12T00:52:20.743 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0014c88640 / io_context_pool 2024-09-12T00:52:20.744 INFO:tasks.workunit.client.0.smithi019.stderr: 7f0017f42800 / radosgw-admin 2024-09-12T00:52:20.744 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:52:20.744 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:52:20.744 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:52:20.613553Z_dcfe508e-0aef-4834-9467-84e32ef921f6/log 2024-09-12T00:52:20.744 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:52:20.744 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:52:20.745 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:20.745 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.700+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.701+0000 7f209c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.701+0000 7f209c52c800 20 realm 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.701+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.702+0000 7f209c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.702+0000 7f209c52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.702+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.702+0000 7f209c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.702+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.703+0000 7f209c52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.703+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.703+0000 7f209c52c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:20.746 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.703+0000 7f209c52c800 20 searching for the correct realm 2024-09-12T00:52:20.747 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.707+0000 7f2097aac640 0 -- 172.21.15.19:0/3433916207 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f208c06acb0 msgr2=0x7f208c0900c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.912 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.913+0000 7f2098aae640 0 -- 172.21.15.19:0/3433916207 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5599fd4771e0 msgr2=0x5599fd479670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:20.916 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.918+0000 7f209c52c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:52:20.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.918+0000 7f209c52c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:52:20.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.918+0000 7f209c52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:20.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.918+0000 7f209c52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:20.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.918+0000 7f209c52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:20.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.918+0000 7f209c52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:20.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.918+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.918+0000 7f209c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.917 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.918+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.918+0000 7f209c52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:20.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.918+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.918 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 20 zone default found 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 4 Realm: () 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 20 zonegroup default 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:20.919 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 20 started sync module instance, tier type = 2024-09-12T00:52:20.920 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.919+0000 7f209c52c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:52:20.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.929+0000 7f209c52c800 20 add_watcher() i=0 2024-09-12T00:52:20.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.929+0000 7f209c52c800 20 add_watcher() i=1 2024-09-12T00:52:20.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.929+0000 7f209c52c800 20 add_watcher() i=2 2024-09-12T00:52:20.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.929+0000 7f209c52c800 20 add_watcher() i=3 2024-09-12T00:52:20.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.929+0000 7f209c52c800 20 add_watcher() i=4 2024-09-12T00:52:20.928 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.929+0000 7f209c52c800 20 add_watcher() i=5 2024-09-12T00:52:20.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.929+0000 7f209c52c800 20 add_watcher() i=6 2024-09-12T00:52:20.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.930+0000 7f209c52c800 20 add_watcher() i=7 2024-09-12T00:52:20.929 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.930+0000 7f209c52c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:20.931 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.932+0000 7f1f4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:20.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.932+0000 7f209c52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:20.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.932+0000 7f209c52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:20.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f209c52c800 5 note: GC not initialized 2024-09-12T00:52:20.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f1f4dfdb640 20 reqs_thread_entry: start 2024-09-12T00:52:20.932 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f209c52c800 20 init_complete bucket index max shards: 11 2024-09-12T00:52:20.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f209c52c800 20 Filter name: none 2024-09-12T00:52:20.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f1ebf7fe640 20 reqs_thread_entry: start 2024-09-12T00:52:20.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f209c52c800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:20.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f209c52c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:20.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f209c52c800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:20.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f209c52c800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:20.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f209c52c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:52:20.933 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.933+0000 7f209c52c800 20 rados->read ofs=0 len=0 2024-09-12T00:52:20.934 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.934+0000 7f209c52c800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.934+0000 7f209c52c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.934+0000 7f209c52c800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.934+0000 7f209c52c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.934+0000 7f209c52c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.934+0000 7f209c52c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.934+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.934+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.934+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.934+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.935+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.935+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:52:20.935 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.935+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:52:20.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.935+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:52:20.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.936+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:52:20.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.936+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:52:20.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.936+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:52:20.936 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.936+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:52:20.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.936+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:52:20.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.936+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:52:20.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.937+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:52:20.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.937+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:52:20.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.937+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:52:20.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.937+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:52:20.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.937+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:52:20.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.937+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:52:20.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.938+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:52:20.937 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.938+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:52:20.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.938+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:52:20.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.938+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:52:20.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.939+0000 7f209c52c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:52:20.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.939+0000 7f209c52c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:52:20.938 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.940+0000 7f1f4efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:20.940 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.942+0000 7f209c52c800 20 remove_watcher() i=0 2024-09-12T00:52:20.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.942+0000 7f209c52c800 2 removed watcher, disabling cache 2024-09-12T00:52:20.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.943+0000 7f209c52c800 20 remove_watcher() i=1 2024-09-12T00:52:20.942 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.944+0000 7f209c52c800 20 remove_watcher() i=2 2024-09-12T00:52:20.944 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.945+0000 7f209c52c800 20 remove_watcher() i=3 2024-09-12T00:52:20.945 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.946+0000 7f209c52c800 20 remove_watcher() i=4 2024-09-12T00:52:20.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.947+0000 7f209c52c800 20 remove_watcher() i=5 2024-09-12T00:52:20.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.948+0000 7f209c52c800 20 remove_watcher() i=6 2024-09-12T00:52:20.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:20.949+0000 7f209c52c800 20 remove_watcher() i=7 2024-09-12T00:52:20.960 INFO:tasks.workunit.client.0.smithi019.stderr: test: duplicated entries can be purged manually 2024-09-12T00:52:50.976 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:52:51.009 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:51.009 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:51.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.055+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.057+0000 7ff71db20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.057+0000 7ff71db20800 20 realm 2024-09-12T00:52:51.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.057+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.057+0000 7ff71db20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.057+0000 7ff71db20800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:51.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.057+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.057+0000 7ff71db20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.057+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.058+0000 7ff71db20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:51.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.058+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.059+0000 7ff71db20800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:51.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.059+0000 7ff71db20800 20 searching for the correct realm 2024-09-12T00:52:51.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.062+0000 7ff719067640 0 -- 172.21.15.19:0/28974445 >> [v2:172.21.15.135:6800/2991448734,v1:172.21.15.135:6801/2991448734] conn(0x55597f64c990 msgr2=0x55597f64edc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:51.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.065+0000 7ff719868640 0 -- 172.21.15.19:0/28974445 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7ff714015030 msgr2=0x7ff71405f630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:51.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.273+0000 7ff71db20800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:52:51.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.273+0000 7ff71db20800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:52:51.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.273+0000 7ff71db20800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:51.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.273+0000 7ff71db20800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:51.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.273+0000 7ff71db20800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:51.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.273+0000 7ff71db20800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:51.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.273+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.273+0000 7ff71db20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.273 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.273+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.274 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.273+0000 7ff71db20800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.273+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 20 zone default found 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 4 Realm: () 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 20 zonegroup default 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.275 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.274+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.275+0000 7ff71db20800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.275+0000 7ff71db20800 20 started sync module instance, tier type = 2024-09-12T00:52:51.276 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.275+0000 7ff71db20800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:52:51.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.285+0000 7ff71db20800 20 add_watcher() i=0 2024-09-12T00:52:51.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.285+0000 7ff71db20800 20 add_watcher() i=1 2024-09-12T00:52:51.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.285+0000 7ff71db20800 20 add_watcher() i=2 2024-09-12T00:52:51.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.285+0000 7ff71db20800 20 add_watcher() i=3 2024-09-12T00:52:51.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.285+0000 7ff71db20800 20 add_watcher() i=4 2024-09-12T00:52:51.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.285+0000 7ff71db20800 20 add_watcher() i=5 2024-09-12T00:52:51.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.285+0000 7ff71db20800 20 add_watcher() i=6 2024-09-12T00:52:51.285 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.286+0000 7ff71db20800 20 add_watcher() i=7 2024-09-12T00:52:51.286 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.286+0000 7ff71db20800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:51.287 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.288+0000 7ff5c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:51.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.288+0000 7ff71db20800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:51.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.288+0000 7ff71db20800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:51.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.288+0000 7ff71db20800 5 note: GC not initialized 2024-09-12T00:52:51.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.289+0000 7ff5c27fc640 20 reqs_thread_entry: start 2024-09-12T00:52:51.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.289+0000 7ff71db20800 20 init_complete bucket index max shards: 11 2024-09-12T00:52:51.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.289+0000 7ff71db20800 20 Filter name: none 2024-09-12T00:52:51.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.289+0000 7ff53bfff640 20 reqs_thread_entry: start 2024-09-12T00:52:51.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.289+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.289+0000 7ff71db20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:51.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.289+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.290+0000 7ff71db20800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:51.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.290+0000 7ff71db20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:51.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.290+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.290+0000 7ff71db20800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:51.290 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.290+0000 7ff71db20800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.291+0000 7ff71db20800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:51.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.291+0000 7ff71db20800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:51.293 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.293+0000 7ff5c37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:51.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.295+0000 7ff71db20800 20 remove_watcher() i=0 2024-09-12T00:52:51.295 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.295+0000 7ff71db20800 2 removed watcher, disabling cache 2024-09-12T00:52:51.296 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.297+0000 7ff71db20800 20 remove_watcher() i=1 2024-09-12T00:52:51.298 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.298+0000 7ff71db20800 20 remove_watcher() i=2 2024-09-12T00:52:51.299 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.299+0000 7ff71db20800 20 remove_watcher() i=3 2024-09-12T00:52:51.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.301+0000 7ff71db20800 20 remove_watcher() i=4 2024-09-12T00:52:51.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.302+0000 7ff71db20800 20 remove_watcher() i=5 2024-09-12T00:52:51.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.303+0000 7ff71db20800 20 remove_watcher() i=6 2024-09-12T00:52:51.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.304+0000 7ff71db20800 20 remove_watcher() i=7 2024-09-12T00:52:51.316 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.316 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:52:51.316 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: a-bucket id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T00:52:51.317 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.318 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:52:51.354 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:51.354 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:51.396 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.396+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 realm 2024-09-12T00:52:51.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.398+0000 7f5b5bc15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:51.398 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:51.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.399 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.400+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:51.400 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.400+0000 7f5b5bc15800 20 searching for the correct realm 2024-09-12T00:52:51.403 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.403+0000 7f5b4ffff640 0 -- 172.21.15.19:0/1875631128 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f5b4007d040 msgr2=0x7f5b4006c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:51.609 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.609+0000 7f5b57b93640 0 -- 172.21.15.19:0/1875631128 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x56533f757990 msgr2=0x56533f759e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:51.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:52:51.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:52:51.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:51.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:51.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:51.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:51.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.614 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.615 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:51.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:51.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 zone default found 2024-09-12T00:52:51.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 4 Realm: () 2024-09-12T00:52:51.616 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:52:51.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:52:51.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:51.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 zonegroup default 2024-09-12T00:52:51.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 started sync module instance, tier type = 2024-09-12T00:52:51.617 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:52:51.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=0 2024-09-12T00:52:51.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=1 2024-09-12T00:52:51.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=2 2024-09-12T00:52:51.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=3 2024-09-12T00:52:51.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=4 2024-09-12T00:52:51.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=5 2024-09-12T00:52:51.626 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=6 2024-09-12T00:52:51.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.628+0000 7f5b5bc15800 20 add_watcher() i=7 2024-09-12T00:52:51.627 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.628+0000 7f5b5bc15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:51.629 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.629+0000 7f5a0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:51.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:51.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:51.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 note: GC not initialized 2024-09-12T00:52:51.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.630+0000 7f5a0cfe1640 20 reqs_thread_entry: start 2024-09-12T00:52:51.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 init_complete bucket index max shards: 11 2024-09-12T00:52:51.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 Filter name: none 2024-09-12T00:52:51.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.630+0000 7f59867fc640 20 reqs_thread_entry: start 2024-09-12T00:52:51.631 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.630+0000 7f5b5bc15800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:51.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.631+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:51.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:51.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:51.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:52:51.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.631+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.631+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:51.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:51.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:51.632 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:51.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:51.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:52:51.633 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.632+0000 7f5b5bc15800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:52:51.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:51.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:51.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:51.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:52:51.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398983 cookie 94915546988432 notifier 8328 bl.length()=827 2024-09-12T00:52:51.640 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:51.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:51.641 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:51.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:52:51.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:52:51.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:52:51.642 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:52:51.647 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5b5bc15800 time 2024-09-12T00:52:51.649522+0000 2024-09-12T00:52:51.647 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:51.648 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:51.648 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5b5cd8c71a] 2024-09-12T00:52:51.648 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5b5cd8c8d8] 2024-09-12T00:52:51.648 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56533cfe3641] 2024-09-12T00:52:51.648 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56533cff338a] 2024-09-12T00:52:51.648 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:52:51.648 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f5b5ba29590] 2024-09-12T00:52:51.648 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:52:51.648 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:52:51.648 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.648+0000 7f5b5bc15800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5b5bc15800 time 2024-09-12T00:52:51.649522+0000 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5b5cd8c71a] 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5b5cd8c8d8] 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56533cfe3641] 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56533cff338a] 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f5b5ba29590] 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.649 INFO:tasks.workunit.client.0.smithi019.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:52:51.650 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f5b5bc15800 thread_name:radosgw-admin 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5ba3e6f0] 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5b5ba8b99c] 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5b5cd8c774] 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5b5cd8c8d8] 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56533cfe3641] 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56533cff338a] 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f5b5ba29590] 2024-09-12T00:52:51.665 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.649+0000 7f5b5bc15800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f5b5bc15800 thread_name:radosgw-admin 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5ba3e6f0] 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5b5ba8b99c] 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5b5cd8c774] 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5b5cd8c8d8] 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56533cfe3641] 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56533cff338a] 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:52:51.666 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f5b5ba29590] 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:52:51.378+0000 7f5b5bc15800 4 set_mon_vals no callback set 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 10 monclient: shutdown 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 asok(0x56533f44a630) unregister_commands rotate-key 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 10 monclient: build_initial_monmap 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 1 build_initial for_mkfs: 0 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 10 monclient: monmap: 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:51.667 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding auth protocol: cephx 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding auth protocol: cephx 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding auth protocol: cephx 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.668 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 1 librados: starting msgr at 2024-09-12T00:52:51.669 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 1 librados: starting objecter 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command objecter_requests hook 0x56533f69be10 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 1 librados: setting wanted keys 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 1 librados: calling monclient init 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 10 monclient: init 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding auth protocol: cephx 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding auth protocol: cephx 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding auth protocol: cephx 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.670 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command rotate-key hook 0x56533f66ad28 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:51.671 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-b con 0x56533f522600 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-c con 0x56533f5229e0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-a con 0x56533f5ad5d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): authenticate will time out at 2437.883321s 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): get_auth_request con 0x56533f5ad5d0 auth_method 0 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request con 0x56533f5229e0 auth_method 0 2024-09-12T00:52:51.672 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): get_auth_request con 0x56533f522600 auth_method 0 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.673 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): handle_auth_done global_id 8319 payload 824 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient: _finish_hunting 0 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:52:51.380+0000 7f5b57b93640 1 monclient: found mon.noname-a 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:52:51.380+0000 7f5a43e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: dump: 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.674 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: _finish_auth 0 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: _check_auth_tickets 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: dump: 2024-09-12T00:52:51.675 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.676 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.676 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.676 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.676 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.676 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.676 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.676 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.676 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.676 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.676 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 5 monclient: authenticate success, global_id 8319 2024-09-12T00:52:51.676 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:52:51.381+0000 7f5a4560a640 4 set_mon_vals no callback set 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 1 librados: init done 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:52:51.383+0000 7f5a43e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:52:51.383+0000 7f5a43e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:52:51.383+0000 7f5a43e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:52:51.383+0000 7f5b57392640 10 monclient: get_auth_request con 0x7f5a3c076470 auth_method 0 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:52:51.383+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x56533f695350 auth_method 0 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:52:51.384+0000 7f5b57392640 10 monclient: get_auth_request con 0x56533f6b86a0 auth_method 0 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:52:51.386+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x56533f6bd730 auth_method 0 2024-09-12T00:52:51.677 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 10 monclient: build_initial_monmap 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 1 build_initial for_mkfs: 0 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 10 monclient: monmap: 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding auth protocol: cephx 2024-09-12T00:52:51.678 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding auth protocol: cephx 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding auth protocol: cephx 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.679 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command objecter_requests cmddesc objecter_requests hook 0x56533f6c5090 EEXIST 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient: init 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding auth protocol: cephx 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding auth protocol: cephx 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding auth protocol: cephx 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.680 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command rotate-key cmddesc rotate-key hook 0x56533f6c07e0 EEXIST 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-b con 0x56533f6e8d80 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-a con 0x56533f6eb050 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:51.681 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-c con 0x56533f6e7550 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 10 monclient(hunting): authenticate will time out at 2437.891007s 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request con 0x56533f6eb050 auth_method 0 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): get_auth_request con 0x56533f6e7550 auth_method 0 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.682 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:52:51.388+0000 7f5b57392640 10 monclient(hunting): get_auth_request con 0x56533f6e8d80 auth_method 0 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:52:51.388+0000 7f5b57392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:52:51.388+0000 7f5b57392640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:52:51.388+0000 7f5b57392640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): handle_auth_done global_id 7802 payload 824 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient: _finish_hunting 0 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:52:51.388+0000 7f5b57b93640 1 monclient: found mon.noname-c 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:51.683 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: dump: 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: _finish_auth 0 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: _check_auth_tickets 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 5 monclient: authenticate success, global_id 7802 2024-09-12T00:52:51.684 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: dump: 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.685 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:52:51.388+0000 7f5b58394640 4 set_mon_vals no callback set 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:52:51.390+0000 7f5a41602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:52:51.390+0000 7f5a41602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:52:51.390+0000 7f5a41602640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:52:51.390+0000 7f5b57392640 10 monclient: get_auth_request con 0x7f5a30076380 auth_method 0 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 10 monclient: get_monmap_and_config 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 10 monclient: build_initial_monmap 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 1 build_initial for_mkfs: 0 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 10 monclient: monmap: 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:51.686 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding auth protocol: cephx 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding auth protocol: cephx 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding auth protocol: cephx 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.687 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient: init 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding auth protocol: cephx 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding auth protocol: cephx 2024-09-12T00:52:51.688 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding auth protocol: cephx 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.689 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command rotate-key cmddesc rotate-key hook 0x7ffc8dffeb58 EEXIST 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-b con 0x56533f73d2d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-c con 0x56533f737870 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-a con 0x56533f70d110 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): authenticate will time out at 2437.894929s 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request con 0x56533f737870 auth_method 0 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.690 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): get_auth_request con 0x56533f70d110 auth_method 0 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:52:51.392+0000 7f5b57392640 10 monclient(hunting): get_auth_request con 0x56533f73d2d0 auth_method 0 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:52:51.392+0000 7f5b57392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:52:51.392+0000 7f5b57392640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:52:51.392+0000 7f5b57392640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.691 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_done global_id 7805 payload 274 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient: _finish_hunting 0 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 1 monclient: found mon.noname-c 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: dump: 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.692 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: _finish_auth 0 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: _check_auth_tickets 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: dump: 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.693 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:52:51.392+0000 7f5b5bc15800 5 monclient: authenticate success, global_id 7805 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:52:51.392+0000 7f5b5bc15800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:52:51.392+0000 7f5b5bc15800 4 set_mon_vals no callback set 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 10 monclient: shutdown 2024-09-12T00:52:51.694 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 10 monclient: build_initial_monmap 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 1 build_initial for_mkfs: 0 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 10 monclient: monmap: 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding auth protocol: cephx 2024-09-12T00:52:51.695 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding auth protocol: cephx 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding auth protocol: cephx 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.696 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 1 librados: starting msgr at 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 1 librados: starting objecter 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command objecter_requests cmddesc objecter_requests hook 0x56533f70caa0 EEXIST 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 1 librados: setting wanted keys 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 1 librados: calling monclient init 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 10 monclient: init 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding auth protocol: cephx 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding auth protocol: cephx 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding auth protocol: cephx 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.697 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command rotate-key cmddesc rotate-key hook 0x56533f700c78 EEXIST 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-a con 0x56533f70d110 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:51.698 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-c con 0x56533f737870 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-b con 0x56533f73d2d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): authenticate will time out at 2437.897445s 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): get_auth_request con 0x56533f70d110 auth_method 0 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request con 0x56533f737870 auth_method 0 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.699 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): get_auth_request con 0x56533f73d2d0 auth_method 0 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.700 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.701 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.701 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): handle_auth_done global_id 8328 payload 824 2024-09-12T00:52:51.701 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient: _finish_hunting 0 2024-09-12T00:52:51.701 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:52:51.394+0000 7f5b57392640 1 monclient: found mon.noname-a 2024-09-12T00:52:51.701 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.701 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.701 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:51.701 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: dump: 2024-09-12T00:52:51.701 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.701 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.701 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.702 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.702 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.702 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.702 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.702 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.702 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.702 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.702 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: _finish_auth 0 2024-09-12T00:52:51.702 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: _check_auth_tickets 2024-09-12T00:52:51.702 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: dump: 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.703 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:52:51.395+0000 7f5a3affd640 4 set_mon_vals no callback set 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 5 monclient: authenticate success, global_id 8328 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 1 librados: init done 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command cr dump hook 0x56533f7348e8 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:52:51.396+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:52:51.397+0000 7f5a397fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:52:51.397+0000 7f5a397fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:52:51.397+0000 7f5a397fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.704 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:52:51.397+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x7f5a200764a0 auth_method 0 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:52:51.398+0000 7f5b57b93640 10 monclient: get_auth_request con 0x56533f757990 auth_method 0 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 realm 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:52:51.399+0000 7f5b57392640 10 monclient: get_auth_request con 0x56533f75bb90 auth_method 0 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:52:51.400+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:51.705 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:52:51.400+0000 7f5b5bc15800 20 searching for the correct realm 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:52:51.400+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x56533f760e30 auth_method 0 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:52:51.401+0000 7f5b57b93640 10 monclient: get_auth_request con 0x7f5b40086070 auth_method 0 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:52:51.402+0000 7f5b57392640 10 monclient: get_auth_request con 0x7f5b48047060 auth_method 0 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:52:51.403+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x7f5b4007d040 auth_method 0 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:52:51.403+0000 7f5b4ffff640 0 -- 172.21.15.19:0/1875631128 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f5b4007d040 msgr2=0x7f5b4006c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:52:51.605+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x7f5b4007d040 auth_method 0 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:52:51.607+0000 7f5b57b93640 10 monclient: get_auth_request con 0x7f5b4806cd80 auth_method 0 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:52:51.608+0000 7f5b57392640 10 monclient: get_auth_request con 0x7f5b5008ade0 auth_method 0 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:52:51.609+0000 7f5b57b93640 0 -- 172.21.15.19:0/1875631128 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x56533f757990 msgr2=0x56533f759e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:52:51.609+0000 7f5a397fa640 1 client.8328.objecter ms_handle_reset 0x56533f757990 session 0x56533f757280 osd.6 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:52:51.609+0000 7f5a397fa640 10 monclient: _renew_subs 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:52:51.609+0000 7f5a397fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.706 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:52:51.609+0000 7f5b57b93640 10 monclient: get_auth_request con 0x7f5a200867c0 auth_method 0 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 zone default found 2024-09-12T00:52:51.707 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 4 Realm: () 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 zonegroup default 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 started sync module instance, tier type = 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=0 2024-09-12T00:52:51.708 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=1 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=2 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=3 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=4 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=5 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=6 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:52:51.628+0000 7f5b5bc15800 20 add_watcher() i=7 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:52:51.628+0000 7f5b5bc15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding auth protocol: cephx 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding auth protocol: cephx 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding auth protocol: cephx 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.709 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:52:51.629+0000 7f5a0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:51.710 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command cache list hook 0x56533f70aea0 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command cache inspect hook 0x56533f70aea0 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command cache erase hook 0x56533f70aea0 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command cache zap hook 0x56533f70aea0 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 note: GC not initialized 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:52:51.630+0000 7f5a0cfe1640 20 reqs_thread_entry: start 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command sync trace show hook 0x7f5b50004720 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command sync trace history hook 0x7f5b50004720 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command sync trace active hook 0x7f5b50004720 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command sync trace active_short hook 0x7f5b50004720 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 init_complete bucket index max shards: 11 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 Filter name: none 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:52:51.630+0000 7f59867fc640 20 reqs_thread_entry: start 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:51.711 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:52:51.712 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:52:51.632+0000 7f5b5bc15800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398983 cookie 94915546988432 notifier 8328 bl.length()=827 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:52:51.713 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:52:51.648+0000 7f5b5bc15800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5b5bc15800 time 2024-09-12T00:52:51.649522+0000 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5b5cd8c71a] 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5b5cd8c8d8] 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56533cfe3641] 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56533cff338a] 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f5b5ba29590] 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:52:51.649+0000 7f5b5bc15800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:51.714 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f5b5bc15800 thread_name:radosgw-admin 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5ba3e6f0] 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5b5ba8b99c] 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5b5cd8c774] 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5b5cd8c8d8] 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56533cfe3641] 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56533cff338a] 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f5b5ba29590] 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:52:51.715 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:51.716 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:52:51.717 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:52:51.718 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:52:51.719 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:51.720 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:51.721 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 7f59867fc640 / http_manager 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a0cfe1640 / http_manager 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a0dfe3640 / rgw_dt_lg_renew 2024-09-12T00:52:51.722 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a397fa640 / ms_dispatch 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a3affd640 / io_context_pool 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a41602640 / ms_dispatch 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a43e07640 / ms_dispatch 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a4560a640 / io_context_pool 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5b4ffff640 / msgr-worker-2 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5b57392640 / msgr-worker-1 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5b57b93640 / msgr-worker-0 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5b58394640 / io_context_pool 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5b5bc15800 / radosgw-admin 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/log/ceph/ceph-client.admin.153514.log 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr:--- begin dump of recent events --- 2024-09-12T00:52:51.723 INFO:tasks.workunit.client.0.smithi019.stderr: -499> 2024-09-12T00:52:51.378+0000 7f5b5bc15800 4 set_mon_vals no callback set 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr: -498> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 10 monclient: shutdown 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr: -497> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 asok(0x56533f44a630) unregister_commands rotate-key 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr: -496> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 10 monclient: build_initial_monmap 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr: -495> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 1 build_initial for_mkfs: 0 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr: -494> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 10 monclient: monmap: 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:51.724 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -493> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding auth protocol: cephx 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -492> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding auth protocol: cephx 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -491> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding auth protocol: cephx 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -490> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -489> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -488> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -487> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -486> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -485> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -484> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -483> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.725 INFO:tasks.workunit.client.0.smithi019.stderr: -482> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -481> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -480> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: crc 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -479> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66fb30) adding con mode: secure 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -478> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -477> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 1 librados: starting msgr at 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -476> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 1 librados: starting objecter 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -475> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command objecter_requests hook 0x56533f69be10 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -474> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 1 librados: setting wanted keys 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -473> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 1 librados: calling monclient init 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -472> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 10 monclient: init 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -471> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding auth protocol: cephx 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -470> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding auth protocol: cephx 2024-09-12T00:52:51.726 INFO:tasks.workunit.client.0.smithi019.stderr: -469> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding auth protocol: cephx 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -468> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -467> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -466> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -465> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -464> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -463> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -462> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -461> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -460> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -459> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -458> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: crc 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -457> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 5 AuthRegistry(0x56533f66abe0) adding con mode: secure 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -456> 2024-09-12T00:52:51.379+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.727 INFO:tasks.workunit.client.0.smithi019.stderr: -455> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -454> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command rotate-key hook 0x56533f66ad28 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -453> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -452> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -451> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-b con 0x56533f522600 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -450> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-c con 0x56533f5229e0 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -449> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-a con 0x56533f5ad5d0 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -448> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -447> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -446> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -445> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -444> 2024-09-12T00:52:51.380+0000 7f5b5bc15800 10 monclient(hunting): authenticate will time out at 2437.883321s 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -443> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): get_auth_request con 0x56533f5ad5d0 auth_method 0 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -442> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.728 INFO:tasks.workunit.client.0.smithi019.stderr: -441> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -440> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -439> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request con 0x56533f5229e0 auth_method 0 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -438> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -437> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -436> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -435> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): get_auth_request con 0x56533f522600 auth_method 0 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -434> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -433> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -432> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -431> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -430> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -429> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.729 INFO:tasks.workunit.client.0.smithi019.stderr: -428> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -427> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -426> 2024-09-12T00:52:51.380+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -425> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -424> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -423> 2024-09-12T00:52:51.380+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -422> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient(hunting): handle_auth_done global_id 8319 payload 824 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -421> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient: _finish_hunting 0 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -420> 2024-09-12T00:52:51.380+0000 7f5b57b93640 1 monclient: found mon.noname-a 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -419> 2024-09-12T00:52:51.380+0000 7f5b57b93640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -418> 2024-09-12T00:52:51.380+0000 7f5a43e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -417> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr: -416> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: dump: 2024-09-12T00:52:51.730 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr: -415> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: _finish_auth 0 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr: -414> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: _check_auth_tickets 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr: -413> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr: -412> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr: -411> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:51.731 INFO:tasks.workunit.client.0.smithi019.stderr: -410> 2024-09-12T00:52:51.381+0000 7f5a43e07640 10 monclient: dump: 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr: -409> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 5 monclient: authenticate success, global_id 8319 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr: -408> 2024-09-12T00:52:51.381+0000 7f5a4560a640 4 set_mon_vals no callback set 2024-09-12T00:52:51.732 INFO:tasks.workunit.client.0.smithi019.stderr: -407> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -406> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -405> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -404> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -403> 2024-09-12T00:52:51.381+0000 7f5b5bc15800 1 librados: init done 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -402> 2024-09-12T00:52:51.383+0000 7f5a43e07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -401> 2024-09-12T00:52:51.383+0000 7f5a43e07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -400> 2024-09-12T00:52:51.383+0000 7f5a43e07640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -399> 2024-09-12T00:52:51.383+0000 7f5b57392640 10 monclient: get_auth_request con 0x7f5a3c076470 auth_method 0 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -398> 2024-09-12T00:52:51.383+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x56533f695350 auth_method 0 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -397> 2024-09-12T00:52:51.384+0000 7f5b57392640 10 monclient: get_auth_request con 0x56533f6b86a0 auth_method 0 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -396> 2024-09-12T00:52:51.386+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x56533f6bd730 auth_method 0 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -395> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 10 monclient: build_initial_monmap 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -394> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 1 build_initial for_mkfs: 0 2024-09-12T00:52:51.733 INFO:tasks.workunit.client.0.smithi019.stderr: -393> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 10 monclient: monmap: 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr: -392> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding auth protocol: cephx 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr: -391> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding auth protocol: cephx 2024-09-12T00:52:51.734 INFO:tasks.workunit.client.0.smithi019.stderr: -390> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding auth protocol: cephx 2024-09-12T00:52:51.735 INFO:tasks.workunit.client.0.smithi019.stderr: -389> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.735 INFO:tasks.workunit.client.0.smithi019.stderr: -388> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.735 INFO:tasks.workunit.client.0.smithi019.stderr: -387> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.735 INFO:tasks.workunit.client.0.smithi019.stderr: -386> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.735 INFO:tasks.workunit.client.0.smithi019.stderr: -385> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.735 INFO:tasks.workunit.client.0.smithi019.stderr: -384> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.735 INFO:tasks.workunit.client.0.smithi019.stderr: -383> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.735 INFO:tasks.workunit.client.0.smithi019.stderr: -382> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.735 INFO:tasks.workunit.client.0.smithi019.stderr: -381> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -380> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -379> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: crc 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -378> 2024-09-12T00:52:51.386+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c1750) adding con mode: secure 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -377> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -376> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command objecter_requests cmddesc objecter_requests hook 0x56533f6c5090 EEXIST 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -375> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient: init 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -374> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding auth protocol: cephx 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -373> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding auth protocol: cephx 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -372> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding auth protocol: cephx 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -371> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -370> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.736 INFO:tasks.workunit.client.0.smithi019.stderr: -369> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -368> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -367> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -366> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -365> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -364> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -363> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -362> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -361> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: crc 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -360> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 AuthRegistry(0x56533f6c0698) adding con mode: secure 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -359> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -358> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -357> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command rotate-key cmddesc rotate-key hook 0x56533f6c07e0 EEXIST 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -356> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:51.737 INFO:tasks.workunit.client.0.smithi019.stderr: -355> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -354> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-b con 0x56533f6e8d80 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -353> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-a con 0x56533f6eb050 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -352> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-c con 0x56533f6e7550 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -351> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -350> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -349> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -348> 2024-09-12T00:52:51.387+0000 7f5b5bc15800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -347> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 10 monclient(hunting): authenticate will time out at 2437.891007s 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -346> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request con 0x56533f6eb050 auth_method 0 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -345> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -344> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -343> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -342> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): get_auth_request con 0x56533f6e7550 auth_method 0 2024-09-12T00:52:51.738 INFO:tasks.workunit.client.0.smithi019.stderr: -341> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -340> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -339> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -338> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -337> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -336> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -335> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -334> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -333> 2024-09-12T00:52:51.388+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -332> 2024-09-12T00:52:51.388+0000 7f5b57392640 10 monclient(hunting): get_auth_request con 0x56533f6e8d80 auth_method 0 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -331> 2024-09-12T00:52:51.388+0000 7f5b57392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -330> 2024-09-12T00:52:51.388+0000 7f5b57392640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -329> 2024-09-12T00:52:51.388+0000 7f5b57392640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -328> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient(hunting): handle_auth_done global_id 7802 payload 824 2024-09-12T00:52:51.739 INFO:tasks.workunit.client.0.smithi019.stderr: -327> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient: _finish_hunting 0 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr: -326> 2024-09-12T00:52:51.388+0000 7f5b57b93640 1 monclient: found mon.noname-c 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr: -325> 2024-09-12T00:52:51.388+0000 7f5b57b93640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr: -324> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr: -323> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr: -322> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: dump: 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.740 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr: -321> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: _finish_auth 0 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr: -320> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: _check_auth_tickets 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr: -319> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 5 monclient: authenticate success, global_id 7802 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr: -318> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr: -317> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr: -316> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr: -315> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr: -314> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr: -313> 2024-09-12T00:52:51.388+0000 7f5a41602640 10 monclient: dump: 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.741 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr: -312> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr: -311> 2024-09-12T00:52:51.388+0000 7f5b58394640 4 set_mon_vals no callback set 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr: -310> 2024-09-12T00:52:51.388+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.c at v2:172.21.15.19:3301/0 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr: -309> 2024-09-12T00:52:51.390+0000 7f5a41602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr: -308> 2024-09-12T00:52:51.390+0000 7f5a41602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr: -307> 2024-09-12T00:52:51.390+0000 7f5a41602640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr: -306> 2024-09-12T00:52:51.390+0000 7f5b57392640 10 monclient: get_auth_request con 0x7f5a30076380 auth_method 0 2024-09-12T00:52:51.742 INFO:tasks.workunit.client.0.smithi019.stderr: -305> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 10 monclient: get_monmap_and_config 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr: -304> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 10 monclient: build_initial_monmap 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr: -303> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 1 build_initial for_mkfs: 0 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr: -302> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 10 monclient: monmap: 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr: -301> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding auth protocol: cephx 2024-09-12T00:52:51.743 INFO:tasks.workunit.client.0.smithi019.stderr: -300> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding auth protocol: cephx 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -299> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding auth protocol: cephx 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -298> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -297> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -296> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -295> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -294> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -293> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -292> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -291> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -290> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -289> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -288> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: crc 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -287> 2024-09-12T00:52:51.390+0000 7f5b5bc15800 5 AuthRegistry(0x56533f708cf0) adding con mode: secure 2024-09-12T00:52:51.744 INFO:tasks.workunit.client.0.smithi019.stderr: -286> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -285> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient: init 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -284> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding auth protocol: cephx 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -283> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding auth protocol: cephx 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -282> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding auth protocol: cephx 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -281> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -280> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -279> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -278> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -277> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -276> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -275> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -274> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -273> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.745 INFO:tasks.workunit.client.0.smithi019.stderr: -272> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -271> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: crc 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -270> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffea10) adding con mode: secure 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -269> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -268> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -267> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command rotate-key cmddesc rotate-key hook 0x7ffc8dffeb58 EEXIST 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -266> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -265> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -264> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-b con 0x56533f73d2d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -263> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-c con 0x56533f737870 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -262> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-a con 0x56533f70d110 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -261> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -260> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.746 INFO:tasks.workunit.client.0.smithi019.stderr: -259> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -258> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -257> 2024-09-12T00:52:51.391+0000 7f5b5bc15800 10 monclient(hunting): authenticate will time out at 2437.894929s 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -256> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request con 0x56533f737870 auth_method 0 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -255> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -254> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -253> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -252> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): get_auth_request con 0x56533f70d110 auth_method 0 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -251> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -250> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -249> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -248> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -247> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.747 INFO:tasks.workunit.client.0.smithi019.stderr: -246> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -245> 2024-09-12T00:52:51.392+0000 7f5b57392640 10 monclient(hunting): get_auth_request con 0x56533f73d2d0 auth_method 0 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -244> 2024-09-12T00:52:51.392+0000 7f5b57392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -243> 2024-09-12T00:52:51.392+0000 7f5b57392640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -242> 2024-09-12T00:52:51.392+0000 7f5b57392640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -241> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -240> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -239> 2024-09-12T00:52:51.392+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -238> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_done global_id 7805 payload 274 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -237> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient: _finish_hunting 0 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -236> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 1 monclient: found mon.noname-c 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -235> 2024-09-12T00:52:51.392+0000 7f5b4ffff640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.19:3301/0 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -234> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.748 INFO:tasks.workunit.client.0.smithi019.stderr: -233> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr: -232> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: dump: 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr: -231> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: _finish_auth 0 2024-09-12T00:52:51.749 INFO:tasks.workunit.client.0.smithi019.stderr: -230> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: _check_auth_tickets 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr: -229> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr: -228> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr: -227> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr: -226> 2024-09-12T00:52:51.392+0000 7f5a3affd640 10 monclient: dump: 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.750 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr: -225> 2024-09-12T00:52:51.392+0000 7f5b5bc15800 5 monclient: authenticate success, global_id 7805 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr: -224> 2024-09-12T00:52:51.392+0000 7f5b5bc15800 10 monclient: get_monmap_and_config success 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr: -223> 2024-09-12T00:52:51.392+0000 7f5b5bc15800 4 set_mon_vals no callback set 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr: -222> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 10 monclient: shutdown 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr: -221> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 10 monclient: build_initial_monmap 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr: -220> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 1 build_initial for_mkfs: 0 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr: -219> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 10 monclient: monmap: 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 0 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 0.000000 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr:created 0.000000 2024-09-12T00:52:51.751 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 0 (unknown) 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.noname-a 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.noname-b 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.noname-c 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr: -218> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding auth protocol: cephx 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr: -217> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding auth protocol: cephx 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr: -216> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding auth protocol: cephx 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr: -215> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr: -214> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr: -213> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr: -212> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.752 INFO:tasks.workunit.client.0.smithi019.stderr: -211> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -210> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -209> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -208> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -207> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -206> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -205> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: crc 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -204> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f7386f0) adding con mode: secure 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -203> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -202> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 1 librados: starting msgr at 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -201> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 1 librados: starting objecter 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -200> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command objecter_requests cmddesc objecter_requests hook 0x56533f70caa0 EEXIST 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -199> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 1 librados: setting wanted keys 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -198> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 1 librados: calling monclient init 2024-09-12T00:52:51.753 INFO:tasks.workunit.client.0.smithi019.stderr: -197> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 10 monclient: init 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -196> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding auth protocol: cephx 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -195> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding auth protocol: cephx 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -194> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding auth protocol: cephx 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -193> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -192> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -191> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -190> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -189> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -188> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -187> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -186> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -185> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -184> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -183> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: crc 2024-09-12T00:52:51.754 INFO:tasks.workunit.client.0.smithi019.stderr: -182> 2024-09-12T00:52:51.393+0000 7f5b5bc15800 5 AuthRegistry(0x56533f700b30) adding con mode: secure 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -181> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -180> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -179> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command rotate-key cmddesc rotate-key hook 0x56533f700c78 EEXIST 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -178> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient: _reopen_session rank -1 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -177> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -176> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-a con 0x56533f70d110 addr [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -175> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-c con 0x56533f737870 addr [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -174> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): picked mon.noname-b con 0x56533f73d2d0 addr [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -173> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -172> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -171> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): start opening mon connection 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -170> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): _renew_subs 2024-09-12T00:52:51.755 INFO:tasks.workunit.client.0.smithi019.stderr: -169> 2024-09-12T00:52:51.394+0000 7f5b5bc15800 10 monclient(hunting): authenticate will time out at 2437.897445s 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -168> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): get_auth_request con 0x56533f70d110 auth_method 0 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -167> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -166> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -165> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -164> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request con 0x56533f737870 auth_method 0 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -163> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -162> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -161> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -160> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -159> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -158> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -157> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -156> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.756 INFO:tasks.workunit.client.0.smithi019.stderr: -155> 2024-09-12T00:52:51.394+0000 7f5b4ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -154> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): get_auth_request con 0x56533f73d2d0 auth_method 0 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -153> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -152> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -151> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -150> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -149> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -148> 2024-09-12T00:52:51.394+0000 7f5b57b93640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -147> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient(hunting): handle_auth_done global_id 8328 payload 824 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -146> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient: _finish_hunting 0 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -145> 2024-09-12T00:52:51.394+0000 7f5b57392640 1 monclient: found mon.noname-a 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -144> 2024-09-12T00:52:51.394+0000 7f5b57392640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -143> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -142> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:52:51.757 INFO:tasks.workunit.client.0.smithi019.stderr: -141> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: dump: 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr: -140> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: _finish_auth 0 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr: -139> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: _check_auth_tickets 2024-09-12T00:52:51.758 INFO:tasks.workunit.client.0.smithi019.stderr: -138> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr: -137> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr: -136> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr: -135> 2024-09-12T00:52:51.395+0000 7f5a397fa640 10 monclient: dump: 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr:epoch 1 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr:fsid aacb94df-c940-42c4-9df9-171d09a84719 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr:last_changed 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr:created 2024-09-12T00:23:50.450549+0000 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr:min_mon_release 19 (squid) 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr:election_strategy: 1 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr:0: [v2:172.21.15.19:3300/0,v1:172.21.15.19:6789/0] mon.a 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr:1: [v2:172.21.15.135:3300/0,v1:172.21.15.135:6789/0] mon.b 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr:2: [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] mon.c 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr: -134> 2024-09-12T00:52:51.395+0000 7f5a3affd640 4 set_mon_vals no callback set 2024-09-12T00:52:51.759 INFO:tasks.workunit.client.0.smithi019.stderr: -133> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 5 monclient: authenticate success, global_id 8328 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -132> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -131> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -130> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 10 monclient: _renew_subs 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -129> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -128> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 1 librados: init done 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -127> 2024-09-12T00:52:51.395+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command cr dump hook 0x56533f7348e8 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -126> 2024-09-12T00:52:51.396+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -125> 2024-09-12T00:52:51.397+0000 7f5a397fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -124> 2024-09-12T00:52:51.397+0000 7f5a397fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -123> 2024-09-12T00:52:51.397+0000 7f5a397fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.135:6832/3280264148,v1:172.21.15.135:6833/3280264148] 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -122> 2024-09-12T00:52:51.397+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x7f5a200764a0 auth_method 0 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -121> 2024-09-12T00:52:51.398+0000 7f5b57b93640 10 monclient: get_auth_request con 0x56533f757990 auth_method 0 2024-09-12T00:52:51.760 INFO:tasks.workunit.client.0.smithi019.stderr: -120> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -119> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 realm 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -118> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -117> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -116> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -115> 2024-09-12T00:52:51.398+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -114> 2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -113> 2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -112> 2024-09-12T00:52:51.399+0000 7f5b57392640 10 monclient: get_auth_request con 0x56533f75bb90 auth_method 0 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -111> 2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -110> 2024-09-12T00:52:51.399+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -109> 2024-09-12T00:52:51.400+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -108> 2024-09-12T00:52:51.400+0000 7f5b5bc15800 20 searching for the correct realm 2024-09-12T00:52:51.761 INFO:tasks.workunit.client.0.smithi019.stderr: -107> 2024-09-12T00:52:51.400+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x56533f760e30 auth_method 0 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -106> 2024-09-12T00:52:51.401+0000 7f5b57b93640 10 monclient: get_auth_request con 0x7f5b40086070 auth_method 0 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -105> 2024-09-12T00:52:51.402+0000 7f5b57392640 10 monclient: get_auth_request con 0x7f5b48047060 auth_method 0 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -104> 2024-09-12T00:52:51.403+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x7f5b4007d040 auth_method 0 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -103> 2024-09-12T00:52:51.403+0000 7f5b4ffff640 0 -- 172.21.15.19:0/1875631128 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f5b4007d040 msgr2=0x7f5b4006c930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -102> 2024-09-12T00:52:51.605+0000 7f5b4ffff640 10 monclient: get_auth_request con 0x7f5b4007d040 auth_method 0 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -101> 2024-09-12T00:52:51.607+0000 7f5b57b93640 10 monclient: get_auth_request con 0x7f5b4806cd80 auth_method 0 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -100> 2024-09-12T00:52:51.608+0000 7f5b57392640 10 monclient: get_auth_request con 0x7f5b5008ade0 auth_method 0 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -99> 2024-09-12T00:52:51.609+0000 7f5b57b93640 0 -- 172.21.15.19:0/1875631128 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x56533f757990 msgr2=0x56533f759e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -98> 2024-09-12T00:52:51.609+0000 7f5a397fa640 1 client.8328.objecter ms_handle_reset 0x56533f757990 session 0x56533f757280 osd.6 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -97> 2024-09-12T00:52:51.609+0000 7f5a397fa640 10 monclient: _renew_subs 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -96> 2024-09-12T00:52:51.609+0000 7f5a397fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.19:3300/0 2024-09-12T00:52:51.762 INFO:tasks.workunit.client.0.smithi019.stderr: -95> 2024-09-12T00:52:51.609+0000 7f5b57b93640 10 monclient: get_auth_request con 0x7f5a200867c0 auth_method 0 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -94> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -93> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -92> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -91> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -90> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -89> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -88> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -87> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -86> 2024-09-12T00:52:51.614+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -85> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -84> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -83> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:51.763 INFO:tasks.workunit.client.0.smithi019.stderr: -82> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 zone default found 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -81> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 4 Realm: () 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -80> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -79> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -78> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -77> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 zonegroup default 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -76> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -75> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -74> 2024-09-12T00:52:51.615+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -73> 2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -72> 2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -71> 2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -70> 2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 started sync module instance, tier type = 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -69> 2024-09-12T00:52:51.616+0000 7f5b5bc15800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:52:51.764 INFO:tasks.workunit.client.0.smithi019.stderr: -68> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=0 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -67> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=1 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -66> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=2 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -65> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=3 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -64> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=4 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -63> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=5 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -62> 2024-09-12T00:52:51.626+0000 7f5b5bc15800 20 add_watcher() i=6 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -61> 2024-09-12T00:52:51.628+0000 7f5b5bc15800 20 add_watcher() i=7 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -60> 2024-09-12T00:52:51.628+0000 7f5b5bc15800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -59> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding auth protocol: cephx 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -58> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding auth protocol: cephx 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -57> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding auth protocol: cephx 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -56> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.765 INFO:tasks.workunit.client.0.smithi019.stderr: -55> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -54> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -53> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -52> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -51> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -50> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -49> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -48> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -47> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -46> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: crc 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -45> 2024-09-12T00:52:51.629+0000 7f5b5bc15800 5 AuthRegistry(0x7ffc8dffeef0) adding con mode: secure 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -44> 2024-09-12T00:52:51.629+0000 7f5a0dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -43> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -42> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -41> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:51.766 INFO:tasks.workunit.client.0.smithi019.stderr: -40> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command cache list hook 0x56533f70aea0 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -39> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command cache inspect hook 0x56533f70aea0 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -38> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command cache erase hook 0x56533f70aea0 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -37> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command cache zap hook 0x56533f70aea0 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -36> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 note: GC not initialized 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -35> 2024-09-12T00:52:51.630+0000 7f5a0cfe1640 20 reqs_thread_entry: start 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -34> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command sync trace show hook 0x7f5b50004720 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -33> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command sync trace history hook 0x7f5b50004720 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -32> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command sync trace active hook 0x7f5b50004720 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -31> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 5 asok(0x56533f44a630) register_command sync trace active_short hook 0x7f5b50004720 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -30> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 init_complete bucket index max shards: 11 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -29> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 Filter name: none 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -28> 2024-09-12T00:52:51.630+0000 7f59867fc640 20 reqs_thread_entry: start 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -27> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -26> 2024-09-12T00:52:51.630+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.767 INFO:tasks.workunit.client.0.smithi019.stderr: -25> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -24> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -23> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -22> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -21> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -20> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -19> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -18> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -17> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -16> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -15> 2024-09-12T00:52:51.631+0000 7f5b5bc15800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -14> 2024-09-12T00:52:51.632+0000 7f5b5bc15800 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -13> 2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:51.768 INFO:tasks.workunit.client.0.smithi019.stderr: -12> 2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: -11> 2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: -10> 2024-09-12T00:52:51.640+0000 7f5b5bc15800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: -9> 2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398983 cookie 94915546988432 notifier 8328 bl.length()=827 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: -8> 2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: -7> 2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: -6> 2024-09-12T00:52:51.640+0000 7f5a3affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: -5> 2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: -4> 2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: -3> 2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: -2> 2024-09-12T00:52:51.642+0000 7f5b5bc15800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: -1> 2024-09-12T00:52:51.648+0000 7f5b5bc15800 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5b5bc15800 time 2024-09-12T00:52:51.649522+0000 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.3.0-4753-gd011c522/rpm/el9/BUILD/ceph-19.3.0-4753-gd011c522/src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:52:51.769 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x12e) [0x7f5b5cd8c71a] 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5b5cd8c8d8] 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56533cfe3641] 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56533cff338a] 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: 5: main() 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /lib64/libc.so.6(+0x29590) [0x7f5b5ba29590] 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: 7: __libc_start_main() 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: 8: _start() 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: 0> 2024-09-12T00:52:51.649+0000 7f5b5bc15800 -1 *** Caught signal (Aborted) ** 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: in thread 7f5b5bc15800 thread_name:radosgw-admin 2024-09-12T00:52:51.770 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 1: /lib64/libc.so.6(+0x3e6f0) [0x7f5b5ba3e6f0] 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 2: /lib64/libc.so.6(+0x8b99c) [0x7f5b5ba8b99c] 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 3: raise() 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 4: abort() 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x188) [0x7f5b5cd8c774] 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 6: /usr/lib64/ceph/libceph-common.so.2(+0x18c8d8) [0x7f5b5cd8c8d8] 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56533cfe3641] 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x56533cff338a] 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 9: main() 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 10: /lib64/libc.so.6(+0x29590) [0x7f5b5ba29590] 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 11: __libc_start_main() 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 12: _start() 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:52:51.771 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr:--- logging levels --- 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 none 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 lockdep 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 context 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 crush 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_balancer 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_locker 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_log_expire 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mds_migrator 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 3/ 5 mds_quiesce 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 buffer 2024-09-12T00:52:51.772 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 timer 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 filer 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 striper 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 1 objecter 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rados 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_mirror 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_replay 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 rbd_pwl 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 journaler 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objectcacher 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 client 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 osd 2024-09-12T00:52:51.773 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 optracker 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 objclass 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 filestore 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 journal 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 ms 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mon 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 0/10 monc 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 paxos 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 tp 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 auth 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 crypto 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 finisher 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 reserver 2024-09-12T00:52:51.774 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 heartbeatmap 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 perfcounter 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_sync 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_datacache 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_access 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_flight 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 20/20 rgw_notification 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 javaclient 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 asok 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 1 throttle 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 0 refs 2024-09-12T00:52:51.775 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 compressor 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluestore 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 bluefs 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 3 bdev 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 kstore 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 4/ 5 rocksdb 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 fuse 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 2/ 5 mgr 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mgrc 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 dpdk 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 eventtrace 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 prioritycache 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 test 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:52:51.776 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cephsqlite 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_onode 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_odata 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_omap 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_tm 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_t 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_epm 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_lba 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_cache 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_journal 2024-09-12T00:52:51.777 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_device 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 seastore_backref 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 alienstore 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 mclock 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 cyanstore 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 ceph_exporter 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 memstore 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 1/ 5 trace 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 0/ 5 ceph_dedup 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: -2/-2 (syslog threshold) 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 99/99 (stderr threshold) 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 7f59867fc640 / http_manager 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a0cfe1640 / http_manager 2024-09-12T00:52:51.778 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a0dfe3640 / rgw_dt_lg_renew 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a397fa640 / ms_dispatch 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a3affd640 / io_context_pool 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a41602640 / ms_dispatch 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a43e07640 / ms_dispatch 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5a4560a640 / io_context_pool 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5b4ffff640 / msgr-worker-2 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5b57392640 / msgr-worker-1 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5b57b93640 / msgr-worker-0 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5b58394640 / io_context_pool 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: 7f5b5bc15800 / radosgw-admin 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: max_recent 500 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: max_new 1000 2024-09-12T00:52:51.779 INFO:tasks.workunit.client.0.smithi019.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:52:51.650959Z_5c640990-35db-4a89-9a3f-c5c1707b7cd7/log 2024-09-12T00:52:51.780 INFO:tasks.workunit.client.0.smithi019.stderr:--- end dump of recent events --- 2024-09-12T00:52:51.780 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:52:51.781 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:51.781 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:51.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.728+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.730+0000 7f0e41d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.730+0000 7f0e41d2e800 20 realm 2024-09-12T00:52:51.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.730+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.730+0000 7f0e41d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.730+0000 7f0e41d2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:51.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.730+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.730+0000 7f0e41d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.730+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.731+0000 7f0e41d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:51.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.731+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.731+0000 7f0e41d2e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:51.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.731+0000 7f0e41d2e800 20 searching for the correct realm 2024-09-12T00:52:51.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.735+0000 7f0e37fff640 0 -- 172.21.15.19:0/470508583 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f0e28017930 msgr2=0x7f0e2802f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:51.941 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.941+0000 7f0e3e165640 0 -- 172.21.15.19:0/470508583 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x556d857322f0 msgr2=0x556d857346e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:51.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.946+0000 7f0e41d2e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:52:51.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.946+0000 7f0e41d2e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:52:51.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.946+0000 7f0e41d2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:51.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.946+0000 7f0e41d2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:51.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.946+0000 7f0e41d2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:51.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.946+0000 7f0e41d2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:51.946 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.946+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.946+0000 7f0e41d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.946+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:51.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.947 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:51.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 20 zone default found 2024-09-12T00:52:51.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 4 Realm: () 2024-09-12T00:52:51.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:52:51.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:52:51.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:51.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 20 zonegroup default 2024-09-12T00:52:51.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.947+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.948+0000 7f0e41d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.948 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.948+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.948+0000 7f0e41d2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:51.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.948+0000 7f0e41d2e800 20 started sync module instance, tier type = 2024-09-12T00:52:51.949 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.948+0000 7f0e41d2e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:52:51.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.957+0000 7f0e41d2e800 20 add_watcher() i=0 2024-09-12T00:52:51.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.957+0000 7f0e41d2e800 20 add_watcher() i=1 2024-09-12T00:52:51.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.957+0000 7f0e41d2e800 20 add_watcher() i=2 2024-09-12T00:52:51.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.957+0000 7f0e41d2e800 20 add_watcher() i=3 2024-09-12T00:52:51.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.957+0000 7f0e41d2e800 20 add_watcher() i=4 2024-09-12T00:52:51.957 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.957+0000 7f0e41d2e800 20 add_watcher() i=5 2024-09-12T00:52:51.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.958+0000 7f0e41d2e800 20 add_watcher() i=6 2024-09-12T00:52:51.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.959+0000 7f0e41d2e800 20 add_watcher() i=7 2024-09-12T00:52:51.958 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.959+0000 7f0e41d2e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:51.960 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.961+0000 7f0cef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:51.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.961+0000 7f0e41d2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:51.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.961+0000 7f0e41d2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:51.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.961+0000 7f0e41d2e800 5 note: GC not initialized 2024-09-12T00:52:51.961 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.961+0000 7f0cee7fc640 20 reqs_thread_entry: start 2024-09-12T00:52:51.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.961+0000 7f0e41d2e800 20 init_complete bucket index max shards: 11 2024-09-12T00:52:51.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.962+0000 7f0e41d2e800 20 Filter name: none 2024-09-12T00:52:51.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.962+0000 7f0c5ffff640 20 reqs_thread_entry: start 2024-09-12T00:52:51.962 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.962+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.962+0000 7f0e41d2e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:51.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.962+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.963+0000 7f0e41d2e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:51.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.963+0000 7f0e41d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:51.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.963+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.963+0000 7f0e41d2e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:51.963 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.963+0000 7f0e41d2e800 20 rados->read ofs=0 len=0 2024-09-12T00:52:51.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.963+0000 7f0e41d2e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:51.964 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.963+0000 7f0e41d2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:52:51.965 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.965+0000 7f0cef7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:51.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.968+0000 7f0e41d2e800 20 remove_watcher() i=0 2024-09-12T00:52:51.967 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.968+0000 7f0e41d2e800 2 removed watcher, disabling cache 2024-09-12T00:52:51.968 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.969+0000 7f0e41d2e800 20 remove_watcher() i=1 2024-09-12T00:52:51.969 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.969+0000 7f0e41d2e800 20 remove_watcher() i=2 2024-09-12T00:52:51.970 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.971+0000 7f0e41d2e800 20 remove_watcher() i=3 2024-09-12T00:52:51.971 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.972+0000 7f0e41d2e800 20 remove_watcher() i=4 2024-09-12T00:52:51.972 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.973+0000 7f0e41d2e800 20 remove_watcher() i=5 2024-09-12T00:52:51.973 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.974+0000 7f0e41d2e800 20 remove_watcher() i=6 2024-09-12T00:52:51.975 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:51.975+0000 7f0e41d2e800 20 remove_watcher() i=7 2024-09-12T00:52:51.989 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:52:51.989 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:52:52.024 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:52:52.053 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:52:52.053 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:52:52.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.094+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.095+0000 7febbfc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.095+0000 7febbfc40800 20 realm 2024-09-12T00:52:52.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.095+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.095+0000 7febbfc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.095+0000 7febbfc40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:52:52.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.095+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.096+0000 7febbfc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.096+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.096+0000 7febbfc40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:52.096 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.096+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.097 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.097+0000 7febbfc40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:52:52.097 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.097+0000 7febbfc40800 20 searching for the correct realm 2024-09-12T00:52:52.100 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.100+0000 7febbcf30640 0 -- 172.21.15.19:0/4272440104 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7febb409d1b0 msgr2=0x7febb40891c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:52.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.305+0000 7febbcf30640 0 -- 172.21.15.19:0/4272440104 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5627d0a5b0a0 msgr2=0x5627d0a5d510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:52:52.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.310+0000 7febbfc40800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:52:52.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.310+0000 7febbfc40800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:52:52.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.310+0000 7febbfc40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:52:52.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.310+0000 7febbfc40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:52:52.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.310+0000 7febbfc40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:52:52.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.310+0000 7febbfc40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:52:52.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.310+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.310+0000 7febbfc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.310+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.310+0000 7febbfc40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:52:52.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.310+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:52:52.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 20 zone default found 2024-09-12T00:52:52.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 4 Realm: () 2024-09-12T00:52:52.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:52:52.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:52:52.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:52:52.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 20 zonegroup default 2024-09-12T00:52:52.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.311+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.312+0000 7febbfc40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:52:52.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.312+0000 7febbfc40800 20 started sync module instance, tier type = 2024-09-12T00:52:52.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.312+0000 7febbfc40800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:52:52.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.321+0000 7febbfc40800 20 add_watcher() i=0 2024-09-12T00:52:52.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.321+0000 7febbfc40800 20 add_watcher() i=1 2024-09-12T00:52:52.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.321+0000 7febbfc40800 20 add_watcher() i=2 2024-09-12T00:52:52.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.321+0000 7febbfc40800 20 add_watcher() i=3 2024-09-12T00:52:52.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.321+0000 7febbfc40800 20 add_watcher() i=4 2024-09-12T00:52:52.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.321+0000 7febbfc40800 20 add_watcher() i=5 2024-09-12T00:52:52.321 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.321+0000 7febbfc40800 20 add_watcher() i=6 2024-09-12T00:52:52.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.322+0000 7febbfc40800 20 add_watcher() i=7 2024-09-12T00:52:52.322 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.322+0000 7febbfc40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:52:52.323 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.324+0000 7fea737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:52.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.324+0000 7febbfc40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:52:52.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.324+0000 7febbfc40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:52:52.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.324+0000 7febbfc40800 5 note: GC not initialized 2024-09-12T00:52:52.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.324+0000 7fea727e4640 20 reqs_thread_entry: start 2024-09-12T00:52:52.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.324+0000 7febbfc40800 20 init_complete bucket index max shards: 11 2024-09-12T00:52:52.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 20 Filter name: none 2024-09-12T00:52:52.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7fe9e3fff640 20 reqs_thread_entry: start 2024-09-12T00:52:52.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:52:52.325 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:52:52.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:52:52.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:52:52.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:52:52.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 20 rados->read ofs=0 len=0 2024-09-12T00:52:52.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:52:52.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:52:52.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:52:52.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:52:52.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:52:52.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.325+0000 7febbfc40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:52:52.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.326+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:52:52.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.326+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:52:52.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.326+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:52:52.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.326+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:52:52.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.326+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:52:52.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.326+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:52:52.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.327+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:52:52.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.327+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:52:52.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.328+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:52:52.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.328+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:52:52.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.328+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:52:52.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.328+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:52:52.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.328+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:52:52.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.328+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:52:52.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.329+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:52:52.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.329+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:52:52.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.329+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:52:52.329 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.329+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:52:52.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.330+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:52:52.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.330+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:52:52.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.330+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:52:52.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.330+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:52:52.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.330+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:52:52.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.330+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:52:52.330 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.331+0000 7febbfc40800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:52:52.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.331+0000 7febbfc40800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:52:52.331 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.332+0000 7fea737e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:52:52.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.334+0000 7febbfc40800 20 remove_watcher() i=0 2024-09-12T00:52:52.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.334+0000 7febbfc40800 2 removed watcher, disabling cache 2024-09-12T00:52:52.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.335+0000 7febbfc40800 20 remove_watcher() i=1 2024-09-12T00:52:52.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.336+0000 7febbfc40800 20 remove_watcher() i=2 2024-09-12T00:52:52.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.337+0000 7febbfc40800 20 remove_watcher() i=3 2024-09-12T00:52:52.338 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.338+0000 7febbfc40800 20 remove_watcher() i=4 2024-09-12T00:52:52.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.339+0000 7febbfc40800 20 remove_watcher() i=5 2024-09-12T00:52:52.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.340+0000 7febbfc40800 20 remove_watcher() i=6 2024-09-12T00:52:52.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:52:52.341+0000 7febbfc40800 20 remove_watcher() i=7 2024-09-12T00:53:22.382 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:53:22.417 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:22.417 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:22.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.464+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.466+0000 7f5a6a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.466+0000 7f5a6a40f800 20 realm 2024-09-12T00:53:22.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.466+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.466+0000 7f5a6a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.466+0000 7f5a6a40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:22.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.466+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.466+0000 7f5a6a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.466+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.467+0000 7f5a6a40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:22.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.467+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.468+0000 7f5a6a40f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:22.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.468+0000 7f5a6a40f800 20 searching for the correct realm 2024-09-12T00:53:22.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.471+0000 7f5a5f6f8640 0 -- 172.21.15.19:0/2680882273 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f5a5007a1c0 msgr2=0x7f5a500962c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:22.676 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.677+0000 7f5a686fa640 0 -- 172.21.15.19:0/2680882273 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55df963517b0 msgr2=0x55df96353c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:22.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.682+0000 7f5a6a40f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:22.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.682+0000 7f5a6a40f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:22.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.682+0000 7f5a6a40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:22.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.682+0000 7f5a6a40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:22.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.682+0000 7f5a6a40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:22.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.682+0000 7f5a6a40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:22.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.682+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:22.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:22.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 20 zone default found 2024-09-12T00:53:22.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 4 Realm: () 2024-09-12T00:53:22.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:22.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:22.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:22.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 20 zonegroup default 2024-09-12T00:53:22.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.683+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.684+0000 7f5a6a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.684+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.684+0000 7f5a6a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.684+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.684+0000 7f5a6a40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.685+0000 7f5a6a40f800 20 started sync module instance, tier type = 2024-09-12T00:53:22.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.685+0000 7f5a6a40f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:22.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.695+0000 7f5a6a40f800 20 add_watcher() i=0 2024-09-12T00:53:22.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.695+0000 7f5a6a40f800 20 add_watcher() i=1 2024-09-12T00:53:22.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.695+0000 7f5a6a40f800 20 add_watcher() i=2 2024-09-12T00:53:22.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.695+0000 7f5a6a40f800 20 add_watcher() i=3 2024-09-12T00:53:22.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.695+0000 7f5a6a40f800 20 add_watcher() i=4 2024-09-12T00:53:22.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.695+0000 7f5a6a40f800 20 add_watcher() i=5 2024-09-12T00:53:22.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.695+0000 7f5a6a40f800 20 add_watcher() i=6 2024-09-12T00:53:22.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.696+0000 7f5a6a40f800 20 add_watcher() i=7 2024-09-12T00:53:22.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.696+0000 7f5a6a40f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:22.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.698+0000 7f591dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:22.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.699+0000 7f5a6a40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:22.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.699+0000 7f5a6a40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:22.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.699+0000 7f5a6a40f800 5 note: GC not initialized 2024-09-12T00:53:22.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.699+0000 7f591cfe1640 20 reqs_thread_entry: start 2024-09-12T00:53:22.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.699+0000 7f5a6a40f800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:22.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.699+0000 7f5a6a40f800 20 Filter name: none 2024-09-12T00:53:22.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.699+0000 7f58967fc640 20 reqs_thread_entry: start 2024-09-12T00:53:22.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.699+0000 7f5a6a40f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:22.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.699+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.700+0000 7f5a6a40f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:22.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.700+0000 7f5a6a40f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:22.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.700+0000 7f5a6a40f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:22.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.700+0000 7f5a6a40f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:53:22.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.700+0000 7f5a6a40f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.700+0000 7f5a6a40f800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:53:22.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.700+0000 7f5a6a40f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:53:22.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.700+0000 7f5a6a40f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:53:22.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.700+0000 7f5a6a40f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:22.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.700+0000 7f5a6a40f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:22.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.700+0000 7f5a6a40f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:53:22.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.705+0000 7f591dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:22.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.707+0000 7f5a6a40f800 20 remove_watcher() i=0 2024-09-12T00:53:22.706 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.707+0000 7f5a6a40f800 2 removed watcher, disabling cache 2024-09-12T00:53:22.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.709+0000 7f5a6a40f800 20 remove_watcher() i=1 2024-09-12T00:53:22.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.710+0000 7f5a6a40f800 20 remove_watcher() i=2 2024-09-12T00:53:22.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.711+0000 7f5a6a40f800 20 remove_watcher() i=3 2024-09-12T00:53:22.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.712+0000 7f5a6a40f800 20 remove_watcher() i=4 2024-09-12T00:53:22.712 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.713+0000 7f5a6a40f800 20 remove_watcher() i=5 2024-09-12T00:53:22.713 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.714+0000 7f5a6a40f800 20 remove_watcher() i=6 2024-09-12T00:53:22.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.715+0000 7f5a6a40f800 20 remove_watcher() i=7 2024-09-12T00:53:22.732 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:53:22.760 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:22.760 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:22.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.804+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.805+0000 7f0ba5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.805+0000 7f0ba5a0e800 20 realm 2024-09-12T00:53:22.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.805+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.806+0000 7f0ba5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.806+0000 7f0ba5a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:22.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.806+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.806+0000 7f0ba5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:22.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.806+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.807+0000 7f0ba5a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:22.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.807+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:22.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.807+0000 7f0ba5a0e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:22.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.807+0000 7f0ba5a0e800 20 searching for the correct realm 2024-09-12T00:53:22.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:22.810+0000 7f0ba096a640 0 -- 172.21.15.19:0/3959799612 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f0b98075c30 msgr2=0x7f0b98074990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:23.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.017+0000 7f0ba196c640 0 -- 172.21.15.19:0/3959799612 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x558fbf417470 msgr2=0x558fbf419880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:23.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.021+0000 7f0ba5a0e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:23.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.021+0000 7f0ba5a0e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:23.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.021+0000 7f0ba5a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:23.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.021+0000 7f0ba5a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:23.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.021+0000 7f0ba5a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:23.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.021+0000 7f0ba5a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:23.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.021+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:23.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:23.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 20 zone default found 2024-09-12T00:53:23.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 4 Realm: () 2024-09-12T00:53:23.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:23.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:23.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:23.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 20 zonegroup default 2024-09-12T00:53:23.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.022+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.023+0000 7f0ba5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.023+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.023+0000 7f0ba5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.023+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.024+0000 7f0ba5a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.024+0000 7f0ba5a0e800 20 started sync module instance, tier type = 2024-09-12T00:53:23.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.024+0000 7f0ba5a0e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:23.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.034+0000 7f0ba5a0e800 20 add_watcher() i=0 2024-09-12T00:53:23.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.034+0000 7f0ba5a0e800 20 add_watcher() i=1 2024-09-12T00:53:23.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.034+0000 7f0ba5a0e800 20 add_watcher() i=2 2024-09-12T00:53:23.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.034+0000 7f0ba5a0e800 20 add_watcher() i=3 2024-09-12T00:53:23.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.034+0000 7f0ba5a0e800 20 add_watcher() i=4 2024-09-12T00:53:23.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.034+0000 7f0ba5a0e800 20 add_watcher() i=5 2024-09-12T00:53:23.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.034+0000 7f0ba5a0e800 20 add_watcher() i=6 2024-09-12T00:53:23.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.035+0000 7f0ba5a0e800 20 add_watcher() i=7 2024-09-12T00:53:23.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.035+0000 7f0ba5a0e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:23.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.037+0000 7f0a577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.037+0000 7f0ba5a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.037+0000 7f0ba5a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.037+0000 7f0ba5a0e800 5 note: GC not initialized 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.037+0000 7f0a567e4640 20 reqs_thread_entry: start 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.038+0000 7f0ba5a0e800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.038+0000 7f0ba5a0e800 20 Filter name: none 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.038+0000 7f09c7fff640 20 reqs_thread_entry: start 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.038+0000 7f0ba5a0e800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.038+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.038+0000 7f0ba5a0e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.038+0000 7f0ba5a0e800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:23.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.038+0000 7f0ba5a0e800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:23.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.038+0000 7f0ba5a0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:53:23.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.038+0000 7f0ba5a0e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:53:23.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:53:23.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:53:23.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:23.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:23.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:53:23.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:53:23.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:53:23.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:53:23.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:53:23.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:53:23.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.039+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:53:23.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.040+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:53:23.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.040+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:53:23.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.040+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:53:23.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.040+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:53:23.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.041+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:53:23.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.041+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:53:23.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.041+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:53:23.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.041+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:53:23.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.042+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:53:23.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.042+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:53:23.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.042+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:53:23.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.042+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:53:23.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.042+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:53:23.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.042+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:53:23.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.043+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:53:23.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.043+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:53:23.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.043+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:53:23.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.043+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:53:23.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.043+0000 7f0ba5a0e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:53:23.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.043+0000 7f0ba5a0e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:53:23.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.045+0000 7f0a577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:23.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.047+0000 7f0ba5a0e800 20 remove_watcher() i=0 2024-09-12T00:53:23.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.047+0000 7f0ba5a0e800 2 removed watcher, disabling cache 2024-09-12T00:53:23.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.048+0000 7f0ba5a0e800 20 remove_watcher() i=1 2024-09-12T00:53:23.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.049+0000 7f0ba5a0e800 20 remove_watcher() i=2 2024-09-12T00:53:23.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.050+0000 7f0ba5a0e800 20 remove_watcher() i=3 2024-09-12T00:53:23.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.051+0000 7f0ba5a0e800 20 remove_watcher() i=4 2024-09-12T00:53:23.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.052+0000 7f0ba5a0e800 20 remove_watcher() i=5 2024-09-12T00:53:23.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.053+0000 7f0ba5a0e800 20 remove_watcher() i=6 2024-09-12T00:53:23.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.054+0000 7f0ba5a0e800 20 remove_watcher() i=7 2024-09-12T00:53:23.064 INFO:tasks.workunit.client.0.smithi019.stderr:check reshard logrecord successfully 2024-09-12T00:53:23.065 INFO:tasks.workunit.client.0.smithi019.stderr: test: reshard versioned bucket 2024-09-12T00:53:23.066 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:53:23.097 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:23.097 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:23.136 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.137+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.139+0000 7f7424925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.139+0000 7f7424925800 20 realm 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.139+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.140+0000 7f7424925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.140+0000 7f7424925800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.140+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.140+0000 7f7424925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.140+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.140+0000 7f7424925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.140+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.141+0000 7f7424925800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:23.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.141+0000 7f7424925800 20 searching for the correct realm 2024-09-12T00:53:23.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.144+0000 7f741fdb4640 0 -- 172.21.15.19:0/415337431 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f7414063450 msgr2=0x7f74140638b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:23.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.349+0000 7f7420db6640 0 -- 172.21.15.19:0/415337431 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55880d094e80 msgr2=0x55880d097320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:23.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.354+0000 7f7424925800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:23.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.354+0000 7f7424925800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:23.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.354+0000 7f7424925800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:23.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.354+0000 7f7424925800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:23.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.354+0000 7f7424925800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:23.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.354+0000 7f7424925800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:23.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.354+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:23.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:23.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 20 zone default found 2024-09-12T00:53:23.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 4 Realm: () 2024-09-12T00:53:23.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:23.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:23.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:23.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 20 zonegroup default 2024-09-12T00:53:23.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.355+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.356+0000 7f7424925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.356+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.356+0000 7f7424925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.356+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.356+0000 7f7424925800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.356+0000 7f7424925800 20 started sync module instance, tier type = 2024-09-12T00:53:23.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.356+0000 7f7424925800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:23.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.366+0000 7f7424925800 20 add_watcher() i=0 2024-09-12T00:53:23.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.366+0000 7f7424925800 20 add_watcher() i=1 2024-09-12T00:53:23.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.366+0000 7f7424925800 20 add_watcher() i=2 2024-09-12T00:53:23.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.366+0000 7f7424925800 20 add_watcher() i=3 2024-09-12T00:53:23.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.366+0000 7f7424925800 20 add_watcher() i=4 2024-09-12T00:53:23.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.366+0000 7f7424925800 20 add_watcher() i=5 2024-09-12T00:53:23.365 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.366+0000 7f7424925800 20 add_watcher() i=6 2024-09-12T00:53:23.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.367+0000 7f7424925800 20 add_watcher() i=7 2024-09-12T00:53:23.366 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.367+0000 7f7424925800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:23.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.369+0000 7f72d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:23.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.369+0000 7f7424925800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:23.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.369+0000 7f7424925800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:23.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.369+0000 7f7424925800 5 note: GC not initialized 2024-09-12T00:53:23.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.370+0000 7f72d5fdb640 20 reqs_thread_entry: start 2024-09-12T00:53:23.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.370+0000 7f7424925800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:23.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.370+0000 7f7424925800 20 Filter name: none 2024-09-12T00:53:23.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.370+0000 7f72477fe640 20 reqs_thread_entry: start 2024-09-12T00:53:23.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.370+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.371+0000 7f7424925800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:23.369 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.371+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.372+0000 7f7424925800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:23.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.372+0000 7f7424925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:23.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.372+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.372+0000 7f7424925800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:23.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.372+0000 7f7424925800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.373+0000 7f7424925800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:23.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.373+0000 7f7424925800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:23.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.374+0000 7f72d6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:23.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.377+0000 7f7424925800 20 remove_watcher() i=0 2024-09-12T00:53:23.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.377+0000 7f7424925800 2 removed watcher, disabling cache 2024-09-12T00:53:23.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.378+0000 7f7424925800 20 remove_watcher() i=1 2024-09-12T00:53:23.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.379+0000 7f7424925800 20 remove_watcher() i=2 2024-09-12T00:53:23.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.380+0000 7f7424925800 20 remove_watcher() i=3 2024-09-12T00:53:23.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.381+0000 7f7424925800 20 remove_watcher() i=4 2024-09-12T00:53:23.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.382+0000 7f7424925800 20 remove_watcher() i=5 2024-09-12T00:53:23.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.384+0000 7f7424925800 20 remove_watcher() i=6 2024-09-12T00:53:23.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.385+0000 7f7424925800 20 remove_watcher() i=7 2024-09-12T00:53:23.395 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:53:23.395 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:53:23.395 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: myver id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:53:23.395 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:53:23.396 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T00:53:23.428 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:23.428 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:23.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.469+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.471+0000 7fb76bd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.471+0000 7fb76bd3a800 20 realm 2024-09-12T00:53:23.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.471+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.471+0000 7fb76bd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.471+0000 7fb76bd3a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:23.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.471+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.471+0000 7fb76bd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.471+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.472+0000 7fb76bd3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:23.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.472+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.472+0000 7fb76bd3a800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:23.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.472+0000 7fb76bd3a800 20 searching for the correct realm 2024-09-12T00:53:23.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.476+0000 7fb767280640 0 -- 172.21.15.19:0/2284292505 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fb75c00b040 msgr2=0x7fb75c031440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:23.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.682+0000 7fb768282640 0 -- 172.21.15.19:0/2284292505 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x556b181eeaa0 msgr2=0x556b181f0f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:23.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.686+0000 7fb76bd3a800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:23.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.686+0000 7fb76bd3a800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:23.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.686+0000 7fb76bd3a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:23.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.686+0000 7fb76bd3a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:23.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.686+0000 7fb76bd3a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:23.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.686+0000 7fb76bd3a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:23.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.686+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.687+0000 7fb76bd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.687+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.687+0000 7fb76bd3a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:23.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.687+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:23.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 20 zone default found 2024-09-12T00:53:23.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 4 Realm: () 2024-09-12T00:53:23.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:23.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:23.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:23.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 20 zonegroup default 2024-09-12T00:53:23.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 20 started sync module instance, tier type = 2024-09-12T00:53:23.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.688+0000 7fb76bd3a800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:23.696 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.698+0000 7fb76bd3a800 20 add_watcher() i=0 2024-09-12T00:53:23.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.698+0000 7fb76bd3a800 20 add_watcher() i=1 2024-09-12T00:53:23.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.698+0000 7fb76bd3a800 20 add_watcher() i=2 2024-09-12T00:53:23.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.698+0000 7fb76bd3a800 20 add_watcher() i=3 2024-09-12T00:53:23.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.698+0000 7fb76bd3a800 20 add_watcher() i=4 2024-09-12T00:53:23.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.698+0000 7fb76bd3a800 20 add_watcher() i=5 2024-09-12T00:53:23.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.698+0000 7fb76bd3a800 20 add_watcher() i=6 2024-09-12T00:53:23.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.699+0000 7fb76bd3a800 20 add_watcher() i=7 2024-09-12T00:53:23.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.699+0000 7fb76bd3a800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:23.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.701+0000 7fb61dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:23.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.701+0000 7fb76bd3a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:23.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.701+0000 7fb76bd3a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:23.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.702+0000 7fb76bd3a800 5 note: GC not initialized 2024-09-12T00:53:23.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.702+0000 7fb61cfe1640 20 reqs_thread_entry: start 2024-09-12T00:53:23.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.702+0000 7fb76bd3a800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:23.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.702+0000 7fb76bd3a800 20 Filter name: none 2024-09-12T00:53:23.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.702+0000 7fb5967fc640 20 reqs_thread_entry: start 2024-09-12T00:53:23.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.702+0000 7fb76bd3a800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:53:23.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.702+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.703+0000 7fb76bd3a800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:23.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.703+0000 7fb76bd3a800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:53:23.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.703+0000 7fb76bd3a800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:53:23.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.703+0000 7fb76bd3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 : miss 2024-09-12T00:53:23.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.703+0000 7fb76bd3a800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.703+0000 7fb76bd3a800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:23.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.703+0000 7fb76bd3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:23.702 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.703+0000 7fb76bd3a800 10 adding default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:23.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.703+0000 7fb76bd3a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:23.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.703+0000 7fb76bd3a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:23.703 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.703+0000 7fb76bd3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 2024-09-12T00:53:23.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.709+0000 7fb76bd3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:23.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.709+0000 7fb76bd3a800 10 moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:23.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.709+0000 7fb76bd3a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:23.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.709+0000 7fb76bd3a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18, ofs0, ns] 2024-09-12T00:53:23.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.709+0000 7fb646ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398891 cookie 93918454597552 notifier 8451 bl.length()=821 2024-09-12T00:53:23.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.709+0000 7fb646ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:23.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.709+0000 7fb646ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:23.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.709+0000 7fb646ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:23.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.711+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_sources= new_sources= 2024-09-12T00:53:23.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.711+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential sources added=[] removed=[] 2024-09-12T00:53:23.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.711+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_dests= new_dests= 2024-09-12T00:53:23.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.711+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential dests added=[] removed=[] 2024-09-12T00:53:23.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.0 2024-09-12T00:53:23.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.0 2024-09-12T00:53:23.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.1 2024-09-12T00:53:23.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.1 2024-09-12T00:53:23.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.2 2024-09-12T00:53:23.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.2 2024-09-12T00:53:23.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.3 2024-09-12T00:53:23.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.3 2024-09-12T00:53:23.714 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.4 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.4 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.5 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.5 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.6 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.6 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.7 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.7 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.8 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.8 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.9 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.9 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.10 2024-09-12T00:53:23.715 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.10 2024-09-12T00:53:23.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.11 2024-09-12T00:53:23.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.11 2024-09-12T00:53:23.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.715+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.0 2024-09-12T00:53:23.716 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.716+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1 2024-09-12T00:53:23.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.716+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2 2024-09-12T00:53:23.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.716+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3 2024-09-12T00:53:23.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.717+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.4 2024-09-12T00:53:23.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.718+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.5 2024-09-12T00:53:23.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.718+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.6 2024-09-12T00:53:23.717 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.719+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.7 2024-09-12T00:53:23.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.719+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.8 2024-09-12T00:53:23.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.720+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.9 2024-09-12T00:53:23.718 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.720+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.10 2024-09-12T00:53:23.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.720+0000 7fb76bd3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:23.719 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.720+0000 7fb76bd3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 2024-09-12T00:53:23.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.722+0000 7fb76bd3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:23.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.722+0000 7fb76bd3a800 10 moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:23.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.722+0000 7fb76bd3a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:23.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.722+0000 7fb76bd3a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18, ofs0, ns] 2024-09-12T00:53:23.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.722+0000 7fb646ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398892 cookie 93918454597552 notifier 8451 bl.length()=821 2024-09-12T00:53:23.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.722+0000 7fb646ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:23.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.722+0000 7fb646ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:23.721 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.722+0000 7fb646ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:23.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.724+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_sources= new_sources= 2024-09-12T00:53:23.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.724+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential sources added=[] removed=[] 2024-09-12T00:53:23.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.724+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_dests= new_dests= 2024-09-12T00:53:23.722 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.724+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential dests added=[] removed=[] 2024-09-12T00:53:23.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.726+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.0 2024-09-12T00:53:23.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.726+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1 2024-09-12T00:53:23.725 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.727+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2 2024-09-12T00:53:23.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.727+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3 2024-09-12T00:53:23.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.727+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.4 2024-09-12T00:53:23.726 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.728+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.5 2024-09-12T00:53:23.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.728+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.6 2024-09-12T00:53:23.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.728+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.7 2024-09-12T00:53:23.727 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.729+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.8 2024-09-12T00:53:23.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.729+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.9 2024-09-12T00:53:23.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.729+0000 7fb76bd3a800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.10 2024-09-12T00:53:23.728 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.730+0000 7fb76bd3a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:23.729 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.730+0000 7fb76bd3a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 2024-09-12T00:53:23.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.731+0000 7fb76bd3a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:23.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.731+0000 7fb76bd3a800 10 moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:23.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.731+0000 7fb76bd3a800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:23.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.731+0000 7fb76bd3a800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18, ofs0, ns] 2024-09-12T00:53:23.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.732+0000 7fb6467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398893 cookie 93918454597552 notifier 8451 bl.length()=789 2024-09-12T00:53:23.730 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.732+0000 7fb6467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:23.731 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.732+0000 7fb6467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:23.731 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.732+0000 7fb6467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:23.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.733+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_sources= new_sources= 2024-09-12T00:53:23.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.733+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential sources added=[] removed=[] 2024-09-12T00:53:23.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.733+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_dests= new_dests= 2024-09-12T00:53:23.732 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.733+0000 7fb76bd3a800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential dests added=[] removed=[] 2024-09-12T00:53:23.735 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.736+0000 7fb76bd3a800 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T00:53:23.736 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.738+0000 7fb61dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:23.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.740+0000 7fb76bd3a800 20 remove_watcher() i=0 2024-09-12T00:53:23.738 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.740+0000 7fb76bd3a800 2 removed watcher, disabling cache 2024-09-12T00:53:23.739 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.741+0000 7fb76bd3a800 20 remove_watcher() i=1 2024-09-12T00:53:23.740 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.742+0000 7fb76bd3a800 20 remove_watcher() i=2 2024-09-12T00:53:23.741 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.743+0000 7fb76bd3a800 20 remove_watcher() i=3 2024-09-12T00:53:23.742 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.744+0000 7fb76bd3a800 20 remove_watcher() i=4 2024-09-12T00:53:23.743 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.745+0000 7fb76bd3a800 20 remove_watcher() i=5 2024-09-12T00:53:23.744 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.746+0000 7fb76bd3a800 20 remove_watcher() i=6 2024-09-12T00:53:23.745 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.747+0000 7fb76bd3a800 20 remove_watcher() i=7 2024-09-12T00:53:23.758 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:53:23.787 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:23.787 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:23.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.828+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.829+0000 7f87be725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.829+0000 7f87be725800 20 realm 2024-09-12T00:53:23.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.829+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.830+0000 7f87be725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.830+0000 7f87be725800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:23.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.830+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.830+0000 7f87be725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:23.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.830+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.830+0000 7f87be725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:23.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.830+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:23.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.831+0000 7f87be725800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:23.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.831+0000 7f87be725800 20 searching for the correct realm 2024-09-12T00:53:23.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:23.834+0000 7f87b9b32640 0 -- 172.21.15.19:0/2116390175 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f87b0068c70 msgr2=0x7f87b0049040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:24.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.040+0000 7f87bab34640 0 -- 172.21.15.19:0/2116390175 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55f18e72dcd0 msgr2=0x55f18e7300f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:24.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.044+0000 7f87be725800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:24.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.044+0000 7f87be725800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:24.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.044+0000 7f87be725800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:24.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.044+0000 7f87be725800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:24.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.044+0000 7f87be725800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:24.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.044+0000 7f87be725800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:24.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.044+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:24.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 20 zone default found 2024-09-12T00:53:24.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 4 Realm: () 2024-09-12T00:53:24.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:24.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:24.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:24.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 20 zonegroup default 2024-09-12T00:53:24.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.045+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.046+0000 7f87be725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.046+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.046+0000 7f87be725800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.046+0000 7f87be725800 20 started sync module instance, tier type = 2024-09-12T00:53:24.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.046+0000 7f87be725800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:24.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.055+0000 7f87be725800 20 add_watcher() i=0 2024-09-12T00:53:24.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.055+0000 7f87be725800 20 add_watcher() i=1 2024-09-12T00:53:24.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.055+0000 7f87be725800 20 add_watcher() i=2 2024-09-12T00:53:24.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.055+0000 7f87be725800 20 add_watcher() i=3 2024-09-12T00:53:24.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.055+0000 7f87be725800 20 add_watcher() i=4 2024-09-12T00:53:24.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.055+0000 7f87be725800 20 add_watcher() i=5 2024-09-12T00:53:24.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.055+0000 7f87be725800 20 add_watcher() i=6 2024-09-12T00:53:24.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.056+0000 7f87be725800 20 add_watcher() i=7 2024-09-12T00:53:24.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.056+0000 7f87be725800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:24.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.058+0000 7f8670fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:24.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.058+0000 7f87be725800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:24.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.058+0000 7f87be725800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:24.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.058+0000 7f87be725800 5 note: GC not initialized 2024-09-12T00:53:24.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.058+0000 7f85eb7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:24.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.059+0000 7f87be725800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:24.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.059+0000 7f87be725800 20 Filter name: none 2024-09-12T00:53:24.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.059+0000 7f85e97fa640 20 reqs_thread_entry: start 2024-09-12T00:53:24.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.059+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.059+0000 7f87be725800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:24.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.059+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.060+0000 7f87be725800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:24.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.060+0000 7f87be725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:24.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.060+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.060+0000 7f87be725800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:24.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.060+0000 7f87be725800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.061+0000 7f87be725800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:24.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.061+0000 7f87be725800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:24.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.063+0000 7f8670fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:24.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.065+0000 7f87be725800 20 remove_watcher() i=0 2024-09-12T00:53:24.064 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.065+0000 7f87be725800 2 removed watcher, disabling cache 2024-09-12T00:53:24.065 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.066+0000 7f87be725800 20 remove_watcher() i=1 2024-09-12T00:53:24.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.067+0000 7f87be725800 20 remove_watcher() i=2 2024-09-12T00:53:24.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.068+0000 7f87be725800 20 remove_watcher() i=3 2024-09-12T00:53:24.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.069+0000 7f87be725800 20 remove_watcher() i=4 2024-09-12T00:53:24.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.070+0000 7f87be725800 20 remove_watcher() i=5 2024-09-12T00:53:24.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.071+0000 7f87be725800 20 remove_watcher() i=6 2024-09-12T00:53:24.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.072+0000 7f87be725800 20 remove_watcher() i=7 2024-09-12T00:53:24.082 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:53:24.082 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:53:24.082 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: myver id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:53:24.083 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:53:24.085 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:24.085 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:24.106 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:24.106 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:24.162 INFO:tasks.workunit.client.0.smithi019.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:53:24.164 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:24.164 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:24.243 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:24.243 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:24.473 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:53:24.502 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:24.502 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:24.541 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.543+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.545+0000 7fa899b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.545+0000 7fa899b2c800 20 realm 2024-09-12T00:53:24.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.545+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.545+0000 7fa899b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.545+0000 7fa899b2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:24.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.545+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.545+0000 7fa899b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.544 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.545+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.546+0000 7fa899b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.546+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.547+0000 7fa899b2c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:24.545 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.547+0000 7fa899b2c800 20 searching for the correct realm 2024-09-12T00:53:24.548 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.550+0000 7fa894f44640 0 -- 172.21.15.19:0/1300214890 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fa88c008410 msgr2=0x7fa88c008890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:24.754 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.755+0000 7fa894f44640 0 -- 172.21.15.19:0/1300214890 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x564ca7ec8900 msgr2=0x564ca7ecad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:24.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.760+0000 7fa899b2c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:24.758 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.760+0000 7fa899b2c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:24.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.760+0000 7fa899b2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:24.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.760+0000 7fa899b2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:24.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.760+0000 7fa899b2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:24.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.760+0000 7fa899b2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:24.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.760+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.760+0000 7fa899b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.759 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.760+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.760+0000 7fa899b2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:24.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.760+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:24.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 20 zone default found 2024-09-12T00:53:24.760 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 4 Realm: () 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 20 zonegroup default 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.761+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.762+0000 7fa899b2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.762+0000 7fa899b2c800 20 started sync module instance, tier type = 2024-09-12T00:53:24.761 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.762+0000 7fa899b2c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:24.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.771+0000 7fa899b2c800 20 add_watcher() i=0 2024-09-12T00:53:24.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.771+0000 7fa899b2c800 20 add_watcher() i=1 2024-09-12T00:53:24.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.771+0000 7fa899b2c800 20 add_watcher() i=2 2024-09-12T00:53:24.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.771+0000 7fa899b2c800 20 add_watcher() i=3 2024-09-12T00:53:24.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.771+0000 7fa899b2c800 20 add_watcher() i=4 2024-09-12T00:53:24.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.771+0000 7fa899b2c800 20 add_watcher() i=5 2024-09-12T00:53:24.770 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.771+0000 7fa899b2c800 20 add_watcher() i=6 2024-09-12T00:53:24.771 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.772+0000 7fa899b2c800 20 add_watcher() i=7 2024-09-12T00:53:24.771 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.772+0000 7fa899b2c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:24.772 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.774+0000 7fa74b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:24.773 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.774+0000 7fa899b2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:24.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.774+0000 7fa899b2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:24.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.774+0000 7fa899b2c800 5 note: GC not initialized 2024-09-12T00:53:24.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.774+0000 7fa74a7e4640 20 reqs_thread_entry: start 2024-09-12T00:53:24.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.774+0000 7fa899b2c800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:24.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.774+0000 7fa899b2c800 20 Filter name: none 2024-09-12T00:53:24.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.774+0000 7fa6bbfff640 20 reqs_thread_entry: start 2024-09-12T00:53:24.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.774+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.775+0000 7fa899b2c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:24.774 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.775+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.775+0000 7fa899b2c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:24.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.775+0000 7fa899b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:24.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.775+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.776+0000 7fa899b2c800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:24.775 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.776+0000 7fa899b2c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.776+0000 7fa899b2c800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:24.776 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.776+0000 7fa899b2c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:24.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.778+0000 7fa74b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:24.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.780+0000 7fa899b2c800 20 remove_watcher() i=0 2024-09-12T00:53:24.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.780+0000 7fa899b2c800 2 removed watcher, disabling cache 2024-09-12T00:53:24.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.781+0000 7fa899b2c800 20 remove_watcher() i=1 2024-09-12T00:53:24.781 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.782+0000 7fa899b2c800 20 remove_watcher() i=2 2024-09-12T00:53:24.782 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.783+0000 7fa899b2c800 20 remove_watcher() i=3 2024-09-12T00:53:24.783 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.784+0000 7fa899b2c800 20 remove_watcher() i=4 2024-09-12T00:53:24.784 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.786+0000 7fa899b2c800 20 remove_watcher() i=5 2024-09-12T00:53:24.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.787+0000 7fa899b2c800 20 remove_watcher() i=6 2024-09-12T00:53:24.786 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.787+0000 7fa899b2c800 20 remove_watcher() i=7 2024-09-12T00:53:24.797 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:53:24.798 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:53:24.798 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: a-bucket id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T00:53:24.798 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:53:24.799 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:53:24.829 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:24.829 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:24.868 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.869+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.871+0000 7f5235732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.871+0000 7f5235732800 20 realm 2024-09-12T00:53:24.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.871+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.871+0000 7f5235732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.871+0000 7f5235732800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:24.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.871+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:24.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.871+0000 7f5235732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:24.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:24.871+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.074+0000 7f5235732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:25.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.074+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.074+0000 7f5235732800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:25.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.074+0000 7f5235732800 20 searching for the correct realm 2024-09-12T00:53:25.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.077+0000 7f52313bc640 0 -- 172.21.15.19:0/2262942889 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f522408e020 msgr2=0x7f5224063010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:25.080 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.081+0000 7f52313bc640 0 -- 172.21.15.19:0/2262942889 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f522c081060 msgr2=0x7f522c0a7ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:25.288 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.289+0000 7f5235732800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:25.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.289+0000 7f5235732800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:25.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.289+0000 7f5235732800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:25.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.289+0000 7f5235732800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:25.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.289+0000 7f5235732800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:25.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.289+0000 7f5235732800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:25.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.289+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.290+0000 7f5235732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.289 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.290+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.290+0000 7f5235732800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:25.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.290+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:25.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 20 zone default found 2024-09-12T00:53:25.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 4 Realm: () 2024-09-12T00:53:25.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:25.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:25.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:25.291 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 20 zonegroup default 2024-09-12T00:53:25.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.291+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.292+0000 7f5235732800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.292+0000 7f5235732800 20 started sync module instance, tier type = 2024-09-12T00:53:25.292 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.292+0000 7f5235732800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:25.300 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.302+0000 7f5235732800 20 add_watcher() i=0 2024-09-12T00:53:25.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.302+0000 7f5235732800 20 add_watcher() i=1 2024-09-12T00:53:25.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.302+0000 7f5235732800 20 add_watcher() i=2 2024-09-12T00:53:25.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.302+0000 7f5235732800 20 add_watcher() i=3 2024-09-12T00:53:25.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.302+0000 7f5235732800 20 add_watcher() i=4 2024-09-12T00:53:25.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.302+0000 7f5235732800 20 add_watcher() i=5 2024-09-12T00:53:25.301 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.302+0000 7f5235732800 20 add_watcher() i=6 2024-09-12T00:53:25.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.302+0000 7f5235732800 20 add_watcher() i=7 2024-09-12T00:53:25.302 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.302+0000 7f5235732800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:25.303 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.305+0000 7f50e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:25.304 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.305+0000 7f5235732800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.305+0000 7f5235732800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.305+0000 7f5235732800 5 note: GC not initialized 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.305+0000 7f50e6fe5640 20 reqs_thread_entry: start 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.306+0000 7f5235732800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.306+0000 7f5235732800 20 Filter name: none 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.306+0000 7f50e4fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:25.305 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.306+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.306+0000 7f5235732800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:25.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.306+0000 7f5235732800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.307+0000 7f5235732800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:25.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.307+0000 7f5235732800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:25.306 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.308+0000 7f50e7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:25.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.310+0000 7f5235732800 20 remove_watcher() i=0 2024-09-12T00:53:25.309 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.310+0000 7f5235732800 2 removed watcher, disabling cache 2024-09-12T00:53:25.310 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.311+0000 7f5235732800 20 remove_watcher() i=1 2024-09-12T00:53:25.311 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.313+0000 7f5235732800 20 remove_watcher() i=2 2024-09-12T00:53:25.312 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.314+0000 7f5235732800 20 remove_watcher() i=3 2024-09-12T00:53:25.313 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.315+0000 7f5235732800 20 remove_watcher() i=4 2024-09-12T00:53:25.314 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.316+0000 7f5235732800 20 remove_watcher() i=5 2024-09-12T00:53:25.316 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.317+0000 7f5235732800 20 remove_watcher() i=6 2024-09-12T00:53:25.317 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.318+0000 7f5235732800 20 remove_watcher() i=7 2024-09-12T00:53:25.331 INFO:tasks.workunit.client.0.smithi019.stderr:rados -p default.rgw.buckets.index setomapval .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:53:25.359 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:25.359 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:25.377 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:53:25.407 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:25.408 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:25.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.448+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.450+0000 7f7991146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.450+0000 7f7991146800 20 realm 2024-09-12T00:53:25.450 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.450+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.450+0000 7f7991146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.450+0000 7f7991146800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:25.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.450+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.451+0000 7f7991146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.451 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.451+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.452+0000 7f7991146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:25.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.452+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.452+0000 7f7991146800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:25.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.452+0000 7f7991146800 20 searching for the correct realm 2024-09-12T00:53:25.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.456+0000 7f798e436640 0 -- 172.21.15.19:0/2048054161 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f7984030070 msgr2=0x7f798406e6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:25.661 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.663+0000 7f798f438640 0 -- 172.21.15.19:0/2048054161 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55a0ab8f2110 msgr2=0x55a0ab8f4540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:25.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:25.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:25.666 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:25.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:25.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:25.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:25.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.667 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:25.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:25.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 zone default found 2024-09-12T00:53:25.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 4 Realm: () 2024-09-12T00:53:25.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:25.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:25.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:25.668 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 zonegroup default 2024-09-12T00:53:25.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.668+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.669+0000 7f7991146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.669+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.669+0000 7f7991146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.669+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.670+0000 7f7991146800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.669 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.670+0000 7f7991146800 20 started sync module instance, tier type = 2024-09-12T00:53:25.670 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.670+0000 7f7991146800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:25.677 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.679+0000 7f7991146800 20 add_watcher() i=0 2024-09-12T00:53:25.677 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.679+0000 7f7991146800 20 add_watcher() i=1 2024-09-12T00:53:25.677 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.679+0000 7f7991146800 20 add_watcher() i=2 2024-09-12T00:53:25.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.679+0000 7f7991146800 20 add_watcher() i=3 2024-09-12T00:53:25.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.679+0000 7f7991146800 20 add_watcher() i=4 2024-09-12T00:53:25.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.679+0000 7f7991146800 20 add_watcher() i=5 2024-09-12T00:53:25.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.679+0000 7f7991146800 20 add_watcher() i=6 2024-09-12T00:53:25.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.679+0000 7f7991146800 20 add_watcher() i=7 2024-09-12T00:53:25.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.679+0000 7f7991146800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:25.679 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.681+0000 7f78457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:25.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.681+0000 7f7991146800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:25.680 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.681+0000 7f7991146800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:25.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.681+0000 7f7991146800 5 note: GC not initialized 2024-09-12T00:53:25.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.681+0000 7f77bffff640 20 reqs_thread_entry: start 2024-09-12T00:53:25.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.682+0000 7f7991146800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:25.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.682+0000 7f7991146800 20 Filter name: none 2024-09-12T00:53:25.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.682+0000 7f77bdffb640 20 reqs_thread_entry: start 2024-09-12T00:53:25.681 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.682+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.682+0000 7f7991146800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:25.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.682+0000 7f7991146800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:25.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:25.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:53:25.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 20 INFO: main: starting shard=0 2024-09-12T00:53:25.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:53:25.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:53:25.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:53:25.682 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 20 INFO: main: starting shard=1 2024-09-12T00:53:25.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:53:25.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:53:25.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.683+0000 7f7991146800 20 INFO: main: starting shard=2 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.684+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.684+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.684+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.684+0000 7f7991146800 20 INFO: main: starting shard=3 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.684+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.684+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.685+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.685+0000 7f7991146800 20 INFO: main: starting shard=4 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.685+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.685+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:53:25.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.685+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.685+0000 7f7991146800 20 INFO: main: starting shard=5 2024-09-12T00:53:25.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.685+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:53:25.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.685+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:53:25.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.686+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.686+0000 7f7991146800 20 INFO: main: starting shard=6 2024-09-12T00:53:25.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.686+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:53:25.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.686+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:53:25.687 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.686+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.686+0000 7f7991146800 20 INFO: main: starting shard=7 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.686+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.686+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.687+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.687+0000 7f7991146800 20 INFO: main: starting shard=8 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.687+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.687+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.687+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.687+0000 7f7991146800 20 INFO: main: starting shard=9 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.687+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.687+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:53:25.688 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.688+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.688+0000 7f7991146800 20 INFO: main: starting shard=10 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.688+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.688+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.688+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.688+0000 7f7991146800 20 INFO: main: starting shard=11 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.688+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.688+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.689+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.689+0000 7f7991146800 20 INFO: main: starting shard=12 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.689+0000 7f7991146800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.689+0000 7f7991146800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.689+0000 7f7991146800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:25.689 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.689+0000 7f7991146800 20 INFO: main: done 2024-09-12T00:53:25.690 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.690+0000 7f78457e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:25.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.692+0000 7f7991146800 20 remove_watcher() i=0 2024-09-12T00:53:25.691 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.692+0000 7f7991146800 2 removed watcher, disabling cache 2024-09-12T00:53:25.692 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.693+0000 7f7991146800 20 remove_watcher() i=1 2024-09-12T00:53:25.693 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.694+0000 7f7991146800 20 remove_watcher() i=2 2024-09-12T00:53:25.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.695+0000 7f7991146800 20 remove_watcher() i=3 2024-09-12T00:53:25.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.696+0000 7f7991146800 20 remove_watcher() i=4 2024-09-12T00:53:25.696 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.697+0000 7f7991146800 20 remove_watcher() i=5 2024-09-12T00:53:25.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.698+0000 7f7991146800 20 remove_watcher() i=6 2024-09-12T00:53:25.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.699+0000 7f7991146800 20 remove_watcher() i=7 2024-09-12T00:53:25.711 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:53:25.743 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:25.744 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:25.785 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.786+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.788+0000 7f8e19c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.788+0000 7f8e19c0f800 20 realm 2024-09-12T00:53:25.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.788+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.788+0000 7f8e19c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.788+0000 7f8e19c0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:25.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.788+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.788+0000 7f8e19c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:25.787 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.788+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.789+0000 7f8e19c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:25.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.789+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:25.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.789+0000 7f8e19c0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:25.788 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.789+0000 7f8e19c0f800 20 searching for the correct realm 2024-09-12T00:53:25.791 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.792+0000 7f8e16ef8640 0 -- 172.21.15.19:0/298224418 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f8e000daba0 msgr2=0x7f8e000e1140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:25.996 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:25.997+0000 7f8e17efa640 0 -- 172.21.15.19:0/298224418 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x563be4723910 msgr2=0x563be4725d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:26.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.001+0000 7f8e19c0f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:26.000 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.001+0000 7f8e19c0f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:26.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.001+0000 7f8e19c0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:26.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.001+0000 7f8e19c0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:26.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.001+0000 7f8e19c0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:26.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.001+0000 7f8e19c0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:26.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.001+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.001+0000 7f8e19c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.001+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:26.001 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:26.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 20 zone default found 2024-09-12T00:53:26.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 4 Realm: () 2024-09-12T00:53:26.002 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:26.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:26.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:26.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 20 zonegroup default 2024-09-12T00:53:26.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.002+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.003+0000 7f8e19c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.003+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.003+0000 7f8e19c0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.003+0000 7f8e19c0f800 20 started sync module instance, tier type = 2024-09-12T00:53:26.003 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.003+0000 7f8e19c0f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:26.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.012+0000 7f8e19c0f800 20 add_watcher() i=0 2024-09-12T00:53:26.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.012+0000 7f8e19c0f800 20 add_watcher() i=1 2024-09-12T00:53:26.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.012+0000 7f8e19c0f800 20 add_watcher() i=2 2024-09-12T00:53:26.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.012+0000 7f8e19c0f800 20 add_watcher() i=3 2024-09-12T00:53:26.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.012+0000 7f8e19c0f800 20 add_watcher() i=4 2024-09-12T00:53:26.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.012+0000 7f8e19c0f800 20 add_watcher() i=5 2024-09-12T00:53:26.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.012+0000 7f8e19c0f800 20 add_watcher() i=6 2024-09-12T00:53:26.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.013+0000 7f8e19c0f800 20 add_watcher() i=7 2024-09-12T00:53:26.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.013+0000 7f8e19c0f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:26.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.014+0000 7f8ccdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:26.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.015+0000 7f8e19c0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:26.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.015+0000 7f8e19c0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:26.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.015+0000 7f8e19c0f800 5 note: GC not initialized 2024-09-12T00:53:26.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.015+0000 7f8cccfe1640 20 reqs_thread_entry: start 2024-09-12T00:53:26.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.015+0000 7f8e19c0f800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:26.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.015+0000 7f8e19c0f800 20 Filter name: none 2024-09-12T00:53:26.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.015+0000 7f8c467fc640 20 reqs_thread_entry: start 2024-09-12T00:53:26.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.015+0000 7f8e19c0f800 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:53:26.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.015+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.016+0000 7f8e19c0f800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:26.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.016+0000 7f8e19c0f800 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:53:26.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.016+0000 7f8e19c0f800 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:53:26.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.016+0000 7f8e19c0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : miss 2024-09-12T00:53:26.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.016+0000 7f8e19c0f800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.016+0000 7f8e19c0f800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:26.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.016+0000 7f8e19c0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:53:26.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.016+0000 7f8e19c0f800 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:53:26.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.016+0000 7f8e19c0f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:26.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.016+0000 7f8e19c0f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:26.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.016+0000 7f8e19c0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:53:26.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.019+0000 7f8e19c0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:53:26.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.019+0000 7f8e19c0f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:53:26.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.019+0000 7f8e19c0f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:26.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.019+0000 7f8e19c0f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:53:26.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.020+0000 7f8cfa7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398985 cookie 94815235802224 notifier 7994 bl.length()=827 2024-09-12T00:53:26.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.020+0000 7f8cfa7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:53:26.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.020+0000 7f8cfa7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:53:26.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.020+0000 7f8cfa7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:26.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.021+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:53:26.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.021+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:53:26.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.021+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:53:26.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.021+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:53:26.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.027+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.0 2024-09-12T00:53:26.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.027+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.0 2024-09-12T00:53:26.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.027+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:53:26.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.027+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:53:26.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.027+0000 7f8e19c0f800 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:53:26.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.027+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:53:26.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.027+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:53:26.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.028+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:53:26.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.028+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:53:26.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.028+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:53:26.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.028+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:53:26.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.028+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:53:26.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.029+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:53:26.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.029+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:53:26.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.029+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:53:26.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.029+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:53:26.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.029+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:53:26.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.030+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:53:26.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.030+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:53:26.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.030+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:53:26.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.030+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:53:26.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.031+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:53:26.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.031+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:53:26.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.031+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:53:26.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.031+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:53:26.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.031+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:53:26.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.031+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:53:26.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.032+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:53:26.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.032+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:53:26.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.032+0000 7f8e19c0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:26.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.032+0000 7f8e19c0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:53:26.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.034+0000 7f8e19c0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:53:26.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.034+0000 7f8e19c0f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:53:26.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.034+0000 7f8e19c0f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:26.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.034+0000 7f8e19c0f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:53:26.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.034+0000 7f8cfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398986 cookie 94815235802224 notifier 7994 bl.length()=827 2024-09-12T00:53:26.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.034+0000 7f8cfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:53:26.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.034+0000 7f8cfaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:53:26.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.034+0000 7f8cfaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:26.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.035+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:53:26.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.035+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:53:26.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.035+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:53:26.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.035+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:53:26.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.038+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:53:26.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.038+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.0 2024-09-12T00:53:26.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.039+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:53:26.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.039+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.1 2024-09-12T00:53:26.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.039+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:53:26.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.039+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.2 2024-09-12T00:53:26.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.039+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:53:26.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.039+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.3 2024-09-12T00:53:26.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.040+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:53:26.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.040+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.4 2024-09-12T00:53:26.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.040+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:53:26.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.040+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.5 2024-09-12T00:53:26.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.040+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:53:26.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.040+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.6 2024-09-12T00:53:26.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.041+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:53:26.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.041+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.7 2024-09-12T00:53:26.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.041+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:53:26.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.041+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.8 2024-09-12T00:53:26.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.041+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:53:26.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.041+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.9 2024-09-12T00:53:26.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.042+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:53:26.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.042+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.10 2024-09-12T00:53:26.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.042+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:53:26.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.042+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.11 2024-09-12T00:53:26.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.042+0000 7f8e19c0f800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:53:26.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.042+0000 7f8e19c0f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.2.12 2024-09-12T00:53:26.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.043+0000 7f8e19c0f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:26.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.043+0000 7f8e19c0f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 2024-09-12T00:53:26.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.044+0000 7f8e19c0f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:53:26.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.044+0000 7f8e19c0f800 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:53:26.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.044+0000 7f8e19c0f800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:26.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.044+0000 7f8e19c0f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17, ofs0, ns] 2024-09-12T00:53:26.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.044+0000 7f8cfaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398987 cookie 94815235802224 notifier 7994 bl.length()=795 2024-09-12T00:53:26.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.044+0000 7f8cfaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 info.flags=0x17 2024-09-12T00:53:26.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.044+0000 7f8cfaffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17 to cache LRU end 2024-09-12T00:53:26.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.044+0000 7f8cfaffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:26.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.046+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_sources= new_sources= 2024-09-12T00:53:26.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.046+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential sources added=[] removed=[] 2024-09-12T00:53:26.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.046+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): orig_dests= new_dests= 2024-09-12T00:53:26.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.046+0000 7f8e19c0f800 20 handle_bi_update(): bucket=:a-bucket[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17]): potential dests added=[] removed=[] 2024-09-12T00:53:26.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.049+0000 7f8e19c0f800 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T00:53:26.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.051+0000 7f8ccdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:26.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.053+0000 7f8e19c0f800 20 remove_watcher() i=0 2024-09-12T00:53:26.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.053+0000 7f8e19c0f800 2 removed watcher, disabling cache 2024-09-12T00:53:26.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.054+0000 7f8e19c0f800 20 remove_watcher() i=1 2024-09-12T00:53:26.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.055+0000 7f8e19c0f800 20 remove_watcher() i=2 2024-09-12T00:53:26.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.056+0000 7f8e19c0f800 20 remove_watcher() i=3 2024-09-12T00:53:26.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.057+0000 7f8e19c0f800 20 remove_watcher() i=4 2024-09-12T00:53:26.057 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.058+0000 7f8e19c0f800 20 remove_watcher() i=5 2024-09-12T00:53:26.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.059+0000 7f8e19c0f800 20 remove_watcher() i=6 2024-09-12T00:53:26.059 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.060+0000 7f8e19c0f800 20 remove_watcher() i=7 2024-09-12T00:53:26.071 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:53:26.101 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:26.101 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:26.140 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.141+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.143+0000 7f0d3e80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.143+0000 7f0d3e80e800 20 realm 2024-09-12T00:53:26.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.143+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.143+0000 7f0d3e80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.143+0000 7f0d3e80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.144+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.144+0000 7f0d3e80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.144+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.145+0000 7f0d3e80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:26.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.145+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.145+0000 7f0d3e80e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:26.144 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.145+0000 7f0d3e80e800 20 searching for the correct realm 2024-09-12T00:53:26.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.148+0000 7f0d396ca640 0 -- 172.21.15.19:0/3582613294 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f0d30020070 msgr2=0x7f0d300169a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:26.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.354+0000 7f0d3a6cc640 0 -- 172.21.15.19:0/3582613294 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x555908746040 msgr2=0x555908748470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:26.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.358+0000 7f0d3e80e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:26.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.358+0000 7f0d3e80e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:26.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.358+0000 7f0d3e80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:26.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.358+0000 7f0d3e80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:26.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.358+0000 7f0d3e80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:26.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.358+0000 7f0d3e80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:26.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.358+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.358+0000 7f0d3e80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.358+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:26.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:26.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 20 zone default found 2024-09-12T00:53:26.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 4 Realm: () 2024-09-12T00:53:26.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:26.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:26.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:26.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 20 zonegroup default 2024-09-12T00:53:26.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.359+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.360+0000 7f0d3e80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.360+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.360+0000 7f0d3e80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.360+0000 7f0d3e80e800 20 started sync module instance, tier type = 2024-09-12T00:53:26.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.360+0000 7f0d3e80e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:26.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.368+0000 7f0d3e80e800 20 add_watcher() i=0 2024-09-12T00:53:26.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.369+0000 7f0d3e80e800 20 add_watcher() i=1 2024-09-12T00:53:26.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.369+0000 7f0d3e80e800 20 add_watcher() i=2 2024-09-12T00:53:26.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.369+0000 7f0d3e80e800 20 add_watcher() i=3 2024-09-12T00:53:26.367 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.369+0000 7f0d3e80e800 20 add_watcher() i=4 2024-09-12T00:53:26.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.369+0000 7f0d3e80e800 20 add_watcher() i=5 2024-09-12T00:53:26.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.369+0000 7f0d3e80e800 20 add_watcher() i=6 2024-09-12T00:53:26.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.370+0000 7f0d3e80e800 20 add_watcher() i=7 2024-09-12T00:53:26.368 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.370+0000 7f0d3e80e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:26.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.372+0000 7f0beb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:26.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.372+0000 7f0d3e80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:26.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.372+0000 7f0d3e80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:26.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.372+0000 7f0d3e80e800 5 note: GC not initialized 2024-09-12T00:53:26.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.372+0000 7f0bea7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:26.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.372+0000 7f0d3e80e800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:26.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.372+0000 7f0d3e80e800 20 Filter name: none 2024-09-12T00:53:26.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.372+0000 7f0b5bfff640 20 reqs_thread_entry: start 2024-09-12T00:53:26.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.373+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.372 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.373+0000 7f0d3e80e800 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:53:26.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.373+0000 7f0d3e80e800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.373+0000 7f0d3e80e800 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:53:26.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.373+0000 7f0d3e80e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:26.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.374+0000 7f0d3e80e800 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:53:26.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.374+0000 7f0d3e80e800 20 INFO: main: starting shard=0 2024-09-12T00:53:26.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.374+0000 7f0d3e80e800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.0 2024-09-12T00:53:26.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.374+0000 7f0d3e80e800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17.3.0 2024-09-12T00:53:26.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.374+0000 7f0d3e80e800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:26.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.374+0000 7f0d3e80e800 20 INFO: main: done 2024-09-12T00:53:26.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.375+0000 7f0beb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:26.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.377+0000 7f0d3e80e800 20 remove_watcher() i=0 2024-09-12T00:53:26.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.377+0000 7f0d3e80e800 2 removed watcher, disabling cache 2024-09-12T00:53:26.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.378+0000 7f0d3e80e800 20 remove_watcher() i=1 2024-09-12T00:53:26.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.379+0000 7f0d3e80e800 20 remove_watcher() i=2 2024-09-12T00:53:26.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.380+0000 7f0d3e80e800 20 remove_watcher() i=3 2024-09-12T00:53:26.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.381+0000 7f0d3e80e800 20 remove_watcher() i=4 2024-09-12T00:53:26.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.382+0000 7f0d3e80e800 20 remove_watcher() i=5 2024-09-12T00:53:26.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.383+0000 7f0d3e80e800 20 remove_watcher() i=6 2024-09-12T00:53:26.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.384+0000 7f0d3e80e800 20 remove_watcher() i=7 2024-09-12T00:53:26.395 INFO:tasks.workunit.client.0.smithi019.stderr: test: PUT succeeds during reshard 2024-09-12T00:53:26.396 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:53:26.426 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:26.426 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:26.464 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.466+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.468+0000 7fde64f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.468+0000 7fde64f31800 20 realm 2024-09-12T00:53:26.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.468+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.468+0000 7fde64f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.468+0000 7fde64f31800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:26.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.468+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.468+0000 7fde64f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.467 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.468+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.469+0000 7fde64f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:26.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.469+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.469+0000 7fde64f31800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:26.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.469+0000 7fde64f31800 20 searching for the correct realm 2024-09-12T00:53:26.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.473+0000 7fde60475640 0 -- 172.21.15.19:0/2317217163 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fde54068230 msgr2=0x7fde5407e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:26.678 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.679+0000 7fde61477640 0 -- 172.21.15.19:0/2317217163 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5575aaa13d00 msgr2=0x5575aaa161c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:26.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.684+0000 7fde64f31800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:26.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.684+0000 7fde64f31800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:26.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.684+0000 7fde64f31800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:26.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.684+0000 7fde64f31800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:26.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.684+0000 7fde64f31800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:26.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.684+0000 7fde64f31800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:26.683 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.684+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.684+0000 7fde64f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.684+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.684+0000 7fde64f31800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:26.684 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.684+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.685+0000 7fde64f31800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:26.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.685+0000 7fde64f31800 20 zone default found 2024-09-12T00:53:26.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.685+0000 7fde64f31800 4 Realm: () 2024-09-12T00:53:26.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.685+0000 7fde64f31800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:26.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.685+0000 7fde64f31800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:26.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.685+0000 7fde64f31800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:26.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.685+0000 7fde64f31800 20 zonegroup default 2024-09-12T00:53:26.685 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.685+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.685+0000 7fde64f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.685+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.686+0000 7fde64f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.686+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.686+0000 7fde64f31800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.686+0000 7fde64f31800 20 started sync module instance, tier type = 2024-09-12T00:53:26.686 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.686+0000 7fde64f31800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:26.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.695+0000 7fde64f31800 20 add_watcher() i=0 2024-09-12T00:53:26.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.695+0000 7fde64f31800 20 add_watcher() i=1 2024-09-12T00:53:26.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.695+0000 7fde64f31800 20 add_watcher() i=2 2024-09-12T00:53:26.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.695+0000 7fde64f31800 20 add_watcher() i=3 2024-09-12T00:53:26.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.695+0000 7fde64f31800 20 add_watcher() i=4 2024-09-12T00:53:26.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.695+0000 7fde64f31800 20 add_watcher() i=5 2024-09-12T00:53:26.694 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.695+0000 7fde64f31800 20 add_watcher() i=6 2024-09-12T00:53:26.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.696+0000 7fde64f31800 20 add_watcher() i=7 2024-09-12T00:53:26.695 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.696+0000 7fde64f31800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:26.696 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.698+0000 7fdd177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:26.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.698+0000 7fde64f31800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:26.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.698+0000 7fde64f31800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:26.697 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.698+0000 7fde64f31800 5 note: GC not initialized 2024-09-12T00:53:26.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.698+0000 7fdd167e4640 20 reqs_thread_entry: start 2024-09-12T00:53:26.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.699+0000 7fde64f31800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:26.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.699+0000 7fde64f31800 20 Filter name: none 2024-09-12T00:53:26.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.699+0000 7fdd0ffff640 20 reqs_thread_entry: start 2024-09-12T00:53:26.698 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.699+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.700+0000 7fde64f31800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:26.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.700+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.700+0000 7fde64f31800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:26.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.700+0000 7fde64f31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:26.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.700+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.701+0000 7fde64f31800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:26.699 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.701+0000 7fde64f31800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.701+0000 7fde64f31800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:26.700 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.701+0000 7fde64f31800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:26.701 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.703+0000 7fdd177e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:26.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.705+0000 7fde64f31800 20 remove_watcher() i=0 2024-09-12T00:53:26.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.705+0000 7fde64f31800 2 removed watcher, disabling cache 2024-09-12T00:53:26.704 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.706+0000 7fde64f31800 20 remove_watcher() i=1 2024-09-12T00:53:26.705 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.707+0000 7fde64f31800 20 remove_watcher() i=2 2024-09-12T00:53:26.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.708+0000 7fde64f31800 20 remove_watcher() i=3 2024-09-12T00:53:26.707 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.709+0000 7fde64f31800 20 remove_watcher() i=4 2024-09-12T00:53:26.708 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.710+0000 7fde64f31800 20 remove_watcher() i=5 2024-09-12T00:53:26.709 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.711+0000 7fde64f31800 20 remove_watcher() i=6 2024-09-12T00:53:26.710 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.712+0000 7fde64f31800 20 remove_watcher() i=7 2024-09-12T00:53:26.723 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:53:26.723 INFO:tasks.workunit.client.0.smithi019.stderr:BUCKET_STATS: 2024-09-12T00:53:26.723 INFO:tasks.workunit.client.0.smithi019.stderr:bucket: myver id: 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:53:26.723 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:53:26.725 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T00:53:26.759 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:26.760 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:26.799 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.800+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.802+0000 7fa8c1b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.802+0000 7fa8c1b0c800 20 realm 2024-09-12T00:53:26.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.802+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.802+0000 7fa8c1b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.802+0000 7fa8c1b0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:26.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.802+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.802+0000 7fa8c1b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:26.801 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.802+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.803+0000 7fa8c1b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:26.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.803+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:26.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.803+0000 7fa8c1b0c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:26.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.803+0000 7fa8c1b0c800 20 searching for the correct realm 2024-09-12T00:53:26.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:26.807+0000 7fa8bedf5640 0 -- 172.21.15.19:0/3842661041 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fa8a803e040 msgr2=0x7fa8a8031930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:27.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.013+0000 7fa8bfdf7640 0 -- 172.21.15.19:0/3842661041 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55e91fafe3a0 msgr2=0x55e91fb00820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:27.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.017+0000 7fa8c1b0c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:27.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.017+0000 7fa8c1b0c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:27.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.017+0000 7fa8c1b0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:27.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.017+0000 7fa8c1b0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:27.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.017+0000 7fa8c1b0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:27.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.017+0000 7fa8c1b0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:27.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.017+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:27.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:27.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 20 zone default found 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 4 Realm: () 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 20 zonegroup default 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.018+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.019+0000 7fa8c1b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.019+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:27.018 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.019+0000 7fa8c1b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:27.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.019+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:27.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.019+0000 7fa8c1b0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:27.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.019+0000 7fa8c1b0c800 20 started sync module instance, tier type = 2024-09-12T00:53:27.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.019+0000 7fa8c1b0c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:27.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.029+0000 7fa8c1b0c800 20 add_watcher() i=0 2024-09-12T00:53:27.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.029+0000 7fa8c1b0c800 20 add_watcher() i=1 2024-09-12T00:53:27.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.029+0000 7fa8c1b0c800 20 add_watcher() i=2 2024-09-12T00:53:27.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.029+0000 7fa8c1b0c800 20 add_watcher() i=3 2024-09-12T00:53:27.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.029+0000 7fa8c1b0c800 20 add_watcher() i=4 2024-09-12T00:53:27.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.029+0000 7fa8c1b0c800 20 add_watcher() i=5 2024-09-12T00:53:27.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.029+0000 7fa8c1b0c800 20 add_watcher() i=6 2024-09-12T00:53:27.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.030+0000 7fa8c1b0c800 20 add_watcher() i=7 2024-09-12T00:53:27.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.030+0000 7fa8c1b0c800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:27.030 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.032+0000 7fa775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:27.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.032+0000 7fa8c1b0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:27.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.032+0000 7fa8c1b0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:27.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.032+0000 7fa8c1b0c800 5 note: GC not initialized 2024-09-12T00:53:27.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.032+0000 7fa774fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:27.031 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.032+0000 7fa8c1b0c800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:27.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.032+0000 7fa8c1b0c800 20 Filter name: none 2024-09-12T00:53:27.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.033+0000 7fa6ee7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:27.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.033+0000 7fa8c1b0c800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:53:27.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.033+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:27.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.033+0000 7fa8c1b0c800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:27.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.033+0000 7fa8c1b0c800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:53:27.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.033+0000 7fa8c1b0c800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:53:27.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.033+0000 7fa8c1b0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 : miss 2024-09-12T00:53:27.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.033+0000 7fa8c1b0c800 20 rados->read ofs=0 len=0 2024-09-12T00:53:27.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.034+0000 7fa8c1b0c800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:27.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.034+0000 7fa8c1b0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:27.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.034+0000 7fa8c1b0c800 10 adding default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:27.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.034+0000 7fa8c1b0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:27.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.034+0000 7fa8c1b0c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:27.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.034+0000 7fa8c1b0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 2024-09-12T00:53:27.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.038+0000 7fa8c1b0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:27.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.038+0000 7fa8c1b0c800 10 moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:27.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.038+0000 7fa8c1b0c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:27.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.038+0000 7fa8c1b0c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18, ofs0, ns] 2024-09-12T00:53:27.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.039+0000 7fa7a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398894 cookie 94459747418144 notifier 8613 bl.length()=821 2024-09-12T00:53:27.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.039+0000 7fa7a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:27.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.039+0000 7fa7a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:27.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.039+0000 7fa7a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:27.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.041+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_sources= new_sources= 2024-09-12T00:53:27.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.041+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential sources added=[] removed=[] 2024-09-12T00:53:27.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.041+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_dests= new_dests= 2024-09-12T00:53:27.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.041+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential dests added=[] removed=[] 2024-09-12T00:53:27.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:27.046+0000 7fa8c1b0c800 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:53:27.728 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:27.729 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:27.794 INFO:tasks.workunit.client.0.smithi019.stderr:put object successful 2024-09-12T00:53:32.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:32.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:32.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.0 2024-09-12T00:53:32.047 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.046+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.0 2024-09-12T00:53:32.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.047+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.1 2024-09-12T00:53:32.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.047+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.1 2024-09-12T00:53:32.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.048+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.2 2024-09-12T00:53:32.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.048+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.2 2024-09-12T00:53:32.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.048+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.3 2024-09-12T00:53:32.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.048+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.3 2024-09-12T00:53:32.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.049+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.4 2024-09-12T00:53:32.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.049+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.4 2024-09-12T00:53:32.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.050+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.5 2024-09-12T00:53:32.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.050+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.5 2024-09-12T00:53:32.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.051+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.6 2024-09-12T00:53:32.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.051+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.6 2024-09-12T00:53:32.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.052+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.7 2024-09-12T00:53:32.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.052+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.7 2024-09-12T00:53:32.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.052+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.8 2024-09-12T00:53:32.051 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.052+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.8 2024-09-12T00:53:32.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.053+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.9 2024-09-12T00:53:32.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.053+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.9 2024-09-12T00:53:32.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.054+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.10 2024-09-12T00:53:32.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.054+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.10 2024-09-12T00:53:32.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.057+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.11 2024-09-12T00:53:32.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.057+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.11 2024-09-12T00:53:32.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.059+0000 7fa8c1b0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:32.058 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.059+0000 7fa8c1b0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 2024-09-12T00:53:32.060 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.062+0000 7fa8c1b0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:32.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.062+0000 7fa8c1b0c800 10 moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:32.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.062+0000 7fa8c1b0c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:32.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.062+0000 7fa8c1b0c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18, ofs0, ns] 2024-09-12T00:53:32.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.062+0000 7fa7a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398895 cookie 94459747418144 notifier 8613 bl.length()=821 2024-09-12T00:53:32.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.062+0000 7fa7a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:32.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.062+0000 7fa7a27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:32.061 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.062+0000 7fa7a27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:32.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.064+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_sources= new_sources= 2024-09-12T00:53:32.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.064+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential sources added=[] removed=[] 2024-09-12T00:53:32.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.064+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_dests= new_dests= 2024-09-12T00:53:32.063 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.064+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential dests added=[] removed=[] 2024-09-12T00:53:32.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.068+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.0 2024-09-12T00:53:32.066 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.068+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.0 2024-09-12T00:53:32.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.068+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.1 2024-09-12T00:53:32.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.068+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.1 2024-09-12T00:53:32.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.069+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.2 2024-09-12T00:53:32.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.069+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.2 2024-09-12T00:53:32.067 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.069+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.3 2024-09-12T00:53:32.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.069+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.3 2024-09-12T00:53:32.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.069+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.4 2024-09-12T00:53:32.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.069+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.4 2024-09-12T00:53:32.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.070+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.5 2024-09-12T00:53:32.068 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.070+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.5 2024-09-12T00:53:32.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.070+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.6 2024-09-12T00:53:32.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.070+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.6 2024-09-12T00:53:32.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.071+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.7 2024-09-12T00:53:32.069 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.071+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.7 2024-09-12T00:53:32.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.071+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.8 2024-09-12T00:53:32.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.071+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.8 2024-09-12T00:53:32.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.072+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.9 2024-09-12T00:53:32.070 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.072+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.9 2024-09-12T00:53:32.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.072+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.10 2024-09-12T00:53:32.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.072+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.10 2024-09-12T00:53:32.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.073+0000 7fa8c1b0c800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.11 2024-09-12T00:53:32.071 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.073+0000 7fa8c1b0c800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.1.11 2024-09-12T00:53:32.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.075+0000 7fa8c1b0c800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:32.073 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.075+0000 7fa8c1b0c800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 2024-09-12T00:53:32.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.077+0000 7fa8c1b0c800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:32.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.077+0000 7fa8c1b0c800 10 moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:32.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.077+0000 7fa8c1b0c800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:32.075 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.077+0000 7fa8c1b0c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18, ofs0, ns] 2024-09-12T00:53:32.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.077+0000 7fa7a2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398896 cookie 94459747418144 notifier 8613 bl.length()=789 2024-09-12T00:53:32.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.077+0000 7fa7a2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:32.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.077+0000 7fa7a2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:32.076 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.077+0000 7fa7a2ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:32.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.079+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_sources= new_sources= 2024-09-12T00:53:32.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.079+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential sources added=[] removed=[] 2024-09-12T00:53:32.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.079+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_dests= new_dests= 2024-09-12T00:53:32.077 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.079+0000 7fa8c1b0c800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential dests added=[] removed=[] 2024-09-12T00:53:32.081 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.082+0000 7fa8c1b0c800 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T00:53:32.083 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.085+0000 7fa775fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:32.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.088+0000 7fa8c1b0c800 20 remove_watcher() i=0 2024-09-12T00:53:32.087 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.088+0000 7fa8c1b0c800 2 removed watcher, disabling cache 2024-09-12T00:53:32.088 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.089+0000 7fa8c1b0c800 20 remove_watcher() i=1 2024-09-12T00:53:32.089 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.091+0000 7fa8c1b0c800 20 remove_watcher() i=2 2024-09-12T00:53:32.090 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.092+0000 7fa8c1b0c800 20 remove_watcher() i=3 2024-09-12T00:53:32.091 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.093+0000 7fa8c1b0c800 20 remove_watcher() i=4 2024-09-12T00:53:32.093 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.094+0000 7fa8c1b0c800 20 remove_watcher() i=5 2024-09-12T00:53:32.094 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.096+0000 7fa8c1b0c800 20 remove_watcher() i=6 2024-09-12T00:53:32.095 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:32.097+0000 7fa8c1b0c800 20 remove_watcher() i=7 2024-09-12T00:53:32.799 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:53:32.799 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T00:53:32.802 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:32.802 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:32.843 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:32.843 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:32.905 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:32.905 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:32.957 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:32.957 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:32.982 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:32.982 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:33.034 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:33.034 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:33.059 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:33.059 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:33.116 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:33.116 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:33.142 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:53:33.561 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:53:34.974 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:34.974 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:35.060 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:53:35.061 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:53:35.096 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:35.096 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:35.139 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.141+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.143+0000 7efc4b612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.143+0000 7efc4b612800 20 realm 2024-09-12T00:53:35.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.143+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.143+0000 7efc4b612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.143+0000 7efc4b612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:35.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.143+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.143+0000 7efc4b612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.142 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.143+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.144+0000 7efc4b612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:35.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.144+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.144+0000 7efc4b612800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:35.143 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.144+0000 7efc4b612800 20 searching for the correct realm 2024-09-12T00:53:35.146 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.148+0000 7efc3e4ca640 0 -- 172.21.15.19:0/2903519931 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7efc3005f2f0 msgr2=0x7efc300962d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:35.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.355+0000 7efc474cc640 0 -- 172.21.15.19:0/2903519931 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x56297c9dc6e0 msgr2=0x56297c9deaf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:35.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.359+0000 7efc4b612800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:35.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.359+0000 7efc4b612800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:35.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.359+0000 7efc4b612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:35.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.359+0000 7efc4b612800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:35.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.359+0000 7efc4b612800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:35.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.359+0000 7efc4b612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:35.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.359+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:35.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:35.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 20 zone default found 2024-09-12T00:53:35.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 4 Realm: () 2024-09-12T00:53:35.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:35.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:35.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:35.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 20 zonegroup default 2024-09-12T00:53:35.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.360+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.361+0000 7efc4b612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.361+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.361+0000 7efc4b612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.361+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.361+0000 7efc4b612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.361+0000 7efc4b612800 20 started sync module instance, tier type = 2024-09-12T00:53:35.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.361+0000 7efc4b612800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:35.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.371+0000 7efc4b612800 20 add_watcher() i=0 2024-09-12T00:53:35.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.371+0000 7efc4b612800 20 add_watcher() i=1 2024-09-12T00:53:35.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.371+0000 7efc4b612800 20 add_watcher() i=2 2024-09-12T00:53:35.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.371+0000 7efc4b612800 20 add_watcher() i=3 2024-09-12T00:53:35.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.371+0000 7efc4b612800 20 add_watcher() i=4 2024-09-12T00:53:35.370 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.371+0000 7efc4b612800 20 add_watcher() i=5 2024-09-12T00:53:35.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.371+0000 7efc4b612800 20 add_watcher() i=6 2024-09-12T00:53:35.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.373+0000 7efc4b612800 20 add_watcher() i=7 2024-09-12T00:53:35.371 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.373+0000 7efc4b612800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:35.373 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.374+0000 7efafd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:35.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.375+0000 7efc4b612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:35.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.375+0000 7efc4b612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:35.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.375+0000 7efc4b612800 5 note: GC not initialized 2024-09-12T00:53:35.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.375+0000 7efa77fff640 20 reqs_thread_entry: start 2024-09-12T00:53:35.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.375+0000 7efc4b612800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:35.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.375+0000 7efc4b612800 20 Filter name: none 2024-09-12T00:53:35.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.375+0000 7efa75ffb640 20 reqs_thread_entry: start 2024-09-12T00:53:35.374 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.375+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.376+0000 7efc4b612800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:35.375 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.376+0000 7efc4b612800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.377+0000 7efc4b612800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:35.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.377+0000 7efc4b612800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:35.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.377+0000 7efc4b612800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:53:35.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.377+0000 7efc4b612800 20 INFO: main: starting shard=0 2024-09-12T00:53:35.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.377+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:35.376 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.377+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:35.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.377+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.377+0000 7efc4b612800 20 INFO: main: starting shard=1 2024-09-12T00:53:35.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.377+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:35.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.377+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:35.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.378+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.378+0000 7efc4b612800 20 INFO: main: starting shard=2 2024-09-12T00:53:35.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.378+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:35.377 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.378+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:35.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.379+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.379+0000 7efc4b612800 20 INFO: main: starting shard=3 2024-09-12T00:53:35.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.379+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:35.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.379+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:35.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.379+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.379+0000 7efc4b612800 20 INFO: main: starting shard=4 2024-09-12T00:53:35.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.379+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:35.378 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.379+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:35.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.380+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.380+0000 7efc4b612800 20 INFO: main: starting shard=5 2024-09-12T00:53:35.379 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.380+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:35.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.380+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:35.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.381+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:53:35.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.381+0000 7efc4b612800 20 INFO: main: starting shard=6 2024-09-12T00:53:35.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.381+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:35.380 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.381+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:35.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.381+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.381+0000 7efc4b612800 20 INFO: main: starting shard=7 2024-09-12T00:53:35.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.381+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:35.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.381+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:35.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.382+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.382+0000 7efc4b612800 20 INFO: main: starting shard=8 2024-09-12T00:53:35.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.382+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:35.381 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.382+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:35.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.382+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.382+0000 7efc4b612800 20 INFO: main: starting shard=9 2024-09-12T00:53:35.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.382+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:35.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.382+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:35.382 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.383+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.383+0000 7efc4b612800 20 INFO: main: starting shard=10 2024-09-12T00:53:35.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.383+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:35.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.383+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:35.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.384+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.383 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.384+0000 7efc4b612800 20 INFO: main: starting shard=11 2024-09-12T00:53:35.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.384+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:35.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.384+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:35.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.385+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.385+0000 7efc4b612800 20 INFO: main: starting shard=12 2024-09-12T00:53:35.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.385+0000 7efc4b612800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:35.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.385+0000 7efc4b612800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:35.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.385+0000 7efc4b612800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.384 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.385+0000 7efc4b612800 20 INFO: main: done 2024-09-12T00:53:35.385 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.386+0000 7efafd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:35.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.389+0000 7efc4b612800 20 remove_watcher() i=0 2024-09-12T00:53:35.387 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.389+0000 7efc4b612800 2 removed watcher, disabling cache 2024-09-12T00:53:35.389 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.390+0000 7efc4b612800 20 remove_watcher() i=1 2024-09-12T00:53:35.390 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.391+0000 7efc4b612800 20 remove_watcher() i=2 2024-09-12T00:53:35.391 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.392+0000 7efc4b612800 20 remove_watcher() i=3 2024-09-12T00:53:35.392 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.393+0000 7efc4b612800 20 remove_watcher() i=4 2024-09-12T00:53:35.393 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.394+0000 7efc4b612800 20 remove_watcher() i=5 2024-09-12T00:53:35.394 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.395+0000 7efc4b612800 20 remove_watcher() i=6 2024-09-12T00:53:35.395 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.397+0000 7efc4b612800 20 remove_watcher() i=7 2024-09-12T00:53:35.410 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:35.410 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:35.436 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:35.437 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:35.517 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:53:35.518 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:53:35.551 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:35.551 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:35.590 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.591+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.593+0000 7f7f62944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.593+0000 7f7f62944800 20 realm 2024-09-12T00:53:35.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.593+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.593+0000 7f7f62944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.593+0000 7f7f62944800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:35.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.593+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.593+0000 7f7f62944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.592 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.593+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.594+0000 7f7f62944800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:35.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.594+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.595+0000 7f7f62944800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:35.593 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.595+0000 7f7f62944800 20 searching for the correct realm 2024-09-12T00:53:35.597 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.598+0000 7f7f5def3640 0 -- 172.21.15.19:0/241437932 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f7f540869a0 msgr2=0x7f7f54096220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:35.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.803+0000 7f7f5eef5640 0 -- 172.21.15.19:0/241437932 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55c97f3f6c30 msgr2=0x55c97f3f9020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:35.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.808+0000 7f7f62944800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:35.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.808+0000 7f7f62944800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:35.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.808+0000 7f7f62944800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:35.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.808+0000 7f7f62944800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:35.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.808+0000 7f7f62944800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:35.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.808+0000 7f7f62944800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:35.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.808+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.808+0000 7f7f62944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.807 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.808+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.808+0000 7f7f62944800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:35.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.808+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:35.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 20 zone default found 2024-09-12T00:53:35.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 4 Realm: () 2024-09-12T00:53:35.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:35.808 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:35.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:35.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 20 zonegroup default 2024-09-12T00:53:35.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.809+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.809 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.810+0000 7f7f62944800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:35.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.810+0000 7f7f62944800 20 started sync module instance, tier type = 2024-09-12T00:53:35.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.810+0000 7f7f62944800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:35.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.820+0000 7f7f62944800 20 add_watcher() i=0 2024-09-12T00:53:35.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.820+0000 7f7f62944800 20 add_watcher() i=1 2024-09-12T00:53:35.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.820+0000 7f7f62944800 20 add_watcher() i=2 2024-09-12T00:53:35.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.820+0000 7f7f62944800 20 add_watcher() i=3 2024-09-12T00:53:35.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.820+0000 7f7f62944800 20 add_watcher() i=4 2024-09-12T00:53:35.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.820+0000 7f7f62944800 20 add_watcher() i=5 2024-09-12T00:53:35.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.820+0000 7f7f62944800 20 add_watcher() i=6 2024-09-12T00:53:35.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.821+0000 7f7f62944800 20 add_watcher() i=7 2024-09-12T00:53:35.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.821+0000 7f7f62944800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:35.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.822+0000 7f7e14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:35.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.823+0000 7f7f62944800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:35.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.823+0000 7f7f62944800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:35.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.823+0000 7f7f62944800 5 note: GC not initialized 2024-09-12T00:53:35.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.823+0000 7f7d8f7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:35.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.823+0000 7f7f62944800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:35.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.823+0000 7f7f62944800 20 Filter name: none 2024-09-12T00:53:35.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.823+0000 7f7d8d7fa640 20 reqs_thread_entry: start 2024-09-12T00:53:35.822 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.823+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.824+0000 7f7f62944800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:35.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.824+0000 7f7f62944800 20 rados->read ofs=0 len=0 2024-09-12T00:53:35.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.824+0000 7f7f62944800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:35.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.824+0000 7f7f62944800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:35.823 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.824+0000 7f7f62944800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:53:35.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.824+0000 7f7f62944800 20 INFO: main: starting shard=0 2024-09-12T00:53:35.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.824+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:35.824 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.824+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:35.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.825+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.825+0000 7f7f62944800 20 INFO: main: starting shard=1 2024-09-12T00:53:35.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.825+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:35.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.825+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:35.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.826+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.826+0000 7f7f62944800 20 INFO: main: starting shard=2 2024-09-12T00:53:35.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.826+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:35.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.826+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:35.825 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.826+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.826+0000 7f7f62944800 20 INFO: main: starting shard=3 2024-09-12T00:53:35.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.826+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:35.826 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.826+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:35.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.827+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.827+0000 7f7f62944800 20 INFO: main: starting shard=4 2024-09-12T00:53:35.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.827+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:35.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.827+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:35.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.827+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.827+0000 7f7f62944800 20 INFO: main: starting shard=5 2024-09-12T00:53:35.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.827+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:35.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.827+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:35.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.828+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.828+0000 7f7f62944800 20 INFO: main: starting shard=6 2024-09-12T00:53:35.827 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.828+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:35.828 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.828+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:35.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.828+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.828+0000 7f7f62944800 20 INFO: main: starting shard=7 2024-09-12T00:53:35.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.828+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:35.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.828+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.829+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.829+0000 7f7f62944800 20 INFO: main: starting shard=8 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.829+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.829+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.829+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.829+0000 7f7f62944800 20 INFO: main: starting shard=9 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.829+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.829+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.830+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.830+0000 7f7f62944800 20 INFO: main: starting shard=10 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.830+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.830+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:35.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.830+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.830+0000 7f7f62944800 20 INFO: main: starting shard=11 2024-09-12T00:53:35.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.830+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:35.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.830+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:35.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.831+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.831 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.831+0000 7f7f62944800 20 INFO: main: starting shard=12 2024-09-12T00:53:35.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.831+0000 7f7f62944800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:35.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.831+0000 7f7f62944800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:35.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.831+0000 7f7f62944800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:35.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.831+0000 7f7f62944800 20 INFO: main: done 2024-09-12T00:53:35.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.832+0000 7f7e14fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:35.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.835+0000 7f7f62944800 20 remove_watcher() i=0 2024-09-12T00:53:35.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.835+0000 7f7f62944800 2 removed watcher, disabling cache 2024-09-12T00:53:35.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.836+0000 7f7f62944800 20 remove_watcher() i=1 2024-09-12T00:53:35.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.837+0000 7f7f62944800 20 remove_watcher() i=2 2024-09-12T00:53:35.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.838+0000 7f7f62944800 20 remove_watcher() i=3 2024-09-12T00:53:35.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.839+0000 7f7f62944800 20 remove_watcher() i=4 2024-09-12T00:53:35.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.840+0000 7f7f62944800 20 remove_watcher() i=5 2024-09-12T00:53:35.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.841+0000 7f7f62944800 20 remove_watcher() i=6 2024-09-12T00:53:35.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:35.842+0000 7f7f62944800 20 remove_watcher() i=7 2024-09-12T00:53:35.855 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:35.855 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:35.880 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:35.880 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:35.961 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:53:35.962 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:53:35.994 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:35.994 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:36.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.033+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.035+0000 7ff1e7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:36.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.035+0000 7ff1e7919800 20 realm 2024-09-12T00:53:36.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.035+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.036+0000 7ff1e7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:36.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.036+0000 7ff1e7919800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:36.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.036+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.036+0000 7ff1e7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:36.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.036+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.037+0000 7ff1e7919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:36.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.037+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.037+0000 7ff1e7919800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:36.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.037+0000 7ff1e7919800 20 searching for the correct realm 2024-09-12T00:53:36.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.040+0000 7ff1e4c09640 0 -- 172.21.15.19:0/2094273363 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7ff1dc026400 msgr2=0x7ff1dc026860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:36.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.246+0000 7ff1e540a640 0 -- 172.21.15.19:0/2094273363 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7ff1e003c960 msgr2=0x7ff1e003a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:36.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.454+0000 7ff1e7919800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:36.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.454+0000 7ff1e7919800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:36.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.454+0000 7ff1e7919800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:36.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.454+0000 7ff1e7919800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:36.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.454+0000 7ff1e7919800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:36.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.454+0000 7ff1e7919800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:36.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.454+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.454+0000 7ff1e7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:36.453 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.454+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.454+0000 7ff1e7919800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:36.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.454+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.455+0000 7ff1e7919800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:36.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.455+0000 7ff1e7919800 20 zone default found 2024-09-12T00:53:36.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.455+0000 7ff1e7919800 4 Realm: () 2024-09-12T00:53:36.454 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.455+0000 7ff1e7919800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:36.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.455+0000 7ff1e7919800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:36.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.455+0000 7ff1e7919800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:36.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.455+0000 7ff1e7919800 20 zonegroup default 2024-09-12T00:53:36.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.455+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.455+0000 7ff1e7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:36.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.455+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.456+0000 7ff1e7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:36.455 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.456+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.456+0000 7ff1e7919800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:36.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.456+0000 7ff1e7919800 20 started sync module instance, tier type = 2024-09-12T00:53:36.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.456+0000 7ff1e7919800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:36.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.467+0000 7ff1e7919800 20 add_watcher() i=0 2024-09-12T00:53:36.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.467+0000 7ff1e7919800 20 add_watcher() i=1 2024-09-12T00:53:36.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.467+0000 7ff1e7919800 20 add_watcher() i=2 2024-09-12T00:53:36.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.467+0000 7ff1e7919800 20 add_watcher() i=3 2024-09-12T00:53:36.465 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.467+0000 7ff1e7919800 20 add_watcher() i=4 2024-09-12T00:53:36.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.467+0000 7ff1e7919800 20 add_watcher() i=5 2024-09-12T00:53:36.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.467+0000 7ff1e7919800 20 add_watcher() i=6 2024-09-12T00:53:36.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.468+0000 7ff1e7919800 20 add_watcher() i=7 2024-09-12T00:53:36.466 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.468+0000 7ff1e7919800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:36.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.470+0000 7ff09b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:36.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.470+0000 7ff1e7919800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:36.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.470+0000 7ff1e7919800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:36.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.470+0000 7ff1e7919800 5 note: GC not initialized 2024-09-12T00:53:36.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.470+0000 7ff09a7e4640 20 reqs_thread_entry: start 2024-09-12T00:53:36.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.471+0000 7ff1e7919800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:36.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.471+0000 7ff1e7919800 20 Filter name: none 2024-09-12T00:53:36.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.471+0000 7ff00bfff640 20 reqs_thread_entry: start 2024-09-12T00:53:36.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.471+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.471+0000 7ff1e7919800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:36.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.471+0000 7ff1e7919800 20 rados->read ofs=0 len=0 2024-09-12T00:53:36.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.472+0000 7ff1e7919800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:36.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.472+0000 7ff1e7919800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:36.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.472+0000 7ff1e7919800 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:53:36.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.472+0000 7ff1e7919800 20 INFO: main: starting shard=0 2024-09-12T00:53:36.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.472+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:36.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.472+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:36.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.472+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:53:36.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.472+0000 7ff1e7919800 20 INFO: main: starting shard=1 2024-09-12T00:53:36.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.472+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:36.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.472+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:36.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.473+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.473+0000 7ff1e7919800 20 INFO: main: starting shard=2 2024-09-12T00:53:36.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.473+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:36.472 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.473+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:36.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.473+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.473+0000 7ff1e7919800 20 INFO: main: starting shard=3 2024-09-12T00:53:36.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.473+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:36.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.473+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:36.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.474+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.474+0000 7ff1e7919800 20 INFO: main: starting shard=4 2024-09-12T00:53:36.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.474+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:36.473 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.474+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:36.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.475+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.475+0000 7ff1e7919800 20 INFO: main: starting shard=5 2024-09-12T00:53:36.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.475+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:36.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.475+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:36.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.475+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.475+0000 7ff1e7919800 20 INFO: main: starting shard=6 2024-09-12T00:53:36.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.475+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:36.474 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.475+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:36.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.476+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.476+0000 7ff1e7919800 20 INFO: main: starting shard=7 2024-09-12T00:53:36.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.476+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:36.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.476+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:36.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.476+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.476+0000 7ff1e7919800 20 INFO: main: starting shard=8 2024-09-12T00:53:36.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.476+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:36.475 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.476+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:36.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.477+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.477+0000 7ff1e7919800 20 INFO: main: starting shard=9 2024-09-12T00:53:36.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.477+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:36.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.477+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:36.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.477+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.477+0000 7ff1e7919800 20 INFO: main: starting shard=10 2024-09-12T00:53:36.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.477+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:36.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.477+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:36.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.478+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.478+0000 7ff1e7919800 20 INFO: main: starting shard=11 2024-09-12T00:53:36.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.478+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:36.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.478+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:36.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.478+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.478+0000 7ff1e7919800 20 INFO: main: starting shard=12 2024-09-12T00:53:36.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.478+0000 7ff1e7919800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:36.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.478+0000 7ff1e7919800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:36.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.479+0000 7ff1e7919800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:53:36.478 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.479+0000 7ff1e7919800 20 INFO: main: done 2024-09-12T00:53:36.479 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.480+0000 7ff09b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:36.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.483+0000 7ff1e7919800 20 remove_watcher() i=0 2024-09-12T00:53:36.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.483+0000 7ff1e7919800 2 removed watcher, disabling cache 2024-09-12T00:53:36.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.484+0000 7ff1e7919800 20 remove_watcher() i=1 2024-09-12T00:53:36.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.485+0000 7ff1e7919800 20 remove_watcher() i=2 2024-09-12T00:53:36.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.486+0000 7ff1e7919800 20 remove_watcher() i=3 2024-09-12T00:53:36.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.487+0000 7ff1e7919800 20 remove_watcher() i=4 2024-09-12T00:53:36.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.488+0000 7ff1e7919800 20 remove_watcher() i=5 2024-09-12T00:53:36.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.490+0000 7ff1e7919800 20 remove_watcher() i=6 2024-09-12T00:53:36.489 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:36.491+0000 7ff1e7919800 20 remove_watcher() i=7 2024-09-12T00:53:36.503 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:36.504 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:36.529 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:53:36.943 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:53:37.356 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:53:37.389 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:37.389 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:37.429 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.430+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.431 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.432+0000 7f2be3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.432+0000 7f2be3b25800 20 realm 2024-09-12T00:53:37.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.432+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.432+0000 7f2be3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.432+0000 7f2be3b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:37.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.432+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.433+0000 7f2be3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.432 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.433+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.433+0000 7f2be3b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:37.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.434+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.434+0000 7f2be3b25800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:37.433 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.434+0000 7f2be3b25800 20 searching for the correct realm 2024-09-12T00:53:37.437 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.438+0000 7f2bdef32640 0 -- 172.21.15.19:0/623049809 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f2bd40963d0 msgr2=0x7f2bd4096850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:37.440 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.441+0000 7f2bdf733640 0 -- 172.21.15.19:0/623049809 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f2bd8017020 msgr2=0x7f2bd8065060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:37.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.446+0000 7f2be3b25800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:37.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.446+0000 7f2be3b25800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:37.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.446+0000 7f2be3b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:37.445 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.446+0000 7f2be3b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:37.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.446+0000 7f2be3b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:37.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.446+0000 7f2be3b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:37.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.446+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.446 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:37.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:37.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 20 zone default found 2024-09-12T00:53:37.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 4 Realm: () 2024-09-12T00:53:37.447 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:37.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:37.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:37.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 20 zonegroup default 2024-09-12T00:53:37.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.447+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.448+0000 7f2be3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.448+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.448+0000 7f2be3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.448+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.448+0000 7f2be3b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.448+0000 7f2be3b25800 20 started sync module instance, tier type = 2024-09-12T00:53:37.448 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.448+0000 7f2be3b25800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:37.456 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.458+0000 7f2be3b25800 20 add_watcher() i=0 2024-09-12T00:53:37.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.458+0000 7f2be3b25800 20 add_watcher() i=1 2024-09-12T00:53:37.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.458+0000 7f2be3b25800 20 add_watcher() i=2 2024-09-12T00:53:37.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.458+0000 7f2be3b25800 20 add_watcher() i=3 2024-09-12T00:53:37.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.458+0000 7f2be3b25800 20 add_watcher() i=4 2024-09-12T00:53:37.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.458+0000 7f2be3b25800 20 add_watcher() i=5 2024-09-12T00:53:37.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.458+0000 7f2be3b25800 20 add_watcher() i=6 2024-09-12T00:53:37.457 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.459+0000 7f2be3b25800 20 add_watcher() i=7 2024-09-12T00:53:37.458 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.459+0000 7f2be3b25800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:37.460 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.461+0000 7f2a95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:37.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.462+0000 7f2be3b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:37.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.462+0000 7f2be3b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:37.461 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.462+0000 7f2be3b25800 5 note: GC not initialized 2024-09-12T00:53:37.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.462+0000 7f2a94fe1640 20 reqs_thread_entry: start 2024-09-12T00:53:37.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.462+0000 7f2be3b25800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:37.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.462+0000 7f2be3b25800 20 Filter name: none 2024-09-12T00:53:37.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.462+0000 7f2a0e7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:37.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.462+0000 7f2be3b25800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:53:37.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.462+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.463+0000 7f2be3b25800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:37.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.463+0000 7f2be3b25800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:53:37.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.463+0000 7f2be3b25800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:53:37.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.463+0000 7f2be3b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 : miss 2024-09-12T00:53:37.462 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.463+0000 7f2be3b25800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.463+0000 7f2be3b25800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:37.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.463+0000 7f2be3b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:37.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.463+0000 7f2be3b25800 10 adding default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:37.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.463+0000 7f2be3b25800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:37.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.463+0000 7f2be3b25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:37.463 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.463+0000 7f2be3b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 2024-09-12T00:53:37.468 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.470+0000 7f2be3b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:37.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.470+0000 7f2be3b25800 10 moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:37.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.470+0000 7f2be3b25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:37.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.470+0000 7f2be3b25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18, ofs0, ns] 2024-09-12T00:53:37.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.470+0000 7f2ac27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398897 cookie 94452972022864 notifier 8718 bl.length()=821 2024-09-12T00:53:37.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.470+0000 7f2ac27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:37.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.470+0000 7f2ac27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:37.469 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.470+0000 7f2ac27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:37.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.472+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_sources= new_sources= 2024-09-12T00:53:37.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.472+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential sources added=[] removed=[] 2024-09-12T00:53:37.470 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.472+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_dests= new_dests= 2024-09-12T00:53:37.471 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.472+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential dests added=[] removed=[] 2024-09-12T00:53:37.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.0 2024-09-12T00:53:37.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.0 2024-09-12T00:53:37.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.1 2024-09-12T00:53:37.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.1 2024-09-12T00:53:37.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.2 2024-09-12T00:53:37.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.2 2024-09-12T00:53:37.476 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.3 2024-09-12T00:53:37.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.3 2024-09-12T00:53:37.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.4 2024-09-12T00:53:37.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.4 2024-09-12T00:53:37.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.5 2024-09-12T00:53:37.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.5 2024-09-12T00:53:37.477 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.6 2024-09-12T00:53:37.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.6 2024-09-12T00:53:37.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.7 2024-09-12T00:53:37.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.7 2024-09-12T00:53:37.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.8 2024-09-12T00:53:37.480 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.8 2024-09-12T00:53:37.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.10 2024-09-12T00:53:37.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.10 2024-09-12T00:53:37.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.11 2024-09-12T00:53:37.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.11 2024-09-12T00:53:37.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.12 2024-09-12T00:53:37.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.12 2024-09-12T00:53:37.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.13 2024-09-12T00:53:37.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.13 2024-09-12T00:53:37.481 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.14 2024-09-12T00:53:37.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.14 2024-09-12T00:53:37.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.15 2024-09-12T00:53:37.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.15 2024-09-12T00:53:37.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.16 2024-09-12T00:53:37.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.16 2024-09-12T00:53:37.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:37.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:37.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:37.482 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.477+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:37.483 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.478+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.478+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.478+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.478+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.479+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.479+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.479+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.479+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.480+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.480+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.480+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.480+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.481+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.481+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:37.484 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.482+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:37.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.482+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:37.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.483+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:37.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.483+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:37.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.483+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:37.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.483+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:37.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.484+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:37.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.484+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:37.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.486+0000 7f2be3b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:37.485 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.486+0000 7f2be3b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 2024-09-12T00:53:37.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.488+0000 7f2be3b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:37.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.488+0000 7f2be3b25800 10 moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:37.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.488+0000 7f2be3b25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:37.486 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.488+0000 7f2be3b25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18, ofs0, ns] 2024-09-12T00:53:37.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.488+0000 7f2ac27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398898 cookie 94452972022864 notifier 8718 bl.length()=821 2024-09-12T00:53:37.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.488+0000 7f2ac27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:37.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.488+0000 7f2ac27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:37.487 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.488+0000 7f2ac27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:37.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.489+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_sources= new_sources= 2024-09-12T00:53:37.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.489+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential sources added=[] removed=[] 2024-09-12T00:53:37.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.489+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_dests= new_dests= 2024-09-12T00:53:37.488 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.489+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential dests added=[] removed=[] 2024-09-12T00:53:37.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.493+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:37.491 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.493+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.0 2024-09-12T00:53:37.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.493+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:37.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.493+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.1 2024-09-12T00:53:37.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.493+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:37.492 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.493+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.2 2024-09-12T00:53:37.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.494+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:37.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.494+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.3 2024-09-12T00:53:37.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.494+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:37.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.494+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.4 2024-09-12T00:53:37.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.494+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:37.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.494+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.5 2024-09-12T00:53:37.493 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.495+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:37.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.495+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.6 2024-09-12T00:53:37.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.495+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:37.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.495+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.7 2024-09-12T00:53:37.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.496+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:37.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.496+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.8 2024-09-12T00:53:37.494 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.496+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:37.495 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.496+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.9 2024-09-12T00:53:37.495 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.496+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:37.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.496+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.10 2024-09-12T00:53:37.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.497+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:37.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.497+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.11 2024-09-12T00:53:37.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.497+0000 7f2be3b25800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:37.496 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.497+0000 7f2be3b25800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.2.12 2024-09-12T00:53:37.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.498+0000 7f2be3b25800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:53:37.497 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.498+0000 7f2be3b25800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 2024-09-12T00:53:37.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.499+0000 7f2be3b25800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:37.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.499+0000 7f2be3b25800 10 moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:37.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.499+0000 7f2be3b25800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:37.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.499+0000 7f2be3b25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18, ofs0, ns] 2024-09-12T00:53:37.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.499+0000 7f2ac27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398899 cookie 94452972022864 notifier 8718 bl.length()=789 2024-09-12T00:53:37.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.499+0000 7f2ac27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:37.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.499+0000 7f2ac27fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:37.498 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.499+0000 7f2ac27fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:37.499 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.501+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_sources= new_sources= 2024-09-12T00:53:37.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.501+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential sources added=[] removed=[] 2024-09-12T00:53:37.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.501+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): orig_dests= new_dests= 2024-09-12T00:53:37.500 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.501+0000 7f2be3b25800 20 handle_bi_update(): bucket=:myver[844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18]): potential dests added=[] removed=[] 2024-09-12T00:53:37.502 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.503+0000 7f2be3b25800 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T00:53:37.504 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.505+0000 7f2a95fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:37.506 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.508+0000 7f2be3b25800 20 remove_watcher() i=0 2024-09-12T00:53:37.506 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.508+0000 7f2be3b25800 2 removed watcher, disabling cache 2024-09-12T00:53:37.507 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.509+0000 7f2be3b25800 20 remove_watcher() i=1 2024-09-12T00:53:37.508 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.509+0000 7f2be3b25800 20 remove_watcher() i=2 2024-09-12T00:53:37.509 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.511+0000 7f2be3b25800 20 remove_watcher() i=3 2024-09-12T00:53:37.510 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.512+0000 7f2be3b25800 20 remove_watcher() i=4 2024-09-12T00:53:37.511 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.513+0000 7f2be3b25800 20 remove_watcher() i=5 2024-09-12T00:53:37.512 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.514+0000 7f2be3b25800 20 remove_watcher() i=6 2024-09-12T00:53:37.513 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.515+0000 7f2be3b25800 20 remove_watcher() i=7 2024-09-12T00:53:37.526 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:53:37.562 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:37.563 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:37.602 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.603+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.604+0000 7fbbdc5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.604+0000 7fbbdc5af800 20 realm 2024-09-12T00:53:37.603 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.604+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.605+0000 7fbbdc5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.605+0000 7fbbdc5af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:37.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.605+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.605+0000 7fbbdc5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.604 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.605+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.606+0000 7fbbdc5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:37.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.606+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.606+0000 7fbbdc5af800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:37.605 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.606+0000 7fbbdc5af800 20 searching for the correct realm 2024-09-12T00:53:37.608 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.609+0000 7fbbd9898640 0 -- 172.21.15.19:0/3970366620 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fbbd00998e0 msgr2=0x7fbbd006f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:37.813 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.815+0000 7fbbda89a640 0 -- 172.21.15.19:0/3970366620 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5647ce0b99f0 msgr2=0x5647ce0bbeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:37.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.819+0000 7fbbdc5af800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:37.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.819+0000 7fbbdc5af800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:37.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.819+0000 7fbbdc5af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:37.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.819+0000 7fbbdc5af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:37.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.819+0000 7fbbdc5af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:37.818 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.819+0000 7fbbdc5af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:37.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.819+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.819+0000 7fbbdc5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.819 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.819+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.820+0000 7fbbdc5af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.820+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.820+0000 7fbbdc5af800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.820+0000 7fbbdc5af800 20 zone default found 2024-09-12T00:53:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.820+0000 7fbbdc5af800 4 Realm: () 2024-09-12T00:53:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.820+0000 7fbbdc5af800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.820+0000 7fbbdc5af800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.820+0000 7fbbdc5af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.820+0000 7fbbdc5af800 20 zonegroup default 2024-09-12T00:53:37.820 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.820+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.820+0000 7fbbdc5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.821+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.821+0000 7fbbdc5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.821+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.821+0000 7fbbdc5af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.821+0000 7fbbdc5af800 20 started sync module instance, tier type = 2024-09-12T00:53:37.821 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.821+0000 7fbbdc5af800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:37.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.830+0000 7fbbdc5af800 20 add_watcher() i=0 2024-09-12T00:53:37.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.830+0000 7fbbdc5af800 20 add_watcher() i=1 2024-09-12T00:53:37.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.830+0000 7fbbdc5af800 20 add_watcher() i=2 2024-09-12T00:53:37.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.830+0000 7fbbdc5af800 20 add_watcher() i=3 2024-09-12T00:53:37.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.830+0000 7fbbdc5af800 20 add_watcher() i=4 2024-09-12T00:53:37.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.830+0000 7fbbdc5af800 20 add_watcher() i=5 2024-09-12T00:53:37.829 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.830+0000 7fbbdc5af800 20 add_watcher() i=6 2024-09-12T00:53:37.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.831+0000 7fbbdc5af800 20 add_watcher() i=7 2024-09-12T00:53:37.830 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.831+0000 7fbbdc5af800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:37.832 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.833+0000 7fba90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:37.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.834+0000 7fbbdc5af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:37.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.834+0000 7fbbdc5af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:37.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.834+0000 7fbbdc5af800 5 note: GC not initialized 2024-09-12T00:53:37.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.834+0000 7fba0b7fe640 20 reqs_thread_entry: start 2024-09-12T00:53:37.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.834+0000 7fbbdc5af800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:37.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.834+0000 7fbbdc5af800 20 Filter name: none 2024-09-12T00:53:37.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.834+0000 7fba097fa640 20 reqs_thread_entry: start 2024-09-12T00:53:37.833 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.834+0000 7fbbdc5af800 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:53:37.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.834+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.834 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:53:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:53:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 : miss 2024-09-12T00:53:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 20 rados->read ofs=0 len=0 2024-09-12T00:53:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 info.flags=0x17 2024-09-12T00:53:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 10 adding default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 to cache LRU end 2024-09-12T00:53:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:53:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:53:37.835 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18 2024-09-12T00:53:37.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.0 2024-09-12T00:53:37.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.835+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.0 2024-09-12T00:53:37.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.836+0000 7fbbdc5af800 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:53:37.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.836+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.1 2024-09-12T00:53:37.836 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.836+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.1 2024-09-12T00:53:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.836+0000 7fbbdc5af800 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:53:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.836+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.2 2024-09-12T00:53:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.836+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.2 2024-09-12T00:53:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.837+0000 7fbbdc5af800 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:53:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.837+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.3 2024-09-12T00:53:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.837+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.3 2024-09-12T00:53:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.837+0000 7fbbdc5af800 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:53:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.837+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.4 2024-09-12T00:53:37.837 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.837+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.4 2024-09-12T00:53:37.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.838+0000 7fbbdc5af800 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:53:37.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.838+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.5 2024-09-12T00:53:37.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.838+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.5 2024-09-12T00:53:37.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.838+0000 7fbbdc5af800 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:53:37.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.838+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.6 2024-09-12T00:53:37.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.838+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.6 2024-09-12T00:53:37.838 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.839+0000 7fbbdc5af800 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:53:37.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.839+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.7 2024-09-12T00:53:37.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.839+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.7 2024-09-12T00:53:37.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.839+0000 7fbbdc5af800 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:53:37.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.839+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.8 2024-09-12T00:53:37.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.839+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.8 2024-09-12T00:53:37.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.840+0000 7fbbdc5af800 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:53:37.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.840+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.839 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.840+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.840+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.10 2024-09-12T00:53:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.840+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.10 2024-09-12T00:53:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.841+0000 7fbbdc5af800 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:53:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.841+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.11 2024-09-12T00:53:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.841+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.11 2024-09-12T00:53:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.842+0000 7fbbdc5af800 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:53:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.842+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.12 2024-09-12T00:53:37.840 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.842+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.12 2024-09-12T00:53:37.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.842+0000 7fbbdc5af800 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:53:37.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.842+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.13 2024-09-12T00:53:37.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.842+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.13 2024-09-12T00:53:37.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.843+0000 7fbbdc5af800 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:53:37.841 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.843+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.14 2024-09-12T00:53:37.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.843+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.14 2024-09-12T00:53:37.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.843+0000 7fbbdc5af800 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:53:37.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.843+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.15 2024-09-12T00:53:37.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.843+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.15 2024-09-12T00:53:37.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.844+0000 7fbbdc5af800 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:53:37.842 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.844+0000 7fbbdc5af800 10 bucket_obj is .dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.16 2024-09-12T00:53:37.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.844+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.16 2024-09-12T00:53:37.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.844+0000 7fbbdc5af800 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:53:37.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.844+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.843 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.845+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:x state=0x5647ce0f5ba8 s->prefetch_data=0 2024-09-12T00:53:37.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.845+0000 7fbbdc5af800 20 get_obj_state: setting s->obj_tag to w4pqhnnee9qect9ms1d3ivvia8c30t70 2024-09-12T00:53:37.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.845+0000 7fbbdc5af800 20 get_obj_state_impl: setting s->olh_tag to yqh7veu9y0xbv0pqrb86flv6k63sipfu 2024-09-12T00:53:37.844 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.845+0000 7fbbdc5af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yqh7veu9y0xbv0pqrb86flv6k63sipfu 2024-09-12T00:53:37.845 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.846+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.846 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.848+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.848+0000 7fbbdc5af800 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:53:37.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.848+0000 7fbbdc5af800 20 olh_log_entry: epoch=2 op=3 key=x[e5gBvuYDiCD46xpW5nOVFn288KdA0nX] 2024-09-12T00:53:37.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.848+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:_:e5gBvuYDiCD46xpW5nOVFn288KdA0nX_x state=0x5647ce132678 s->prefetch_data=0 2024-09-12T00:53:37.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.849+0000 7fbbdc5af800 10 manifest: total_size = 9 2024-09-12T00:53:37.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.849+0000 7fbbdc5af800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8853823527398633709 2024-09-12T00:53:37.847 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.849+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:_:e5gBvuYDiCD46xpW5nOVFn288KdA0nX_x state=0x5647ce132678 s->prefetch_data=0 2024-09-12T00:53:37.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.849+0000 7fbbdc5af800 20 prepare_atomic_modification: state is not atomic. state=0x5647ce132678 2024-09-12T00:53:37.848 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.849+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.853+0000 7fbabdffb640 20 handle_completion(): completion ok for obj=x[e5gBvuYDiCD46xpW5nOVFn288KdA0nX] 2024-09-12T00:53:37.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.853+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:x state=0x5647ce0f5ba8 s->prefetch_data=0 2024-09-12T00:53:37.851 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.853+0000 7fbbdc5af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=yqh7veu9y0xbv0pqrb86flv6k63sipfu 2024-09-12T00:53:37.857 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.858+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.859+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.858 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.860+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.860+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:y state=0x5647ce0f5ba8 s->prefetch_data=0 2024-09-12T00:53:37.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.860+0000 7fbbdc5af800 20 get_obj_state: setting s->obj_tag to 2kmh5ch03stzholdg1smilmmb85ww1ws 2024-09-12T00:53:37.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.860+0000 7fbbdc5af800 20 get_obj_state_impl: setting s->olh_tag to zn7595hndecmdkssmjogk5my8hk3fcja 2024-09-12T00:53:37.859 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.860+0000 7fbbdc5af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zn7595hndecmdkssmjogk5my8hk3fcja 2024-09-12T00:53:37.860 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.862+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.863+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.863+0000 7fbbdc5af800 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:53:37.862 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.863+0000 7fbbdc5af800 20 olh_log_entry: epoch=2 op=3 key=y[ZT5yc3KfYsJkeySWrt7VvkH1iYghaJx] 2024-09-12T00:53:37.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.863+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:_:ZT5yc3KfYsJkeySWrt7VvkH1iYghaJx_y state=0x5647ce132678 s->prefetch_data=0 2024-09-12T00:53:37.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.864+0000 7fbbdc5af800 10 manifest: total_size = 22 2024-09-12T00:53:37.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.864+0000 7fbbdc5af800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14030645271147085008 2024-09-12T00:53:37.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.864+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:_:ZT5yc3KfYsJkeySWrt7VvkH1iYghaJx_y state=0x5647ce132678 s->prefetch_data=0 2024-09-12T00:53:37.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.864+0000 7fbbdc5af800 20 prepare_atomic_modification: state is not atomic. state=0x5647ce132678 2024-09-12T00:53:37.863 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.864+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.867+0000 7fbabd7fa640 20 handle_completion(): completion ok for obj=y[ZT5yc3KfYsJkeySWrt7VvkH1iYghaJx] 2024-09-12T00:53:37.866 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.868+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:y state=0x5647ce0f5ba8 s->prefetch_data=0 2024-09-12T00:53:37.867 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.868+0000 7fbbdc5af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=zn7595hndecmdkssmjogk5my8hk3fcja 2024-09-12T00:53:37.869 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.870+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.871+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.870 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.872+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.872+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:z state=0x5647ce0f5ba8 s->prefetch_data=0 2024-09-12T00:53:37.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.872+0000 7fbbdc5af800 20 get_obj_state: setting s->obj_tag to qe9cruf7qw2l1tfi2gtjdbqeftp7f1hk 2024-09-12T00:53:37.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.872+0000 7fbbdc5af800 20 get_obj_state_impl: setting s->olh_tag to kfo4bjqljl39pv3piygmo4kw5yenjf2o 2024-09-12T00:53:37.871 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.872+0000 7fbbdc5af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kfo4bjqljl39pv3piygmo4kw5yenjf2o 2024-09-12T00:53:37.872 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.874+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.875+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.876+0000 7fbbdc5af800 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:53:37.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.876+0000 7fbbdc5af800 20 olh_log_entry: epoch=2 op=3 key=z[s9ZuRpqXuxAKu3ASJ6dYKb0YNjRAoU5] 2024-09-12T00:53:37.874 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.876+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:_:s9ZuRpqXuxAKu3ASJ6dYKb0YNjRAoU5_z state=0x5647ce135fc8 s->prefetch_data=0 2024-09-12T00:53:37.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.876+0000 7fbbdc5af800 10 manifest: total_size = 22 2024-09-12T00:53:37.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.876+0000 7fbbdc5af800 20 get_obj_state: setting s->obj_tag to 844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8117348015976737102 2024-09-12T00:53:37.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.876+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:_:s9ZuRpqXuxAKu3ASJ6dYKb0YNjRAoU5_z state=0x5647ce135fc8 s->prefetch_data=0 2024-09-12T00:53:37.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.876+0000 7fbbdc5af800 20 prepare_atomic_modification: state is not atomic. state=0x5647ce135fc8 2024-09-12T00:53:37.875 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.876+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.878 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.880+0000 7fbabdffb640 20 handle_completion(): completion ok for obj=z[s9ZuRpqXuxAKu3ASJ6dYKb0YNjRAoU5] 2024-09-12T00:53:37.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.880+0000 7fbbdc5af800 20 get_obj_state: octx=0x5647cde2f690 obj=myver:z state=0x5647ce0f5ba8 s->prefetch_data=0 2024-09-12T00:53:37.879 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.880+0000 7fbbdc5af800 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kfo4bjqljl39pv3piygmo4kw5yenjf2o 2024-09-12T00:53:37.881 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.883+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.884+0000 7fbbdc5af800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18.3.9 2024-09-12T00:53:37.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.884+0000 7fbbdc5af800 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:53:37.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.884+0000 7fbbdc5af800 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:53:37.883 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.885+0000 7fba90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:37.885 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.887+0000 7fbbdc5af800 20 remove_watcher() i=0 2024-09-12T00:53:37.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.887+0000 7fbbdc5af800 2 removed watcher, disabling cache 2024-09-12T00:53:37.886 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.888+0000 7fbbdc5af800 20 remove_watcher() i=1 2024-09-12T00:53:37.887 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.889+0000 7fbbdc5af800 20 remove_watcher() i=2 2024-09-12T00:53:37.888 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.890+0000 7fbbdc5af800 20 remove_watcher() i=3 2024-09-12T00:53:37.889 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.891+0000 7fbbdc5af800 20 remove_watcher() i=4 2024-09-12T00:53:37.891 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.893+0000 7fbbdc5af800 20 remove_watcher() i=5 2024-09-12T00:53:37.893 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.895+0000 7fbbdc5af800 20 remove_watcher() i=6 2024-09-12T00:53:37.894 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:37.896+0000 7fbbdc5af800 20 remove_watcher() i=7 2024-09-12T00:53:37.908 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:37.908 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:37.948 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:37.948 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:38.045 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:53:38.075 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:53:38.075 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:53:38.115 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.116+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.118+0000 7f846e137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:38.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.118+0000 7f846e137800 20 realm 2024-09-12T00:53:38.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.118+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.118+0000 7f846e137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:38.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.118+0000 7f846e137800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:53:38.117 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.118+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.118+0000 7f846e137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:38.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.118+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.119+0000 7f846e137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:38.118 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.119+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.120+0000 7f846e137800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:53:38.119 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.120+0000 7f846e137800 20 searching for the correct realm 2024-09-12T00:53:38.122 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.123+0000 7f8469620640 0 -- 172.21.15.19:0/1780643032 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f846009f270 msgr2=0x7f84600830d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:53:38.328 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.329+0000 7f846a622640 0 -- 172.21.15.19:0/1780643032 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x555a856adb60 msgr2=0x555a856b0020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:53:38.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.333+0000 7f846e137800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:53:38.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.333+0000 7f846e137800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:53:38.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.333+0000 7f846e137800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:53:38.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.333+0000 7f846e137800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:53:38.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.333+0000 7f846e137800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:53:38.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.333+0000 7f846e137800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:53:38.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.333+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.332 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.333+0000 7f846e137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:38.333 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.333+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:53:38.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:53:38.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 20 zone default found 2024-09-12T00:53:38.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 4 Realm: () 2024-09-12T00:53:38.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:53:38.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:53:38.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:53:38.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 20 zonegroup default 2024-09-12T00:53:38.334 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:38.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.334+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.335+0000 7f846e137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:38.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.335+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.335+0000 7f846e137800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:53:38.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.335+0000 7f846e137800 20 started sync module instance, tier type = 2024-09-12T00:53:38.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.335+0000 7f846e137800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:53:38.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.345+0000 7f846e137800 20 add_watcher() i=0 2024-09-12T00:53:38.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.345+0000 7f846e137800 20 add_watcher() i=1 2024-09-12T00:53:38.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.345+0000 7f846e137800 20 add_watcher() i=2 2024-09-12T00:53:38.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.345+0000 7f846e137800 20 add_watcher() i=3 2024-09-12T00:53:38.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.345+0000 7f846e137800 20 add_watcher() i=4 2024-09-12T00:53:38.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.345+0000 7f846e137800 20 add_watcher() i=5 2024-09-12T00:53:38.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.345+0000 7f846e137800 20 add_watcher() i=6 2024-09-12T00:53:38.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.346+0000 7f846e137800 20 add_watcher() i=7 2024-09-12T00:53:38.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.346+0000 7f846e137800 2 all 8 watchers are set, enabling cache 2024-09-12T00:53:38.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.348+0000 7f831b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:38.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.348+0000 7f846e137800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:53:38.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.348+0000 7f846e137800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:53:38.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.348+0000 7f846e137800 5 note: GC not initialized 2024-09-12T00:53:38.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.348+0000 7f831a7fc640 20 reqs_thread_entry: start 2024-09-12T00:53:38.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.349+0000 7f846e137800 20 init_complete bucket index max shards: 11 2024-09-12T00:53:38.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.349+0000 7f846e137800 20 Filter name: none 2024-09-12T00:53:38.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.349+0000 7f828ffff640 20 reqs_thread_entry: start 2024-09-12T00:53:38.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.349+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.349+0000 7f846e137800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:38.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.349+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.350+0000 7f846e137800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:38.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.350+0000 7f846e137800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:38.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.350+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.351+0000 7f846e137800 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:53:38.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.351+0000 7f846e137800 20 rados->read ofs=0 len=0 2024-09-12T00:53:38.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.351+0000 7f846e137800 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:53:38.350 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.351+0000 7f846e137800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:53:38.351 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.353+0000 7f831b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:53:38.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.355+0000 7f846e137800 20 remove_watcher() i=0 2024-09-12T00:53:38.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.355+0000 7f846e137800 2 removed watcher, disabling cache 2024-09-12T00:53:38.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.356+0000 7f846e137800 20 remove_watcher() i=1 2024-09-12T00:53:38.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.357+0000 7f846e137800 20 remove_watcher() i=2 2024-09-12T00:53:38.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.358+0000 7f846e137800 20 remove_watcher() i=3 2024-09-12T00:53:38.358 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.359+0000 7f846e137800 20 remove_watcher() i=4 2024-09-12T00:53:38.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.360+0000 7f846e137800 20 remove_watcher() i=5 2024-09-12T00:53:38.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.361+0000 7f846e137800 20 remove_watcher() i=6 2024-09-12T00:53:38.361 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T00:53:38.362+0000 7f846e137800 20 remove_watcher() i=7 2024-09-12T00:53:38.372 INFO:tasks.workunit.client.0.smithi019.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:53:38.372 INFO:tasks.workunit.client.0.smithi019.stderr:Deleting bucket a-bucket 2024-09-12T00:53:38.374 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:38.374 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:38.399 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:38.399 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:38.456 INFO:tasks.workunit.client.0.smithi019.stderr:Deleting bucket myver 2024-09-12T00:53:38.457 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:38.457 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:38.531 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T00:53:38.531 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T00:53:38.700 INFO:tasks.workunit.client.0.smithi019.stderr:Completed resharding tests 2024-09-12T00:53:38.701 INFO:tasks.workunit.client.0.smithi019.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T00:53:38.701 INFO:tasks.workunit.client.0.smithi019.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T00:53:38.701 INFO:tasks.workunit.client.0.smithi019.stdout:connected to https://localhost:443 2024-09-12T00:53:38.783 INFO:tasks.workunit.client.0.smithi019.stderr:+ deactivate 2024-09-12T00:53:38.783 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T00:53:38.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T00:53:38.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ export PATH 2024-09-12T00:53:38.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:53:38.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n '' ']' 2024-09-12T00:53:38.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:53:38.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ hash -r 2024-09-12T00:53:38.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n '' ']' 2024-09-12T00:53:38.784 INFO:tasks.workunit.client.0.smithi019.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:53:38.785 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:53:38.785 INFO:tasks.workunit.client.0.smithi019.stderr:+ unset -f deactivate 2024-09-12T00:53:38.785 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo OK. 2024-09-12T00:53:38.786 INFO:tasks.workunit.client.0.smithi019.stdout:OK. 2024-09-12T00:53:38.787 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:53:38.787 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:53:38.866 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:53:38.867 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:53:39.303 DEBUG:teuthology.parallel:result is None 2024-09-12T00:53:39.304 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:53:39.344 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:53:39.344 DEBUG:teuthology.orchestra.run.smithi019:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:53:39.413 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:53:39.413 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:53:39.428 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:53:39.428 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:53:39.428 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:53:39.428 DEBUG:teuthology.orchestra.run.smithi019:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:53:39.483 INFO:teuthology.orchestra.run.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:53:43.832 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:53:43.832 DEBUG:teuthology.orchestra.run.smithi019:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:53:45.961 INFO:teuthology.orchestra.run.smithi019.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required RPM packages. Installing via sudo. 2024-09-12T00:53:46.550 INFO:teuthology.orchestra.run.smithi019.stdout:Last metadata expiration check: 0:32:00 ago on Thu 12 Sep 2024 12:21:46 AM UTC. 2024-09-12T00:53:46.702 INFO:teuthology.orchestra.run.smithi019.stdout:Dependencies resolved. 2024-09-12T00:53:46.703 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T00:53:46.703 INFO:teuthology.orchestra.run.smithi019.stdout: Package Arch Version Repository Size 2024-09-12T00:53:46.703 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T00:53:46.703 INFO:teuthology.orchestra.run.smithi019.stdout:Installing: 2024-09-12T00:53:46.703 INFO:teuthology.orchestra.run.smithi019.stdout: java-1.8.0-openjdk x86_64 1:1.8.0.362.b09-4.el9 appstream 426 k 2024-09-12T00:53:46.703 INFO:teuthology.orchestra.run.smithi019.stdout: java-1.8.0-openjdk-devel x86_64 1:1.8.0.362.b09-4.el9 appstream 9.3 M 2024-09-12T00:53:46.703 INFO:teuthology.orchestra.run.smithi019.stdout:Installing dependencies: 2024-09-12T00:53:46.703 INFO:teuthology.orchestra.run.smithi019.stdout: java-1.8.0-openjdk-headless x86_64 1:1.8.0.362.b09-4.el9 appstream 32 M 2024-09-12T00:53:46.704 INFO:teuthology.orchestra.run.smithi019.stdout:Installing weak dependencies: 2024-09-12T00:53:46.704 INFO:teuthology.orchestra.run.smithi019.stdout: gtk2 x86_64 2.24.33-8.el9 appstream 3.5 M 2024-09-12T00:53:46.704 INFO:teuthology.orchestra.run.smithi019.stdout: libcanberra-gtk2 x86_64 0.30-27.el9 appstream 26 k 2024-09-12T00:53:46.704 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:53:46.704 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction Summary 2024-09-12T00:53:46.704 INFO:teuthology.orchestra.run.smithi019.stdout:================================================================================ 2024-09-12T00:53:46.704 INFO:teuthology.orchestra.run.smithi019.stdout:Install 5 Packages 2024-09-12T00:53:46.704 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:53:46.705 INFO:teuthology.orchestra.run.smithi019.stdout:Total download size: 46 M 2024-09-12T00:53:46.705 INFO:teuthology.orchestra.run.smithi019.stdout:Installed size: 166 M 2024-09-12T00:53:46.705 INFO:teuthology.orchestra.run.smithi019.stdout:Downloading Packages: 2024-09-12T00:53:46.949 INFO:teuthology.orchestra.run.smithi019.stdout:(1/5): java-1.8.0-openjdk-1.8.0.362.b09-4.el9.x 1.9 MB/s | 426 kB 00:00 2024-09-12T00:53:47.433 INFO:teuthology.orchestra.run.smithi019.stdout:(2/5): gtk2-2.24.33-8.el9.x86_64.rpm 5.0 MB/s | 3.5 MB 00:00 2024-09-12T00:53:47.483 INFO:teuthology.orchestra.run.smithi019.stdout:(3/5): libcanberra-gtk2-0.30-27.el9.x86_64.rpm 519 kB/s | 26 kB 00:00 2024-09-12T00:53:48.325 INFO:teuthology.orchestra.run.smithi019.stdout:(4/5): java-1.8.0-openjdk-devel-1.8.0.362.b09-4 5.9 MB/s | 9.3 MB 00:01 2024-09-12T00:53:51.359 INFO:teuthology.orchestra.run.smithi019.stdout:(5/5): java-1.8.0-openjdk-headless-1.8.0.362.b0 7.3 MB/s | 32 MB 00:04 2024-09-12T00:53:51.359 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------------------- 2024-09-12T00:53:51.359 INFO:teuthology.orchestra.run.smithi019.stdout:Total 9.8 MB/s | 46 MB 00:04 2024-09-12T00:53:51.801 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check 2024-09-12T00:53:51.825 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction check succeeded. 2024-09-12T00:53:51.825 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction test 2024-09-12T00:53:52.327 INFO:teuthology.orchestra.run.smithi019.stdout:Transaction test succeeded. 2024-09-12T00:53:52.327 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction 2024-09-12T00:53:52.870 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 1/1 2024-09-12T00:53:53.027 INFO:teuthology.orchestra.run.smithi019.stdout: Preparing : 1/1 2024-09-12T00:53:53.240 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : libcanberra-gtk2-0.30-27.el9.x86_64 1/5 2024-09-12T00:53:53.890 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : gtk2-2.24.33-8.el9.x86_64 2/5 2024-09-12T00:53:53.936 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:53:54.187 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 3/5 2024-09-12T00:53:54.221 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:53:54.461 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 4/5 2024-09-12T00:53:54.508 INFO:teuthology.orchestra.run.smithi019.stdout: Installing : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:53:54.516 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:53:54.528 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 5/5 2024-09-12T00:53:54.571 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 5/5 2024-09-12T00:53:57.685 INFO:teuthology.orchestra.run.smithi019.stdout: Running scriptlet: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 5/5 2024-09-12T00:53:57.686 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : gtk2-2.24.33-8.el9.x86_64 1/5 2024-09-12T00:53:57.686 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2/5 2024-09-12T00:53:57.686 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_6 3/5 2024-09-12T00:53:57.686 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x8 4/5 2024-09-12T00:53:58.123 INFO:teuthology.orchestra.run.smithi019.stdout: Verifying : libcanberra-gtk2-0.30-27.el9.x86_64 5/5 2024-09-12T00:53:58.123 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:53:58.123 INFO:teuthology.orchestra.run.smithi019.stdout:Installed: 2024-09-12T00:53:58.123 INFO:teuthology.orchestra.run.smithi019.stdout: gtk2-2.24.33-8.el9.x86_64 2024-09-12T00:53:58.123 INFO:teuthology.orchestra.run.smithi019.stdout: java-1.8.0-openjdk-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:53:58.123 INFO:teuthology.orchestra.run.smithi019.stdout: java-1.8.0-openjdk-devel-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:53:58.124 INFO:teuthology.orchestra.run.smithi019.stdout: java-1.8.0-openjdk-headless-1:1.8.0.362.b09-4.el9.x86_64 2024-09-12T00:53:58.124 INFO:teuthology.orchestra.run.smithi019.stdout: libcanberra-gtk2-0.30-27.el9.x86_64 2024-09-12T00:53:58.124 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:53:58.124 INFO:teuthology.orchestra.run.smithi019.stdout:Complete! 2024-09-12T00:53:58.574 INFO:teuthology.orchestra.run.smithi019.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:53:58.648 INFO:teuthology.orchestra.run.smithi019.stderr:--2024-09-12 00:53:58-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:53:58.780 INFO:teuthology.orchestra.run.smithi019.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.72.101, 104.16.73.101, 2606:4700::6810:4965, ... 2024-09-12T00:53:58.788 INFO:teuthology.orchestra.run.smithi019.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.72.101|:443... connected. 2024-09-12T00:53:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:53:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:53:58.878 INFO:teuthology.orchestra.run.smithi019.stderr:--2024-09-12 00:53:58-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:53:58.888 INFO:teuthology.orchestra.run.smithi019.stderr:Resolving github.com (github.com)... 140.82.114.4 2024-09-12T00:53:58.897 INFO:teuthology.orchestra.run.smithi019.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2024-09-12T00:53:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:53:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T005229Z&X-Amz-Expires=300&X-Amz-Signature=4ba290f3fdcae4d1f860139ed8089d21d0ec43610b8892b84fba4cd176652d66&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:53:58.983 INFO:teuthology.orchestra.run.smithi019.stderr:--2024-09-12 00:53:58-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T005229Z&X-Amz-Expires=300&X-Amz-Signature=4ba290f3fdcae4d1f860139ed8089d21d0ec43610b8892b84fba4cd176652d66&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:53:58.984 INFO:teuthology.orchestra.run.smithi019.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.108.133, 185.199.111.133, ... 2024-09-12T00:53:58.996 INFO:teuthology.orchestra.run.smithi019.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-09-12T00:53:59.079 INFO:teuthology.orchestra.run.smithi019.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:53:59.079 INFO:teuthology.orchestra.run.smithi019.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:53:59.079 INFO:teuthology.orchestra.run.smithi019.stderr:Saving to: ‘gradle-6.0.1-bin.zip’ 2024-09-12T00:53:59.079 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:53:59.092 INFO:teuthology.orchestra.run.smithi019.stderr: 0K .......... .......... .......... .......... .......... 0% 3.54M 26s 2024-09-12T00:53:59.104 INFO:teuthology.orchestra.run.smithi019.stderr: 50K .......... .......... .......... .......... .......... 0% 3.96M 24s 2024-09-12T00:53:59.113 INFO:teuthology.orchestra.run.smithi019.stderr: 100K .......... .......... .......... .......... .......... 0% 5.24M 22s 2024-09-12T00:53:59.116 INFO:teuthology.orchestra.run.smithi019.stderr: 150K .......... .......... .......... .......... .......... 0% 18.3M 18s 2024-09-12T00:53:59.118 INFO:teuthology.orchestra.run.smithi019.stderr: 200K .......... .......... .......... .......... .......... 0% 25.7M 15s 2024-09-12T00:53:59.123 INFO:teuthology.orchestra.run.smithi019.stderr: 250K .......... .......... .......... .......... .......... 0% 8.17M 14s 2024-09-12T00:53:59.125 INFO:teuthology.orchestra.run.smithi019.stderr: 300K .......... .......... .......... .......... .......... 0% 27.9M 13s 2024-09-12T00:53:59.132 INFO:teuthology.orchestra.run.smithi019.stderr: 350K .......... .......... .......... .......... .......... 0% 29.2M 11s 2024-09-12T00:53:59.133 INFO:teuthology.orchestra.run.smithi019.stderr: 400K .......... .......... .......... .......... .......... 0% 73.0M 10s 2024-09-12T00:53:59.133 INFO:teuthology.orchestra.run.smithi019.stderr: 450K .......... .......... .......... .......... .......... 0% 39.7M 9s 2024-09-12T00:53:59.133 INFO:teuthology.orchestra.run.smithi019.stderr: 500K .......... .......... .......... .......... .......... 0% 29.8M 9s 2024-09-12T00:54:00.877 INFO:teuthology.orchestra.run.smithi019.stderr: 550K .......... .......... .......... .......... .......... 0% 10.5M 9s 2024-09-12T00:54:00.878 INFO:teuthology.orchestra.run.smithi019.stderr: 600K .......... .......... .......... .......... .......... 0% 33.4M 8s 2024-09-12T00:54:00.878 INFO:teuthology.orchestra.run.smithi019.stderr: 650K .......... .......... .......... .......... .......... 0% 328M 8s 2024-09-12T00:54:00.878 INFO:teuthology.orchestra.run.smithi019.stderr: 700K .......... .......... .......... .......... .......... 0% 60.2M 7s 2024-09-12T00:54:00.878 INFO:teuthology.orchestra.run.smithi019.stderr: 750K .......... .......... .......... .......... .......... 0% 53.5M 7s 2024-09-12T00:54:00.878 INFO:teuthology.orchestra.run.smithi019.stderr: 800K .......... .......... .......... .......... .......... 0% 128M 7s 2024-09-12T00:54:00.878 INFO:teuthology.orchestra.run.smithi019.stderr: 850K .......... .......... .......... .......... .......... 0% 216M 6s 2024-09-12T00:54:00.878 INFO:teuthology.orchestra.run.smithi019.stderr: 900K .......... .......... .......... .......... .......... 1% 36.9M 6s 2024-09-12T00:54:00.878 INFO:teuthology.orchestra.run.smithi019.stderr: 950K .......... .......... .......... .......... .......... 1% 329M 6s 2024-09-12T00:54:00.878 INFO:teuthology.orchestra.run.smithi019.stderr: 1000K .......... .......... .......... .......... .......... 1% 42.0M 6s 2024-09-12T00:54:00.878 INFO:teuthology.orchestra.run.smithi019.stderr: 1050K .......... .......... .......... .......... .......... 1% 178M 5s 2024-09-12T00:54:00.878 INFO:teuthology.orchestra.run.smithi019.stderr: 1100K .......... .......... .......... .......... .......... 1% 370M 5s 2024-09-12T00:54:00.879 INFO:teuthology.orchestra.run.smithi019.stderr: 1150K .......... .......... .......... .......... .......... 1% 10.9M 5s 2024-09-12T00:54:00.879 INFO:teuthology.orchestra.run.smithi019.stderr: 1200K .......... .......... .......... .......... .......... 1% 227M 5s 2024-09-12T00:54:00.879 INFO:teuthology.orchestra.run.smithi019.stderr: 1250K .......... .......... .......... .......... .......... 1% 34.8M 5s 2024-09-12T00:54:00.879 INFO:teuthology.orchestra.run.smithi019.stderr: 1300K .......... .......... .......... .......... .......... 1% 289M 5s 2024-09-12T00:54:00.879 INFO:teuthology.orchestra.run.smithi019.stderr: 1350K .......... .......... .......... .......... .......... 1% 243M 5s 2024-09-12T00:54:00.879 INFO:teuthology.orchestra.run.smithi019.stderr: 1400K .......... .......... .......... .......... .......... 1% 97.2M 5s 2024-09-12T00:54:00.879 INFO:teuthology.orchestra.run.smithi019.stderr: 1450K .......... .......... .......... .......... .......... 1% 101M 4s 2024-09-12T00:54:00.879 INFO:teuthology.orchestra.run.smithi019.stderr: 1500K .......... .......... .......... .......... .......... 1% 111M 4s 2024-09-12T00:54:00.879 INFO:teuthology.orchestra.run.smithi019.stderr: 1550K .......... .......... .......... .......... .......... 1% 332M 4s 2024-09-12T00:54:00.879 INFO:teuthology.orchestra.run.smithi019.stderr: 1600K .......... .......... .......... .......... .......... 1% 141M 4s 2024-09-12T00:54:00.879 INFO:teuthology.orchestra.run.smithi019.stderr: 1650K .......... .......... .......... .......... .......... 1% 152M 4s 2024-09-12T00:54:00.880 INFO:teuthology.orchestra.run.smithi019.stderr: 1700K .......... .......... .......... .......... .......... 1% 124M 4s 2024-09-12T00:54:00.880 INFO:teuthology.orchestra.run.smithi019.stderr: 1750K .......... .......... .......... .......... .......... 1% 143M 4s 2024-09-12T00:54:00.880 INFO:teuthology.orchestra.run.smithi019.stderr: 1800K .......... .......... .......... .......... .......... 1% 299M 4s 2024-09-12T00:54:00.880 INFO:teuthology.orchestra.run.smithi019.stderr: 1850K .......... .......... .......... .......... .......... 2% 128M 4s 2024-09-12T00:54:00.880 INFO:teuthology.orchestra.run.smithi019.stderr: 1900K .......... .......... .......... .......... .......... 2% 166M 3s 2024-09-12T00:54:00.880 INFO:teuthology.orchestra.run.smithi019.stderr: 1950K .......... .......... .......... .......... .......... 2% 165M 3s 2024-09-12T00:54:00.880 INFO:teuthology.orchestra.run.smithi019.stderr: 2000K .......... .......... .......... .......... .......... 2% 286M 3s 2024-09-12T00:54:00.880 INFO:teuthology.orchestra.run.smithi019.stderr: 2050K .......... .......... .......... .......... .......... 2% 126M 3s 2024-09-12T00:54:00.880 INFO:teuthology.orchestra.run.smithi019.stderr: 2100K .......... .......... .......... .......... .......... 2% 204M 3s 2024-09-12T00:54:00.880 INFO:teuthology.orchestra.run.smithi019.stderr: 2150K .......... .......... .......... .......... .......... 2% 184M 3s 2024-09-12T00:54:00.880 INFO:teuthology.orchestra.run.smithi019.stderr: 2200K .......... .......... .......... .......... .......... 2% 157M 3s 2024-09-12T00:54:00.881 INFO:teuthology.orchestra.run.smithi019.stderr: 2250K .......... .......... .......... .......... .......... 2% 305M 3s 2024-09-12T00:54:00.881 INFO:teuthology.orchestra.run.smithi019.stderr: 2300K .......... .......... .......... .......... .......... 2% 13.1M 3s 2024-09-12T00:54:00.881 INFO:teuthology.orchestra.run.smithi019.stderr: 2350K .......... .......... .......... .......... .......... 2% 290M 3s 2024-09-12T00:54:00.881 INFO:teuthology.orchestra.run.smithi019.stderr: 2400K .......... .......... .......... .......... .......... 2% 258M 3s 2024-09-12T00:54:00.881 INFO:teuthology.orchestra.run.smithi019.stderr: 2450K .......... .......... .......... .......... .......... 2% 185M 3s 2024-09-12T00:54:00.881 INFO:teuthology.orchestra.run.smithi019.stderr: 2500K .......... .......... .......... .......... .......... 2% 315M 3s 2024-09-12T00:54:00.881 INFO:teuthology.orchestra.run.smithi019.stderr: 2550K .......... .......... .......... .......... .......... 2% 45.7M 3s 2024-09-12T00:54:00.881 INFO:teuthology.orchestra.run.smithi019.stderr: 2600K .......... .......... .......... .......... .......... 2% 331M 3s 2024-09-12T00:54:00.881 INFO:teuthology.orchestra.run.smithi019.stderr: 2650K .......... .......... .......... .......... .......... 2% 264M 3s 2024-09-12T00:54:00.881 INFO:teuthology.orchestra.run.smithi019.stderr: 2700K .......... .......... .......... .......... .......... 2% 339M 3s 2024-09-12T00:54:00.881 INFO:teuthology.orchestra.run.smithi019.stderr: 2750K .......... .......... .......... .......... .......... 3% 315M 3s 2024-09-12T00:54:00.882 INFO:teuthology.orchestra.run.smithi019.stderr: 2800K .......... .......... .......... .......... .......... 3% 195M 3s 2024-09-12T00:54:00.882 INFO:teuthology.orchestra.run.smithi019.stderr: 2850K .......... .......... .......... .......... .......... 3% 206M 3s 2024-09-12T00:54:00.882 INFO:teuthology.orchestra.run.smithi019.stderr: 2900K .......... .......... .......... .......... .......... 3% 357M 3s 2024-09-12T00:54:00.882 INFO:teuthology.orchestra.run.smithi019.stderr: 2950K .......... .......... .......... .......... .......... 3% 344M 3s 2024-09-12T00:54:00.882 INFO:teuthology.orchestra.run.smithi019.stderr: 3000K .......... .......... .......... .......... .......... 3% 231M 2s 2024-09-12T00:54:00.882 INFO:teuthology.orchestra.run.smithi019.stderr: 3050K .......... .......... .......... .......... .......... 3% 244M 2s 2024-09-12T00:54:00.882 INFO:teuthology.orchestra.run.smithi019.stderr: 3100K .......... .......... .......... .......... .......... 3% 249M 2s 2024-09-12T00:54:00.882 INFO:teuthology.orchestra.run.smithi019.stderr: 3150K .......... .......... .......... .......... .......... 3% 224M 2s 2024-09-12T00:54:00.882 INFO:teuthology.orchestra.run.smithi019.stderr: 3200K .......... .......... .......... .......... .......... 3% 368M 2s 2024-09-12T00:54:00.882 INFO:teuthology.orchestra.run.smithi019.stderr: 3250K .......... .......... .......... .......... .......... 3% 277M 2s 2024-09-12T00:54:00.882 INFO:teuthology.orchestra.run.smithi019.stderr: 3300K .......... .......... .......... .......... .......... 3% 254M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3350K .......... .......... .......... .......... .......... 3% 284M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3400K .......... .......... .......... .......... .......... 3% 365M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3450K .......... .......... .......... .......... .......... 3% 251M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3500K .......... .......... .......... .......... .......... 3% 332M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3550K .......... .......... .......... .......... .......... 3% 290M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3600K .......... .......... .......... .......... .......... 3% 271M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3650K .......... .......... .......... .......... .......... 3% 316M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3700K .......... .......... .......... .......... .......... 4% 285M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3750K .......... .......... .......... .......... .......... 4% 333M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3800K .......... .......... .......... .......... .......... 4% 341M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3850K .......... .......... .......... .......... .......... 4% 275M 2s 2024-09-12T00:54:00.883 INFO:teuthology.orchestra.run.smithi019.stderr: 3900K .......... .......... .......... .......... .......... 4% 346M 2s 2024-09-12T00:54:00.884 INFO:teuthology.orchestra.run.smithi019.stderr: 3950K .......... .......... .......... .......... .......... 4% 335M 2s 2024-09-12T00:54:00.884 INFO:teuthology.orchestra.run.smithi019.stderr: 4000K .......... .......... .......... .......... .......... 4% 336M 2s 2024-09-12T00:54:00.884 INFO:teuthology.orchestra.run.smithi019.stderr: 4050K .......... .......... .......... .......... .......... 4% 283M 2s 2024-09-12T00:54:00.884 INFO:teuthology.orchestra.run.smithi019.stderr: 4100K .......... .......... .......... .......... .......... 4% 307M 2s 2024-09-12T00:54:00.884 INFO:teuthology.orchestra.run.smithi019.stderr: 4150K .......... .......... .......... .......... .......... 4% 293M 2s 2024-09-12T00:54:00.884 INFO:teuthology.orchestra.run.smithi019.stderr: 4200K .......... .......... .......... .......... .......... 4% 310M 2s 2024-09-12T00:54:00.884 INFO:teuthology.orchestra.run.smithi019.stderr: 4250K .......... .......... .......... .......... .......... 4% 260M 2s 2024-09-12T00:54:00.884 INFO:teuthology.orchestra.run.smithi019.stderr: 4300K .......... .......... .......... .......... .......... 4% 174M 2s 2024-09-12T00:54:00.884 INFO:teuthology.orchestra.run.smithi019.stderr: 4350K .......... .......... .......... .......... .......... 4% 349M 2s 2024-09-12T00:54:00.884 INFO:teuthology.orchestra.run.smithi019.stderr: 4400K .......... .......... .......... .......... .......... 4% 351M 2s 2024-09-12T00:54:00.884 INFO:teuthology.orchestra.run.smithi019.stderr: 4450K .......... .......... .......... .......... .......... 4% 356M 2s 2024-09-12T00:54:00.885 INFO:teuthology.orchestra.run.smithi019.stderr: 4500K .......... .......... .......... .......... .......... 4% 392M 2s 2024-09-12T00:54:00.885 INFO:teuthology.orchestra.run.smithi019.stderr: 4550K .......... .......... .......... .......... .......... 4% 46.3M 2s 2024-09-12T00:54:00.885 INFO:teuthology.orchestra.run.smithi019.stderr: 4600K .......... .......... .......... .......... .......... 5% 49.4M 2s 2024-09-12T00:54:00.885 INFO:teuthology.orchestra.run.smithi019.stderr: 4650K .......... .......... .......... .......... .......... 5% 38.6M 2s 2024-09-12T00:54:00.885 INFO:teuthology.orchestra.run.smithi019.stderr: 4700K .......... .......... .......... .......... .......... 5% 333M 2s 2024-09-12T00:54:00.885 INFO:teuthology.orchestra.run.smithi019.stderr: 4750K .......... .......... .......... .......... .......... 5% 322M 2s 2024-09-12T00:54:00.885 INFO:teuthology.orchestra.run.smithi019.stderr: 4800K .......... .......... .......... .......... .......... 5% 325M 2s 2024-09-12T00:54:00.885 INFO:teuthology.orchestra.run.smithi019.stderr: 4850K .......... .......... .......... .......... .......... 5% 294M 2s 2024-09-12T00:54:00.885 INFO:teuthology.orchestra.run.smithi019.stderr: 4900K .......... .......... .......... .......... .......... 5% 319M 2s 2024-09-12T00:54:00.885 INFO:teuthology.orchestra.run.smithi019.stderr: 4950K .......... .......... .......... .......... .......... 5% 311M 2s 2024-09-12T00:54:00.885 INFO:teuthology.orchestra.run.smithi019.stderr: 5000K .......... .......... .......... .......... .......... 5% 400M 2s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5050K .......... .......... .......... .......... .......... 5% 399M 2s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5100K .......... .......... .......... .......... .......... 5% 132M 2s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5150K .......... .......... .......... .......... .......... 5% 307M 2s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5200K .......... .......... .......... .......... .......... 5% 345M 2s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5250K .......... .......... .......... .......... .......... 5% 313M 2s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5300K .......... .......... .......... .......... .......... 5% 274M 2s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5350K .......... .......... .......... .......... .......... 5% 294M 2s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5400K .......... .......... .......... .......... .......... 5% 281M 2s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5450K .......... .......... .......... .......... .......... 5% 274M 2s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5500K .......... .......... .......... .......... .......... 5% 285M 1s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5550K .......... .......... .......... .......... .......... 6% 272M 1s 2024-09-12T00:54:00.886 INFO:teuthology.orchestra.run.smithi019.stderr: 5600K .......... .......... .......... .......... .......... 6% 294M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 5650K .......... .......... .......... .......... .......... 6% 314M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 5700K .......... .......... .......... .......... .......... 6% 317M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 5750K .......... .......... .......... .......... .......... 6% 314M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 5800K .......... .......... .......... .......... .......... 6% 282M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 5850K .......... .......... .......... .......... .......... 6% 290M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 5900K .......... .......... .......... .......... .......... 6% 166M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 5950K .......... .......... .......... .......... .......... 6% 298M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 6000K .......... .......... .......... .......... .......... 6% 387M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 6050K .......... .......... .......... .......... .......... 6% 291M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 6100K .......... .......... .......... .......... .......... 6% 281M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 6150K .......... .......... .......... .......... .......... 6% 359M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 6200K .......... .......... .......... .......... .......... 6% 312M 1s 2024-09-12T00:54:00.887 INFO:teuthology.orchestra.run.smithi019.stderr: 6250K .......... .......... .......... .......... .......... 6% 333M 1s 2024-09-12T00:54:00.888 INFO:teuthology.orchestra.run.smithi019.stderr: 6300K .......... .......... .......... .......... .......... 6% 254M 1s 2024-09-12T00:54:00.888 INFO:teuthology.orchestra.run.smithi019.stderr: 6350K .......... .......... .......... .......... .......... 6% 381M 1s 2024-09-12T00:54:00.888 INFO:teuthology.orchestra.run.smithi019.stderr: 6400K .......... .......... .......... .......... .......... 6% 343M 1s 2024-09-12T00:54:00.888 INFO:teuthology.orchestra.run.smithi019.stderr: 6450K .......... .......... .......... .......... .......... 6% 319M 1s 2024-09-12T00:54:00.888 INFO:teuthology.orchestra.run.smithi019.stderr: 6500K .......... .......... .......... .......... .......... 7% 290M 1s 2024-09-12T00:54:00.888 INFO:teuthology.orchestra.run.smithi019.stderr: 6550K .......... .......... .......... .......... .......... 7% 349M 1s 2024-09-12T00:54:00.888 INFO:teuthology.orchestra.run.smithi019.stderr: 6600K .......... .......... .......... .......... .......... 7% 385M 1s 2024-09-12T00:54:00.888 INFO:teuthology.orchestra.run.smithi019.stderr: 6650K .......... .......... .......... .......... .......... 7% 345M 1s 2024-09-12T00:54:00.888 INFO:teuthology.orchestra.run.smithi019.stderr: 6700K .......... .......... .......... .......... .......... 7% 342M 1s 2024-09-12T00:54:00.888 INFO:teuthology.orchestra.run.smithi019.stderr: 6750K .......... .......... .......... .......... .......... 7% 277M 1s 2024-09-12T00:54:00.888 INFO:teuthology.orchestra.run.smithi019.stderr: 6800K .......... .......... .......... .......... .......... 7% 329M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 6850K .......... .......... .......... .......... .......... 7% 327M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 6900K .......... .......... .......... .......... .......... 7% 389M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 6950K .......... .......... .......... .......... .......... 7% 268M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 7000K .......... .......... .......... .......... .......... 7% 348M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 7050K .......... .......... .......... .......... .......... 7% 345M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 7100K .......... .......... .......... .......... .......... 7% 377M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 7150K .......... .......... .......... .......... .......... 7% 354M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 7200K .......... .......... .......... .......... .......... 7% 407M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 7250K .......... .......... .......... .......... .......... 7% 345M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 7300K .......... .......... .......... .......... .......... 7% 394M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 7350K .......... .......... .......... .......... .......... 7% 400M 1s 2024-09-12T00:54:00.889 INFO:teuthology.orchestra.run.smithi019.stderr: 7400K .......... .......... .......... .......... .......... 8% 406M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 7450K .......... .......... .......... .......... .......... 8% 345M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 7500K .......... .......... .......... .......... .......... 8% 121M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 7550K .......... .......... .......... .......... .......... 8% 240M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 7600K .......... .......... .......... .......... .......... 8% 360M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 7650K .......... .......... .......... .......... .......... 8% 326M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 7700K .......... .......... .......... .......... .......... 8% 59.4M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 7750K .......... .......... .......... .......... .......... 8% 37.1M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 7800K .......... .......... .......... .......... .......... 8% 236M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 7850K .......... .......... .......... .......... .......... 8% 386M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 7900K .......... .......... .......... .......... .......... 8% 277M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 7950K .......... .......... .......... .......... .......... 8% 387M 1s 2024-09-12T00:54:00.890 INFO:teuthology.orchestra.run.smithi019.stderr: 8000K .......... .......... .......... .......... .......... 8% 119M 1s 2024-09-12T00:54:00.891 INFO:teuthology.orchestra.run.smithi019.stderr: 8050K .......... .......... .......... .......... .......... 8% 305M 1s 2024-09-12T00:54:00.891 INFO:teuthology.orchestra.run.smithi019.stderr: 8100K .......... .......... .......... .......... .......... 8% 296M 1s 2024-09-12T00:54:00.891 INFO:teuthology.orchestra.run.smithi019.stderr: 8150K .......... .......... .......... .......... .......... 8% 391M 1s 2024-09-12T00:54:00.891 INFO:teuthology.orchestra.run.smithi019.stderr: 8200K .......... .......... .......... .......... .......... 8% 337M 1s 2024-09-12T00:54:00.891 INFO:teuthology.orchestra.run.smithi019.stderr: 8250K .......... .......... .......... .......... .......... 8% 301M 1s 2024-09-12T00:54:00.891 INFO:teuthology.orchestra.run.smithi019.stderr: 8300K .......... .......... .......... .......... .......... 8% 241M 1s 2024-09-12T00:54:00.891 INFO:teuthology.orchestra.run.smithi019.stderr: 8350K .......... .......... .......... .......... .......... 9% 387M 1s 2024-09-12T00:54:00.891 INFO:teuthology.orchestra.run.smithi019.stderr: 8400K .......... .......... .......... .......... .......... 9% 193M 1s 2024-09-12T00:54:00.891 INFO:teuthology.orchestra.run.smithi019.stderr: 8450K .......... .......... .......... .......... .......... 9% 311M 1s 2024-09-12T00:54:00.891 INFO:teuthology.orchestra.run.smithi019.stderr: 8500K .......... .......... .......... .......... .......... 9% 306M 1s 2024-09-12T00:54:00.891 INFO:teuthology.orchestra.run.smithi019.stderr: 8550K .......... .......... .......... .......... .......... 9% 331M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 8600K .......... .......... .......... .......... .......... 9% 251M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 8650K .......... .......... .......... .......... .......... 9% 336M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 8700K .......... .......... .......... .......... .......... 9% 346M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 8750K .......... .......... .......... .......... .......... 9% 328M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 8800K .......... .......... .......... .......... .......... 9% 290M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 8850K .......... .......... .......... .......... .......... 9% 358M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 8900K .......... .......... .......... .......... .......... 9% 353M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 8950K .......... .......... .......... .......... .......... 9% 338M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 9000K .......... .......... .......... .......... .......... 9% 286M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 9050K .......... .......... .......... .......... .......... 9% 323M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 9100K .......... .......... .......... .......... .......... 9% 378M 1s 2024-09-12T00:54:00.892 INFO:teuthology.orchestra.run.smithi019.stderr: 9150K .......... .......... .......... .......... .......... 9% 357M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9200K .......... .......... .......... .......... .......... 9% 226M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9250K .......... .......... .......... .......... .......... 10% 270M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9300K .......... .......... .......... .......... .......... 10% 344M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9350K .......... .......... .......... .......... .......... 10% 392M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9400K .......... .......... .......... .......... .......... 10% 390M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9450K .......... .......... .......... .......... .......... 10% 340M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9500K .......... .......... .......... .......... .......... 10% 363M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9550K .......... .......... .......... .......... .......... 10% 364M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9600K .......... .......... .......... .......... .......... 10% 311M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9650K .......... .......... .......... .......... .......... 10% 290M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9700K .......... .......... .......... .......... .......... 10% 360M 1s 2024-09-12T00:54:00.893 INFO:teuthology.orchestra.run.smithi019.stderr: 9750K .......... .......... .......... .......... .......... 10% 291M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 9800K .......... .......... .......... .......... .......... 10% 374M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 9850K .......... .......... .......... .......... .......... 10% 302M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 9900K .......... .......... .......... .......... .......... 10% 284M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 9950K .......... .......... .......... .......... .......... 10% 323M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 10000K .......... .......... .......... .......... .......... 10% 349M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 10050K .......... .......... .......... .......... .......... 10% 349M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 10100K .......... .......... .......... .......... .......... 10% 344M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 10150K .......... .......... .......... .......... .......... 10% 304M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 10200K .......... .......... .......... .......... .......... 11% 338M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 10250K .......... .......... .......... .......... .......... 11% 60.0M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 10300K .......... .......... .......... .......... .......... 11% 328M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 10350K .......... .......... .......... .......... .......... 11% 337M 1s 2024-09-12T00:54:00.894 INFO:teuthology.orchestra.run.smithi019.stderr: 10400K .......... .......... .......... .......... .......... 11% 253M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 10450K .......... .......... .......... .......... .......... 11% 298M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 10500K .......... .......... .......... .......... .......... 11% 375M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 10550K .......... .......... .......... .......... .......... 11% 391M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 10600K .......... .......... .......... .......... .......... 11% 397M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 10650K .......... .......... .......... .......... .......... 11% 131M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 10700K .......... .......... .......... .......... .......... 11% 360M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 10750K .......... .......... .......... .......... .......... 11% 375M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 10800K .......... .......... .......... .......... .......... 11% 48.4M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 10850K .......... .......... .......... .......... .......... 11% 131M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 10900K .......... .......... .......... .......... .......... 11% 289M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 10950K .......... .......... .......... .......... .......... 11% 350M 1s 2024-09-12T00:54:00.895 INFO:teuthology.orchestra.run.smithi019.stderr: 11000K .......... .......... .......... .......... .......... 11% 79.1M 1s 2024-09-12T00:54:00.896 INFO:teuthology.orchestra.run.smithi019.stderr: 11050K .......... .......... .......... .......... .......... 11% 219M 1s 2024-09-12T00:54:00.896 INFO:teuthology.orchestra.run.smithi019.stderr: 11100K .......... .......... .......... .......... .......... 12% 346M 1s 2024-09-12T00:54:00.896 INFO:teuthology.orchestra.run.smithi019.stderr: 11150K .......... .......... .......... .......... .......... 12% 388M 1s 2024-09-12T00:54:00.896 INFO:teuthology.orchestra.run.smithi019.stderr: 11200K .......... .......... .......... .......... .......... 12% 364M 1s 2024-09-12T00:54:00.896 INFO:teuthology.orchestra.run.smithi019.stderr: 11250K .......... .......... .......... .......... .......... 12% 305M 1s 2024-09-12T00:54:00.896 INFO:teuthology.orchestra.run.smithi019.stderr: 11300K .......... .......... .......... .......... .......... 12% 328M 1s 2024-09-12T00:54:00.896 INFO:teuthology.orchestra.run.smithi019.stderr: 11350K .......... .......... .......... .......... .......... 12% 362M 1s 2024-09-12T00:54:00.896 INFO:teuthology.orchestra.run.smithi019.stderr: 11400K .......... .......... .......... .......... .......... 12% 280M 1s 2024-09-12T00:54:00.896 INFO:teuthology.orchestra.run.smithi019.stderr: 11450K .......... .......... .......... .......... .......... 12% 281M 1s 2024-09-12T00:54:00.896 INFO:teuthology.orchestra.run.smithi019.stderr: 11500K .......... .......... .......... .......... .......... 12% 326M 1s 2024-09-12T00:54:00.896 INFO:teuthology.orchestra.run.smithi019.stderr: 11550K .......... .......... .......... .......... .......... 12% 322M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 11600K .......... .......... .......... .......... .......... 12% 376M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 11650K .......... .......... .......... .......... .......... 12% 350M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 11700K .......... .......... .......... .......... .......... 12% 233M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 11750K .......... .......... .......... .......... .......... 12% 310M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 11800K .......... .......... .......... .......... .......... 12% 301M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 11850K .......... .......... .......... .......... .......... 12% 358M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 11900K .......... .......... .......... .......... .......... 12% 334M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 11950K .......... .......... .......... .......... .......... 12% 270M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 12000K .......... .......... .......... .......... .......... 12% 378M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 12050K .......... .......... .......... .......... .......... 13% 346M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 12100K .......... .......... .......... .......... .......... 13% 302M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 12150K .......... .......... .......... .......... .......... 13% 350M 1s 2024-09-12T00:54:00.897 INFO:teuthology.orchestra.run.smithi019.stderr: 12200K .......... .......... .......... .......... .......... 13% 303M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12250K .......... .......... .......... .......... .......... 13% 254M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12300K .......... .......... .......... .......... .......... 13% 389M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12350K .......... .......... .......... .......... .......... 13% 150M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12400K .......... .......... .......... .......... .......... 13% 320M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12450K .......... .......... .......... .......... .......... 13% 288M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12500K .......... .......... .......... .......... .......... 13% 334M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12550K .......... .......... .......... .......... .......... 13% 294M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12600K .......... .......... .......... .......... .......... 13% 329M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12650K .......... .......... .......... .......... .......... 13% 318M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12700K .......... .......... .......... .......... .......... 13% 325M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12750K .......... .......... .......... .......... .......... 13% 308M 1s 2024-09-12T00:54:00.898 INFO:teuthology.orchestra.run.smithi019.stderr: 12800K .......... .......... .......... .......... .......... 13% 406M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 12850K .......... .......... .......... .......... .......... 13% 314M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 12900K .......... .......... .......... .......... .......... 13% 373M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 12950K .......... .......... .......... .......... .......... 13% 360M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 13000K .......... .......... .......... .......... .......... 14% 384M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 13050K .......... .......... .......... .......... .......... 14% 369M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 13100K .......... .......... .......... .......... .......... 14% 298M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 13150K .......... .......... .......... .......... .......... 14% 297M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 13200K .......... .......... .......... .......... .......... 14% 62.8M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 13250K .......... .......... .......... .......... .......... 14% 355M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 13300K .......... .......... .......... .......... .......... 14% 391M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 13350K .......... .......... .......... .......... .......... 14% 80.7M 1s 2024-09-12T00:54:00.899 INFO:teuthology.orchestra.run.smithi019.stderr: 13400K .......... .......... .......... .......... .......... 14% 303M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 13450K .......... .......... .......... .......... .......... 14% 326M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 13500K .......... .......... .......... .......... .......... 14% 400M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 13550K .......... .......... .......... .......... .......... 14% 288M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 13600K .......... .......... .......... .......... .......... 14% 371M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 13650K .......... .......... .......... .......... .......... 14% 392M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 13700K .......... .......... .......... .......... .......... 14% 378M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 13750K .......... .......... .......... .......... .......... 14% 329M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 13800K .......... .......... .......... .......... .......... 14% 371M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 13850K .......... .......... .......... .......... .......... 14% 82.3M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 13900K .......... .......... .......... .......... .......... 15% 270M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 13950K .......... .......... .......... .......... .......... 15% 145M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 14000K .......... .......... .......... .......... .......... 15% 205M 1s 2024-09-12T00:54:00.900 INFO:teuthology.orchestra.run.smithi019.stderr: 14050K .......... .......... .......... .......... .......... 15% 96.2M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14100K .......... .......... .......... .......... .......... 15% 169M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14150K .......... .......... .......... .......... .......... 15% 269M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14200K .......... .......... .......... .......... .......... 15% 355M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14250K .......... .......... .......... .......... .......... 15% 360M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14300K .......... .......... .......... .......... .......... 15% 337M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14350K .......... .......... .......... .......... .......... 15% 302M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14400K .......... .......... .......... .......... .......... 15% 350M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14450K .......... .......... .......... .......... .......... 15% 368M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14500K .......... .......... .......... .......... .......... 15% 333M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14550K .......... .......... .......... .......... .......... 15% 280M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14600K .......... .......... .......... .......... .......... 15% 299M 1s 2024-09-12T00:54:00.901 INFO:teuthology.orchestra.run.smithi019.stderr: 14650K .......... .......... .......... .......... .......... 15% 384M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 14700K .......... .......... .......... .......... .......... 15% 223M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 14750K .......... .......... .......... .......... .......... 15% 266M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 14800K .......... .......... .......... .......... .......... 15% 250M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 14850K .......... .......... .......... .......... .......... 16% 304M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 14900K .......... .......... .......... .......... .......... 16% 276M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 14950K .......... .......... .......... .......... .......... 16% 311M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 15000K .......... .......... .......... .......... .......... 16% 328M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 15050K .......... .......... .......... .......... .......... 16% 366M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 15100K .......... .......... .......... .......... .......... 16% 281M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 15150K .......... .......... .......... .......... .......... 16% 311M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 15200K .......... .......... .......... .......... .......... 16% 377M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 15250K .......... .......... .......... .......... .......... 16% 342M 1s 2024-09-12T00:54:00.902 INFO:teuthology.orchestra.run.smithi019.stderr: 15300K .......... .......... .......... .......... .......... 16% 219M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15350K .......... .......... .......... .......... .......... 16% 159M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15400K .......... .......... .......... .......... .......... 16% 273M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15450K .......... .......... .......... .......... .......... 16% 298M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15500K .......... .......... .......... .......... .......... 16% 227M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15550K .......... .......... .......... .......... .......... 16% 234M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15600K .......... .......... .......... .......... .......... 16% 305M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15650K .......... .......... .......... .......... .......... 16% 254M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15700K .......... .......... .......... .......... .......... 16% 309M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15750K .......... .......... .......... .......... .......... 17% 212M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15800K .......... .......... .......... .......... .......... 17% 280M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15850K .......... .......... .......... .......... .......... 17% 266M 1s 2024-09-12T00:54:00.903 INFO:teuthology.orchestra.run.smithi019.stderr: 15900K .......... .......... .......... .......... .......... 17% 242M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 15950K .......... .......... .......... .......... .......... 17% 232M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16000K .......... .......... .......... .......... .......... 17% 291M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16050K .......... .......... .......... .......... .......... 17% 317M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16100K .......... .......... .......... .......... .......... 17% 301M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16150K .......... .......... .......... .......... .......... 17% 272M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16200K .......... .......... .......... .......... .......... 17% 274M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16250K .......... .......... .......... .......... .......... 17% 304M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16300K .......... .......... .......... .......... .......... 17% 287M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16350K .......... .......... .......... .......... .......... 17% 98.6M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16400K .......... .......... .......... .......... .......... 17% 321M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16450K .......... .......... .......... .......... .......... 17% 341M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16500K .......... .......... .......... .......... .......... 17% 325M 1s 2024-09-12T00:54:00.904 INFO:teuthology.orchestra.run.smithi019.stderr: 16550K .......... .......... .......... .......... .......... 17% 306M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 16600K .......... .......... .......... .......... .......... 17% 258M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 16650K .......... .......... .......... .......... .......... 17% 336M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 16700K .......... .......... .......... .......... .......... 18% 343M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 16750K .......... .......... .......... .......... .......... 18% 266M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 16800K .......... .......... .......... .......... .......... 18% 291M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 16850K .......... .......... .......... .......... .......... 18% 262M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 16900K .......... .......... .......... .......... .......... 18% 185M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 16950K .......... .......... .......... .......... .......... 18% 251M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 17000K .......... .......... .......... .......... .......... 18% 154M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 17050K .......... .......... .......... .......... .......... 18% 89.3M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 17100K .......... .......... .......... .......... .......... 18% 309M 1s 2024-09-12T00:54:00.905 INFO:teuthology.orchestra.run.smithi019.stderr: 17150K .......... .......... .......... .......... .......... 18% 245M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17200K .......... .......... .......... .......... .......... 18% 316M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17250K .......... .......... .......... .......... .......... 18% 140M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17300K .......... .......... .......... .......... .......... 18% 315M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17350K .......... .......... .......... .......... .......... 18% 291M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17400K .......... .......... .......... .......... .......... 18% 323M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17450K .......... .......... .......... .......... .......... 18% 186M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17500K .......... .......... .......... .......... .......... 18% 326M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17550K .......... .......... .......... .......... .......... 18% 361M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17600K .......... .......... .......... .......... .......... 18% 350M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17650K .......... .......... .......... .......... .......... 19% 266M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17700K .......... .......... .......... .......... .......... 19% 333M 1s 2024-09-12T00:54:00.906 INFO:teuthology.orchestra.run.smithi019.stderr: 17750K .......... .......... .......... .......... .......... 19% 275M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 17800K .......... .......... .......... .......... .......... 19% 140M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 17850K .......... .......... .......... .......... .......... 19% 338M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 17900K .......... .......... .......... .......... .......... 19% 332M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 17950K .......... .......... .......... .......... .......... 19% 305M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 18000K .......... .......... .......... .......... .......... 19% 322M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 18050K .......... .......... .......... .......... .......... 19% 324M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 18100K .......... .......... .......... .......... .......... 19% 342M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 18150K .......... .......... .......... .......... .......... 19% 291M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 18200K .......... .......... .......... .......... .......... 19% 331M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 18250K .......... .......... .......... .......... .......... 19% 330M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 18300K .......... .......... .......... .......... .......... 19% 316M 1s 2024-09-12T00:54:00.907 INFO:teuthology.orchestra.run.smithi019.stderr: 18350K .......... .......... .......... .......... .......... 19% 113M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18400K .......... .......... .......... .......... .......... 19% 268M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18450K .......... .......... .......... .......... .......... 19% 253M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18500K .......... .......... .......... .......... .......... 19% 294M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18550K .......... .......... .......... .......... .......... 20% 223M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18600K .......... .......... .......... .......... .......... 20% 283M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18650K .......... .......... .......... .......... .......... 20% 304M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18700K .......... .......... .......... .......... .......... 20% 349M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18750K .......... .......... .......... .......... .......... 20% 265M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18800K .......... .......... .......... .......... .......... 20% 319M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18850K .......... .......... .......... .......... .......... 20% 351M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18900K .......... .......... .......... .......... .......... 20% 304M 1s 2024-09-12T00:54:00.908 INFO:teuthology.orchestra.run.smithi019.stderr: 18950K .......... .......... .......... .......... .......... 20% 339M 1s 2024-09-12T00:54:00.909 INFO:teuthology.orchestra.run.smithi019.stderr: 19000K .......... .......... .......... .......... .......... 20% 150M 1s 2024-09-12T00:54:00.909 INFO:teuthology.orchestra.run.smithi019.stderr: 19050K .......... .......... .......... .......... .......... 20% 336M 1s 2024-09-12T00:54:00.909 INFO:teuthology.orchestra.run.smithi019.stderr: 19100K .......... .......... .......... .......... .......... 20% 150M 1s 2024-09-12T00:54:00.909 INFO:teuthology.orchestra.run.smithi019.stderr: 19150K .......... .......... .......... .......... .......... 20% 301M 1s 2024-09-12T00:54:00.909 INFO:teuthology.orchestra.run.smithi019.stderr: 19200K .......... .......... .......... .......... .......... 20% 303M 1s 2024-09-12T00:54:00.909 INFO:teuthology.orchestra.run.smithi019.stderr: 19250K .......... .......... .......... .......... .......... 20% 267M 1s 2024-09-12T00:54:00.909 INFO:teuthology.orchestra.run.smithi019.stderr: 19300K .......... .......... .......... .......... .......... 20% 351M 1s 2024-09-12T00:54:00.909 INFO:teuthology.orchestra.run.smithi019.stderr: 19350K .......... .......... .......... .......... .......... 20% 200M 1s 2024-09-12T00:54:00.909 INFO:teuthology.orchestra.run.smithi019.stderr: 19400K .......... .......... .......... .......... .......... 20% 327M 1s 2024-09-12T00:54:00.909 INFO:teuthology.orchestra.run.smithi019.stderr: 19450K .......... .......... .......... .......... .......... 20% 308M 1s 2024-09-12T00:54:00.909 INFO:teuthology.orchestra.run.smithi019.stderr: 19500K .......... .......... .......... .......... .......... 21% 313M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 19550K .......... .......... .......... .......... .......... 21% 280M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 19600K .......... .......... .......... .......... .......... 21% 174M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 19650K .......... .......... .......... .......... .......... 21% 303M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 19700K .......... .......... .......... .......... .......... 21% 313M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 19750K .......... .......... .......... .......... .......... 21% 330M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 19800K .......... .......... .......... .......... .......... 21% 308M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 19850K .......... .......... .......... .......... .......... 21% 336M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 19900K .......... .......... .......... .......... .......... 21% 275M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 19950K .......... .......... .......... .......... .......... 21% 267M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 20000K .......... .......... .......... .......... .......... 21% 125M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 20050K .......... .......... .......... .......... .......... 21% 298M 1s 2024-09-12T00:54:00.910 INFO:teuthology.orchestra.run.smithi019.stderr: 20100K .......... .......... .......... .......... .......... 21% 109M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20150K .......... .......... .......... .......... .......... 21% 141M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20200K .......... .......... .......... .......... .......... 21% 243M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20250K .......... .......... .......... .......... .......... 21% 314M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20300K .......... .......... .......... .......... .......... 21% 162M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20350K .......... .......... .......... .......... .......... 21% 268M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20400K .......... .......... .......... .......... .......... 22% 244M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20450K .......... .......... .......... .......... .......... 22% 227M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20500K .......... .......... .......... .......... .......... 22% 336M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20550K .......... .......... .......... .......... .......... 22% 277M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20600K .......... .......... .......... .......... .......... 22% 276M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20650K .......... .......... .......... .......... .......... 22% 316M 1s 2024-09-12T00:54:00.911 INFO:teuthology.orchestra.run.smithi019.stderr: 20700K .......... .......... .......... .......... .......... 22% 293M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 20750K .......... .......... .......... .......... .......... 22% 358M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 20800K .......... .......... .......... .......... .......... 22% 211M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 20850K .......... .......... .......... .......... .......... 22% 261M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 20900K .......... .......... .......... .......... .......... 22% 229M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 20950K .......... .......... .......... .......... .......... 22% 313M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 21000K .......... .......... .......... .......... .......... 22% 312M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 21050K .......... .......... .......... .......... .......... 22% 346M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 21100K .......... .......... .......... .......... .......... 22% 254M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 21150K .......... .......... .......... .......... .......... 22% 322M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 21200K .......... .......... .......... .......... .......... 22% 320M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 21250K .......... .......... .......... .......... .......... 22% 100M 1s 2024-09-12T00:54:00.912 INFO:teuthology.orchestra.run.smithi019.stderr: 21300K .......... .......... .......... .......... .......... 22% 133M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21350K .......... .......... .......... .......... .......... 23% 305M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21400K .......... .......... .......... .......... .......... 23% 222M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21450K .......... .......... .......... .......... .......... 23% 325M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21500K .......... .......... .......... .......... .......... 23% 146M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21550K .......... .......... .......... .......... .......... 23% 259M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21600K .......... .......... .......... .......... .......... 23% 61.0M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21650K .......... .......... .......... .......... .......... 23% 212M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21700K .......... .......... .......... .......... .......... 23% 241M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21750K .......... .......... .......... .......... .......... 23% 281M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21800K .......... .......... .......... .......... .......... 23% 287M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21850K .......... .......... .......... .......... .......... 23% 341M 1s 2024-09-12T00:54:00.913 INFO:teuthology.orchestra.run.smithi019.stderr: 21900K .......... .......... .......... .......... .......... 23% 183M 1s 2024-09-12T00:54:00.914 INFO:teuthology.orchestra.run.smithi019.stderr: 21950K .......... .......... .......... .......... .......... 23% 322M 1s 2024-09-12T00:54:00.914 INFO:teuthology.orchestra.run.smithi019.stderr: 22000K .......... .......... .......... .......... .......... 23% 253M 1s 2024-09-12T00:54:00.914 INFO:teuthology.orchestra.run.smithi019.stderr: 22050K .......... .......... .......... .......... .......... 23% 316M 1s 2024-09-12T00:54:00.914 INFO:teuthology.orchestra.run.smithi019.stderr: 22100K .......... .......... .......... .......... .......... 23% 303M 1s 2024-09-12T00:54:00.914 INFO:teuthology.orchestra.run.smithi019.stderr: 22150K .......... .......... .......... .......... .......... 23% 322M 1s 2024-09-12T00:54:00.914 INFO:teuthology.orchestra.run.smithi019.stderr: 22200K .......... .......... .......... .......... .......... 23% 295M 1s 2024-09-12T00:54:00.914 INFO:teuthology.orchestra.run.smithi019.stderr: 22250K .......... .......... .......... .......... .......... 24% 325M 1s 2024-09-12T00:54:00.914 INFO:teuthology.orchestra.run.smithi019.stderr: 22300K .......... .......... .......... .......... .......... 24% 268M 1s 2024-09-12T00:54:00.914 INFO:teuthology.orchestra.run.smithi019.stderr: 22350K .......... .......... .......... .......... .......... 24% 152M 1s 2024-09-12T00:54:00.914 INFO:teuthology.orchestra.run.smithi019.stderr: 22400K .......... .......... .......... .......... .......... 24% 107M 1s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 22450K .......... .......... .......... .......... .......... 24% 322M 1s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 22500K .......... .......... .......... .......... .......... 24% 312M 1s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 22550K .......... .......... .......... .......... .......... 24% 159M 1s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 22600K .......... .......... .......... .......... .......... 24% 181M 1s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 22650K .......... .......... .......... .......... .......... 24% 293M 1s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 22700K .......... .......... .......... .......... .......... 24% 268M 1s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 22750K .......... .......... .......... .......... .......... 24% 325M 0s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 22800K .......... .......... .......... .......... .......... 24% 332M 0s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 22850K .......... .......... .......... .......... .......... 24% 263M 0s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 22900K .......... .......... .......... .......... .......... 24% 336M 0s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 22950K .......... .......... .......... .......... .......... 24% 329M 0s 2024-09-12T00:54:00.915 INFO:teuthology.orchestra.run.smithi019.stderr: 23000K .......... .......... .......... .......... .......... 24% 315M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23050K .......... .......... .......... .......... .......... 24% 286M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23100K .......... .......... .......... .......... .......... 24% 291M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23150K .......... .......... .......... .......... .......... 24% 302M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23200K .......... .......... .......... .......... .......... 25% 300M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23250K .......... .......... .......... .......... .......... 25% 307M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23300K .......... .......... .......... .......... .......... 25% 298M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23350K .......... .......... .......... .......... .......... 25% 269M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23400K .......... .......... .......... .......... .......... 25% 341M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23450K .......... .......... .......... .......... .......... 25% 308M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23500K .......... .......... .......... .......... .......... 25% 320M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23550K .......... .......... .......... .......... .......... 25% 270M 0s 2024-09-12T00:54:00.916 INFO:teuthology.orchestra.run.smithi019.stderr: 23600K .......... .......... .......... .......... .......... 25% 267M 0s 2024-09-12T00:54:00.917 INFO:teuthology.orchestra.run.smithi019.stderr: 23650K .......... .......... .......... .......... .......... 25% 329M 0s 2024-09-12T00:54:00.917 INFO:teuthology.orchestra.run.smithi019.stderr: 23700K .......... .......... .......... .......... .......... 25% 322M 0s 2024-09-12T00:54:00.917 INFO:teuthology.orchestra.run.smithi019.stderr: 23750K .......... .......... .......... .......... .......... 25% 368M 0s 2024-09-12T00:54:00.917 INFO:teuthology.orchestra.run.smithi019.stderr: 23800K .......... .......... .......... .......... .......... 25% 284M 0s 2024-09-12T00:54:00.917 INFO:teuthology.orchestra.run.smithi019.stderr: 23850K .......... .......... .......... .......... .......... 25% 293M 0s 2024-09-12T00:54:00.917 INFO:teuthology.orchestra.run.smithi019.stderr: 23900K .......... .......... .......... .......... .......... 25% 300M 0s 2024-09-12T00:54:00.917 INFO:teuthology.orchestra.run.smithi019.stderr: 23950K .......... .......... .......... .......... .......... 25% 307M 0s 2024-09-12T00:54:00.917 INFO:teuthology.orchestra.run.smithi019.stderr: 24000K .......... .......... .......... .......... .......... 25% 311M 0s 2024-09-12T00:54:00.917 INFO:teuthology.orchestra.run.smithi019.stderr: 24050K .......... .......... .......... .......... .......... 25% 342M 0s 2024-09-12T00:54:00.917 INFO:teuthology.orchestra.run.smithi019.stderr: 24100K .......... .......... .......... .......... .......... 25% 382M 0s 2024-09-12T00:54:00.917 INFO:teuthology.orchestra.run.smithi019.stderr: 24150K .......... .......... .......... .......... .......... 26% 300M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24200K .......... .......... .......... .......... .......... 26% 298M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24250K .......... .......... .......... .......... .......... 26% 353M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24300K .......... .......... .......... .......... .......... 26% 377M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24350K .......... .......... .......... .......... .......... 26% 333M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24400K .......... .......... .......... .......... .......... 26% 69.1M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24450K .......... .......... .......... .......... .......... 26% 333M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24500K .......... .......... .......... .......... .......... 26% 295M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24550K .......... .......... .......... .......... .......... 26% 345M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24600K .......... .......... .......... .......... .......... 26% 334M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24650K .......... .......... .......... .......... .......... 26% 69.6M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24700K .......... .......... .......... .......... .......... 26% 247M 0s 2024-09-12T00:54:00.918 INFO:teuthology.orchestra.run.smithi019.stderr: 24750K .......... .......... .......... .......... .......... 26% 213M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 24800K .......... .......... .......... .......... .......... 26% 316M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 24850K .......... .......... .......... .......... .......... 26% 311M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 24900K .......... .......... .......... .......... .......... 26% 186M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 24950K .......... .......... .......... .......... .......... 26% 317M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 25000K .......... .......... .......... .......... .......... 26% 328M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 25050K .......... .......... .......... .......... .......... 27% 311M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 25100K .......... .......... .......... .......... .......... 27% 102M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 25150K .......... .......... .......... .......... .......... 27% 352M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 25200K .......... .......... .......... .......... .......... 27% 260M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 25250K .......... .......... .......... .......... .......... 27% 297M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 25300K .......... .......... .......... .......... .......... 27% 324M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 25350K .......... .......... .......... .......... .......... 27% 334M 0s 2024-09-12T00:54:00.919 INFO:teuthology.orchestra.run.smithi019.stderr: 25400K .......... .......... .......... .......... .......... 27% 313M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 25450K .......... .......... .......... .......... .......... 27% 355M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 25500K .......... .......... .......... .......... .......... 27% 80.2M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 25550K .......... .......... .......... .......... .......... 27% 328M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 25600K .......... .......... .......... .......... .......... 27% 303M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 25650K .......... .......... .......... .......... .......... 27% 311M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 25700K .......... .......... .......... .......... .......... 27% 321M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 25750K .......... .......... .......... .......... .......... 27% 323M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 25800K .......... .......... .......... .......... .......... 27% 281M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 25850K .......... .......... .......... .......... .......... 27% 114M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 25900K .......... .......... .......... .......... .......... 27% 183M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 25950K .......... .......... .......... .......... .......... 27% 189M 0s 2024-09-12T00:54:00.920 INFO:teuthology.orchestra.run.smithi019.stderr: 26000K .......... .......... .......... .......... .......... 28% 317M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26050K .......... .......... .......... .......... .......... 28% 328M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26100K .......... .......... .......... .......... .......... 28% 296M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26150K .......... .......... .......... .......... .......... 28% 331M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26200K .......... .......... .......... .......... .......... 28% 315M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26250K .......... .......... .......... .......... .......... 28% 311M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26300K .......... .......... .......... .......... .......... 28% 266M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26350K .......... .......... .......... .......... .......... 28% 292M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26400K .......... .......... .......... .......... .......... 28% 353M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26450K .......... .......... .......... .......... .......... 28% 334M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26500K .......... .......... .......... .......... .......... 28% 308M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26550K .......... .......... .......... .......... .......... 28% 317M 0s 2024-09-12T00:54:00.921 INFO:teuthology.orchestra.run.smithi019.stderr: 26600K .......... .......... .......... .......... .......... 28% 110M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 26650K .......... .......... .......... .......... .......... 28% 266M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 26700K .......... .......... .......... .......... .......... 28% 58.5M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 26750K .......... .......... .......... .......... .......... 28% 202M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 26800K .......... .......... .......... .......... .......... 28% 243M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 26850K .......... .......... .......... .......... .......... 28% 298M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 26900K .......... .......... .......... .......... .......... 29% 281M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 26950K .......... .......... .......... .......... .......... 29% 331M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 27000K .......... .......... .......... .......... .......... 29% 335M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 27050K .......... .......... .......... .......... .......... 29% 315M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 27100K .......... .......... .......... .......... .......... 29% 277M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 27150K .......... .......... .......... .......... .......... 29% 323M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 27200K .......... .......... .......... .......... .......... 29% 342M 0s 2024-09-12T00:54:00.922 INFO:teuthology.orchestra.run.smithi019.stderr: 27250K .......... .......... .......... .......... .......... 29% 331M 0s 2024-09-12T00:54:00.923 INFO:teuthology.orchestra.run.smithi019.stderr: 27300K .......... .......... .......... .......... .......... 29% 312M 0s 2024-09-12T00:54:00.923 INFO:teuthology.orchestra.run.smithi019.stderr: 27350K .......... .......... .......... .......... .......... 29% 333M 0s 2024-09-12T00:54:00.923 INFO:teuthology.orchestra.run.smithi019.stderr: 27400K .......... .......... .......... .......... .......... 29% 340M 0s 2024-09-12T00:54:00.923 INFO:teuthology.orchestra.run.smithi019.stderr: 27450K .......... .......... .......... .......... .......... 29% 339M 0s 2024-09-12T00:54:00.923 INFO:teuthology.orchestra.run.smithi019.stderr: 27500K .......... .......... .......... .......... .......... 29% 50.4M 0s 2024-09-12T00:54:00.923 INFO:teuthology.orchestra.run.smithi019.stderr: 27550K .......... .......... .......... .......... .......... 29% 94.7M 0s 2024-09-12T00:54:00.923 INFO:teuthology.orchestra.run.smithi019.stderr: 27600K .......... .......... .......... .......... .......... 29% 247M 0s 2024-09-12T00:54:00.923 INFO:teuthology.orchestra.run.smithi019.stderr: 27650K .......... .......... .......... .......... .......... 29% 276M 0s 2024-09-12T00:54:00.923 INFO:teuthology.orchestra.run.smithi019.stderr: 27700K .......... .......... .......... .......... .......... 29% 128M 0s 2024-09-12T00:54:00.923 INFO:teuthology.orchestra.run.smithi019.stderr: 27750K .......... .......... .......... .......... .......... 29% 101M 0s 2024-09-12T00:54:00.923 INFO:teuthology.orchestra.run.smithi019.stderr: 27800K .......... .......... .......... .......... .......... 29% 155M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 27850K .......... .......... .......... .......... .......... 30% 291M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 27900K .......... .......... .......... .......... .......... 30% 144M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 27950K .......... .......... .......... .......... .......... 30% 245M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 28000K .......... .......... .......... .......... .......... 30% 325M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 28050K .......... .......... .......... .......... .......... 30% 128M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 28100K .......... .......... .......... .......... .......... 30% 276M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 28150K .......... .......... .......... .......... .......... 30% 322M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 28200K .......... .......... .......... .......... .......... 30% 24.9M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 28250K .......... .......... .......... .......... .......... 30% 16.7M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 28300K .......... .......... .......... .......... .......... 30% 22.1M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 28350K .......... .......... .......... .......... .......... 30% 153M 0s 2024-09-12T00:54:00.924 INFO:teuthology.orchestra.run.smithi019.stderr: 28400K .......... .......... .......... .......... .......... 30% 210M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 28450K .......... .......... .......... .......... .......... 30% 59.7M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 28500K .......... .......... .......... .......... .......... 30% 196M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 28550K .......... .......... .......... .......... .......... 30% 209M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 28600K .......... .......... .......... .......... .......... 30% 224M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 28650K .......... .......... .......... .......... .......... 30% 226M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 28700K .......... .......... .......... .......... .......... 30% 184M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 28750K .......... .......... .......... .......... .......... 31% 213M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 28800K .......... .......... .......... .......... .......... 31% 219M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 28850K .......... .......... .......... .......... .......... 31% 217M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 28900K .......... .......... .......... .......... .......... 31% 200M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 28950K .......... .......... .......... .......... .......... 31% 222M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 29000K .......... .......... .......... .......... .......... 31% 229M 0s 2024-09-12T00:54:00.925 INFO:teuthology.orchestra.run.smithi019.stderr: 29050K .......... .......... .......... .......... .......... 31% 231M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29100K .......... .......... .......... .......... .......... 31% 184M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29150K .......... .......... .......... .......... .......... 31% 222M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29200K .......... .......... .......... .......... .......... 31% 215M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29250K .......... .......... .......... .......... .......... 31% 224M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29300K .......... .......... .......... .......... .......... 31% 201M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29350K .......... .......... .......... .......... .......... 31% 196M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29400K .......... .......... .......... .......... .......... 31% 226M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29450K .......... .......... .......... .......... .......... 31% 229M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29500K .......... .......... .......... .......... .......... 31% 186M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29550K .......... .......... .......... .......... .......... 31% 210M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29600K .......... .......... .......... .......... .......... 31% 214M 0s 2024-09-12T00:54:00.926 INFO:teuthology.orchestra.run.smithi019.stderr: 29650K .......... .......... .......... .......... .......... 31% 207M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 29700K .......... .......... .......... .......... .......... 32% 203M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 29750K .......... .......... .......... .......... .......... 32% 208M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 29800K .......... .......... .......... .......... .......... 32% 179M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 29850K .......... .......... .......... .......... .......... 32% 224M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 29900K .......... .......... .......... .......... .......... 32% 190M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 29950K .......... .......... .......... .......... .......... 32% 206M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 30000K .......... .......... .......... .......... .......... 32% 222M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 30050K .......... .......... .......... .......... .......... 32% 217M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 30100K .......... .......... .......... .......... .......... 32% 203M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 30150K .......... .......... .......... .......... .......... 32% 221M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 30200K .......... .......... .......... .......... .......... 32% 93.6M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 30250K .......... .......... .......... .......... .......... 32% 230M 0s 2024-09-12T00:54:00.927 INFO:teuthology.orchestra.run.smithi019.stderr: 30300K .......... .......... .......... .......... .......... 32% 189M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30350K .......... .......... .......... .......... .......... 32% 217M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30400K .......... .......... .......... .......... .......... 32% 230M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30450K .......... .......... .......... .......... .......... 32% 228M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30500K .......... .......... .......... .......... .......... 32% 210M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30550K .......... .......... .......... .......... .......... 32% 224M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30600K .......... .......... .......... .......... .......... 32% 232M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30650K .......... .......... .......... .......... .......... 33% 237M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30700K .......... .......... .......... .......... .......... 33% 40.7M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30750K .......... .......... .......... .......... .......... 33% 179M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30800K .......... .......... .......... .......... .......... 33% 213M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30850K .......... .......... .......... .......... .......... 33% 219M 0s 2024-09-12T00:54:00.928 INFO:teuthology.orchestra.run.smithi019.stderr: 30900K .......... .......... .......... .......... .......... 33% 229M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 30950K .......... .......... .......... .......... .......... 33% 208M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31000K .......... .......... .......... .......... .......... 33% 213M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31050K .......... .......... .......... .......... .......... 33% 233M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31100K .......... .......... .......... .......... .......... 33% 39.3M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31150K .......... .......... .......... .......... .......... 33% 182M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31200K .......... .......... .......... .......... .......... 33% 232M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31250K .......... .......... .......... .......... .......... 33% 78.8M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31300K .......... .......... .......... .......... .......... 33% 225M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31350K .......... .......... .......... .......... .......... 33% 18.8M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31400K .......... .......... .......... .......... .......... 33% 193M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31450K .......... .......... .......... .......... .......... 33% 215M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31500K .......... .......... .......... .......... .......... 33% 209M 0s 2024-09-12T00:54:00.929 INFO:teuthology.orchestra.run.smithi019.stderr: 31550K .......... .......... .......... .......... .......... 34% 183M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 31600K .......... .......... .......... .......... .......... 34% 224M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 31650K .......... .......... .......... .......... .......... 34% 218M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 31700K .......... .......... .......... .......... .......... 34% 210M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 31750K .......... .......... .......... .......... .......... 34% 204M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 31800K .......... .......... .......... .......... .......... 34% 228M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 31850K .......... .......... .......... .......... .......... 34% 317M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 31900K .......... .......... .......... .......... .......... 34% 353M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 31950K .......... .......... .......... .......... .......... 34% 277M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 32000K .......... .......... .......... .......... .......... 34% 350M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 32050K .......... .......... .......... .......... .......... 34% 320M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 32100K .......... .......... .......... .......... .......... 34% 280M 0s 2024-09-12T00:54:00.930 INFO:teuthology.orchestra.run.smithi019.stderr: 32150K .......... .......... .......... .......... .......... 34% 258M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32200K .......... .......... .......... .......... .......... 34% 308M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32250K .......... .......... .......... .......... .......... 34% 320M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32300K .......... .......... .......... .......... .......... 34% 299M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32350K .......... .......... .......... .......... .......... 34% 284M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32400K .......... .......... .......... .......... .......... 34% 321M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32450K .......... .......... .......... .......... .......... 34% 361M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32500K .......... .......... .......... .......... .......... 35% 339M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32550K .......... .......... .......... .......... .......... 35% 289M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32600K .......... .......... .......... .......... .......... 35% 302M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32650K .......... .......... .......... .......... .......... 35% 348M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32700K .......... .......... .......... .......... .......... 35% 318M 0s 2024-09-12T00:54:00.931 INFO:teuthology.orchestra.run.smithi019.stderr: 32750K .......... .......... .......... .......... .......... 35% 290M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 32800K .......... .......... .......... .......... .......... 35% 298M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 32850K .......... .......... .......... .......... .......... 35% 325M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 32900K .......... .......... .......... .......... .......... 35% 309M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 32950K .......... .......... .......... .......... .......... 35% 261M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 33000K .......... .......... .......... .......... .......... 35% 347M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 33050K .......... .......... .......... .......... .......... 35% 317M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 33100K .......... .......... .......... .......... .......... 35% 323M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 33150K .......... .......... .......... .......... .......... 35% 296M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 33200K .......... .......... .......... .......... .......... 35% 323M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 33250K .......... .......... .......... .......... .......... 35% 257M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 33300K .......... .......... .......... .......... .......... 35% 316M 0s 2024-09-12T00:54:00.932 INFO:teuthology.orchestra.run.smithi019.stderr: 33350K .......... .......... .......... .......... .......... 35% 300M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33400K .......... .......... .......... .......... .......... 36% 304M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33450K .......... .......... .......... .......... .......... 36% 281M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33500K .......... .......... .......... .......... .......... 36% 319M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33550K .......... .......... .......... .......... .......... 36% 260M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33600K .......... .......... .......... .......... .......... 36% 279M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33650K .......... .......... .......... .......... .......... 36% 304M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33700K .......... .......... .......... .......... .......... 36% 316M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33750K .......... .......... .......... .......... .......... 36% 284M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33800K .......... .......... .......... .......... .......... 36% 327M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33850K .......... .......... .......... .......... .......... 36% 286M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33900K .......... .......... .......... .......... .......... 36% 312M 0s 2024-09-12T00:54:00.933 INFO:teuthology.orchestra.run.smithi019.stderr: 33950K .......... .......... .......... .......... .......... 36% 273M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34000K .......... .......... .......... .......... .......... 36% 295M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34050K .......... .......... .......... .......... .......... 36% 346M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34100K .......... .......... .......... .......... .......... 36% 356M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34150K .......... .......... .......... .......... .......... 36% 306M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34200K .......... .......... .......... .......... .......... 36% 315M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34250K .......... .......... .......... .......... .......... 36% 305M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34300K .......... .......... .......... .......... .......... 36% 312M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34350K .......... .......... .......... .......... .......... 37% 22.0M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34400K .......... .......... .......... .......... .......... 37% 69.6M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34450K .......... .......... .......... .......... .......... 37% 298M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34500K .......... .......... .......... .......... .......... 37% 308M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34550K .......... .......... .......... .......... .......... 37% 277M 0s 2024-09-12T00:54:00.934 INFO:teuthology.orchestra.run.smithi019.stderr: 34600K .......... .......... .......... .......... .......... 37% 297M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 34650K .......... .......... .......... .......... .......... 37% 310M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 34700K .......... .......... .......... .......... .......... 37% 260M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 34750K .......... .......... .......... .......... .......... 37% 257M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 34800K .......... .......... .......... .......... .......... 37% 279M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 34850K .......... .......... .......... .......... .......... 37% 341M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 34900K .......... .......... .......... .......... .......... 37% 310M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 34950K .......... .......... .......... .......... .......... 37% 288M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 35000K .......... .......... .......... .......... .......... 37% 316M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 35050K .......... .......... .......... .......... .......... 37% 326M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 35100K .......... .......... .......... .......... .......... 37% 310M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 35150K .......... .......... .......... .......... .......... 37% 273M 0s 2024-09-12T00:54:00.935 INFO:teuthology.orchestra.run.smithi019.stderr: 35200K .......... .......... .......... .......... .......... 37% 326M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35250K .......... .......... .......... .......... .......... 37% 330M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35300K .......... .......... .......... .......... .......... 38% 337M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35350K .......... .......... .......... .......... .......... 38% 315M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35400K .......... .......... .......... .......... .......... 38% 341M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35450K .......... .......... .......... .......... .......... 38% 327M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35500K .......... .......... .......... .......... .......... 38% 326M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35550K .......... .......... .......... .......... .......... 38% 255M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35600K .......... .......... .......... .......... .......... 38% 297M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35650K .......... .......... .......... .......... .......... 38% 313M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35700K .......... .......... .......... .......... .......... 38% 319M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35750K .......... .......... .......... .......... .......... 38% 236M 0s 2024-09-12T00:54:00.936 INFO:teuthology.orchestra.run.smithi019.stderr: 35800K .......... .......... .......... .......... .......... 38% 306M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 35850K .......... .......... .......... .......... .......... 38% 307M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 35900K .......... .......... .......... .......... .......... 38% 304M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 35950K .......... .......... .......... .......... .......... 38% 264M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 36000K .......... .......... .......... .......... .......... 38% 323M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 36050K .......... .......... .......... .......... .......... 38% 312M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 36100K .......... .......... .......... .......... .......... 38% 308M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 36150K .......... .......... .......... .......... .......... 38% 264M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 36200K .......... .......... .......... .......... .......... 39% 299M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 36250K .......... .......... .......... .......... .......... 39% 296M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 36300K .......... .......... .......... .......... .......... 39% 336M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 36350K .......... .......... .......... .......... .......... 39% 281M 0s 2024-09-12T00:54:00.937 INFO:teuthology.orchestra.run.smithi019.stderr: 36400K .......... .......... .......... .......... .......... 39% 326M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 36450K .......... .......... .......... .......... .......... 39% 305M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 36500K .......... .......... .......... .......... .......... 39% 341M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 36550K .......... .......... .......... .......... .......... 39% 294M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 36600K .......... .......... .......... .......... .......... 39% 316M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 36650K .......... .......... .......... .......... .......... 39% 370M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 36700K .......... .......... .......... .......... .......... 39% 352M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 36750K .......... .......... .......... .......... .......... 39% 305M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 36800K .......... .......... .......... .......... .......... 39% 343M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 36850K .......... .......... .......... .......... .......... 39% 303M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 36900K .......... .......... .......... .......... .......... 39% 325M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 36950K .......... .......... .......... .......... .......... 39% 299M 0s 2024-09-12T00:54:00.938 INFO:teuthology.orchestra.run.smithi019.stderr: 37000K .......... .......... .......... .......... .......... 39% 313M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37050K .......... .......... .......... .......... .......... 39% 317M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37100K .......... .......... .......... .......... .......... 39% 308M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37150K .......... .......... .......... .......... .......... 40% 46.8M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37200K .......... .......... .......... .......... .......... 40% 314M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37250K .......... .......... .......... .......... .......... 40% 304M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37300K .......... .......... .......... .......... .......... 40% 318M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37350K .......... .......... .......... .......... .......... 40% 282M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37400K .......... .......... .......... .......... .......... 40% 219M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37450K .......... .......... .......... .......... .......... 40% 54.5M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37500K .......... .......... .......... .......... .......... 40% 249M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37550K .......... .......... .......... .......... .......... 40% 176M 0s 2024-09-12T00:54:00.939 INFO:teuthology.orchestra.run.smithi019.stderr: 37600K .......... .......... .......... .......... .......... 40% 368M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 37650K .......... .......... .......... .......... .......... 40% 185M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 37700K .......... .......... .......... .......... .......... 40% 311M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 37750K .......... .......... .......... .......... .......... 40% 283M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 37800K .......... .......... .......... .......... .......... 40% 173M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 37850K .......... .......... .......... .......... .......... 40% 349M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 37900K .......... .......... .......... .......... .......... 40% 317M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 37950K .......... .......... .......... .......... .......... 40% 277M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 38000K .......... .......... .......... .......... .......... 40% 364M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 38050K .......... .......... .......... .......... .......... 41% 330M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 38100K .......... .......... .......... .......... .......... 41% 366M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 38150K .......... .......... .......... .......... .......... 41% 297M 0s 2024-09-12T00:54:00.940 INFO:teuthology.orchestra.run.smithi019.stderr: 38200K .......... .......... .......... .......... .......... 41% 335M 0s 2024-09-12T00:54:00.941 INFO:teuthology.orchestra.run.smithi019.stderr: 38250K .......... .......... .......... .......... .......... 41% 339M 0s 2024-09-12T00:54:00.941 INFO:teuthology.orchestra.run.smithi019.stderr: 38300K .......... .......... .......... .......... .......... 41% 303M 0s 2024-09-12T00:54:00.941 INFO:teuthology.orchestra.run.smithi019.stderr: 38350K .......... .......... .......... .......... .......... 41% 266M 0s 2024-09-12T00:54:00.941 INFO:teuthology.orchestra.run.smithi019.stderr: 38400K .......... .......... .......... .......... .......... 41% 325M 0s 2024-09-12T00:54:00.941 INFO:teuthology.orchestra.run.smithi019.stderr: 38450K .......... .......... .......... .......... .......... 41% 324M 0s 2024-09-12T00:54:00.941 INFO:teuthology.orchestra.run.smithi019.stderr: 38500K .......... .......... .......... .......... .......... 41% 125M 0s 2024-09-12T00:54:00.941 INFO:teuthology.orchestra.run.smithi019.stderr: 38550K .......... .......... .......... .......... .......... 41% 288M 0s 2024-09-12T00:54:00.941 INFO:teuthology.orchestra.run.smithi019.stderr: 38600K .......... .......... .......... .......... .......... 41% 308M 0s 2024-09-12T00:54:00.941 INFO:teuthology.orchestra.run.smithi019.stderr: 38650K .......... .......... .......... .......... .......... 41% 316M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 38700K .......... .......... .......... .......... .......... 41% 317M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 38750K .......... .......... .......... .......... .......... 41% 275M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 38800K .......... .......... .......... .......... .......... 41% 269M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 38850K .......... .......... .......... .......... .......... 41% 344M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 38900K .......... .......... .......... .......... .......... 41% 272M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 38950K .......... .......... .......... .......... .......... 41% 288M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 39000K .......... .......... .......... .......... .......... 42% 309M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 39050K .......... .......... .......... .......... .......... 42% 315M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 39100K .......... .......... .......... .......... .......... 42% 324M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 39150K .......... .......... .......... .......... .......... 42% 268M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 39200K .......... .......... .......... .......... .......... 42% 307M 0s 2024-09-12T00:54:00.942 INFO:teuthology.orchestra.run.smithi019.stderr: 39250K .......... .......... .......... .......... .......... 42% 363M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39300K .......... .......... .......... .......... .......... 42% 346M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39350K .......... .......... .......... .......... .......... 42% 344M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39400K .......... .......... .......... .......... .......... 42% 354M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39450K .......... .......... .......... .......... .......... 42% 334M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39500K .......... .......... .......... .......... .......... 42% 316M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39550K .......... .......... .......... .......... .......... 42% 265M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39600K .......... .......... .......... .......... .......... 42% 310M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39650K .......... .......... .......... .......... .......... 42% 306M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39700K .......... .......... .......... .......... .......... 42% 337M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39750K .......... .......... .......... .......... .......... 42% 294M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39800K .......... .......... .......... .......... .......... 42% 143M 0s 2024-09-12T00:54:00.943 INFO:teuthology.orchestra.run.smithi019.stderr: 39850K .......... .......... .......... .......... .......... 42% 279M 0s 2024-09-12T00:54:00.944 INFO:teuthology.orchestra.run.smithi019.stderr: 39900K .......... .......... .......... .......... .......... 43% 312M 0s 2024-09-12T00:54:00.944 INFO:teuthology.orchestra.run.smithi019.stderr: 39950K .......... .......... .......... .......... .......... 43% 264M 0s 2024-09-12T00:54:00.944 INFO:teuthology.orchestra.run.smithi019.stderr: 40000K .......... .......... .......... .......... .......... 43% 318M 0s 2024-09-12T00:54:00.944 INFO:teuthology.orchestra.run.smithi019.stderr: 40050K .......... .......... .......... .......... .......... 43% 69.6M 0s 2024-09-12T00:54:00.944 INFO:teuthology.orchestra.run.smithi019.stderr: 40100K .......... .......... .......... .......... .......... 43% 290M 0s 2024-09-12T00:54:00.944 INFO:teuthology.orchestra.run.smithi019.stderr: 40150K .......... .......... .......... .......... .......... 43% 301M 0s 2024-09-12T00:54:00.944 INFO:teuthology.orchestra.run.smithi019.stderr: 40200K .......... .......... .......... .......... .......... 43% 253M 0s 2024-09-12T00:54:00.944 INFO:teuthology.orchestra.run.smithi019.stderr: 40250K .......... .......... .......... .......... .......... 43% 285M 0s 2024-09-12T00:54:00.944 INFO:teuthology.orchestra.run.smithi019.stderr: 40300K .......... .......... .......... .......... .......... 43% 293M 0s 2024-09-12T00:54:00.944 INFO:teuthology.orchestra.run.smithi019.stderr: 40350K .......... .......... .......... .......... .......... 43% 192M 0s 2024-09-12T00:54:00.944 INFO:teuthology.orchestra.run.smithi019.stderr: 40400K .......... .......... .......... .......... .......... 43% 320M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 40450K .......... .......... .......... .......... .......... 43% 302M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 40500K .......... .......... .......... .......... .......... 43% 108M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 40550K .......... .......... .......... .......... .......... 43% 273M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 40600K .......... .......... .......... .......... .......... 43% 181M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 40650K .......... .......... .......... .......... .......... 43% 152M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 40700K .......... .......... .......... .......... .......... 43% 76.1M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 40750K .......... .......... .......... .......... .......... 43% 154M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 40800K .......... .......... .......... .......... .......... 43% 205M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 40850K .......... .......... .......... .......... .......... 44% 196M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 40900K .......... .......... .......... .......... .......... 44% 172M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 40950K .......... .......... .......... .......... .......... 44% 250M 0s 2024-09-12T00:54:00.945 INFO:teuthology.orchestra.run.smithi019.stderr: 41000K .......... .......... .......... .......... .......... 44% 342M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41050K .......... .......... .......... .......... .......... 44% 368M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41100K .......... .......... .......... .......... .......... 44% 286M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41150K .......... .......... .......... .......... .......... 44% 285M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41200K .......... .......... .......... .......... .......... 44% 245M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41250K .......... .......... .......... .......... .......... 44% 321M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41300K .......... .......... .......... .......... .......... 44% 267M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41350K .......... .......... .......... .......... .......... 44% 256M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41400K .......... .......... .......... .......... .......... 44% 265M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41450K .......... .......... .......... .......... .......... 44% 296M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41500K .......... .......... .......... .......... .......... 44% 255M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41550K .......... .......... .......... .......... .......... 44% 290M 0s 2024-09-12T00:54:00.946 INFO:teuthology.orchestra.run.smithi019.stderr: 41600K .......... .......... .......... .......... .......... 44% 306M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 41650K .......... .......... .......... .......... .......... 44% 272M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 41700K .......... .......... .......... .......... .......... 44% 267M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 41750K .......... .......... .......... .......... .......... 44% 287M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 41800K .......... .......... .......... .......... .......... 45% 237M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 41850K .......... .......... .......... .......... .......... 45% 270M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 41900K .......... .......... .......... .......... .......... 45% 289M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 41950K .......... .......... .......... .......... .......... 45% 323M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 42000K .......... .......... .......... .......... .......... 45% 309M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 42050K .......... .......... .......... .......... .......... 45% 314M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 42100K .......... .......... .......... .......... .......... 45% 290M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 42150K .......... .......... .......... .......... .......... 45% 321M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 42200K .......... .......... .......... .......... .......... 45% 328M 0s 2024-09-12T00:54:00.947 INFO:teuthology.orchestra.run.smithi019.stderr: 42250K .......... .......... .......... .......... .......... 45% 341M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42300K .......... .......... .......... .......... .......... 45% 266M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42350K .......... .......... .......... .......... .......... 45% 336M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42400K .......... .......... .......... .......... .......... 45% 204M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42450K .......... .......... .......... .......... .......... 45% 96.5M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42500K .......... .......... .......... .......... .......... 45% 81.6M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42550K .......... .......... .......... .......... .......... 45% 330M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42600K .......... .......... .......... .......... .......... 45% 322M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42650K .......... .......... .......... .......... .......... 45% 110M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42700K .......... .......... .......... .......... .......... 46% 59.9M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42750K .......... .......... .......... .......... .......... 46% 281M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42800K .......... .......... .......... .......... .......... 46% 312M 0s 2024-09-12T00:54:00.948 INFO:teuthology.orchestra.run.smithi019.stderr: 42850K .......... .......... .......... .......... .......... 46% 274M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 42900K .......... .......... .......... .......... .......... 46% 76.9M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 42950K .......... .......... .......... .......... .......... 46% 254M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 43000K .......... .......... .......... .......... .......... 46% 294M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 43050K .......... .......... .......... .......... .......... 46% 340M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 43100K .......... .......... .......... .......... .......... 46% 358M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 43150K .......... .......... .......... .......... .......... 46% 283M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 43200K .......... .......... .......... .......... .......... 46% 326M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 43250K .......... .......... .......... .......... .......... 46% 300M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 43300K .......... .......... .......... .......... .......... 46% 310M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 43350K .......... .......... .......... .......... .......... 46% 296M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 43400K .......... .......... .......... .......... .......... 46% 315M 0s 2024-09-12T00:54:00.949 INFO:teuthology.orchestra.run.smithi019.stderr: 43450K .......... .......... .......... .......... .......... 46% 371M 0s 2024-09-12T00:54:00.950 INFO:teuthology.orchestra.run.smithi019.stderr: 43500K .......... .......... .......... .......... .......... 46% 90.3M 0s 2024-09-12T00:54:00.950 INFO:teuthology.orchestra.run.smithi019.stderr: 43550K .......... .......... .......... .......... .......... 46% 241M 0s 2024-09-12T00:54:00.950 INFO:teuthology.orchestra.run.smithi019.stderr: 43600K .......... .......... .......... .......... .......... 46% 305M 0s 2024-09-12T00:54:00.950 INFO:teuthology.orchestra.run.smithi019.stderr: 43650K .......... .......... .......... .......... .......... 47% 249M 0s 2024-09-12T00:54:00.950 INFO:teuthology.orchestra.run.smithi019.stderr: 43700K .......... .......... .......... .......... .......... 47% 334M 0s 2024-09-12T00:54:00.950 INFO:teuthology.orchestra.run.smithi019.stderr: 43750K .......... .......... .......... .......... .......... 47% 263M 0s 2024-09-12T00:54:00.950 INFO:teuthology.orchestra.run.smithi019.stderr: 43800K .......... .......... .......... .......... .......... 47% 309M 0s 2024-09-12T00:54:00.950 INFO:teuthology.orchestra.run.smithi019.stderr: 43850K .......... .......... .......... .......... .......... 47% 307M 0s 2024-09-12T00:54:00.950 INFO:teuthology.orchestra.run.smithi019.stderr: 43900K .......... .......... .......... .......... .......... 47% 339M 0s 2024-09-12T00:54:00.950 INFO:teuthology.orchestra.run.smithi019.stderr: 43950K .......... .......... .......... .......... .......... 47% 297M 0s 2024-09-12T00:54:00.950 INFO:teuthology.orchestra.run.smithi019.stderr: 44000K .......... .......... .......... .......... .......... 47% 325M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44050K .......... .......... .......... .......... .......... 47% 318M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44100K .......... .......... .......... .......... .......... 47% 328M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44150K .......... .......... .......... .......... .......... 47% 263M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44200K .......... .......... .......... .......... .......... 47% 345M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44250K .......... .......... .......... .......... .......... 47% 331M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44300K .......... .......... .......... .......... .......... 47% 317M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44350K .......... .......... .......... .......... .......... 47% 284M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44400K .......... .......... .......... .......... .......... 47% 261M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44450K .......... .......... .......... .......... .......... 47% 304M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44500K .......... .......... .......... .......... .......... 47% 339M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44550K .......... .......... .......... .......... .......... 48% 317M 0s 2024-09-12T00:54:00.951 INFO:teuthology.orchestra.run.smithi019.stderr: 44600K .......... .......... .......... .......... .......... 48% 298M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 44650K .......... .......... .......... .......... .......... 48% 43.4M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 44700K .......... .......... .......... .......... .......... 48% 286M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 44750K .......... .......... .......... .......... .......... 48% 329M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 44800K .......... .......... .......... .......... .......... 48% 91.7M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 44850K .......... .......... .......... .......... .......... 48% 272M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 44900K .......... .......... .......... .......... .......... 48% 299M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 44950K .......... .......... .......... .......... .......... 48% 301M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 45000K .......... .......... .......... .......... .......... 48% 260M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 45050K .......... .......... .......... .......... .......... 48% 53.8M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 45100K .......... .......... .......... .......... .......... 48% 330M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 45150K .......... .......... .......... .......... .......... 48% 277M 0s 2024-09-12T00:54:00.952 INFO:teuthology.orchestra.run.smithi019.stderr: 45200K .......... .......... .......... .......... .......... 48% 324M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45250K .......... .......... .......... .......... .......... 48% 329M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45300K .......... .......... .......... .......... .......... 48% 343M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45350K .......... .......... .......... .......... .......... 48% 95.3M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45400K .......... .......... .......... .......... .......... 48% 284M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45450K .......... .......... .......... .......... .......... 48% 353M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45500K .......... .......... .......... .......... .......... 49% 339M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45550K .......... .......... .......... .......... .......... 49% 336M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45600K .......... .......... .......... .......... .......... 49% 72.8M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45650K .......... .......... .......... .......... .......... 49% 299M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45700K .......... .......... .......... .......... .......... 49% 320M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45750K .......... .......... .......... .......... .......... 49% 266M 0s 2024-09-12T00:54:00.953 INFO:teuthology.orchestra.run.smithi019.stderr: 45800K .......... .......... .......... .......... .......... 49% 344M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 45850K .......... .......... .......... .......... .......... 49% 266M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 45900K .......... .......... .......... .......... .......... 49% 315M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 45950K .......... .......... .......... .......... .......... 49% 341M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 46000K .......... .......... .......... .......... .......... 49% 22.3M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 46050K .......... .......... .......... .......... .......... 49% 258M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 46100K .......... .......... .......... .......... .......... 49% 270M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 46150K .......... .......... .......... .......... .......... 49% 235M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 46200K .......... .......... .......... .......... .......... 49% 355M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 46250K .......... .......... .......... .......... .......... 49% 291M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 46300K .......... .......... .......... .......... .......... 49% 250M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 46350K .......... .......... .......... .......... .......... 49% 357M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 46400K .......... .......... .......... .......... .......... 49% 131M 0s 2024-09-12T00:54:00.954 INFO:teuthology.orchestra.run.smithi019.stderr: 46450K .......... .......... .......... .......... .......... 50% 330M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 46500K .......... .......... .......... .......... .......... 50% 309M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 46550K .......... .......... .......... .......... .......... 50% 322M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 46600K .......... .......... .......... .......... .......... 50% 138M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 46650K .......... .......... .......... .......... .......... 50% 298M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 46700K .......... .......... .......... .......... .......... 50% 309M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 46750K .......... .......... .......... .......... .......... 50% 259M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 46800K .......... .......... .......... .......... .......... 50% 254M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 46850K .......... .......... .......... .......... .......... 50% 246M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 46900K .......... .......... .......... .......... .......... 50% 316M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 46950K .......... .......... .......... .......... .......... 50% 294M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 47000K .......... .......... .......... .......... .......... 50% 338M 0s 2024-09-12T00:54:00.955 INFO:teuthology.orchestra.run.smithi019.stderr: 47050K .......... .......... .......... .......... .......... 50% 345M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47100K .......... .......... .......... .......... .......... 50% 302M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47150K .......... .......... .......... .......... .......... 50% 310M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47200K .......... .......... .......... .......... .......... 50% 54.2M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47250K .......... .......... .......... .......... .......... 50% 293M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47300K .......... .......... .......... .......... .......... 50% 70.3M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47350K .......... .......... .......... .......... .......... 51% 326M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47400K .......... .......... .......... .......... .......... 51% 353M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47450K .......... .......... .......... .......... .......... 51% 16.7M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47500K .......... .......... .......... .......... .......... 51% 113M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47550K .......... .......... .......... .......... .......... 51% 316M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47600K .......... .......... .......... .......... .......... 51% 311M 0s 2024-09-12T00:54:00.956 INFO:teuthology.orchestra.run.smithi019.stderr: 47650K .......... .......... .......... .......... .......... 51% 269M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 47700K .......... .......... .......... .......... .......... 51% 251M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 47750K .......... .......... .......... .......... .......... 51% 255M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 47800K .......... .......... .......... .......... .......... 51% 298M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 47850K .......... .......... .......... .......... .......... 51% 285M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 47900K .......... .......... .......... .......... .......... 51% 322M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 47950K .......... .......... .......... .......... .......... 51% 297M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 48000K .......... .......... .......... .......... .......... 51% 307M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 48050K .......... .......... .......... .......... .......... 51% 281M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 48100K .......... .......... .......... .......... .......... 51% 289M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 48150K .......... .......... .......... .......... .......... 51% 357M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 48200K .......... .......... .......... .......... .......... 51% 262M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 48250K .......... .......... .......... .......... .......... 51% 330M 0s 2024-09-12T00:54:00.957 INFO:teuthology.orchestra.run.smithi019.stderr: 48300K .......... .......... .......... .......... .......... 52% 301M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48350K .......... .......... .......... .......... .......... 52% 297M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48400K .......... .......... .......... .......... .......... 52% 283M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48450K .......... .......... .......... .......... .......... 52% 326M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48500K .......... .......... .......... .......... .......... 52% 316M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48550K .......... .......... .......... .......... .......... 52% 329M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48600K .......... .......... .......... .......... .......... 52% 270M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48650K .......... .......... .......... .......... .......... 52% 347M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48700K .......... .......... .......... .......... .......... 52% 293M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48750K .......... .......... .......... .......... .......... 52% 335M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48800K .......... .......... .......... .......... .......... 52% 328M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48850K .......... .......... .......... .......... .......... 52% 311M 0s 2024-09-12T00:54:00.958 INFO:teuthology.orchestra.run.smithi019.stderr: 48900K .......... .......... .......... .......... .......... 52% 286M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 48950K .......... .......... .......... .......... .......... 52% 315M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 49000K .......... .......... .......... .......... .......... 52% 374M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 49050K .......... .......... .......... .......... .......... 52% 368M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 49100K .......... .......... .......... .......... .......... 52% 380M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 49150K .......... .......... .......... .......... .......... 52% 310M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 49200K .......... .......... .......... .......... .......... 53% 339M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 49250K .......... .......... .......... .......... .......... 53% 375M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 49300K .......... .......... .......... .......... .......... 53% 374M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 49350K .......... .......... .......... .......... .......... 53% 354M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 49400K .......... .......... .......... .......... .......... 53% 336M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 49450K .......... .......... .......... .......... .......... 53% 381M 0s 2024-09-12T00:54:00.959 INFO:teuthology.orchestra.run.smithi019.stderr: 49500K .......... .......... .......... .......... .......... 53% 381M 0s 2024-09-12T00:54:00.960 INFO:teuthology.orchestra.run.smithi019.stderr: 49550K .......... .......... .......... .......... .......... 53% 353M 0s 2024-09-12T00:54:00.960 INFO:teuthology.orchestra.run.smithi019.stderr: 49600K .......... .......... .......... .......... .......... 53% 348M 0s 2024-09-12T00:54:00.960 INFO:teuthology.orchestra.run.smithi019.stderr: 49650K .......... .......... .......... .......... .......... 53% 385M 0s 2024-09-12T00:54:00.960 INFO:teuthology.orchestra.run.smithi019.stderr: 49700K .......... .......... .......... .......... .......... 53% 383M 0s 2024-09-12T00:54:00.960 INFO:teuthology.orchestra.run.smithi019.stderr: 49750K .......... .......... .......... .......... .......... 53% 390M 0s 2024-09-12T00:54:00.960 INFO:teuthology.orchestra.run.smithi019.stderr: 49800K .......... .......... .......... .......... .......... 53% 255M 0s 2024-09-12T00:54:00.960 INFO:teuthology.orchestra.run.smithi019.stderr: 49850K .......... .......... .......... .......... .......... 53% 306M 0s 2024-09-12T00:54:00.960 INFO:teuthology.orchestra.run.smithi019.stderr: 49900K .......... .......... .......... .......... .......... 53% 307M 0s 2024-09-12T00:54:00.960 INFO:teuthology.orchestra.run.smithi019.stderr: 49950K .......... .......... .......... .......... .......... 53% 299M 0s 2024-09-12T00:54:00.960 INFO:teuthology.orchestra.run.smithi019.stderr: 50000K .......... .......... .......... .......... .......... 53% 328M 0s 2024-09-12T00:54:00.960 INFO:teuthology.orchestra.run.smithi019.stderr: 50050K .......... .......... .......... .......... .......... 53% 312M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50100K .......... .......... .......... .......... .......... 53% 280M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50150K .......... .......... .......... .......... .......... 54% 348M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50200K .......... .......... .......... .......... .......... 54% 366M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50250K .......... .......... .......... .......... .......... 54% 349M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50300K .......... .......... .......... .......... .......... 54% 298M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50350K .......... .......... .......... .......... .......... 54% 317M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50400K .......... .......... .......... .......... .......... 54% 328M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50450K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50500K .......... .......... .......... .......... .......... 54% 280M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50550K .......... .......... .......... .......... .......... 54% 20.0M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50600K .......... .......... .......... .......... .......... 54% 337M 0s 2024-09-12T00:54:00.961 INFO:teuthology.orchestra.run.smithi019.stderr: 50650K .......... .......... .......... .......... .......... 54% 319M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 50700K .......... .......... .......... .......... .......... 54% 297M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 50750K .......... .......... .......... .......... .......... 54% 288M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 50800K .......... .......... .......... .......... .......... 54% 317M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 50850K .......... .......... .......... .......... .......... 54% 270M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 50900K .......... .......... .......... .......... .......... 54% 145M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 50950K .......... .......... .......... .......... .......... 54% 265M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 51000K .......... .......... .......... .......... .......... 54% 230M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 51050K .......... .......... .......... .......... .......... 55% 295M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 51100K .......... .......... .......... .......... .......... 55% 273M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 51150K .......... .......... .......... .......... .......... 55% 333M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 51200K .......... .......... .......... .......... .......... 55% 271M 0s 2024-09-12T00:54:00.962 INFO:teuthology.orchestra.run.smithi019.stderr: 51250K .......... .......... .......... .......... .......... 55% 325M 0s 2024-09-12T00:54:00.963 INFO:teuthology.orchestra.run.smithi019.stderr: 51300K .......... .......... .......... .......... .......... 55% 300M 0s 2024-09-12T00:54:00.963 INFO:teuthology.orchestra.run.smithi019.stderr: 51350K .......... .......... .......... .......... .......... 55% 334M 0s 2024-09-12T00:54:00.963 INFO:teuthology.orchestra.run.smithi019.stderr: 51400K .......... .......... .......... .......... .......... 55% 364M 0s 2024-09-12T00:54:00.963 INFO:teuthology.orchestra.run.smithi019.stderr: 51450K .......... .......... .......... .......... .......... 55% 319M 0s 2024-09-12T00:54:00.963 INFO:teuthology.orchestra.run.smithi019.stderr: 51500K .......... .......... .......... .......... .......... 55% 276M 0s 2024-09-12T00:54:00.963 INFO:teuthology.orchestra.run.smithi019.stderr: 51550K .......... .......... .......... .......... .......... 55% 325M 0s 2024-09-12T00:54:00.963 INFO:teuthology.orchestra.run.smithi019.stderr: 51600K .......... .......... .......... .......... .......... 55% 336M 0s 2024-09-12T00:54:00.963 INFO:teuthology.orchestra.run.smithi019.stderr: 51650K .......... .......... .......... .......... .......... 55% 294M 0s 2024-09-12T00:54:00.963 INFO:teuthology.orchestra.run.smithi019.stderr: 51700K .......... .......... .......... .......... .......... 55% 311M 0s 2024-09-12T00:54:00.963 INFO:teuthology.orchestra.run.smithi019.stderr: 51750K .......... .......... .......... .......... .......... 55% 200M 0s 2024-09-12T00:54:00.963 INFO:teuthology.orchestra.run.smithi019.stderr: 51800K .......... .......... .......... .......... .......... 55% 62.7M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 51850K .......... .......... .......... .......... .......... 55% 79.7M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 51900K .......... .......... .......... .......... .......... 55% 56.7M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 51950K .......... .......... .......... .......... .......... 55% 83.9M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 52000K .......... .......... .......... .......... .......... 56% 61.7M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 52050K .......... .......... .......... .......... .......... 56% 62.0M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 52100K .......... .......... .......... .......... .......... 56% 74.2M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 52150K .......... .......... .......... .......... .......... 56% 37.6M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 52200K .......... .......... .......... .......... .......... 56% 165M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 52250K .......... .......... .......... .......... .......... 56% 95.6M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 52300K .......... .......... .......... .......... .......... 56% 125M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 52350K .......... .......... .......... .......... .......... 56% 135M 0s 2024-09-12T00:54:00.964 INFO:teuthology.orchestra.run.smithi019.stderr: 52400K .......... .......... .......... .......... .......... 56% 121M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 52450K .......... .......... .......... .......... .......... 56% 104M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 52500K .......... .......... .......... .......... .......... 56% 144M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 52550K .......... .......... .......... .......... .......... 56% 75.9M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 52600K .......... .......... .......... .......... .......... 56% 133M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 52650K .......... .......... .......... .......... .......... 56% 120M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 52700K .......... .......... .......... .......... .......... 56% 78.4M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 52750K .......... .......... .......... .......... .......... 56% 105M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 52800K .......... .......... .......... .......... .......... 56% 85.8M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 52850K .......... .......... .......... .......... .......... 56% 304M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 52900K .......... .......... .......... .......... .......... 56% 193M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 52950K .......... .......... .......... .......... .......... 57% 127M 0s 2024-09-12T00:54:00.965 INFO:teuthology.orchestra.run.smithi019.stderr: 53000K .......... .......... .......... .......... .......... 57% 209M 0s 2024-09-12T00:54:00.966 INFO:teuthology.orchestra.run.smithi019.stderr: 53050K .......... .......... .......... .......... .......... 57% 158M 0s 2024-09-12T00:54:00.966 INFO:teuthology.orchestra.run.smithi019.stderr: 53100K .......... .......... .......... .......... .......... 57% 106M 0s 2024-09-12T00:54:00.966 INFO:teuthology.orchestra.run.smithi019.stderr: 53150K .......... .......... .......... .......... .......... 57% 100M 0s 2024-09-12T00:54:00.966 INFO:teuthology.orchestra.run.smithi019.stderr: 53200K .......... .......... .......... .......... .......... 57% 68.3M 0s 2024-09-12T00:54:00.966 INFO:teuthology.orchestra.run.smithi019.stderr: 53250K .......... .......... .......... .......... .......... 57% 305M 0s 2024-09-12T00:54:00.966 INFO:teuthology.orchestra.run.smithi019.stderr: 53300K .......... .......... .......... .......... .......... 57% 178M 0s 2024-09-12T00:54:00.966 INFO:teuthology.orchestra.run.smithi019.stderr: 53350K .......... .......... .......... .......... .......... 57% 125M 0s 2024-09-12T00:54:00.966 INFO:teuthology.orchestra.run.smithi019.stderr: 53400K .......... .......... .......... .......... .......... 57% 83.0M 0s 2024-09-12T00:54:00.966 INFO:teuthology.orchestra.run.smithi019.stderr: 53450K .......... .......... .......... .......... .......... 57% 164M 0s 2024-09-12T00:54:00.966 INFO:teuthology.orchestra.run.smithi019.stderr: 53500K .......... .......... .......... .......... .......... 57% 195M 0s 2024-09-12T00:54:00.966 INFO:teuthology.orchestra.run.smithi019.stderr: 53550K .......... .......... .......... .......... .......... 57% 124M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 53600K .......... .......... .......... .......... .......... 57% 114M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 53650K .......... .......... .......... .......... .......... 57% 239M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 53700K .......... .......... .......... .......... .......... 57% 125M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 53750K .......... .......... .......... .......... .......... 57% 168M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 53800K .......... .......... .......... .......... .......... 57% 240M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 53850K .......... .......... .......... .......... .......... 58% 162M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 53900K .......... .......... .......... .......... .......... 58% 121M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 53950K .......... .......... .......... .......... .......... 58% 281M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 54000K .......... .......... .......... .......... .......... 58% 113M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 54050K .......... .......... .......... .......... .......... 58% 131M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 54100K .......... .......... .......... .......... .......... 58% 65.2M 0s 2024-09-12T00:54:00.967 INFO:teuthology.orchestra.run.smithi019.stderr: 54150K .......... .......... .......... .......... .......... 58% 159M 0s 2024-09-12T00:54:00.968 INFO:teuthology.orchestra.run.smithi019.stderr: 54200K .......... .......... .......... .......... .......... 58% 59.5M 0s 2024-09-12T00:54:00.968 INFO:teuthology.orchestra.run.smithi019.stderr: 54250K .......... .......... .......... .......... .......... 58% 318M 0s 2024-09-12T00:54:00.968 INFO:teuthology.orchestra.run.smithi019.stderr: 54300K .......... .......... .......... .......... .......... 58% 85.8M 0s 2024-09-12T00:54:00.968 INFO:teuthology.orchestra.run.smithi019.stderr: 54350K .......... .......... .......... .......... .......... 58% 292M 0s 2024-09-12T00:54:00.968 INFO:teuthology.orchestra.run.smithi019.stderr: 54400K .......... .......... .......... .......... .......... 58% 149M 0s 2024-09-12T00:54:00.968 INFO:teuthology.orchestra.run.smithi019.stderr: 54450K .......... .......... .......... .......... .......... 58% 145M 0s 2024-09-12T00:54:00.968 INFO:teuthology.orchestra.run.smithi019.stderr: 54500K .......... .......... .......... .......... .......... 58% 244M 0s 2024-09-12T00:54:00.968 INFO:teuthology.orchestra.run.smithi019.stderr: 54550K .......... .......... .......... .......... .......... 58% 329M 0s 2024-09-12T00:54:00.968 INFO:teuthology.orchestra.run.smithi019.stderr: 54600K .......... .......... .......... .......... .......... 58% 109M 0s 2024-09-12T00:54:00.968 INFO:teuthology.orchestra.run.smithi019.stderr: 54650K .......... .......... .......... .......... .......... 58% 38.4M 0s 2024-09-12T00:54:00.968 INFO:teuthology.orchestra.run.smithi019.stderr: 54700K .......... .......... .......... .......... .......... 58% 275M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 54750K .......... .......... .......... .......... .......... 58% 235M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 54800K .......... .......... .......... .......... .......... 59% 89.2M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 54850K .......... .......... .......... .......... .......... 59% 62.9M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 54900K .......... .......... .......... .......... .......... 59% 180M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 54950K .......... .......... .......... .......... .......... 59% 70.5M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 55000K .......... .......... .......... .......... .......... 59% 227M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 55050K .......... .......... .......... .......... .......... 59% 220M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 55100K .......... .......... .......... .......... .......... 59% 72.7M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 55150K .......... .......... .......... .......... .......... 59% 227M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 55200K .......... .......... .......... .......... .......... 59% 57.4M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 55250K .......... .......... .......... .......... .......... 59% 212M 0s 2024-09-12T00:54:00.969 INFO:teuthology.orchestra.run.smithi019.stderr: 55300K .......... .......... .......... .......... .......... 59% 68.4M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55350K .......... .......... .......... .......... .......... 59% 224M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55400K .......... .......... .......... .......... .......... 59% 220M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55450K .......... .......... .......... .......... .......... 59% 30.8M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55500K .......... .......... .......... .......... .......... 59% 179M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55550K .......... .......... .......... .......... .......... 59% 110M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55600K .......... .......... .......... .......... .......... 59% 103M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55650K .......... .......... .......... .......... .......... 59% 212M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55700K .......... .......... .......... .......... .......... 60% 201M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55750K .......... .......... .......... .......... .......... 60% 123M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55800K .......... .......... .......... .......... .......... 60% 223M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55850K .......... .......... .......... .......... .......... 60% 212M 0s 2024-09-12T00:54:00.970 INFO:teuthology.orchestra.run.smithi019.stderr: 55900K .......... .......... .......... .......... .......... 60% 189M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 55950K .......... .......... .......... .......... .......... 60% 99.0M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56000K .......... .......... .......... .......... .......... 60% 209M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56050K .......... .......... .......... .......... .......... 60% 222M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56100K .......... .......... .......... .......... .......... 60% 67.2M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56150K .......... .......... .......... .......... .......... 60% 218M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56200K .......... .......... .......... .......... .......... 60% 229M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56250K .......... .......... .......... .......... .......... 60% 230M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56300K .......... .......... .......... .......... .......... 60% 95.6M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56350K .......... .......... .......... .......... .......... 60% 225M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56400K .......... .......... .......... .......... .......... 60% 230M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56450K .......... .......... .......... .......... .......... 60% 49.3M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56500K .......... .......... .......... .......... .......... 60% 199M 0s 2024-09-12T00:54:00.971 INFO:teuthology.orchestra.run.smithi019.stderr: 56550K .......... .......... .......... .......... .......... 60% 215M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 56600K .......... .......... .......... .......... .......... 60% 226M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 56650K .......... .......... .......... .......... .......... 61% 77.5M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 56700K .......... .......... .......... .......... .......... 61% 180M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 56750K .......... .......... .......... .......... .......... 61% 157M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 56800K .......... .......... .......... .......... .......... 61% 111M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 56850K .......... .......... .......... .......... .......... 61% 214M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 56900K .......... .......... .......... .......... .......... 61% 205M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 56950K .......... .......... .......... .......... .......... 61% 229M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 57000K .......... .......... .......... .......... .......... 61% 40.8M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 57050K .......... .......... .......... .......... .......... 61% 106M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 57100K .......... .......... .......... .......... .......... 61% 97.2M 0s 2024-09-12T00:54:00.972 INFO:teuthology.orchestra.run.smithi019.stderr: 57150K .......... .......... .......... .......... .......... 61% 52.9M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57200K .......... .......... .......... .......... .......... 61% 169M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57250K .......... .......... .......... .......... .......... 61% 226M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57300K .......... .......... .......... .......... .......... 61% 187M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57350K .......... .......... .......... .......... .......... 61% 108M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57400K .......... .......... .......... .......... .......... 61% 173M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57450K .......... .......... .......... .......... .......... 61% 46.2M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57500K .......... .......... .......... .......... .......... 61% 186M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57550K .......... .......... .......... .......... .......... 62% 80.5M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57600K .......... .......... .......... .......... .......... 62% 221M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57650K .......... .......... .......... .......... .......... 62% 231M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57700K .......... .......... .......... .......... .......... 62% 138M 0s 2024-09-12T00:54:00.973 INFO:teuthology.orchestra.run.smithi019.stderr: 57750K .......... .......... .......... .......... .......... 62% 222M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 57800K .......... .......... .......... .......... .......... 62% 224M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 57850K .......... .......... .......... .......... .......... 62% 228M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 57900K .......... .......... .......... .......... .......... 62% 101M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 57950K .......... .......... .......... .......... .......... 62% 82.7M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 58000K .......... .......... .......... .......... .......... 62% 207M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 58050K .......... .......... .......... .......... .......... 62% 162M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 58100K .......... .......... .......... .......... .......... 62% 113M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 58150K .......... .......... .......... .......... .......... 62% 219M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 58200K .......... .......... .......... .......... .......... 62% 217M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 58250K .......... .......... .......... .......... .......... 62% 91.0M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 58300K .......... .......... .......... .......... .......... 62% 150M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 58350K .......... .......... .......... .......... .......... 62% 212M 0s 2024-09-12T00:54:00.974 INFO:teuthology.orchestra.run.smithi019.stderr: 58400K .......... .......... .......... .......... .......... 62% 174M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 58450K .......... .......... .......... .......... .......... 62% 221M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 58500K .......... .......... .......... .......... .......... 63% 110M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 58550K .......... .......... .......... .......... .......... 63% 219M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 58600K .......... .......... .......... .......... .......... 63% 106M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 58650K .......... .......... .......... .......... .......... 63% 212M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 58700K .......... .......... .......... .......... .......... 63% 158M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 58750K .......... .......... .......... .......... .......... 63% 59.0M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 58800K .......... .......... .......... .......... .......... 63% 217M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 58850K .......... .......... .......... .......... .......... 63% 221M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 58900K .......... .......... .......... .......... .......... 63% 209M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 58950K .......... .......... .......... .......... .......... 63% 151M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 59000K .......... .......... .......... .......... .......... 63% 232M 0s 2024-09-12T00:54:00.975 INFO:teuthology.orchestra.run.smithi019.stderr: 59050K .......... .......... .......... .......... .......... 63% 229M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59100K .......... .......... .......... .......... .......... 63% 121M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59150K .......... .......... .......... .......... .......... 63% 79.7M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59200K .......... .......... .......... .......... .......... 63% 215M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59250K .......... .......... .......... .......... .......... 63% 139M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59300K .......... .......... .......... .......... .......... 63% 108M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59350K .......... .......... .......... .......... .......... 63% 91.7M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59400K .......... .......... .......... .......... .......... 63% 162M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59450K .......... .......... .......... .......... .......... 64% 89.0M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59500K .......... .......... .......... .......... .......... 64% 184M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59550K .......... .......... .......... .......... .......... 64% 139M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59600K .......... .......... .......... .......... .......... 64% 205M 0s 2024-09-12T00:54:00.976 INFO:teuthology.orchestra.run.smithi019.stderr: 59650K .......... .......... .......... .......... .......... 64% 195M 0s 2024-09-12T00:54:00.977 INFO:teuthology.orchestra.run.smithi019.stderr: 59700K .......... .......... .......... .......... .......... 64% 139M 0s 2024-09-12T00:54:00.977 INFO:teuthology.orchestra.run.smithi019.stderr: 59750K .......... .......... .......... .......... .......... 64% 60.4M 0s 2024-09-12T00:54:00.977 INFO:teuthology.orchestra.run.smithi019.stderr: 59800K .......... .......... .......... .......... .......... 64% 21.7M 0s 2024-09-12T00:54:00.977 INFO:teuthology.orchestra.run.smithi019.stderr: 59850K .......... .......... .......... .......... .......... 64% 205M 0s 2024-09-12T00:54:00.977 INFO:teuthology.orchestra.run.smithi019.stderr: 59900K .......... .......... .......... .......... .......... 64% 173M 0s 2024-09-12T00:54:00.977 INFO:teuthology.orchestra.run.smithi019.stderr: 59950K .......... .......... .......... .......... .......... 64% 205M 0s 2024-09-12T00:54:00.977 INFO:teuthology.orchestra.run.smithi019.stderr: 60000K .......... .......... .......... .......... .......... 64% 217M 0s 2024-09-12T00:54:00.977 INFO:teuthology.orchestra.run.smithi019.stderr: 60050K .......... .......... .......... .......... .......... 64% 218M 0s 2024-09-12T00:54:00.977 INFO:teuthology.orchestra.run.smithi019.stderr: 60100K .......... .......... .......... .......... .......... 64% 205M 0s 2024-09-12T00:54:00.977 INFO:teuthology.orchestra.run.smithi019.stderr: 60150K .......... .......... .......... .......... .......... 64% 195M 0s 2024-09-12T00:54:00.977 INFO:teuthology.orchestra.run.smithi019.stderr: 60200K .......... .......... .......... .......... .......... 64% 229M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60250K .......... .......... .......... .......... .......... 64% 221M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60300K .......... .......... .......... .......... .......... 64% 187M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60350K .......... .......... .......... .......... .......... 65% 220M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60400K .......... .......... .......... .......... .......... 65% 193M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60450K .......... .......... .......... .......... .......... 65% 215M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60500K .......... .......... .......... .......... .......... 65% 207M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60550K .......... .......... .......... .......... .......... 65% 217M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60600K .......... .......... .......... .......... .......... 65% 220M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60650K .......... .......... .......... .......... .......... 65% 218M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60700K .......... .......... .......... .......... .......... 65% 193M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60750K .......... .......... .......... .......... .......... 65% 165M 0s 2024-09-12T00:54:00.978 INFO:teuthology.orchestra.run.smithi019.stderr: 60800K .......... .......... .......... .......... .......... 65% 214M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 60850K .......... .......... .......... .......... .......... 65% 231M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 60900K .......... .......... .......... .......... .......... 65% 188M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 60950K .......... .......... .......... .......... .......... 65% 212M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 61000K .......... .......... .......... .......... .......... 65% 220M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 61050K .......... .......... .......... .......... .......... 65% 220M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 61100K .......... .......... .......... .......... .......... 65% 198M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 61150K .......... .......... .......... .......... .......... 65% 222M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 61200K .......... .......... .......... .......... .......... 65% 270M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 61250K .......... .......... .......... .......... .......... 65% 315M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 61300K .......... .......... .......... .......... .......... 66% 299M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 61350K .......... .......... .......... .......... .......... 66% 48.1M 0s 2024-09-12T00:54:00.979 INFO:teuthology.orchestra.run.smithi019.stderr: 61400K .......... .......... .......... .......... .......... 66% 19.7M 0s 2024-09-12T00:54:00.980 INFO:teuthology.orchestra.run.smithi019.stderr: 61450K .......... .......... .......... .......... .......... 66% 43.6M 0s 2024-09-12T00:54:00.980 INFO:teuthology.orchestra.run.smithi019.stderr: 61500K .......... .......... .......... .......... .......... 66% 332M 0s 2024-09-12T00:54:00.980 INFO:teuthology.orchestra.run.smithi019.stderr: 61550K .......... .......... .......... .......... .......... 66% 90.2M 0s 2024-09-12T00:54:00.980 INFO:teuthology.orchestra.run.smithi019.stderr: 61600K .......... .......... .......... .......... .......... 66% 343M 0s 2024-09-12T00:54:00.980 INFO:teuthology.orchestra.run.smithi019.stderr: 61650K .......... .......... .......... .......... .......... 66% 299M 0s 2024-09-12T00:54:00.980 INFO:teuthology.orchestra.run.smithi019.stderr: 61700K .......... .......... .......... .......... .......... 66% 327M 0s 2024-09-12T00:54:00.980 INFO:teuthology.orchestra.run.smithi019.stderr: 61750K .......... .......... .......... .......... .......... 66% 322M 0s 2024-09-12T00:54:00.980 INFO:teuthology.orchestra.run.smithi019.stderr: 61800K .......... .......... .......... .......... .......... 66% 155M 0s 2024-09-12T00:54:00.980 INFO:teuthology.orchestra.run.smithi019.stderr: 61850K .......... .......... .......... .......... .......... 66% 230M 0s 2024-09-12T00:54:00.980 INFO:teuthology.orchestra.run.smithi019.stderr: 61900K .......... .......... .......... .......... .......... 66% 165M 0s 2024-09-12T00:54:00.980 INFO:teuthology.orchestra.run.smithi019.stderr: 61950K .......... .......... .......... .......... .......... 66% 147M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62000K .......... .......... .......... .......... .......... 66% 311M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62050K .......... .......... .......... .......... .......... 66% 237M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62100K .......... .......... .......... .......... .......... 66% 62.8M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62150K .......... .......... .......... .......... .......... 66% 41.0M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62200K .......... .......... .......... .......... .......... 67% 331M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62250K .......... .......... .......... .......... .......... 67% 271M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62300K .......... .......... .......... .......... .......... 67% 48.5M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62350K .......... .......... .......... .......... .......... 67% 65.4M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62400K .......... .......... .......... .......... .......... 67% 329M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62450K .......... .......... .......... .......... .......... 67% 333M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62500K .......... .......... .......... .......... .......... 67% 172M 0s 2024-09-12T00:54:00.981 INFO:teuthology.orchestra.run.smithi019.stderr: 62550K .......... .......... .......... .......... .......... 67% 28.3M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 62600K .......... .......... .......... .......... .......... 67% 89.3M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 62650K .......... .......... .......... .......... .......... 67% 69.8M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 62700K .......... .......... .......... .......... .......... 67% 106M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 62750K .......... .......... .......... .......... .......... 67% 127M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 62800K .......... .......... .......... .......... .......... 67% 168M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 62850K .......... .......... .......... .......... .......... 67% 119M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 62900K .......... .......... .......... .......... .......... 67% 85.4M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 62950K .......... .......... .......... .......... .......... 67% 45.9M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 63000K .......... .......... .......... .......... .......... 67% 64.4M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 63050K .......... .......... .......... .......... .......... 67% 130M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 63100K .......... .......... .......... .......... .......... 67% 240M 0s 2024-09-12T00:54:00.982 INFO:teuthology.orchestra.run.smithi019.stderr: 63150K .......... .......... .......... .......... .......... 68% 117M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63200K .......... .......... .......... .......... .......... 68% 221M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63250K .......... .......... .......... .......... .......... 68% 173M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63300K .......... .......... .......... .......... .......... 68% 177M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63350K .......... .......... .......... .......... .......... 68% 117M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63400K .......... .......... .......... .......... .......... 68% 340M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63450K .......... .......... .......... .......... .......... 68% 82.9M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63500K .......... .......... .......... .......... .......... 68% 147M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63550K .......... .......... .......... .......... .......... 68% 79.9M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63600K .......... .......... .......... .......... .......... 68% 193M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63650K .......... .......... .......... .......... .......... 68% 86.8M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63700K .......... .......... .......... .......... .......... 68% 206M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63750K .......... .......... .......... .......... .......... 68% 51.5M 0s 2024-09-12T00:54:00.983 INFO:teuthology.orchestra.run.smithi019.stderr: 63800K .......... .......... .......... .......... .......... 68% 168M 0s 2024-09-12T00:54:00.984 INFO:teuthology.orchestra.run.smithi019.stderr: 63850K .......... .......... .......... .......... .......... 68% 15.6M 0s 2024-09-12T00:54:00.984 INFO:teuthology.orchestra.run.smithi019.stderr: 63900K .......... .......... .......... .......... .......... 68% 101M 0s 2024-09-12T00:54:00.984 INFO:teuthology.orchestra.run.smithi019.stderr: 63950K .......... .......... .......... .......... .......... 68% 45.9M 0s 2024-09-12T00:54:00.984 INFO:teuthology.orchestra.run.smithi019.stderr: 64000K .......... .......... .......... .......... .......... 68% 275M 0s 2024-09-12T00:54:00.984 INFO:teuthology.orchestra.run.smithi019.stderr: 64050K .......... .......... .......... .......... .......... 68% 161M 0s 2024-09-12T00:54:00.984 INFO:teuthology.orchestra.run.smithi019.stderr: 64100K .......... .......... .......... .......... .......... 69% 123M 0s 2024-09-12T00:54:00.984 INFO:teuthology.orchestra.run.smithi019.stderr: 64150K .......... .......... .......... .......... .......... 69% 141M 0s 2024-09-12T00:54:00.984 INFO:teuthology.orchestra.run.smithi019.stderr: 64200K .......... .......... .......... .......... .......... 69% 109M 0s 2024-09-12T00:54:00.984 INFO:teuthology.orchestra.run.smithi019.stderr: 64250K .......... .......... .......... .......... .......... 69% 63.7M 0s 2024-09-12T00:54:00.984 INFO:teuthology.orchestra.run.smithi019.stderr: 64300K .......... .......... .......... .......... .......... 69% 234M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64350K .......... .......... .......... .......... .......... 69% 118M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64400K .......... .......... .......... .......... .......... 69% 208M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64450K .......... .......... .......... .......... .......... 69% 162M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64500K .......... .......... .......... .......... .......... 69% 331M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64550K .......... .......... .......... .......... .......... 69% 208M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64600K .......... .......... .......... .......... .......... 69% 90.2M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64650K .......... .......... .......... .......... .......... 69% 155M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64700K .......... .......... .......... .......... .......... 69% 253M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64750K .......... .......... .......... .......... .......... 69% 253M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64800K .......... .......... .......... .......... .......... 69% 150M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64850K .......... .......... .......... .......... .......... 69% 288M 0s 2024-09-12T00:54:00.985 INFO:teuthology.orchestra.run.smithi019.stderr: 64900K .......... .......... .......... .......... .......... 69% 181M 0s 2024-09-12T00:54:00.986 INFO:teuthology.orchestra.run.smithi019.stderr: 64950K .......... .......... .......... .......... .......... 69% 186M 0s 2024-09-12T00:54:00.986 INFO:teuthology.orchestra.run.smithi019.stderr: 65000K .......... .......... .......... .......... .......... 70% 119M 0s 2024-09-12T00:54:00.986 INFO:teuthology.orchestra.run.smithi019.stderr: 65050K .......... .......... .......... .......... .......... 70% 126M 0s 2024-09-12T00:54:00.986 INFO:teuthology.orchestra.run.smithi019.stderr: 65100K .......... .......... .......... .......... .......... 70% 243M 0s 2024-09-12T00:54:00.986 INFO:teuthology.orchestra.run.smithi019.stderr: 65150K .......... .......... .......... .......... .......... 70% 71.5M 0s 2024-09-12T00:54:00.986 INFO:teuthology.orchestra.run.smithi019.stderr: 65200K .......... .......... .......... .......... .......... 70% 159M 0s 2024-09-12T00:54:00.986 INFO:teuthology.orchestra.run.smithi019.stderr: 65250K .......... .......... .......... .......... .......... 70% 182M 0s 2024-09-12T00:54:00.986 INFO:teuthology.orchestra.run.smithi019.stderr: 65300K .......... .......... .......... .......... .......... 70% 183M 0s 2024-09-12T00:54:00.986 INFO:teuthology.orchestra.run.smithi019.stderr: 65350K .......... .......... .......... .......... .......... 70% 164M 0s 2024-09-12T00:54:00.986 INFO:teuthology.orchestra.run.smithi019.stderr: 65400K .......... .......... .......... .......... .......... 70% 117M 0s 2024-09-12T00:54:00.986 INFO:teuthology.orchestra.run.smithi019.stderr: 65450K .......... .......... .......... .......... .......... 70% 200M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 65500K .......... .......... .......... .......... .......... 70% 175M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 65550K .......... .......... .......... .......... .......... 70% 84.5M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 65600K .......... .......... .......... .......... .......... 70% 278M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 65650K .......... .......... .......... .......... .......... 70% 115M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 65700K .......... .......... .......... .......... .......... 70% 138M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 65750K .......... .......... .......... .......... .......... 70% 165M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 65800K .......... .......... .......... .......... .......... 70% 133M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 65850K .......... .......... .......... .......... .......... 70% 120M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 65900K .......... .......... .......... .......... .......... 70% 126M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 65950K .......... .......... .......... .......... .......... 71% 41.9M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 66000K .......... .......... .......... .......... .......... 71% 127M 0s 2024-09-12T00:54:00.987 INFO:teuthology.orchestra.run.smithi019.stderr: 66050K .......... .......... .......... .......... .......... 71% 131M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66100K .......... .......... .......... .......... .......... 71% 97.7M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66150K .......... .......... .......... .......... .......... 71% 225M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66200K .......... .......... .......... .......... .......... 71% 95.3M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66250K .......... .......... .......... .......... .......... 71% 149M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66300K .......... .......... .......... .......... .......... 71% 136M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66350K .......... .......... .......... .......... .......... 71% 135M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66400K .......... .......... .......... .......... .......... 71% 80.4M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66450K .......... .......... .......... .......... .......... 71% 280M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66500K .......... .......... .......... .......... .......... 71% 272M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66550K .......... .......... .......... .......... .......... 71% 287M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66600K .......... .......... .......... .......... .......... 71% 370M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66650K .......... .......... .......... .......... .......... 71% 339M 0s 2024-09-12T00:54:00.988 INFO:teuthology.orchestra.run.smithi019.stderr: 66700K .......... .......... .......... .......... .......... 71% 340M 0s 2024-09-12T00:54:00.989 INFO:teuthology.orchestra.run.smithi019.stderr: 66750K .......... .......... .......... .......... .......... 71% 272M 0s 2024-09-12T00:54:00.989 INFO:teuthology.orchestra.run.smithi019.stderr: 66800K .......... .......... .......... .......... .......... 71% 312M 0s 2024-09-12T00:54:00.989 INFO:teuthology.orchestra.run.smithi019.stderr: 66850K .......... .......... .......... .......... .......... 72% 352M 0s 2024-09-12T00:54:00.989 INFO:teuthology.orchestra.run.smithi019.stderr: 66900K .......... .......... .......... .......... .......... 72% 372M 0s 2024-09-12T00:54:00.989 INFO:teuthology.orchestra.run.smithi019.stderr: 66950K .......... .......... .......... .......... .......... 72% 330M 0s 2024-09-12T00:54:00.989 INFO:teuthology.orchestra.run.smithi019.stderr: 67000K .......... .......... .......... .......... .......... 72% 360M 0s 2024-09-12T00:54:00.989 INFO:teuthology.orchestra.run.smithi019.stderr: 67050K .......... .......... .......... .......... .......... 72% 372M 0s 2024-09-12T00:54:00.989 INFO:teuthology.orchestra.run.smithi019.stderr: 67100K .......... .......... .......... .......... .......... 72% 379M 0s 2024-09-12T00:54:00.989 INFO:teuthology.orchestra.run.smithi019.stderr: 67150K .......... .......... .......... .......... .......... 72% 228M 0s 2024-09-12T00:54:00.989 INFO:teuthology.orchestra.run.smithi019.stderr: 67200K .......... .......... .......... .......... .......... 72% 365M 0s 2024-09-12T00:54:00.989 INFO:teuthology.orchestra.run.smithi019.stderr: 67250K .......... .......... .......... .......... .......... 72% 342M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67300K .......... .......... .......... .......... .......... 72% 360M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67350K .......... .......... .......... .......... .......... 72% 336M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67400K .......... .......... .......... .......... .......... 72% 311M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67450K .......... .......... .......... .......... .......... 72% 361M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67500K .......... .......... .......... .......... .......... 72% 385M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67550K .......... .......... .......... .......... .......... 72% 305M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67600K .......... .......... .......... .......... .......... 72% 350M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67650K .......... .......... .......... .......... .......... 72% 377M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67700K .......... .......... .......... .......... .......... 72% 373M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67750K .......... .......... .......... .......... .......... 72% 319M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67800K .......... .......... .......... .......... .......... 73% 375M 0s 2024-09-12T00:54:00.990 INFO:teuthology.orchestra.run.smithi019.stderr: 67850K .......... .......... .......... .......... .......... 73% 329M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 67900K .......... .......... .......... .......... .......... 73% 376M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 67950K .......... .......... .......... .......... .......... 73% 106M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 68000K .......... .......... .......... .......... .......... 73% 351M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 68050K .......... .......... .......... .......... .......... 73% 317M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 68100K .......... .......... .......... .......... .......... 73% 323M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 68150K .......... .......... .......... .......... .......... 73% 320M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 68200K .......... .......... .......... .......... .......... 73% 350M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 68250K .......... .......... .......... .......... .......... 73% 366M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 68300K .......... .......... .......... .......... .......... 73% 347M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 68350K .......... .......... .......... .......... .......... 73% 280M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 68400K .......... .......... .......... .......... .......... 73% 319M 0s 2024-09-12T00:54:00.991 INFO:teuthology.orchestra.run.smithi019.stderr: 68450K .......... .......... .......... .......... .......... 73% 356M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 68500K .......... .......... .......... .......... .......... 73% 376M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 68550K .......... .......... .......... .......... .......... 73% 342M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 68600K .......... .......... .......... .......... .......... 73% 372M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 68650K .......... .......... .......... .......... .......... 73% 349M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 68700K .......... .......... .......... .......... .......... 74% 368M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 68750K .......... .......... .......... .......... .......... 74% 311M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 68800K .......... .......... .......... .......... .......... 74% 373M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 68850K .......... .......... .......... .......... .......... 74% 311M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 68900K .......... .......... .......... .......... .......... 74% 378M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 68950K .......... .......... .......... .......... .......... 74% 339M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 69000K .......... .......... .......... .......... .......... 74% 376M 0s 2024-09-12T00:54:00.992 INFO:teuthology.orchestra.run.smithi019.stderr: 69050K .......... .......... .......... .......... .......... 74% 160M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69100K .......... .......... .......... .......... .......... 74% 162M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69150K .......... .......... .......... .......... .......... 74% 65.2M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69200K .......... .......... .......... .......... .......... 74% 341M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69250K .......... .......... .......... .......... .......... 74% 173M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69300K .......... .......... .......... .......... .......... 74% 106M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69350K .......... .......... .......... .......... .......... 74% 100M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69400K .......... .......... .......... .......... .......... 74% 382M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69450K .......... .......... .......... .......... .......... 74% 106M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69500K .......... .......... .......... .......... .......... 74% 86.3M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69550K .......... .......... .......... .......... .......... 74% 322M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69600K .......... .......... .......... .......... .......... 74% 326M 0s 2024-09-12T00:54:00.993 INFO:teuthology.orchestra.run.smithi019.stderr: 69650K .......... .......... .......... .......... .......... 75% 351M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 69700K .......... .......... .......... .......... .......... 75% 384M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 69750K .......... .......... .......... .......... .......... 75% 163M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 69800K .......... .......... .......... .......... .......... 75% 362M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 69850K .......... .......... .......... .......... .......... 75% 373M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 69900K .......... .......... .......... .......... .......... 75% 340M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 69950K .......... .......... .......... .......... .......... 75% 317M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 70000K .......... .......... .......... .......... .......... 75% 213M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 70050K .......... .......... .......... .......... .......... 75% 347M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 70100K .......... .......... .......... .......... .......... 75% 354M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 70150K .......... .......... .......... .......... .......... 75% 351M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 70200K .......... .......... .......... .......... .......... 75% 200M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 70250K .......... .......... .......... .......... .......... 75% 288M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 70300K .......... .......... .......... .......... .......... 75% 296M 0s 2024-09-12T00:54:00.994 INFO:teuthology.orchestra.run.smithi019.stderr: 70350K .......... .......... .......... .......... .......... 75% 274M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70400K .......... .......... .......... .......... .......... 75% 300M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70450K .......... .......... .......... .......... .......... 75% 314M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70500K .......... .......... .......... .......... .......... 75% 357M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70550K .......... .......... .......... .......... .......... 75% 373M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70600K .......... .......... .......... .......... .......... 76% 370M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70650K .......... .......... .......... .......... .......... 76% 353M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70700K .......... .......... .......... .......... .......... 76% 382M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70750K .......... .......... .......... .......... .......... 76% 375M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70800K .......... .......... .......... .......... .......... 76% 383M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70850K .......... .......... .......... .......... .......... 76% 233M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70900K .......... .......... .......... .......... .......... 76% 354M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 70950K .......... .......... .......... .......... .......... 76% 383M 0s 2024-09-12T00:54:00.995 INFO:teuthology.orchestra.run.smithi019.stderr: 71000K .......... .......... .......... .......... .......... 76% 367M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71050K .......... .......... .......... .......... .......... 76% 333M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71100K .......... .......... .......... .......... .......... 76% 382M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71150K .......... .......... .......... .......... .......... 76% 241M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71200K .......... .......... .......... .......... .......... 76% 228M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71250K .......... .......... .......... .......... .......... 76% 323M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71300K .......... .......... .......... .......... .......... 76% 378M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71350K .......... .......... .......... .......... .......... 76% 335M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71400K .......... .......... .......... .......... .......... 76% 301M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71450K .......... .......... .......... .......... .......... 76% 405M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71500K .......... .......... .......... .......... .......... 77% 356M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71550K .......... .......... .......... .......... .......... 77% 135M 0s 2024-09-12T00:54:00.996 INFO:teuthology.orchestra.run.smithi019.stderr: 71600K .......... .......... .......... .......... .......... 77% 375M 0s 2024-09-12T00:54:00.997 INFO:teuthology.orchestra.run.smithi019.stderr: 71650K .......... .......... .......... .......... .......... 77% 110M 0s 2024-09-12T00:54:00.997 INFO:teuthology.orchestra.run.smithi019.stderr: 71700K .......... .......... .......... .......... .......... 77% 146M 0s 2024-09-12T00:54:00.997 INFO:teuthology.orchestra.run.smithi019.stderr: 71750K .......... .......... .......... .......... .......... 77% 294M 0s 2024-09-12T00:54:00.997 INFO:teuthology.orchestra.run.smithi019.stderr: 71800K .......... .......... .......... .......... .......... 77% 96.8M 0s 2024-09-12T00:54:00.997 INFO:teuthology.orchestra.run.smithi019.stderr: 71850K .......... .......... .......... .......... .......... 77% 117M 0s 2024-09-12T00:54:00.997 INFO:teuthology.orchestra.run.smithi019.stderr: 71900K .......... .......... .......... .......... .......... 77% 70.0M 0s 2024-09-12T00:54:00.997 INFO:teuthology.orchestra.run.smithi019.stderr: 71950K .......... .......... .......... .......... .......... 77% 335M 0s 2024-09-12T00:54:00.997 INFO:teuthology.orchestra.run.smithi019.stderr: 72000K .......... .......... .......... .......... .......... 77% 57.6M 0s 2024-09-12T00:54:00.997 INFO:teuthology.orchestra.run.smithi019.stderr: 72050K .......... .......... .......... .......... .......... 77% 261M 0s 2024-09-12T00:54:00.997 INFO:teuthology.orchestra.run.smithi019.stderr: 72100K .......... .......... .......... .......... .......... 77% 197M 0s 2024-09-12T00:54:00.997 INFO:teuthology.orchestra.run.smithi019.stderr: 72150K .......... .......... .......... .......... .......... 77% 365M 0s 2024-09-12T00:54:00.998 INFO:teuthology.orchestra.run.smithi019.stderr: 72200K .......... .......... .......... .......... .......... 77% 367M 0s 2024-09-12T00:54:00.998 INFO:teuthology.orchestra.run.smithi019.stderr: 72250K .......... .......... .......... .......... .......... 77% 279M 0s 2024-09-12T00:54:00.998 INFO:teuthology.orchestra.run.smithi019.stderr: 72300K .......... .......... .......... .......... .......... 77% 170M 0s 2024-09-12T00:54:00.998 INFO:teuthology.orchestra.run.smithi019.stderr: 72350K .......... .......... .......... .......... .......... 77% 280M 0s 2024-09-12T00:54:00.998 INFO:teuthology.orchestra.run.smithi019.stderr: 72400K .......... .......... .......... .......... .......... 77% 353M 0s 2024-09-12T00:54:00.998 INFO:teuthology.orchestra.run.smithi019.stderr: 72450K .......... .......... .......... .......... .......... 78% 152M 0s 2024-09-12T00:54:00.998 INFO:teuthology.orchestra.run.smithi019.stderr: 72500K .......... .......... .......... .......... .......... 78% 290M 0s 2024-09-12T00:54:00.998 INFO:teuthology.orchestra.run.smithi019.stderr: 72550K .......... .......... .......... .......... .......... 78% 352M 0s 2024-09-12T00:54:00.998 INFO:teuthology.orchestra.run.smithi019.stderr: 72600K .......... .......... .......... .......... .......... 78% 316M 0s 2024-09-12T00:54:00.998 INFO:teuthology.orchestra.run.smithi019.stderr: 72650K .......... .......... .......... .......... .......... 78% 294M 0s 2024-09-12T00:54:00.998 INFO:teuthology.orchestra.run.smithi019.stderr: 72700K .......... .......... .......... .......... .......... 78% 187M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 72750K .......... .......... .......... .......... .......... 78% 54.7M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 72800K .......... .......... .......... .......... .......... 78% 366M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 72850K .......... .......... .......... .......... .......... 78% 301M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 72900K .......... .......... .......... .......... .......... 78% 316M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 72950K .......... .......... .......... .......... .......... 78% 119M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 73000K .......... .......... .......... .......... .......... 78% 364M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 73050K .......... .......... .......... .......... .......... 78% 120M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 73100K .......... .......... .......... .......... .......... 78% 279M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 73150K .......... .......... .......... .......... .......... 78% 357M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 73200K .......... .......... .......... .......... .......... 78% 335M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 73250K .......... .......... .......... .......... .......... 78% 103M 0s 2024-09-12T00:54:00.999 INFO:teuthology.orchestra.run.smithi019.stderr: 73300K .......... .......... .......... .......... .......... 78% 254M 0s 2024-09-12T00:54:01.000 INFO:teuthology.orchestra.run.smithi019.stderr: 73350K .......... .......... .......... .......... .......... 79% 371M 0s 2024-09-12T00:54:01.000 INFO:teuthology.orchestra.run.smithi019.stderr: 73400K .......... .......... .......... .......... .......... 79% 370M 0s 2024-09-12T00:54:01.000 INFO:teuthology.orchestra.run.smithi019.stderr: 73450K .......... .......... .......... .......... .......... 79% 360M 0s 2024-09-12T00:54:01.000 INFO:teuthology.orchestra.run.smithi019.stderr: 73500K .......... .......... .......... .......... .......... 79% 326M 0s 2024-09-12T00:54:01.000 INFO:teuthology.orchestra.run.smithi019.stderr: 73550K .......... .......... .......... .......... .......... 79% 367M 0s 2024-09-12T00:54:01.000 INFO:teuthology.orchestra.run.smithi019.stderr: 73600K .......... .......... .......... .......... .......... 79% 360M 0s 2024-09-12T00:54:01.000 INFO:teuthology.orchestra.run.smithi019.stderr: 73650K .......... .......... .......... .......... .......... 79% 371M 0s 2024-09-12T00:54:01.000 INFO:teuthology.orchestra.run.smithi019.stderr: 73700K .......... .......... .......... .......... .......... 79% 269M 0s 2024-09-12T00:54:01.000 INFO:teuthology.orchestra.run.smithi019.stderr: 73750K .......... .......... .......... .......... .......... 79% 380M 0s 2024-09-12T00:54:01.000 INFO:teuthology.orchestra.run.smithi019.stderr: 73800K .......... .......... .......... .......... .......... 79% 296M 0s 2024-09-12T00:54:01.000 INFO:teuthology.orchestra.run.smithi019.stderr: 73850K .......... .......... .......... .......... .......... 79% 364M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 73900K .......... .......... .......... .......... .......... 79% 304M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 73950K .......... .......... .......... .......... .......... 79% 360M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 74000K .......... .......... .......... .......... .......... 79% 354M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 74050K .......... .......... .......... .......... .......... 79% 372M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 74100K .......... .......... .......... .......... .......... 79% 316M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 74150K .......... .......... .......... .......... .......... 79% 338M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 74200K .......... .......... .......... .......... .......... 79% 374M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 74250K .......... .......... .......... .......... .......... 79% 373M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 74300K .......... .......... .......... .......... .......... 80% 105M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 74350K .......... .......... .......... .......... .......... 80% 140M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 74400K .......... .......... .......... .......... .......... 80% 95.5M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 74450K .......... .......... .......... .......... .......... 80% 190M 0s 2024-09-12T00:54:01.001 INFO:teuthology.orchestra.run.smithi019.stderr: 74500K .......... .......... .......... .......... .......... 80% 336M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 74550K .......... .......... .......... .......... .......... 80% 332M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 74600K .......... .......... .......... .......... .......... 80% 342M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 74650K .......... .......... .......... .......... .......... 80% 147M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 74700K .......... .......... .......... .......... .......... 80% 301M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 74750K .......... .......... .......... .......... .......... 80% 362M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 74800K .......... .......... .......... .......... .......... 80% 365M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 74850K .......... .......... .......... .......... .......... 80% 224M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 74900K .......... .......... .......... .......... .......... 80% 150M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 74950K .......... .......... .......... .......... .......... 80% 352M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 75000K .......... .......... .......... .......... .......... 80% 367M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 75050K .......... .......... .......... .......... .......... 80% 350M 0s 2024-09-12T00:54:01.002 INFO:teuthology.orchestra.run.smithi019.stderr: 75100K .......... .......... .......... .......... .......... 80% 295M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75150K .......... .......... .......... .......... .......... 80% 351M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75200K .......... .......... .......... .......... .......... 81% 357M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75250K .......... .......... .......... .......... .......... 81% 350M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75300K .......... .......... .......... .......... .......... 81% 320M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75350K .......... .......... .......... .......... .......... 81% 367M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75400K .......... .......... .......... .......... .......... 81% 359M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75450K .......... .......... .......... .......... .......... 81% 353M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75500K .......... .......... .......... .......... .......... 81% 295M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75550K .......... .......... .......... .......... .......... 81% 341M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75600K .......... .......... .......... .......... .......... 81% 362M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75650K .......... .......... .......... .......... .......... 81% 372M 0s 2024-09-12T00:54:01.003 INFO:teuthology.orchestra.run.smithi019.stderr: 75700K .......... .......... .......... .......... .......... 81% 343M 0s 2024-09-12T00:54:01.004 INFO:teuthology.orchestra.run.smithi019.stderr: 75750K .......... .......... .......... .......... .......... 81% 354M 0s 2024-09-12T00:54:01.004 INFO:teuthology.orchestra.run.smithi019.stderr: 75800K .......... .......... .......... .......... .......... 81% 340M 0s 2024-09-12T00:54:01.004 INFO:teuthology.orchestra.run.smithi019.stderr: 75850K .......... .......... .......... .......... .......... 81% 97.3M 0s 2024-09-12T00:54:01.004 INFO:teuthology.orchestra.run.smithi019.stderr: 75900K .......... .......... .......... .......... .......... 81% 202M 0s 2024-09-12T00:54:01.004 INFO:teuthology.orchestra.run.smithi019.stderr: 75950K .......... .......... .......... .......... .......... 81% 205M 0s 2024-09-12T00:54:01.004 INFO:teuthology.orchestra.run.smithi019.stderr: 76000K .......... .......... .......... .......... .......... 81% 208M 0s 2024-09-12T00:54:01.004 INFO:teuthology.orchestra.run.smithi019.stderr: 76050K .......... .......... .......... .......... .......... 81% 125M 0s 2024-09-12T00:54:01.004 INFO:teuthology.orchestra.run.smithi019.stderr: 76100K .......... .......... .......... .......... .......... 81% 324M 0s 2024-09-12T00:54:01.004 INFO:teuthology.orchestra.run.smithi019.stderr: 76150K .......... .......... .......... .......... .......... 82% 77.7M 0s 2024-09-12T00:54:01.004 INFO:teuthology.orchestra.run.smithi019.stderr: 76200K .......... .......... .......... .......... .......... 82% 358M 0s 2024-09-12T00:54:01.004 INFO:teuthology.orchestra.run.smithi019.stderr: 76250K .......... .......... .......... .......... .......... 82% 369M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76300K .......... .......... .......... .......... .......... 82% 264M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76350K .......... .......... .......... .......... .......... 82% 235M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76400K .......... .......... .......... .......... .......... 82% 237M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76450K .......... .......... .......... .......... .......... 82% 348M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76500K .......... .......... .......... .......... .......... 82% 137M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76550K .......... .......... .......... .......... .......... 82% 281M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76600K .......... .......... .......... .......... .......... 82% 330M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76650K .......... .......... .......... .......... .......... 82% 313M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76700K .......... .......... .......... .......... .......... 82% 290M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76750K .......... .......... .......... .......... .......... 82% 361M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76800K .......... .......... .......... .......... .......... 82% 324M 0s 2024-09-12T00:54:01.005 INFO:teuthology.orchestra.run.smithi019.stderr: 76850K .......... .......... .......... .......... .......... 82% 376M 0s 2024-09-12T00:54:01.006 INFO:teuthology.orchestra.run.smithi019.stderr: 76900K .......... .......... .......... .......... .......... 82% 334M 0s 2024-09-12T00:54:01.006 INFO:teuthology.orchestra.run.smithi019.stderr: 76950K .......... .......... .......... .......... .......... 82% 314M 0s 2024-09-12T00:54:01.006 INFO:teuthology.orchestra.run.smithi019.stderr: 77000K .......... .......... .......... .......... .......... 82% 366M 0s 2024-09-12T00:54:01.006 INFO:teuthology.orchestra.run.smithi019.stderr: 77050K .......... .......... .......... .......... .......... 82% 350M 0s 2024-09-12T00:54:01.006 INFO:teuthology.orchestra.run.smithi019.stderr: 77100K .......... .......... .......... .......... .......... 83% 314M 0s 2024-09-12T00:54:01.006 INFO:teuthology.orchestra.run.smithi019.stderr: 77150K .......... .......... .......... .......... .......... 83% 369M 0s 2024-09-12T00:54:01.006 INFO:teuthology.orchestra.run.smithi019.stderr: 77200K .......... .......... .......... .......... .......... 83% 356M 0s 2024-09-12T00:54:01.006 INFO:teuthology.orchestra.run.smithi019.stderr: 77250K .......... .......... .......... .......... .......... 83% 370M 0s 2024-09-12T00:54:01.006 INFO:teuthology.orchestra.run.smithi019.stderr: 77300K .......... .......... .......... .......... .......... 83% 331M 0s 2024-09-12T00:54:01.008 INFO:teuthology.orchestra.run.smithi019.stderr: 77350K .......... .......... .......... .......... .......... 83% 378M 0s 2024-09-12T00:54:01.008 INFO:teuthology.orchestra.run.smithi019.stderr: 77400K .......... .......... .......... .......... .......... 83% 353M 0s 2024-09-12T00:54:01.009 INFO:teuthology.orchestra.run.smithi019.stderr: 77450K .......... .......... .......... .......... .......... 83% 134M 0s 2024-09-12T00:54:01.009 INFO:teuthology.orchestra.run.smithi019.stderr: 77500K .......... .......... .......... .......... .......... 83% 74.2M 0s 2024-09-12T00:54:01.009 INFO:teuthology.orchestra.run.smithi019.stderr: 77550K .......... .......... .......... .......... .......... 83% 358M 0s 2024-09-12T00:54:01.009 INFO:teuthology.orchestra.run.smithi019.stderr: 77600K .......... .......... .......... .......... .......... 83% 380M 0s 2024-09-12T00:54:01.009 INFO:teuthology.orchestra.run.smithi019.stderr: 77650K .......... .......... .......... .......... .......... 83% 368M 0s 2024-09-12T00:54:01.009 INFO:teuthology.orchestra.run.smithi019.stderr: 77700K .......... .......... .......... .......... .......... 83% 317M 0s 2024-09-12T00:54:01.009 INFO:teuthology.orchestra.run.smithi019.stderr: 77750K .......... .......... .......... .......... .......... 83% 236M 0s 2024-09-12T00:54:01.009 INFO:teuthology.orchestra.run.smithi019.stderr: 77800K .......... .......... .......... .......... .......... 83% 332M 0s 2024-09-12T00:54:01.009 INFO:teuthology.orchestra.run.smithi019.stderr: 77850K .......... .......... .......... .......... .......... 83% 358M 0s 2024-09-12T00:54:01.009 INFO:teuthology.orchestra.run.smithi019.stderr: 77900K .......... .......... .......... .......... .......... 83% 273M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 77950K .......... .......... .......... .......... .......... 83% 112M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 78000K .......... .......... .......... .......... .......... 84% 248M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 78050K .......... .......... .......... .......... .......... 84% 338M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 78100K .......... .......... .......... .......... .......... 84% 332M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 78150K .......... .......... .......... .......... .......... 84% 372M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 78200K .......... .......... .......... .......... .......... 84% 327M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 78250K .......... .......... .......... .......... .......... 84% 363M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 78300K .......... .......... .......... .......... .......... 84% 302M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 78350K .......... .......... .......... .......... .......... 84% 368M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 78400K .......... .......... .......... .......... .......... 84% 357M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 78450K .......... .......... .......... .......... .......... 84% 119M 0s 2024-09-12T00:54:01.010 INFO:teuthology.orchestra.run.smithi019.stderr: 78500K .......... .......... .......... .......... .......... 84% 323M 0s 2024-09-12T00:54:01.011 INFO:teuthology.orchestra.run.smithi019.stderr: 78550K .......... .......... .......... .......... .......... 84% 337M 0s 2024-09-12T00:54:01.011 INFO:teuthology.orchestra.run.smithi019.stderr: 78600K .......... .......... .......... .......... .......... 84% 377M 0s 2024-09-12T00:54:01.011 INFO:teuthology.orchestra.run.smithi019.stderr: 78650K .......... .......... .......... .......... .......... 84% 352M 0s 2024-09-12T00:54:01.011 INFO:teuthology.orchestra.run.smithi019.stderr: 78700K .......... .......... .......... .......... .......... 84% 296M 0s 2024-09-12T00:54:01.011 INFO:teuthology.orchestra.run.smithi019.stderr: 78750K .......... .......... .......... .......... .......... 84% 366M 0s 2024-09-12T00:54:01.011 INFO:teuthology.orchestra.run.smithi019.stderr: 78800K .......... .......... .......... .......... .......... 84% 381M 0s 2024-09-12T00:54:01.011 INFO:teuthology.orchestra.run.smithi019.stderr: 78850K .......... .......... .......... .......... .......... 84% 233M 0s 2024-09-12T00:54:01.011 INFO:teuthology.orchestra.run.smithi019.stderr: 78900K .......... .......... .......... .......... .......... 84% 320M 0s 2024-09-12T00:54:01.011 INFO:teuthology.orchestra.run.smithi019.stderr: 78950K .......... .......... .......... .......... .......... 85% 344M 0s 2024-09-12T00:54:01.011 INFO:teuthology.orchestra.run.smithi019.stderr: 79000K .......... .......... .......... .......... .......... 85% 357M 0s 2024-09-12T00:54:01.011 INFO:teuthology.orchestra.run.smithi019.stderr: 79050K .......... .......... .......... .......... .......... 85% 146M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79100K .......... .......... .......... .......... .......... 85% 135M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79150K .......... .......... .......... .......... .......... 85% 281M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79200K .......... .......... .......... .......... .......... 85% 83.9M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79250K .......... .......... .......... .......... .......... 85% 357M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79300K .......... .......... .......... .......... .......... 85% 249M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79350K .......... .......... .......... .......... .......... 85% 355M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79400K .......... .......... .......... .......... .......... 85% 351M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79450K .......... .......... .......... .......... .......... 85% 354M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79500K .......... .......... .......... .......... .......... 85% 198M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79550K .......... .......... .......... .......... .......... 85% 116M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79600K .......... .......... .......... .......... .......... 85% 123M 0s 2024-09-12T00:54:01.012 INFO:teuthology.orchestra.run.smithi019.stderr: 79650K .......... .......... .......... .......... .......... 85% 321M 0s 2024-09-12T00:54:01.013 INFO:teuthology.orchestra.run.smithi019.stderr: 79700K .......... .......... .......... .......... .......... 85% 309M 0s 2024-09-12T00:54:01.013 INFO:teuthology.orchestra.run.smithi019.stderr: 79750K .......... .......... .......... .......... .......... 85% 357M 0s 2024-09-12T00:54:01.013 INFO:teuthology.orchestra.run.smithi019.stderr: 79800K .......... .......... .......... .......... .......... 85% 341M 0s 2024-09-12T00:54:01.013 INFO:teuthology.orchestra.run.smithi019.stderr: 79850K .......... .......... .......... .......... .......... 86% 347M 0s 2024-09-12T00:54:01.013 INFO:teuthology.orchestra.run.smithi019.stderr: 79900K .......... .......... .......... .......... .......... 86% 318M 0s 2024-09-12T00:54:01.013 INFO:teuthology.orchestra.run.smithi019.stderr: 79950K .......... .......... .......... .......... .......... 86% 364M 0s 2024-09-12T00:54:01.013 INFO:teuthology.orchestra.run.smithi019.stderr: 80000K .......... .......... .......... .......... .......... 86% 374M 0s 2024-09-12T00:54:01.013 INFO:teuthology.orchestra.run.smithi019.stderr: 80050K .......... .......... .......... .......... .......... 86% 289M 0s 2024-09-12T00:54:01.013 INFO:teuthology.orchestra.run.smithi019.stderr: 80100K .......... .......... .......... .......... .......... 86% 291M 0s 2024-09-12T00:54:01.013 INFO:teuthology.orchestra.run.smithi019.stderr: 80150K .......... .......... .......... .......... .......... 86% 362M 0s 2024-09-12T00:54:01.013 INFO:teuthology.orchestra.run.smithi019.stderr: 80200K .......... .......... .......... .......... .......... 86% 353M 0s 2024-09-12T00:54:01.014 INFO:teuthology.orchestra.run.smithi019.stderr: 80250K .......... .......... .......... .......... .......... 86% 359M 0s 2024-09-12T00:54:01.014 INFO:teuthology.orchestra.run.smithi019.stderr: 80300K .......... .......... .......... .......... .......... 86% 316M 0s 2024-09-12T00:54:01.014 INFO:teuthology.orchestra.run.smithi019.stderr: 80350K .......... .......... .......... .......... .......... 86% 358M 0s 2024-09-12T00:54:01.014 INFO:teuthology.orchestra.run.smithi019.stderr: 80400K .......... .......... .......... .......... .......... 86% 360M 0s 2024-09-12T00:54:01.014 INFO:teuthology.orchestra.run.smithi019.stderr: 80450K .......... .......... .......... .......... .......... 86% 370M 0s 2024-09-12T00:54:01.014 INFO:teuthology.orchestra.run.smithi019.stderr: 80500K .......... .......... .......... .......... .......... 86% 171M 0s 2024-09-12T00:54:01.014 INFO:teuthology.orchestra.run.smithi019.stderr: 80550K .......... .......... .......... .......... .......... 86% 117M 0s 2024-09-12T00:54:01.014 INFO:teuthology.orchestra.run.smithi019.stderr: 80600K .......... .......... .......... .......... .......... 86% 341M 0s 2024-09-12T00:54:01.014 INFO:teuthology.orchestra.run.smithi019.stderr: 80650K .......... .......... .......... .......... .......... 86% 267M 0s 2024-09-12T00:54:01.014 INFO:teuthology.orchestra.run.smithi019.stderr: 80700K .......... .......... .......... .......... .......... 86% 262M 0s 2024-09-12T00:54:01.014 INFO:teuthology.orchestra.run.smithi019.stderr: 80750K .......... .......... .......... .......... .......... 86% 204M 0s 2024-09-12T00:54:01.015 INFO:teuthology.orchestra.run.smithi019.stderr: 80800K .......... .......... .......... .......... .......... 87% 271M 0s 2024-09-12T00:54:01.015 INFO:teuthology.orchestra.run.smithi019.stderr: 80850K .......... .......... .......... .......... .......... 87% 170M 0s 2024-09-12T00:54:01.015 INFO:teuthology.orchestra.run.smithi019.stderr: 80900K .......... .......... .......... .......... .......... 87% 311M 0s 2024-09-12T00:54:01.015 INFO:teuthology.orchestra.run.smithi019.stderr: 80950K .......... .......... .......... .......... .......... 87% 232M 0s 2024-09-12T00:54:01.015 INFO:teuthology.orchestra.run.smithi019.stderr: 81000K .......... .......... .......... .......... .......... 87% 234M 0s 2024-09-12T00:54:01.015 INFO:teuthology.orchestra.run.smithi019.stderr: 81050K .......... .......... .......... .......... .......... 87% 118M 0s 2024-09-12T00:54:01.015 INFO:teuthology.orchestra.run.smithi019.stderr: 81100K .......... .......... .......... .......... .......... 87% 219M 0s 2024-09-12T00:54:01.015 INFO:teuthology.orchestra.run.smithi019.stderr: 81150K .......... .......... .......... .......... .......... 87% 357M 0s 2024-09-12T00:54:01.015 INFO:teuthology.orchestra.run.smithi019.stderr: 81200K .......... .......... .......... .......... .......... 87% 351M 0s 2024-09-12T00:54:01.015 INFO:teuthology.orchestra.run.smithi019.stderr: 81250K .......... .......... .......... .......... .......... 87% 363M 0s 2024-09-12T00:54:01.015 INFO:teuthology.orchestra.run.smithi019.stderr: 81300K .......... .......... .......... .......... .......... 87% 323M 0s 2024-09-12T00:54:01.016 INFO:teuthology.orchestra.run.smithi019.stderr: 81350K .......... .......... .......... .......... .......... 87% 327M 0s 2024-09-12T00:54:01.016 INFO:teuthology.orchestra.run.smithi019.stderr: 81400K .......... .......... .......... .......... .......... 87% 384M 0s 2024-09-12T00:54:01.016 INFO:teuthology.orchestra.run.smithi019.stderr: 81450K .......... .......... .......... .......... .......... 87% 350M 0s 2024-09-12T00:54:01.016 INFO:teuthology.orchestra.run.smithi019.stderr: 81500K .......... .......... .......... .......... .......... 87% 267M 0s 2024-09-12T00:54:01.016 INFO:teuthology.orchestra.run.smithi019.stderr: 81550K .......... .......... .......... .......... .......... 87% 146M 0s 2024-09-12T00:54:01.016 INFO:teuthology.orchestra.run.smithi019.stderr: 81600K .......... .......... .......... .......... .......... 87% 210M 0s 2024-09-12T00:54:01.016 INFO:teuthology.orchestra.run.smithi019.stderr: 81650K .......... .......... .......... .......... .......... 87% 238M 0s 2024-09-12T00:54:01.016 INFO:teuthology.orchestra.run.smithi019.stderr: 81700K .......... .......... .......... .......... .......... 87% 246M 0s 2024-09-12T00:54:01.016 INFO:teuthology.orchestra.run.smithi019.stderr: 81750K .......... .......... .......... .......... .......... 88% 280M 0s 2024-09-12T00:54:01.016 INFO:teuthology.orchestra.run.smithi019.stderr: 81800K .......... .......... .......... .......... .......... 88% 313M 0s 2024-09-12T00:54:01.016 INFO:teuthology.orchestra.run.smithi019.stderr: 81850K .......... .......... .......... .......... .......... 88% 379M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 81900K .......... .......... .......... .......... .......... 88% 413M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 81950K .......... .......... .......... .......... .......... 88% 325M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 82000K .......... .......... .......... .......... .......... 88% 374M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 82050K .......... .......... .......... .......... .......... 88% 368M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 82100K .......... .......... .......... .......... .......... 88% 327M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 82150K .......... .......... .......... .......... .......... 88% 386M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 82200K .......... .......... .......... .......... .......... 88% 374M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 82250K .......... .......... .......... .......... .......... 88% 390M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 82300K .......... .......... .......... .......... .......... 88% 96.3M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 82350K .......... .......... .......... .......... .......... 88% 102M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 82400K .......... .......... .......... .......... .......... 88% 371M 0s 2024-09-12T00:54:01.017 INFO:teuthology.orchestra.run.smithi019.stderr: 82450K .......... .......... .......... .......... .......... 88% 383M 0s 2024-09-12T00:54:01.018 INFO:teuthology.orchestra.run.smithi019.stderr: 82500K .......... .......... .......... .......... .......... 88% 327M 0s 2024-09-12T00:54:01.018 INFO:teuthology.orchestra.run.smithi019.stderr: 82550K .......... .......... .......... .......... .......... 88% 389M 0s 2024-09-12T00:54:01.018 INFO:teuthology.orchestra.run.smithi019.stderr: 82600K .......... .......... .......... .......... .......... 88% 117M 0s 2024-09-12T00:54:01.018 INFO:teuthology.orchestra.run.smithi019.stderr: 82650K .......... .......... .......... .......... .......... 89% 123M 0s 2024-09-12T00:54:01.018 INFO:teuthology.orchestra.run.smithi019.stderr: 82700K .......... .......... .......... .......... .......... 89% 298M 0s 2024-09-12T00:54:01.018 INFO:teuthology.orchestra.run.smithi019.stderr: 82750K .......... .......... .......... .......... .......... 89% 381M 0s 2024-09-12T00:54:01.018 INFO:teuthology.orchestra.run.smithi019.stderr: 82800K .......... .......... .......... .......... .......... 89% 372M 0s 2024-09-12T00:54:01.018 INFO:teuthology.orchestra.run.smithi019.stderr: 82850K .......... .......... .......... .......... .......... 89% 147M 0s 2024-09-12T00:54:01.018 INFO:teuthology.orchestra.run.smithi019.stderr: 82900K .......... .......... .......... .......... .......... 89% 323M 0s 2024-09-12T00:54:01.018 INFO:teuthology.orchestra.run.smithi019.stderr: 82950K .......... .......... .......... .......... .......... 89% 336M 0s 2024-09-12T00:54:01.018 INFO:teuthology.orchestra.run.smithi019.stderr: 83000K .......... .......... .......... .......... .......... 89% 378M 0s 2024-09-12T00:54:01.019 INFO:teuthology.orchestra.run.smithi019.stderr: 83050K .......... .......... .......... .......... .......... 89% 372M 0s 2024-09-12T00:54:01.019 INFO:teuthology.orchestra.run.smithi019.stderr: 83100K .......... .......... .......... .......... .......... 89% 138M 0s 2024-09-12T00:54:01.019 INFO:teuthology.orchestra.run.smithi019.stderr: 83150K .......... .......... .......... .......... .......... 89% 372M 0s 2024-09-12T00:54:01.019 INFO:teuthology.orchestra.run.smithi019.stderr: 83200K .......... .......... .......... .......... .......... 89% 338M 0s 2024-09-12T00:54:01.019 INFO:teuthology.orchestra.run.smithi019.stderr: 83250K .......... .......... .......... .......... .......... 89% 372M 0s 2024-09-12T00:54:01.019 INFO:teuthology.orchestra.run.smithi019.stderr: 83300K .......... .......... .......... .......... .......... 89% 338M 0s 2024-09-12T00:54:01.019 INFO:teuthology.orchestra.run.smithi019.stderr: 83350K .......... .......... .......... .......... .......... 89% 375M 0s 2024-09-12T00:54:01.019 INFO:teuthology.orchestra.run.smithi019.stderr: 83400K .......... .......... .......... .......... .......... 89% 357M 0s 2024-09-12T00:54:01.019 INFO:teuthology.orchestra.run.smithi019.stderr: 83450K .......... .......... .......... .......... .......... 89% 348M 0s 2024-09-12T00:54:01.019 INFO:teuthology.orchestra.run.smithi019.stderr: 83500K .......... .......... .......... .......... .......... 89% 330M 0s 2024-09-12T00:54:01.019 INFO:teuthology.orchestra.run.smithi019.stderr: 83550K .......... .......... .......... .......... .......... 89% 405M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 83600K .......... .......... .......... .......... .......... 90% 262M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 83650K .......... .......... .......... .......... .......... 90% 346M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 83700K .......... .......... .......... .......... .......... 90% 344M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 83750K .......... .......... .......... .......... .......... 90% 333M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 83800K .......... .......... .......... .......... .......... 90% 207M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 83850K .......... .......... .......... .......... .......... 90% 176M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 83900K .......... .......... .......... .......... .......... 90% 113M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 83950K .......... .......... .......... .......... .......... 90% 312M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 84000K .......... .......... .......... .......... .......... 90% 382M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 84050K .......... .......... .......... .......... .......... 90% 279M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 84100K .......... .......... .......... .......... .......... 90% 97.9M 0s 2024-09-12T00:54:01.020 INFO:teuthology.orchestra.run.smithi019.stderr: 84150K .......... .......... .......... .......... .......... 90% 387M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84200K .......... .......... .......... .......... .......... 90% 219M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84250K .......... .......... .......... .......... .......... 90% 376M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84300K .......... .......... .......... .......... .......... 90% 85.2M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84350K .......... .......... .......... .......... .......... 90% 373M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84400K .......... .......... .......... .......... .......... 90% 387M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84450K .......... .......... .......... .......... .......... 90% 388M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84500K .......... .......... .......... .......... .......... 91% 343M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84550K .......... .......... .......... .......... .......... 91% 364M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84600K .......... .......... .......... .......... .......... 91% 381M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84650K .......... .......... .......... .......... .......... 91% 390M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84700K .......... .......... .......... .......... .......... 91% 149M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84750K .......... .......... .......... .......... .......... 91% 381M 0s 2024-09-12T00:54:01.021 INFO:teuthology.orchestra.run.smithi019.stderr: 84800K .......... .......... .......... .......... .......... 91% 375M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 84850K .......... .......... .......... .......... .......... 91% 359M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 84900K .......... .......... .......... .......... .......... 91% 345M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 84950K .......... .......... .......... .......... .......... 91% 206M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 85000K .......... .......... .......... .......... .......... 91% 264M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 85050K .......... .......... .......... .......... .......... 91% 383M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 85100K .......... .......... .......... .......... .......... 91% 303M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 85150K .......... .......... .......... .......... .......... 91% 366M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 85200K .......... .......... .......... .......... .......... 91% 393M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 85250K .......... .......... .......... .......... .......... 91% 183M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 85300K .......... .......... .......... .......... .......... 91% 325M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 85350K .......... .......... .......... .......... .......... 91% 386M 0s 2024-09-12T00:54:01.022 INFO:teuthology.orchestra.run.smithi019.stderr: 85400K .......... .......... .......... .......... .......... 91% 87.0M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 85450K .......... .......... .......... .......... .......... 92% 386M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 85500K .......... .......... .......... .......... .......... 92% 302M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 85550K .......... .......... .......... .......... .......... 92% 375M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 85600K .......... .......... .......... .......... .......... 92% 407M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 85650K .......... .......... .......... .......... .......... 92% 164M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 85700K .......... .......... .......... .......... .......... 92% 169M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 85750K .......... .......... .......... .......... .......... 92% 102M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 85800K .......... .......... .......... .......... .......... 92% 244M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 85850K .......... .......... .......... .......... .......... 92% 376M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 85900K .......... .......... .......... .......... .......... 92% 327M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 85950K .......... .......... .......... .......... .......... 92% 393M 0s 2024-09-12T00:54:01.023 INFO:teuthology.orchestra.run.smithi019.stderr: 86000K .......... .......... .......... .......... .......... 92% 276M 0s 2024-09-12T00:54:01.024 INFO:teuthology.orchestra.run.smithi019.stderr: 86050K .......... .......... .......... .......... .......... 92% 400M 0s 2024-09-12T00:54:01.024 INFO:teuthology.orchestra.run.smithi019.stderr: 86100K .......... .......... .......... .......... .......... 92% 147M 0s 2024-09-12T00:54:01.024 INFO:teuthology.orchestra.run.smithi019.stderr: 86150K .......... .......... .......... .......... .......... 92% 373M 0s 2024-09-12T00:54:01.024 INFO:teuthology.orchestra.run.smithi019.stderr: 86200K .......... .......... .......... .......... .......... 92% 368M 0s 2024-09-12T00:54:01.024 INFO:teuthology.orchestra.run.smithi019.stderr: 86250K .......... .......... .......... .......... .......... 92% 350M 0s 2024-09-12T00:54:01.024 INFO:teuthology.orchestra.run.smithi019.stderr: 86300K .......... .......... .......... .......... .......... 92% 342M 0s 2024-09-12T00:54:01.024 INFO:teuthology.orchestra.run.smithi019.stderr: 86350K .......... .......... .......... .......... .......... 93% 345M 0s 2024-09-12T00:54:01.024 INFO:teuthology.orchestra.run.smithi019.stderr: 86400K .......... .......... .......... .......... .......... 93% 241M 0s 2024-09-12T00:54:01.024 INFO:teuthology.orchestra.run.smithi019.stderr: 86450K .......... .......... .......... .......... .......... 93% 368M 0s 2024-09-12T00:54:01.024 INFO:teuthology.orchestra.run.smithi019.stderr: 86500K .......... .......... .......... .......... .......... 93% 310M 0s 2024-09-12T00:54:01.024 INFO:teuthology.orchestra.run.smithi019.stderr: 86550K .......... .......... .......... .......... .......... 93% 415M 0s 2024-09-12T00:54:01.025 INFO:teuthology.orchestra.run.smithi019.stderr: 86600K .......... .......... .......... .......... .......... 93% 368M 0s 2024-09-12T00:54:01.025 INFO:teuthology.orchestra.run.smithi019.stderr: 86650K .......... .......... .......... .......... .......... 93% 378M 0s 2024-09-12T00:54:01.025 INFO:teuthology.orchestra.run.smithi019.stderr: 86700K .......... .......... .......... .......... .......... 93% 321M 0s 2024-09-12T00:54:01.025 INFO:teuthology.orchestra.run.smithi019.stderr: 86750K .......... .......... .......... .......... .......... 93% 383M 0s 2024-09-12T00:54:01.025 INFO:teuthology.orchestra.run.smithi019.stderr: 86800K .......... .......... .......... .......... .......... 93% 210M 0s 2024-09-12T00:54:01.025 INFO:teuthology.orchestra.run.smithi019.stderr: 86850K .......... .......... .......... .......... .......... 93% 393M 0s 2024-09-12T00:54:01.025 INFO:teuthology.orchestra.run.smithi019.stderr: 86900K .......... .......... .......... .......... .......... 93% 140M 0s 2024-09-12T00:54:01.025 INFO:teuthology.orchestra.run.smithi019.stderr: 86950K .......... .......... .......... .......... .......... 93% 217M 0s 2024-09-12T00:54:01.025 INFO:teuthology.orchestra.run.smithi019.stderr: 87000K .......... .......... .......... .......... .......... 93% 182M 0s 2024-09-12T00:54:01.025 INFO:teuthology.orchestra.run.smithi019.stderr: 87050K .......... .......... .......... .......... .......... 93% 374M 0s 2024-09-12T00:54:01.025 INFO:teuthology.orchestra.run.smithi019.stderr: 87100K .......... .......... .......... .......... .......... 93% 327M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87150K .......... .......... .......... .......... .......... 93% 64.9M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87200K .......... .......... .......... .......... .......... 93% 363M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87250K .......... .......... .......... .......... .......... 93% 378M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87300K .......... .......... .......... .......... .......... 94% 347M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87350K .......... .......... .......... .......... .......... 94% 148M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87400K .......... .......... .......... .......... .......... 94% 251M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87450K .......... .......... .......... .......... .......... 94% 390M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87500K .......... .......... .......... .......... .......... 94% 318M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87550K .......... .......... .......... .......... .......... 94% 353M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87600K .......... .......... .......... .......... .......... 94% 377M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87650K .......... .......... .......... .......... .......... 94% 398M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87700K .......... .......... .......... .......... .......... 94% 73.8M 0s 2024-09-12T00:54:01.026 INFO:teuthology.orchestra.run.smithi019.stderr: 87750K .......... .......... .......... .......... .......... 94% 339M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 87800K .......... .......... .......... .......... .......... 94% 374M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 87850K .......... .......... .......... .......... .......... 94% 369M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 87900K .......... .......... .......... .......... .......... 94% 297M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 87950K .......... .......... .......... .......... .......... 94% 378M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 88000K .......... .......... .......... .......... .......... 94% 368M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 88050K .......... .......... .......... .......... .......... 94% 353M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 88100K .......... .......... .......... .......... .......... 94% 351M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 88150K .......... .......... .......... .......... .......... 94% 390M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 88200K .......... .......... .......... .......... .......... 94% 392M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 88250K .......... .......... .......... .......... .......... 95% 340M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 88300K .......... .......... .......... .......... .......... 95% 201M 0s 2024-09-12T00:54:01.027 INFO:teuthology.orchestra.run.smithi019.stderr: 88350K .......... .......... .......... .......... .......... 95% 387M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88400K .......... .......... .......... .......... .......... 95% 397M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88450K .......... .......... .......... .......... .......... 95% 75.4M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88500K .......... .......... .......... .......... .......... 95% 326M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88550K .......... .......... .......... .......... .......... 95% 382M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88600K .......... .......... .......... .......... .......... 95% 365M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88650K .......... .......... .......... .......... .......... 95% 117M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88700K .......... .......... .......... .......... .......... 95% 300M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88750K .......... .......... .......... .......... .......... 95% 396M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88800K .......... .......... .......... .......... .......... 95% 265M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88850K .......... .......... .......... .......... .......... 95% 303M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88900K .......... .......... .......... .......... .......... 95% 79.4M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 88950K .......... .......... .......... .......... .......... 95% 370M 0s 2024-09-12T00:54:01.028 INFO:teuthology.orchestra.run.smithi019.stderr: 89000K .......... .......... .......... .......... .......... 95% 318M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89050K .......... .......... .......... .......... .......... 95% 362M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89100K .......... .......... .......... .......... .......... 95% 303M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89150K .......... .......... .......... .......... .......... 96% 387M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89200K .......... .......... .......... .......... .......... 96% 376M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89250K .......... .......... .......... .......... .......... 96% 379M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89300K .......... .......... .......... .......... .......... 96% 334M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89350K .......... .......... .......... .......... .......... 96% 393M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89400K .......... .......... .......... .......... .......... 96% 382M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89450K .......... .......... .......... .......... .......... 96% 385M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89500K .......... .......... .......... .......... .......... 96% 246M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89550K .......... .......... .......... .......... .......... 96% 362M 0s 2024-09-12T00:54:01.029 INFO:teuthology.orchestra.run.smithi019.stderr: 89600K .......... .......... .......... .......... .......... 96% 376M 0s 2024-09-12T00:54:01.030 INFO:teuthology.orchestra.run.smithi019.stderr: 89650K .......... .......... .......... .......... .......... 96% 392M 0s 2024-09-12T00:54:01.030 INFO:teuthology.orchestra.run.smithi019.stderr: 89700K .......... .......... .......... .......... .......... 96% 350M 0s 2024-09-12T00:54:01.030 INFO:teuthology.orchestra.run.smithi019.stderr: 89750K .......... .......... .......... .......... .......... 96% 400M 0s 2024-09-12T00:54:01.030 INFO:teuthology.orchestra.run.smithi019.stderr: 89800K .......... .......... .......... .......... .......... 96% 374M 0s 2024-09-12T00:54:01.030 INFO:teuthology.orchestra.run.smithi019.stderr: 89850K .......... .......... .......... .......... .......... 96% 394M 0s 2024-09-12T00:54:01.030 INFO:teuthology.orchestra.run.smithi019.stderr: 89900K .......... .......... .......... .......... .......... 96% 135M 0s 2024-09-12T00:54:01.030 INFO:teuthology.orchestra.run.smithi019.stderr: 89950K .......... .......... .......... .......... .......... 96% 367M 0s 2024-09-12T00:54:01.030 INFO:teuthology.orchestra.run.smithi019.stderr: 90000K .......... .......... .......... .......... .......... 96% 217M 0s 2024-09-12T00:54:01.030 INFO:teuthology.orchestra.run.smithi019.stderr: 90050K .......... .......... .......... .......... .......... 96% 380M 0s 2024-09-12T00:54:01.030 INFO:teuthology.orchestra.run.smithi019.stderr: 90100K .......... .......... .......... .......... .......... 97% 157M 0s 2024-09-12T00:54:01.030 INFO:teuthology.orchestra.run.smithi019.stderr: 90150K .......... .......... .......... .......... .......... 97% 366M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90200K .......... .......... .......... .......... .......... 97% 386M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90250K .......... .......... .......... .......... .......... 97% 79.2M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90300K .......... .......... .......... .......... .......... 97% 157M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90350K .......... .......... .......... .......... .......... 97% 371M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90400K .......... .......... .......... .......... .......... 97% 302M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90450K .......... .......... .......... .......... .......... 97% 337M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90500K .......... .......... .......... .......... .......... 97% 163M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90550K .......... .......... .......... .......... .......... 97% 352M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90600K .......... .......... .......... .......... .......... 97% 379M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90650K .......... .......... .......... .......... .......... 97% 394M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90700K .......... .......... .......... .......... .......... 97% 313M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90750K .......... .......... .......... .......... .......... 97% 114M 0s 2024-09-12T00:54:01.031 INFO:teuthology.orchestra.run.smithi019.stderr: 90800K .......... .......... .......... .......... .......... 97% 82.3M 0s 2024-09-12T00:54:01.032 INFO:teuthology.orchestra.run.smithi019.stderr: 90850K .......... .......... .......... .......... .......... 97% 313M 0s 2024-09-12T00:54:01.032 INFO:teuthology.orchestra.run.smithi019.stderr: 90900K .......... .......... .......... .......... .......... 97% 289M 0s 2024-09-12T00:54:01.032 INFO:teuthology.orchestra.run.smithi019.stderr: 90950K .......... .......... .......... .......... .......... 97% 103M 0s 2024-09-12T00:54:01.032 INFO:teuthology.orchestra.run.smithi019.stderr: 91000K .......... .......... .......... .......... .......... 98% 325M 0s 2024-09-12T00:54:01.032 INFO:teuthology.orchestra.run.smithi019.stderr: 91050K .......... .......... .......... .......... .......... 98% 279M 0s 2024-09-12T00:54:01.032 INFO:teuthology.orchestra.run.smithi019.stderr: 91100K .......... .......... .......... .......... .......... 98% 224M 0s 2024-09-12T00:54:01.032 INFO:teuthology.orchestra.run.smithi019.stderr: 91150K .......... .......... .......... .......... .......... 98% 281M 0s 2024-09-12T00:54:01.032 INFO:teuthology.orchestra.run.smithi019.stderr: 91200K .......... .......... .......... .......... .......... 98% 345M 0s 2024-09-12T00:54:01.032 INFO:teuthology.orchestra.run.smithi019.stderr: 91250K .......... .......... .......... .......... .......... 98% 385M 0s 2024-09-12T00:54:01.032 INFO:teuthology.orchestra.run.smithi019.stderr: 91300K .......... .......... .......... .......... .......... 98% 324M 0s 2024-09-12T00:54:01.032 INFO:teuthology.orchestra.run.smithi019.stderr: 91350K .......... .......... .......... .......... .......... 98% 393M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91400K .......... .......... .......... .......... .......... 98% 287M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91450K .......... .......... .......... .......... .......... 98% 255M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91500K .......... .......... .......... .......... .......... 98% 390M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91550K .......... .......... .......... .......... .......... 98% 332M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91600K .......... .......... .......... .......... .......... 98% 377M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91650K .......... .......... .......... .......... .......... 98% 238M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91700K .......... .......... .......... .......... .......... 98% 306M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91750K .......... .......... .......... .......... .......... 98% 319M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91800K .......... .......... .......... .......... .......... 98% 278M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91850K .......... .......... .......... .......... .......... 98% 311M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91900K .......... .......... .......... .......... .......... 98% 393M 0s 2024-09-12T00:54:01.033 INFO:teuthology.orchestra.run.smithi019.stderr: 91950K .......... .......... .......... .......... .......... 99% 90.8M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92000K .......... .......... .......... .......... .......... 99% 257M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92050K .......... .......... .......... .......... .......... 99% 282M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92100K .......... .......... .......... .......... .......... 99% 369M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92150K .......... .......... .......... .......... .......... 99% 259M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92200K .......... .......... .......... .......... .......... 99% 266M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92250K .......... .......... .......... .......... .......... 99% 257M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92300K .......... .......... .......... .......... .......... 99% 258M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92350K .......... .......... .......... .......... .......... 99% 294M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92400K .......... .......... .......... .......... .......... 99% 288M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92450K .......... .......... .......... .......... .......... 99% 313M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92500K .......... .......... .......... .......... .......... 99% 319M 0s 2024-09-12T00:54:01.034 INFO:teuthology.orchestra.run.smithi019.stderr: 92550K .......... .......... .......... .......... .......... 99% 324M 0s 2024-09-12T00:54:01.035 INFO:teuthology.orchestra.run.smithi019.stderr: 92600K .......... .......... .......... .......... .......... 99% 400M 0s 2024-09-12T00:54:01.035 INFO:teuthology.orchestra.run.smithi019.stderr: 92650K .......... .......... .......... .......... .......... 99% 364M 0s 2024-09-12T00:54:01.035 INFO:teuthology.orchestra.run.smithi019.stderr: 92700K .......... .......... .......... .......... .......... 99% 103M 0s 2024-09-12T00:54:01.035 INFO:teuthology.orchestra.run.smithi019.stderr: 92750K .......... .......... .......... .......... .......... 99% 261M 0s 2024-09-12T00:54:01.035 INFO:teuthology.orchestra.run.smithi019.stderr: 92800K .......... .......... .......... .......... .......... 99% 332M 0s 2024-09-12T00:54:01.035 INFO:teuthology.orchestra.run.smithi019.stderr: 92850K .......... .......... .......... .......... .......... 99% 412M 0s 2024-09-12T00:54:01.035 INFO:teuthology.orchestra.run.smithi019.stderr: 92900K 100% 134G=0.5s 2024-09-12T00:54:01.035 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:54:01.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12 00:53:59 (173 MB/s) - ‘gradle-6.0.1-bin.zip’ saved [95129672/95129672] 2024-09-12T00:54:01.035 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T00:54:01.079 INFO:teuthology.orchestra.run.smithi019.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:54:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:54:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:54:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:54:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:54:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:54:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:54:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:54:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:54:01.079 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:54:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:54:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:54:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:54:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:54:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:54:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:54:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:54:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:54:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:54:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:54:01.080 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:54:01.081 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:54:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:54:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:54:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:54:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:54:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:54:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:54:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:54:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:54:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:54:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:54:01.082 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:54:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:54:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:54:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:54:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:54:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:54:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:54:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:54:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:54:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:54:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:54:01.083 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:54:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:54:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:54:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:54:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:54:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:54:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:54:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:54:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:54:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:54:01.084 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:54:01.085 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:54:01.086 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:54:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:54:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:54:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:54:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:54:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:54:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:54:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:54:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:54:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:54:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:54:01.087 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:54:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:54:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:54:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:54:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:54:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:54:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:54:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:54:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:54:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:54:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:54:01.088 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:54:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:54:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:54:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:54:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:54:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:54:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:54:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:54:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:54:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:54:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:54:01.089 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:54:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:54:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:54:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:54:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:54:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:54:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:54:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:54:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:54:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:54:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:54:01.090 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:54:01.091 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:54:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:54:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:54:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:54:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:54:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:54:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:54:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:54:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:54:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:54:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:54:01.092 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:54:01.093 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:54:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:54:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:54:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:54:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:54:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:54:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:54:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:54:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:54:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:54:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:54:01.094 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:54:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:54:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:54:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:54:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:54:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:54:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:54:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:54:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:54:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:54:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:54:01.095 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:54:01.096 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:54:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:54:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:54:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:54:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:54:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:54:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:54:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:54:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:54:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:54:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:54:01.097 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:54:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:54:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:54:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:54:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:54:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:54:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:54:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:54:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:54:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:54:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:54:01.098 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:54:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:54:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:54:01.099 INFO:teuthology.orchestra.run.smithi019.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin 2024-09-12T00:54:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:01.099 INFO:teuthology.orchestra.run.smithi019.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:54:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:01.099 INFO:teuthology.orchestra.run.smithi019.stdout:Here are the highlights of this release: 2024-09-12T00:54:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:54:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:54:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: - Advanced control of transitive versions 2024-09-12T00:54:01.099 INFO:teuthology.orchestra.run.smithi019.stdout: - Support for optional features and dependencies 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: - Rules to tweak published metadata 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: - Support for Java 13 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: - New Zinc compiler for Scala 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: - VS2019 support 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout:------------------------------------------------------------ 2024-09-12T00:54:01.100 INFO:teuthology.orchestra.run.smithi019.stdout:Gradle 6.0.1 2024-09-12T00:54:01.101 INFO:teuthology.orchestra.run.smithi019.stdout:------------------------------------------------------------ 2024-09-12T00:54:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:01.101 INFO:teuthology.orchestra.run.smithi019.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:54:01.101 INFO:teuthology.orchestra.run.smithi019.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:54:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:01.101 INFO:teuthology.orchestra.run.smithi019.stdout:Kotlin: 1.3.50 2024-09-12T00:54:01.101 INFO:teuthology.orchestra.run.smithi019.stdout:Groovy: 2.5.8 2024-09-12T00:54:01.101 INFO:teuthology.orchestra.run.smithi019.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:54:01.101 INFO:teuthology.orchestra.run.smithi019.stdout:JVM: 11.0.20.1 (Red Hat, Inc. 11.0.20.1+1-LTS) 2024-09-12T00:54:01.101 INFO:teuthology.orchestra.run.smithi019.stdout:OS: Linux 5.14.0-505.el9.x86_64 amd64 2024-09-12T00:54:01.101 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:01.102 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:54:01.102 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:54:01.102 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T00:54:01.102 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:54:01.102 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T00:54:01.102 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:54:01.526 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:54:01.526 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:54:01.527 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'HDRYCRFUSHDORKDHHLPN', 'access_secret': '5021rgAmiFRDwdvpOOQhHr8q2nuESp8TCGX7SzpTILcZrDRJ3Cm6EA==', 'region': 'mexico', 'endpoint': 'smithi019.front.sepia.ceph.com:443', 'port': 443, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': True, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi019.front.sepia.ceph.com'} 2024-09-12T00:54:01.527 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:54:01.527 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'HDRYCRFUSHDORKDHHLPN', '--secret', '5021rgAmiFRDwdvpOOQhHr8q2nuESp8TCGX7SzpTILcZrDRJ3Cm6EA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:54:01.527 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key HDRYCRFUSHDORKDHHLPN --secret 5021rgAmiFRDwdvpOOQhHr8q2nuESp8TCGX7SzpTILcZrDRJ3Cm6EA== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:54:01.603 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:01.603 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:01.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.846+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.848+0000 7f570b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.848+0000 7f570b430800 20 realm 2024-09-12T00:54:01.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.848+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.848+0000 7f570b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.848+0000 7f570b430800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:01.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.848+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.848+0000 7f570b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:01.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.848+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.849+0000 7f570b430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.849+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.850+0000 7f570b430800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:01.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.850+0000 7f570b430800 20 searching for the correct realm 2024-09-12T00:54:01.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:01.854+0000 7f56fdfcb640 0 -- 172.21.15.19:0/2267238726 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f56f006e200 msgr2=0x7f56f0074ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:02.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.060+0000 7f5706fcd640 0 -- 172.21.15.19:0/2267238726 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55b60ac1aa20 msgr2=0x55b60ac1ceb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:02.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.065+0000 7f570b430800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:54:02.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.065+0000 7f570b430800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:54:02.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.065+0000 7f570b430800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:02.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.065+0000 7f570b430800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:02.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.065+0000 7f570b430800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:02.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.065+0000 7f570b430800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:02.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.065+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.066+0000 7f570b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.066+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.066+0000 7f570b430800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:02.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.066+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:02.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 20 zone default found 2024-09-12T00:54:02.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 4 Realm: () 2024-09-12T00:54:02.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:54:02.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:54:02.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:02.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 20 zonegroup default 2024-09-12T00:54:02.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.067+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.068+0000 7f570b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.068+0000 7f570b430800 20 started sync module instance, tier type = 2024-09-12T00:54:02.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.068+0000 7f570b430800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:54:02.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.079+0000 7f570b430800 20 add_watcher() i=0 2024-09-12T00:54:02.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.079+0000 7f570b430800 20 add_watcher() i=1 2024-09-12T00:54:02.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.079+0000 7f570b430800 20 add_watcher() i=2 2024-09-12T00:54:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.079+0000 7f570b430800 20 add_watcher() i=3 2024-09-12T00:54:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.079+0000 7f570b430800 20 add_watcher() i=4 2024-09-12T00:54:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.079+0000 7f570b430800 20 add_watcher() i=5 2024-09-12T00:54:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.079+0000 7f570b430800 20 add_watcher() i=6 2024-09-12T00:54:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.080+0000 7f570b430800 20 add_watcher() i=7 2024-09-12T00:54:02.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.080+0000 7f570b430800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:02.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.082+0000 7f55bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.082+0000 7f570b430800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.082+0000 7f570b430800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.082+0000 7f570b430800 5 note: GC not initialized 2024-09-12T00:54:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.082+0000 7f55377fe640 20 reqs_thread_entry: start 2024-09-12T00:54:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.083+0000 7f570b430800 20 init_complete bucket index max shards: 11 2024-09-12T00:54:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.083+0000 7f570b430800 20 Filter name: none 2024-09-12T00:54:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.083+0000 7f55357fa640 20 reqs_thread_entry: start 2024-09-12T00:54:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.083+0000 7f570b430800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:54:02.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.083+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.083+0000 7f570b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.083+0000 7f570b430800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:54:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.083+0000 7f570b430800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:54:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.083+0000 7f570b430800 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:54:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.083+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.084+0000 7f570b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.084+0000 7f570b430800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:54:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.084+0000 7f570b430800 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:54:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.084+0000 7f570b430800 10 cache get: name=default.rgw.meta+users.keys+HDRYCRFUSHDORKDHHLPN : miss 2024-09-12T00:54:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.084+0000 7f570b430800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.084+0000 7f570b430800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.084+0000 7f570b430800 10 cache put: name=default.rgw.meta+users.keys+HDRYCRFUSHDORKDHHLPN info.flags=0x0 2024-09-12T00:54:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.084+0000 7f570b430800 10 adding default.rgw.meta+users.keys+HDRYCRFUSHDORKDHHLPN to cache LRU end 2024-09-12T00:54:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.084+0000 7f570b430800 10 cache get: name=default.rgw.meta+users.keys+HDRYCRFUSHDORKDHHLPN : hit (negative entry) 2024-09-12T00:54:02.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.084+0000 7f570b430800 10 cache get: name=default.rgw.meta+users.keys+HDRYCRFUSHDORKDHHLPN : hit (negative entry) 2024-09-12T00:54:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.086+0000 7f570b430800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:54:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.086+0000 7f570b430800 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:54:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.086+0000 7f570b430800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:54:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.086+0000 7f55e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398989 cookie 94240352932080 notifier 8778 bl.length()=670 2024-09-12T00:54:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.086+0000 7f55e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:54:02.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.086+0000 7f55e9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:54:02.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.090+0000 7f570b430800 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:54:02.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.090+0000 7f570b430800 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:54:02.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.090+0000 7f570b430800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:54:02.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.090+0000 7f55e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398896 cookie 94240352929712 notifier 8778 bl.length()=200 2024-09-12T00:54:02.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.090+0000 7f55e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:54:02.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.090+0000 7f55e9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:54:02.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.093+0000 7f570b430800 10 cache put: name=default.rgw.meta+users.keys+HDRYCRFUSHDORKDHHLPN info.flags=0x7 2024-09-12T00:54:02.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.093+0000 7f570b430800 10 moving default.rgw.meta+users.keys+HDRYCRFUSHDORKDHHLPN to cache LRU end 2024-09-12T00:54:02.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.093+0000 7f570b430800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:HDRYCRFUSHDORKDHHLPN, ofs0, ns] 2024-09-12T00:54:02.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.094+0000 7f55e9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398901 cookie 94240352928016 notifier 8778 bl.length()=189 2024-09-12T00:54:02.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.094+0000 7f55e9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HDRYCRFUSHDORKDHHLPN info.flags=0x7 2024-09-12T00:54:02.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.094+0000 7f55e9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HDRYCRFUSHDORKDHHLPN to cache LRU end 2024-09-12T00:54:02.094 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T00:54:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "user_id": "tester.client.0", 2024-09-12T00:54:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:54:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:54:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "suspended": 0, 2024-09-12T00:54:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T00:54:02.094 INFO:teuthology.orchestra.run.smithi019.stdout: "subusers": [], 2024-09-12T00:54:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "keys": [ 2024-09-12T00:54:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T00:54:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "user": "tester.client.0", 2024-09-12T00:54:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "access_key": "HDRYCRFUSHDORKDHHLPN", 2024-09-12T00:54:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "secret_key": "5021rgAmiFRDwdvpOOQhHr8q2nuESp8TCGX7SzpTILcZrDRJ3Cm6EA==", 2024-09-12T00:54:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "active": true, 2024-09-12T00:54:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T00:54:02.085243Z" 2024-09-12T00:54:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T00:54:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T00:54:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "swift_keys": [], 2024-09-12T00:54:02.095 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": [], 2024-09-12T00:54:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T00:54:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "default_placement": "", 2024-09-12T00:54:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "default_storage_class": "", 2024-09-12T00:54:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "placement_tags": [], 2024-09-12T00:54:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T00:54:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T00:54:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:54:02.096 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T00:54:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:54:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T00:54:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:54:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "user_quota": { 2024-09-12T00:54:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T00:54:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T00:54:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T00:54:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T00:54:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T00:54:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T00:54:02.097 INFO:teuthology.orchestra.run.smithi019.stdout: "temp_url_keys": [], 2024-09-12T00:54:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "rgw", 2024-09-12T00:54:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "mfa_ids": [], 2024-09-12T00:54:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "account_id": "", 2024-09-12T00:54:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-12T00:54:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T00:54:02.085212Z", 2024-09-12T00:54:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-12T00:54:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: "group_ids": [] 2024-09-12T00:54:02.098 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T00:54:02.098 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:02.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.096+0000 7f55bcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:02.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.099+0000 7f570b430800 20 remove_watcher() i=0 2024-09-12T00:54:02.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.099+0000 7f570b430800 2 removed watcher, disabling cache 2024-09-12T00:54:02.099 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.100+0000 7f570b430800 20 remove_watcher() i=1 2024-09-12T00:54:02.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.102+0000 7f570b430800 20 remove_watcher() i=2 2024-09-12T00:54:02.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.103+0000 7f570b430800 20 remove_watcher() i=3 2024-09-12T00:54:02.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.104+0000 7f570b430800 20 remove_watcher() i=4 2024-09-12T00:54:02.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.106+0000 7f570b430800 20 remove_watcher() i=5 2024-09-12T00:54:02.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.107+0000 7f570b430800 20 remove_watcher() i=6 2024-09-12T00:54:02.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.108+0000 7f570b430800 20 remove_watcher() i=7 2024-09-12T00:54:02.121 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T00:54:02.121 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:54:02.156 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:54:02.157 DEBUG:teuthology.orchestra.run.smithi019:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:54:02.227 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T00:54:02.322 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:02.322 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:02.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.364+0000 7f3ada926800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.365+0000 7f3ada926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.365+0000 7f3ada926800 20 realm 2024-09-12T00:54:02.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.365+0000 7f3ada926800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.365+0000 7f3ada926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.364 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.365+0000 7f3ada926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.365+0000 7f3ada926800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.366+0000 7f3ada926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.366+0000 7f3ada926800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.366+0000 7f3ada926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:02.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.366+0000 7f3ada926800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.367+0000 7f3ada926800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:02.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.367+0000 7f3ada926800 20 searching for the correct realm 2024-09-12T00:54:02.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.370+0000 7f3ad5d08640 0 -- 172.21.15.19:0/2925839325 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3acc06c070 msgr2=0x7f3acc0a5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:02.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.576+0000 7f3ad5d08640 0 -- 172.21.15.19:0/2925839325 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x564a1a5101b0 msgr2=0x564a1a512650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:02.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.581+0000 7f3ada926800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:54:02.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.581+0000 7f3ada926800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:54:02.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.581+0000 7f3ada926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:02.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.581+0000 7f3ada926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:02.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.581+0000 7f3ada926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:02.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.581+0000 7f3ada926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:02.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.581+0000 7f3ada926800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 20 zone default found 2024-09-12T00:54:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 4 Realm: () 2024-09-12T00:54:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:54:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:54:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:02.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 20 zonegroup default 2024-09-12T00:54:02.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.582+0000 7f3ada926800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.583+0000 7f3ada926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.583+0000 7f3ada926800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.583+0000 7f3ada926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.583+0000 7f3ada926800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.583+0000 7f3ada926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.583+0000 7f3ada926800 20 started sync module instance, tier type = 2024-09-12T00:54:02.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.583+0000 7f3ada926800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:54:02.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.594+0000 7f3ada926800 20 add_watcher() i=0 2024-09-12T00:54:02.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.594+0000 7f3ada926800 20 add_watcher() i=1 2024-09-12T00:54:02.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.594+0000 7f3ada926800 20 add_watcher() i=2 2024-09-12T00:54:02.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.594+0000 7f3ada926800 20 add_watcher() i=3 2024-09-12T00:54:02.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.594+0000 7f3ada926800 20 add_watcher() i=4 2024-09-12T00:54:02.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.594+0000 7f3ada926800 20 add_watcher() i=5 2024-09-12T00:54:02.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.594+0000 7f3ada926800 20 add_watcher() i=6 2024-09-12T00:54:02.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.595+0000 7f3ada926800 20 add_watcher() i=7 2024-09-12T00:54:02.594 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.595+0000 7f3ada926800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:02.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.597+0000 7f398cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:02.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.597+0000 7f3ada926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:02.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.597+0000 7f3ada926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:02.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.637+0000 7f39077fe640 20 reqs_thread_entry: start 2024-09-12T00:54:02.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.637+0000 7f3ada926800 20 init_complete bucket index max shards: 11 2024-09-12T00:54:02.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.637+0000 7f3ada926800 20 Filter name: none 2024-09-12T00:54:02.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.637+0000 7f39057fa640 20 reqs_thread_entry: start 2024-09-12T00:54:02.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.637+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:54:02.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.639+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.639+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.639+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:02.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.639+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15596505835200184670', time=2024-09-12T02:44:48.338655+0000, chain.objs.size()=4 2024-09-12T00:54:02.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.639+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9__multipart_foo.2~6SFVDGLVVMscVDE9vKNqLbjk23fpUxT.1 2024-09-12T00:54:02.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.639+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9__multipart_foo.2~6SFVDGLVVMscVDE9vKNqLbjk23fpUxT.2 2024-09-12T00:54:02.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.639+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9__multipart_foo.2~6SFVDGLVVMscVDE9vKNqLbjk23fpUxT.3 2024-09-12T00:54:02.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.639+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9__multipart_foo.2~6SFVDGLVVMscVDE9vKNqLbjk23fpUxT.4 2024-09-12T00:54:02.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.639+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_4jh3XSVzKcPKbPdNSH1UzBVUFoiooG0', time=2024-09-12T02:44:48.362494+0000, chain.objs.size()=1 2024-09-12T00:54:02.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.639+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.w0aYziz0AAnJvKGqT80ABVAlUQnKQ94_0 2024-09-12T00:54:02.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.642+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.644+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:54:02.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.646+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.646+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.646+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:54:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.646+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_XRclkBQ3uU8S95nD0iaDFAg9erELWCo', time=2024-09-12T02:44:48.386758+0000, chain.objs.size()=1 2024-09-12T00:54:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.646+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.SiaoEFo_brQrtJ0m8meG3HPTmhxHBuL_1 2024-09-12T00:54:02.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.646+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_O3ejJQg0CXIZPTZssxoDV57D92PRbxK', time=2024-09-12T02:44:48.477727+0000, chain.objs.size()=1 2024-09-12T00:54:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.646+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.DKWdtIS4RC0J6qT0oRd17lX-n74h1oC_0 2024-09-12T00:54:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.646+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14288371563683417402', time=2024-09-12T02:44:48.545526+0000, chain.objs.size()=3 2024-09-12T00:54:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.646+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.8mj80BeHca1S4OTUR_m69QYXl-etNDH_0 2024-09-12T00:54:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.646+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.8mj80BeHca1S4OTUR_m69QYXl-etNDH_1 2024-09-12T00:54:02.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.646+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.8mj80BeHca1S4OTUR_m69QYXl-etNDH_2 2024-09-12T00:54:02.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.649+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.653+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:54:02.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.655+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.655+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.656+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:02.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.656+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_fu25QoKmQN8DVarSv8XA249RwDgBh0h', time=2024-09-12T02:44:48.437194+0000, chain.objs.size()=2 2024-09-12T00:54:02.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.656+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.MA6mScv4JOMjVPYlsY18RH2s7QN4_h9_1 2024-09-12T00:54:02.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.656+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.MA6mScv4JOMjVPYlsY18RH2s7QN4_h9_2 2024-09-12T00:54:02.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.656+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4056489938823761789', time=2024-09-12T02:44:48.473640+0000, chain.objs.size()=5 2024-09-12T00:54:02.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.656+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.1 2024-09-12T00:54:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.656+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.1_1 2024-09-12T00:54:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.656+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.2 2024-09-12T00:54:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.656+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.2_1 2024-09-12T00:54:02.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.656+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.3 2024-09-12T00:54:02.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.658+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.661+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:54:02.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.662+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.663+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.663+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:02.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.663+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_Dn2HZAmWVTl7jmCB64W7PCd6TA2kgOI', time=2024-09-12T02:44:48.366753+0000, chain.objs.size()=1 2024-09-12T00:54:02.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.663+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.e9LJDiNmIQHy4VZYn_6ShTAXR1ziKWh_1 2024-09-12T00:54:02.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.663+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7351978077085484376', time=2024-09-12T02:44:48.409316+0000, chain.objs.size()=2 2024-09-12T00:54:02.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.663+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.jp2dtLN_cDXyL8E-7LT41Bx08sJNwiP_0 2024-09-12T00:54:02.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.663+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.jp2dtLN_cDXyL8E-7LT41Bx08sJNwiP_1 2024-09-12T00:54:02.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.664+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.667+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:54:02.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.668+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.669+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.669+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.670+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:54:02.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.671+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.672+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.672+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.673+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:54:02.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.674+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.675+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.675+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:02.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.675+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.2383221703664704022', time=2024-09-12T02:44:48.509825+0000, chain.objs.size()=5 2024-09-12T00:54:02.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.675+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-STANDARD.2~YaobJVHN5e5S-SoUudQg8UmruJ_t-cR.1 2024-09-12T00:54:02.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.675+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-STANDARD.2~YaobJVHN5e5S-SoUudQg8UmruJ_t-cR.1_1 2024-09-12T00:54:02.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.675+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-STANDARD.2~YaobJVHN5e5S-SoUudQg8UmruJ_t-cR.2 2024-09-12T00:54:02.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.675+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-STANDARD.2~YaobJVHN5e5S-SoUudQg8UmruJ_t-cR.2_1 2024-09-12T00:54:02.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.675+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-STANDARD.2~YaobJVHN5e5S-SoUudQg8UmruJ_t-cR.3 2024-09-12T00:54:02.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.682+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.690+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:54:02.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.692+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.692+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.692+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.693+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:54:02.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.695+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.695+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.695+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:02.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.695+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13589380348398336201', time=2024-09-12T02:44:48.441404+0000, chain.objs.size()=5 2024-09-12T00:54:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.695+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.1 2024-09-12T00:54:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.695+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.1_1 2024-09-12T00:54:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.695+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.2 2024-09-12T00:54:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.695+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.2_1 2024-09-12T00:54:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.696+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.3 2024-09-12T00:54:02.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.697+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.699+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:54:02.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.701+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.701+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.702+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:54:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.702+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14168597094602997839', time=2024-09-12T02:44:48.393248+0000, chain.objs.size()=2 2024-09-12T00:54:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.702+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.6OGuGVEmt6ziIE9C8j1SAF2mtuZRYDL_0 2024-09-12T00:54:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.702+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.6OGuGVEmt6ziIE9C8j1SAF2mtuZRYDL_1 2024-09-12T00:54:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.702+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_7YF162-Q5t-_j5SHYQyIeetx_JfqyVD', time=2024-09-12T02:44:48.432693+0000, chain.objs.size()=1 2024-09-12T00:54:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.702+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.sPPLEtlrVnZ2TEss33roJE_ct0VSIK4_0 2024-09-12T00:54:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.702+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15011727309784485814', time=2024-09-12T02:44:48.538598+0000, chain.objs.size()=3 2024-09-12T00:54:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.702+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.bh3-nkBbN161J35wAgxCUE_eMd6SHFA_0 2024-09-12T00:54:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.702+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.bh3-nkBbN161J35wAgxCUE_eMd6SHFA_1 2024-09-12T00:54:02.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.702+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13__shadow_.bh3-nkBbN161J35wAgxCUE_eMd6SHFA_2 2024-09-12T00:54:02.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.704+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.706+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:54:02.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:02.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5279243247369810204', time=2024-09-12T02:44:48.312605+0000, chain.objs.size()=4 2024-09-12T00:54:02.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10__multipart_foo.2~FVKuaPnx342gprr07ZmWRNf8yo6xOHq.1 2024-09-12T00:54:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10__multipart_foo.2~FVKuaPnx342gprr07ZmWRNf8yo6xOHq.2 2024-09-12T00:54:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10__multipart_foo.2~FVKuaPnx342gprr07ZmWRNf8yo6xOHq.3 2024-09-12T00:54:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10__multipart_foo.2~FVKuaPnx342gprr07ZmWRNf8yo6xOHq.4 2024-09-12T00:54:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.978535672187611597', time=2024-09-12T02:44:48.469213+0000, chain.objs.size()=3 2024-09-12T00:54:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.1 2024-09-12T00:54:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.2 2024-09-12T00:54:02.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.708+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.3 2024-09-12T00:54:02.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.713+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.715+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:54:02.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.716+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:54:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6665534206580483315', time=2024-09-12T02:44:48.263170+0000, chain.objs.size()=4 2024-09-12T00:54:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11__multipart_foo.2~pywVykB0IpYUj7qQLcbv4ZoUeQcjKQq.1 2024-09-12T00:54:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11__multipart_foo.2~pywVykB0IpYUj7qQLcbv4ZoUeQcjKQq.2 2024-09-12T00:54:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11__multipart_foo.2~pywVykB0IpYUj7qQLcbv4ZoUeQcjKQq.3 2024-09-12T00:54:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11__multipart_foo.2~pywVykB0IpYUj7qQLcbv4ZoUeQcjKQq.4 2024-09-12T00:54:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_Q_9Wml6dWTsbk9tD-K0rSqyIJ5b9mT4', time=2024-09-12T02:44:48.405367+0000, chain.objs.size()=1 2024-09-12T00:54:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.R4UvJeTKfOYxo9-DBdtn_OU6N50_ZJr_0 2024-09-12T00:54:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16654132493071302455', time=2024-09-12T02:44:48.505829+0000, chain.objs.size()=5 2024-09-12T00:54:02.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-FROZEN.2~Hi6a8Suz1mikoyXWsk3Qb3IIk9l8PWk.1 2024-09-12T00:54:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-FROZEN.2~Hi6a8Suz1mikoyXWsk3Qb3IIk9l8PWk.1_1 2024-09-12T00:54:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.717+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-FROZEN.2~Hi6a8Suz1mikoyXWsk3Qb3IIk9l8PWk.2 2024-09-12T00:54:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.718+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-FROZEN.2~Hi6a8Suz1mikoyXWsk3Qb3IIk9l8PWk.2_1 2024-09-12T00:54:02.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.718+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-FROZEN.2~Hi6a8Suz1mikoyXWsk3Qb3IIk9l8PWk.3 2024-09-12T00:54:02.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.722+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.725+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:54:02.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.726+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.726+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.727+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.728+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:54:02.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.729+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.729+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.730+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:02.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.730+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_LsU8i_Q9RjTmId0k_NMKLRTc6ABuneQ', time=2024-09-12T02:44:48.375038+0000, chain.objs.size()=2 2024-09-12T00:54:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.730+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.Foq_hmkMAe_Rn-vQ4eQudkK1aMu4UhZ_0 2024-09-12T00:54:02.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.730+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.Foq_hmkMAe_Rn-vQ4eQudkK1aMu4UhZ_1 2024-09-12T00:54:02.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.732+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.735+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:54:02.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.736+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.736+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.737+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:02.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.737+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_z0FHcYY3HV6dbioHWwJl6h-NyR4RHsZ', time=2024-09-12T02:44:48.450927+0000, chain.objs.size()=3 2024-09-12T00:54:02.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.737+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.NgF2YsfllR-5GNi3GvUKXuZqrKQuH3L_0 2024-09-12T00:54:02.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.737+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.NgF2YsfllR-5GNi3GvUKXuZqrKQuH3L_1 2024-09-12T00:54:02.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.737+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.NgF2YsfllR-5GNi3GvUKXuZqrKQuH3L_2 2024-09-12T00:54:02.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.739+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.741+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:54:02.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.742+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.743+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.743+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.744+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:54:02.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.746+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.746+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.746+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.748+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:54:02.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.749+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.750+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.750+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.750+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_7AEWM2xdqEempY0QNNq1nVvzTLVmYSi', time=2024-09-12T02:44:48.379311+0000, chain.objs.size()=2 2024-09-12T00:54:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.750+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.mqm_N3QWJawpJko8UHReeg-8_u_G1Cd_0 2024-09-12T00:54:02.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.750+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.mqm_N3QWJawpJko8UHReeg-8_u_G1Cd_1 2024-09-12T00:54:02.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.752+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.755+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:54:02.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.756+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.756+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.757+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.758+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:54:02.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.759+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.760+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.760+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.761+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:54:02.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.763+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.763+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.764+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.764+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3467870845072686979', time=2024-09-12T02:44:48.483016+0000, chain.objs.size()=5 2024-09-12T00:54:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.764+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.1 2024-09-12T00:54:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.764+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.1_1 2024-09-12T00:54:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.764+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.2 2024-09-12T00:54:02.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.764+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.2_1 2024-09-12T00:54:02.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.764+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-FROZEN.2~6nZuPrIo8yQjy77nX2fM2l8Uoo3F1OF.3 2024-09-12T00:54:02.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.766+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.768+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:54:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.769+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.770+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.770+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.772+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:54:02.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.773+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.773+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.774+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.775+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:54:02.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.776+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.777+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.777+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.777+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8933943863736858152', time=2024-09-12T02:44:48.454901+0000, chain.objs.size()=3 2024-09-12T00:54:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.777+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.1 2024-09-12T00:54:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.777+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.2 2024-09-12T00:54:02.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.777+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-STANDARD.2~nUU30PAGHvO4vMUv4xGFWPZKDokYC2B.3 2024-09-12T00:54:02.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.779+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.781+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:54:02.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.782+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.783+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.783+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.784+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:54:02.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.785+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.786+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.786+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:02.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.786+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4654643825064238513', time=2024-09-12T02:44:48.463995+0000, chain.objs.size()=5 2024-09-12T00:54:02.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.786+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.1 2024-09-12T00:54:02.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.786+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.1_1 2024-09-12T00:54:02.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.786+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.2 2024-09-12T00:54:02.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.786+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.2_1 2024-09-12T00:54:02.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.786+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__multipart_foo-LUKEWARM.2~NwnEY62eu5xS_B_09o6IIiNYFpbmmqh.3 2024-09-12T00:54:02.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.789+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.790+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:54:02.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.792+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.792+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.793+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.792 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.793+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:54:02.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.795+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.795+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.795+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.796+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:54:02.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.798+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.798+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.798+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.798+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1359761561105354428', time=2024-09-12T02:44:48.371144+0000, chain.objs.size()=2 2024-09-12T00:54:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.798+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.jp2dtLN_cDXyL8E-7LT41Bx08sJNwiP_0 2024-09-12T00:54:02.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.798+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.jp2dtLN_cDXyL8E-7LT41Bx08sJNwiP_1 2024-09-12T00:54:02.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.800+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.802+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:54:02.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.804+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.804+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.805+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:02.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.805+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_J908ixsFL_Y4obn9MuNeV0zqbNhbn9x', time=2024-09-12T02:44:48.459174+0000, chain.objs.size()=2 2024-09-12T00:54:02.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.805+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.uRMcL1WDtrZwmQ8ovXCg22EHB8GJOGG_1 2024-09-12T00:54:02.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.805+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.uRMcL1WDtrZwmQ8ovXCg22EHB8GJOGG_2 2024-09-12T00:54:02.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.806+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.809+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:54:02.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.810+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:54:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3322312607224284375', time=2024-09-12T02:44:48.400630+0000, chain.objs.size()=2 2024-09-12T00:54:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.6OGuGVEmt6ziIE9C8j1SAF2mtuZRYDL_0 2024-09-12T00:54:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15__shadow_.6OGuGVEmt6ziIE9C8j1SAF2mtuZRYDL_1 2024-09-12T00:54:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='_ORFJYDeOMtz2sxMnzWNUFr0sseAPTrp', time=2024-09-12T02:44:48.447028+0000, chain.objs.size()=3 2024-09-12T00:54:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.2NypNftmlARtb3KIK0UtH0Q6C9jiZP4_0 2024-09-12T00:54:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.2NypNftmlARtb3KIK0UtH0Q6C9jiZP4_1 2024-09-12T00:54:02.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16__shadow_.2NypNftmlARtb3KIK0UtH0Q6C9jiZP4_2 2024-09-12T00:54:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8554560583895401482', time=2024-09-12T02:44:48.516164+0000, chain.objs.size()=5 2024-09-12T00:54:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-LUKEWARM.2~bSTzICmqwwKp7Zz4clAgVGjWsI-Ylyv.1 2024-09-12T00:54:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-LUKEWARM.2~bSTzICmqwwKp7Zz4clAgVGjWsI-Ylyv.1_1 2024-09-12T00:54:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-LUKEWARM.2~bSTzICmqwwKp7Zz4clAgVGjWsI-Ylyv.2 2024-09-12T00:54:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__shadow_foo-LUKEWARM.2~bSTzICmqwwKp7Zz4clAgVGjWsI-Ylyv.2_1 2024-09-12T00:54:02.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.811+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14__multipart_foo-LUKEWARM.2~bSTzICmqwwKp7Zz4clAgVGjWsI-Ylyv.3 2024-09-12T00:54:02.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.814+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.816+0000 7f3ada926800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:54:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.818+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:02.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.818+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.819+0000 7f3ada926800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.819+0000 7f3ada926800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5440206347788700520', time=2024-09-12T02:44:48.286535+0000, chain.objs.size()=4 2024-09-12T00:54:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.819+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12__multipart_foo.2~iR_AdDCiLcSCEM7bGO-FITXdRzW0B0p.1 2024-09-12T00:54:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.819+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12__multipart_foo.2~iR_AdDCiLcSCEM7bGO-FITXdRzW0B0p.2 2024-09-12T00:54:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.819+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12__multipart_foo.2~iR_AdDCiLcSCEM7bGO-FITXdRzW0B0p.3 2024-09-12T00:54:02.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.819+0000 7f3ada926800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12__multipart_foo.2~iR_AdDCiLcSCEM7bGO-FITXdRzW0B0p.4 2024-09-12T00:54:02.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.822+0000 7f3ada926800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:02.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.825+0000 7f398cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:02.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.827+0000 7f3ada926800 20 remove_watcher() i=0 2024-09-12T00:54:02.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.827+0000 7f3ada926800 2 removed watcher, disabling cache 2024-09-12T00:54:02.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.828+0000 7f3ada926800 20 remove_watcher() i=1 2024-09-12T00:54:02.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.830+0000 7f3ada926800 20 remove_watcher() i=2 2024-09-12T00:54:02.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.831+0000 7f3ada926800 20 remove_watcher() i=3 2024-09-12T00:54:02.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.832+0000 7f3ada926800 20 remove_watcher() i=4 2024-09-12T00:54:02.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.833+0000 7f3ada926800 20 remove_watcher() i=5 2024-09-12T00:54:02.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.834+0000 7f3ada926800 20 remove_watcher() i=6 2024-09-12T00:54:02.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.835+0000 7f3ada926800 20 remove_watcher() i=7 2024-09-12T00:54:02.845 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T00:54:02.898 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:02.898 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:02.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.939+0000 7f2d79013800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.941+0000 7f2d79013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.941+0000 7f2d79013800 20 realm 2024-09-12T00:54:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.941+0000 7f2d79013800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.941+0000 7f2d79013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.941+0000 7f2d79013800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.941+0000 7f2d79013800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.941+0000 7f2d79013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.941+0000 7f2d79013800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.942+0000 7f2d79013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.942+0000 7f2d79013800 20 rados->read ofs=0 len=0 2024-09-12T00:54:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.942+0000 7f2d79013800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:02.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.942+0000 7f2d79013800 20 searching for the correct realm 2024-09-12T00:54:02.944 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:02.945+0000 7f2d73f91640 0 -- 172.21.15.19:0/156082073 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f2d6801f070 msgr2=0x7f2d68037400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:03.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.150+0000 7f2d74f93640 0 -- 172.21.15.19:0/156082073 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55fb44bdfa90 msgr2=0x55fb44be1f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:03.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.155+0000 7f2d79013800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:54:03.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.155+0000 7f2d79013800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:54:03.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.155+0000 7f2d79013800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:03.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.155+0000 7f2d79013800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:03.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.155+0000 7f2d79013800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:03.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.155+0000 7f2d79013800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:03.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.155+0000 7f2d79013800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.155+0000 7f2d79013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.155+0000 7f2d79013800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.155+0000 7f2d79013800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.155+0000 7f2d79013800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 20 zone default found 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 4 Realm: () 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 20 zonegroup default 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.156+0000 7f2d79013800 20 rados->read ofs=0 len=0 2024-09-12T00:54:03.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.157+0000 7f2d79013800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:03.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.157+0000 7f2d79013800 20 started sync module instance, tier type = 2024-09-12T00:54:03.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.157+0000 7f2d79013800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:54:03.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.166+0000 7f2d79013800 20 add_watcher() i=0 2024-09-12T00:54:03.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.166+0000 7f2d79013800 20 add_watcher() i=1 2024-09-12T00:54:03.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.166+0000 7f2d79013800 20 add_watcher() i=2 2024-09-12T00:54:03.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.166+0000 7f2d79013800 20 add_watcher() i=3 2024-09-12T00:54:03.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.166+0000 7f2d79013800 20 add_watcher() i=4 2024-09-12T00:54:03.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.166+0000 7f2d79013800 20 add_watcher() i=5 2024-09-12T00:54:03.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.166+0000 7f2d79013800 20 add_watcher() i=6 2024-09-12T00:54:03.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.167+0000 7f2d79013800 20 add_watcher() i=7 2024-09-12T00:54:03.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.167+0000 7f2d79013800 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.169+0000 7f2c2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.169+0000 7f2d79013800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:03.168 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.169+0000 7f2d79013800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:03.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.205+0000 7f2c29fdb640 20 reqs_thread_entry: start 2024-09-12T00:54:03.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.205+0000 7f2d79013800 20 init_complete bucket index max shards: 11 2024-09-12T00:54:03.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.206+0000 7f2d79013800 20 Filter name: none 2024-09-12T00:54:03.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.206+0000 7f2b9b7fe640 20 reqs_thread_entry: start 2024-09-12T00:54:03.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.206+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:54:03.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.207+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.208+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.208+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.209+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:54:03.208 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.210+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.210+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.211+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.210 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.212+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:54:03.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.213+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.212 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.214+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.213 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.214+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.216+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:54:03.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.217+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.218+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.218+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.218 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.219+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:54:03.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.221+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.221+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.220 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.221+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.222+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:54:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.224+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.225+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.223 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.225+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.225 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.226+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:54:03.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.227+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.226 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.228+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.228+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.229+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:54:03.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.230+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.231+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.231+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.232+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:54:03.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.233+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.232 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.234+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.234+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.235+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:54:03.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.236+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.236+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.237+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.238+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:54:03.237 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.239+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.239+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.240+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.241+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:54:03.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.242+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.242+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.243+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.243+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:54:03.243 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.245+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.245+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.244 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.246+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.245 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.246+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:54:03.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.248+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.248+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.248+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.249+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:54:03.249 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.251+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.251+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.251+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.252+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:54:03.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.254+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.254+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.254+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.255+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:54:03.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.257+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.257+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.258+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.259+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:54:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.260+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.261+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.261+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.262+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:54:03.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.263+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.264+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.264+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.265+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:54:03.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.267+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.267+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.268+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.268+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:54:03.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.270+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.270+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.271+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.272+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:54:03.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.273+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.273+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.274+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.275+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:54:03.274 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.276+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.276+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.277+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.277 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.278+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:54:03.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.279+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.280+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.280+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.281+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:54:03.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.283+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.283+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.283+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.283 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.284+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:54:03.284 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.286+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.286+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.285 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.286+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.287+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:54:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.288+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.289+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.289+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.290+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:54:03.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.291+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.292+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.292+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.293+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:54:03.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.295+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.295+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.296+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.297+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:54:03.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.298+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.298+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.299+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.300+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:54:03.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.301+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.302+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.302+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.303+0000 7f2d79013800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:54:03.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.305+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.304 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.306+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:03.305 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.306+0000 7f2d79013800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:03.307 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.308+0000 7f2c2afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:03.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.310+0000 7f2d79013800 20 remove_watcher() i=0 2024-09-12T00:54:03.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.310+0000 7f2d79013800 2 removed watcher, disabling cache 2024-09-12T00:54:03.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.311+0000 7f2d79013800 20 remove_watcher() i=1 2024-09-12T00:54:03.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.312+0000 7f2d79013800 20 remove_watcher() i=2 2024-09-12T00:54:03.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.313+0000 7f2d79013800 20 remove_watcher() i=3 2024-09-12T00:54:03.312 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.314+0000 7f2d79013800 20 remove_watcher() i=4 2024-09-12T00:54:03.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.315+0000 7f2d79013800 20 remove_watcher() i=5 2024-09-12T00:54:03.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.316+0000 7f2d79013800 20 remove_watcher() i=6 2024-09-12T00:54:03.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:54:03.317+0000 7f2d79013800 20 remove_watcher() i=7 2024-09-12T00:54:03.326 DEBUG:teuthology.orchestra.run.smithi019:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:54:03.822 INFO:teuthology.orchestra.run.smithi019.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:54:07.423 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:54:25.922 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :compileJava 2024-09-12T00:54:25.922 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :processResources 2024-09-12T00:54:25.922 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :classes 2024-09-12T00:54:26.721 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:26.721 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :compileTestJava 2024-09-12T00:54:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:54:26.722 INFO:teuthology.orchestra.run.smithi019.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:54:26.723 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:26.723 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:54:26.723 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :testClasses 2024-09-12T00:54:32.821 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:32.822 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :test 2024-09-12T00:54:32.822 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:32.822 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:54:38.121 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:38.121 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:54:38.521 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:38.521 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:54:38.721 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:38.721 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:54:39.121 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:39.121 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:54:47.921 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:47.921 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:54:48.421 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:48.421 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:54:48.422 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:48.422 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:54:48.521 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:48.521 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:54:48.621 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:48.621 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:54:49.021 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:49.021 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:54:54.621 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:54.621 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:54:55.421 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:55.421 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:54:55.621 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:54:55.621 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:54:55.621 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12 00:54:55,604 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:55:27.721 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:27.722 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:55:28.521 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:28.521 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:55:28.621 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:28.621 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:55:29.021 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:29.021 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:55:29.121 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:29.121 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:55:29.821 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:29.821 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:55:35.321 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:35.321 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:55:35.821 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:35.822 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:55:35.822 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:35.822 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:55:35.921 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:35.921 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:55:44.821 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:44.821 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:55:46.421 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:46.421 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests STANDARD_OUT 2024-09-12T00:55:46.422 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12 00:55:46,378 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:55:46.422 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12 00:55:46,383 [s3-transfer-manager-worker-1] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:55:46.422 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12 00:55:46,387 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:55:46.721 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:55:46.721 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:56:00.221 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:56:00.221 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:56:00.820 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:56:00.821 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T00:56:03.421 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:56:03.421 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T00:56:03.821 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:56:03.821 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:57:34.822 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:57:34.822 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:57:35.321 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:57:35.321 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T00:57:44.321 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:57:44.321 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T00:57:44.721 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:57:44.721 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T00:57:50.321 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:57:50.321 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T00:57:50.721 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:57:50.721 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T00:57:52.721 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:57:52.721 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T00:57:59.521 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:57:59.522 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T00:57:59.621 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:57:59.621 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T00:58:00.021 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:00.021 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T00:58:00.121 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:00.121 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T00:58:00.521 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:00.521 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T00:58:00.621 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:00.621 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T00:58:01.121 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:01.121 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T00:58:01.121 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:01.121 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T00:58:01.621 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:01.621 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T00:58:01.721 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:01.721 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T00:58:02.121 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:02.121 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T00:58:02.221 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:02.221 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T00:58:02.621 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:02.621 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T00:58:02.721 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:02.721 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T00:58:03.121 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:03.121 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T00:58:16.322 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:16.322 INFO:teuthology.orchestra.run.smithi019.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T00:58:16.813 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:16.814 INFO:teuthology.orchestra.run.smithi019.stdout:---------------------------------------------------------------------- 2024-09-12T00:58:16.814 INFO:teuthology.orchestra.run.smithi019.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T00:58:16.814 INFO:teuthology.orchestra.run.smithi019.stdout:---------------------------------------------------------------------- 2024-09-12T00:58:16.814 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:16.814 INFO:teuthology.orchestra.run.smithi019.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:58:16.814 INFO:teuthology.orchestra.run.smithi019.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:58:16.814 INFO:teuthology.orchestra.run.smithi019.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:58:16.814 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:16.814 INFO:teuthology.orchestra.run.smithi019.stdout:BUILD SUCCESSFUL in 4m 13s 2024-09-12T00:58:16.814 INFO:teuthology.orchestra.run.smithi019.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T00:58:17.132 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T00:58:17.186 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:17.187 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:17.227 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.228+0000 7f383f939800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.230+0000 7f383f939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.230+0000 7f383f939800 20 realm 2024-09-12T00:58:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.230+0000 7f383f939800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.230+0000 7f383f939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.230+0000 7f383f939800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:17.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.230+0000 7f383f939800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.230+0000 7f383f939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.230+0000 7f383f939800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.231+0000 7f383f939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:17.230 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.231+0000 7f383f939800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.232+0000 7f383f939800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:17.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.232+0000 7f383f939800 20 searching for the correct realm 2024-09-12T00:58:17.234 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.235+0000 7f3832dc6640 0 -- 172.21.15.19:0/126889110 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f382406f5f0 msgr2=0x7f382405f460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:17.440 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.441+0000 7f383bdc8640 0 -- 172.21.15.19:0/126889110 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5599598c5950 msgr2=0x5599598c7de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:17.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.446+0000 7f383f939800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:58:17.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.446+0000 7f383f939800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:58:17.450 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.446+0000 7f383f939800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:17.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.446+0000 7f383f939800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:17.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.446+0000 7f383f939800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:17.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.446+0000 7f383f939800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:17.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.446+0000 7f383f939800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:17.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:17.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 20 zone default found 2024-09-12T00:58:17.451 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 4 Realm: () 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 20 zonegroup default 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.447+0000 7f383f939800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.448+0000 7f383f939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.448+0000 7f383f939800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.448+0000 7f383f939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.448+0000 7f383f939800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.448+0000 7f383f939800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.448+0000 7f383f939800 20 started sync module instance, tier type = 2024-09-12T00:58:17.452 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.448+0000 7f383f939800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:58:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.458+0000 7f383f939800 20 add_watcher() i=0 2024-09-12T00:58:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.458+0000 7f383f939800 20 add_watcher() i=1 2024-09-12T00:58:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.458+0000 7f383f939800 20 add_watcher() i=2 2024-09-12T00:58:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.458+0000 7f383f939800 20 add_watcher() i=3 2024-09-12T00:58:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.458+0000 7f383f939800 20 add_watcher() i=4 2024-09-12T00:58:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.458+0000 7f383f939800 20 add_watcher() i=5 2024-09-12T00:58:17.457 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.458+0000 7f383f939800 20 add_watcher() i=6 2024-09-12T00:58:17.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.459+0000 7f383f939800 20 add_watcher() i=7 2024-09-12T00:58:17.458 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.459+0000 7f383f939800 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:17.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.461+0000 7f36f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:17.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.461+0000 7f383f939800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:17.460 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.461+0000 7f383f939800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:17.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.500+0000 7f36f0fe1640 20 reqs_thread_entry: start 2024-09-12T00:58:17.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.500+0000 7f383f939800 20 init_complete bucket index max shards: 11 2024-09-12T00:58:17.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.500+0000 7f383f939800 20 Filter name: none 2024-09-12T00:58:17.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.500+0000 7f366a7fc640 20 reqs_thread_entry: start 2024-09-12T00:58:17.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.500+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:58:17.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.502+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.502+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.503+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.504+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:58:17.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.505+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.505+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.506+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.506+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3668770901895932062', time=2024-09-12T02:55:35.457125+0000, chain.objs.size()=9 2024-09-12T00:58:17.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.506+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.51__multipart_key1.2~qV3nLNg3XwJ1bKo2TDE5OSWgVLaQAln.1 2024-09-12T00:58:17.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.506+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.51__shadow_key1.2~qV3nLNg3XwJ1bKo2TDE5OSWgVLaQAln.1_1 2024-09-12T00:58:17.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.506+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.51__multipart_key1.2~qV3nLNg3XwJ1bKo2TDE5OSWgVLaQAln.2 2024-09-12T00:58:17.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.506+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.51__shadow_key1.2~qV3nLNg3XwJ1bKo2TDE5OSWgVLaQAln.2_1 2024-09-12T00:58:17.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.506+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.51__multipart_key1.2~qV3nLNg3XwJ1bKo2TDE5OSWgVLaQAln.3 2024-09-12T00:58:17.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.506+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.51__shadow_key1.2~qV3nLNg3XwJ1bKo2TDE5OSWgVLaQAln.3_1 2024-09-12T00:58:17.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.506+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.51__multipart_key1.2~qV3nLNg3XwJ1bKo2TDE5OSWgVLaQAln.4 2024-09-12T00:58:17.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.506+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.51__shadow_key1.2~qV3nLNg3XwJ1bKo2TDE5OSWgVLaQAln.4_1 2024-09-12T00:58:17.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.506+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.51__multipart_key1.2~qV3nLNg3XwJ1bKo2TDE5OSWgVLaQAln.5 2024-09-12T00:58:17.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.511+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.514+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:58:17.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.515+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.515+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.516+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.516+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='2~wPnnEcdW4l5A6zjbiUw6u_yq2rvL-pj', time=2024-09-12T02:54:38.076480+0000, chain.objs.size()=9 2024-09-12T00:58:17.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.516+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.40__multipart_key1.2~wPnnEcdW4l5A6zjbiUw6u_yq2rvL-pj.1 2024-09-12T00:58:17.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.516+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.40__shadow_key1.2~wPnnEcdW4l5A6zjbiUw6u_yq2rvL-pj.1_1 2024-09-12T00:58:17.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.516+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.40__multipart_key1.2~wPnnEcdW4l5A6zjbiUw6u_yq2rvL-pj.2 2024-09-12T00:58:17.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.516+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.40__shadow_key1.2~wPnnEcdW4l5A6zjbiUw6u_yq2rvL-pj.2_1 2024-09-12T00:58:17.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.516+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.40__multipart_key1.2~wPnnEcdW4l5A6zjbiUw6u_yq2rvL-pj.3 2024-09-12T00:58:17.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.516+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.40__shadow_key1.2~wPnnEcdW4l5A6zjbiUw6u_yq2rvL-pj.3_1 2024-09-12T00:58:17.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.516+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.40__multipart_key1.2~wPnnEcdW4l5A6zjbiUw6u_yq2rvL-pj.4 2024-09-12T00:58:17.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.516+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.40__shadow_key1.2~wPnnEcdW4l5A6zjbiUw6u_yq2rvL-pj.4_1 2024-09-12T00:58:17.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.516+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.40__multipart_key1.2~wPnnEcdW4l5A6zjbiUw6u_yq2rvL-pj.5 2024-09-12T00:58:17.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.522+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.524+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:58:17.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.526+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.526+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.526+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.526+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15405426038101558790', time=2024-09-12T02:55:46.205868+0000, chain.objs.size()=9 2024-09-12T00:58:17.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.526+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.52__multipart_key1.2~yHtvlUcZvOPg08aQGIRjfF9d2-iMPXm.1 2024-09-12T00:58:17.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.526+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.52__shadow_key1.2~yHtvlUcZvOPg08aQGIRjfF9d2-iMPXm.1_1 2024-09-12T00:58:17.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.526+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.52__multipart_key1.2~yHtvlUcZvOPg08aQGIRjfF9d2-iMPXm.2 2024-09-12T00:58:17.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.526+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.52__shadow_key1.2~yHtvlUcZvOPg08aQGIRjfF9d2-iMPXm.2_1 2024-09-12T00:58:17.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.527+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.52__multipart_key1.2~yHtvlUcZvOPg08aQGIRjfF9d2-iMPXm.3 2024-09-12T00:58:17.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.527+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.52__shadow_key1.2~yHtvlUcZvOPg08aQGIRjfF9d2-iMPXm.3_1 2024-09-12T00:58:17.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.527+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.52__multipart_key1.2~yHtvlUcZvOPg08aQGIRjfF9d2-iMPXm.4 2024-09-12T00:58:17.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.527+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.52__shadow_key1.2~yHtvlUcZvOPg08aQGIRjfF9d2-iMPXm.4_1 2024-09-12T00:58:17.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.527+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.52__multipart_key1.2~yHtvlUcZvOPg08aQGIRjfF9d2-iMPXm.5 2024-09-12T00:58:17.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.531+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.534+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:58:17.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.536+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.536+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8974289571082469645', time=2024-09-12T02:57:02.994927+0000, chain.objs.size()=16 2024-09-12T00:58:17.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.1 2024-09-12T00:58:17.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.1_1 2024-09-12T00:58:17.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.1_2 2024-09-12T00:58:17.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.2 2024-09-12T00:58:17.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.2_1 2024-09-12T00:58:17.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.2_2 2024-09-12T00:58:17.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.3 2024-09-12T00:58:17.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.3_1 2024-09-12T00:58:17.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.3_2 2024-09-12T00:58:17.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.4 2024-09-12T00:58:17.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.4_1 2024-09-12T00:58:17.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.537+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.4_2 2024-09-12T00:58:17.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.540+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.5 2024-09-12T00:58:17.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.541+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.5_1 2024-09-12T00:58:17.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.543+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.5_2 2024-09-12T00:58:17.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.543+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~enGsdZs1mEb1TYZXF_0T75WxNCEMtIN.6 2024-09-12T00:58:17.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.546+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.548+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:58:17.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.549+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.550+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.550+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.551+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:58:17.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.552+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.553+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.553+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.553+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14433575073111958948', time=2024-09-12T02:55:27.649329+0000, chain.objs.size()=7 2024-09-12T00:58:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.553+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~tBTZzERW8mv0XW7iIbijgZv3M-x4CkP.1 2024-09-12T00:58:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.553+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~tBTZzERW8mv0XW7iIbijgZv3M-x4CkP.1_1 2024-09-12T00:58:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.553+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~tBTZzERW8mv0XW7iIbijgZv3M-x4CkP.1_2 2024-09-12T00:58:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.553+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~tBTZzERW8mv0XW7iIbijgZv3M-x4CkP.2 2024-09-12T00:58:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.553+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~tBTZzERW8mv0XW7iIbijgZv3M-x4CkP.2_1 2024-09-12T00:58:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.554+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~tBTZzERW8mv0XW7iIbijgZv3M-x4CkP.2_2 2024-09-12T00:58:17.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.554+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~tBTZzERW8mv0XW7iIbijgZv3M-x4CkP.3 2024-09-12T00:58:17.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.558+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.560+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:58:17.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.561+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.561 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16810691080798323140', time=2024-09-12T02:55:16.147564+0000, chain.objs.size()=9 2024-09-12T00:58:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~ybLfBc7pR_UAoWzF5LwMt4bUmgKBCEH.1 2024-09-12T00:58:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~ybLfBc7pR_UAoWzF5LwMt4bUmgKBCEH.1_1 2024-09-12T00:58:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~ybLfBc7pR_UAoWzF5LwMt4bUmgKBCEH.2 2024-09-12T00:58:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~ybLfBc7pR_UAoWzF5LwMt4bUmgKBCEH.2_1 2024-09-12T00:58:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~ybLfBc7pR_UAoWzF5LwMt4bUmgKBCEH.3 2024-09-12T00:58:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~ybLfBc7pR_UAoWzF5LwMt4bUmgKBCEH.3_1 2024-09-12T00:58:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~ybLfBc7pR_UAoWzF5LwMt4bUmgKBCEH.4 2024-09-12T00:58:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~ybLfBc7pR_UAoWzF5LwMt4bUmgKBCEH.4_1 2024-09-12T00:58:17.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.562+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~ybLfBc7pR_UAoWzF5LwMt4bUmgKBCEH.5 2024-09-12T00:58:17.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.566+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.568 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.569+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:58:17.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.571+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.571+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.571+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.572+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:58:17.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.573+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13948453563246801773', time=2024-09-12T02:54:55.089372+0000, chain.objs.size()=9 2024-09-12T00:58:17.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__multipart_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.1 2024-09-12T00:58:17.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__shadow_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.1_1 2024-09-12T00:58:17.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__multipart_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.2 2024-09-12T00:58:17.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__shadow_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.2_1 2024-09-12T00:58:17.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__multipart_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.3 2024-09-12T00:58:17.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__shadow_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.3_1 2024-09-12T00:58:17.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__multipart_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.4 2024-09-12T00:58:17.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__shadow_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.4_1 2024-09-12T00:58:17.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.574+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__multipart_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.5 2024-09-12T00:58:17.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.578+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.580+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:58:17.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.582+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.582+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.583+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.583+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.730794030535592362', time=2024-09-12T02:56:00.398649+0000, chain.objs.size()=5 2024-09-12T00:58:17.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.583+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__multipart_file2.mpg.2~XQdypx1EGeUq9RNgMhrMCx64HAbSOkc.1 2024-09-12T00:58:17.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.583+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__multipart_file2.mpg.2~XQdypx1EGeUq9RNgMhrMCx64HAbSOkc.2 2024-09-12T00:58:17.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.583+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__multipart_file2.mpg.2~XQdypx1EGeUq9RNgMhrMCx64HAbSOkc.3 2024-09-12T00:58:17.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.583+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__multipart_file2.mpg.2~XQdypx1EGeUq9RNgMhrMCx64HAbSOkc.4 2024-09-12T00:58:17.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.583+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__multipart_file2.mpg.2~XQdypx1EGeUq9RNgMhrMCx64HAbSOkc.5 2024-09-12T00:58:17.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.586+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.587 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.588+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:58:17.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.590+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.590+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.590+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.590 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.591+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:58:17.591 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.592 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5488885735587747019', time=2024-09-12T02:57:34.751801+0000, chain.objs.size()=16 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.1 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.1_1 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.1_2 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.2 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.2_1 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.2_2 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.3 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.3_1 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.3_2 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.4 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.4_1 2024-09-12T00:58:17.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.593+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.4_2 2024-09-12T00:58:17.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.598+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.5 2024-09-12T00:58:17.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.598+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.5_1 2024-09-12T00:58:17.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.600+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.5_2 2024-09-12T00:58:17.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.600+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~yq5rf_XOyaUvOu4Fa6i-G0QfdadTyji.6 2024-09-12T00:58:17.602 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.604+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.604 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.606+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:58:17.605 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.607+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.607+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.608+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.607 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.609+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:58:17.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.610+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.610+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:58:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4646820148050918730', time=2024-09-12T02:54:54.772641+0000, chain.objs.size()=9 2024-09-12T00:58:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__multipart_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.1 2024-09-12T00:58:17.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__shadow_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.1_1 2024-09-12T00:58:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__multipart_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.2 2024-09-12T00:58:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__shadow_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.2_1 2024-09-12T00:58:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__multipart_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.3 2024-09-12T00:58:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__shadow_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.3_1 2024-09-12T00:58:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__multipart_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.4 2024-09-12T00:58:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__shadow_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.4_1 2024-09-12T00:58:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.44__multipart_key1.2~0EGko6vbWvaoXHVkM8fxtBd5YuCqefG.5 2024-09-12T00:58:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.2208345209805041672', time=2024-09-12T02:56:27.763870+0000, chain.objs.size()=21 2024-09-12T00:58:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.1 2024-09-12T00:58:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.1_1 2024-09-12T00:58:17.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.611+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.2 2024-09-12T00:58:17.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.614+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.2_1 2024-09-12T00:58:17.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.614+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.3 2024-09-12T00:58:17.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.616+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.3_1 2024-09-12T00:58:17.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.616+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.4 2024-09-12T00:58:17.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.616+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.4_1 2024-09-12T00:58:17.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.616+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.5 2024-09-12T00:58:17.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.616+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.5_1 2024-09-12T00:58:17.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.616+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.6 2024-09-12T00:58:17.615 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.616+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.6_1 2024-09-12T00:58:17.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.617+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.7 2024-09-12T00:58:17.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.617+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.7_1 2024-09-12T00:58:17.616 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.618+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.8 2024-09-12T00:58:17.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.620+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.8_1 2024-09-12T00:58:17.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.620+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.9 2024-09-12T00:58:17.619 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.620+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.9_1 2024-09-12T00:58:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.621+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.10 2024-09-12T00:58:17.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.621+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.10_1 2024-09-12T00:58:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.621+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~frXPJylY4W68upvXTuFh6AbKJ7kWHyb.11 2024-09-12T00:58:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.621+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3990623761298225032', time=2024-09-12T02:56:38.781504+0000, chain.objs.size()=21 2024-09-12T00:58:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.621+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.1 2024-09-12T00:58:17.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.621+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.1_1 2024-09-12T00:58:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.623+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.2 2024-09-12T00:58:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.624+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.2_1 2024-09-12T00:58:17.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.624+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.3 2024-09-12T00:58:17.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.627+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.3_1 2024-09-12T00:58:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.627+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.4 2024-09-12T00:58:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.627+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.4_1 2024-09-12T00:58:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.627+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.5 2024-09-12T00:58:17.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.627+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.5_1 2024-09-12T00:58:17.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.628+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.6 2024-09-12T00:58:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.629+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.6_1 2024-09-12T00:58:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.629+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.7 2024-09-12T00:58:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.629+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.7_1 2024-09-12T00:58:17.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.630+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.8 2024-09-12T00:58:17.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.630+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.8_1 2024-09-12T00:58:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.634+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.9 2024-09-12T00:58:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.634+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.9_1 2024-09-12T00:58:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.634+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.10 2024-09-12T00:58:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.634+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.10_1 2024-09-12T00:58:17.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.634+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~TXvbHfgkPFL6EINFY0rlkS7_MYVA2m2.11 2024-09-12T00:58:17.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.639+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.642+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:58:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.643+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.644+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.644+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.645+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:58:17.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.646+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.646+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:58:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17431371750719526506', time=2024-09-12T02:55:19.310496+0000, chain.objs.size()=9 2024-09-12T00:58:17.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~mj7BwzpFovBknXrrYNEUZnSJtQwccob.1 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~mj7BwzpFovBknXrrYNEUZnSJtQwccob.1_1 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~mj7BwzpFovBknXrrYNEUZnSJtQwccob.2 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~mj7BwzpFovBknXrrYNEUZnSJtQwccob.2_1 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~mj7BwzpFovBknXrrYNEUZnSJtQwccob.3 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~mj7BwzpFovBknXrrYNEUZnSJtQwccob.3_1 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~mj7BwzpFovBknXrrYNEUZnSJtQwccob.4 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~mj7BwzpFovBknXrrYNEUZnSJtQwccob.4_1 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~mj7BwzpFovBknXrrYNEUZnSJtQwccob.5 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12307176451210477378', time=2024-09-12T02:55:25.046268+0000, chain.objs.size()=7 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~fi545sQMb69oR6Y0pLo_evk2tUVTfrB.1 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~fi545sQMb69oR6Y0pLo_evk2tUVTfrB.1_1 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.647+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~fi545sQMb69oR6Y0pLo_evk2tUVTfrB.1_2 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.650+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~fi545sQMb69oR6Y0pLo_evk2tUVTfrB.2 2024-09-12T00:58:17.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.650+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~fi545sQMb69oR6Y0pLo_evk2tUVTfrB.2_1 2024-09-12T00:58:17.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.650+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~fi545sQMb69oR6Y0pLo_evk2tUVTfrB.2_2 2024-09-12T00:58:17.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.650+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~fi545sQMb69oR6Y0pLo_evk2tUVTfrB.3 2024-09-12T00:58:17.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.650+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK', time=2024-09-12T02:57:57.245600+0000, chain.objs.size()=1 2024-09-12T00:58:17.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.650+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.19 2024-09-12T00:58:17.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.651+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK', time=2024-09-12T02:57:57.310360+0000, chain.objs.size()=50 2024-09-12T00:58:17.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.651+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.1 2024-09-12T00:58:17.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.651+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.2 2024-09-12T00:58:17.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.652+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.3 2024-09-12T00:58:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.652+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.4 2024-09-12T00:58:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.652+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.5 2024-09-12T00:58:17.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.652+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.6 2024-09-12T00:58:17.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.656+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.7 2024-09-12T00:58:17.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.656+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.8 2024-09-12T00:58:17.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.657+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.9 2024-09-12T00:58:17.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.657+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.10 2024-09-12T00:58:17.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.657+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.11 2024-09-12T00:58:17.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.660+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.12 2024-09-12T00:58:17.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.660+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.13 2024-09-12T00:58:17.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.660+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.14 2024-09-12T00:58:17.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.660+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.15 2024-09-12T00:58:17.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.660+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.16 2024-09-12T00:58:17.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.660+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.17 2024-09-12T00:58:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.662+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.18 2024-09-12T00:58:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.662+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.vgr9h0su8pYCB6xepb4h1PqyZY2naDvk.19 2024-09-12T00:58:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.662+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.20 2024-09-12T00:58:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.662+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.21 2024-09-12T00:58:17.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.662+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.22 2024-09-12T00:58:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.665+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.23 2024-09-12T00:58:17.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.665+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.24 2024-09-12T00:58:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.665+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.25 2024-09-12T00:58:17.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.666+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.26 2024-09-12T00:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.666+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.27 2024-09-12T00:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.666+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.28 2024-09-12T00:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.666+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.29 2024-09-12T00:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.666+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.30 2024-09-12T00:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.666+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.31 2024-09-12T00:58:17.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.666+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.32 2024-09-12T00:58:17.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.669+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.33 2024-09-12T00:58:17.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.669+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.34 2024-09-12T00:58:17.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.670+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.35 2024-09-12T00:58:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.671+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.36 2024-09-12T00:58:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.671+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.37 2024-09-12T00:58:17.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.671+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.38 2024-09-12T00:58:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.671+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.39 2024-09-12T00:58:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.671+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.40 2024-09-12T00:58:17.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.671+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.41 2024-09-12T00:58:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.673+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.42 2024-09-12T00:58:17.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.673+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.43 2024-09-12T00:58:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.674+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.44 2024-09-12T00:58:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.674+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.45 2024-09-12T00:58:17.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.675+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.46 2024-09-12T00:58:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.675+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.47 2024-09-12T00:58:17.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.675+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.48 2024-09-12T00:58:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.676+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.49 2024-09-12T00:58:17.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.676+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.58__multipart_key1.2~GKm2u0CWBMy7jOVpEfO9N-wubuLnmjK.50 2024-09-12T00:58:17.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.681+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.683+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:58:17.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.685+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.685+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.685+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.686+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:58:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.687+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.688+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.688+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.689+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:58:17.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.691+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.691+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.692+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.693+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:58:17.693 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.694+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12196854585482105706', time=2024-09-12T02:56:00.327027+0000, chain.objs.size()=9 2024-09-12T00:58:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__multipart_file.mpg.2~k-URuHSzIBptaeB7GBljVLg8Yj9aka8.1 2024-09-12T00:58:17.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__shadow_file.mpg.2~k-URuHSzIBptaeB7GBljVLg8Yj9aka8.1_1 2024-09-12T00:58:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__multipart_file.mpg.2~k-URuHSzIBptaeB7GBljVLg8Yj9aka8.2 2024-09-12T00:58:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__shadow_file.mpg.2~k-URuHSzIBptaeB7GBljVLg8Yj9aka8.2_1 2024-09-12T00:58:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__multipart_file.mpg.2~k-URuHSzIBptaeB7GBljVLg8Yj9aka8.3 2024-09-12T00:58:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__shadow_file.mpg.2~k-URuHSzIBptaeB7GBljVLg8Yj9aka8.3_1 2024-09-12T00:58:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__multipart_file.mpg.2~k-URuHSzIBptaeB7GBljVLg8Yj9aka8.4 2024-09-12T00:58:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__shadow_file.mpg.2~k-URuHSzIBptaeB7GBljVLg8Yj9aka8.4_1 2024-09-12T00:58:17.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.695+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.53__multipart_file.mpg.2~k-URuHSzIBptaeB7GBljVLg8Yj9aka8.5 2024-09-12T00:58:17.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.699+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.703+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:58:17.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.704+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.704+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.705+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.706+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:58:17.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.707+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.707+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.707+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:58:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.707+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16616776531561541522', time=2024-09-12T02:54:48.084119+0000, chain.objs.size()=9 2024-09-12T00:58:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.707+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.42__multipart_key1.2~5i6mIr-cYIF7zLRnGMj_GSX73p0A6_s.1 2024-09-12T00:58:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.42__shadow_key1.2~5i6mIr-cYIF7zLRnGMj_GSX73p0A6_s.1_1 2024-09-12T00:58:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.42__multipart_key1.2~5i6mIr-cYIF7zLRnGMj_GSX73p0A6_s.2 2024-09-12T00:58:17.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.42__shadow_key1.2~5i6mIr-cYIF7zLRnGMj_GSX73p0A6_s.2_1 2024-09-12T00:58:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.42__multipart_key1.2~5i6mIr-cYIF7zLRnGMj_GSX73p0A6_s.3 2024-09-12T00:58:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.42__shadow_key1.2~5i6mIr-cYIF7zLRnGMj_GSX73p0A6_s.3_1 2024-09-12T00:58:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.42__multipart_key1.2~5i6mIr-cYIF7zLRnGMj_GSX73p0A6_s.4 2024-09-12T00:58:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.42__shadow_key1.2~5i6mIr-cYIF7zLRnGMj_GSX73p0A6_s.4_1 2024-09-12T00:58:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.42__multipart_key1.2~5i6mIr-cYIF7zLRnGMj_GSX73p0A6_s.5 2024-09-12T00:58:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8782784197376537784', time=2024-09-12T02:55:27.872368+0000, chain.objs.size()=5 2024-09-12T00:58:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.46__shadow_.UlKpPFMVLvRnVCe2plxOK6g7NzPt8fy_1 2024-09-12T00:58:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.46__shadow_.UlKpPFMVLvRnVCe2plxOK6g7NzPt8fy_2 2024-09-12T00:58:17.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.708+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.46__shadow_.UlKpPFMVLvRnVCe2plxOK6g7NzPt8fy_3 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.46__shadow_.UlKpPFMVLvRnVCe2plxOK6g7NzPt8fy_4 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.46__shadow_.UlKpPFMVLvRnVCe2plxOK6g7NzPt8fy_5 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.2459501576895074708', time=2024-09-12T02:57:44.382520+0000, chain.objs.size()=9 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.56__multipart_key1.2~rXROaICR9O6CtJA9fBKFVmSCsTuMGTc.1 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.56__shadow_key1.2~rXROaICR9O6CtJA9fBKFVmSCsTuMGTc.1_1 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.56__multipart_key1.2~rXROaICR9O6CtJA9fBKFVmSCsTuMGTc.2 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.56__shadow_key1.2~rXROaICR9O6CtJA9fBKFVmSCsTuMGTc.2_1 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.56__multipart_key1.2~rXROaICR9O6CtJA9fBKFVmSCsTuMGTc.3 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.56__shadow_key1.2~rXROaICR9O6CtJA9fBKFVmSCsTuMGTc.3_1 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.56__multipart_key1.2~rXROaICR9O6CtJA9fBKFVmSCsTuMGTc.4 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.56__shadow_key1.2~rXROaICR9O6CtJA9fBKFVmSCsTuMGTc.4_1 2024-09-12T00:58:17.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.714+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.56__multipart_key1.2~rXROaICR9O6CtJA9fBKFVmSCsTuMGTc.5 2024-09-12T00:58:17.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.721+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.722 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.724+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:58:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.725+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.725+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.726+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.725 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.727+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:58:17.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.728+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.728+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.729+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.730+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:58:17.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.731+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.731+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.732+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.733+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:58:17.732 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.734+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.734+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:58:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18079351759936012610', time=2024-09-12T02:55:28.186709+0000, chain.objs.size()=7 2024-09-12T00:58:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~LZDSnRKyGHD-_wM8xXMf9tRMfyTZ5nu.1 2024-09-12T00:58:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~LZDSnRKyGHD-_wM8xXMf9tRMfyTZ5nu.1_1 2024-09-12T00:58:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~LZDSnRKyGHD-_wM8xXMf9tRMfyTZ5nu.1_2 2024-09-12T00:58:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~LZDSnRKyGHD-_wM8xXMf9tRMfyTZ5nu.2 2024-09-12T00:58:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~LZDSnRKyGHD-_wM8xXMf9tRMfyTZ5nu.2_1 2024-09-12T00:58:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~LZDSnRKyGHD-_wM8xXMf9tRMfyTZ5nu.2_2 2024-09-12T00:58:17.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~LZDSnRKyGHD-_wM8xXMf9tRMfyTZ5nu.3 2024-09-12T00:58:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='2~mOlFl00IK_sVXq6zw5nEXLXe76lwvPt', time=2024-09-12T02:56:03.625128+0000, chain.objs.size()=5 2024-09-12T00:58:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.54__multipart_key1.2~mOlFl00IK_sVXq6zw5nEXLXe76lwvPt.7 2024-09-12T00:58:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.54__shadow_key1.2~mOlFl00IK_sVXq6zw5nEXLXe76lwvPt.7_1 2024-09-12T00:58:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.54__multipart_key1.2~mOlFl00IK_sVXq6zw5nEXLXe76lwvPt.10 2024-09-12T00:58:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.54__shadow_key1.2~mOlFl00IK_sVXq6zw5nEXLXe76lwvPt.10_1 2024-09-12T00:58:17.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.735+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.54__multipart_key1.2~mOlFl00IK_sVXq6zw5nEXLXe76lwvPt.13 2024-09-12T00:58:17.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.738+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3113688395001212888', time=2024-09-12T02:57:50.449695+0000, chain.objs.size()=9 2024-09-12T00:58:17.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.738+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.57__multipart_key1.2~YTaS55EXExcwNdVL-CsFH1cwD1iTh_b.1 2024-09-12T00:58:17.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.738+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.57__shadow_key1.2~YTaS55EXExcwNdVL-CsFH1cwD1iTh_b.1_1 2024-09-12T00:58:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.739+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.57__multipart_key1.2~YTaS55EXExcwNdVL-CsFH1cwD1iTh_b.2 2024-09-12T00:58:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.739+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.57__shadow_key1.2~YTaS55EXExcwNdVL-CsFH1cwD1iTh_b.2_1 2024-09-12T00:58:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.739+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.57__multipart_key1.2~YTaS55EXExcwNdVL-CsFH1cwD1iTh_b.3 2024-09-12T00:58:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.739+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.57__shadow_key1.2~YTaS55EXExcwNdVL-CsFH1cwD1iTh_b.3_1 2024-09-12T00:58:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.739+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.57__multipart_key1.2~YTaS55EXExcwNdVL-CsFH1cwD1iTh_b.4 2024-09-12T00:58:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.739+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.57__shadow_key1.2~YTaS55EXExcwNdVL-CsFH1cwD1iTh_b.4_1 2024-09-12T00:58:17.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.739+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.57__multipart_key1.2~YTaS55EXExcwNdVL-CsFH1cwD1iTh_b.5 2024-09-12T00:58:17.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.746+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.748+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:58:17.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.749+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.818993179825972512', time=2024-09-12T02:58:16.399055+0000, chain.objs.size()=21 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__multipart_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.1 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__shadow_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.1_1 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__multipart_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.2 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__shadow_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.2_1 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__multipart_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.3 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__shadow_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.3_1 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__multipart_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.4 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__shadow_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.4_1 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__multipart_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.5 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__shadow_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.5_1 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__multipart_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.6 2024-09-12T00:58:17.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.750+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__shadow_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.6_1 2024-09-12T00:58:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.755+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__multipart_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.7 2024-09-12T00:58:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.755+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__shadow_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.7_1 2024-09-12T00:58:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.756+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__multipart_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.8 2024-09-12T00:58:17.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.756+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__shadow_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.8_1 2024-09-12T00:58:17.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.756+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__multipart_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.9 2024-09-12T00:58:17.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.756+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__shadow_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.9_1 2024-09-12T00:58:17.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.756+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__multipart_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.10 2024-09-12T00:58:17.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.756+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__shadow_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.10_1 2024-09-12T00:58:17.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.756+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.66__multipart_key1.2~bpV1QrdaFv3Bej3h2SqRtxG22v61S6T.11 2024-09-12T00:58:17.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.761+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.763+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:58:17.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.765+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.765+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.765+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.766+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:58:17.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.768+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.768+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.768+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.769+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:58:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:58:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6877258868287757512', time=2024-09-12T02:57:34.980258+0000, chain.objs.size()=16 2024-09-12T00:58:17.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.1 2024-09-12T00:58:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.1_1 2024-09-12T00:58:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.1_2 2024-09-12T00:58:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.2 2024-09-12T00:58:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.2_1 2024-09-12T00:58:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.2_2 2024-09-12T00:58:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.3 2024-09-12T00:58:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.3_1 2024-09-12T00:58:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.771+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.3_2 2024-09-12T00:58:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.772+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.4 2024-09-12T00:58:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.772+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.4_1 2024-09-12T00:58:17.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.772+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.4_2 2024-09-12T00:58:17.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.776+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.5 2024-09-12T00:58:17.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.776+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.5_1 2024-09-12T00:58:17.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.776+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.5_2 2024-09-12T00:58:17.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.776+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~OrrZ5hYmYaPtYtO1NV30T0KyQ59jrIY.6 2024-09-12T00:58:17.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.780+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.783+0000 7f383f939800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:58:17.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.784+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.784+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:58:17.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17365436801639482877', time=2024-09-12T02:55:22.173694+0000, chain.objs.size()=9 2024-09-12T00:58:17.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~arTKcrRkoUGgHt8ynlN2LjPAYrMT2qK.1 2024-09-12T00:58:17.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~arTKcrRkoUGgHt8ynlN2LjPAYrMT2qK.1_1 2024-09-12T00:58:17.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~arTKcrRkoUGgHt8ynlN2LjPAYrMT2qK.2 2024-09-12T00:58:17.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~arTKcrRkoUGgHt8ynlN2LjPAYrMT2qK.2_1 2024-09-12T00:58:17.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~arTKcrRkoUGgHt8ynlN2LjPAYrMT2qK.3 2024-09-12T00:58:17.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~arTKcrRkoUGgHt8ynlN2LjPAYrMT2qK.3_1 2024-09-12T00:58:17.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~arTKcrRkoUGgHt8ynlN2LjPAYrMT2qK.4 2024-09-12T00:58:17.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__shadow_key1.2~arTKcrRkoUGgHt8ynlN2LjPAYrMT2qK.4_1 2024-09-12T00:58:17.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.47__multipart_key1.2~arTKcrRkoUGgHt8ynlN2LjPAYrMT2qK.5 2024-09-12T00:58:17.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8688802454288490725', time=2024-09-12T02:56:50.869198+0000, chain.objs.size()=19 2024-09-12T00:58:17.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.1 2024-09-12T00:58:17.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.1_1 2024-09-12T00:58:17.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.785+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.2 2024-09-12T00:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.789+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.2_1 2024-09-12T00:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.789+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.3 2024-09-12T00:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.789+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.3_1 2024-09-12T00:58:17.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.790+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.4 2024-09-12T00:58:17.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.792+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.4_1 2024-09-12T00:58:17.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.792+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.5 2024-09-12T00:58:17.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.792+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.5_1 2024-09-12T00:58:17.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.792+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.6 2024-09-12T00:58:17.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.792+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.6_1 2024-09-12T00:58:17.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.792+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.7 2024-09-12T00:58:17.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.793+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.7_1 2024-09-12T00:58:17.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.797+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.8 2024-09-12T00:58:17.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.797+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.8_1 2024-09-12T00:58:17.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.797+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.9 2024-09-12T00:58:17.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.797+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__shadow_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.9_1 2024-09-12T00:58:17.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.798+0000 7f383f939800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.55__multipart_key1.2~NJWiDeSf1-dAbFcCgOdjShqCFeu6hEN.10 2024-09-12T00:58:17.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.801+0000 7f383f939800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:58:17.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.805+0000 7f36f1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:17.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.807+0000 7f383f939800 20 remove_watcher() i=0 2024-09-12T00:58:17.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.807+0000 7f383f939800 2 removed watcher, disabling cache 2024-09-12T00:58:17.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.807+0000 7f383f939800 20 remove_watcher() i=1 2024-09-12T00:58:17.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.808+0000 7f383f939800 20 remove_watcher() i=2 2024-09-12T00:58:17.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.809+0000 7f383f939800 20 remove_watcher() i=3 2024-09-12T00:58:17.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.810+0000 7f383f939800 20 remove_watcher() i=4 2024-09-12T00:58:17.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.812+0000 7f383f939800 20 remove_watcher() i=5 2024-09-12T00:58:17.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.813+0000 7f383f939800 20 remove_watcher() i=6 2024-09-12T00:58:17.812 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.813+0000 7f383f939800 20 remove_watcher() i=7 2024-09-12T00:58:17.824 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T00:58:17.879 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:17.880 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:17.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.921+0000 7ffa3e02f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.923+0000 7ffa3e02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.923+0000 7ffa3e02f800 20 realm 2024-09-12T00:58:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.923+0000 7ffa3e02f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.923+0000 7ffa3e02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.923+0000 7ffa3e02f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.923+0000 7ffa3e02f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.923+0000 7ffa3e02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.923+0000 7ffa3e02f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.924+0000 7ffa3e02f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.924+0000 7ffa3e02f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.924+0000 7ffa3e02f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.924+0000 7ffa3e02f800 20 searching for the correct realm 2024-09-12T00:58:17.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.925+0000 7ffa39b8c640 0 -- 172.21.15.19:0/4187226835 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7ffa30068070 msgr2=0x7ffa300a5980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:17.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.929+0000 7ffa39b8c640 0 -- 172.21.15.19:0/4187226835 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5598b55e72d0 msgr2=0x5598b55e9770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:17.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.936+0000 7ffa3e02f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:58:17.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.936+0000 7ffa3e02f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:58:17.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.936+0000 7ffa3e02f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:17.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.936+0000 7ffa3e02f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:17.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.936+0000 7ffa3e02f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:17.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.936+0000 7ffa3e02f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:17.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.936+0000 7ffa3e02f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.936+0000 7ffa3e02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.936+0000 7ffa3e02f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.936+0000 7ffa3e02f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:17.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.936+0000 7ffa3e02f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:17.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 20 zone default found 2024-09-12T00:58:17.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 4 Realm: () 2024-09-12T00:58:17.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:58:17.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:58:17.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:17.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 20 zonegroup default 2024-09-12T00:58:17.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:17.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.937+0000 7ffa3e02f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:17.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.938+0000 7ffa3e02f800 20 started sync module instance, tier type = 2024-09-12T00:58:17.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.938+0000 7ffa3e02f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:58:17.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.946+0000 7ffa3e02f800 20 add_watcher() i=0 2024-09-12T00:58:17.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.946+0000 7ffa3e02f800 20 add_watcher() i=1 2024-09-12T00:58:17.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.946+0000 7ffa3e02f800 20 add_watcher() i=2 2024-09-12T00:58:17.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.946+0000 7ffa3e02f800 20 add_watcher() i=3 2024-09-12T00:58:17.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.946+0000 7ffa3e02f800 20 add_watcher() i=4 2024-09-12T00:58:17.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.946+0000 7ffa3e02f800 20 add_watcher() i=5 2024-09-12T00:58:17.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.946+0000 7ffa3e02f800 20 add_watcher() i=6 2024-09-12T00:58:17.945 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.947+0000 7ffa3e02f800 20 add_watcher() i=7 2024-09-12T00:58:17.946 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.947+0000 7ffa3e02f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.948+0000 7ff8effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.949+0000 7ffa3e02f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:17.947 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.949+0000 7ffa3e02f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:17.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.984+0000 7ff8eefe5640 20 reqs_thread_entry: start 2024-09-12T00:58:17.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.984+0000 7ffa3e02f800 20 init_complete bucket index max shards: 11 2024-09-12T00:58:17.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.984+0000 7ffa3e02f800 20 Filter name: none 2024-09-12T00:58:17.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.984+0000 7ff8ecfe1640 20 reqs_thread_entry: start 2024-09-12T00:58:17.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.984+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:58:17.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.986+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.986+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.987+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.988+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:58:17.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.989+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.989+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.990+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.991+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:58:17.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.992+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.992+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.993+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.993+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:58:17.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.995+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.996+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.996+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.997+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:58:17.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.998+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.997 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.999+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:17.999+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:17.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.000+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:58:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.001+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.000 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.002+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.002+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.003+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:58:18.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.005+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.005+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.005+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.006+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:58:18.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.008+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.008+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.009+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.010+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:58:18.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.011+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.012+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.012+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.013+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:58:18.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.014+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.015+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.015+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.016+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:58:18.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.017+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.018+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.018+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.019+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:58:18.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.020+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.020+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.021+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.022+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:58:18.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.023+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.024+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.024+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.025+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:58:18.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.027+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.027+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.028+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.029+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:58:18.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.030+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.030+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.031+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.031+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:58:18.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.033+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.033+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.033+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.034+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:58:18.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.036+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.036+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.036+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.037+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:58:18.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.038+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.039+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.039+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.040+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:58:18.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.041+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.042+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.042+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.043+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:58:18.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.044+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.045+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.045+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.046+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:58:18.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.047+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.048+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.048+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.049+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:58:18.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.050+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.050+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.051+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.052+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:58:18.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.053+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.054+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.054+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.055+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:58:18.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.056+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.057+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.057+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.057 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.058+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:58:18.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.060+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.060+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.061+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.062+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:58:18.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.063+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.063+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.063+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.065+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:58:18.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.066+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.066+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.067+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.068+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:58:18.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.069+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.070+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.070+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.071+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:58:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.073+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.074+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.074+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.075+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:58:18.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.077+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.078+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.078+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.079+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:58:18.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.080+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.081+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.081+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.082+0000 7ffa3e02f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:58:18.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.083+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.084+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.084+0000 7ffa3e02f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.086+0000 7ff8effe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.088+0000 7ffa3e02f800 20 remove_watcher() i=0 2024-09-12T00:58:18.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.088+0000 7ffa3e02f800 2 removed watcher, disabling cache 2024-09-12T00:58:18.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.089+0000 7ffa3e02f800 20 remove_watcher() i=1 2024-09-12T00:58:18.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.090+0000 7ffa3e02f800 20 remove_watcher() i=2 2024-09-12T00:58:18.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.091+0000 7ffa3e02f800 20 remove_watcher() i=3 2024-09-12T00:58:18.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.092+0000 7ffa3e02f800 20 remove_watcher() i=4 2024-09-12T00:58:18.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.093+0000 7ffa3e02f800 20 remove_watcher() i=5 2024-09-12T00:58:18.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.094+0000 7ffa3e02f800 20 remove_watcher() i=6 2024-09-12T00:58:18.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.095+0000 7ffa3e02f800 20 remove_watcher() i=7 2024-09-12T00:58:18.106 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T00:58:18.160 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:18.160 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:18.200 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.201+0000 7f3411d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.202+0000 7f3411d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.202+0000 7f3411d1f800 20 realm 2024-09-12T00:58:18.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.202+0000 7f3411d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.202+0000 7f3411d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.202+0000 7f3411d1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.202+0000 7f3411d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.203+0000 7f3411d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.202 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.203+0000 7f3411d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.203+0000 7f3411d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.203+0000 7f3411d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.204+0000 7f3411d1f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:18.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.204+0000 7f3411d1f800 20 searching for the correct realm 2024-09-12T00:58:18.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.206+0000 7f340daa2640 0 -- 172.21.15.19:0/3874621102 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f34000dd040 msgr2=0x7f34000a3f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:18.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.210+0000 7f340daa2640 0 -- 172.21.15.19:0/3874621102 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f34080024f0 msgr2=0x7f3408031450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.416+0000 7f3411d1f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:58:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.416+0000 7f3411d1f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:58:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.416+0000 7f3411d1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:18.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.416+0000 7f3411d1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.416+0000 7f3411d1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.416+0000 7f3411d1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.416+0000 7f3411d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.416+0000 7f3411d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.416+0000 7f3411d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.417+0000 7f3411d1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.417+0000 7f3411d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.417+0000 7f3411d1f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.417+0000 7f3411d1f800 20 zone default found 2024-09-12T00:58:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.417+0000 7f3411d1f800 4 Realm: () 2024-09-12T00:58:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.417+0000 7f3411d1f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:58:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.417+0000 7f3411d1f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:58:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.417+0000 7f3411d1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.417+0000 7f3411d1f800 20 zonegroup default 2024-09-12T00:58:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.417+0000 7f3411d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.418+0000 7f3411d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.418+0000 7f3411d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.418+0000 7f3411d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.418+0000 7f3411d1f800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.419+0000 7f3411d1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.419+0000 7f3411d1f800 20 started sync module instance, tier type = 2024-09-12T00:58:18.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.419+0000 7f3411d1f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:58:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.428+0000 7f3411d1f800 20 add_watcher() i=0 2024-09-12T00:58:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.428+0000 7f3411d1f800 20 add_watcher() i=1 2024-09-12T00:58:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.428+0000 7f3411d1f800 20 add_watcher() i=2 2024-09-12T00:58:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.428+0000 7f3411d1f800 20 add_watcher() i=3 2024-09-12T00:58:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.428+0000 7f3411d1f800 20 add_watcher() i=4 2024-09-12T00:58:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.428+0000 7f3411d1f800 20 add_watcher() i=5 2024-09-12T00:58:18.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.428+0000 7f3411d1f800 20 add_watcher() i=6 2024-09-12T00:58:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.429+0000 7f3411d1f800 20 add_watcher() i=7 2024-09-12T00:58:18.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.429+0000 7f3411d1f800 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:18.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.431+0000 7f32bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:18.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.431+0000 7f3411d1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:18.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.431+0000 7f3411d1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:18.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.468+0000 7f32be7fc640 20 reqs_thread_entry: start 2024-09-12T00:58:18.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.468+0000 7f3411d1f800 20 init_complete bucket index max shards: 11 2024-09-12T00:58:18.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.468+0000 7f3411d1f800 20 Filter name: none 2024-09-12T00:58:18.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.468+0000 7f322ffff640 20 reqs_thread_entry: start 2024-09-12T00:58:18.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.468+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:58:18.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.469+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.469 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.470+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.470+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.470 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.471+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:58:18.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.472+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.471 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.473+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.472 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.473+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.473 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.474+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:58:18.475 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.477+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.477+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.476 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.477+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.477 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.478+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:58:18.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.480+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.480+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.481+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.482+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:58:18.481 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.483+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.483+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.482 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.484+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.483 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.485+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.486+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.486+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.487+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.488+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:58:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.489+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.489+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.488 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.490+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.491+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:58:18.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.492+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.492+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.492+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.493+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:58:18.493 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.495+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.495+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.494 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.495+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.496+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:58:18.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.498+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.497 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.499+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.499+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.498 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.500+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:58:18.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.501+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.502+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.502+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.503+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:58:18.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.505+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.506+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.506+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.507+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:58:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.508+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.509+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.509+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.510+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:58:18.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.511+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.512+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.512+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.513+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:58:18.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.515+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.516+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.516+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.517+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:58:18.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.519+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.519+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.519+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.520+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:58:18.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.522+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.523+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.523+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.523 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.524+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:58:18.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.525+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.526+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.526+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.525 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.527+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:58:18.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.528+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.529+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.529+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.530+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:58:18.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.531+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.532+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.531 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.532+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.533+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:58:18.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.535+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.535+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.535+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.535 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.536+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:58:18.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.538+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.538+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.537 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.538+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.538 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.539+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:58:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.540+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.539 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.541+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.540 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.541+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.541 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.542+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:58:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.544+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.544+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.543 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.545+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.544 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.546+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:58:18.545 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.547+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.547+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.546 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.548+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.547 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.549+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:58:18.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.550+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.551+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.549 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.551+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.552+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:58:18.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.553+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.554+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.554+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.553 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.555+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:58:18.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.557+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.557+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.556 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.557+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.557 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.558+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:58:18.558 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.560+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.560+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.559 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.561+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.560 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.561+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:58:18.562 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.564+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.564+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.564+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.565+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:58:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.567+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.567+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.567+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.568+0000 7f3411d1f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:58:18.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.570+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.571+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.571+0000 7f3411d1f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.573+0000 7f32bf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:18.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.575+0000 7f3411d1f800 20 remove_watcher() i=0 2024-09-12T00:58:18.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.575+0000 7f3411d1f800 2 removed watcher, disabling cache 2024-09-12T00:58:18.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.576+0000 7f3411d1f800 20 remove_watcher() i=1 2024-09-12T00:58:18.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.577+0000 7f3411d1f800 20 remove_watcher() i=2 2024-09-12T00:58:18.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.578+0000 7f3411d1f800 20 remove_watcher() i=3 2024-09-12T00:58:18.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.579+0000 7f3411d1f800 20 remove_watcher() i=4 2024-09-12T00:58:18.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.580+0000 7f3411d1f800 20 remove_watcher() i=5 2024-09-12T00:58:18.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.581+0000 7f3411d1f800 20 remove_watcher() i=6 2024-09-12T00:58:18.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.583+0000 7f3411d1f800 20 remove_watcher() i=7 2024-09-12T00:58:18.593 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T00:58:18.646 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:18.646 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:18.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.688+0000 7f141fd40800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.689+0000 7f141fd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.689+0000 7f141fd40800 20 realm 2024-09-12T00:58:18.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.689+0000 7f141fd40800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.690+0000 7f141fd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.690+0000 7f141fd40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:18.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.690+0000 7f141fd40800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.690+0000 7f141fd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.690+0000 7f141fd40800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.690+0000 7f141fd40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.690+0000 7f141fd40800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.691+0000 7f141fd40800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:18.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.691+0000 7f141fd40800 20 searching for the correct realm 2024-09-12T00:58:18.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.693+0000 7f141b2ec640 0 -- 172.21.15.19:0/3179657196 >> [v2:172.21.15.135:6800/2991448734,v1:172.21.15.135:6801/2991448734] conn(0x55acc9727f00 msgr2=0x55acc972a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:18.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.696+0000 7f141baed640 0 -- 172.21.15.19:0/3179657196 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f14140a8d40 msgr2=0x7f14140b1040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:18.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.903+0000 7f141fd40800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:58:18.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.903+0000 7f141fd40800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:58:18.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.903+0000 7f141fd40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:18.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.903+0000 7f141fd40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.903+0000 7f141fd40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.903+0000 7f141fd40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.903+0000 7f141fd40800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.903+0000 7f141fd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.903+0000 7f141fd40800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:18.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 20 zone default found 2024-09-12T00:58:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 4 Realm: () 2024-09-12T00:58:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:58:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:58:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 20 zonegroup default 2024-09-12T00:58:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.904+0000 7f141fd40800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.905+0000 7f141fd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.905+0000 7f141fd40800 20 rados->read ofs=0 len=0 2024-09-12T00:58:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.905+0000 7f141fd40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.905+0000 7f141fd40800 20 started sync module instance, tier type = 2024-09-12T00:58:18.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.905+0000 7f141fd40800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:58:18.912 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.914+0000 7f141fd40800 20 add_watcher() i=0 2024-09-12T00:58:18.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.914+0000 7f141fd40800 20 add_watcher() i=1 2024-09-12T00:58:18.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.914+0000 7f141fd40800 20 add_watcher() i=2 2024-09-12T00:58:18.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.914+0000 7f141fd40800 20 add_watcher() i=3 2024-09-12T00:58:18.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.914+0000 7f141fd40800 20 add_watcher() i=4 2024-09-12T00:58:18.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.914+0000 7f141fd40800 20 add_watcher() i=5 2024-09-12T00:58:18.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.914+0000 7f141fd40800 20 add_watcher() i=6 2024-09-12T00:58:18.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.915+0000 7f141fd40800 20 add_watcher() i=7 2024-09-12T00:58:18.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.915+0000 7f141fd40800 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:18.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.917+0000 7f12d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:18.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.917+0000 7f141fd40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:18.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.917+0000 7f141fd40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:18.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.955+0000 7f12d0fe1640 20 reqs_thread_entry: start 2024-09-12T00:58:18.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.955+0000 7f141fd40800 20 init_complete bucket index max shards: 11 2024-09-12T00:58:18.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.955+0000 7f141fd40800 20 Filter name: none 2024-09-12T00:58:18.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.955+0000 7f124a7fc640 20 reqs_thread_entry: start 2024-09-12T00:58:18.954 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.955+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:58:18.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.956+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.957+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.957+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.957 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.959+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:58:18.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.960+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.961+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.959 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.961+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.960 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.962+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:58:18.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.963+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.964+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.962 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.964+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.963 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.965+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:58:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.966+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.967+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.967+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.968+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:58:18.968 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.970+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.970+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.971+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.973+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:58:18.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.974+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.975+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.973 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.975+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.974 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.976+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:58:18.975 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.977+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.977+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.978+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.977 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.979+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:58:18.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.981+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.981+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.980 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.981+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.982+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:58:18.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.984+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.984+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.985+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.986+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:58:18.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.987+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.987+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.988+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.989+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:58:18.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.990+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.990+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.991+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.992+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:58:18.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.993+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.993+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.994+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.993 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.995+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:58:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.996+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.997+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.995 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.997+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.998+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:58:18.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:18.999+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.000+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:18.998 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.000+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:18.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.001+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:58:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.002+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.003+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.003+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.004+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:58:19.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.005+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.005+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.006+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.007+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:58:19.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.008+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.009+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.009+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.010+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:58:19.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.011+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.012+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.012+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.013+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:58:19.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.014+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.015+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.015+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.016+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:58:19.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.018+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.018+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.018+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.019+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:58:19.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.021+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.021+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.022+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.023+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:58:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.024+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.025+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.025+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.026+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:58:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.027+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.028+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.028+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.029+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:58:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.030+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.031+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.031+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.032+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:58:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.033+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.034+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.034+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.035+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:58:19.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.036+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.037+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.037+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.038+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:58:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.040+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.041+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.041+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.042+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:58:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.043+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.043+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.044+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.045+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:58:19.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.046+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.046+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.047+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.048+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:58:19.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.049+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.049+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.048 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.050+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.050+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:58:19.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.052+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.052+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.052+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.053+0000 7f141fd40800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:58:19.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.055+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.055+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:19.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.055+0000 7f141fd40800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:19.056 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.057+0000 7f12d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:19.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.059+0000 7f141fd40800 20 remove_watcher() i=0 2024-09-12T00:58:19.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.059+0000 7f141fd40800 2 removed watcher, disabling cache 2024-09-12T00:58:19.059 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.060+0000 7f141fd40800 20 remove_watcher() i=1 2024-09-12T00:58:19.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.061+0000 7f141fd40800 20 remove_watcher() i=2 2024-09-12T00:58:19.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.062+0000 7f141fd40800 20 remove_watcher() i=3 2024-09-12T00:58:19.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.063+0000 7f141fd40800 20 remove_watcher() i=4 2024-09-12T00:58:19.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.064+0000 7f141fd40800 20 remove_watcher() i=5 2024-09-12T00:58:19.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.065+0000 7f141fd40800 20 remove_watcher() i=6 2024-09-12T00:58:19.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:19.066+0000 7f141fd40800 20 remove_watcher() i=7 2024-09-12T00:58:19.080 DEBUG:teuthology.orchestra.run.smithi019:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T00:58:19.577 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :clean 2024-09-12T00:58:20.474 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :compileJava 2024-09-12T00:58:20.474 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :processResources 2024-09-12T00:58:20.474 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :classes 2024-09-12T00:58:21.074 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:21.075 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :compileTestJava 2024-09-12T00:58:21.075 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:21.075 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:58:21.075 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :testClasses 2024-09-12T00:58:21.075 INFO:teuthology.orchestra.run.smithi019.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:58:21.075 INFO:teuthology.orchestra.run.smithi019.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:58:23.075 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:23.075 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :test 2024-09-12T00:58:23.075 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:23.075 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T00:58:23.075 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12 00:58:22,403 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:58:23.075 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:23.075 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T00:58:23.075 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:23.075 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T00:58:23.174 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:23.174 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T00:58:23.174 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:23.174 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T00:58:23.574 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:23.574 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T00:58:23.574 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:23.574 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T00:58:23.973 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:23.974 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T00:58:24.173 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:24.174 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T00:58:24.273 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:24.273 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T00:58:24.474 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:24.474 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T00:58:24.874 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:24.874 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T00:58:24.874 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:24.874 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T00:58:24.973 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:24.973 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T00:58:25.373 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:25.374 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T00:58:26.074 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:26.074 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T00:58:26.173 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:26.174 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T00:58:26.473 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:26.473 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T00:58:26.574 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:26.574 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T00:58:26.647 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:26.647 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------- 2024-09-12T00:58:26.648 INFO:teuthology.orchestra.run.smithi019.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T00:58:26.648 INFO:teuthology.orchestra.run.smithi019.stdout:-------------------------------------------------------------------- 2024-09-12T00:58:26.648 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:26.648 INFO:teuthology.orchestra.run.smithi019.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:58:26.648 INFO:teuthology.orchestra.run.smithi019.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:58:26.648 INFO:teuthology.orchestra.run.smithi019.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:58:26.648 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:26.648 INFO:teuthology.orchestra.run.smithi019.stdout:BUILD SUCCESSFUL in 7s 2024-09-12T00:58:26.648 INFO:teuthology.orchestra.run.smithi019.stdout:5 actionable tasks: 5 executed 2024-09-12T00:58:26.665 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T00:58:26.718 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:26.718 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:26.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.759+0000 7fc482214800 20 rados->read ofs=0 len=0 2024-09-12T00:58:26.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.760+0000 7fc482214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:26.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.760+0000 7fc482214800 20 realm 2024-09-12T00:58:26.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.760+0000 7fc482214800 20 rados->read ofs=0 len=0 2024-09-12T00:58:26.759 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.760+0000 7fc482214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:26.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.760+0000 7fc482214800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:26.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.760+0000 7fc482214800 20 rados->read ofs=0 len=0 2024-09-12T00:58:26.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.761+0000 7fc482214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:26.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.761+0000 7fc482214800 20 rados->read ofs=0 len=0 2024-09-12T00:58:26.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.761+0000 7fc482214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:26.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.761+0000 7fc482214800 20 rados->read ofs=0 len=0 2024-09-12T00:58:26.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.762+0000 7fc482214800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:26.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.762+0000 7fc482214800 20 searching for the correct realm 2024-09-12T00:58:26.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.765+0000 7fc47d0ca640 0 -- 172.21.15.19:0/163774389 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc47407a920 msgr2=0x7fc47406b400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:26.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.769+0000 7fc47d0ca640 0 -- 172.21.15.19:0/163774389 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55adedd115f0 msgr2=0x55adedd13a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:58:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:58:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 rados->read ofs=0 len=0 2024-09-12T00:58:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 rados->read ofs=0 len=0 2024-09-12T00:58:26.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:26.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 rados->read ofs=0 len=0 2024-09-12T00:58:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.774+0000 7fc482214800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 20 zone default found 2024-09-12T00:58:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 4 Realm: () 2024-09-12T00:58:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:58:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:58:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 20 zonegroup default 2024-09-12T00:58:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 20 rados->read ofs=0 len=0 2024-09-12T00:58:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 20 rados->read ofs=0 len=0 2024-09-12T00:58:26.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 20 rados->read ofs=0 len=0 2024-09-12T00:58:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 20 started sync module instance, tier type = 2024-09-12T00:58:26.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.775+0000 7fc482214800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:58:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.784+0000 7fc482214800 20 add_watcher() i=0 2024-09-12T00:58:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.784+0000 7fc482214800 20 add_watcher() i=1 2024-09-12T00:58:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.784+0000 7fc482214800 20 add_watcher() i=2 2024-09-12T00:58:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.784+0000 7fc482214800 20 add_watcher() i=3 2024-09-12T00:58:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.784+0000 7fc482214800 20 add_watcher() i=4 2024-09-12T00:58:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.784+0000 7fc482214800 20 add_watcher() i=5 2024-09-12T00:58:26.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.784+0000 7fc482214800 20 add_watcher() i=6 2024-09-12T00:58:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.785+0000 7fc482214800 20 add_watcher() i=7 2024-09-12T00:58:26.784 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.785+0000 7fc482214800 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.788+0000 7fc32ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.788+0000 7fc482214800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:26.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.788+0000 7fc482214800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:26.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.827+0000 7fc32effd640 20 reqs_thread_entry: start 2024-09-12T00:58:26.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.827+0000 7fc482214800 20 init_complete bucket index max shards: 11 2024-09-12T00:58:26.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.827+0000 7fc482214800 20 Filter name: none 2024-09-12T00:58:26.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.827+0000 7fc32cff9640 20 reqs_thread_entry: start 2024-09-12T00:58:26.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.827+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:58:26.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.828+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.829+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.829+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.830+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:58:26.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.832+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.833+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.833+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.834+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:58:26.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.836+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.836+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.836+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.838+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:58:26.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.839+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.839+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.840+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.841+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:58:26.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.842+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.842+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.843+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.844+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:58:26.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.845+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.845+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.846+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.847+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:58:26.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.848+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.849+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.849+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.850+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:58:26.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.852+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.852+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.852+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.855+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:58:26.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.856+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.857+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.857+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.858+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:58:26.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.859+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.860+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.860+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.861+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:58:26.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.862+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.863+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.863+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.864+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:58:26.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.865+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.866+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.866+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.867+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:58:26.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.868+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.869+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.869+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.871+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:58:26.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.872+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.872+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.873+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.874+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:58:26.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.875+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.875+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.876+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.876+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:58:26.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.878+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.878+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.879+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.880+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:58:26.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.881+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.881+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.882+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.883+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:58:26.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.884+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.885+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.885+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.886+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:58:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.887+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.887+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.888+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.889+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:58:26.888 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.890+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.890+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.891+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.892+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:58:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.893+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.894+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.894+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.895+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:58:26.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.896+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.896+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.897+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.897+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:58:26.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.899+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.899+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.899+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.900+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:58:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.902+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.903+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.901 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.903+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.904+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:58:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.905+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.906+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.906+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.907+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:58:26.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.908+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.908+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.909+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.910+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:58:26.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.911+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.912+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.912+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.913+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:58:26.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.914+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.915+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.913 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.915+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.914 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.916+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:58:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.917+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.918+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.916 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.918+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.919+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:58:26.919 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.921+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.921+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.921+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.922+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:58:26.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.924+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.924+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.924+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.925+0000 7fc482214800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:58:26.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.926+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.927+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:26.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.927+0000 7fc482214800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:26.928 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.929+0000 7fc32ffff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:26.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.931+0000 7fc482214800 20 remove_watcher() i=0 2024-09-12T00:58:26.930 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.931+0000 7fc482214800 2 removed watcher, disabling cache 2024-09-12T00:58:26.931 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.932+0000 7fc482214800 20 remove_watcher() i=1 2024-09-12T00:58:26.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.933+0000 7fc482214800 20 remove_watcher() i=2 2024-09-12T00:58:26.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.934+0000 7fc482214800 20 remove_watcher() i=3 2024-09-12T00:58:26.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.935+0000 7fc482214800 20 remove_watcher() i=4 2024-09-12T00:58:26.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.936+0000 7fc482214800 20 remove_watcher() i=5 2024-09-12T00:58:26.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.937+0000 7fc482214800 20 remove_watcher() i=6 2024-09-12T00:58:26.937 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:26.938+0000 7fc482214800 20 remove_watcher() i=7 2024-09-12T00:58:26.950 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T00:58:27.003 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:27.003 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:27.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.044+0000 7fe74772e800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.045+0000 7fe74772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.045+0000 7fe74772e800 20 realm 2024-09-12T00:58:27.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.045+0000 7fe74772e800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.046+0000 7fe74772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.046+0000 7fe74772e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:27.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.046+0000 7fe74772e800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.046+0000 7fe74772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.046+0000 7fe74772e800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.047+0000 7fe74772e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:27.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.047+0000 7fe74772e800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.047+0000 7fe74772e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:27.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.047+0000 7fe74772e800 20 searching for the correct realm 2024-09-12T00:58:27.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.050+0000 7fe742cdc640 0 -- 172.21.15.19:0/3183500488 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fe738027040 msgr2=0x7fe738049410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:27.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.255+0000 7fe743cde640 0 -- 172.21.15.19:0/3183500488 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x557298417ae0 msgr2=0x557298419f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.259+0000 7fe74772e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:58:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.259+0000 7fe74772e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:58:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.259+0000 7fe74772e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.259+0000 7fe74772e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:27.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.259+0000 7fe74772e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.259+0000 7fe74772e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.259+0000 7fe74772e800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.259+0000 7fe74772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.259+0000 7fe74772e800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 20 zone default found 2024-09-12T00:58:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 4 Realm: () 2024-09-12T00:58:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:58:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:58:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:27.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 20 zonegroup default 2024-09-12T00:58:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.260+0000 7fe74772e800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.261+0000 7fe74772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.261+0000 7fe74772e800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.261+0000 7fe74772e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.261+0000 7fe74772e800 20 started sync module instance, tier type = 2024-09-12T00:58:27.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.261+0000 7fe74772e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:58:27.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.270+0000 7fe74772e800 20 add_watcher() i=0 2024-09-12T00:58:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.270+0000 7fe74772e800 20 add_watcher() i=1 2024-09-12T00:58:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.270+0000 7fe74772e800 20 add_watcher() i=2 2024-09-12T00:58:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.270+0000 7fe74772e800 20 add_watcher() i=3 2024-09-12T00:58:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.270+0000 7fe74772e800 20 add_watcher() i=4 2024-09-12T00:58:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.270+0000 7fe74772e800 20 add_watcher() i=5 2024-09-12T00:58:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.270+0000 7fe74772e800 20 add_watcher() i=6 2024-09-12T00:58:27.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.271+0000 7fe74772e800 20 add_watcher() i=7 2024-09-12T00:58:27.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.271+0000 7fe74772e800 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:27.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.273+0000 7fe5f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:27.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.273+0000 7fe74772e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:27.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.273+0000 7fe74772e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:27.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.310+0000 7fe5f8fe1640 20 reqs_thread_entry: start 2024-09-12T00:58:27.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.310+0000 7fe74772e800 20 init_complete bucket index max shards: 11 2024-09-12T00:58:27.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.310+0000 7fe74772e800 20 Filter name: none 2024-09-12T00:58:27.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.310+0000 7fe5727fc640 20 reqs_thread_entry: start 2024-09-12T00:58:27.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.310+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:58:27.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.312+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.312+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.313+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.314+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:58:27.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.315+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.315+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.316+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.317+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:58:27.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.318+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.318+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.317 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.319+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.318 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.320+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:58:27.319 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.321+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.321+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.320 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.322+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.321 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.322+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:58:27.322 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.324+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.324+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.323 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.324+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.324 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.325+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:58:27.325 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.327+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.327+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.326 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.327+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.327 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.328+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:58:27.328 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.330+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.330+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.329 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.330+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.331 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.332+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:58:27.332 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.334+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.334+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.333 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.335+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.334 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.336+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:58:27.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.337+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.337+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.336 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.338+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.337 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.338+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:58:27.338 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.340+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.340+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.339 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.340+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.341+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:58:27.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.342+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.343+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.343+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.344+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:58:27.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.345+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.344 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.346+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.345 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.346+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.346 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.347+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:58:27.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.348+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.347 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.349+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.348 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.349+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.349 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.350+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:58:27.350 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.352+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.352+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.351 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.353+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.353+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:58:27.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.355+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.355+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.354 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.355+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.355 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.356+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:58:27.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.357+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.358+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.358+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.358 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.359+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:58:27.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.360+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.359 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.361+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.360 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.361+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.361 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.362+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:58:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.363+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.364+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.362 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.364+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.363 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.365+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:58:27.365 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.366+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.367+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.366 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.367+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.367 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.368+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:58:27.368 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.370+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.370+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.369 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.371+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.372+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:58:27.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.373+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.374+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.374+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.374 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.375+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:58:27.375 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.377+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.377+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.378+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.377 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.379+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:58:27.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.380+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.381+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.379 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.381+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.380 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.382+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:58:27.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.383+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.384+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.383 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.384+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.384 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.385+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:58:27.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.386+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.385 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.387+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.387+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.388+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:58:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.389+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.390+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.390+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.391+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:58:27.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.392+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.393+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.393+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.394+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:58:27.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.396+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.396+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.395 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.397+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.396 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.398+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:58:27.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.399+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.400+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.399 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.400+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.401+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:58:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.402+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.403+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.402 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.403+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.404+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:58:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.405+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.406+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.406+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.407+0000 7fe74772e800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:58:27.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.408+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.409+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.408 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.409+0000 7fe74772e800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.411+0000 7fe5f9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:27.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.413+0000 7fe74772e800 20 remove_watcher() i=0 2024-09-12T00:58:27.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.413+0000 7fe74772e800 2 removed watcher, disabling cache 2024-09-12T00:58:27.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.414+0000 7fe74772e800 20 remove_watcher() i=1 2024-09-12T00:58:27.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.415+0000 7fe74772e800 20 remove_watcher() i=2 2024-09-12T00:58:27.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.416+0000 7fe74772e800 20 remove_watcher() i=3 2024-09-12T00:58:27.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.417+0000 7fe74772e800 20 remove_watcher() i=4 2024-09-12T00:58:27.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.418+0000 7fe74772e800 20 remove_watcher() i=5 2024-09-12T00:58:27.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.419+0000 7fe74772e800 20 remove_watcher() i=6 2024-09-12T00:58:27.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.421+0000 7fe74772e800 20 remove_watcher() i=7 2024-09-12T00:58:27.432 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T00:58:27.485 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:27.485 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:27.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.526+0000 7fea9aa14800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.527+0000 7fea9aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.527+0000 7fea9aa14800 20 realm 2024-09-12T00:58:27.526 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.527+0000 7fea9aa14800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.527+0000 7fea9aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.527+0000 7fea9aa14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:27.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.527+0000 7fea9aa14800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.528+0000 7fea9aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.528+0000 7fea9aa14800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.527 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.528+0000 7fea9aa14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:27.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.528+0000 7fea9aa14800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.529+0000 7fea9aa14800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:27.528 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.529+0000 7fea9aa14800 20 searching for the correct realm 2024-09-12T00:58:27.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.532+0000 7fea8d8ca640 0 -- 172.21.15.19:0/921868222 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fea80015070 msgr2=0x7fea80009340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:27.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.737+0000 7fea968cc640 0 -- 172.21.15.19:0/921868222 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x560c89420630 msgr2=0x560c89422ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:27.740 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.742+0000 7fea9aa14800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:58:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.742+0000 7fea9aa14800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:58:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.742+0000 7fea9aa14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.742+0000 7fea9aa14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.742+0000 7fea9aa14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.742+0000 7fea9aa14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.742+0000 7fea9aa14800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.742+0000 7fea9aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.742+0000 7fea9aa14800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.742+0000 7fea9aa14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.742+0000 7fea9aa14800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 20 zone default found 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 4 Realm: () 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 20 zonegroup default 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 20 rados->read ofs=0 len=0 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:27.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 20 started sync module instance, tier type = 2024-09-12T00:58:27.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.743+0000 7fea9aa14800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:58:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.752+0000 7fea9aa14800 20 add_watcher() i=0 2024-09-12T00:58:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.752+0000 7fea9aa14800 20 add_watcher() i=1 2024-09-12T00:58:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.752+0000 7fea9aa14800 20 add_watcher() i=2 2024-09-12T00:58:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.752+0000 7fea9aa14800 20 add_watcher() i=3 2024-09-12T00:58:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.752+0000 7fea9aa14800 20 add_watcher() i=4 2024-09-12T00:58:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.752+0000 7fea9aa14800 20 add_watcher() i=5 2024-09-12T00:58:27.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.752+0000 7fea9aa14800 20 add_watcher() i=6 2024-09-12T00:58:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.753+0000 7fea9aa14800 20 add_watcher() i=7 2024-09-12T00:58:27.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.753+0000 7fea9aa14800 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:27.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.755+0000 7fe94cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:27.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.755+0000 7fea9aa14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:27.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.755+0000 7fea9aa14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.789+0000 7fe8c77fe640 20 reqs_thread_entry: start 2024-09-12T00:58:27.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.789+0000 7fea9aa14800 20 init_complete bucket index max shards: 11 2024-09-12T00:58:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.789+0000 7fea9aa14800 20 Filter name: none 2024-09-12T00:58:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.790+0000 7fe8c57fa640 20 reqs_thread_entry: start 2024-09-12T00:58:27.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.790+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:58:27.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.791+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.792+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.792+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.793+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:58:27.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.794+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.795+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.793 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.795+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.796+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:58:27.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.797+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.798+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.798+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.799+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:58:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.800+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.801+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.801+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.801 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.802+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:58:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.803+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.804+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.804+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.806+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:58:27.805 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.807+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.807+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.808+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.807 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.809+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:58:27.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.810+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.811+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.810 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.811+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.811 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.813+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:58:27.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.814+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.814+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.813 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.815+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.816+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:58:27.815 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.817+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.817+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.816 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.818+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.819+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:58:27.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.820+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.820+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.821+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.821 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.822+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:58:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.823+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.824+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.822 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.824+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.825+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:58:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.826+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.827+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.827+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.826 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.828+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:58:27.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.829+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.829+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.828 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.830+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.831+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:58:27.830 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.832+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.832+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.832+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.833+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:58:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.834+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.833 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.835+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.835+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.835 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.837+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:58:27.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.838+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.839+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.839+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.840+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:58:27.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.841+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.842+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.842+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.841 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.843+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:58:27.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.844+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.845+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.845+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.846+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:58:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.848+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.848+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.848+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.848 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.849+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:58:27.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.850+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.851+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.849 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.851+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.852+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:58:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.853+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.854+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.854+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.855+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:58:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.857+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.857+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.856 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.857+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.858+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:58:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.860+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.860+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.860+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.861+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:58:27.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.863+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.863+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.864+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.865+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:58:27.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.866+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.867+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.867+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.869+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:58:27.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.870+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.870+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.871+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.872+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:58:27.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.873+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.873+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.874+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.875+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:58:27.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.876+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.877+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.877+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.878+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:58:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.879+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.879+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.880+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.879 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.881+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:58:27.880 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.882+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.882+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.883+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.882 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.884+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:58:27.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.885+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.885+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.884 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.886+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.887+0000 7fea9aa14800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:58:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.888+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.888+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.889+0000 7fea9aa14800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:27.889 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.890+0000 7fe94cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.892+0000 7fea9aa14800 20 remove_watcher() i=0 2024-09-12T00:58:27.891 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.892+0000 7fea9aa14800 2 removed watcher, disabling cache 2024-09-12T00:58:27.892 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.893+0000 7fea9aa14800 20 remove_watcher() i=1 2024-09-12T00:58:27.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.894+0000 7fea9aa14800 20 remove_watcher() i=2 2024-09-12T00:58:27.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.895+0000 7fea9aa14800 20 remove_watcher() i=3 2024-09-12T00:58:27.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.896+0000 7fea9aa14800 20 remove_watcher() i=4 2024-09-12T00:58:27.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.897+0000 7fea9aa14800 20 remove_watcher() i=5 2024-09-12T00:58:27.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.898+0000 7fea9aa14800 20 remove_watcher() i=6 2024-09-12T00:58:27.898 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:27.899+0000 7fea9aa14800 20 remove_watcher() i=7 2024-09-12T00:58:27.909 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T00:58:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:58:27.963 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:58:28.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.004+0000 7f381f535800 20 rados->read ofs=0 len=0 2024-09-12T00:58:28.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.006+0000 7f381f535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:28.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.006+0000 7f381f535800 20 realm 2024-09-12T00:58:28.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.006+0000 7f381f535800 20 rados->read ofs=0 len=0 2024-09-12T00:58:28.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.006+0000 7f381f535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.006+0000 7f381f535800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:58:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.006+0000 7f381f535800 20 rados->read ofs=0 len=0 2024-09-12T00:58:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.006+0000 7f381f535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.006+0000 7f381f535800 20 rados->read ofs=0 len=0 2024-09-12T00:58:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.007+0000 7f381f535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:28.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.007+0000 7f381f535800 20 rados->read ofs=0 len=0 2024-09-12T00:58:28.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.007+0000 7f381f535800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:58:28.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.007+0000 7f381f535800 20 searching for the correct realm 2024-09-12T00:58:28.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.012+0000 7f381bae5640 0 -- 172.21.15.19:0/2398402579 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7f3810009040 msgr2=0x7f381008c560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:58:28.013 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.015+0000 7f381b2e4640 0 -- 172.21.15.19:0/2398402579 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f381409c040 msgr2=0x7f3814062d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:58:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T00:58:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T00:58:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:58:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:58:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:58:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:58:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 rados->read ofs=0 len=0 2024-09-12T00:58:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 rados->read ofs=0 len=0 2024-09-12T00:58:28.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:58:28.019 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 rados->read ofs=0 len=0 2024-09-12T00:58:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:58:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 zone default found 2024-09-12T00:58:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 4 Realm: () 2024-09-12T00:58:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T00:58:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T00:58:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:58:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 zonegroup default 2024-09-12T00:58:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.019+0000 7f381f535800 20 rados->read ofs=0 len=0 2024-09-12T00:58:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.020+0000 7f381f535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:28.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.020+0000 7f381f535800 20 rados->read ofs=0 len=0 2024-09-12T00:58:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.020+0000 7f381f535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.020+0000 7f381f535800 20 rados->read ofs=0 len=0 2024-09-12T00:58:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.020+0000 7f381f535800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:58:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.020+0000 7f381f535800 20 started sync module instance, tier type = 2024-09-12T00:58:28.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.020+0000 7f381f535800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T00:58:28.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.029+0000 7f381f535800 20 add_watcher() i=0 2024-09-12T00:58:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.029+0000 7f381f535800 20 add_watcher() i=1 2024-09-12T00:58:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.029+0000 7f381f535800 20 add_watcher() i=2 2024-09-12T00:58:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.029+0000 7f381f535800 20 add_watcher() i=3 2024-09-12T00:58:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.029+0000 7f381f535800 20 add_watcher() i=4 2024-09-12T00:58:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.029+0000 7f381f535800 20 add_watcher() i=5 2024-09-12T00:58:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.029+0000 7f381f535800 20 add_watcher() i=6 2024-09-12T00:58:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.030+0000 7f381f535800 20 add_watcher() i=7 2024-09-12T00:58:28.028 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.030+0000 7f381f535800 2 all 8 watchers are set, enabling cache 2024-09-12T00:58:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.031+0000 7f36d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.032+0000 7f381f535800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:58:28.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.032+0000 7f381f535800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:58:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.067+0000 7f36d0fe1640 20 reqs_thread_entry: start 2024-09-12T00:58:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.067+0000 7f381f535800 20 init_complete bucket index max shards: 11 2024-09-12T00:58:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.067+0000 7f381f535800 20 Filter name: none 2024-09-12T00:58:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.067+0000 7f364a7fc640 20 reqs_thread_entry: start 2024-09-12T00:58:28.066 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.067+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:58:28.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.069+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.069+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.068 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.070+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.071+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:58:28.071 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.072+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.073+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.073+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.074+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:58:28.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.076+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.076+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.076+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.076 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.078+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:58:28.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.079+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.078 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.080+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.080+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.081+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:58:28.081 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.083+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.083+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.082 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.084+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.083 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.085+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:58:28.085 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.086+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.087+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.087+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.087 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.088+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:58:28.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.090+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.090+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.090+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.092+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:58:28.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.093+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.093+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.094+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.095+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:58:28.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.096+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.096+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.095 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.097+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.098+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:58:28.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.099+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.100+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.100+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.100 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.101+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:58:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.103+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.103+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.103+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.103 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.104+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:58:28.104 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.106+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.106+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.105 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.107+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.106 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.108+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:58:28.107 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.109+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.109+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.110+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.111+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:58:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.112+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.113+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.113+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.114+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:58:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.115+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.114 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.116+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.115 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.116+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.117+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:58:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.118+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.119+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.119+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.120+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:58:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.121+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.120 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.122+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.122+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.123+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:58:28.123 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.124+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.125+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.125+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.126+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:58:28.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.128+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.129+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.129+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.130+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:58:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.131+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.132+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.132+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.133+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:58:28.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.135+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.135+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.135+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.136+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:58:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.138+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.138+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.138+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.139+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:58:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.140+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.141+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.141+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.142+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:58:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.143+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.143+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.144+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.145+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:58:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.146+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.147+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.147+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.148+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:58:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.149+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.150+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.150+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.151+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:58:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.152+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.153+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.153+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.154+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:58:28.154 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.156+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.156+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.156+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.157+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:58:28.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.159+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.159+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.158 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.159+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.160+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:58:28.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.162+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.162+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.162+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.163+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:58:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.165+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.165+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.166+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.165 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.167+0000 7f381f535800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:58:28.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.168+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.168+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:58:28.167 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.168+0000 7f381f535800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:58:28.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.170+0000 7f36d1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:58:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.172+0000 7f381f535800 20 remove_watcher() i=0 2024-09-12T00:58:28.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.172+0000 7f381f535800 2 removed watcher, disabling cache 2024-09-12T00:58:28.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.173+0000 7f381f535800 20 remove_watcher() i=1 2024-09-12T00:58:28.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.174+0000 7f381f535800 20 remove_watcher() i=2 2024-09-12T00:58:28.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.175+0000 7f381f535800 20 remove_watcher() i=3 2024-09-12T00:58:28.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.176+0000 7f381f535800 20 remove_watcher() i=4 2024-09-12T00:58:28.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.177+0000 7f381f535800 20 remove_watcher() i=5 2024-09-12T00:58:28.177 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.178+0000 7f381f535800 20 remove_watcher() i=6 2024-09-12T00:58:28.178 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T00:58:28.180+0000 7f381f535800 20 remove_watcher() i=7 2024-09-12T00:58:28.190 DEBUG:teuthology.orchestra.run.smithi019:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T00:58:28.686 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :clean 2024-09-12T00:58:29.482 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :compileJava 2024-09-12T00:58:29.483 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :processResources 2024-09-12T00:58:29.483 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :classes 2024-09-12T00:58:29.983 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:29.983 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :compileTestJava 2024-09-12T00:58:29.983 INFO:teuthology.orchestra.run.smithi019.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:58:29.984 INFO:teuthology.orchestra.run.smithi019.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:58:29.984 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:29.984 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:58:29.984 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :testClasses 2024-09-12T00:58:31.983 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:31.983 INFO:teuthology.orchestra.run.smithi019.stdout:> Task :test 2024-09-12T00:58:31.984 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:31.984 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:58:31.984 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12 00:58:31,366 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:58:31.984 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:31.984 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T00:58:31.984 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:31.984 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T00:58:32.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:32.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T00:58:32.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:32.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T00:58:32.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:32.982 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T00:58:33.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:33.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T00:58:33.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:33.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T00:58:38.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:38.682 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T00:58:39.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:39.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T00:58:39.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:39.182 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T00:58:39.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:39.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T00:58:39.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:39.782 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T00:58:40.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:40.083 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T00:58:40.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:40.183 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T00:58:40.282 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:40.283 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T00:58:40.283 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:40.283 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T00:58:40.683 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:40.683 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T00:58:46.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:46.182 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T00:58:46.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:46.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T00:58:46.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:46.682 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T00:58:47.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:47.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T00:58:47.282 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:47.283 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T00:58:47.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:47.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T00:58:47.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:47.683 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T00:58:48.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:48.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T00:58:48.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:48.182 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T00:58:48.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:48.583 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T00:58:48.583 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:48.583 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T00:58:48.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:48.982 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T00:58:49.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:49.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T00:58:49.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:49.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T00:58:49.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:49.682 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T00:58:49.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:58:49.982 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T00:59:04.583 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:04.583 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T00:59:05.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:05.182 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T00:59:33.283 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:33.283 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T00:59:33.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:33.882 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T00:59:33.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:33.982 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T00:59:34.382 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:34.382 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T00:59:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:34.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T00:59:35.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:35.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T00:59:40.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:40.483 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T00:59:40.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:40.882 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T00:59:40.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:40.982 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T00:59:41.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:41.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T00:59:49.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:49.083 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T00:59:50.783 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:50.783 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:59:50.784 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12 00:59:50,751 [s3-transfer-manager-worker-9] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:59:50.784 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12 00:59:50,754 [s3-transfer-manager-worker-10] WARN com.amazonaws.services.s3.internal.S3AbortableInputStream - Not all bytes were read from the S3ObjectInputStream, aborting HTTP connection. This is likely an error and may result in sub-optimal behavior. Request only the bytes you need via a ranged GET or drain the input stream after use. 2024-09-12T00:59:51.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T00:59:51.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T01:00:05.583 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:00:05.583 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T01:00:06.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:00:06.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T01:00:10.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:00:10.883 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T01:00:11.285 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:00:11.285 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T01:00:59.983 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:00:59.984 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T01:01:00.382 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:00.382 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T01:01:08.983 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:08.983 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T01:01:09.282 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:09.282 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T01:01:14.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:14.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T01:01:14.883 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:14.883 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T01:01:16.783 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:16.783 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T01:01:24.282 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:24.282 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T01:01:24.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:24.483 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T01:01:24.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:24.683 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T01:01:24.683 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:24.683 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T01:01:25.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:25.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T01:01:25.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:25.183 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T01:01:25.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:25.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T01:01:25.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:25.682 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T01:01:25.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:25.982 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T01:01:26.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:26.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T01:01:26.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:26.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T01:01:26.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:26.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T01:01:26.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:26.882 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T01:01:26.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:26.982 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T01:01:27.382 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:27.382 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T01:01:27.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:27.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T01:01:28.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:28.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T01:01:28.282 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:28.282 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T01:01:28.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:28.782 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T01:01:28.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:28.982 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T01:01:29.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:29.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T01:01:29.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:29.682 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:30.182 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T01:01:30.382 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:30.382 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T01:01:30.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:30.882 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T01:01:31.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:31.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T01:01:31.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:31.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T01:01:31.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:31.782 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T01:01:32.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:32.182 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T01:01:32.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:32.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T01:01:32.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:32.882 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T01:01:33.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:33.083 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T01:01:33.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:33.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T01:01:33.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:33.782 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T01:01:34.282 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:34.282 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T01:01:34.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:34.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T01:01:34.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:34.982 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T01:01:35.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:35.182 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T01:01:35.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:35.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T01:01:35.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:35.782 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T01:01:36.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:36.182 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T01:01:36.382 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:36.382 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T01:01:36.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:36.882 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T01:01:37.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:37.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T01:01:37.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:37.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T01:01:37.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:37.782 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T01:01:38.282 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:38.282 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T01:01:38.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:38.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T01:01:38.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:38.982 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T01:01:39.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:39.182 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T01:01:39.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:39.682 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T01:01:39.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:39.882 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T01:01:40.282 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:40.282 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T01:01:40.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:40.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T01:01:40.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:40.882 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T01:01:41.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:41.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T01:01:41.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:41.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T01:01:41.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:41.782 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T01:01:42.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:42.182 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T01:01:42.282 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:42.282 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T01:01:42.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:42.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T01:01:42.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:42.682 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T01:01:43.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:43.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T01:01:43.182 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:43.182 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T01:01:43.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:43.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T01:01:43.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:43.682 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T01:01:44.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:44.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T01:01:44.382 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:44.382 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T01:01:44.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:44.682 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T01:01:44.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:44.782 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T01:01:44.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:44.882 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T01:01:44.982 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:44.982 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T01:01:45.382 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:45.382 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T01:01:45.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:45.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T01:01:45.885 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:45.885 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T01:01:46.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:46.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T01:01:46.482 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:46.482 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T01:01:46.582 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:46.582 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T01:01:46.882 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:46.882 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T01:01:52.682 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:52.683 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T01:01:53.082 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:53.082 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T01:01:58.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:58.783 INFO:teuthology.orchestra.run.smithi019.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T01:01:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:59.177 INFO:teuthology.orchestra.run.smithi019.stdout:---------------------------------------------------------------------- 2024-09-12T01:01:59.177 INFO:teuthology.orchestra.run.smithi019.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T01:01:59.177 INFO:teuthology.orchestra.run.smithi019.stdout:---------------------------------------------------------------------- 2024-09-12T01:01:59.177 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:59.177 INFO:teuthology.orchestra.run.smithi019.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T01:01:59.177 INFO:teuthology.orchestra.run.smithi019.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T01:01:59.178 INFO:teuthology.orchestra.run.smithi019.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T01:01:59.178 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:01:59.178 INFO:teuthology.orchestra.run.smithi019.stdout:BUILD SUCCESSFUL in 3m 30s 2024-09-12T01:01:59.178 INFO:teuthology.orchestra.run.smithi019.stdout:5 actionable tasks: 5 executed 2024-09-12T01:01:59.192 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T01:01:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:01:59.246 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:01:59.286 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.287+0000 7fc358e0f800 20 rados->read ofs=0 len=0 2024-09-12T01:01:59.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.289+0000 7fc358e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:59.287 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.289+0000 7fc358e0f800 20 realm 2024-09-12T01:01:59.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.289+0000 7fc358e0f800 20 rados->read ofs=0 len=0 2024-09-12T01:01:59.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.289+0000 7fc358e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:59.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.289+0000 7fc358e0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:01:59.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.289+0000 7fc358e0f800 20 rados->read ofs=0 len=0 2024-09-12T01:01:59.288 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.289+0000 7fc358e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:59.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.289+0000 7fc358e0f800 20 rados->read ofs=0 len=0 2024-09-12T01:01:59.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.290+0000 7fc358e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:59.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.290+0000 7fc358e0f800 20 rados->read ofs=0 len=0 2024-09-12T01:01:59.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.290+0000 7fc358e0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:01:59.289 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.291+0000 7fc358e0f800 20 searching for the correct realm 2024-09-12T01:01:59.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.496+0000 7fc3560f8640 0 -- 172.21.15.19:0/2448172718 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc34c0443f0 msgr2=0x7fc34c082a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:59.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.903+0000 7fc3570fa640 0 -- 172.21.15.19:0/2448172718 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55eb8a0fcb60 msgr2=0x55eb8a0fefd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:01:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.908+0000 7fc358e0f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:01:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.908+0000 7fc358e0f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:01:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.908+0000 7fc358e0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:01:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.908+0000 7fc358e0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:01:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.908+0000 7fc358e0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:01:59.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.908+0000 7fc358e0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:01:59.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.908+0000 7fc358e0f800 20 rados->read ofs=0 len=0 2024-09-12T01:01:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.909+0000 7fc358e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.909+0000 7fc358e0f800 20 rados->read ofs=0 len=0 2024-09-12T01:01:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.909+0000 7fc358e0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:01:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.909+0000 7fc358e0f800 20 rados->read ofs=0 len=0 2024-09-12T01:01:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:01:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 20 zone default found 2024-09-12T01:01:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 4 Realm: () 2024-09-12T01:01:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:01:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:01:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:01:59.909 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 20 zonegroup default 2024-09-12T01:01:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 20 rados->read ofs=0 len=0 2024-09-12T01:01:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 20 rados->read ofs=0 len=0 2024-09-12T01:01:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.910+0000 7fc358e0f800 20 rados->read ofs=0 len=0 2024-09-12T01:01:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.911+0000 7fc358e0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:01:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.911+0000 7fc358e0f800 20 started sync module instance, tier type = 2024-09-12T01:01:59.910 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.911+0000 7fc358e0f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:01:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.921+0000 7fc358e0f800 20 add_watcher() i=0 2024-09-12T01:01:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.921+0000 7fc358e0f800 20 add_watcher() i=1 2024-09-12T01:01:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.921+0000 7fc358e0f800 20 add_watcher() i=2 2024-09-12T01:01:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.921+0000 7fc358e0f800 20 add_watcher() i=3 2024-09-12T01:01:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.921+0000 7fc358e0f800 20 add_watcher() i=4 2024-09-12T01:01:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.921+0000 7fc358e0f800 20 add_watcher() i=5 2024-09-12T01:01:59.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.921+0000 7fc358e0f800 20 add_watcher() i=6 2024-09-12T01:01:59.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.922+0000 7fc358e0f800 20 add_watcher() i=7 2024-09-12T01:01:59.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.922+0000 7fc358e0f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:01:59.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.924+0000 7fc20d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:01:59.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.924+0000 7fc358e0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:01:59.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.924+0000 7fc358e0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:01:59.965 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.966+0000 7fc187fff640 20 reqs_thread_entry: start 2024-09-12T01:01:59.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.966+0000 7fc358e0f800 20 init_complete bucket index max shards: 11 2024-09-12T01:01:59.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.966+0000 7fc358e0f800 20 Filter name: none 2024-09-12T01:01:59.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.967+0000 7fc185ffb640 20 reqs_thread_entry: start 2024-09-12T01:01:59.966 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.967+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:01:59.967 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.968+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.969+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.969+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.969+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.133347135804300905', time=2024-09-12T02:59:33.624523+0000, chain.objs.size()=7 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.969+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~O85amAUUHCAOAEbdW5eUyFgfGjPe-g9.1 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.969+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~O85amAUUHCAOAEbdW5eUyFgfGjPe-g9.1_1 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.969+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~O85amAUUHCAOAEbdW5eUyFgfGjPe-g9.1_2 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.969+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~O85amAUUHCAOAEbdW5eUyFgfGjPe-g9.2 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.969+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~O85amAUUHCAOAEbdW5eUyFgfGjPe-g9.2_1 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.969+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~O85amAUUHCAOAEbdW5eUyFgfGjPe-g9.2_2 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.970+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~O85amAUUHCAOAEbdW5eUyFgfGjPe-g9.3 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.970+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6445357912957359475', time=2024-09-12T03:01:52.761997+0000, chain.objs.size()=9 2024-09-12T01:01:59.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.970+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.143__multipart_key1.2~S5M5Twp6D9O71KJMcfpaDrVfK7C0AOr.1 2024-09-12T01:01:59.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.970+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.143__shadow_key1.2~S5M5Twp6D9O71KJMcfpaDrVfK7C0AOr.1_1 2024-09-12T01:01:59.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.970+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.143__multipart_key1.2~S5M5Twp6D9O71KJMcfpaDrVfK7C0AOr.2 2024-09-12T01:01:59.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.971+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.143__shadow_key1.2~S5M5Twp6D9O71KJMcfpaDrVfK7C0AOr.2_1 2024-09-12T01:01:59.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.971+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.143__multipart_key1.2~S5M5Twp6D9O71KJMcfpaDrVfK7C0AOr.3 2024-09-12T01:01:59.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.977+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.143__shadow_key1.2~S5M5Twp6D9O71KJMcfpaDrVfK7C0AOr.3_1 2024-09-12T01:01:59.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.977+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.143__multipart_key1.2~S5M5Twp6D9O71KJMcfpaDrVfK7C0AOr.4 2024-09-12T01:01:59.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.977+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.143__shadow_key1.2~S5M5Twp6D9O71KJMcfpaDrVfK7C0AOr.4_1 2024-09-12T01:01:59.976 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.977+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.143__multipart_key1.2~S5M5Twp6D9O71KJMcfpaDrVfK7C0AOr.5 2024-09-12T01:01:59.979 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.980+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:59.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.983+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:01:59.983 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.984+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.985+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:59.984 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.985+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.987+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:01:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.988+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.988+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.989+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:59.989 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.990+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:01:59.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.991+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:01:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.991+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:01:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.992+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:01:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.992+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8158552835173622569', time=2024-09-12T02:59:04.924594+0000, chain.objs.size()=9 2024-09-12T01:01:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.992+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__multipart_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.1 2024-09-12T01:01:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.992+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__shadow_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.1_1 2024-09-12T01:01:59.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.992+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__multipart_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.2 2024-09-12T01:01:59.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.992+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__shadow_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.2_1 2024-09-12T01:01:59.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.992+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__multipart_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.3 2024-09-12T01:01:59.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.992+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__shadow_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.3_1 2024-09-12T01:01:59.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.992+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__multipart_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.4 2024-09-12T01:01:59.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.992+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__shadow_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.4_1 2024-09-12T01:01:59.992 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.992+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__multipart_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.5 2024-09-12T01:01:59.996 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:01:59.998+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:01:59.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.000+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:02:00.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.002+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.002+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.003+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.003+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~wNj9bxqVfnWKLRoGgK2aoSfICRvtuEy', time=2024-09-12T02:58:38.652295+0000, chain.objs.size()=9 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.003+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.79__multipart_key1.2~wNj9bxqVfnWKLRoGgK2aoSfICRvtuEy.1 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.003+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.79__shadow_key1.2~wNj9bxqVfnWKLRoGgK2aoSfICRvtuEy.1_1 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.003+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.79__multipart_key1.2~wNj9bxqVfnWKLRoGgK2aoSfICRvtuEy.2 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.003+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.79__shadow_key1.2~wNj9bxqVfnWKLRoGgK2aoSfICRvtuEy.2_1 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.003+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.79__multipart_key1.2~wNj9bxqVfnWKLRoGgK2aoSfICRvtuEy.3 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.003+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.79__shadow_key1.2~wNj9bxqVfnWKLRoGgK2aoSfICRvtuEy.3_1 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.003+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.79__multipart_key1.2~wNj9bxqVfnWKLRoGgK2aoSfICRvtuEy.4 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.003+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.79__shadow_key1.2~wNj9bxqVfnWKLRoGgK2aoSfICRvtuEy.4_1 2024-09-12T01:02:00.002 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.003+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.79__multipart_key1.2~wNj9bxqVfnWKLRoGgK2aoSfICRvtuEy.5 2024-09-12T01:02:00.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.007+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.010+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:02:00.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.011+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.012+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.012+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.012 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.013+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:02:00.014 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.015+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.016 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15067527785463612286', time=2024-09-12T02:59:22.969931+0000, chain.objs.size()=9 2024-09-12T01:02:00.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~veAUMBR5CsY3JI_Aok-82WINZMXo-be.1 2024-09-12T01:02:00.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~veAUMBR5CsY3JI_Aok-82WINZMXo-be.1_1 2024-09-12T01:02:00.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~veAUMBR5CsY3JI_Aok-82WINZMXo-be.2 2024-09-12T01:02:00.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~veAUMBR5CsY3JI_Aok-82WINZMXo-be.2_1 2024-09-12T01:02:00.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~veAUMBR5CsY3JI_Aok-82WINZMXo-be.3 2024-09-12T01:02:00.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~veAUMBR5CsY3JI_Aok-82WINZMXo-be.3_1 2024-09-12T01:02:00.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~veAUMBR5CsY3JI_Aok-82WINZMXo-be.4 2024-09-12T01:02:00.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~veAUMBR5CsY3JI_Aok-82WINZMXo-be.4_1 2024-09-12T01:02:00.018 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.016+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~veAUMBR5CsY3JI_Aok-82WINZMXo-be.5 2024-09-12T01:02:00.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.021+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.023 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.024+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:02:00.024 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.025+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.026+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.026+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.025 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.026+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8002937620773167025', time=2024-09-12T02:58:46.275907+0000, chain.objs.size()=2 2024-09-12T01:02:00.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.026+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.83__shadow_.dOwnteeLA0F5SkoAjWqXJgn7Bcj_CCs_1 2024-09-12T01:02:00.026 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.026+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.83__shadow_.dOwnteeLA0F5SkoAjWqXJgn7Bcj_CCs_2 2024-09-12T01:02:00.027 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.029+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.031+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:02:00.031 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.032+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.033+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.032 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.033+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.034+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:02:00.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.036+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.036+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.037+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.037+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11613757503528696267', time=2024-09-12T03:00:27.004748+0000, chain.objs.size()=9 2024-09-12T01:02:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.037+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~Z8HhmQW0UO9CC7ddDRnCZrksL480q5q.1 2024-09-12T01:02:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.037+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~Z8HhmQW0UO9CC7ddDRnCZrksL480q5q.1_1 2024-09-12T01:02:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.037+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~Z8HhmQW0UO9CC7ddDRnCZrksL480q5q.2 2024-09-12T01:02:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.037+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~Z8HhmQW0UO9CC7ddDRnCZrksL480q5q.2_1 2024-09-12T01:02:00.038 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.037+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~Z8HhmQW0UO9CC7ddDRnCZrksL480q5q.3 2024-09-12T01:02:00.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.037+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~Z8HhmQW0UO9CC7ddDRnCZrksL480q5q.3_1 2024-09-12T01:02:00.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.037+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~Z8HhmQW0UO9CC7ddDRnCZrksL480q5q.4 2024-09-12T01:02:00.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.037+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~Z8HhmQW0UO9CC7ddDRnCZrksL480q5q.4_1 2024-09-12T01:02:00.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.037+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~Z8HhmQW0UO9CC7ddDRnCZrksL480q5q.5 2024-09-12T01:02:00.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.042+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.045+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:02:00.045 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.047+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.047+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.046 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.047+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.047 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.048+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:02:00.049 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.050 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11482343592729813117', time=2024-09-12T02:59:04.627614+0000, chain.objs.size()=9 2024-09-12T01:02:00.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__multipart_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.1 2024-09-12T01:02:00.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__shadow_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.1_1 2024-09-12T01:02:00.051 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__multipart_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.2 2024-09-12T01:02:00.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__shadow_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.2_1 2024-09-12T01:02:00.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__multipart_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.3 2024-09-12T01:02:00.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__shadow_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.3_1 2024-09-12T01:02:00.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__multipart_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.4 2024-09-12T01:02:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__shadow_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.4_1 2024-09-12T01:02:00.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.050+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.91__multipart_key1.2~r6GOOU_CTstO2elld0pBT5lKJBWG5qK.5 2024-09-12T01:02:00.055 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.056+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.058 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.059+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:02:00.060 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.061+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.062+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.062+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.062+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.2699702421030945585', time=2024-09-12T02:59:33.144696+0000, chain.objs.size()=7 2024-09-12T01:02:00.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.062+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~8akKEyKSy5TGIzUW2KF3t8FClTr0iSz.1 2024-09-12T01:02:00.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.062+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~8akKEyKSy5TGIzUW2KF3t8FClTr0iSz.1_1 2024-09-12T01:02:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.062+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~8akKEyKSy5TGIzUW2KF3t8FClTr0iSz.1_2 2024-09-12T01:02:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.062+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~8akKEyKSy5TGIzUW2KF3t8FClTr0iSz.2 2024-09-12T01:02:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.062+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~8akKEyKSy5TGIzUW2KF3t8FClTr0iSz.2_1 2024-09-12T01:02:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.062+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~8akKEyKSy5TGIzUW2KF3t8FClTr0iSz.2_2 2024-09-12T01:02:00.062 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.062+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~8akKEyKSy5TGIzUW2KF3t8FClTr0iSz.3 2024-09-12T01:02:00.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.066+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.069+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:02:00.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.070+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.071+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.069 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.071+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.072+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:02:00.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.073+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.072 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:02:00.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10268119243295925970', time=2024-09-12T02:59:40.603622+0000, chain.objs.size()=9 2024-09-12T01:02:00.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.98__multipart_key1.2~83ypBM5n_Mh080PUNd-dxt3rYtBIPix.1 2024-09-12T01:02:00.073 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.98__shadow_key1.2~83ypBM5n_Mh080PUNd-dxt3rYtBIPix.1_1 2024-09-12T01:02:00.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.98__multipart_key1.2~83ypBM5n_Mh080PUNd-dxt3rYtBIPix.2 2024-09-12T01:02:00.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.98__shadow_key1.2~83ypBM5n_Mh080PUNd-dxt3rYtBIPix.2_1 2024-09-12T01:02:00.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.98__multipart_key1.2~83ypBM5n_Mh080PUNd-dxt3rYtBIPix.3 2024-09-12T01:02:00.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.98__shadow_key1.2~83ypBM5n_Mh080PUNd-dxt3rYtBIPix.3_1 2024-09-12T01:02:00.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.98__multipart_key1.2~83ypBM5n_Mh080PUNd-dxt3rYtBIPix.4 2024-09-12T01:02:00.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.98__shadow_key1.2~83ypBM5n_Mh080PUNd-dxt3rYtBIPix.4_1 2024-09-12T01:02:00.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.98__multipart_key1.2~83ypBM5n_Mh080PUNd-dxt3rYtBIPix.5 2024-09-12T01:02:00.074 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9133981209498070033', time=2024-09-12T03:00:21.918798+0000, chain.objs.size()=9 2024-09-12T01:02:00.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~UDvOuIL1WWW1eNAk4RgKwKSBZDfpyVj.1 2024-09-12T01:02:00.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~UDvOuIL1WWW1eNAk4RgKwKSBZDfpyVj.1_1 2024-09-12T01:02:00.075 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.074+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~UDvOuIL1WWW1eNAk4RgKwKSBZDfpyVj.2 2024-09-12T01:02:00.077 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.079+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~UDvOuIL1WWW1eNAk4RgKwKSBZDfpyVj.2_1 2024-09-12T01:02:00.079 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.080+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~UDvOuIL1WWW1eNAk4RgKwKSBZDfpyVj.3 2024-09-12T01:02:00.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.081+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~UDvOuIL1WWW1eNAk4RgKwKSBZDfpyVj.3_1 2024-09-12T01:02:00.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.081+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~UDvOuIL1WWW1eNAk4RgKwKSBZDfpyVj.4 2024-09-12T01:02:00.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.081+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~UDvOuIL1WWW1eNAk4RgKwKSBZDfpyVj.4_1 2024-09-12T01:02:00.080 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.081+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~UDvOuIL1WWW1eNAk4RgKwKSBZDfpyVj.5 2024-09-12T01:02:00.084 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.085+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.086 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.088+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:02:00.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.089+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.088 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.089 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4214360821127668938', time=2024-09-12T02:59:50.508171+0000, chain.objs.size()=9 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.99__multipart_key1.2~8PCf0jz4Grxrza3YBXRAcYiov6StWbc.1 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.99__shadow_key1.2~8PCf0jz4Grxrza3YBXRAcYiov6StWbc.1_1 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.99__multipart_key1.2~8PCf0jz4Grxrza3YBXRAcYiov6StWbc.2 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.99__shadow_key1.2~8PCf0jz4Grxrza3YBXRAcYiov6StWbc.2_1 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.99__multipart_key1.2~8PCf0jz4Grxrza3YBXRAcYiov6StWbc.3 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.99__shadow_key1.2~8PCf0jz4Grxrza3YBXRAcYiov6StWbc.3_1 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.99__multipart_key1.2~8PCf0jz4Grxrza3YBXRAcYiov6StWbc.4 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.99__shadow_key1.2~8PCf0jz4Grxrza3YBXRAcYiov6StWbc.4_1 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.99__multipart_key1.2~8PCf0jz4Grxrza3YBXRAcYiov6StWbc.5 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11959123764154919888', time=2024-09-12T03:01:00.057864+0000, chain.objs.size()=7 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~MP7eoMH8sh_GQJ7JQt-wXtslPvxl-tz.1 2024-09-12T01:02:00.090 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~MP7eoMH8sh_GQJ7JQt-wXtslPvxl-tz.1_1 2024-09-12T01:02:00.091 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.090+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~MP7eoMH8sh_GQJ7JQt-wXtslPvxl-tz.1_2 2024-09-12T01:02:00.092 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.093+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~MP7eoMH8sh_GQJ7JQt-wXtslPvxl-tz.2 2024-09-12T01:02:00.093 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.095+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~MP7eoMH8sh_GQJ7JQt-wXtslPvxl-tz.2_1 2024-09-12T01:02:00.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.096+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~MP7eoMH8sh_GQJ7JQt-wXtslPvxl-tz.2_2 2024-09-12T01:02:00.094 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.096+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~MP7eoMH8sh_GQJ7JQt-wXtslPvxl-tz.3 2024-09-12T01:02:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.097+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11207765252100135452', time=2024-09-12T03:01:14.609445+0000, chain.objs.size()=9 2024-09-12T01:02:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.097+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.104__multipart_key1.2~Pouf3WLzLLZ61TXnpay-2gFhP0ONTW5.1 2024-09-12T01:02:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.097+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.104__shadow_key1.2~Pouf3WLzLLZ61TXnpay-2gFhP0ONTW5.1_1 2024-09-12T01:02:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.097+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.104__multipart_key1.2~Pouf3WLzLLZ61TXnpay-2gFhP0ONTW5.2 2024-09-12T01:02:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.097+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.104__shadow_key1.2~Pouf3WLzLLZ61TXnpay-2gFhP0ONTW5.2_1 2024-09-12T01:02:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.097+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.104__multipart_key1.2~Pouf3WLzLLZ61TXnpay-2gFhP0ONTW5.3 2024-09-12T01:02:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.097+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.104__shadow_key1.2~Pouf3WLzLLZ61TXnpay-2gFhP0ONTW5.3_1 2024-09-12T01:02:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.097+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.104__multipart_key1.2~Pouf3WLzLLZ61TXnpay-2gFhP0ONTW5.4 2024-09-12T01:02:00.096 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.097+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.104__shadow_key1.2~Pouf3WLzLLZ61TXnpay-2gFhP0ONTW5.4_1 2024-09-12T01:02:00.098 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.099+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.104__multipart_key1.2~Pouf3WLzLLZ61TXnpay-2gFhP0ONTW5.5 2024-09-12T01:02:00.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.102+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11097165529878135116', time=2024-09-12T03:01:58.871879+0000, chain.objs.size()=9 2024-09-12T01:02:00.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.102+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.144__multipart_key1/data/file.mpg.2~9WeA9dozTtt9eYYeCRYxDCjg8N9qho4.1 2024-09-12T01:02:00.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.102+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.144__shadow_key1/data/file.mpg.2~9WeA9dozTtt9eYYeCRYxDCjg8N9qho4.1_1 2024-09-12T01:02:00.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.102+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.144__multipart_key1/data/file.mpg.2~9WeA9dozTtt9eYYeCRYxDCjg8N9qho4.2 2024-09-12T01:02:00.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.102+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.144__shadow_key1/data/file.mpg.2~9WeA9dozTtt9eYYeCRYxDCjg8N9qho4.2_1 2024-09-12T01:02:00.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.102+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.144__multipart_key1/data/file.mpg.2~9WeA9dozTtt9eYYeCRYxDCjg8N9qho4.3 2024-09-12T01:02:00.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.102+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.144__shadow_key1/data/file.mpg.2~9WeA9dozTtt9eYYeCRYxDCjg8N9qho4.3_1 2024-09-12T01:02:00.101 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.102+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.144__multipart_key1/data/file.mpg.2~9WeA9dozTtt9eYYeCRYxDCjg8N9qho4.4 2024-09-12T01:02:00.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.102+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.144__shadow_key1/data/file.mpg.2~9WeA9dozTtt9eYYeCRYxDCjg8N9qho4.4_1 2024-09-12T01:02:00.102 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.102+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.144__multipart_key1/data/file.mpg.2~9WeA9dozTtt9eYYeCRYxDCjg8N9qho4.5 2024-09-12T01:02:00.108 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.108+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.109 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.111+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:02:00.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.112+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.113+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.113+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.113+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9656896204025314162', time=2024-09-12T02:59:29.996658+0000, chain.objs.size()=7 2024-09-12T01:02:00.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.113+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~XZb2oFleKoY-dsmvN2gzkdRrMJqi5yX.1 2024-09-12T01:02:00.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.113+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~XZb2oFleKoY-dsmvN2gzkdRrMJqi5yX.1_1 2024-09-12T01:02:00.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.113+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~XZb2oFleKoY-dsmvN2gzkdRrMJqi5yX.1_2 2024-09-12T01:02:00.112 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.113+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~XZb2oFleKoY-dsmvN2gzkdRrMJqi5yX.2 2024-09-12T01:02:00.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.113+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~XZb2oFleKoY-dsmvN2gzkdRrMJqi5yX.2_1 2024-09-12T01:02:00.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.113+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~XZb2oFleKoY-dsmvN2gzkdRrMJqi5yX.2_2 2024-09-12T01:02:00.113 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.113+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~XZb2oFleKoY-dsmvN2gzkdRrMJqi5yX.3 2024-09-12T01:02:00.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.118+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.120+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:02:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.121+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16161017447496978203', time=2024-09-12T02:59:18.852155+0000, chain.objs.size()=9 2024-09-12T01:02:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~D9WnO_uIrPEy_Q3xH_EO6GbfhSzzPEP.1 2024-09-12T01:02:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~D9WnO_uIrPEy_Q3xH_EO6GbfhSzzPEP.1_1 2024-09-12T01:02:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~D9WnO_uIrPEy_Q3xH_EO6GbfhSzzPEP.2 2024-09-12T01:02:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~D9WnO_uIrPEy_Q3xH_EO6GbfhSzzPEP.2_1 2024-09-12T01:02:00.121 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~D9WnO_uIrPEy_Q3xH_EO6GbfhSzzPEP.3 2024-09-12T01:02:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~D9WnO_uIrPEy_Q3xH_EO6GbfhSzzPEP.3_1 2024-09-12T01:02:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~D9WnO_uIrPEy_Q3xH_EO6GbfhSzzPEP.4 2024-09-12T01:02:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~D9WnO_uIrPEy_Q3xH_EO6GbfhSzzPEP.4_1 2024-09-12T01:02:00.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.122+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~D9WnO_uIrPEy_Q3xH_EO6GbfhSzzPEP.5 2024-09-12T01:02:00.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.127+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.129+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:02:00.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.131+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.131+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.131+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.131+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13639105553885557753', time=2024-09-12T03:00:59.860995+0000, chain.objs.size()=7 2024-09-12T01:02:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.131+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~on6W2J-kFzZhqiKKBzKtmF1Fqsza28d.1 2024-09-12T01:02:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.131+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~on6W2J-kFzZhqiKKBzKtmF1Fqsza28d.1_1 2024-09-12T01:02:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.131+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~on6W2J-kFzZhqiKKBzKtmF1Fqsza28d.1_2 2024-09-12T01:02:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.131+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~on6W2J-kFzZhqiKKBzKtmF1Fqsza28d.2 2024-09-12T01:02:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.131+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~on6W2J-kFzZhqiKKBzKtmF1Fqsza28d.2_1 2024-09-12T01:02:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.131+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~on6W2J-kFzZhqiKKBzKtmF1Fqsza28d.2_2 2024-09-12T01:02:00.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.131+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~on6W2J-kFzZhqiKKBzKtmF1Fqsza28d.3 2024-09-12T01:02:00.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.136+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.138+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:02:00.138 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.140+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.140+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.141+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.141 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.142+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:02:00.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.143+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.144+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.144+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.143 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.145+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:02:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.146+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:02:00.146 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15314502223988745041', time=2024-09-12T03:00:32.000767+0000, chain.objs.size()=9 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~S7r4nO3t5FLkCFv-VkET6n2pXBYqy74.1 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~S7r4nO3t5FLkCFv-VkET6n2pXBYqy74.1_1 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~S7r4nO3t5FLkCFv-VkET6n2pXBYqy74.2 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~S7r4nO3t5FLkCFv-VkET6n2pXBYqy74.2_1 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~S7r4nO3t5FLkCFv-VkET6n2pXBYqy74.3 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~S7r4nO3t5FLkCFv-VkET6n2pXBYqy74.3_1 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~S7r4nO3t5FLkCFv-VkET6n2pXBYqy74.4 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~S7r4nO3t5FLkCFv-VkET6n2pXBYqy74.4_1 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~S7r4nO3t5FLkCFv-VkET6n2pXBYqy74.5 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17075056860615594856', time=2024-09-12T03:00:45.929879+0000, chain.objs.size()=7 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.147+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~8FJj1EuDt18_ibb1P8LtLOrZ7OWpHdN.1 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.148+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~8FJj1EuDt18_ibb1P8LtLOrZ7OWpHdN.1_1 2024-09-12T01:02:00.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.148+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~8FJj1EuDt18_ibb1P8LtLOrZ7OWpHdN.1_2 2024-09-12T01:02:00.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.152+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~8FJj1EuDt18_ibb1P8LtLOrZ7OWpHdN.2 2024-09-12T01:02:00.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.152+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~8FJj1EuDt18_ibb1P8LtLOrZ7OWpHdN.2_1 2024-09-12T01:02:00.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.152+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__shadow_key1.2~8FJj1EuDt18_ibb1P8LtLOrZ7OWpHdN.2_2 2024-09-12T01:02:00.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.152+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.102__multipart_key1.2~8FJj1EuDt18_ibb1P8LtLOrZ7OWpHdN.3 2024-09-12T01:02:00.156 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.158+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.160+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:02:00.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.161+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.162+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.160 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.162+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.163+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:02:00.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.164+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.164+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.165+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.165+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4535280123427984236', time=2024-09-12T03:00:05.748398+0000, chain.objs.size()=5 2024-09-12T01:02:00.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.165+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__multipart_file2.mpg.2~LJPbEpoJOIR2LvYimlzI-8mFFW3GjhB.1 2024-09-12T01:02:00.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.165+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__multipart_file2.mpg.2~LJPbEpoJOIR2LvYimlzI-8mFFW3GjhB.2 2024-09-12T01:02:00.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.165+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__multipart_file2.mpg.2~LJPbEpoJOIR2LvYimlzI-8mFFW3GjhB.3 2024-09-12T01:02:00.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.165+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__multipart_file2.mpg.2~LJPbEpoJOIR2LvYimlzI-8mFFW3GjhB.4 2024-09-12T01:02:00.164 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.165+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__multipart_file2.mpg.2~LJPbEpoJOIR2LvYimlzI-8mFFW3GjhB.5 2024-09-12T01:02:00.166 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.168+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.169 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.170+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:02:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.171+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.172+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.172+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.173+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:02:00.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.175+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.175+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.175+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.174 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.175+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1334852746299487142', time=2024-09-12T03:00:05.693327+0000, chain.objs.size()=9 2024-09-12T01:02:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.175+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__multipart_file.mpg.2~GUPipKBpOOQTo0rgTIxS_2qA9NsyMjK.1 2024-09-12T01:02:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.175+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__shadow_file.mpg.2~GUPipKBpOOQTo0rgTIxS_2qA9NsyMjK.1_1 2024-09-12T01:02:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.175+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__multipart_file.mpg.2~GUPipKBpOOQTo0rgTIxS_2qA9NsyMjK.2 2024-09-12T01:02:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.175+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__shadow_file.mpg.2~GUPipKBpOOQTo0rgTIxS_2qA9NsyMjK.2_1 2024-09-12T01:02:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.175+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__multipart_file.mpg.2~GUPipKBpOOQTo0rgTIxS_2qA9NsyMjK.3 2024-09-12T01:02:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.176+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__shadow_file.mpg.2~GUPipKBpOOQTo0rgTIxS_2qA9NsyMjK.3_1 2024-09-12T01:02:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.176+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__multipart_file.mpg.2~GUPipKBpOOQTo0rgTIxS_2qA9NsyMjK.4 2024-09-12T01:02:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.176+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__shadow_file.mpg.2~GUPipKBpOOQTo0rgTIxS_2qA9NsyMjK.4_1 2024-09-12T01:02:00.175 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.176+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.100__multipart_file.mpg.2~GUPipKBpOOQTo0rgTIxS_2qA9NsyMjK.5 2024-09-12T01:02:00.180 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.181+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.182 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.183+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:02:00.183 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.184+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.185+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.184 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.185+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.185 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.186+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:02:00.186 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.188+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.188+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.188+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.188+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12967938146898942728', time=2024-09-12T02:59:33.342605+0000, chain.objs.size()=5 2024-09-12T01:02:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.188+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.93__shadow_.CLo7kuYsWszwMKNBT3IydNZTEoP0mQW_1 2024-09-12T01:02:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.188+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.93__shadow_.CLo7kuYsWszwMKNBT3IydNZTEoP0mQW_2 2024-09-12T01:02:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.188+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.93__shadow_.CLo7kuYsWszwMKNBT3IydNZTEoP0mQW_3 2024-09-12T01:02:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.188+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.93__shadow_.CLo7kuYsWszwMKNBT3IydNZTEoP0mQW_4 2024-09-12T01:02:00.187 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.188+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.93__shadow_.CLo7kuYsWszwMKNBT3IydNZTEoP0mQW_5 2024-09-12T01:02:00.192 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.192+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.193 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.194+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:02:00.194 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.196+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.196+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.195 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.196+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:02:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.196+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~yfrMATxO3l6FCVEPpeze2g-uwv6EnlR', time=2024-09-12T03:00:11.104930+0000, chain.objs.size()=9 2024-09-12T01:02:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.196+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.101__multipart_key1.2~yfrMATxO3l6FCVEPpeze2g-uwv6EnlR.7 2024-09-12T01:02:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.196+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.101__shadow_key1.2~yfrMATxO3l6FCVEPpeze2g-uwv6EnlR.7_1 2024-09-12T01:02:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.196+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.101__multipart_key1.2~yfrMATxO3l6FCVEPpeze2g-uwv6EnlR.8 2024-09-12T01:02:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.197+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.101__shadow_key1.2~yfrMATxO3l6FCVEPpeze2g-uwv6EnlR.8_1 2024-09-12T01:02:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.197+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.101__multipart_key1.2~yfrMATxO3l6FCVEPpeze2g-uwv6EnlR.9 2024-09-12T01:02:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.197+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.101__shadow_key1.2~yfrMATxO3l6FCVEPpeze2g-uwv6EnlR.9_1 2024-09-12T01:02:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.197+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.101__multipart_key1.2~yfrMATxO3l6FCVEPpeze2g-uwv6EnlR.10 2024-09-12T01:02:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.197+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.101__shadow_key1.2~yfrMATxO3l6FCVEPpeze2g-uwv6EnlR.10_1 2024-09-12T01:02:00.196 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.197+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.101__multipart_key1.2~yfrMATxO3l6FCVEPpeze2g-uwv6EnlR.11 2024-09-12T01:02:00.201 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.202+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.203 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.205+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:02:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.206+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.205 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:02:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u', time=2024-09-12T03:01:20.819557+0000, chain.objs.size()=1 2024-09-12T01:02:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.20 2024-09-12T01:02:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u', time=2024-09-12T03:01:20.959450+0000, chain.objs.size()=52 2024-09-12T01:02:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.1 2024-09-12T01:02:00.206 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.2 2024-09-12T01:02:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.3 2024-09-12T01:02:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.4 2024-09-12T01:02:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.5 2024-09-12T01:02:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.6 2024-09-12T01:02:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.7 2024-09-12T01:02:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.8 2024-09-12T01:02:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.9 2024-09-12T01:02:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.10 2024-09-12T01:02:00.207 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.207+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.11 2024-09-12T01:02:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.210+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.12 2024-09-12T01:02:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.210+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.13 2024-09-12T01:02:00.209 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.210+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.14 2024-09-12T01:02:00.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.212+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.15 2024-09-12T01:02:00.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.212+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.16 2024-09-12T01:02:00.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.212+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.17 2024-09-12T01:02:00.211 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.212+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.18 2024-09-12T01:02:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.215+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.19 2024-09-12T01:02:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.215+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.dEYaJDDH8GJYCSaCMeY7ek8yHybRravf.20 2024-09-12T01:02:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.215+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.21 2024-09-12T01:02:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.215+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.22 2024-09-12T01:02:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.215+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.23 2024-09-12T01:02:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.215+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.24 2024-09-12T01:02:00.214 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.215+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.25 2024-09-12T01:02:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.217+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.26 2024-09-12T01:02:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.217+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.27 2024-09-12T01:02:00.216 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.217+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.28 2024-09-12T01:02:00.217 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.218+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.29 2024-09-12T01:02:00.219 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.220+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.30 2024-09-12T01:02:00.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.222+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.31 2024-09-12T01:02:00.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.222+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.32 2024-09-12T01:02:00.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.222+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.33 2024-09-12T01:02:00.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.222+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.34 2024-09-12T01:02:00.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.222+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.35 2024-09-12T01:02:00.221 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.222+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.36 2024-09-12T01:02:00.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.222+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.37 2024-09-12T01:02:00.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.222+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.38 2024-09-12T01:02:00.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.222+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.39 2024-09-12T01:02:00.222 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.223+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.40 2024-09-12T01:02:00.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.229+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.41 2024-09-12T01:02:00.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.229+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.42 2024-09-12T01:02:00.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.229+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.43 2024-09-12T01:02:00.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.229+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.44 2024-09-12T01:02:00.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.229+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.45 2024-09-12T01:02:00.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.229+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.46 2024-09-12T01:02:00.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.229+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.47 2024-09-12T01:02:00.228 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.229+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.48 2024-09-12T01:02:00.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.229+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.49 2024-09-12T01:02:00.229 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.229+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.50 2024-09-12T01:02:00.231 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.232+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.51 2024-09-12T01:02:00.233 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.234+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.105__multipart_key1.2~vXDcAfDU6geX-QL1vliBL_Cf4qjYz_u.52 2024-09-12T01:02:00.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.237+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.240+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:02:00.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.241+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.240 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.241+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:02:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1756745091083034705', time=2024-09-12T02:59:26.204747+0000, chain.objs.size()=9 2024-09-12T01:02:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~rlvPkoMuKxyIE35cWBWOPa5gk1v7L_p.1 2024-09-12T01:02:00.241 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~rlvPkoMuKxyIE35cWBWOPa5gk1v7L_p.1_1 2024-09-12T01:02:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~rlvPkoMuKxyIE35cWBWOPa5gk1v7L_p.2 2024-09-12T01:02:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~rlvPkoMuKxyIE35cWBWOPa5gk1v7L_p.2_1 2024-09-12T01:02:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~rlvPkoMuKxyIE35cWBWOPa5gk1v7L_p.3 2024-09-12T01:02:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~rlvPkoMuKxyIE35cWBWOPa5gk1v7L_p.3_1 2024-09-12T01:02:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~rlvPkoMuKxyIE35cWBWOPa5gk1v7L_p.4 2024-09-12T01:02:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__shadow_key1.2~rlvPkoMuKxyIE35cWBWOPa5gk1v7L_p.4_1 2024-09-12T01:02:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.94__multipart_key1.2~rlvPkoMuKxyIE35cWBWOPa5gk1v7L_p.5 2024-09-12T01:02:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.2288653149635339742', time=2024-09-12T03:01:09.019216+0000, chain.objs.size()=9 2024-09-12T01:02:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.103__multipart_key1.2~wQHNOJ73MM25hvPfGf8FXK__IsrSUur.1 2024-09-12T01:02:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.103__shadow_key1.2~wQHNOJ73MM25hvPfGf8FXK__IsrSUur.1_1 2024-09-12T01:02:00.242 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.242+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.103__multipart_key1.2~wQHNOJ73MM25hvPfGf8FXK__IsrSUur.2 2024-09-12T01:02:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.246+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.103__shadow_key1.2~wQHNOJ73MM25hvPfGf8FXK__IsrSUur.2_1 2024-09-12T01:02:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.246+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.103__multipart_key1.2~wQHNOJ73MM25hvPfGf8FXK__IsrSUur.3 2024-09-12T01:02:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.246+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.103__shadow_key1.2~wQHNOJ73MM25hvPfGf8FXK__IsrSUur.3_1 2024-09-12T01:02:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.247+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.103__multipart_key1.2~wQHNOJ73MM25hvPfGf8FXK__IsrSUur.4 2024-09-12T01:02:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.247+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.103__shadow_key1.2~wQHNOJ73MM25hvPfGf8FXK__IsrSUur.4_1 2024-09-12T01:02:00.246 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.247+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.103__multipart_key1.2~wQHNOJ73MM25hvPfGf8FXK__IsrSUur.5 2024-09-12T01:02:00.250 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.251+0000 7fc358e0f800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:02:00.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.254+0000 7fc358e0f800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:02:00.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.255+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.255+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.256+0000 7fc358e0f800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.256 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.257+0000 7fc20d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:00.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.259+0000 7fc358e0f800 20 remove_watcher() i=0 2024-09-12T01:02:00.258 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.259+0000 7fc358e0f800 2 removed watcher, disabling cache 2024-09-12T01:02:00.259 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.260+0000 7fc358e0f800 20 remove_watcher() i=1 2024-09-12T01:02:00.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.261+0000 7fc358e0f800 20 remove_watcher() i=2 2024-09-12T01:02:00.262 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.263+0000 7fc358e0f800 20 remove_watcher() i=3 2024-09-12T01:02:00.263 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.264+0000 7fc358e0f800 20 remove_watcher() i=4 2024-09-12T01:02:00.264 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.265+0000 7fc358e0f800 20 remove_watcher() i=5 2024-09-12T01:02:00.265 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.266+0000 7fc358e0f800 20 remove_watcher() i=6 2024-09-12T01:02:00.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.267+0000 7fc358e0f800 20 remove_watcher() i=7 2024-09-12T01:02:00.277 DEBUG:teuthology.orchestra.run.smithi019:> radosgw-admin gc process --include-all 2024-09-12T01:02:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:00.330 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:00.370 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.371+0000 7f29e1719800 20 rados->read ofs=0 len=0 2024-09-12T01:02:00.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.372+0000 7f29e1719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:00.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.372+0000 7f29e1719800 20 realm 2024-09-12T01:02:00.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.372+0000 7f29e1719800 20 rados->read ofs=0 len=0 2024-09-12T01:02:00.371 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.372+0000 7f29e1719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:00.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.372+0000 7f29e1719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:00.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.372+0000 7f29e1719800 20 rados->read ofs=0 len=0 2024-09-12T01:02:00.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.373+0000 7f29e1719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:00.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.373+0000 7f29e1719800 20 rados->read ofs=0 len=0 2024-09-12T01:02:00.372 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.373+0000 7f29e1719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:00.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.373+0000 7f29e1719800 20 rados->read ofs=0 len=0 2024-09-12T01:02:00.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.374+0000 7f29e1719800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:00.373 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.374+0000 7f29e1719800 20 searching for the correct realm 2024-09-12T01:02:00.376 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.377+0000 7f29dea02640 0 -- 172.21.15.19:0/4258801695 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f29d406cc00 msgr2=0x7f29d409b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:00.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.583+0000 7f29dfa04640 0 -- 172.21.15.19:0/4258801695 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5631d145f1f0 msgr2=0x5631d14616b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:00.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.587+0000 7f29e1719800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:00.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.587+0000 7f29e1719800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:00.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.587+0000 7f29e1719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:00.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.587+0000 7f29e1719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:00.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.587+0000 7f29e1719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:00.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.587+0000 7f29e1719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:00.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.587+0000 7f29e1719800 20 rados->read ofs=0 len=0 2024-09-12T01:02:00.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.587+0000 7f29e1719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:00.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.587+0000 7f29e1719800 20 rados->read ofs=0 len=0 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.587+0000 7f29e1719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.587+0000 7f29e1719800 20 rados->read ofs=0 len=0 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 20 zone default found 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 4 Realm: () 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 20 zonegroup default 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 20 rados->read ofs=0 len=0 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:00.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 20 rados->read ofs=0 len=0 2024-09-12T01:02:00.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:00.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.588+0000 7f29e1719800 20 rados->read ofs=0 len=0 2024-09-12T01:02:00.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.589+0000 7f29e1719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:00.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.589+0000 7f29e1719800 20 started sync module instance, tier type = 2024-09-12T01:02:00.589 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.589+0000 7f29e1719800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.598+0000 7f29e1719800 20 add_watcher() i=0 2024-09-12T01:02:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.598+0000 7f29e1719800 20 add_watcher() i=1 2024-09-12T01:02:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.598+0000 7f29e1719800 20 add_watcher() i=2 2024-09-12T01:02:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.598+0000 7f29e1719800 20 add_watcher() i=3 2024-09-12T01:02:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.598+0000 7f29e1719800 20 add_watcher() i=4 2024-09-12T01:02:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.598+0000 7f29e1719800 20 add_watcher() i=5 2024-09-12T01:02:00.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.598+0000 7f29e1719800 20 add_watcher() i=6 2024-09-12T01:02:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.599+0000 7f29e1719800 20 add_watcher() i=7 2024-09-12T01:02:00.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.599+0000 7f29e1719800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:00.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.600+0000 7f2895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:00.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.601+0000 7f29e1719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:00.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.601+0000 7f29e1719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.638+0000 7f2894fe1640 20 reqs_thread_entry: start 2024-09-12T01:02:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.638+0000 7f29e1719800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.638+0000 7f29e1719800 20 Filter name: none 2024-09-12T01:02:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.638+0000 7f280e7fc640 20 reqs_thread_entry: start 2024-09-12T01:02:00.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.638+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:02:00.638 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.639+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.640+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.641+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.642+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:02:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.643+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.644+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.644+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.644 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.645+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:02:00.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.646+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.647+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.647+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.647 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.648+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:02:00.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.649+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.650+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.650+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.650 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.651+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:02:00.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.652+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.653+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.653+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.654+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:02:00.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.655+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.656+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.656+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.657+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:02:00.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.658+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.659+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.659+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.660+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:02:00.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.661+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.662+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.662+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.663+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:02:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.664+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.665+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.665+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.664 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.666+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:02:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.667+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.668+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.668+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.669+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:02:00.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.670+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.671+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.671+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.672+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:02:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.673+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.674+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.674+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.675+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:02:00.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.676+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.677+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.677+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.678+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:02:00.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.679+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.680+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.680+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.681+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:02:00.681 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.682+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.683+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.683+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.684+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:02:00.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.685+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.684 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.686+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.686+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.687+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:02:00.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.688+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.689+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.688 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.689+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.690+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:02:00.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.692+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.692+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.692+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.692 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.694+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:02:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.695+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.696+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.696+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.695 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.697+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:02:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.698+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.699+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.699+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.698 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.700+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:02:00.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.701+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.702+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.701 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.702+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.702 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.703+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:02:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.705+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.705+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.704 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.705+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.706+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:02:00.706 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.708+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.708+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.708+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.709+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:02:00.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.711+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.710 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.711+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.712+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.713+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:02:00.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.714+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.715+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.716+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.717+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:02:00.716 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.718+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.718+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.717 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.719+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.718 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.719+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:02:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.721+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.721+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.720 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.722+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.721 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.722+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:02:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.724+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.724+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.724+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.724 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.726+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:02:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.727+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.727+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.728+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.729+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:02:00.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.730+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.731+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.732+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.731 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.733+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:02:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.734+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.735+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.735+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.734 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.736+0000 7f29e1719800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:02:00.736 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.737+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.738+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:02:00.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.738+0000 7f29e1719800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:02:00.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.740+0000 7f2895fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:00.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.743+0000 7f29e1719800 20 remove_watcher() i=0 2024-09-12T01:02:00.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.743+0000 7f29e1719800 2 removed watcher, disabling cache 2024-09-12T01:02:00.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.744+0000 7f29e1719800 20 remove_watcher() i=1 2024-09-12T01:02:00.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.745+0000 7f29e1719800 20 remove_watcher() i=2 2024-09-12T01:02:00.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.746+0000 7f29e1719800 20 remove_watcher() i=3 2024-09-12T01:02:00.745 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.747+0000 7f29e1719800 20 remove_watcher() i=4 2024-09-12T01:02:00.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.748+0000 7f29e1719800 20 remove_watcher() i=5 2024-09-12T01:02:00.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.749+0000 7f29e1719800 20 remove_watcher() i=6 2024-09-12T01:02:00.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:00.750+0000 7f29e1719800 20 remove_watcher() i=7 2024-09-12T01:02:00.760 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T01:02:00.777 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T01:02:00.778 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T01:02:00.778 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T01:02:00.778 DEBUG:teuthology.orchestra.run.smithi019:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:02:00.808 INFO:teuthology.orchestra.run.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T01:02:01.608 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T01:02:01.609 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-12T01:02:01.609 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key FBBSFZAACLUOVFWCWCIR --secret yltPu/LmB9sRHZoA91jGf2iUg930OTwLrOV5uHnxzccIQKPInIhdBw== --cluster ceph 2024-09-12T01:02:01.715 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:01.715 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:01.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.753+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.754+0000 7ffac6f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.754+0000 7ffac6f75800 20 realm 2024-09-12T01:02:01.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.754+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.755+0000 7ffac6f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.755+0000 7ffac6f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:01.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.755+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.755+0000 7ffac6f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.754 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.755+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.756+0000 7ffac6f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:01.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.756+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.756+0000 7ffac6f75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:01.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.756+0000 7ffac6f75800 20 searching for the correct realm 2024-09-12T01:02:01.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.759+0000 7ffac4265640 0 -- 172.21.15.19:0/921472692 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7ffab807c920 msgr2=0x7ffab8096400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:01.964 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.965+0000 7ffac5267640 0 -- 172.21.15.19:0/921472692 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5591c46cb7f0 msgr2=0x5591c46cdc80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:01.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.970+0000 7ffac6f75800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:01.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.970+0000 7ffac6f75800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:01.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.970+0000 7ffac6f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:01.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.970+0000 7ffac6f75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:01.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.970+0000 7ffac6f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:01.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.970+0000 7ffac6f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:01.969 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.970+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.970+0000 7ffac6f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.970+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.971+0000 7ffac6f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:01.970 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.971+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.971+0000 7ffac6f75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.971+0000 7ffac6f75800 20 zone default found 2024-09-12T01:02:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.971+0000 7ffac6f75800 4 Realm: () 2024-09-12T01:02:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.971+0000 7ffac6f75800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.971+0000 7ffac6f75800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.971+0000 7ffac6f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.971+0000 7ffac6f75800 20 zonegroup default 2024-09-12T01:02:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.971+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.972+0000 7ffac6f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.971 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.972+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.972+0000 7ffac6f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.972+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.972+0000 7ffac6f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.972+0000 7ffac6f75800 20 started sync module instance, tier type = 2024-09-12T01:02:01.972 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.972+0000 7ffac6f75800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:01.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.982+0000 7ffac6f75800 20 add_watcher() i=0 2024-09-12T01:02:01.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.982+0000 7ffac6f75800 20 add_watcher() i=1 2024-09-12T01:02:01.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.982+0000 7ffac6f75800 20 add_watcher() i=2 2024-09-12T01:02:01.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.982+0000 7ffac6f75800 20 add_watcher() i=3 2024-09-12T01:02:01.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.982+0000 7ffac6f75800 20 add_watcher() i=4 2024-09-12T01:02:01.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.982+0000 7ffac6f75800 20 add_watcher() i=5 2024-09-12T01:02:01.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.982+0000 7ffac6f75800 20 add_watcher() i=6 2024-09-12T01:02:01.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.983+0000 7ffac6f75800 20 add_watcher() i=7 2024-09-12T01:02:01.982 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.983+0000 7ffac6f75800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.985+0000 7ff97afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.985+0000 7ffac6f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.985+0000 7ffac6f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.985+0000 7ffac6f75800 5 note: GC not initialized 2024-09-12T01:02:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.986+0000 7ff979fe3640 20 reqs_thread_entry: start 2024-09-12T01:02:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.986+0000 7ffac6f75800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.986+0000 7ffac6f75800 20 Filter name: none 2024-09-12T01:02:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.986+0000 7ff8eb7fe640 20 reqs_thread_entry: start 2024-09-12T01:02:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.986+0000 7ffac6f75800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T01:02:01.985 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.986+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.986 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.986+0000 7ffac6f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.986+0000 7ffac6f75800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.986+0000 7ffac6f75800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.986+0000 7ffac6f75800 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.986+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.987+0000 7ffac6f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.987+0000 7ffac6f75800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.987+0000 7ffac6f75800 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.987+0000 7ffac6f75800 10 cache get: name=default.rgw.meta+users.keys+FBBSFZAACLUOVFWCWCIR : miss 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.987+0000 7ffac6f75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.987+0000 7ffac6f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.987+0000 7ffac6f75800 10 cache put: name=default.rgw.meta+users.keys+FBBSFZAACLUOVFWCWCIR info.flags=0x0 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.987+0000 7ffac6f75800 10 adding default.rgw.meta+users.keys+FBBSFZAACLUOVFWCWCIR to cache LRU end 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.987+0000 7ffac6f75800 10 cache get: name=default.rgw.meta+users.keys+FBBSFZAACLUOVFWCWCIR : hit (negative entry) 2024-09-12T01:02:01.987 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.987+0000 7ffac6f75800 10 cache get: name=default.rgw.meta+users.keys+FBBSFZAACLUOVFWCWCIR : hit (negative entry) 2024-09-12T01:02:01.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.989+0000 7ffac6f75800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:02:01.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.989+0000 7ffac6f75800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:02:01.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.989+0000 7ffac6f75800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T01:02:01.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.989+0000 7ff99bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398948 cookie 94084554084256 notifier 8387 bl.length()=645 2024-09-12T01:02:01.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.989+0000 7ff99bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:02:01.988 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.989+0000 7ff99bfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:02:01.990 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.992+0000 7ffac6f75800 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T01:02:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.992+0000 7ffac6f75800 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:02:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.992+0000 7ffac6f75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T01:02:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.992+0000 7ff99bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399112 cookie 94084554139872 notifier 8387 bl.length()=185 2024-09-12T01:02:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.992+0000 7ff99bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T01:02:01.991 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.992+0000 7ff99bfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T01:02:01.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.995+0000 7ffac6f75800 10 cache put: name=default.rgw.meta+users.keys+FBBSFZAACLUOVFWCWCIR info.flags=0x7 2024-09-12T01:02:01.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.995+0000 7ffac6f75800 10 moving default.rgw.meta+users.keys+FBBSFZAACLUOVFWCWCIR to cache LRU end 2024-09-12T01:02:01.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.995+0000 7ffac6f75800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:FBBSFZAACLUOVFWCWCIR, ofs0, ns] 2024-09-12T01:02:01.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.995+0000 7ff99b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398954 cookie 94084554135920 notifier 8387 bl.length()=186 2024-09-12T01:02:01.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.995+0000 7ff99b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+FBBSFZAACLUOVFWCWCIR info.flags=0x7 2024-09-12T01:02:01.994 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.995+0000 7ff99b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+FBBSFZAACLUOVFWCWCIR to cache LRU end 2024-09-12T01:02:01.995 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:02:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "user_id": "foo.client.0", 2024-09-12T01:02:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "display_name": "Mr.foo.client.0", 2024-09-12T01:02:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "foo+test@test.test", 2024-09-12T01:02:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "suspended": 0, 2024-09-12T01:02:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T01:02:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "subusers": [], 2024-09-12T01:02:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: "keys": [ 2024-09-12T01:02:01.995 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "user": "foo.client.0", 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "access_key": "FBBSFZAACLUOVFWCWCIR", 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "secret_key": "yltPu/LmB9sRHZoA91jGf2iUg930OTwLrOV5uHnxzccIQKPInIhdBw==", 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "active": true, 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:01.988171Z" 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "swift_keys": [], 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": [], 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "default_placement": "", 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "default_storage_class": "", 2024-09-12T01:02:01.996 INFO:teuthology.orchestra.run.smithi019.stdout: "placement_tags": [], 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "user_quota": { 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:01.997 INFO:teuthology.orchestra.run.smithi019.stdout: "temp_url_keys": [], 2024-09-12T01:02:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "rgw", 2024-09-12T01:02:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "mfa_ids": [], 2024-09-12T01:02:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "account_id": "", 2024-09-12T01:02:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-12T01:02:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:01.988158Z", 2024-09-12T01:02:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-12T01:02:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: "group_ids": [] 2024-09-12T01:02:01.998 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:02:01.998 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:02:01.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:01.997+0000 7ff97afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:01.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.000+0000 7ffac6f75800 20 remove_watcher() i=0 2024-09-12T01:02:01.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.000+0000 7ffac6f75800 2 removed watcher, disabling cache 2024-09-12T01:02:01.999 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.001+0000 7ffac6f75800 20 remove_watcher() i=1 2024-09-12T01:02:02.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.002+0000 7ffac6f75800 20 remove_watcher() i=2 2024-09-12T01:02:02.001 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.003+0000 7ffac6f75800 20 remove_watcher() i=3 2024-09-12T01:02:02.003 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.004+0000 7ffac6f75800 20 remove_watcher() i=4 2024-09-12T01:02:02.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.005+0000 7ffac6f75800 20 remove_watcher() i=5 2024-09-12T01:02:02.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.006+0000 7ffac6f75800 20 remove_watcher() i=6 2024-09-12T01:02:02.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.007+0000 7ffac6f75800 20 remove_watcher() i=7 2024-09-12T01:02:02.018 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 3893010636 --totp-seed OCB6LCZH36CLETNCRZTEYQLHK6LXZYQO2VUHMXOTGMQPKMUV2LP4W25ZYFGSHDDJ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:02:02.086 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:02.086 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:02.122 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.123+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.125+0000 7f133031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:02.124 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.125+0000 7f133031f800 20 realm 2024-09-12T01:02:02.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.125+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.125+0000 7f133031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:02.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.125+0000 7f133031f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:02.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.125+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.126+0000 7f133031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:02.125 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.126+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.126+0000 7f133031f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:02.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.126+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.127+0000 7f133031f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:02.126 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.127+0000 7f133031f800 20 searching for the correct realm 2024-09-12T01:02:02.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.130+0000 7f132b80b640 0 -- 172.21.15.19:0/2065737919 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f1320013030 msgr2=0x7f13200638e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:02.335 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.337+0000 7f132c80d640 0 -- 172.21.15.19:0/2065737919 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5645d850edd0 msgr2=0x5645d8511260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.341+0000 7f133031f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.341+0000 7f133031f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.341+0000 7f133031f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.341+0000 7f133031f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:02.340 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.341+0000 7f133031f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.341+0000 7f133031f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.341+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.341+0000 7f133031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.341+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.341 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.342+0000 7f133031f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.342+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.342+0000 7f133031f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.342+0000 7f133031f800 20 zone default found 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.342+0000 7f133031f800 4 Realm: () 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.342+0000 7f133031f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.342+0000 7f133031f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.342+0000 7f133031f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.342+0000 7f133031f800 20 zonegroup default 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.342+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.343+0000 7f133031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.343+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.342 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.343+0000 7f133031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.343+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.343+0000 7f133031f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.344+0000 7f133031f800 20 started sync module instance, tier type = 2024-09-12T01:02:02.343 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.344+0000 7f133031f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:02.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.353+0000 7f133031f800 20 add_watcher() i=0 2024-09-12T01:02:02.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.353+0000 7f133031f800 20 add_watcher() i=1 2024-09-12T01:02:02.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.353+0000 7f133031f800 20 add_watcher() i=2 2024-09-12T01:02:02.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.353+0000 7f133031f800 20 add_watcher() i=3 2024-09-12T01:02:02.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.353+0000 7f133031f800 20 add_watcher() i=4 2024-09-12T01:02:02.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.353+0000 7f133031f800 20 add_watcher() i=5 2024-09-12T01:02:02.352 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.353+0000 7f133031f800 20 add_watcher() i=6 2024-09-12T01:02:02.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.355+0000 7f133031f800 20 add_watcher() i=7 2024-09-12T01:02:02.353 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.355+0000 7f133031f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.356+0000 7f11e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.356+0000 7f133031f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.356+0000 7f133031f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.357+0000 7f133031f800 5 note: GC not initialized 2024-09-12T01:02:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.357+0000 7f11e1fdb640 20 reqs_thread_entry: start 2024-09-12T01:02:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.357+0000 7f133031f800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:02.356 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.357+0000 7f133031f800 20 Filter name: none 2024-09-12T01:02:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.357+0000 7f11537fe640 20 reqs_thread_entry: start 2024-09-12T01:02:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.357+0000 7f133031f800 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T01:02:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.357+0000 7f133031f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.358+0000 7f133031f800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T01:02:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.358+0000 7f133031f800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T01:02:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.358+0000 7f133031f800 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:02:02.357 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:02.358+0000 7f133031f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:02:03.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.926+0000 7f133031f800 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:02:03.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.926+0000 7f133031f800 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:02:03.925 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.926+0000 7f133031f800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T01:02:03.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.927+0000 7f1202ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333541 cookie 94857981922704 notifier 8405 bl.length()=659 2024-09-12T01:02:03.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.927+0000 7f1202ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T01:02:03.926 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.927+0000 7f1202ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T01:02:03.929 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.930+0000 7f11e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:03.932 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.934+0000 7f133031f800 20 remove_watcher() i=0 2024-09-12T01:02:03.933 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.934+0000 7f133031f800 2 removed watcher, disabling cache 2024-09-12T01:02:03.934 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.935+0000 7f133031f800 20 remove_watcher() i=1 2024-09-12T01:02:03.935 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.937+0000 7f133031f800 20 remove_watcher() i=2 2024-09-12T01:02:03.936 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.938+0000 7f133031f800 20 remove_watcher() i=3 2024-09-12T01:02:03.938 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.939+0000 7f133031f800 20 remove_watcher() i=4 2024-09-12T01:02:03.939 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.940+0000 7f133031f800 20 remove_watcher() i=5 2024-09-12T01:02:03.940 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.942+0000 7f133031f800 20 remove_watcher() i=6 2024-09-12T01:02:03.941 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:03.943+0000 7f133031f800 20 remove_watcher() i=7 2024-09-12T01:02:03.954 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T01:02:03.955 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key STUOZCRGWRXKTAMFWFDY --secret ZyTDzyPP89qDie15gARhRO6rS1xzkOgZe5HB//eyWw9AUeSMvmyu0g== --cluster ceph 2024-09-12T01:02:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:04.024 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:04.061 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.062+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.064+0000 7f2133a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.064+0000 7f2133a0f800 20 realm 2024-09-12T01:02:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.064+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.064+0000 7f2133a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.064+0000 7f2133a0f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:04.063 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.064+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.065+0000 7f2133a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.065+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.065+0000 7f2133a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.065+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.064 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.066+0000 7f2133a0f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:04.065 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.066+0000 7f2133a0f800 20 searching for the correct realm 2024-09-12T01:02:04.067 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.068+0000 7f21314f9640 0 -- 172.21.15.19:0/722156925 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f2124037040 msgr2=0x7f2124040900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:04.070 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.072+0000 7f21314f9640 0 -- 172.21.15.19:0/722156925 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f212c06a020 msgr2=0x7f212c0a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.279+0000 7f2133a0f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.279+0000 7f2133a0f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.279+0000 7f2133a0f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.279+0000 7f2133a0f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.279+0000 7f2133a0f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.279+0000 7f2133a0f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:04.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.279+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.280+0000 7f2133a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.280+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.280+0000 7f2133a0f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:04.279 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.280+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:04.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 20 zone default found 2024-09-12T01:02:04.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 4 Realm: () 2024-09-12T01:02:04.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:04.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:04.280 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:04.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 20 zonegroup default 2024-09-12T01:02:04.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.281+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.281 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.282+0000 7f2133a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.282+0000 7f2133a0f800 20 started sync module instance, tier type = 2024-09-12T01:02:04.282 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.282+0000 7f2133a0f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.292+0000 7f2133a0f800 20 add_watcher() i=0 2024-09-12T01:02:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.292+0000 7f2133a0f800 20 add_watcher() i=1 2024-09-12T01:02:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.292+0000 7f2133a0f800 20 add_watcher() i=2 2024-09-12T01:02:04.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.292+0000 7f2133a0f800 20 add_watcher() i=3 2024-09-12T01:02:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.292+0000 7f2133a0f800 20 add_watcher() i=4 2024-09-12T01:02:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.292+0000 7f2133a0f800 20 add_watcher() i=5 2024-09-12T01:02:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.292+0000 7f2133a0f800 20 add_watcher() i=6 2024-09-12T01:02:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.293+0000 7f2133a0f800 20 add_watcher() i=7 2024-09-12T01:02:04.291 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.293+0000 7f2133a0f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.294+0000 7f1fe77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.294+0000 7f2133a0f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.294+0000 7f2133a0f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f2133a0f800 5 note: GC not initialized 2024-09-12T01:02:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f1fe67e4640 20 reqs_thread_entry: start 2024-09-12T01:02:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f2133a0f800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f2133a0f800 20 Filter name: none 2024-09-12T01:02:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f1f57fff640 20 reqs_thread_entry: start 2024-09-12T01:02:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f2133a0f800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T01:02:04.294 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f2133a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f2133a0f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T01:02:04.295 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f2133a0f800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f2133a0f800 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.295+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.296+0000 7f2133a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.296+0000 7f2133a0f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.296+0000 7f2133a0f800 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.296+0000 7f2133a0f800 10 cache get: name=default.rgw.meta+users.keys+STUOZCRGWRXKTAMFWFDY : miss 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.296+0000 7f2133a0f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.296+0000 7f2133a0f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.296+0000 7f2133a0f800 10 cache put: name=default.rgw.meta+users.keys+STUOZCRGWRXKTAMFWFDY info.flags=0x0 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.296+0000 7f2133a0f800 10 adding default.rgw.meta+users.keys+STUOZCRGWRXKTAMFWFDY to cache LRU end 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.296+0000 7f2133a0f800 10 cache get: name=default.rgw.meta+users.keys+STUOZCRGWRXKTAMFWFDY : hit (negative entry) 2024-09-12T01:02:04.296 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.296+0000 7f2133a0f800 10 cache get: name=default.rgw.meta+users.keys+STUOZCRGWRXKTAMFWFDY : hit (negative entry) 2024-09-12T01:02:04.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.297+0000 7f2133a0f800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:02:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.297+0000 7f2133a0f800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:02:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.297+0000 7f2133a0f800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T01:02:04.300 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.298+0000 7f2014ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333705 cookie 94080995103424 notifier 8104 bl.length()=645 2024-09-12T01:02:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.298+0000 7f2014ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:02:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.298+0000 7f2014ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:02:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.301+0000 7f2133a0f800 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T01:02:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.301+0000 7f2133a0f800 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:02:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.301+0000 7f2133a0f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T01:02:04.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.301+0000 7f2014ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333710 cookie 94080995111904 notifier 8104 bl.length()=185 2024-09-12T01:02:04.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.301+0000 7f2014ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T01:02:04.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.301+0000 7f2014ff9640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T01:02:04.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.304+0000 7f2133a0f800 10 cache put: name=default.rgw.meta+users.keys+STUOZCRGWRXKTAMFWFDY info.flags=0x7 2024-09-12T01:02:04.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.304+0000 7f2133a0f800 10 moving default.rgw.meta+users.keys+STUOZCRGWRXKTAMFWFDY to cache LRU end 2024-09-12T01:02:04.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.304+0000 7f2133a0f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:STUOZCRGWRXKTAMFWFDY, ofs0, ns] 2024-09-12T01:02:04.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.304+0000 7f2003fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333711 cookie 94080995117904 notifier 8104 bl.length()=186 2024-09-12T01:02:04.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.304+0000 7f2003fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+STUOZCRGWRXKTAMFWFDY info.flags=0x7 2024-09-12T01:02:04.303 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.304+0000 7f2003fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+STUOZCRGWRXKTAMFWFDY to cache LRU end 2024-09-12T01:02:04.304 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:02:04.304 INFO:teuthology.orchestra.run.smithi019.stdout: "user_id": "bar.client.0", 2024-09-12T01:02:04.304 INFO:teuthology.orchestra.run.smithi019.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "bar+test@test.test", 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: "suspended": 0, 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: "subusers": [], 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: "keys": [ 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: "user": "bar.client.0", 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: "access_key": "STUOZCRGWRXKTAMFWFDY", 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: "secret_key": "ZyTDzyPP89qDie15gARhRO6rS1xzkOgZe5HB//eyWw9AUeSMvmyu0g==", 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: "active": true, 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:04.297318Z" 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T01:02:04.305 INFO:teuthology.orchestra.run.smithi019.stdout: "swift_keys": [], 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": [], 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "default_placement": "", 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "default_storage_class": "", 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "placement_tags": [], 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "user_quota": { 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:04.306 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: "temp_url_keys": [], 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "rgw", 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: "mfa_ids": [], 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: "account_id": "", 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:04.297307Z", 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: "group_ids": [] 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:02:04.307 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:02:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.307+0000 7f1fe77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.309+0000 7f2133a0f800 20 remove_watcher() i=0 2024-09-12T01:02:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.309+0000 7f2133a0f800 2 removed watcher, disabling cache 2024-09-12T01:02:04.308 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.310+0000 7f2133a0f800 20 remove_watcher() i=1 2024-09-12T01:02:04.309 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.311+0000 7f2133a0f800 20 remove_watcher() i=2 2024-09-12T01:02:04.310 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.312+0000 7f2133a0f800 20 remove_watcher() i=3 2024-09-12T01:02:04.311 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.313+0000 7f2133a0f800 20 remove_watcher() i=4 2024-09-12T01:02:04.313 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.314+0000 7f2133a0f800 20 remove_watcher() i=5 2024-09-12T01:02:04.314 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.315+0000 7f2133a0f800 20 remove_watcher() i=6 2024-09-12T01:02:04.315 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.316+0000 7f2133a0f800 20 remove_watcher() i=7 2024-09-12T01:02:04.327 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 7956937145 --totp-seed UWOYVOOBJZLOOWRJPAFLU25Q5NFDPRXXO2GXZSWESH3WNMUJIYJFL3U56U5QUG4D --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:02:04.396 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:04.397 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:04.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.434+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.436+0000 7f9517b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.436+0000 7f9517b75800 20 realm 2024-09-12T01:02:04.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.436+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.436+0000 7f9517b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.436+0000 7f9517b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:04.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.436+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.435 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.436+0000 7f9517b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.436+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.437+0000 7f9517b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:04.436 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.437+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.438+0000 7f9517b75800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:04.437 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.438+0000 7f9517b75800 20 searching for the correct realm 2024-09-12T01:02:04.439 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.441+0000 7f950ffff640 0 -- 172.21.15.19:0/1050466384 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f95000aa5d0 msgr2=0x7f95000e30b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:02:04.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.647+0000 7f9515e67640 0 -- 172.21.15.19:0/1050466384 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5635ba54cbb0 msgr2=0x5635ba54f020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:04.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.651+0000 7f9517b75800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:04.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.651+0000 7f9517b75800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:04.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.651+0000 7f9517b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:04.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.651+0000 7f9517b75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:04.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.651+0000 7f9517b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:04.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.651+0000 7f9517b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:04.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.651+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.651+0000 7f9517b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.651+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:04.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 20 zone default found 2024-09-12T01:02:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 4 Realm: () 2024-09-12T01:02:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:04.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 20 zonegroup default 2024-09-12T01:02:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.652+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.653+0000 7f9517b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.653+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.653+0000 7f9517b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.653+0000 7f9517b75800 20 started sync module instance, tier type = 2024-09-12T01:02:04.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.653+0000 7f9517b75800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:04.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.662+0000 7f9517b75800 20 add_watcher() i=0 2024-09-12T01:02:04.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.662+0000 7f9517b75800 20 add_watcher() i=1 2024-09-12T01:02:04.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.662+0000 7f9517b75800 20 add_watcher() i=2 2024-09-12T01:02:04.661 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.662+0000 7f9517b75800 20 add_watcher() i=3 2024-09-12T01:02:04.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.662+0000 7f9517b75800 20 add_watcher() i=4 2024-09-12T01:02:04.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.662+0000 7f9517b75800 20 add_watcher() i=5 2024-09-12T01:02:04.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.662+0000 7f9517b75800 20 add_watcher() i=6 2024-09-12T01:02:04.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.662+0000 7f9517b75800 20 add_watcher() i=7 2024-09-12T01:02:04.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.662+0000 7f9517b75800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:04.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.664+0000 7f93cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:04.665 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.664+0000 7f9517b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:04.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.664+0000 7f9517b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:04.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.665+0000 7f9517b75800 5 note: GC not initialized 2024-09-12T01:02:04.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.665+0000 7f93cafe5640 20 reqs_thread_entry: start 2024-09-12T01:02:04.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.665+0000 7f9517b75800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:04.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.665+0000 7f9517b75800 20 Filter name: none 2024-09-12T01:02:04.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.665+0000 7f93c8fe1640 20 reqs_thread_entry: start 2024-09-12T01:02:04.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.665+0000 7f9517b75800 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T01:02:04.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.665+0000 7f9517b75800 20 rados->read ofs=0 len=0 2024-09-12T01:02:04.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.666+0000 7f9517b75800 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T01:02:04.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.666+0000 7f9517b75800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T01:02:04.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.666+0000 7f9517b75800 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:02:04.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.666+0000 7f9517b75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:02:04.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.668+0000 7f9517b75800 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:02:04.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.668+0000 7f9517b75800 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:02:04.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.668+0000 7f9517b75800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T01:02:04.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.669+0000 7f93f8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333706 cookie 94788759430864 notifier 8438 bl.length()=659 2024-09-12T01:02:04.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.669+0000 7f93f8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T01:02:04.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.669+0000 7f93f8ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T01:02:04.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.671+0000 7f93cbfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:04.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.674+0000 7f9517b75800 20 remove_watcher() i=0 2024-09-12T01:02:04.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.674+0000 7f9517b75800 2 removed watcher, disabling cache 2024-09-12T01:02:04.673 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.675+0000 7f9517b75800 20 remove_watcher() i=1 2024-09-12T01:02:04.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.676+0000 7f9517b75800 20 remove_watcher() i=2 2024-09-12T01:02:04.675 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.677+0000 7f9517b75800 20 remove_watcher() i=3 2024-09-12T01:02:04.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.678+0000 7f9517b75800 20 remove_watcher() i=4 2024-09-12T01:02:04.677 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.679+0000 7f9517b75800 20 remove_watcher() i=5 2024-09-12T01:02:04.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.680+0000 7f9517b75800 20 remove_watcher() i=6 2024-09-12T01:02:04.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.681+0000 7f9517b75800 20 remove_watcher() i=7 2024-09-12T01:02:04.692 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-12T01:02:04.692 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key HULOJFEHJEYERQRCQPSS --secret m9yxVRkJqXtVqs1DGWqRfUqgeHVz8D4mZWxhXCA/+DgP+tv/4fM2iw== --cluster ceph 2024-09-12T01:02:04.759 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:04.759 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:04.981 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:04.982+0000 7f5167896640 0 --2- 172.21.15.19:0/744691223 >> [v2:172.21.15.19:3301/0,v1:172.21.15.19:6790/0] conn(0x55931cc9b060 0x55931cd872d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T01:02:05.004 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.005+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.007+0000 7f51725ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.007+0000 7f51725ad800 20 realm 2024-09-12T01:02:05.006 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.007+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.008+0000 7f51725ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.008+0000 7f51725ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:05.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.008+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.008+0000 7f51725ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.008+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.009+0000 7f51725ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:05.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.009+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.009+0000 7f51725ad800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:05.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.009+0000 7f51725ad800 20 searching for the correct realm 2024-09-12T01:02:05.010 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.011+0000 7f5170097640 0 -- 172.21.15.19:0/1762974565 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x55931cde2880 msgr2=0x55931cde4cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:05.017 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.019+0000 7f5170898640 0 -- 172.21.15.19:0/1762974565 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7f516003fb80 msgr2=0x7f5160082a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:02:05.235 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.236+0000 7f51725ad800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:05.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.236+0000 7f51725ad800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:05.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.236+0000 7f51725ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:05.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.236+0000 7f51725ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:05.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.236+0000 7f51725ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:05.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.236+0000 7f51725ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:05.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.236+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.237+0000 7f51725ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.236 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.237+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.237+0000 7f51725ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.237+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 20 zone default found 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 4 Realm: () 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 20 zonegroup default 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.238 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 20 started sync module instance, tier type = 2024-09-12T01:02:05.239 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.238+0000 7f51725ad800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:05.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.248+0000 7f51725ad800 20 add_watcher() i=0 2024-09-12T01:02:05.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.248+0000 7f51725ad800 20 add_watcher() i=1 2024-09-12T01:02:05.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.248+0000 7f51725ad800 20 add_watcher() i=2 2024-09-12T01:02:05.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.248+0000 7f51725ad800 20 add_watcher() i=3 2024-09-12T01:02:05.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.248+0000 7f51725ad800 20 add_watcher() i=4 2024-09-12T01:02:05.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.248+0000 7f51725ad800 20 add_watcher() i=5 2024-09-12T01:02:05.247 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.248+0000 7f51725ad800 20 add_watcher() i=6 2024-09-12T01:02:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.249+0000 7f51725ad800 20 add_watcher() i=7 2024-09-12T01:02:05.248 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.249+0000 7f51725ad800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.251+0000 7f5026fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.252+0000 7f51725ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.252+0000 7f51725ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.252+0000 7f51725ad800 5 note: GC not initialized 2024-09-12T01:02:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.252+0000 7f5025fdb640 20 reqs_thread_entry: start 2024-09-12T01:02:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.252+0000 7f51725ad800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.252+0000 7f51725ad800 20 Filter name: none 2024-09-12T01:02:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.252+0000 7f4f977fe640 20 reqs_thread_entry: start 2024-09-12T01:02:05.251 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.252+0000 7f51725ad800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T01:02:05.252 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.252+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T01:02:05.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:02:05.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T01:02:05.253 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T01:02:05.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:02:05.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 10 cache get: name=default.rgw.meta+users.keys+HULOJFEHJEYERQRCQPSS : miss 2024-09-12T01:02:05.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 10 cache put: name=default.rgw.meta+users.keys+HULOJFEHJEYERQRCQPSS info.flags=0x0 2024-09-12T01:02:05.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 10 adding default.rgw.meta+users.keys+HULOJFEHJEYERQRCQPSS to cache LRU end 2024-09-12T01:02:05.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 10 cache get: name=default.rgw.meta+users.keys+HULOJFEHJEYERQRCQPSS : hit (negative entry) 2024-09-12T01:02:05.254 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.253+0000 7f51725ad800 10 cache get: name=default.rgw.meta+users.keys+HULOJFEHJEYERQRCQPSS : hit (negative entry) 2024-09-12T01:02:05.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.255+0000 7f51725ad800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:02:05.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.255+0000 7f51725ad800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:02:05.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.255+0000 7f51725ad800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T01:02:05.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.255+0000 7f50477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301008 cookie 94090332921504 notifier 8456 bl.length()=719 2024-09-12T01:02:05.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.255+0000 7f50477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:02:05.255 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.255+0000 7f50477fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:02:05.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.258+0000 7f51725ad800 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T01:02:05.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.258+0000 7f51725ad800 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:02:05.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.258+0000 7f51725ad800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T01:02:05.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.258+0000 7f50477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301009 cookie 94090332926976 notifier 8456 bl.length()=215 2024-09-12T01:02:05.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.258+0000 7f50477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T01:02:05.257 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.258+0000 7f50477fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T01:02:05.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.261+0000 7f51725ad800 10 cache put: name=default.rgw.meta+users.keys+HULOJFEHJEYERQRCQPSS info.flags=0x7 2024-09-12T01:02:05.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.261+0000 7f51725ad800 10 moving default.rgw.meta+users.keys+HULOJFEHJEYERQRCQPSS to cache LRU end 2024-09-12T01:02:05.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.261+0000 7f51725ad800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:HULOJFEHJEYERQRCQPSS, ofs0, ns] 2024-09-12T01:02:05.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.261+0000 7f50477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301010 cookie 94090332923520 notifier 8456 bl.length()=201 2024-09-12T01:02:05.260 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.261+0000 7f50477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+HULOJFEHJEYERQRCQPSS info.flags=0x7 2024-09-12T01:02:05.261 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.261+0000 7f50477fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+HULOJFEHJEYERQRCQPSS to cache LRU end 2024-09-12T01:02:05.261 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:02:05.261 INFO:teuthology.orchestra.run.smithi019.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T01:02:05.262 INFO:teuthology.orchestra.run.smithi019.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-12T01:02:05.262 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T01:02:05.262 INFO:teuthology.orchestra.run.smithi019.stdout: "suspended": 0, 2024-09-12T01:02:05.262 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T01:02:05.262 INFO:teuthology.orchestra.run.smithi019.stdout: "subusers": [], 2024-09-12T01:02:05.262 INFO:teuthology.orchestra.run.smithi019.stdout: "keys": [ 2024-09-12T01:02:05.262 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:02:05.262 INFO:teuthology.orchestra.run.smithi019.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T01:02:05.262 INFO:teuthology.orchestra.run.smithi019.stdout: "access_key": "HULOJFEHJEYERQRCQPSS", 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "secret_key": "m9yxVRkJqXtVqs1DGWqRfUqgeHVz8D4mZWxhXCA/+DgP+tv/4fM2iw==", 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "active": true, 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:05.254460Z" 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "swift_keys": [], 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": [], 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "default_placement": "", 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "default_storage_class": "", 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "placement_tags": [], 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:05.263 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: "user_quota": { 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: "temp_url_keys": [], 2024-09-12T01:02:05.264 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "rgw", 2024-09-12T01:02:05.265 INFO:teuthology.orchestra.run.smithi019.stdout: "mfa_ids": [], 2024-09-12T01:02:05.265 INFO:teuthology.orchestra.run.smithi019.stdout: "account_id": "", 2024-09-12T01:02:05.265 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-12T01:02:05.265 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:05.254444Z", 2024-09-12T01:02:05.265 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-12T01:02:05.265 INFO:teuthology.orchestra.run.smithi019.stdout: "group_ids": [] 2024-09-12T01:02:05.265 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:02:05.265 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:02:05.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.263+0000 7f5026fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:05.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.266+0000 7f51725ad800 20 remove_watcher() i=0 2024-09-12T01:02:05.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.266+0000 7f51725ad800 2 removed watcher, disabling cache 2024-09-12T01:02:05.266 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.267+0000 7f51725ad800 20 remove_watcher() i=1 2024-09-12T01:02:05.267 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.268+0000 7f51725ad800 20 remove_watcher() i=2 2024-09-12T01:02:05.268 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.269+0000 7f51725ad800 20 remove_watcher() i=3 2024-09-12T01:02:05.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.270+0000 7f51725ad800 20 remove_watcher() i=4 2024-09-12T01:02:05.270 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.271+0000 7f51725ad800 20 remove_watcher() i=5 2024-09-12T01:02:05.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.272+0000 7f51725ad800 20 remove_watcher() i=6 2024-09-12T01:02:05.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.273+0000 7f51725ad800 20 remove_watcher() i=7 2024-09-12T01:02:05.284 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 1726654327 --totp-seed ZHNU5UUWT3DQBQ4TTA3LQST3HIEODMJX5ULGFHQXZZKQTFWIXIYTZKR2XHS5D2MQ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:02:05.352 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:05.353 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:05.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.391+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.392+0000 7fc1c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.392+0000 7fc1c102f800 20 realm 2024-09-12T01:02:05.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.392+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.391 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.392+0000 7fc1c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.392+0000 7fc1c102f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.392+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.392+0000 7fc1c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.392+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.392 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.393+0000 7fc1c102f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:05.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.393+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.394+0000 7fc1c102f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:05.393 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.394+0000 7fc1c102f800 20 searching for the correct realm 2024-09-12T01:02:05.394 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.395+0000 7fc1bf321640 0 -- 172.21.15.19:0/2226980870 >> [v2:172.21.15.19:6800/3407245840,v1:172.21.15.19:6801/3407245840] conn(0x7fc1ac0030f0 msgr2=0x7fc1a803c950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:05.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.399+0000 7fc1beb20640 0 -- 172.21.15.19:0/2226980870 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x5628e78b0860 msgr2=0x5628e78b2c90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:05.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.404+0000 7fc1c102f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:05.403 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.404+0000 7fc1c102f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:05.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.404+0000 7fc1c102f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:05.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.404+0000 7fc1c102f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:05.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.404+0000 7fc1c102f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:05.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.404+0000 7fc1c102f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:05.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.404+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 20 zone default found 2024-09-12T01:02:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 4 Realm: () 2024-09-12T01:02:05.405 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 20 zonegroup default 2024-09-12T01:02:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.405+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.406+0000 7fc1c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.406+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.406+0000 7fc1c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.406+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.406+0000 7fc1c102f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.406+0000 7fc1c102f800 20 started sync module instance, tier type = 2024-09-12T01:02:05.406 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.406+0000 7fc1c102f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.415+0000 7fc1c102f800 20 add_watcher() i=0 2024-09-12T01:02:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.415+0000 7fc1c102f800 20 add_watcher() i=1 2024-09-12T01:02:05.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.415+0000 7fc1c102f800 20 add_watcher() i=2 2024-09-12T01:02:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.415+0000 7fc1c102f800 20 add_watcher() i=3 2024-09-12T01:02:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.415+0000 7fc1c102f800 20 add_watcher() i=4 2024-09-12T01:02:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.415+0000 7fc1c102f800 20 add_watcher() i=5 2024-09-12T01:02:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.415+0000 7fc1c102f800 20 add_watcher() i=6 2024-09-12T01:02:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.416+0000 7fc1c102f800 20 add_watcher() i=7 2024-09-12T01:02:05.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.416+0000 7fc1c102f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.418+0000 7fc0757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.418+0000 7fc1c102f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.418+0000 7fc1c102f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.418+0000 7fc1c102f800 5 note: GC not initialized 2024-09-12T01:02:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.419+0000 7fbfeffff640 20 reqs_thread_entry: start 2024-09-12T01:02:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.419+0000 7fc1c102f800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.419+0000 7fc1c102f800 20 Filter name: none 2024-09-12T01:02:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.419+0000 7fbfedffb640 20 reqs_thread_entry: start 2024-09-12T01:02:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.419+0000 7fc1c102f800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T01:02:05.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.419+0000 7fc1c102f800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.420+0000 7fc1c102f800 20 rados_obj.operate() r=0 bl.length=519 2024-09-12T01:02:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.420+0000 7fc1c102f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T01:02:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.420+0000 7fc1c102f800 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:02:05.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.420+0000 7fc1c102f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:02:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.422+0000 7fc1c102f800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:02:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.422+0000 7fc1c102f800 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:02:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.422+0000 7fc1c102f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T01:02:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.423+0000 7fc0a27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301011 cookie 94733683380816 notifier 9111 bl.length()=733 2024-09-12T01:02:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.423+0000 7fc0a27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T01:02:05.421 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.423+0000 7fc0a27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T01:02:05.423 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.425+0000 7fc0757e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:05.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.427+0000 7fc1c102f800 20 remove_watcher() i=0 2024-09-12T01:02:05.426 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.427+0000 7fc1c102f800 2 removed watcher, disabling cache 2024-09-12T01:02:05.427 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.428+0000 7fc1c102f800 20 remove_watcher() i=1 2024-09-12T01:02:05.428 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.429+0000 7fc1c102f800 20 remove_watcher() i=2 2024-09-12T01:02:05.429 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.431+0000 7fc1c102f800 20 remove_watcher() i=3 2024-09-12T01:02:05.430 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.432+0000 7fc1c102f800 20 remove_watcher() i=4 2024-09-12T01:02:05.431 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.433+0000 7fc1c102f800 20 remove_watcher() i=5 2024-09-12T01:02:05.432 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.434+0000 7fc1c102f800 20 remove_watcher() i=6 2024-09-12T01:02:05.433 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.435+0000 7fc1c102f800 20 remove_watcher() i=7 2024-09-12T01:02:05.446 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T01:02:05.446 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key CTSDNDFUJLNSZUPTEWIJ --secret HK0aVnOyiPoGc8T5oJEu/yzAPlhVG7bEMxKpjXng+xb2luozqhnZzA== --cluster ceph 2024-09-12T01:02:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:05.512 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:05.548 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.549+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.551+0000 7f897610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.551+0000 7f897610c800 20 realm 2024-09-12T01:02:05.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.551+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.551+0000 7f897610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.550 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.551+0000 7f897610c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:05.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.551+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.551+0000 7f897610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.551+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.552+0000 7f897610c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:05.551 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.552+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.553+0000 7f897610c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:05.552 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.553+0000 7f897610c800 20 searching for the correct realm 2024-09-12T01:02:05.555 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.556+0000 7f89733f5640 0 -- 172.21.15.19:0/1685687260 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f8968069b50 msgr2=0x7f89680962c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:05.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.761+0000 7f89743f7640 0 -- 172.21.15.19:0/1685687260 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55d54808ae30 msgr2=0x55d54808d2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.765+0000 7f897610c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.765+0000 7f897610c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.765+0000 7f897610c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:05.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.765+0000 7f897610c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:05.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.765+0000 7f897610c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:05.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.765+0000 7f897610c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:05.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.765+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:05.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 20 zone default found 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 4 Realm: () 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 20 zonegroup default 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.766+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.767+0000 7f897610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.767+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.767+0000 7f897610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.767+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.767+0000 7f897610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.767+0000 7f897610c800 20 started sync module instance, tier type = 2024-09-12T01:02:05.767 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.767+0000 7f897610c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:05.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.777+0000 7f897610c800 20 add_watcher() i=0 2024-09-12T01:02:05.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.777+0000 7f897610c800 20 add_watcher() i=1 2024-09-12T01:02:05.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.777+0000 7f897610c800 20 add_watcher() i=2 2024-09-12T01:02:05.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.777+0000 7f897610c800 20 add_watcher() i=3 2024-09-12T01:02:05.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.777+0000 7f897610c800 20 add_watcher() i=4 2024-09-12T01:02:05.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.777+0000 7f897610c800 20 add_watcher() i=5 2024-09-12T01:02:05.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.777+0000 7f897610c800 20 add_watcher() i=6 2024-09-12T01:02:05.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.778+0000 7f897610c800 20 add_watcher() i=7 2024-09-12T01:02:05.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.778+0000 7f897610c800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:05.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.780+0000 7f882a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:05.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.780+0000 7f897610c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:05.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.780+0000 7f897610c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:05.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.780+0000 7f897610c800 5 note: GC not initialized 2024-09-12T01:02:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.780+0000 7f88297e2640 20 reqs_thread_entry: start 2024-09-12T01:02:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.780+0000 7f897610c800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.780+0000 7f897610c800 20 Filter name: none 2024-09-12T01:02:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.780+0000 7f88227fc640 20 reqs_thread_entry: start 2024-09-12T01:02:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.780+0000 7f897610c800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:02:05.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.780+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.781+0000 7f897610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.781+0000 7f897610c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T01:02:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.781+0000 7f897610c800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:02:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.781+0000 7f897610c800 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T01:02:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.781+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.781+0000 7f897610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.781+0000 7f897610c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T01:02:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.781+0000 7f897610c800 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:02:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.781+0000 7f897610c800 10 cache get: name=default.rgw.meta+users.keys+CTSDNDFUJLNSZUPTEWIJ : miss 2024-09-12T01:02:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.781+0000 7f897610c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.782+0000 7f897610c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.782+0000 7f897610c800 10 cache put: name=default.rgw.meta+users.keys+CTSDNDFUJLNSZUPTEWIJ info.flags=0x0 2024-09-12T01:02:05.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.782+0000 7f897610c800 10 adding default.rgw.meta+users.keys+CTSDNDFUJLNSZUPTEWIJ to cache LRU end 2024-09-12T01:02:05.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.782+0000 7f897610c800 10 cache get: name=default.rgw.meta+users.keys+CTSDNDFUJLNSZUPTEWIJ : hit (negative entry) 2024-09-12T01:02:05.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.782+0000 7f897610c800 10 cache get: name=default.rgw.meta+users.keys+CTSDNDFUJLNSZUPTEWIJ : hit (negative entry) 2024-09-12T01:02:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.783+0000 7f897610c800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:02:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.783+0000 7f897610c800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:02:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.783+0000 7f897610c800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:02:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.784+0000 7f8852ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301012 cookie 94374524985088 notifier 8489 bl.length()=660 2024-09-12T01:02:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.784+0000 7f8852ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:02:05.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.784+0000 7f8852ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:02:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.786+0000 7f897610c800 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T01:02:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.786+0000 7f897610c800 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:02:05.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.786+0000 7f897610c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T01:02:05.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.787+0000 7f8852ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301003 cookie 94374524974304 notifier 8489 bl.length()=191 2024-09-12T01:02:05.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.787+0000 7f8852ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T01:02:05.786 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.787+0000 7f8852ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T01:02:05.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.789+0000 7f897610c800 10 cache put: name=default.rgw.meta+users.keys+CTSDNDFUJLNSZUPTEWIJ info.flags=0x7 2024-09-12T01:02:05.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.789+0000 7f897610c800 10 moving default.rgw.meta+users.keys+CTSDNDFUJLNSZUPTEWIJ to cache LRU end 2024-09-12T01:02:05.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.789+0000 7f897610c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:CTSDNDFUJLNSZUPTEWIJ, ofs0, ns] 2024-09-12T01:02:05.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.789+0000 7f88527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300843 cookie 94374524976944 notifier 8489 bl.length()=189 2024-09-12T01:02:05.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.789+0000 7f88527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+CTSDNDFUJLNSZUPTEWIJ info.flags=0x7 2024-09-12T01:02:05.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.789+0000 7f88527fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+CTSDNDFUJLNSZUPTEWIJ to cache LRU end 2024-09-12T01:02:05.789 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "user_id": "foobar.client.0", 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "foobar+test@test.test", 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "suspended": 0, 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "subusers": [], 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "keys": [ 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "user": "foobar.client.0", 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "access_key": "CTSDNDFUJLNSZUPTEWIJ", 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "secret_key": "HK0aVnOyiPoGc8T5oJEu/yzAPlhVG7bEMxKpjXng+xb2luozqhnZzA==", 2024-09-12T01:02:05.790 INFO:teuthology.orchestra.run.smithi019.stdout: "active": true, 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:05.782873Z" 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "swift_keys": [], 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": [], 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "default_placement": "", 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "default_storage_class": "", 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "placement_tags": [], 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:05.791 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "user_quota": { 2024-09-12T01:02:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:05.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "temp_url_keys": [], 2024-09-12T01:02:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "rgw", 2024-09-12T01:02:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "mfa_ids": [], 2024-09-12T01:02:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "account_id": "", 2024-09-12T01:02:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-12T01:02:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:05.782855Z", 2024-09-12T01:02:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-12T01:02:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: "group_ids": [] 2024-09-12T01:02:05.793 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:02:05.793 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:02:05.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.792+0000 7f882a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:05.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.794+0000 7f897610c800 20 remove_watcher() i=0 2024-09-12T01:02:05.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.794+0000 7f897610c800 2 removed watcher, disabling cache 2024-09-12T01:02:05.794 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.796+0000 7f897610c800 20 remove_watcher() i=1 2024-09-12T01:02:05.795 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.797+0000 7f897610c800 20 remove_watcher() i=2 2024-09-12T01:02:05.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.798+0000 7f897610c800 20 remove_watcher() i=3 2024-09-12T01:02:05.797 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.799+0000 7f897610c800 20 remove_watcher() i=4 2024-09-12T01:02:05.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.800+0000 7f897610c800 20 remove_watcher() i=5 2024-09-12T01:02:05.799 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.801+0000 7f897610c800 20 remove_watcher() i=6 2024-09-12T01:02:05.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.802+0000 7f897610c800 20 remove_watcher() i=7 2024-09-12T01:02:05.813 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 1774269134 --totp-seed BKQ2VANBNMKALE7DJVKVJVC3E6ALQFZQWTU6CRDR45II22DGTVC3QC27NE2IGIAE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:02:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:05.881 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:05.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.919+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.921+0000 7fe6aa339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.921+0000 7fe6aa339800 20 realm 2024-09-12T01:02:05.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.921+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.921+0000 7fe6aa339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.921+0000 7fe6aa339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.921+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.922+0000 7fe6aa339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.922+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.922+0000 7fe6aa339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:05.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.922+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:05.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.923+0000 7fe6aa339800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:05.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.923+0000 7fe6aa339800 20 searching for the correct realm 2024-09-12T01:02:05.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:05.926+0000 7fe6a57c6640 0 -- 172.21.15.19:0/2152451053 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fe69c001c20 msgr2=0x7fe69c066860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:06.129 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.131+0000 7fe6a67c8640 0 -- 172.21.15.19:0/2152451053 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55afc64196f0 msgr2=0x55afc641bbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:06.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.135+0000 7fe6aa339800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:06.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.135+0000 7fe6aa339800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:06.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.135+0000 7fe6aa339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:06.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.135+0000 7fe6aa339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:06.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.135+0000 7fe6aa339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:06.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.135+0000 7fe6aa339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:06.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.135+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.135+0000 7fe6aa339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.135+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.135+0000 7fe6aa339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.135+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 20 zone default found 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 4 Realm: () 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 20 zonegroup default 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.136 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.136+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.137+0000 7fe6aa339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.137+0000 7fe6aa339800 20 started sync module instance, tier type = 2024-09-12T01:02:06.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.137+0000 7fe6aa339800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:06.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.145+0000 7fe6aa339800 20 add_watcher() i=0 2024-09-12T01:02:06.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.145+0000 7fe6aa339800 20 add_watcher() i=1 2024-09-12T01:02:06.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.145+0000 7fe6aa339800 20 add_watcher() i=2 2024-09-12T01:02:06.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.145+0000 7fe6aa339800 20 add_watcher() i=3 2024-09-12T01:02:06.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.145+0000 7fe6aa339800 20 add_watcher() i=4 2024-09-12T01:02:06.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.145+0000 7fe6aa339800 20 add_watcher() i=5 2024-09-12T01:02:06.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.145+0000 7fe6aa339800 20 add_watcher() i=6 2024-09-12T01:02:06.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.146+0000 7fe6aa339800 20 add_watcher() i=7 2024-09-12T01:02:06.145 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.146+0000 7fe6aa339800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:06.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.148+0000 7fe557fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:06.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.148+0000 7fe6aa339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:06.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.148+0000 7fe6aa339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:06.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.148+0000 7fe6aa339800 5 note: GC not initialized 2024-09-12T01:02:06.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.148+0000 7fe556ffd640 20 reqs_thread_entry: start 2024-09-12T01:02:06.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.148+0000 7fe6aa339800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:06.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.148+0000 7fe6aa339800 20 Filter name: none 2024-09-12T01:02:06.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.148+0000 7fe554ff9640 20 reqs_thread_entry: start 2024-09-12T01:02:06.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.149+0000 7fe6aa339800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:02:06.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.149+0000 7fe6aa339800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.149+0000 7fe6aa339800 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T01:02:06.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.149+0000 7fe6aa339800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T01:02:06.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.149+0000 7fe6aa339800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:02:06.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.149+0000 7fe6aa339800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:02:06.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.152+0000 7fe6aa339800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:02:06.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.152+0000 7fe6aa339800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:02:06.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.152+0000 7fe6aa339800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:02:06.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.152+0000 7fe5897fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301013 cookie 94213433892736 notifier 8507 bl.length()=674 2024-09-12T01:02:06.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.152+0000 7fe5897fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:02:06.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.152+0000 7fe5897fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:02:06.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.155+0000 7fe557fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:06.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.157+0000 7fe6aa339800 20 remove_watcher() i=0 2024-09-12T01:02:06.155 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.157+0000 7fe6aa339800 2 removed watcher, disabling cache 2024-09-12T01:02:06.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.158+0000 7fe6aa339800 20 remove_watcher() i=1 2024-09-12T01:02:06.157 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.159+0000 7fe6aa339800 20 remove_watcher() i=2 2024-09-12T01:02:06.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.160+0000 7fe6aa339800 20 remove_watcher() i=3 2024-09-12T01:02:06.159 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.161+0000 7fe6aa339800 20 remove_watcher() i=4 2024-09-12T01:02:06.161 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.162+0000 7fe6aa339800 20 remove_watcher() i=5 2024-09-12T01:02:06.162 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.163+0000 7fe6aa339800 20 remove_watcher() i=6 2024-09-12T01:02:06.163 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.164+0000 7fe6aa339800 20 remove_watcher() i=7 2024-09-12T01:02:06.175 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T01:02:06.236 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:06.236 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:06.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.274+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.276+0000 7fca73611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.276+0000 7fca73611800 20 realm 2024-09-12T01:02:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.276+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.276+0000 7fca73611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.276+0000 7fca73611800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.276+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.276+0000 7fca73611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.275 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.276+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.277+0000 7fca73611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.277+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.277+0000 7fca73611800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:06.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.277+0000 7fca73611800 20 searching for the correct realm 2024-09-12T01:02:06.278 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.280+0000 7fca6e547640 0 -- 172.21.15.19:0/1761684379 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fca640e0040 msgr2=0x7fca64056810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:02:06.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.486+0000 7fca6f549640 0 -- 172.21.15.19:0/1761684379 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55b78db5af60 msgr2=0x55b78db5d3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:06.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.490+0000 7fca73611800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:06.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.490+0000 7fca73611800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:06.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.490+0000 7fca73611800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:06.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.490+0000 7fca73611800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:06.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.490+0000 7fca73611800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:06.489 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.490+0000 7fca73611800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:06.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.490+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.490+0000 7fca73611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.490 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.490+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:06.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:06.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 20 zone default found 2024-09-12T01:02:06.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 4 Realm: () 2024-09-12T01:02:06.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:06.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:06.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:06.491 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 20 zonegroup default 2024-09-12T01:02:06.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.491+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.492+0000 7fca73611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.492+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.492+0000 7fca73611800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.492+0000 7fca73611800 20 started sync module instance, tier type = 2024-09-12T01:02:06.492 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.492+0000 7fca73611800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.502+0000 7fca73611800 20 add_watcher() i=0 2024-09-12T01:02:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.502+0000 7fca73611800 20 add_watcher() i=1 2024-09-12T01:02:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.502+0000 7fca73611800 20 add_watcher() i=2 2024-09-12T01:02:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.502+0000 7fca73611800 20 add_watcher() i=3 2024-09-12T01:02:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.502+0000 7fca73611800 20 add_watcher() i=4 2024-09-12T01:02:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.502+0000 7fca73611800 20 add_watcher() i=5 2024-09-12T01:02:06.501 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.502+0000 7fca73611800 20 add_watcher() i=6 2024-09-12T01:02:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.503+0000 7fca73611800 20 add_watcher() i=7 2024-09-12T01:02:06.502 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.503+0000 7fca73611800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.504+0000 7fc9257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.505+0000 7fca73611800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.505+0000 7fca73611800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.505+0000 7fca73611800 5 note: GC not initialized 2024-09-12T01:02:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.505+0000 7fc89ffff640 20 reqs_thread_entry: start 2024-09-12T01:02:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.505+0000 7fca73611800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:06.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.505+0000 7fca73611800 20 Filter name: none 2024-09-12T01:02:06.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.505+0000 7fc89dffb640 20 reqs_thread_entry: start 2024-09-12T01:02:06.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.505+0000 7fca73611800 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T01:02:06.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.505+0000 7fca73611800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.506+0000 7fca73611800 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T01:02:06.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.506+0000 7fca73611800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T01:02:06.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.506+0000 7fca73611800 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:02:06.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.506+0000 7fca73611800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:02:06.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.507+0000 7fca73611800 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:02:06.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.507+0000 7fca73611800 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:02:06.506 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.507+0000 7fca73611800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T01:02:06.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.507+0000 7fc9527fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301014 cookie 94246844941840 notifier 9162 bl.length()=727 2024-09-12T01:02:06.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.507+0000 7fc9527fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T01:02:06.507 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.507+0000 7fc9527fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T01:02:06.508 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:02:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "user_id": "foobar.client.0", 2024-09-12T01:02:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T01:02:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "foobar+test@test.test", 2024-09-12T01:02:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "suspended": 0, 2024-09-12T01:02:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T01:02:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "subusers": [], 2024-09-12T01:02:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: "keys": [ 2024-09-12T01:02:06.508 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "user": "foobar.client.0", 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "access_key": "CTSDNDFUJLNSZUPTEWIJ", 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "secret_key": "HK0aVnOyiPoGc8T5oJEu/yzAPlhVG7bEMxKpjXng+xb2luozqhnZzA==", 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "active": true, 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:05.782873Z" 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "swift_keys": [], 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": [ 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "oidc-provider", 2024-09-12T01:02:06.509 INFO:teuthology.orchestra.run.smithi019.stdout: "perm": "*" 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "roles", 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "perm": "*" 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "user-policy", 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "perm": "*" 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "default_placement": "", 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "default_storage_class": "", 2024-09-12T01:02:06.510 INFO:teuthology.orchestra.run.smithi019.stdout: "placement_tags": [], 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "user_quota": { 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:06.511 INFO:teuthology.orchestra.run.smithi019.stdout: "temp_url_keys": [], 2024-09-12T01:02:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "rgw", 2024-09-12T01:02:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "mfa_ids": [ 2024-09-12T01:02:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "1774269134" 2024-09-12T01:02:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T01:02:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "account_id": "", 2024-09-12T01:02:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-12T01:02:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:05.782855Z", 2024-09-12T01:02:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-12T01:02:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: "group_ids": [] 2024-09-12T01:02:06.512 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:02:06.512 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:02:06.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.510+0000 7fc9257e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:06.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.512+0000 7fca73611800 20 remove_watcher() i=0 2024-09-12T01:02:06.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.512+0000 7fca73611800 2 removed watcher, disabling cache 2024-09-12T01:02:06.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.513+0000 7fca73611800 20 remove_watcher() i=1 2024-09-12T01:02:06.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.514+0000 7fca73611800 20 remove_watcher() i=2 2024-09-12T01:02:06.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.515+0000 7fca73611800 20 remove_watcher() i=3 2024-09-12T01:02:06.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.516+0000 7fca73611800 20 remove_watcher() i=4 2024-09-12T01:02:06.516 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.517+0000 7fca73611800 20 remove_watcher() i=5 2024-09-12T01:02:06.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.518+0000 7fca73611800 20 remove_watcher() i=6 2024-09-12T01:02:06.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.519+0000 7fca73611800 20 remove_watcher() i=7 2024-09-12T01:02:06.530 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T01:02:06.592 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:06.592 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:06.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.629+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.631+0000 7fcb8cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.631+0000 7fcb8cdaf800 20 realm 2024-09-12T01:02:06.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.631+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.631+0000 7fcb8cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.631+0000 7fcb8cdaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:06.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.631+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.631+0000 7fcb8cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.631+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.632+0000 7fcb8cdaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:06.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.632+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.632+0000 7fcb8cdaf800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:06.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.632+0000 7fcb8cdaf800 20 searching for the correct realm 2024-09-12T01:02:06.633 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.634+0000 7fcb8a899640 0 -- 172.21.15.19:0/2265566465 >> [v2:172.21.15.19:6805/977330370,v1:172.21.15.19:6807/977330370] conn(0x555ef2e8c2a0 msgr2=0x555ef2e8e6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:06.636 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.637+0000 7fcb8b09a640 0 -- 172.21.15.19:0/2265566465 >> [v2:172.21.15.135:6816/3292274812,v1:172.21.15.135:6817/3292274812] conn(0x7fcb7c085b00 msgr2=0x7fcb7c0719d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.844 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:06.845 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.845+0000 7fcb8cdaf800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 20 zone default found 2024-09-12T01:02:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 4 Realm: () 2024-09-12T01:02:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 20 zonegroup default 2024-09-12T01:02:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.846 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 20 started sync module instance, tier type = 2024-09-12T01:02:06.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.846+0000 7fcb8cdaf800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:06.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.855+0000 7fcb8cdaf800 20 add_watcher() i=0 2024-09-12T01:02:06.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.855+0000 7fcb8cdaf800 20 add_watcher() i=1 2024-09-12T01:02:06.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.855+0000 7fcb8cdaf800 20 add_watcher() i=2 2024-09-12T01:02:06.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.855+0000 7fcb8cdaf800 20 add_watcher() i=3 2024-09-12T01:02:06.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.855+0000 7fcb8cdaf800 20 add_watcher() i=4 2024-09-12T01:02:06.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.855+0000 7fcb8cdaf800 20 add_watcher() i=5 2024-09-12T01:02:06.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.855+0000 7fcb8cdaf800 20 add_watcher() i=6 2024-09-12T01:02:06.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.856+0000 7fcb8cdaf800 20 add_watcher() i=7 2024-09-12T01:02:06.855 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.856+0000 7fcb8cdaf800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.858+0000 7fca417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.858+0000 7fcb8cdaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.858+0000 7fcb8cdaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:06.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.858+0000 7fcb8cdaf800 5 note: GC not initialized 2024-09-12T01:02:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.858+0000 7fc9bbfff640 20 reqs_thread_entry: start 2024-09-12T01:02:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.858+0000 7fcb8cdaf800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.858+0000 7fcb8cdaf800 20 Filter name: none 2024-09-12T01:02:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fc9b9ffb640 20 reqs_thread_entry: start 2024-09-12T01:02:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T01:02:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.858 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T01:02:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:02:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T01:02:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T01:02:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 20 rados->read ofs=0 len=0 2024-09-12T01:02:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T01:02:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:02:06.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.859+0000 7fcb8cdaf800 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T01:02:06.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.861+0000 7fcb8cdaf800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:02:06.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.861+0000 7fcb8cdaf800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:02:06.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.861+0000 7fcb8cdaf800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T01:02:06.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.861+0000 7fca6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301004 cookie 93866290663168 notifier 8540 bl.length()=384 2024-09-12T01:02:06.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.861+0000 7fca6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:02:06.860 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.861+0000 7fca6e7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:02:06.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.864+0000 7fcb8cdaf800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T01:02:06.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.864+0000 7fcb8cdaf800 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:02:06.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.864+0000 7fcb8cdaf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T01:02:06.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.864+0000 7fca6e7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301005 cookie 93866290671008 notifier 8540 bl.length()=225 2024-09-12T01:02:06.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.864+0000 7fca6e7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T01:02:06.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.864+0000 7fca6e7fc640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T01:02:06.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.866+0000 7fcb8cdaf800 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T01:02:06.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.866+0000 7fcb8cdaf800 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:02:06.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.866+0000 7fcb8cdaf800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T01:02:06.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.867+0000 7fca6dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300845 cookie 93866290666944 notifier 8540 bl.length()=234 2024-09-12T01:02:06.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.867+0000 7fca6dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T01:02:06.866 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.867+0000 7fca6dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T01:02:06.867 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.869+0000 7fca417e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:06.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.871+0000 7fcb8cdaf800 20 remove_watcher() i=0 2024-09-12T01:02:06.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.871+0000 7fcb8cdaf800 2 removed watcher, disabling cache 2024-09-12T01:02:06.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.872+0000 7fcb8cdaf800 20 remove_watcher() i=1 2024-09-12T01:02:06.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.873+0000 7fcb8cdaf800 20 remove_watcher() i=2 2024-09-12T01:02:06.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.874+0000 7fcb8cdaf800 20 remove_watcher() i=3 2024-09-12T01:02:06.873 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.875+0000 7fcb8cdaf800 20 remove_watcher() i=4 2024-09-12T01:02:06.874 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.876+0000 7fcb8cdaf800 20 remove_watcher() i=5 2024-09-12T01:02:06.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.877+0000 7fcb8cdaf800 20 remove_watcher() i=6 2024-09-12T01:02:06.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:06.878+0000 7fcb8cdaf800 20 remove_watcher() i=7 2024-09-12T01:02:06.886 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:02:06.886 INFO:teuthology.orchestra.run.smithi019.stdout: "id": "RGW88888888888888888", 2024-09-12T01:02:06.886 INFO:teuthology.orchestra.run.smithi019.stdout: "tenant": "", 2024-09-12T01:02:06.886 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T01:02:06.886 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T01:02:06.886 INFO:teuthology.orchestra.run.smithi019.stdout: "quota": { 2024-09-12T01:02:06.886 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:06.886 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:06.886 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:06.886 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max_users": 1000, 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max_roles": 1000, 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max_groups": 1000, 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout: "max_access_keys": 4 2024-09-12T01:02:06.887 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:02:06.896 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T01:02:06.896 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key LTSELOMJFTAZUYISLWGX --secret mDqsn2897vpg0ex3GK8HZaS5p0f8jQDKIlPHkeyhP7SNI5vpUn7CcQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T01:02:06.966 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:06.966 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:07.005 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.006+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.008+0000 7f3f9052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.008+0000 7f3f9052c800 20 realm 2024-09-12T01:02:07.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.008+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.008+0000 7f3f9052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.007 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.008+0000 7f3f9052c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:07.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.008+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.008+0000 7f3f9052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.008+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.008 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.009+0000 7f3f9052c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.009+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.009+0000 7f3f9052c800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:07.009 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.009+0000 7f3f9052c800 20 searching for the correct realm 2024-09-12T01:02:07.011 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.013+0000 7f3f8393d640 0 -- 172.21.15.19:0/1180972228 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f3f7402f960 msgr2=0x7f3f74030400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:07.015 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.017+0000 7f3f8393d640 0 -- 172.21.15.19:0/1180972228 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55aaf518eae0 msgr2=0x55aaf5190f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.020 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.021 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 zone default found 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 4 Realm: () 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 zonegroup default 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.021+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.022+0000 7f3f9052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.022+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.022+0000 7f3f9052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.022+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.022+0000 7f3f9052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.022+0000 7f3f9052c800 20 started sync module instance, tier type = 2024-09-12T01:02:07.022 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.022+0000 7f3f9052c800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.030+0000 7f3f9052c800 20 add_watcher() i=0 2024-09-12T01:02:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.030+0000 7f3f9052c800 20 add_watcher() i=1 2024-09-12T01:02:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.030+0000 7f3f9052c800 20 add_watcher() i=2 2024-09-12T01:02:07.029 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.030+0000 7f3f9052c800 20 add_watcher() i=3 2024-09-12T01:02:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.030+0000 7f3f9052c800 20 add_watcher() i=4 2024-09-12T01:02:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.030+0000 7f3f9052c800 20 add_watcher() i=5 2024-09-12T01:02:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.030+0000 7f3f9052c800 20 add_watcher() i=6 2024-09-12T01:02:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.031+0000 7f3f9052c800 20 add_watcher() i=7 2024-09-12T01:02:07.030 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.031+0000 7f3f9052c800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:07.033 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.033+0000 7f3e42fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.033+0000 7f3f9052c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.033+0000 7f3f9052c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.033+0000 7f3f9052c800 5 note: GC not initialized 2024-09-12T01:02:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.033+0000 7f3e41fdb640 20 reqs_thread_entry: start 2024-09-12T01:02:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.033+0000 7f3f9052c800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:07.034 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.033+0000 7f3f9052c800 20 Filter name: none 2024-09-12T01:02:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.033+0000 7f3db37fe640 20 reqs_thread_entry: start 2024-09-12T01:02:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T01:02:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T01:02:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:02:07.035 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T01:02:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T01:02:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:02:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 10 cache get: name=default.rgw.meta+users.keys+LTSELOMJFTAZUYISLWGX : miss 2024-09-12T01:02:07.036 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 10 cache put: name=default.rgw.meta+users.keys+LTSELOMJFTAZUYISLWGX info.flags=0x0 2024-09-12T01:02:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 10 adding default.rgw.meta+users.keys+LTSELOMJFTAZUYISLWGX to cache LRU end 2024-09-12T01:02:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T01:02:07.037 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.034+0000 7f3f9052c800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.035+0000 7f3f9052c800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:02:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.035+0000 7f3f9052c800 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T01:02:07.039 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.035+0000 7f3f9052c800 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T01:02:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.035+0000 7f3f9052c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:02:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.035+0000 7f3f9052c800 10 cache get: name=default.rgw.meta+users.keys+LTSELOMJFTAZUYISLWGX : hit (negative entry) 2024-09-12T01:02:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.035+0000 7f3f9052c800 10 cache get: name=default.rgw.meta+users.keys+LTSELOMJFTAZUYISLWGX : hit (negative entry) 2024-09-12T01:02:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.037+0000 7f3f9052c800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:02:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.037+0000 7f3f9052c800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:02:07.040 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.037+0000 7f3f9052c800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T01:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.037+0000 7f3e637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301006 cookie 94192744903008 notifier 8555 bl.length()=681 2024-09-12T01:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.037+0000 7f3e637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.037+0000 7f3e637fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.040+0000 7f3f9052c800 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T01:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.040+0000 7f3f9052c800 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:02:07.041 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.040+0000 7f3f9052c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T01:02:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.040+0000 7f3e62ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301015 cookie 94192744917536 notifier 8555 bl.length()=189 2024-09-12T01:02:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.040+0000 7f3e62ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T01:02:07.042 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.040+0000 7f3e62ffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T01:02:07.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.043+0000 7f3f9052c800 10 cache put: name=default.rgw.meta+users.keys+LTSELOMJFTAZUYISLWGX info.flags=0x7 2024-09-12T01:02:07.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.043+0000 7f3f9052c800 10 moving default.rgw.meta+users.keys+LTSELOMJFTAZUYISLWGX to cache LRU end 2024-09-12T01:02:07.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.043+0000 7f3f9052c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.keys:LTSELOMJFTAZUYISLWGX, ofs0, ns] 2024-09-12T01:02:07.043 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.043+0000 7f3e637fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301007 cookie 94192744912592 notifier 8555 bl.length()=188 2024-09-12T01:02:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.043+0000 7f3e637fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTSELOMJFTAZUYISLWGX info.flags=0x7 2024-09-12T01:02:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.043+0000 7f3e637fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTSELOMJFTAZUYISLWGX to cache LRU end 2024-09-12T01:02:07.044 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.045+0000 7f3f9052c800 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T01:02:07.045 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:02:07.045 INFO:teuthology.orchestra.run.smithi019.stdout: "user_id": "root1.client.0", 2024-09-12T01:02:07.045 INFO:teuthology.orchestra.run.smithi019.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T01:02:07.045 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "root1+test@test.test", 2024-09-12T01:02:07.045 INFO:teuthology.orchestra.run.smithi019.stdout: "suspended": 0, 2024-09-12T01:02:07.046 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T01:02:07.046 INFO:teuthology.orchestra.run.smithi019.stdout: "subusers": [], 2024-09-12T01:02:07.046 INFO:teuthology.orchestra.run.smithi019.stdout: "keys": [ 2024-09-12T01:02:07.046 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:02:07.046 INFO:teuthology.orchestra.run.smithi019.stdout: "user": "root1.client.0", 2024-09-12T01:02:07.047 INFO:teuthology.orchestra.run.smithi019.stdout: "access_key": "LTSELOMJFTAZUYISLWGX", 2024-09-12T01:02:07.047 INFO:teuthology.orchestra.run.smithi019.stdout: "secret_key": "mDqsn2897vpg0ex3GK8HZaS5p0f8jQDKIlPHkeyhP7SNI5vpUn7CcQ==", 2024-09-12T01:02:07.047 INFO:teuthology.orchestra.run.smithi019.stdout: "active": true, 2024-09-12T01:02:07.047 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:07.036098Z" 2024-09-12T01:02:07.047 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:02:07.047 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T01:02:07.047 INFO:teuthology.orchestra.run.smithi019.stdout: "swift_keys": [], 2024-09-12T01:02:07.047 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": [], 2024-09-12T01:02:07.048 INFO:teuthology.orchestra.run.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T01:02:07.048 INFO:teuthology.orchestra.run.smithi019.stdout: "default_placement": "", 2024-09-12T01:02:07.048 INFO:teuthology.orchestra.run.smithi019.stdout: "default_storage_class": "", 2024-09-12T01:02:07.048 INFO:teuthology.orchestra.run.smithi019.stdout: "placement_tags": [], 2024-09-12T01:02:07.048 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T01:02:07.048 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:07.048 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:07.049 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:07.049 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:07.049 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:07.049 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:07.049 INFO:teuthology.orchestra.run.smithi019.stdout: "user_quota": { 2024-09-12T01:02:07.049 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:07.049 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:07.050 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:07.050 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:07.050 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:07.050 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:07.050 INFO:teuthology.orchestra.run.smithi019.stdout: "temp_url_keys": [], 2024-09-12T01:02:07.050 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "root", 2024-09-12T01:02:07.050 INFO:teuthology.orchestra.run.smithi019.stdout: "mfa_ids": [], 2024-09-12T01:02:07.050 INFO:teuthology.orchestra.run.smithi019.stdout: "account_id": "RGW88888888888888888", 2024-09-12T01:02:07.050 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-12T01:02:07.050 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:07.036087Z", 2024-09-12T01:02:07.051 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-12T01:02:07.051 INFO:teuthology.orchestra.run.smithi019.stdout: "group_ids": [] 2024-09-12T01:02:07.051 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:02:07.051 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:02:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.046+0000 7f3e42fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.048+0000 7f3f9052c800 20 remove_watcher() i=0 2024-09-12T01:02:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.048+0000 7f3f9052c800 2 removed watcher, disabling cache 2024-09-12T01:02:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.049+0000 7f3f9052c800 20 remove_watcher() i=1 2024-09-12T01:02:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.050+0000 7f3f9052c800 20 remove_watcher() i=2 2024-09-12T01:02:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.051+0000 7f3f9052c800 20 remove_watcher() i=3 2024-09-12T01:02:07.052 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.052+0000 7f3f9052c800 20 remove_watcher() i=4 2024-09-12T01:02:07.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.053+0000 7f3f9052c800 20 remove_watcher() i=5 2024-09-12T01:02:07.053 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.054+0000 7f3f9052c800 20 remove_watcher() i=6 2024-09-12T01:02:07.054 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.055+0000 7f3f9052c800 20 remove_watcher() i=7 2024-09-12T01:02:07.065 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 8026088432 --totp-seed UPBL65WCIVP25LDM32WJYHI7DEFJPCCPBNEZKVTK5QCN4PMO6DVDQKTSODNOWDTX --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:02:07.133 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:07.134 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:07.170 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.171+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.172+0000 7f2dab80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.172+0000 7f2dab80e800 20 realm 2024-09-12T01:02:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.172+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.173+0000 7f2dab80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.171 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.173+0000 7f2dab80e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:07.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.173+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.173+0000 7f2dab80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.172 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.173+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.173+0000 7f2dab80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:07.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.173+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.174+0000 7f2dab80e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:07.173 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.174+0000 7f2dab80e800 20 searching for the correct realm 2024-09-12T01:02:07.176 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.177+0000 7f2da676a640 0 -- 172.21.15.19:0/1166326843 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f2d9c01c040 msgr2=0x7f2d9c04c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:07.382 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.383+0000 7f2da776c640 0 -- 172.21.15.19:0/1166326843 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x555e8e252ff0 msgr2=0x555e8e2554b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:07.386 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.387 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.388 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.388+0000 7f2dab80e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 20 zone default found 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 4 Realm: () 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 20 zonegroup default 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.389 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 20 started sync module instance, tier type = 2024-09-12T01:02:07.390 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.389+0000 7f2dab80e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:07.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.398+0000 7f2dab80e800 20 add_watcher() i=0 2024-09-12T01:02:07.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.398+0000 7f2dab80e800 20 add_watcher() i=1 2024-09-12T01:02:07.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.398+0000 7f2dab80e800 20 add_watcher() i=2 2024-09-12T01:02:07.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.398+0000 7f2dab80e800 20 add_watcher() i=3 2024-09-12T01:02:07.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.398+0000 7f2dab80e800 20 add_watcher() i=4 2024-09-12T01:02:07.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.398+0000 7f2dab80e800 20 add_watcher() i=5 2024-09-12T01:02:07.397 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.398+0000 7f2dab80e800 20 add_watcher() i=6 2024-09-12T01:02:07.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.399+0000 7f2dab80e800 20 add_watcher() i=7 2024-09-12T01:02:07.398 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.399+0000 7f2dab80e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:07.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.401+0000 7f2c5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:07.400 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.401+0000 7f2dab80e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:07.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.401+0000 7f2dab80e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:07.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.401+0000 7f2dab80e800 5 note: GC not initialized 2024-09-12T01:02:07.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.401+0000 7f2bd7fff640 20 reqs_thread_entry: start 2024-09-12T01:02:07.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.402+0000 7f2dab80e800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:07.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.402+0000 7f2dab80e800 20 Filter name: none 2024-09-12T01:02:07.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.402+0000 7f2bd5ffb640 20 reqs_thread_entry: start 2024-09-12T01:02:07.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.402+0000 7f2dab80e800 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T01:02:07.401 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.402+0000 7f2dab80e800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.405+0000 7f2dab80e800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T01:02:07.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.405+0000 7f2dab80e800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T01:02:07.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.405+0000 7f2dab80e800 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:02:07.404 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.405+0000 7f2dab80e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:02:07.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.408+0000 7f2dab80e800 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:02:07.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.408+0000 7f2dab80e800 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:02:07.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.408+0000 7f2dab80e800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T01:02:07.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.408+0000 7f2c8a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301008 cookie 93864600141824 notifier 8573 bl.length()=695 2024-09-12T01:02:07.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.408+0000 7f2c8a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T01:02:07.407 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.408+0000 7f2c8a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T01:02:07.410 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.411+0000 7f2c5d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:07.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.413+0000 7f2dab80e800 20 remove_watcher() i=0 2024-09-12T01:02:07.412 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.413+0000 7f2dab80e800 2 removed watcher, disabling cache 2024-09-12T01:02:07.413 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.414+0000 7f2dab80e800 20 remove_watcher() i=1 2024-09-12T01:02:07.414 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.415+0000 7f2dab80e800 20 remove_watcher() i=2 2024-09-12T01:02:07.415 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.416+0000 7f2dab80e800 20 remove_watcher() i=3 2024-09-12T01:02:07.416 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.417+0000 7f2dab80e800 20 remove_watcher() i=4 2024-09-12T01:02:07.417 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.418+0000 7f2dab80e800 20 remove_watcher() i=5 2024-09-12T01:02:07.418 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.419+0000 7f2dab80e800 20 remove_watcher() i=6 2024-09-12T01:02:07.419 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.420+0000 7f2dab80e800 20 remove_watcher() i=7 2024-09-12T01:02:07.432 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T01:02:07.493 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:07.494 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:07.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.531+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.533+0000 7fe3be935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.533+0000 7fe3be935800 20 realm 2024-09-12T01:02:07.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.533+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.533+0000 7fe3be935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.533+0000 7fe3be935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:07.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.533+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.533+0000 7fe3be935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.533+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.534+0000 7fe3be935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:07.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.534+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.533 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.534+0000 7fe3be935800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:07.534 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.534+0000 7fe3be935800 20 searching for the correct realm 2024-09-12T01:02:07.536 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.538+0000 7fe3b9dc2640 0 -- 172.21.15.19:0/4083274785 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fe3b00b3ba0 msgr2=0x7fe3b00b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:07.742 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.743+0000 7fe3ba5c3640 0 -- 172.21.15.19:0/4083274785 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7fe3b4037070 msgr2=0x7fe3b4064370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:02:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.747+0000 7fe3be935800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.747+0000 7fe3be935800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.747+0000 7fe3be935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.747+0000 7fe3be935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.747+0000 7fe3be935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:07.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.747+0000 7fe3be935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:07.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.747+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 20 zone default found 2024-09-12T01:02:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 4 Realm: () 2024-09-12T01:02:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:07.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 20 zonegroup default 2024-09-12T01:02:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.748+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.749+0000 7fe3be935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.749+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.749+0000 7fe3be935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.749+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.749+0000 7fe3be935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.749+0000 7fe3be935800 20 started sync module instance, tier type = 2024-09-12T01:02:07.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.749+0000 7fe3be935800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.758+0000 7fe3be935800 20 add_watcher() i=0 2024-09-12T01:02:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.758+0000 7fe3be935800 20 add_watcher() i=1 2024-09-12T01:02:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.758+0000 7fe3be935800 20 add_watcher() i=2 2024-09-12T01:02:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.758+0000 7fe3be935800 20 add_watcher() i=3 2024-09-12T01:02:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.758+0000 7fe3be935800 20 add_watcher() i=4 2024-09-12T01:02:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.758+0000 7fe3be935800 20 add_watcher() i=5 2024-09-12T01:02:07.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.758+0000 7fe3be935800 20 add_watcher() i=6 2024-09-12T01:02:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.759+0000 7fe3be935800 20 add_watcher() i=7 2024-09-12T01:02:07.758 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.759+0000 7fe3be935800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.761+0000 7fe270fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.761+0000 7fe3be935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:07.760 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.761+0000 7fe3be935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.761+0000 7fe3be935800 5 note: GC not initialized 2024-09-12T01:02:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.761+0000 7fe1eb7fe640 20 reqs_thread_entry: start 2024-09-12T01:02:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.761+0000 7fe3be935800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.761+0000 7fe3be935800 20 Filter name: none 2024-09-12T01:02:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe1e97fa640 20 reqs_thread_entry: start 2024-09-12T01:02:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T01:02:07.761 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T01:02:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:02:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T01:02:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T01:02:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T01:02:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:02:07.762 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.762+0000 7fe3be935800 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T01:02:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.764+0000 7fe3be935800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:02:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.764+0000 7fe3be935800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:02:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.764+0000 7fe3be935800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T01:02:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.764+0000 7fe29dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301009 cookie 94395886176016 notifier 8591 bl.length()=384 2024-09-12T01:02:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.764+0000 7fe29dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:02:07.763 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.764+0000 7fe29dffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:02:07.765 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.767+0000 7fe3be935800 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T01:02:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.767+0000 7fe3be935800 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:02:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.767+0000 7fe3be935800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T01:02:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.767+0000 7fe29dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301010 cookie 94395886186784 notifier 8591 bl.length()=225 2024-09-12T01:02:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.767+0000 7fe29dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T01:02:07.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.767+0000 7fe29dffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T01:02:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.769+0000 7fe3be935800 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T01:02:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.769+0000 7fe3be935800 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:02:07.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.769+0000 7fe3be935800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T01:02:07.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.770+0000 7fe29dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300846 cookie 94395886174816 notifier 8591 bl.length()=234 2024-09-12T01:02:07.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.770+0000 7fe29dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T01:02:07.769 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.770+0000 7fe29dffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T01:02:07.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.773+0000 7fe270fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:07.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.775+0000 7fe3be935800 20 remove_watcher() i=0 2024-09-12T01:02:07.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.775+0000 7fe3be935800 2 removed watcher, disabling cache 2024-09-12T01:02:07.775 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.776+0000 7fe3be935800 20 remove_watcher() i=1 2024-09-12T01:02:07.776 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.777+0000 7fe3be935800 20 remove_watcher() i=2 2024-09-12T01:02:07.777 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.778+0000 7fe3be935800 20 remove_watcher() i=3 2024-09-12T01:02:07.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.779+0000 7fe3be935800 20 remove_watcher() i=4 2024-09-12T01:02:07.779 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.780+0000 7fe3be935800 20 remove_watcher() i=5 2024-09-12T01:02:07.780 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.781+0000 7fe3be935800 20 remove_watcher() i=6 2024-09-12T01:02:07.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.782+0000 7fe3be935800 20 remove_watcher() i=7 2024-09-12T01:02:07.791 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:02:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "id": "RGW99999999999999999", 2024-09-12T01:02:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "tenant": "", 2024-09-12T01:02:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T01:02:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T01:02:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "quota": { 2024-09-12T01:02:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:07.791 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_users": 1000, 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_roles": 1000, 2024-09-12T01:02:07.792 INFO:teuthology.orchestra.run.smithi019.stdout: "max_groups": 1000, 2024-09-12T01:02:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T01:02:07.793 INFO:teuthology.orchestra.run.smithi019.stdout: "max_access_keys": 4 2024-09-12T01:02:07.793 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:02:07.794 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T01:02:07.794 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key VFWQLYPWHHAVSIVAAEFE --secret 3+CrGNqRHPO+hYRW59Adm4YXdpv8uXEraWVOjjhQ81eJbmIyubQhtA== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T01:02:07.864 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:07.864 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:07.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.901+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.903+0000 7f48b0746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.903+0000 7f48b0746800 20 realm 2024-09-12T01:02:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.903+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.903+0000 7f48b0746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.903+0000 7f48b0746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.903+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.904+0000 7f48b0746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.904+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.904+0000 7f48b0746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.904+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:07.903 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.905+0000 7f48b0746800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:07.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.905+0000 7f48b0746800 20 searching for the correct realm 2024-09-12T01:02:07.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:07.908+0000 7f48ada36640 0 -- 172.21.15.19:0/2135290286 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f48a4090b10 msgr2=0x7f48a40972d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:08.111 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.112+0000 7f48aea38640 0 -- 172.21.15.19:0/2135290286 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x562aec0469f0 msgr2=0x562aec048e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.116+0000 7f48b0746800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.116+0000 7f48b0746800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.116+0000 7f48b0746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.116+0000 7f48b0746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.116+0000 7f48b0746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.116+0000 7f48b0746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.116+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.116 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:08.117 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 20 zone default found 2024-09-12T01:02:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 4 Realm: () 2024-09-12T01:02:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 20 zonegroup default 2024-09-12T01:02:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.117+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.118+0000 7f48b0746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.118+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.118 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.118+0000 7f48b0746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.118+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.118+0000 7f48b0746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.118+0000 7f48b0746800 20 started sync module instance, tier type = 2024-09-12T01:02:08.119 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.118+0000 7f48b0746800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:08.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.128+0000 7f48b0746800 20 add_watcher() i=0 2024-09-12T01:02:08.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.128+0000 7f48b0746800 20 add_watcher() i=1 2024-09-12T01:02:08.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.128+0000 7f48b0746800 20 add_watcher() i=2 2024-09-12T01:02:08.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.128+0000 7f48b0746800 20 add_watcher() i=3 2024-09-12T01:02:08.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.128+0000 7f48b0746800 20 add_watcher() i=4 2024-09-12T01:02:08.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.128+0000 7f48b0746800 20 add_watcher() i=5 2024-09-12T01:02:08.127 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.128+0000 7f48b0746800 20 add_watcher() i=6 2024-09-12T01:02:08.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.129+0000 7f48b0746800 20 add_watcher() i=7 2024-09-12T01:02:08.128 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.129+0000 7f48b0746800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.131+0000 7f4764fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.131+0000 7f48b0746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.131+0000 7f48b0746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:08.130 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.131+0000 7f48b0746800 5 note: GC not initialized 2024-09-12T01:02:08.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.131+0000 7f46df7fe640 20 reqs_thread_entry: start 2024-09-12T01:02:08.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.131+0000 7f48b0746800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:08.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.131+0000 7f48b0746800 20 Filter name: none 2024-09-12T01:02:08.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.131+0000 7f46dd7fa640 20 reqs_thread_entry: start 2024-09-12T01:02:08.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T01:02:08.131 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T01:02:08.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:02:08.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T01:02:08.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.132 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 10 cache get: name=default.rgw.meta+users.keys+VFWQLYPWHHAVSIVAAEFE : miss 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 10 cache put: name=default.rgw.meta+users.keys+VFWQLYPWHHAVSIVAAEFE info.flags=0x0 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 10 adding default.rgw.meta+users.keys+VFWQLYPWHHAVSIVAAEFE to cache LRU end 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.132+0000 7f48b0746800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.133+0000 7f48b0746800 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.133+0000 7f48b0746800 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.133+0000 7f48b0746800 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T01:02:08.133 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.133+0000 7f48b0746800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:02:08.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.133+0000 7f48b0746800 10 cache get: name=default.rgw.meta+users.keys+VFWQLYPWHHAVSIVAAEFE : hit (negative entry) 2024-09-12T01:02:08.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.133+0000 7f48b0746800 10 cache get: name=default.rgw.meta+users.keys+VFWQLYPWHHAVSIVAAEFE : hit (negative entry) 2024-09-12T01:02:08.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.135+0000 7f48b0746800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:02:08.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.135+0000 7f48b0746800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:02:08.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.135+0000 7f48b0746800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T01:02:08.134 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.135+0000 7f4791ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301011 cookie 94742348380736 notifier 9249 bl.length()=681 2024-09-12T01:02:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.135+0000 7f4791ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:02:08.135 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.135+0000 7f4791ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:02:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.138+0000 7f48b0746800 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T01:02:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.138+0000 7f48b0746800 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:02:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.138+0000 7f48b0746800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T01:02:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.138+0000 7f4791ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301016 cookie 94742348391296 notifier 9249 bl.length()=189 2024-09-12T01:02:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.138+0000 7f4791ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T01:02:08.137 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.138+0000 7f4791ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T01:02:08.139 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.141+0000 7f48b0746800 10 cache put: name=default.rgw.meta+users.keys+VFWQLYPWHHAVSIVAAEFE info.flags=0x7 2024-09-12T01:02:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.141+0000 7f48b0746800 10 moving default.rgw.meta+users.keys+VFWQLYPWHHAVSIVAAEFE to cache LRU end 2024-09-12T01:02:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.141+0000 7f48b0746800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:VFWQLYPWHHAVSIVAAEFE, ofs0, ns] 2024-09-12T01:02:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.141+0000 7f4791ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301017 cookie 94742348392352 notifier 9249 bl.length()=188 2024-09-12T01:02:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.141+0000 7f4791ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+VFWQLYPWHHAVSIVAAEFE info.flags=0x7 2024-09-12T01:02:08.140 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.141+0000 7f4791ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+VFWQLYPWHHAVSIVAAEFE to cache LRU end 2024-09-12T01:02:08.142 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.144+0000 7f48b0746800 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T01:02:08.143 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:02:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "user_id": "root2.client.0", 2024-09-12T01:02:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T01:02:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "email": "root2+test@test.test", 2024-09-12T01:02:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "suspended": 0, 2024-09-12T01:02:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "max_buckets": 1000, 2024-09-12T01:02:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "subusers": [], 2024-09-12T01:02:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "keys": [ 2024-09-12T01:02:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: { 2024-09-12T01:02:08.143 INFO:teuthology.orchestra.run.smithi019.stdout: "user": "root2.client.0", 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "access_key": "VFWQLYPWHHAVSIVAAEFE", 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "secret_key": "3+CrGNqRHPO+hYRW59Adm4YXdpv8uXEraWVOjjhQ81eJbmIyubQhtA==", 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "active": true, 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:08.134190Z" 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: } 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: ], 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "swift_keys": [], 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "caps": [], 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "op_mask": "read, write, delete", 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "default_placement": "", 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "default_storage_class": "", 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "placement_tags": [], 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "bucket_quota": { 2024-09-12T01:02:08.144 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "user_quota": { 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "enabled": false, 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "check_on_raw": false, 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size": -1, 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "max_size_kb": 0, 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "max_objects": -1 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: }, 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "temp_url_keys": [], 2024-09-12T01:02:08.145 INFO:teuthology.orchestra.run.smithi019.stdout: "type": "root", 2024-09-12T01:02:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "mfa_ids": [], 2024-09-12T01:02:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "account_id": "RGW99999999999999999", 2024-09-12T01:02:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "path": "/", 2024-09-12T01:02:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "create_date": "2024-09-12T01:02:08.134178Z", 2024-09-12T01:02:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "tags": [], 2024-09-12T01:02:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: "group_ids": [] 2024-09-12T01:02:08.146 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:02:08.146 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:02:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.145+0000 7f4764fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.147+0000 7f48b0746800 20 remove_watcher() i=0 2024-09-12T01:02:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.147+0000 7f48b0746800 2 removed watcher, disabling cache 2024-09-12T01:02:08.147 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.148+0000 7f48b0746800 20 remove_watcher() i=1 2024-09-12T01:02:08.148 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.149+0000 7f48b0746800 20 remove_watcher() i=2 2024-09-12T01:02:08.149 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.150+0000 7f48b0746800 20 remove_watcher() i=3 2024-09-12T01:02:08.150 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.151+0000 7f48b0746800 20 remove_watcher() i=4 2024-09-12T01:02:08.151 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.152+0000 7f48b0746800 20 remove_watcher() i=5 2024-09-12T01:02:08.152 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.153+0000 7f48b0746800 20 remove_watcher() i=6 2024-09-12T01:02:08.153 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.154+0000 7f48b0746800 20 remove_watcher() i=7 2024-09-12T01:02:08.165 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 4227445095 --totp-seed OOW5S4NJ3J4LLC5IY4EAIIWWOSJZHIZBYCDK6BKUFTIMXG2CV3O3VQOKLFWNXOGL --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T01:02:08.234 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:02:08.234 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:02:08.269 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.271+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.272+0000 7f6398936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.272+0000 7f6398936800 20 realm 2024-09-12T01:02:08.271 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.272+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.273+0000 7f6398936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.273+0000 7f6398936800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:02:08.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.273+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.273+0000 7f6398936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.273+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.272 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.273+0000 7f6398936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:08.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.273+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.274+0000 7f6398936800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:02:08.273 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.274+0000 7f6398936800 20 searching for the correct realm 2024-09-12T01:02:08.276 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.277+0000 7f6393eb6640 0 -- 172.21.15.19:0/681331610 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f6388026bc0 msgr2=0x7f6388056440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:08.480 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.481+0000 7f6393eb6640 0 -- 172.21.15.19:0/681331610 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5646c1fb24f0 msgr2=0x5646c1fb4960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:02:08.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.485+0000 7f6398936800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:02:08.484 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.485+0000 7f6398936800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:02:08.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.485+0000 7f6398936800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:02:08.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.485+0000 7f6398936800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:02:08.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.485+0000 7f6398936800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:02:08.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.485+0000 7f6398936800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:02:08.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.485+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.485 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:02:08.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:02:08.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 20 zone default found 2024-09-12T01:02:08.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 4 Realm: () 2024-09-12T01:02:08.486 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:02:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:02:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:02:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 20 zonegroup default 2024-09-12T01:02:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.486+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.487+0000 7f6398936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.487+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.487+0000 7f6398936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.487+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.487+0000 7f6398936800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:02:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.487+0000 7f6398936800 20 started sync module instance, tier type = 2024-09-12T01:02:08.487 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.487+0000 7f6398936800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:02:08.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.496+0000 7f6398936800 20 add_watcher() i=0 2024-09-12T01:02:08.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.496+0000 7f6398936800 20 add_watcher() i=1 2024-09-12T01:02:08.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.496+0000 7f6398936800 20 add_watcher() i=2 2024-09-12T01:02:08.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.496+0000 7f6398936800 20 add_watcher() i=3 2024-09-12T01:02:08.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.496+0000 7f6398936800 20 add_watcher() i=4 2024-09-12T01:02:08.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.496+0000 7f6398936800 20 add_watcher() i=5 2024-09-12T01:02:08.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.496+0000 7f6398936800 20 add_watcher() i=6 2024-09-12T01:02:08.495 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.497+0000 7f6398936800 20 add_watcher() i=7 2024-09-12T01:02:08.496 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.497+0000 7f6398936800 2 all 8 watchers are set, enabling cache 2024-09-12T01:02:08.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.499+0000 7f624afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:08.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.500+0000 7f6398936800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:02:08.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.500+0000 7f6398936800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:02:08.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.500+0000 7f6398936800 5 note: GC not initialized 2024-09-12T01:02:08.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.500+0000 7f6249fdb640 20 reqs_thread_entry: start 2024-09-12T01:02:08.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.500+0000 7f6398936800 20 init_complete bucket index max shards: 11 2024-09-12T01:02:08.499 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.500+0000 7f6398936800 20 Filter name: none 2024-09-12T01:02:08.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.500+0000 7f61bb7fe640 20 reqs_thread_entry: start 2024-09-12T01:02:08.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.500+0000 7f6398936800 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T01:02:08.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.500+0000 7f6398936800 20 rados->read ofs=0 len=0 2024-09-12T01:02:08.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.501+0000 7f6398936800 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T01:02:08.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.501+0000 7f6398936800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T01:02:08.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.501+0000 7f6398936800 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:02:08.500 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.501+0000 7f6398936800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:02:08.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.504+0000 7f6398936800 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:02:08.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.504+0000 7f6398936800 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:02:08.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.504+0000 7f6398936800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T01:02:08.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.504+0000 7f626b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301012 cookie 94861902169600 notifier 8627 bl.length()=695 2024-09-12T01:02:08.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.504+0000 7f626b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T01:02:08.503 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.504+0000 7f626b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T01:02:08.505 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.507+0000 7f624afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:02:08.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.509+0000 7f6398936800 20 remove_watcher() i=0 2024-09-12T01:02:08.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.509+0000 7f6398936800 2 removed watcher, disabling cache 2024-09-12T01:02:08.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.510+0000 7f6398936800 20 remove_watcher() i=1 2024-09-12T01:02:08.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.511+0000 7f6398936800 20 remove_watcher() i=2 2024-09-12T01:02:08.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.512+0000 7f6398936800 20 remove_watcher() i=3 2024-09-12T01:02:08.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.514+0000 7f6398936800 20 remove_watcher() i=4 2024-09-12T01:02:08.513 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.515+0000 7f6398936800 20 remove_watcher() i=5 2024-09-12T01:02:08.514 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.516+0000 7f6398936800 20 remove_watcher() i=6 2024-09-12T01:02:08.515 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:02:08.517+0000 7f6398936800 20 remove_watcher() i=7 2024-09-12T01:02:08.528 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T01:02:08.529 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:02:08.529 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T01:02:08.559 INFO:tasks.s3tests:Configuring boto... 2024-09-12T01:02:08.559 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:02:08.559 DEBUG:teuthology.orchestra.run.smithi019:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:02:08.629 DEBUG:teuthology.orchestra.run.smithi019:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T01:02:08.813 INFO:teuthology.orchestra.run.smithi019.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T01:02:09.001 INFO:teuthology.orchestra.run.smithi019.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T01:02:09.280 INFO:teuthology.orchestra.run.smithi019.stdout:py installdeps: -rrequirements.txt 2024-09-12T01:04:09.621 INFO:teuthology.orchestra.run.smithi019.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T01:04:11.088 INFO:teuthology.orchestra.run.smithi019.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=b237e7ca71b9e9c32a876c80b4ab2b582b9fa02c7f51a2f47efe3ac77d125c2e,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T01:04:11.088 INFO:teuthology.orchestra.run.smithi019.stdout:py run-test-pre: PYTHONHASHSEED='1461586395' 2024-09-12T01:04:11.088 INFO:teuthology.orchestra.run.smithi019.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T01:04:11.227 INFO:teuthology.orchestra.run.smithi019.stdout:============================= test session starts ============================== 2024-09-12T01:04:11.227 INFO:teuthology.orchestra.run.smithi019.stdout:platform linux -- Python 3.9.19, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T01:04:11.228 INFO:teuthology.orchestra.run.smithi019.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T01:04:11.228 INFO:teuthology.orchestra.run.smithi019.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:04:11.228 INFO:teuthology.orchestra.run.smithi019.stdout:configfile: pytest.ini 2024-09-12T01:04:13.050 INFO:teuthology.orchestra.run.smithi019.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T01:04:13.051 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:04:13.749 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T01:04:14.155 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T01:04:14.537 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T01:04:14.916 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T01:04:15.319 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T01:04:15.626 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T01:04:16.064 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T01:04:16.371 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T01:04:16.497 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T01:04:16.623 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T01:04:17.025 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T01:04:17.448 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T01:04:17.849 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T01:04:18.255 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T01:04:18.382 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T01:04:18.511 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T01:04:18.592 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T01:04:18.672 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T01:04:18.752 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T01:04:18.834 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T01:04:18.914 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T01:04:18.994 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T01:04:19.076 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T01:04:19.157 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T01:04:19.237 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T01:04:19.318 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T01:04:19.399 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T01:04:19.479 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T01:04:19.559 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T01:04:19.639 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T01:04:19.720 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T01:04:19.800 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T01:04:19.881 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T01:04:19.962 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T01:04:20.049 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T01:04:20.130 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T01:04:20.211 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T01:04:20.292 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T01:04:20.372 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:04:20.451 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T01:04:20.531 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T01:04:20.612 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:04:20.691 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T01:04:20.772 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T01:04:20.852 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T01:04:20.933 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T01:04:21.014 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T01:04:21.094 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T01:04:21.175 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T01:04:21.255 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T01:04:21.335 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T01:04:21.416 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T01:04:21.496 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T01:04:22.338 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T01:04:31.257 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T01:04:39.988 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T01:04:56.851 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T01:05:19.442 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T01:05:26.113 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T01:05:31.997 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T01:05:33.577 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T01:05:33.984 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T01:05:35.026 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T01:05:36.089 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T01:05:37.076 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T01:05:37.629 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T01:05:38.165 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T01:05:38.166 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T01:05:38.167 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T01:05:38.168 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T01:05:38.169 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T01:05:38.169 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T01:05:38.171 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T01:05:38.171 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T01:05:38.172 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:05:38.173 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:05:38.173 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T01:05:38.174 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:05:38.175 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T01:05:38.176 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:05:38.177 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:05:38.178 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T01:05:38.179 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:05:38.180 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:05:38.180 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:05:38.181 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T01:05:38.182 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T01:05:38.183 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T01:05:38.184 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T01:05:38.185 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T01:05:38.186 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T01:05:38.186 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T01:05:38.187 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T01:05:38.188 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T01:05:38.277 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T01:05:38.289 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T01:05:39.577 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T01:05:51.705 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T01:05:52.573 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T01:05:53.632 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T01:05:54.679 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T01:05:55.726 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T01:05:56.757 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T01:05:57.631 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T01:05:58.694 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T01:05:59.632 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T01:06:00.575 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T01:06:01.446 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T01:06:02.207 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T01:06:02.975 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T01:06:03.557 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T01:06:04.425 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T01:06:05.387 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T01:06:06.378 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T01:06:07.243 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T01:06:08.112 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T01:06:09.001 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T01:06:09.881 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T01:06:10.762 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T01:06:11.530 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T01:06:12.295 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T01:06:12.873 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T01:06:13.481 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T01:06:14.045 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T01:06:14.609 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T01:06:15.174 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T01:06:16.164 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T01:06:16.741 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:06:17.325 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T01:06:18.061 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T01:06:18.779 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T01:06:19.344 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:06:20.088 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T01:06:20.796 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T01:06:21.673 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T01:06:22.315 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T01:06:23.022 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T01:06:23.738 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T01:06:24.773 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T01:06:25.810 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T01:06:26.753 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T01:06:27.833 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:29.034 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:31.436 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:33.500 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:34.725 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:35.903 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T01:06:36.873 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T01:06:38.012 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T01:06:38.873 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T01:06:40.533 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T01:06:41.690 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T01:06:43.054 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T01:06:45.603 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T01:06:48.901 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T01:06:50.833 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T01:06:52.641 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T01:06:54.083 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T01:06:55.054 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T01:06:56.684 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T01:06:57.885 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T01:06:59.448 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T01:07:00.589 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T01:07:02.552 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T01:07:04.247 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T01:07:06.427 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T01:07:08.533 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T01:07:10.105 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T01:07:11.528 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T01:07:12.715 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T01:07:15.248 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T01:07:17.125 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T01:07:19.285 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T01:07:21.376 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T01:07:23.331 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T01:07:25.321 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T01:07:26.970 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T01:07:28.190 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T01:07:29.543 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T01:07:31.884 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T01:07:34.855 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T01:07:36.281 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T01:07:38.270 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T01:07:40.262 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T01:07:42.225 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:07:44.377 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T01:07:46.615 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T01:07:48.801 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T01:07:50.849 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T01:07:52.192 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T01:07:53.347 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:07:54.468 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T01:07:55.612 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T01:07:57.586 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:07:59.654 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T01:08:01.715 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:08:03.680 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T01:08:05.735 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:08:07.699 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T01:08:09.688 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T01:08:11.758 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T01:08:13.725 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T01:08:15.760 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:08:17.741 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T01:08:19.763 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T01:08:21.226 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T01:08:22.673 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T01:08:24.088 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T01:08:25.489 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T01:08:26.634 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T01:08:27.878 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T01:08:28.981 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T01:08:30.092 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T01:08:31.187 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T01:08:32.275 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T01:08:33.351 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T01:08:34.433 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T01:08:35.541 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T01:08:37.336 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T01:08:39.117 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T01:08:40.090 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:08:41.068 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T01:08:42.142 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T01:08:43.213 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T01:08:45.023 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:08:46.812 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T01:08:47.888 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T01:08:48.960 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T01:08:50.047 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:08:51.134 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T01:08:52.246 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T01:08:53.320 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T01:08:54.410 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:08:55.485 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T01:08:56.578 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T01:08:57.655 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T01:08:58.769 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T01:08:59.856 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T01:09:00.902 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T01:09:01.945 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T01:09:02.998 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T01:09:04.084 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:09:05.177 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T01:09:51.872 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T01:09:52.940 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T01:09:53.998 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T01:09:55.044 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T01:09:56.075 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T01:09:57.112 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T01:09:58.146 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T01:09:59.202 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T01:10:00.293 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T01:10:01.327 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T01:10:02.368 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T01:10:03.399 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T01:10:04.444 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T01:10:05.540 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:10:06.623 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T01:10:07.740 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:10:08.827 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T01:10:09.916 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T01:10:11.004 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T01:10:12.089 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:10:13.173 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:10:14.252 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:10:15.380 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T01:10:16.542 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T01:10:17.699 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T01:10:18.779 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T01:10:19.877 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T01:10:21.014 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T01:10:22.129 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T01:10:22.715 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T01:10:23.688 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T01:10:26.030 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T01:10:28.364 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T01:10:29.443 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T01:10:30.564 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T01:10:31.638 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T01:10:32.708 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T01:10:33.852 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T01:10:35.010 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T01:10:36.083 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T01:10:37.176 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T01:10:38.289 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T01:10:39.369 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T01:10:40.527 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T01:10:41.611 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T01:10:42.961 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T01:10:44.677 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T01:10:45.681 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T01:10:46.649 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T01:10:47.519 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:10:48.395 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T01:10:48.969 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T01:10:49.550 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T01:10:50.115 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T01:10:51.093 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T01:10:55.615 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T01:10:56.223 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T01:10:57.146 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T01:10:57.973 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T01:10:58.842 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T01:10:59.724 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T01:11:02.361 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T01:11:03.613 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T01:11:04.879 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T01:11:53.366 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T01:12:40.782 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T01:12:41.733 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T01:12:42.677 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T01:12:43.656 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T01:12:44.629 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T01:12:45.706 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T01:12:46.684 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T01:12:47.648 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T01:12:48.805 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T01:12:49.803 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T01:12:50.815 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T01:12:51.892 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T01:12:53.007 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T01:12:53.971 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T01:12:54.833 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T01:12:55.779 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T01:12:56.708 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T01:12:58.592 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T01:12:59.617 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T01:13:00.575 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T01:13:01.504 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T01:13:03.120 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T01:13:03.756 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T01:13:04.634 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T01:13:05.536 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T01:13:06.415 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T01:13:07.321 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T01:13:08.186 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T01:13:09.053 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T01:13:10.086 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T01:13:10.970 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T01:13:11.843 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T01:13:12.718 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T01:13:13.587 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T01:13:14.767 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T01:13:15.681 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T01:13:16.555 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T01:13:17.434 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T01:13:18.310 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T01:13:19.200 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T01:13:20.070 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T01:13:20.955 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T01:13:22.912 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T01:13:23.790 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T01:13:24.834 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T01:13:25.859 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T01:13:26.821 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T01:13:27.840 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T01:13:28.839 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T01:13:30.928 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T01:13:31.945 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T01:13:32.955 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T01:13:34.090 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T01:13:35.234 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T01:13:36.354 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T01:13:37.349 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T01:13:38.462 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T01:13:39.589 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T01:13:40.651 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T01:13:41.789 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T01:13:42.800 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T01:13:43.725 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T01:13:44.666 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T01:13:45.685 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T01:13:46.545 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T01:13:47.128 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T01:13:48.304 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T01:13:49.268 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T01:13:50.270 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T01:13:53.780 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T01:13:54.751 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T01:13:55.729 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T01:13:56.687 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T01:13:57.652 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T01:13:58.545 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T01:13:59.508 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T01:14:00.606 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T01:14:01.714 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T01:14:02.682 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T01:14:03.653 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T01:14:04.625 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T01:14:05.679 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T01:14:06.722 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T01:14:07.661 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T01:14:08.680 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T01:14:09.752 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T01:14:10.798 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T01:14:11.361 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T01:14:11.932 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T01:14:12.503 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T01:14:13.279 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T01:14:14.065 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T01:14:14.841 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T01:14:15.636 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T01:14:16.478 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T01:14:17.040 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T01:14:17.603 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T01:14:18.417 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T01:14:18.999 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T01:14:19.562 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T01:14:20.131 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T01:14:20.712 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T01:14:21.547 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T01:14:22.385 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T01:14:23.267 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T01:14:24.107 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T01:14:24.942 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T01:14:25.843 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T01:14:26.669 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T01:14:27.589 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T01:14:28.440 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:14:29.269 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:14:30.270 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T01:14:31.297 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T01:14:32.394 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T01:14:33.396 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T01:14:34.418 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T01:14:35.518 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T01:14:36.608 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T01:14:37.694 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T01:14:38.787 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T01:14:39.663 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T01:14:40.789 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T01:14:41.906 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T01:14:43.013 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T01:14:44.107 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T01:14:45.268 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T01:14:46.841 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T01:14:48.241 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T01:14:49.653 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T01:14:51.155 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T01:14:52.562 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T01:14:53.579 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T01:14:54.575 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T01:14:55.610 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T01:14:56.649 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T01:14:57.608 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T01:14:58.741 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T01:15:00.235 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T01:15:01.742 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T01:15:03.235 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T01:15:04.737 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T01:15:06.253 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:15:07.744 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T01:15:09.278 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T01:15:10.782 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T01:15:12.293 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T01:15:13.676 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T01:15:15.053 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T01:15:16.459 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T01:15:18.375 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T01:15:20.226 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T01:15:20.788 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T01:15:21.376 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T01:15:21.947 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T01:15:22.908 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T01:15:23.871 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T01:15:24.650 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T01:15:25.425 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T01:15:26.683 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T01:15:29.341 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T01:15:30.551 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T01:15:31.664 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T01:15:36.827 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T01:15:37.937 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T01:15:39.067 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T01:15:40.145 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T01:15:41.286 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T01:15:42.789 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T01:15:43.981 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T01:15:45.379 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T01:15:46.635 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T01:15:48.642 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T01:15:50.454 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T01:15:51.355 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T01:15:52.233 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T01:15:55.045 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T01:15:56.257 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T01:16:23.228 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T01:16:24.242 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T01:16:25.440 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T01:16:28.917 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T01:16:30.066 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T01:16:31.958 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T01:16:42.358 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T01:17:07.391 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T01:17:35.655 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T01:19:31.982 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T01:19:43.784 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T01:20:07.404 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T01:20:08.880 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T01:20:15.885 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T01:20:21.306 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T01:20:24.349 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T01:20:25.357 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T01:20:30.057 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T01:20:31.263 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T01:20:32.276 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T01:20:33.319 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T01:20:52.594 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T01:20:56.237 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T01:20:57.297 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T01:20:58.274 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T01:20:59.411 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T01:21:06.571 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T01:21:10.688 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T01:21:14.744 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T01:21:15.869 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T01:21:16.965 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T01:21:18.082 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T01:21:19.176 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T01:21:20.301 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T01:21:21.403 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T01:21:22.435 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T01:21:24.283 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T01:21:28.386 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T01:21:34.575 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T01:21:36.949 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T01:21:42.488 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T01:21:52.192 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T01:21:54.139 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T01:21:58.222 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T01:22:05.605 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T01:22:07.763 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T01:22:08.929 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T01:22:10.508 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T01:22:11.553 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T01:22:18.608 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T01:22:19.618 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T01:22:20.626 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T01:22:21.669 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T01:22:22.675 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T01:22:24.141 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T01:22:35.995 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T01:22:37.569 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T01:22:38.892 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T01:22:40.429 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T01:22:42.102 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T01:22:47.429 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T01:22:49.009 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T01:22:55.210 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T01:23:17.026 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T01:23:54.654 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T01:23:57.389 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T01:24:00.177 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T01:24:01.588 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T01:24:03.053 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T01:24:04.242 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T01:24:05.862 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T01:24:07.406 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T01:24:10.051 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T01:24:10.989 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T01:24:11.938 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T01:24:12.877 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T01:24:13.740 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T01:24:14.647 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T01:24:15.638 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T01:24:16.539 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T01:24:17.403 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T01:24:18.420 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T01:24:19.289 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T01:24:20.171 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T01:24:21.048 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T01:24:21.949 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T01:24:22.855 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T01:24:23.864 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T01:24:24.872 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T01:24:26.343 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T01:24:27.378 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T01:24:28.398 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T01:24:29.412 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T01:24:30.428 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T01:24:31.343 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T01:24:32.230 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T01:24:33.090 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T01:24:33.953 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T01:25:24.783 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T01:26:16.146 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T01:26:26.541 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T01:26:27.572 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T01:27:29.369 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T01:28:31.292 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T01:28:32.333 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T01:28:33.342 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T01:28:34.246 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T01:28:35.110 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T01:29:07.656 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T01:29:17.010 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T01:29:26.406 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T01:29:27.418 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T01:29:28.416 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T01:29:29.437 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T01:29:30.934 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T01:29:31.934 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T01:29:32.949 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T01:29:34.026 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T01:29:35.157 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T01:29:36.339 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T01:29:37.505 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T01:29:38.573 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T01:29:39.590 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T01:29:41.293 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T01:29:42.955 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T01:29:45.580 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T01:29:47.959 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T01:29:50.522 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T01:29:53.058 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T01:29:55.629 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T01:29:58.049 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T01:30:00.491 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T01:30:03.101 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T01:30:05.684 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T01:30:06.701 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T01:30:07.717 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T01:30:08.798 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T01:30:11.452 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T01:30:14.053 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T01:30:16.665 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T01:30:18.771 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T01:30:39.706 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T01:30:41.161 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T01:30:42.621 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:30:44.021 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T01:30:45.923 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T01:30:47.598 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T01:30:48.701 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T01:30:50.291 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T01:30:51.207 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T01:30:52.087 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T01:30:52.956 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T01:30:53.866 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T01:30:54.900 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T01:30:55.842 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T01:30:57.339 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T01:30:58.258 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T01:30:59.090 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T01:30:59.939 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T01:31:00.768 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T01:31:01.652 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T01:31:02.600 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T01:31:03.646 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T01:31:04.493 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T01:31:05.361 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T01:31:06.183 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T01:31:07.192 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T01:31:08.146 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T01:31:09.175 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T01:31:10.165 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T01:31:11.123 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T01:31:12.128 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T01:31:13.224 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T01:31:14.269 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T01:31:15.286 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T01:31:16.299 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T01:31:17.318 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T01:31:18.301 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:31:19.438 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T01:31:20.574 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T01:31:21.703 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T01:31:22.673 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T01:31:23.614 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T01:31:24.572 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T01:31:25.671 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T01:31:26.619 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T01:31:27.663 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:31:28.825 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T01:31:29.738 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T01:31:30.754 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T01:31:31.785 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T01:31:42.605 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T01:31:43.588 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T01:31:53.606 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T01:31:54.694 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T01:31:55.795 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T01:31:56.690 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T01:31:57.610 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:31:58.549 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:31:59.547 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T01:32:00.507 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T01:32:01.437 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T01:32:02.349 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T01:32:03.289 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T01:32:04.306 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T01:32:05.231 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T01:32:06.325 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T01:32:07.382 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T01:32:08.559 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T01:32:09.481 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T01:32:10.708 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T01:32:21.907 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T01:32:22.766 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:32:23.724 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:32:24.721 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T01:32:25.767 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T01:32:28.135 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T01:32:29.188 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T01:32:30.731 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T01:32:36.531 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T01:32:38.666 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T01:32:49.233 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T01:32:59.472 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T01:33:00.403 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T01:33:01.657 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T01:33:17.182 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T01:33:40.568 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T01:33:44.270 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T01:33:46.615 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T01:33:49.013 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T01:33:51.141 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T01:33:52.079 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T01:33:56.408 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T01:34:01.504 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T01:34:20.781 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T01:34:28.188 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T01:34:30.475 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T01:34:32.595 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T01:34:33.833 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T01:34:39.634 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T01:34:43.245 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T01:34:44.652 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T01:34:46.769 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T01:34:53.277 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T01:34:57.001 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T01:35:01.824 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T01:35:03.980 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T01:35:04.451 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T01:35:08.661 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T01:35:16.616 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T01:35:19.293 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T01:35:23.299 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T01:35:24.904 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T01:36:07.808 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T01:36:08.279 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T01:36:09.567 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T01:36:10.571 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T01:36:11.561 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T01:36:12.759 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T01:36:12.780 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T01:36:12.780 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.780 INFO:teuthology.orchestra.run.smithi019.stdout:=============================== warnings summary =============================== 2024-09-12T01:36:12.780 INFO:teuthology.orchestra.run.smithi019.stdout:.tox/py/lib/python3.9/site-packages/boto/plugin.py:40 2024-09-12T01:36:12.780 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib; see the module's documentation for alternative uses 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout: import imp 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py:120 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout: if boto_type is 'S3Connection': 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_headers.py:124 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3.py:359 2024-09-12T01:36:12.781 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence \W 2024-09-12T01:36:12.782 INFO:teuthology.orchestra.run.smithi019.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T01:36:12.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.782 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T01:36:12.782 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T01:36:12.782 INFO:teuthology.orchestra.run.smithi019.stdout: if k is 'BucketName': 2024-09-12T01:36:12.782 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.782 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T01:36:12.782 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout: @pytest.mark.timeout(10) 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T01:36:12.783 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:12.784 INFO:teuthology.orchestra.run.smithi019.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:36:12.784 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.784 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T01:36:12.784 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:12.784 INFO:teuthology.orchestra.run.smithi019.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T01:36:12.784 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.784 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T01:36:12.784 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:12.784 INFO:teuthology.orchestra.run.smithi019.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:12.784 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.784 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.785 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T01:36:12.786 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:12.786 INFO:teuthology.orchestra.run.smithi019.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:12.786 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.786 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T01:36:12.786 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:12.786 INFO:teuthology.orchestra.run.smithi019.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T01:36:12.786 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.786 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T01:36:12.786 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:12.786 INFO:teuthology.orchestra.run.smithi019.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:12.787 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.787 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T01:36:12.787 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence \$ 2024-09-12T01:36:12.787 INFO:teuthology.orchestra.run.smithi019.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T01:36:12.787 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.787 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_headers.py: 29 warnings 2024-09-12T01:36:12.787 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_iam.py: 82 warnings 2024-09-12T01:36:12.787 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3.py: 497 warnings 2024-09-12T01:36:12.787 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_s3select.py: 33 warnings 2024-09-12T01:36:12.787 INFO:teuthology.orchestra.run.smithi019.stdout:s3tests_boto3/functional/test_sns.py: 3 warnings 2024-09-12T01:36:12.788 INFO:teuthology.orchestra.run.smithi019.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'smithi019.front.sepia.ceph.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:36:12.788 INFO:teuthology.orchestra.run.smithi019.stdout: warnings.warn( 2024-09-12T01:36:12.788 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:36:12.788 INFO:teuthology.orchestra.run.smithi019.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T01:36:12.788 INFO:teuthology.orchestra.run.smithi019.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 662 warnings in 1921.55s (0:32:01) = 2024-09-12T01:36:12.916 INFO:teuthology.orchestra.run.smithi019.stdout:___________________________________ summary ____________________________________ 2024-09-12T01:36:12.916 INFO:teuthology.orchestra.run.smithi019.stdout: py: commands succeeded 2024-09-12T01:36:12.917 INFO:teuthology.orchestra.run.smithi019.stdout: congratulations :) 2024-09-12T01:36:12.935 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T01:36:12.936 DEBUG:teuthology.orchestra.run.smithi019:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T01:36:13.046 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:36:13.047 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T01:36:13.047 DEBUG:teuthology.orchestra.run.smithi019:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T01:36:13.077 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T01:36:13.078 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T01:36:13.277 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T01:36:13.290 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:36:13.290 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T01:36:13.291 DEBUG:teuthology.orchestra.run.smithi019:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:13.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:36:13.321 INFO:teuthology.orchestra.run.smithi019.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T01:36:13.321 DEBUG:teuthology.orchestra.run.smithi019:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:13.392 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T01:36:13.392 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T01:36:13.462 INFO:tasks.workunit:timeout=3h 2024-09-12T01:36:13.462 INFO:tasks.workunit:cleanup=True 2024-09-12T01:36:13.462 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T01:36:13.533 INFO:tasks.workunit.client.0.smithi019.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T01:37:00.059 INFO:tasks.workunit.client.0.smithi019.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T01:37:00.060 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T01:37:00.060 INFO:tasks.workunit.client.0.smithi019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T01:37:00.060 INFO:tasks.workunit.client.0.smithi019.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T01:37:00.060 INFO:tasks.workunit.client.0.smithi019.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T01:37:00.060 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T01:37:00.060 INFO:tasks.workunit.client.0.smithi019.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T01:37:00.060 INFO:tasks.workunit.client.0.smithi019.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T01:37:00.060 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T01:37:00.060 INFO:tasks.workunit.client.0.smithi019.stderr: git switch -c 2024-09-12T01:37:00.060 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T01:37:00.060 INFO:tasks.workunit.client.0.smithi019.stderr:Or undo this operation with: 2024-09-12T01:37:00.061 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T01:37:00.061 INFO:tasks.workunit.client.0.smithi019.stderr: git switch - 2024-09-12T01:37:00.061 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T01:37:00.061 INFO:tasks.workunit.client.0.smithi019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T01:37:00.061 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T01:37:00.061 INFO:tasks.workunit.client.0.smithi019.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T01:37:00.063 DEBUG:teuthology.orchestra.run.smithi019:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T01:37:00.133 INFO:tasks.workunit.client.0.smithi019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T01:37:00.135 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:37:00.135 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T01:37:00.185 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T01:37:00.235 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T01:37:00.276 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T01:37:00.277 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:37:00.277 INFO:tasks.workunit.client.0.smithi019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T01:37:00.317 INFO:tasks.workunit.client.0.smithi019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T01:37:00.321 DEBUG:teuthology.orchestra.run.smithi019:> set -ex 2024-09-12T01:37:00.321 DEBUG:teuthology.orchestra.run.smithi019:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T01:37:00.394 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T01:37:00.396 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T01:37:00.396 DEBUG:teuthology.orchestra.run.smithi019:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:37:00.469 INFO:tasks.workunit.client.0.smithi019.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T01:37:00.469 INFO:tasks.workunit.client.0.smithi019.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:37:00.470 INFO:tasks.workunit.client.0.smithi019.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:37:02.878 INFO:tasks.workunit.client.0.smithi019.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T01:37:02.878 INFO:tasks.workunit.client.0.smithi019.stderr:++ deactivate nondestructive 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ hash -r 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ unset VIRTUAL_ENV 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ export VIRTUAL_ENV 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ _OLD_VIRTUAL_PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ export PATH 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n '' ']' 2024-09-12T01:37:02.879 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -z '' ']' 2024-09-12T01:37:02.880 INFO:tasks.workunit.client.0.smithi019.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T01:37:02.880 INFO:tasks.workunit.client.0.smithi019.stderr:++ PS1='(rgw) ' 2024-09-12T01:37:02.880 INFO:tasks.workunit.client.0.smithi019.stderr:++ export PS1 2024-09-12T01:37:02.880 INFO:tasks.workunit.client.0.smithi019.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:37:02.880 INFO:tasks.workunit.client.0.smithi019.stderr:++ hash -r 2024-09-12T01:37:02.880 INFO:tasks.workunit.client.0.smithi019.stderr:+ pip install pip --upgrade 2024-09-12T01:37:03.116 INFO:tasks.workunit.client.0.smithi019.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.9/site-packages (21.3.1) 2024-09-12T01:37:03.325 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting pip 2024-09-12T01:37:03.331 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T01:37:03.377 INFO:tasks.workunit.client.0.smithi019.stdout:Installing collected packages: pip 2024-09-12T01:37:03.377 INFO:tasks.workunit.client.0.smithi019.stdout: Attempting uninstall: pip 2024-09-12T01:37:03.377 INFO:tasks.workunit.client.0.smithi019.stdout: Found existing installation: pip 21.3.1 2024-09-12T01:37:03.539 INFO:tasks.workunit.client.0.smithi019.stdout: Uninstalling pip-21.3.1: 2024-09-12T01:37:03.544 INFO:tasks.workunit.client.0.smithi019.stdout: Successfully uninstalled pip-21.3.1 2024-09-12T01:37:04.312 INFO:tasks.workunit.client.0.smithi019.stdout:Successfully installed pip-24.2 2024-09-12T01:37:04.361 INFO:tasks.workunit.client.0.smithi019.stderr:+ pip install boto3 2024-09-12T01:37:05.178 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting boto3 2024-09-12T01:37:05.180 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T01:37:05.797 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T01:37:05.798 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T01:37:05.856 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T01:37:05.857 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T01:37:05.912 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T01:37:05.913 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T01:37:05.971 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:37:05.972 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T01:37:06.073 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting urllib3<1.27,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:37:06.075 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached urllib3-1.26.20-py2.py3-none-any.whl.metadata (50 kB) 2024-09-12T01:37:06.251 INFO:tasks.workunit.client.0.smithi019.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T01:37:06.252 INFO:tasks.workunit.client.0.smithi019.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T01:37:06.257 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T01:37:06.258 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T01:37:06.268 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T01:37:06.269 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T01:37:06.270 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T01:37:06.272 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2024-09-12T01:37:06.273 INFO:tasks.workunit.client.0.smithi019.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T01:37:06.350 INFO:tasks.workunit.client.0.smithi019.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T01:37:07.455 INFO:tasks.workunit.client.0.smithi019.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-1.26.20 2024-09-12T01:37:07.574 INFO:tasks.workunit.client.0.smithi019.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T01:37:07.701 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T01:37:07.737 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:07.737 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:07.777 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.777+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:07.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.779+0000 7efef620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:07.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.779+0000 7efef620e800 20 realm 2024-09-12T01:37:07.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.779+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:07.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.779+0000 7efef620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:07.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.779+0000 7efef620e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:07.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.779+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:07.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.779+0000 7efef620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:07.779 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.780+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:07.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.780+0000 7efef620e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:07.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.780+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:07.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.781+0000 7efef620e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:07.780 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.781+0000 7efef620e800 20 searching for the correct realm 2024-09-12T01:37:07.784 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.784+0000 7efef1058640 0 -- 172.21.15.19:0/1037223652 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7efedc051140 msgr2=0x7efedc04ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:07.989 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.990+0000 7efef205a640 0 -- 172.21.15.19:0/1037223652 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x556e4eaff600 msgr2=0x556e4eb01aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:07.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.995+0000 7efef620e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:37:07.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.995+0000 7efef620e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:37:07.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.995+0000 7efef620e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:37:07.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.995+0000 7efef620e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:37:07.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.995+0000 7efef620e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:37:07.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.995+0000 7efef620e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:37:07.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.995+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:07.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.995+0000 7efef620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:07.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.995+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:07.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:07.995 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:07.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:37:07.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 20 zone default found 2024-09-12T01:37:07.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 4 Realm: () 2024-09-12T01:37:07.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:37:07.997 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:37:07.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:37:07.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 20 zonegroup default 2024-09-12T01:37:07.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:07.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:07.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.996+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:07.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.997+0000 7efef620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:07.998 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.997+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:07.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.997+0000 7efef620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:07.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.997+0000 7efef620e800 20 started sync module instance, tier type = 2024-09-12T01:37:07.999 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:07.997+0000 7efef620e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:37:08.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.007+0000 7efef620e800 20 add_watcher() i=0 2024-09-12T01:37:08.006 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.007+0000 7efef620e800 20 add_watcher() i=1 2024-09-12T01:37:08.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.007+0000 7efef620e800 20 add_watcher() i=2 2024-09-12T01:37:08.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.007+0000 7efef620e800 20 add_watcher() i=3 2024-09-12T01:37:08.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.007+0000 7efef620e800 20 add_watcher() i=4 2024-09-12T01:37:08.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.007+0000 7efef620e800 20 add_watcher() i=5 2024-09-12T01:37:08.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.007+0000 7efef620e800 20 add_watcher() i=6 2024-09-12T01:37:08.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.008+0000 7efef620e800 20 add_watcher() i=7 2024-09-12T01:37:08.007 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.008+0000 7efef620e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:37:08.009 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.010+0000 7efda37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:08.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.010+0000 7efef620e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:37:08.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.010+0000 7efef620e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:37:08.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.011+0000 7efef620e800 5 note: GC not initialized 2024-09-12T01:37:08.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.011+0000 7efda27fc640 20 reqs_thread_entry: start 2024-09-12T01:37:08.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.011+0000 7efef620e800 20 init_complete bucket index max shards: 11 2024-09-12T01:37:08.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.011+0000 7efef620e800 20 Filter name: none 2024-09-12T01:37:08.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.011+0000 7efd13fff640 20 reqs_thread_entry: start 2024-09-12T01:37:08.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.011+0000 7efef620e800 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T01:37:08.011 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.011+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:08.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.012+0000 7efef620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:08.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.012+0000 7efef620e800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T01:37:08.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.012+0000 7efef620e800 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:37:08.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.012+0000 7efef620e800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T01:37:08.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.012+0000 7efef620e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:08.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.012+0000 7efef620e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:08.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.012+0000 7efef620e800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T01:37:08.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.012+0000 7efef620e800 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:37:08.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.012+0000 7efef620e800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:37:08.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.012+0000 7efef620e800 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T01:37:08.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.013+0000 7efef620e800 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:37:08.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.013+0000 7efef620e800 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:37:08.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.013+0000 7efef620e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T01:37:08.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.014+0000 7efdd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461302455 cookie 93932254984624 notifier 9285 bl.length()=613 2024-09-12T01:37:08.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.014+0000 7efdd57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T01:37:08.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.014+0000 7efdd57fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T01:37:08.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.017+0000 7efef620e800 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:37:08.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.017+0000 7efef620e800 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:37:08.016 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.017+0000 7efef620e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T01:37:08.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.017+0000 7efdd57fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461302456 cookie 93932254976384 notifier 9285 bl.length()=191 2024-09-12T01:37:08.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.017+0000 7efdd57fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T01:37:08.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.017+0000 7efdd57fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T01:37:08.019 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.020+0000 7efda37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:08.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.022+0000 7efef620e800 20 remove_watcher() i=0 2024-09-12T01:37:08.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.022+0000 7efef620e800 2 removed watcher, disabling cache 2024-09-12T01:37:08.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.023+0000 7efef620e800 20 remove_watcher() i=1 2024-09-12T01:37:08.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.024+0000 7efef620e800 20 remove_watcher() i=2 2024-09-12T01:37:08.025 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.026+0000 7efef620e800 20 remove_watcher() i=3 2024-09-12T01:37:08.026 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.027+0000 7efef620e800 20 remove_watcher() i=4 2024-09-12T01:37:08.027 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.028+0000 7efef620e800 20 remove_watcher() i=5 2024-09-12T01:37:08.028 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.029+0000 7efef620e800 20 remove_watcher() i=6 2024-09-12T01:37:08.029 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.030+0000 7efef620e800 20 remove_watcher() i=7 2024-09-12T01:37:08.219 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:08.219 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:08.268 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:08.268 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:08.329 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:08.329 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:08.377 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:08.377 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:08.405 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T01:37:08.405 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T01:37:08.408 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:08.408 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:08.448 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:08.449 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:08.486 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:08.487 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:08.531 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:37:08.560 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:08.560 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:08.802 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.803+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:08.804 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.805+0000 7f6d3a737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:08.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.805+0000 7f6d3a737800 20 realm 2024-09-12T01:37:08.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.805+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:08.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.805+0000 7f6d3a737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:08.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.805+0000 7f6d3a737800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:08.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.805+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:08.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.805+0000 7f6d3a737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:08.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.805+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:08.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.806+0000 7f6d3a737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:08.805 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.806+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:08.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.807+0000 7f6d3a737800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:08.806 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.807+0000 7f6d3a737800 20 searching for the correct realm 2024-09-12T01:37:08.810 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:08.810+0000 7f6d35c20640 0 -- 172.21.15.19:0/2927497878 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7f6d2c065040 msgr2=0x7f6d2c0b2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:37:09.015 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.016+0000 7f6d35c20640 0 -- 172.21.15.19:0/2927497878 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x556f5280e3f0 msgr2=0x556f528108b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:09.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.021+0000 7f6d3a737800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:37:09.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.021+0000 7f6d3a737800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:37:09.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.021+0000 7f6d3a737800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:37:09.020 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.021+0000 7f6d3a737800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:37:09.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.021+0000 7f6d3a737800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:37:09.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.021+0000 7f6d3a737800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:37:09.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.021+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:09.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.021+0000 7f6d3a737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.021+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 20 zone default found 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 4 Realm: () 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 20 zonegroup default 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:09.022 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.022+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:09.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.023+0000 7f6d3a737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:09.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.023+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:09.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.023+0000 7f6d3a737800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:09.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.023+0000 7f6d3a737800 20 started sync module instance, tier type = 2024-09-12T01:37:09.023 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.023+0000 7f6d3a737800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:37:09.032 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.033+0000 7f6d3a737800 20 add_watcher() i=0 2024-09-12T01:37:09.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.033+0000 7f6d3a737800 20 add_watcher() i=1 2024-09-12T01:37:09.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.033+0000 7f6d3a737800 20 add_watcher() i=2 2024-09-12T01:37:09.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.033+0000 7f6d3a737800 20 add_watcher() i=3 2024-09-12T01:37:09.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.033+0000 7f6d3a737800 20 add_watcher() i=4 2024-09-12T01:37:09.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.033+0000 7f6d3a737800 20 add_watcher() i=5 2024-09-12T01:37:09.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.033+0000 7f6d3a737800 20 add_watcher() i=6 2024-09-12T01:37:09.033 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.034+0000 7f6d3a737800 20 add_watcher() i=7 2024-09-12T01:37:09.034 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.034+0000 7f6d3a737800 2 all 8 watchers are set, enabling cache 2024-09-12T01:37:09.035 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.036+0000 7f6becfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:09.036 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.037+0000 7f6d3a737800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:37:09.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.037+0000 7f6d3a737800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:37:09.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.037+0000 7f6d3a737800 5 note: GC not initialized 2024-09-12T01:37:09.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.037+0000 7f6b677fe640 20 reqs_thread_entry: start 2024-09-12T01:37:09.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.037+0000 7f6d3a737800 20 init_complete bucket index max shards: 11 2024-09-12T01:37:09.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.037+0000 7f6d3a737800 20 Filter name: none 2024-09-12T01:37:09.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.037+0000 7f6b657fa640 20 reqs_thread_entry: start 2024-09-12T01:37:09.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.037+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:09.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.038+0000 7f6d3a737800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:37:09.037 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.038+0000 7f6d3a737800 20 rados->read ofs=0 len=0 2024-09-12T01:37:09.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.039+0000 7f6d3a737800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:37:09.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.039+0000 7f6d3a737800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:37:09.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.039+0000 7f6d3a737800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T01:37:09.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.039+0000 7f6d3a737800 20 INFO: main: starting shard=0 2024-09-12T01:37:09.038 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.039+0000 7f6d3a737800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.0 2024-09-12T01:37:09.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.040+0000 7f6d3a737800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:09.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.040+0000 7f6d3a737800 20 INFO: main: starting shard=1 2024-09-12T01:37:09.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.040+0000 7f6d3a737800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.1 2024-09-12T01:37:09.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.040+0000 7f6d3a737800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:09.039 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.040+0000 7f6d3a737800 20 INFO: main: starting shard=2 2024-09-12T01:37:09.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.040+0000 7f6d3a737800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.2 2024-09-12T01:37:09.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.041+0000 7f6d3a737800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:09.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.041+0000 7f6d3a737800 20 INFO: main: starting shard=3 2024-09-12T01:37:09.040 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.041+0000 7f6d3a737800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.3 2024-09-12T01:37:09.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.041+0000 7f6d3a737800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:09.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.041+0000 7f6d3a737800 20 INFO: main: starting shard=4 2024-09-12T01:37:09.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.041+0000 7f6d3a737800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.4 2024-09-12T01:37:09.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.042+0000 7f6d3a737800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:09.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.042+0000 7f6d3a737800 20 INFO: main: starting shard=5 2024-09-12T01:37:09.041 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.042+0000 7f6d3a737800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.5 2024-09-12T01:37:09.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.043+0000 7f6d3a737800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:09.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.043+0000 7f6d3a737800 20 INFO: main: starting shard=6 2024-09-12T01:37:09.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.043+0000 7f6d3a737800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.6 2024-09-12T01:37:09.042 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.043+0000 7f6d3a737800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:09.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.043+0000 7f6d3a737800 20 INFO: main: starting shard=7 2024-09-12T01:37:09.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.043+0000 7f6d3a737800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.7 2024-09-12T01:37:09.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.043+0000 7f6d3a737800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:09.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.043+0000 7f6d3a737800 20 INFO: main: starting shard=8 2024-09-12T01:37:09.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.043+0000 7f6d3a737800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.8 2024-09-12T01:37:09.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.044+0000 7f6d3a737800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:09.043 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.044+0000 7f6d3a737800 20 INFO: main: starting shard=9 2024-09-12T01:37:09.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.044+0000 7f6d3a737800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.9 2024-09-12T01:37:09.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.045+0000 7f6d3a737800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:09.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.045+0000 7f6d3a737800 20 INFO: main: starting shard=10 2024-09-12T01:37:09.044 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.045+0000 7f6d3a737800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.10 2024-09-12T01:37:09.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.046+0000 7f6d3a737800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:09.045 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.046+0000 7f6d3a737800 20 INFO: main: done 2024-09-12T01:37:09.046 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.046+0000 7f6becfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:09.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.049+0000 7f6d3a737800 20 remove_watcher() i=0 2024-09-12T01:37:09.048 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.049+0000 7f6d3a737800 2 removed watcher, disabling cache 2024-09-12T01:37:09.049 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.050+0000 7f6d3a737800 20 remove_watcher() i=1 2024-09-12T01:37:09.050 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.051+0000 7f6d3a737800 20 remove_watcher() i=2 2024-09-12T01:37:09.052 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.052+0000 7f6d3a737800 20 remove_watcher() i=3 2024-09-12T01:37:09.053 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.054+0000 7f6d3a737800 20 remove_watcher() i=4 2024-09-12T01:37:09.054 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.055+0000 7f6d3a737800 20 remove_watcher() i=5 2024-09-12T01:37:09.055 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.056+0000 7f6d3a737800 20 remove_watcher() i=6 2024-09-12T01:37:09.056 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.057+0000 7f6d3a737800 20 remove_watcher() i=7 2024-09-12T01:37:09.069 INFO:tasks.workunit.client.0.smithi019.stderr:rados -p default.rgw.buckets.data ls | grep ccfd3a45-1e84-4c1c-a3fd-82f7a6e501b1 2024-09-12T01:37:09.094 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:09.094 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:09.138 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:09.138+0000 7f88ea1bb640 0 -- 172.21.15.19:0/223496032 >> [v2:172.21.15.19:6816/1125148903,v1:172.21.15.19:6817/1125148903] conn(0x7f88e40840b0 msgr2=0x7f88e4069040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:09.145 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T01:37:09.145 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T01:37:09.147 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:37:10.560 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:10.560 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:10.600 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:37:11.037 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T01:37:11.066 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:11.066 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:11.105 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.106+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.108+0000 7fe6b862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:11.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.108+0000 7fe6b862f800 20 realm 2024-09-12T01:37:11.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.108+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.108+0000 7fe6b862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:11.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.108+0000 7fe6b862f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:11.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.108+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.107 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.108+0000 7fe6b862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:11.108 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.108+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.108 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.109+0000 7fe6b862f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:11.108 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.109+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.108 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.109+0000 7fe6b862f800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:11.109 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.109+0000 7fe6b862f800 20 searching for the correct realm 2024-09-12T01:37:11.112 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.113+0000 7fe6b5918640 0 -- 172.21.15.19:0/903425580 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fe6ac00ba60 msgr2=0x7fe6ac067070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:37:11.318 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.319+0000 7fe6b691a640 0 -- 172.21.15.19:0/903425580 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x55cf6f6c9150 msgr2=0x55cf6f6cb5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:11.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.324+0000 7fe6b862f800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:37:11.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.324+0000 7fe6b862f800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:37:11.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.324+0000 7fe6b862f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:37:11.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.324+0000 7fe6b862f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:37:11.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.324+0000 7fe6b862f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:37:11.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.324+0000 7fe6b862f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:37:11.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.324+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:11.324 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 20 zone default found 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 4 Realm: () 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 20 zonegroup default 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.325+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.326+0000 7fe6b862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.326+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.326 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.326+0000 7fe6b862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:11.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.326+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.326+0000 7fe6b862f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:11.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.326+0000 7fe6b862f800 20 started sync module instance, tier type = 2024-09-12T01:37:11.327 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.326+0000 7fe6b862f800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:37:11.335 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.336+0000 7fe6b862f800 20 add_watcher() i=0 2024-09-12T01:37:11.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.336+0000 7fe6b862f800 20 add_watcher() i=1 2024-09-12T01:37:11.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.336+0000 7fe6b862f800 20 add_watcher() i=2 2024-09-12T01:37:11.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.336+0000 7fe6b862f800 20 add_watcher() i=3 2024-09-12T01:37:11.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.336+0000 7fe6b862f800 20 add_watcher() i=4 2024-09-12T01:37:11.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.336+0000 7fe6b862f800 20 add_watcher() i=5 2024-09-12T01:37:11.336 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.336+0000 7fe6b862f800 20 add_watcher() i=6 2024-09-12T01:37:11.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.338+0000 7fe6b862f800 20 add_watcher() i=7 2024-09-12T01:37:11.337 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.338+0000 7fe6b862f800 2 all 8 watchers are set, enabling cache 2024-09-12T01:37:11.339 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.340+0000 7fe56cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:11.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.340+0000 7fe6b862f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:37:11.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.340+0000 7fe6b862f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:37:11.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.340+0000 7fe6b862f800 5 note: GC not initialized 2024-09-12T01:37:11.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.341+0000 7fe4e77fe640 20 reqs_thread_entry: start 2024-09-12T01:37:11.340 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.341+0000 7fe6b862f800 20 init_complete bucket index max shards: 11 2024-09-12T01:37:11.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.341+0000 7fe6b862f800 20 Filter name: none 2024-09-12T01:37:11.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.341+0000 7fe4e57fa640 20 reqs_thread_entry: start 2024-09-12T01:37:11.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.341+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.342+0000 7fe6b862f800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:37:11.341 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.342+0000 7fe6b862f800 20 rados->read ofs=0 len=0 2024-09-12T01:37:11.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.342+0000 7fe6b862f800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:37:11.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.342+0000 7fe6b862f800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T01:37:11.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.342+0000 7fe6b862f800 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T01:37:11.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.342+0000 7fe6b862f800 20 INFO: main: starting shard=0 2024-09-12T01:37:11.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.342+0000 7fe6b862f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.0 2024-09-12T01:37:11.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.343+0000 7fe6b862f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:11.342 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.343+0000 7fe6b862f800 20 INFO: main: starting shard=1 2024-09-12T01:37:11.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.343+0000 7fe6b862f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.1 2024-09-12T01:37:11.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.343+0000 7fe6b862f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:11.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.343+0000 7fe6b862f800 20 INFO: main: starting shard=2 2024-09-12T01:37:11.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.343+0000 7fe6b862f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.2 2024-09-12T01:37:11.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.344+0000 7fe6b862f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:11.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.344+0000 7fe6b862f800 20 INFO: main: starting shard=3 2024-09-12T01:37:11.343 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.344+0000 7fe6b862f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.3 2024-09-12T01:37:11.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.344+0000 7fe6b862f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:11.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.344+0000 7fe6b862f800 20 INFO: main: starting shard=4 2024-09-12T01:37:11.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.344+0000 7fe6b862f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.4 2024-09-12T01:37:11.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.345+0000 7fe6b862f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:11.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.345+0000 7fe6b862f800 20 INFO: main: starting shard=5 2024-09-12T01:37:11.344 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.345+0000 7fe6b862f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.5 2024-09-12T01:37:11.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.345+0000 7fe6b862f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:11.345 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.345+0000 7fe6b862f800 20 INFO: main: starting shard=6 2024-09-12T01:37:11.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.345+0000 7fe6b862f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.6 2024-09-12T01:37:11.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.346+0000 7fe6b862f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:11.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.346+0000 7fe6b862f800 20 INFO: main: starting shard=7 2024-09-12T01:37:11.346 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.346+0000 7fe6b862f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.7 2024-09-12T01:37:11.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.347+0000 7fe6b862f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:11.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.347+0000 7fe6b862f800 20 INFO: main: starting shard=8 2024-09-12T01:37:11.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.347+0000 7fe6b862f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.8 2024-09-12T01:37:11.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.347+0000 7fe6b862f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:11.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.347+0000 7fe6b862f800 20 INFO: main: starting shard=9 2024-09-12T01:37:11.347 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.347+0000 7fe6b862f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.9 2024-09-12T01:37:11.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.348+0000 7fe6b862f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:11.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.348+0000 7fe6b862f800 20 INFO: main: starting shard=10 2024-09-12T01:37:11.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.348+0000 7fe6b862f800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.10 2024-09-12T01:37:11.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.349+0000 7fe6b862f800 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T01:37:11.348 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.349+0000 7fe6b862f800 20 INFO: main: done 2024-09-12T01:37:11.349 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.350+0000 7fe56cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:11.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.352+0000 7fe6b862f800 20 remove_watcher() i=0 2024-09-12T01:37:11.352 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.352+0000 7fe6b862f800 2 removed watcher, disabling cache 2024-09-12T01:37:11.353 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.353+0000 7fe6b862f800 20 remove_watcher() i=1 2024-09-12T01:37:11.354 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.355+0000 7fe6b862f800 20 remove_watcher() i=2 2024-09-12T01:37:11.355 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.356+0000 7fe6b862f800 20 remove_watcher() i=3 2024-09-12T01:37:11.356 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.357+0000 7fe6b862f800 20 remove_watcher() i=4 2024-09-12T01:37:11.357 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.358+0000 7fe6b862f800 20 remove_watcher() i=5 2024-09-12T01:37:11.359 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.360+0000 7fe6b862f800 20 remove_watcher() i=6 2024-09-12T01:37:11.360 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.361+0000 7fe6b862f800 20 remove_watcher() i=7 2024-09-12T01:37:11.373 INFO:tasks.workunit.client.0.smithi019.stderr:rados -p default.rgw.buckets.data ls | grep 1774316c-8fed-420b-aba8-2d8ef5f2be9d 2024-09-12T01:37:11.397 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:11.397 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:11.439 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:11.440+0000 7fe4733e6640 0 -- 172.21.15.19:0/804732064 >> [v2:172.21.15.135:6800/2991448734,v1:172.21.15.135:6801/2991448734] conn(0x7fe46c061470 msgr2=0x7fe46c05fee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:11.447 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T01:37:11.447 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T01:37:11.450 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:11.450 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:11.480 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:11.480 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:11.519 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:11.520 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:11.550 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T01:37:12.965 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:12.965 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:13.059 INFO:tasks.workunit.client.0.smithi019.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T01:37:13.060 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T01:37:13.475 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:13.475 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:13.545 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:13.545 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:13.591 INFO:tasks.workunit.client.0.smithi019.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T01:37:13.591 INFO:tasks.workunit.client.0.smithi019.stderr: 2024-09-12T01:37:13.593 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:13.593 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:13.664 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:13.665 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:13.726 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:13.726 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:13.764 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T01:37:15.173 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:15.173 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:15.238 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:15.238 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:17.310 INFO:tasks.workunit.client.0.smithi019.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T01:37:17.737 INFO:tasks.workunit.client.0.smithi019.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T01:37:17.768 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:17.769 INFO:tasks.workunit.client.0.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:18.010 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.011+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.013+0000 7f9207687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:18.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.013+0000 7f9207687800 20 realm 2024-09-12T01:37:18.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.013+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.013+0000 7f9207687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:18.012 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.013+0000 7f9207687800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:18.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.013+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.013+0000 7f9207687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:18.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.013+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.014+0000 7f9207687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:18.013 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.014+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.014+0000 7f9207687800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:18.014 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.014+0000 7f9207687800 20 searching for the correct realm 2024-09-12T01:37:18.017 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.018+0000 7f9204970640 0 -- 172.21.15.19:0/1458963294 >> [v2:172.21.15.135:6800/2991448734,v1:172.21.15.135:6801/2991448734] conn(0x55eb506103a0 msgr2=0x55eb50612860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:18.021 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.021+0000 7f9205171640 0 -- 172.21.15.19:0/1458963294 >> [v2:172.21.15.19:6824/737061592,v1:172.21.15.19:6825/737061592] conn(0x7f9200069040 msgr2=0x7f920007f430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:18.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.229+0000 7f9207687800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:37:18.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.229+0000 7f9207687800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:37:18.228 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.229+0000 7f9207687800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:37:18.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.229+0000 7f9207687800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:37:18.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.229+0000 7f9207687800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:37:18.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.229+0000 7f9207687800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:37:18.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.229+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.229+0000 7f9207687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:18.229 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.229+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.229+0000 7f9207687800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:18.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.229+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.230+0000 7f9207687800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:37:18.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.230+0000 7f9207687800 20 zone default found 2024-09-12T01:37:18.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.230+0000 7f9207687800 4 Realm: () 2024-09-12T01:37:18.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.230+0000 7f9207687800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:37:18.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.230+0000 7f9207687800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:37:18.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.230+0000 7f9207687800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:37:18.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.230+0000 7f9207687800 20 zonegroup default 2024-09-12T01:37:18.230 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.230+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.230+0000 7f9207687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:18.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.230+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.231+0000 7f9207687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:18.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.231+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.231+0000 7f9207687800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:18.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.231+0000 7f9207687800 20 started sync module instance, tier type = 2024-09-12T01:37:18.231 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.231+0000 7f9207687800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:37:18.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.241+0000 7f9207687800 20 add_watcher() i=0 2024-09-12T01:37:18.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.241+0000 7f9207687800 20 add_watcher() i=1 2024-09-12T01:37:18.240 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.241+0000 7f9207687800 20 add_watcher() i=2 2024-09-12T01:37:18.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.241+0000 7f9207687800 20 add_watcher() i=3 2024-09-12T01:37:18.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.241+0000 7f9207687800 20 add_watcher() i=4 2024-09-12T01:37:18.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.241+0000 7f9207687800 20 add_watcher() i=5 2024-09-12T01:37:18.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.241+0000 7f9207687800 20 add_watcher() i=6 2024-09-12T01:37:18.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.242+0000 7f9207687800 20 add_watcher() i=7 2024-09-12T01:37:18.241 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.242+0000 7f9207687800 2 all 8 watchers are set, enabling cache 2024-09-12T01:37:18.243 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.244+0000 7f90bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:18.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.244+0000 7f9207687800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:37:18.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.244+0000 7f9207687800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:37:18.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.244+0000 7f9207687800 5 note: GC not initialized 2024-09-12T01:37:18.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.245+0000 7f90ba7e4640 20 reqs_thread_entry: start 2024-09-12T01:37:18.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.245+0000 7f9207687800 20 init_complete bucket index max shards: 11 2024-09-12T01:37:18.244 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.245+0000 7f9207687800 20 Filter name: none 2024-09-12T01:37:18.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.245+0000 7f902bfff640 20 reqs_thread_entry: start 2024-09-12T01:37:18.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.245+0000 7f9207687800 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T01:37:18.245 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.245+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782 : miss 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 20 rados->read ofs=0 len=0 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782 info.flags=0x17 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782 to cache LRU end 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782 2024-09-12T01:37:18.246 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.246+0000 7f9207687800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.0 2024-09-12T01:37:18.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.247+0000 7f9207687800 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T01:37:18.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.247+0000 7f9207687800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.1 2024-09-12T01:37:18.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.248+0000 7f9207687800 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T01:37:18.247 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.248+0000 7f9207687800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.2 2024-09-12T01:37:18.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.248+0000 7f9207687800 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T01:37:18.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.248+0000 7f9207687800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.3 2024-09-12T01:37:18.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.249+0000 7f9207687800 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T01:37:18.248 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.249+0000 7f9207687800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.4 2024-09-12T01:37:18.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.249+0000 7f9207687800 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T01:37:18.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.249+0000 7f9207687800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.5 2024-09-12T01:37:18.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.250+0000 7f9207687800 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T01:37:18.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.250+0000 7f9207687800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.6 2024-09-12T01:37:18.249 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.250+0000 7f9207687800 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T01:37:18.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.250+0000 7f9207687800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.7 2024-09-12T01:37:18.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.251+0000 7f9207687800 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T01:37:18.250 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.251+0000 7f9207687800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.8 2024-09-12T01:37:18.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.252+0000 7f9207687800 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T01:37:18.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.252+0000 7f9207687800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.9 2024-09-12T01:37:18.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.252+0000 7f9207687800 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T01:37:18.251 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.252+0000 7f9207687800 20 bucket index object: :.dir.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.782.10 2024-09-12T01:37:18.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.253+0000 7f9207687800 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T01:37:18.252 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.253+0000 7f9207687800 1 NOTICE: finished all shards (0 entries found) 2024-09-12T01:37:18.253 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.254+0000 7f90bb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:18.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.256+0000 7f9207687800 20 remove_watcher() i=0 2024-09-12T01:37:18.255 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.256+0000 7f9207687800 2 removed watcher, disabling cache 2024-09-12T01:37:18.256 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.257+0000 7f9207687800 20 remove_watcher() i=1 2024-09-12T01:37:18.257 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.258+0000 7f9207687800 20 remove_watcher() i=2 2024-09-12T01:37:18.258 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.259+0000 7f9207687800 20 remove_watcher() i=3 2024-09-12T01:37:18.260 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.261+0000 7f9207687800 20 remove_watcher() i=4 2024-09-12T01:37:18.261 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.262+0000 7f9207687800 20 remove_watcher() i=5 2024-09-12T01:37:18.262 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.263+0000 7f9207687800 20 remove_watcher() i=6 2024-09-12T01:37:18.263 INFO:tasks.workunit.client.0.smithi019.stderr:2024-09-12T01:37:18.264+0000 7f9207687800 20 remove_watcher() i=7 2024-09-12T01:37:18.275 INFO:tasks.workunit.client.0.smithi019.stderr:Deleting bucket versioning-bucket 2024-09-12T01:37:18.277 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:18.277 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:18.311 INFO:tasks.workunit.client.0.smithi019.stderr:/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib64/python3.9/site-packages/urllib3/connectionpool.py:1064: InsecureRequestWarning: Unverified HTTPS request is being made to host 'localhost'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/1.26.x/advanced-usage.html#ssl-warnings 2024-09-12T01:37:18.311 INFO:tasks.workunit.client.0.smithi019.stderr: warnings.warn( 2024-09-12T01:37:18.439 INFO:tasks.workunit.client.0.smithi019.stderr:Completed bucket versioning tests 2024-09-12T01:37:18.439 INFO:tasks.workunit.client.0.smithi019.stdout:Could not connect to the endpoint URL: "http://localhost:80/" 2024-09-12T01:37:18.439 INFO:tasks.workunit.client.0.smithi019.stdout:Could not connect to the endpoint URL: "http://localhost:8000/" 2024-09-12T01:37:18.439 INFO:tasks.workunit.client.0.smithi019.stdout:connected to https://localhost:443 2024-09-12T01:37:18.503 INFO:tasks.workunit.client.0.smithi019.stderr:+ deactivate 2024-09-12T01:37:18.503 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin ']' 2024-09-12T01:37:18.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ PATH=/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2024-09-12T01:37:18.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ export PATH 2024-09-12T01:37:18.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T01:37:18.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n '' ']' 2024-09-12T01:37:18.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T01:37:18.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ hash -r 2024-09-12T01:37:18.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' -n '' ']' 2024-09-12T01:37:18.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ unset VIRTUAL_ENV 2024-09-12T01:37:18.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T01:37:18.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ unset -f deactivate 2024-09-12T01:37:18.504 INFO:tasks.workunit.client.0.smithi019.stderr:+ echo OK. 2024-09-12T01:37:18.505 INFO:tasks.workunit.client.0.smithi019.stdout:OK. 2024-09-12T01:37:18.505 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T01:37:18.506 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T01:37:18.589 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T01:37:18.589 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T01:37:18.982 DEBUG:teuthology.parallel:result is None 2024-09-12T01:37:18.982 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:37:19.022 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:37:19.022 DEBUG:teuthology.orchestra.run.smithi019:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T01:37:19.091 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T01:37:19.091 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T01:37:19.102 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T01:37:19.112 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T01:37:19.112 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T01:37:19.112 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T01:37:19.195 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T01:37:19.195 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T01:37:19.253 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:19.253 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:19.290 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.291+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.292+0000 7feb5752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.292+0000 7feb5752e800 20 realm 2024-09-12T01:37:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.292+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.293+0000 7feb5752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.293+0000 7feb5752e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.293+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.293+0000 7feb5752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:19.292 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.293+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.293+0000 7feb5752e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.293+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.294+0000 7feb5752e800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:19.293 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.294+0000 7feb5752e800 20 searching for the correct realm 2024-09-12T01:37:19.297 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.298+0000 7feb52adc640 0 -- 172.21.15.19:0/3304290567 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7feb480923c0 msgr2=0x7feb48092840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T01:37:19.504 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.504+0000 7feb53ade640 0 -- 172.21.15.19:0/3304290567 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x56258a189e40 msgr2=0x56258a18c300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:19.508 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.509+0000 7feb5752e800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:37:19.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.509+0000 7feb5752e800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:37:19.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.509+0000 7feb5752e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:37:19.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.509+0000 7feb5752e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:37:19.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.509+0000 7feb5752e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:37:19.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.509+0000 7feb5752e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:37:19.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.509+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.509+0000 7feb5752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:19.509 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.509+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:19.510 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 20 zone default found 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 4 Realm: () 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 20 zonegroup default 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.510+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.511+0000 7feb5752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.511+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.511+0000 7feb5752e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:19.511 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.511+0000 7feb5752e800 20 started sync module instance, tier type = 2024-09-12T01:37:19.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.511+0000 7feb5752e800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:37:19.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.521+0000 7feb5752e800 20 add_watcher() i=0 2024-09-12T01:37:19.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.521+0000 7feb5752e800 20 add_watcher() i=1 2024-09-12T01:37:19.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.521+0000 7feb5752e800 20 add_watcher() i=2 2024-09-12T01:37:19.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.521+0000 7feb5752e800 20 add_watcher() i=3 2024-09-12T01:37:19.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.521+0000 7feb5752e800 20 add_watcher() i=4 2024-09-12T01:37:19.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.521+0000 7feb5752e800 20 add_watcher() i=5 2024-09-12T01:37:19.521 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.521+0000 7feb5752e800 20 add_watcher() i=6 2024-09-12T01:37:19.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.523+0000 7feb5752e800 20 add_watcher() i=7 2024-09-12T01:37:19.522 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.523+0000 7feb5752e800 2 all 8 watchers are set, enabling cache 2024-09-12T01:37:19.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.524+0000 7fea09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:19.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.524+0000 7feb5752e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:37:19.524 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.524+0000 7feb5752e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:37:19.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.563+0000 7fea08fe1640 20 reqs_thread_entry: start 2024-09-12T01:37:19.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.563+0000 7feb5752e800 20 init_complete bucket index max shards: 11 2024-09-12T01:37:19.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.563+0000 7feb5752e800 20 Filter name: none 2024-09-12T01:37:19.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.563+0000 7fe9827fc640 20 reqs_thread_entry: start 2024-09-12T01:37:19.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.563+0000 7feb5752e800 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T01:37:19.563 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.563+0000 7feb5752e800 20 rados->read ofs=0 len=0 2024-09-12T01:37:19.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.563+0000 7feb5752e800 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T01:37:19.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.564+0000 7feb5752e800 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T01:37:19.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.564+0000 7feb5752e800 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T01:37:19.564 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.564+0000 7feb5752e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T01:37:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.564+0000 7feb5752e800 10 removing key index: HDRYCRFUSHDORKDHHLPN 2024-09-12T01:37:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.565+0000 7feb5752e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:HDRYCRFUSHDORKDHHLPN, ofs0, ns] 2024-09-12T01:37:19.565 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.565+0000 7fea36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461302073 cookie 94719230701088 notifier 8753 bl.length()=170 2024-09-12T01:37:19.566 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.567+0000 7feb5752e800 10 removing email index: tester.client.0_test@test.test 2024-09-12T01:37:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.568+0000 7feb5752e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T01:37:19.567 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.568+0000 7fea36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301025 cookie 94719230707376 notifier 8753 bl.length()=181 2024-09-12T01:37:19.569 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.569+0000 7feb5752e800 10 removing user buckets index 2024-09-12T01:37:19.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.571+0000 7feb5752e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T01:37:19.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.571+0000 7fea36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461302459 cookie 94719230717264 notifier 8753 bl.length()=172 2024-09-12T01:37:19.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.572+0000 7feb5752e800 10 removing user index: tester.client.0 2024-09-12T01:37:19.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.573+0000 7feb5752e800 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T01:37:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.573+0000 7feb5752e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T01:37:19.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.573+0000 7fea36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461302460 cookie 94719230714320 notifier 8753 bl.length()=164 2024-09-12T01:37:19.575 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.576+0000 7fea09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:19.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.578+0000 7feb5752e800 20 remove_watcher() i=0 2024-09-12T01:37:19.577 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.578+0000 7feb5752e800 2 removed watcher, disabling cache 2024-09-12T01:37:19.578 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.579+0000 7feb5752e800 20 remove_watcher() i=1 2024-09-12T01:37:19.580 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.581+0000 7feb5752e800 20 remove_watcher() i=2 2024-09-12T01:37:19.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.582+0000 7feb5752e800 20 remove_watcher() i=3 2024-09-12T01:37:19.582 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.583+0000 7feb5752e800 20 remove_watcher() i=4 2024-09-12T01:37:19.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.584+0000 7feb5752e800 20 remove_watcher() i=5 2024-09-12T01:37:19.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.585+0000 7feb5752e800 20 remove_watcher() i=6 2024-09-12T01:37:19.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:19.586+0000 7feb5752e800 20 remove_watcher() i=7 2024-09-12T01:37:19.598 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T01:37:19.611 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T01:37:19.621 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T01:37:19.678 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T01:37:19.690 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T01:37:19.690 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:37:19.699 INFO:tasks.rgw.client.0.smithi019.stdout:2024-09-12T01:37:19.695+0000 f874640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term env OPENSSL_ia32cap=~0x1000000000000000 valgrind --trace-children=no --child-silent-after-fork=yes --soname-synonyms=somalloc=*tcmalloc* --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --gen-suppressions=all --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --vgdb=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends beast ssl_certificate=/home/ubuntu/cephtest/ca/rgw.client.0.crt ssl_port=443 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 45333) UID: 0 2024-09-12T01:37:19.699 INFO:tasks.rgw.client.0.smithi019.stdout:2024-09-12T01:37:19.699+0000 a1be240 -1 shutting down 2024-09-12T01:37:33.633 INFO:tasks.rgw.client.0.smithi019.stderr:==00:01:12:20.290 45336== could not unlink /tmp/vgdb-pipe-from-vgdb-to-45336-by-root-on-??? 2024-09-12T01:37:33.634 INFO:tasks.rgw.client.0.smithi019.stderr:==00:01:12:20.290 45336== could not unlink /tmp/vgdb-pipe-to-vgdb-from-45336-by-root-on-??? 2024-09-12T01:37:33.634 INFO:tasks.rgw.client.0.smithi019.stderr:==00:01:12:20.290 45336== could not unlink /tmp/vgdb-pipe-shared-mem-vgdb-45336-by-root-on-??? 2024-09-12T01:37:35.062 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T01:37:37.995 INFO:tasks.rgw.client.0:Stopped 2024-09-12T01:37:37.996 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T01:37:38.033 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T01:37:38.118 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T01:37:38.161 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T01:37:38.161 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T01:37:38.161 DEBUG:teuthology.orchestra.run.smithi019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T01:37:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setuser ceph since I am not root 2024-09-12T01:37:38.262 INFO:teuthology.orchestra.run.smithi019.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T01:37:38.298 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.299+0000 7fc627440800 20 rados->read ofs=0 len=0 2024-09-12T01:37:38.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.301+0000 7fc627440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:38.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.301+0000 7fc627440800 20 realm 2024-09-12T01:37:38.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.301+0000 7fc627440800 20 rados->read ofs=0 len=0 2024-09-12T01:37:38.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.301+0000 7fc627440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:38.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.301+0000 7fc627440800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T01:37:38.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.301+0000 7fc627440800 20 rados->read ofs=0 len=0 2024-09-12T01:37:38.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.302+0000 7fc627440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:38.301 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.302+0000 7fc627440800 20 rados->read ofs=0 len=0 2024-09-12T01:37:38.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.302+0000 7fc627440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:38.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.302+0000 7fc627440800 20 rados->read ofs=0 len=0 2024-09-12T01:37:38.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.303+0000 7fc627440800 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T01:37:38.302 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.303+0000 7fc627440800 20 searching for the correct realm 2024-09-12T01:37:38.306 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.307+0000 7fc624729640 0 -- 172.21.15.19:0/752109256 >> [v2:172.21.15.135:6808/43193093,v1:172.21.15.135:6809/43193093] conn(0x7fc618076050 msgr2=0x7fc61806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:38.512 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.513+0000 7fc624729640 0 -- 172.21.15.19:0/752109256 >> [v2:172.21.15.135:6824/1074135986,v1:172.21.15.135:6825/1074135986] conn(0x5594da520f00 msgr2=0x5594da5233a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T01:37:38.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.518+0000 7fc627440800 20 RGWRados::pool_iterate: got zonegroup_info.417029b0-aad0-4608-9da6-38135a9deddf 2024-09-12T01:37:38.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.518+0000 7fc627440800 20 RGWRados::pool_iterate: got zone_info.844f1394-9f73-45bf-8dcb-b3ca2aab8fdc 2024-09-12T01:37:38.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.518+0000 7fc627440800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T01:37:38.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.518+0000 7fc627440800 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T01:37:38.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.518+0000 7fc627440800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T01:37:38.517 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.518+0000 7fc627440800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T01:37:38.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.518+0000 7fc627440800 20 rados->read ofs=0 len=0 2024-09-12T01:37:38.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.518+0000 7fc627440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:38.518 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.518+0000 7fc627440800 20 rados->read ofs=0 len=0 2024-09-12T01:37:38.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.518+0000 7fc627440800 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T01:37:38.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.518+0000 7fc627440800 20 rados->read ofs=0 len=0 2024-09-12T01:37:38.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T01:37:38.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 20 zone default found 2024-09-12T01:37:38.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 4 Realm: () 2024-09-12T01:37:38.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 4 ZoneGroup: default (417029b0-aad0-4608-9da6-38135a9deddf) 2024-09-12T01:37:38.519 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 4 Zone: default (844f1394-9f73-45bf-8dcb-b3ca2aab8fdc) 2024-09-12T01:37:38.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T01:37:38.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 20 zonegroup default 2024-09-12T01:37:38.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 20 rados->read ofs=0 len=0 2024-09-12T01:37:38.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:38.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 20 rados->read ofs=0 len=0 2024-09-12T01:37:38.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:38.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.519+0000 7fc627440800 20 rados->read ofs=0 len=0 2024-09-12T01:37:38.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.520+0000 7fc627440800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T01:37:38.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.520+0000 7fc627440800 20 started sync module instance, tier type = 2024-09-12T01:37:38.520 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.520+0000 7fc627440800 20 started zone id=844f1394-9f73-45bf-8dcb-b3ca2aab8fdc (name=default) with tier type = 2024-09-12T01:37:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.530+0000 7fc627440800 20 add_watcher() i=0 2024-09-12T01:37:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.530+0000 7fc627440800 20 add_watcher() i=1 2024-09-12T01:37:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.530+0000 7fc627440800 20 add_watcher() i=2 2024-09-12T01:37:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.530+0000 7fc627440800 20 add_watcher() i=3 2024-09-12T01:37:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.530+0000 7fc627440800 20 add_watcher() i=4 2024-09-12T01:37:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.530+0000 7fc627440800 20 add_watcher() i=5 2024-09-12T01:37:38.529 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.530+0000 7fc627440800 20 add_watcher() i=6 2024-09-12T01:37:38.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.531+0000 7fc627440800 20 add_watcher() i=7 2024-09-12T01:37:38.530 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.531+0000 7fc627440800 2 all 8 watchers are set, enabling cache 2024-09-12T01:37:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.532+0000 7fc4dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.533+0000 7fc627440800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T01:37:38.532 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.533+0000 7fc627440800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T01:37:38.570 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.571+0000 7fc4d9fe3640 20 reqs_thread_entry: start 2024-09-12T01:37:38.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.571+0000 7fc627440800 20 init_complete bucket index max shards: 11 2024-09-12T01:37:38.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.571+0000 7fc627440800 20 Filter name: none 2024-09-12T01:37:38.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.571+0000 7fc44b7fe640 20 reqs_thread_entry: start 2024-09-12T01:37:38.571 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.571+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T01:37:38.572 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.573+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.573 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.574+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.574+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:37:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.574+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1828275425608738162', time=2024-09-12T03:04:39.802028+0000, chain.objs.size()=5 2024-09-12T01:37:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.574+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__multipart_mymultipart-LUKEWARM.2~tm8X7peJWqCzfVxxhmDh7gT4wjIN2tl.1 2024-09-12T01:37:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.574+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__shadow_mymultipart-LUKEWARM.2~tm8X7peJWqCzfVxxhmDh7gT4wjIN2tl.1_1 2024-09-12T01:37:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.574+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__multipart_mymultipart-LUKEWARM.2~tm8X7peJWqCzfVxxhmDh7gT4wjIN2tl.2 2024-09-12T01:37:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.574+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__shadow_mymultipart-LUKEWARM.2~tm8X7peJWqCzfVxxhmDh7gT4wjIN2tl.2_1 2024-09-12T01:37:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.574+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__multipart_mymultipart-LUKEWARM.2~tm8X7peJWqCzfVxxhmDh7gT4wjIN2tl.3 2024-09-12T01:37:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.574+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4258883019567050522', time=2024-09-12T03:31:18.747657+0000, chain.objs.size()=1 2024-09-12T01:37:38.574 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.574+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.702__multipart_file1.2~3zh-tZAaULCduAUVxfPL6bbqceVNp69.1 2024-09-12T01:37:38.576 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.577+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.579 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.580+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T01:37:38.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.582+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.581 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.582+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:37:38.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_oI5V98FbWOEOQhlwA0QKe1KjLJPdrLH', time=2024-09-12T03:05:19.290236+0000, chain.objs.size()=1 2024-09-12T01:37:38.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.JTGM15Z6Eeui5vmB5tsQG162tEdTxfj_0 2024-09-12T01:37:38.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5689700796490562815', time=2024-09-12T03:05:31.603950+0000, chain.objs.size()=2 2024-09-12T01:37:38.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.164__multipart_foo.2~OkO12UBAVpEp7nOW3CTEJ9PLf-QS8La.1 2024-09-12T01:37:38.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.164__multipart_foo.2~OkO12UBAVpEp7nOW3CTEJ9PLf-QS8La.2 2024-09-12T01:37:38.583 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12307911239965526276', time=2024-09-12T03:19:38.425504+0000, chain.objs.size()=2 2024-09-12T01:37:38.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~v6Y9Px9Y-U77JS-1XTj1yXLh4ziCgq_.1 2024-09-12T01:37:38.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~v6Y9Px9Y-U77JS-1XTj1yXLh4ziCgq_.2 2024-09-12T01:37:38.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14709036886838049419', time=2024-09-12T03:26:15.624679+0000, chain.objs.size()=12 2024-09-12T01:37:38.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__multipart_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.1 2024-09-12T01:37:38.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__shadow_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.1_1 2024-09-12T01:37:38.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__multipart_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.2 2024-09-12T01:37:38.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__shadow_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.2_1 2024-09-12T01:37:38.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__multipart_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.3 2024-09-12T01:37:38.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__shadow_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.3_1 2024-09-12T01:37:38.584 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.583+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__multipart_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.4 2024-09-12T01:37:38.585 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.586+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__shadow_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.4_1 2024-09-12T01:37:38.586 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.587+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__multipart_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.5 2024-09-12T01:37:38.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.589+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__shadow_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.5_1 2024-09-12T01:37:38.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.589+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__multipart_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.6 2024-09-12T01:37:38.588 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.589+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.614__shadow_multipart_enc.2~YyY4M99dnEUSdzg4QAv9HUkjwYi8zWl.6_1 2024-09-12T01:37:38.593 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.593+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.595 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.596+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T01:37:38.596 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.597+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.597 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:37:38.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8488324220241759779', time=2024-09-12T03:04:31.080971+0000, chain.objs.size()=3 2024-09-12T01:37:38.598 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.158__shadow_.uL07XCBWPyhRo3yyotvJujePN94v46C_0 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.158__shadow_.uL07XCBWPyhRo3yyotvJujePN94v46C_1 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.158__shadow_.uL07XCBWPyhRo3yyotvJujePN94v46C_2 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~h-cJqTLPRez_SGEyOi1QEVo1mFBhYRj', time=2024-09-12T03:06:32.922107+0000, chain.objs.size()=2 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.202__multipart_mymultipart.2~h-cJqTLPRez_SGEyOi1QEVo1mFBhYRj.1 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.202__shadow_mymultipart.2~h-cJqTLPRez_SGEyOi1QEVo1mFBhYRj.1_1 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~w0W7Z-8Y0R9KNueNJBgk-tB5eOKH-TK', time=2024-09-12T03:18:53.932346+0000, chain.objs.size()=1 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~w0W7Z-8Y0R9KNueNJBgk-tB5eOKH-TK.2 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~w0W7Z-8Y0R9KNueNJBgk-tB5eOKH-TK', time=2024-09-12T03:18:53.936710+0000, chain.objs.size()=1 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~w0W7Z-8Y0R9KNueNJBgk-tB5eOKH-TK.3 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12414838564612641894', time=2024-09-12T03:19:18.055174+0000, chain.objs.size()=6 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~w0W7Z-8Y0R9KNueNJBgk-tB5eOKH-TK.1 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.8p7JSjS5jENQ6bn09nSWYgodfHJmaX_X.2 2024-09-12T01:37:38.599 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.eDn0xu65LsDrFSnqchwqB6k_7mK1ckZB.3 2024-09-12T01:37:38.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~w0W7Z-8Y0R9KNueNJBgk-tB5eOKH-TK.4 2024-09-12T01:37:38.600 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.598+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~w0W7Z-8Y0R9KNueNJBgk-tB5eOKH-TK.5 2024-09-12T01:37:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.603+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~w0W7Z-8Y0R9KNueNJBgk-tB5eOKH-TK.6 2024-09-12T01:37:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.603+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3072161463621363333', time=2024-09-12T03:23:49.697027+0000, chain.objs.size()=4 2024-09-12T01:37:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.603+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~iACiypVZcHsmLMl1LjvwPHys0ThvRXA.1 2024-09-12T01:37:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.603+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~iACiypVZcHsmLMl1LjvwPHys0ThvRXA.2 2024-09-12T01:37:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.603+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~iACiypVZcHsmLMl1LjvwPHys0ThvRXA.3 2024-09-12T01:37:38.603 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.604+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~iACiypVZcHsmLMl1LjvwPHys0ThvRXA.4 2024-09-12T01:37:38.606 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.607+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.609 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.610+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T01:37:38.610 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.611+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.611+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.611 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.612+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:37:38.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.612+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18074243451215631777', time=2024-09-12T03:20:06.875887+0000, chain.objs.size()=2 2024-09-12T01:37:38.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.612+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~jrP_DPrUH_YlQTcxIV5pKwzHh6YGaP6.1 2024-09-12T01:37:38.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.612+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~jrP_DPrUH_YlQTcxIV5pKwzHh6YGaP6.2 2024-09-12T01:37:38.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.612+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3576393640148939806', time=2024-09-12T03:30:38.676933+0000, chain.objs.size()=6 2024-09-12T01:37:38.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.612+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.660__multipart_bar.2~vIN-jrwk-psVBS5wfjKqybwZZ1m35M0.1 2024-09-12T01:37:38.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.612+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.660__multipart_bar.2~vIN-jrwk-psVBS5wfjKqybwZZ1m35M0.2 2024-09-12T01:37:38.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.612+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.660__multipart_bar.2~vIN-jrwk-psVBS5wfjKqybwZZ1m35M0.3 2024-09-12T01:37:38.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.612+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.660__multipart_bar.2~vIN-jrwk-psVBS5wfjKqybwZZ1m35M0.4 2024-09-12T01:37:38.612 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.612+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.660__multipart_bar.2~vIN-jrwk-psVBS5wfjKqybwZZ1m35M0.5 2024-09-12T01:37:38.613 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.613+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.660__multipart_bar.2~vIN-jrwk-psVBS5wfjKqybwZZ1m35M0.6 2024-09-12T01:37:38.617 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.617+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.620 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.620+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T01:37:38.621 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.622+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.622 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:37:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9656930630605093011', time=2024-09-12T03:05:15.982817+0000, chain.objs.size()=5 2024-09-12T01:37:38.625 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__multipart_foo-FROZEN.2~Q79ltvlkP8u1SDCLZ0_N1tq2TeKAKeb.1 2024-09-12T01:37:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_foo-FROZEN.2~Q79ltvlkP8u1SDCLZ0_N1tq2TeKAKeb.1_1 2024-09-12T01:37:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__multipart_foo-FROZEN.2~Q79ltvlkP8u1SDCLZ0_N1tq2TeKAKeb.2 2024-09-12T01:37:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_foo-FROZEN.2~Q79ltvlkP8u1SDCLZ0_N1tq2TeKAKeb.2_1 2024-09-12T01:37:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__multipart_foo-FROZEN.2~Q79ltvlkP8u1SDCLZ0_N1tq2TeKAKeb.3 2024-09-12T01:37:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.5775367761424145368', time=2024-09-12T03:16:22.724705+0000, chain.objs.size()=6 2024-09-12T01:37:38.626 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.1 2024-09-12T01:37:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.2 2024-09-12T01:37:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.3 2024-09-12T01:37:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.4 2024-09-12T01:37:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.5 2024-09-12T01:37:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.6 2024-09-12T01:37:38.627 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4924612796491316712', time=2024-09-12T03:32:21.387888+0000, chain.objs.size()=10 2024-09-12T01:37:38.628 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.623+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.735__multipart_foo.2~jJoHwz7YVWR42W5coxblKfZYPySl1YG.1 2024-09-12T01:37:38.629 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.626+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.735__multipart_foo.2~jJoHwz7YVWR42W5coxblKfZYPySl1YG.2 2024-09-12T01:37:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.626+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.735__multipart_foo.2~jJoHwz7YVWR42W5coxblKfZYPySl1YG.3 2024-09-12T01:37:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.627+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.735__multipart_foo.2~jJoHwz7YVWR42W5coxblKfZYPySl1YG.4 2024-09-12T01:37:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.627+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.735__multipart_foo.2~jJoHwz7YVWR42W5coxblKfZYPySl1YG.5 2024-09-12T01:37:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.628+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.735__multipart_foo.2~jJoHwz7YVWR42W5coxblKfZYPySl1YG.6 2024-09-12T01:37:38.630 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.628+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.735__multipart_foo.2~jJoHwz7YVWR42W5coxblKfZYPySl1YG.7 2024-09-12T01:37:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.628+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.735__multipart_foo.2~jJoHwz7YVWR42W5coxblKfZYPySl1YG.8 2024-09-12T01:37:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.628+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.735__multipart_foo.2~jJoHwz7YVWR42W5coxblKfZYPySl1YG.9 2024-09-12T01:37:38.631 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.628+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.735__multipart_foo.2~jJoHwz7YVWR42W5coxblKfZYPySl1YG.10 2024-09-12T01:37:38.632 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.633+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.635 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.636+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T01:37:38.637 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.637+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.638+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.639 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.638+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:37:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.638+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_L__g0sGby56viex2Hm-ZJmwZGkxBvLp', time=2024-09-12T03:04:49.685724+0000, chain.objs.size()=2 2024-09-12T01:37:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.638+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.hfC_5S6whoyCwaElet3KM7TJJQUn-ZL_1 2024-09-12T01:37:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.638+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.hfC_5S6whoyCwaElet3KM7TJJQUn-ZL_2 2024-09-12T01:37:38.640 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.638+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_THwFnLfgsRDSKFSGqYsd3GD1UskYxVk', time=2024-09-12T03:04:56.703365+0000, chain.objs.size()=1 2024-09-12T01:37:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.638+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.Hq_Y6u8vJBz9ibSNuFUCUOVATOo-T1__0 2024-09-12T01:37:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.638+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13167062613840038874', time=2024-09-12T03:16:40.952065+0000, chain.objs.size()=1 2024-09-12T01:37:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.638+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.518__multipart_mymultipart.2~nSM5-IidtqGF1fJUNzLXbt02RKFBjWv.1 2024-09-12T01:37:38.641 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.640+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.642 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.643+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T01:37:38.643 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.644+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.644+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.645+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:37:38.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.645+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6828614214161037835', time=2024-09-12T03:20:19.330177+0000, chain.objs.size()=1 2024-09-12T01:37:38.645 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.645+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.528__shadow_.TyHjlLPTWf8OADjQ-kD4tBPmxvjeE6Z_1 2024-09-12T01:37:38.646 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.646+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.648 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.648+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T01:37:38.649 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:37:38.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_D_KRnDwhmtRTML_8tHrM0_bOx4EOVdS', time=2024-09-12T03:05:31.844595+0000, chain.objs.size()=1 2024-09-12T01:37:38.651 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.165__shadow_.EJ39oTHc2CMeCn2Y_-027jux8UUuLRx_0 2024-09-12T01:37:38.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10708701028970521434', time=2024-09-12T03:20:20.779325+0000, chain.objs.size()=2 2024-09-12T01:37:38.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.528__multipart_mymultipart.2~t9l2Tc25xfhbSXnnG8XUwJ15hIt_qTg.1 2024-09-12T01:37:38.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.528__multipart_mymultipart.2~t9l2Tc25xfhbSXnnG8XUwJ15hIt_qTg.2 2024-09-12T01:37:38.652 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11477460273336908994', time=2024-09-12T03:20:55.697955+0000, chain.objs.size()=1 2024-09-12T01:37:38.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.536__multipart_mymultipart.2~nQ0kUy8DhVBAbPopA3T8Ky-MrcInKmk.1 2024-09-12T01:37:38.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6915026647369422055', time=2024-09-12T03:32:30.168693+0000, chain.objs.size()=1 2024-09-12T01:37:38.653 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.650+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.742__multipart_mymultipart3.2~zI3FsHXWtXA6xkLRixWUARctoSYShUK.1 2024-09-12T01:37:38.654 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.653+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.655 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.655+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T01:37:38.656 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.657+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.657 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.657+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.658+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:37:38.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.658+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_oPsqVVDQAnJsQpz6Qe7cDlZhY1CNTMv', time=2024-09-12T03:04:55.376144+0000, chain.objs.size()=2 2024-09-12T01:37:38.658 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.658+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.PpMSusL2beJhmg0Vlju9LemcYZhdFAV_1 2024-09-12T01:37:38.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.658+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.PpMSusL2beJhmg0Vlju9LemcYZhdFAV_2 2024-09-12T01:37:38.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.658+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_nX0AwginQIIN2XOL3zQdx4bTDffQU9v', time=2024-09-12T03:05:25.960702+0000, chain.objs.size()=1 2024-09-12T01:37:38.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.658+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.163__shadow_.FN9P615-hNvHSqYSnkMMmJPCGoq2Vdp_0 2024-09-12T01:37:38.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.658+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8052671826434787100', time=2024-09-12T03:16:31.417328+0000, chain.objs.size()=1 2024-09-12T01:37:38.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.658+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.516__multipart_mymultipartcopy.2~UjDnW4Lu01mLlPZYQFhImVabyJNKYX7.1 2024-09-12T01:37:38.659 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.658+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4176134930806852270', time=2024-09-12T03:16:38.649995+0000, chain.objs.size()=1 2024-09-12T01:37:38.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.658+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.518__multipart_mymultipart.2~FNDa0_DIo9ggQMWKwBUTs58UuNp5hK3.1 2024-09-12T01:37:38.660 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.660+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.662 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.662+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T01:37:38.663 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.664+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.664+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:37:38.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3619869011574933427', time=2024-09-12T03:04:48.277237+0000, chain.objs.size()=3 2024-09-12T01:37:38.666 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.313RWY_AbUwoWpEXrZWVIuUCA9qq2XK_0 2024-09-12T01:37:38.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.313RWY_AbUwoWpEXrZWVIuUCA9qq2XK_1 2024-09-12T01:37:38.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.313RWY_AbUwoWpEXrZWVIuUCA9qq2XK_2 2024-09-12T01:37:38.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1284957239731324978', time=2024-09-12T03:05:01.601358+0000, chain.objs.size()=3 2024-09-12T01:37:38.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__multipart_foo-STANDARD.2~B8Hhi72H_z-0d4Xd-k7uZ81JVKAqbtC.1 2024-09-12T01:37:38.667 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__multipart_foo-STANDARD.2~B8Hhi72H_z-0d4Xd-k7uZ81JVKAqbtC.2 2024-09-12T01:37:38.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__multipart_foo-STANDARD.2~B8Hhi72H_z-0d4Xd-k7uZ81JVKAqbtC.3 2024-09-12T01:37:38.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9404244635449794940', time=2024-09-12T03:19:31.464247+0000, chain.objs.size()=6 2024-09-12T01:37:38.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.21ipYRndEeF8_i0j8svLfLbvsZP2vQj3.1 2024-09-12T01:37:38.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.7doz6wZl3no31yNfQF6ZRezKJ0syhtWp.2 2024-09-12T01:37:38.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.gkCyZgygqj4UzKopasC5jS5rwssWcfHG.3 2024-09-12T01:37:38.668 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.Q3QU4wtEdklcB4pX5i561sWOc-JgFAkJ.4 2024-09-12T01:37:38.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.4U2Afb8ZPIBs_FazVU2aq6ZHG12Sm-1p.5 2024-09-12T01:37:38.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.665+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.SpWc_xZz_hT5U4jyOvB1MPsbSiPYKg6u.6 2024-09-12T01:37:38.669 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.668+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12507502513375108744', time=2024-09-12T03:19:36.209401+0000, chain.objs.size()=2 2024-09-12T01:37:38.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.668+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~6Tc7tRJLLnpsGjJGuafH-jKE78cb7NI.1 2024-09-12T01:37:38.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.668+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~6Tc7tRJLLnpsGjJGuafH-jKE78cb7NI.2 2024-09-12T01:37:38.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.668+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15796061352727224688', time=2024-09-12T03:19:43.040924+0000, chain.objs.size()=5 2024-09-12T01:37:38.670 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.668+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~DQsH77cbm48cfKTRszV1l_Unw4kf8t5.1 2024-09-12T01:37:38.671 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.671+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__shadow_mymultipart.2~DQsH77cbm48cfKTRszV1l_Unw4kf8t5.1_1 2024-09-12T01:37:38.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.671+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~DQsH77cbm48cfKTRszV1l_Unw4kf8t5.2 2024-09-12T01:37:38.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.671+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__shadow_mymultipart.2~DQsH77cbm48cfKTRszV1l_Unw4kf8t5.2_1 2024-09-12T01:37:38.672 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.671+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~DQsH77cbm48cfKTRszV1l_Unw4kf8t5.3 2024-09-12T01:37:38.674 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.675+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.676 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.677+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T01:37:38.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.678 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:37:38.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_w7eB-bnXmXFCF6I1MjbE73QxHmOCESX', time=2024-09-12T03:05:10.412233+0000, chain.objs.size()=2 2024-09-12T01:37:38.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.65ypi1FIxP8PhCqS33FDWPG9r6lHQpY_1 2024-09-12T01:37:38.679 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.65ypi1FIxP8PhCqS33FDWPG9r6lHQpY_2 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~PS_oVD0p70CJF1lBzP2I2VOANZezQ34', time=2024-09-12T03:06:30.780812+0000, chain.objs.size()=1 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.201__multipart_mymultipart.2~PS_oVD0p70CJF1lBzP2I2VOANZezQ34.1 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8098945826893799740', time=2024-09-12T03:16:22.185612+0000, chain.objs.size()=6 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.1 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.2 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.3 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.4 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.5 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.6 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10129907494975167025', time=2024-09-12T03:16:22.717303+0000, chain.objs.size()=6 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.679+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.1 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.680+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.2 2024-09-12T01:37:38.680 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.680+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.3 2024-09-12T01:37:38.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.683+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.4 2024-09-12T01:37:38.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.683+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.5 2024-09-12T01:37:38.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.683+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.6 2024-09-12T01:37:38.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.683+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13968082645108610695', time=2024-09-12T03:18:30.183403+0000, chain.objs.size()=6 2024-09-12T01:37:38.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.683+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~JcqDkSmWohwQybwO6SD4ykGuqyUZbmR.1 2024-09-12T01:37:38.682 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.683+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.cvUJrfCA4U4xvvE23B5bFf58pmKLHsDU.2 2024-09-12T01:37:38.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.684+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~JcqDkSmWohwQybwO6SD4ykGuqyUZbmR.3 2024-09-12T01:37:38.683 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.684+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~JcqDkSmWohwQybwO6SD4ykGuqyUZbmR.4 2024-09-12T01:37:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.685+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~JcqDkSmWohwQybwO6SD4ykGuqyUZbmR.5 2024-09-12T01:37:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.685+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~JcqDkSmWohwQybwO6SD4ykGuqyUZbmR.6 2024-09-12T01:37:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.685+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3', time=2024-09-12T03:29:16.571614+0000, chain.objs.size()=12 2024-09-12T01:37:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.685+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__multipart_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.1 2024-09-12T01:37:38.685 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.685+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__shadow_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.1_1 2024-09-12T01:37:38.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.687+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__multipart_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.2 2024-09-12T01:37:38.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.687+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__shadow_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.2_1 2024-09-12T01:37:38.686 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.687+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__multipart_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.3 2024-09-12T01:37:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.687+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__shadow_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.3_1 2024-09-12T01:37:38.687 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.687+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__multipart_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.4 2024-09-12T01:37:38.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.690+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__shadow_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.4_1 2024-09-12T01:37:38.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.690+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__multipart_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.5 2024-09-12T01:37:38.689 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.690+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__shadow_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.5_1 2024-09-12T01:37:38.690 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.690+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__multipart_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.6 2024-09-12T01:37:38.691 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.691+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.624__shadow_multipart_enc.2~IHUNBSNmGqd1kj12EVDS9iyMDPtGxl3.6_1 2024-09-12T01:37:38.694 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.695+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.697 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.698+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T01:37:38.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.699+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.699 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.700+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.700+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:37:38.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.700+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6555539819638707778', time=2024-09-12T03:18:53.957389+0000, chain.objs.size()=6 2024-09-12T01:37:38.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.700+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~y4Iex_Y3ty204v9FldurjRVVs0Nsyr6.1 2024-09-12T01:37:38.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.700+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~y4Iex_Y3ty204v9FldurjRVVs0Nsyr6.2 2024-09-12T01:37:38.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.700+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.fA0yRhKaE1ThnyPbJfHH8CkkolLjNbKG.3 2024-09-12T01:37:38.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.700+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~y4Iex_Y3ty204v9FldurjRVVs0Nsyr6.4 2024-09-12T01:37:38.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.700+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~y4Iex_Y3ty204v9FldurjRVVs0Nsyr6.5 2024-09-12T01:37:38.700 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.700+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~y4Iex_Y3ty204v9FldurjRVVs0Nsyr6.6 2024-09-12T01:37:38.703 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.704+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.705 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.706+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T01:37:38.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.708+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.707 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.708+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.708+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:37:38.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.708+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~QPRNiokxSncsehozYO9HkMJiIAPbn2u', time=2024-09-12T03:20:37.927709+0000, chain.objs.size()=1 2024-09-12T01:37:38.708 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.708+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.535__multipart_mymultipart.2~QPRNiokxSncsehozYO9HkMJiIAPbn2u.3 2024-09-12T01:37:38.709 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.710+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.711 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.712+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T01:37:38.712 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.713+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.713 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T01:37:38.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_3tPnyPaGeAhwaf4lmgjGSpSvmHI6gq4', time=2024-09-12T03:05:17.717100+0000, chain.objs.size()=2 2024-09-12T01:37:38.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.uNqA7QlrzjSxC9s1s8o478J3vbAQrl3_1 2024-09-12T01:37:38.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.uNqA7QlrzjSxC9s1s8o478J3vbAQrl3_2 2024-09-12T01:37:38.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_kvxHJgdEw_l_jeF9oCj9VyUft7WaRSx', time=2024-09-12T03:05:31.817433+0000, chain.objs.size()=1 2024-09-12T01:37:38.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.165__shadow_.KVHGYX--yl_Lku6MoQGdjc09QmZya2R_0 2024-09-12T01:37:38.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17023977909497726228', time=2024-09-12T03:16:22.161145+0000, chain.objs.size()=6 2024-09-12T01:37:38.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.1 2024-09-12T01:37:38.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.2 2024-09-12T01:37:38.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.3 2024-09-12T01:37:38.714 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.4 2024-09-12T01:37:38.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.5 2024-09-12T01:37:38.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.6 2024-09-12T01:37:38.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9054210724606161079', time=2024-09-12T03:16:28.387489+0000, chain.objs.size()=1 2024-09-12T01:37:38.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.513__multipart_mymultipart.2~WUEtTcObN0nks648RXbNIxZ3LbTfS03.1 2024-09-12T01:37:38.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~5L3mO67G9vWJvUeWvnrIxLNKgKe4CIx', time=2024-09-12T03:22:09.552182+0000, chain.objs.size()=1 2024-09-12T01:37:38.715 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.714+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.561__multipart_mymultipart.2~5L3mO67G9vWJvUeWvnrIxLNKgKe4CIx.1 2024-09-12T01:37:38.723 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.724+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.726 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.727+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T01:37:38.727 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.728+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.728 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:37:38.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13716396216924214609', time=2024-09-12T03:19:59.544629+0000, chain.objs.size()=3 2024-09-12T01:37:38.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~Gs7gMpFz0C1NLg9DvXqoBebvGYlW5l7.1 2024-09-12T01:37:38.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~Gs7gMpFz0C1NLg9DvXqoBebvGYlW5l7.2 2024-09-12T01:37:38.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~Gs7gMpFz0C1NLg9DvXqoBebvGYlW5l7.3 2024-09-12T01:37:38.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12569415786816573117', time=2024-09-12T03:20:15.365311+0000, chain.objs.size()=4 2024-09-12T01:37:38.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.527__multipart_mymultipart.2~tcJT_NgM4-oRx7AlmaMJ3BI1sHC8TwA.1 2024-09-12T01:37:38.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.527__multipart_mymultipart.2~tcJT_NgM4-oRx7AlmaMJ3BI1sHC8TwA.2 2024-09-12T01:37:38.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.527__multipart_mymultipart.2~tcJT_NgM4-oRx7AlmaMJ3BI1sHC8TwA.3 2024-09-12T01:37:38.729 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.527__multipart_mymultipart.2~tcJT_NgM4-oRx7AlmaMJ3BI1sHC8TwA.4 2024-09-12T01:37:38.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~Vu-Al7iWwzGaUOoygnxuBIToj0jwPtN', time=2024-09-12T03:20:29.255467+0000, chain.objs.size()=1 2024-09-12T01:37:38.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.531__multipart_mymultipart.2~Vu-Al7iWwzGaUOoygnxuBIToj0jwPtN.1 2024-09-12T01:37:38.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~nfq7BKlVWLxNLMRrlPIhLJZ1BjAROwd', time=2024-09-12T03:20:29.327755+0000, chain.objs.size()=1 2024-09-12T01:37:38.730 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.729+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.531__multipart_mymultipart2.2~nfq7BKlVWLxNLMRrlPIhLJZ1BjAROwd.1 2024-09-12T01:37:38.733 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.733+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.735 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.736+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T01:37:38.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.738+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.737 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.738+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.738 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.739+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:37:38.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.739+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_iLqaA-vxNeajcQ_Crt7z4fLgY6z6RBs', time=2024-09-12T03:05:19.234766+0000, chain.objs.size()=3 2024-09-12T01:37:38.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.739+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.Q5YyKdOMWJBOfa91kCz6ETvgpqy-tMR_0 2024-09-12T01:37:38.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.739+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.Q5YyKdOMWJBOfa91kCz6ETvgpqy-tMR_1 2024-09-12T01:37:38.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.739+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.Q5YyKdOMWJBOfa91kCz6ETvgpqy-tMR_2 2024-09-12T01:37:38.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.739+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~b12zIlpLzknUx5PMy1b6POCkn7vhb2v', time=2024-09-12T03:20:29.292369+0000, chain.objs.size()=2 2024-09-12T01:37:38.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.739+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.531__multipart_mymultipart.2~b12zIlpLzknUx5PMy1b6POCkn7vhb2v.1 2024-09-12T01:37:38.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.739+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.531__multipart_mymultipart.2~b12zIlpLzknUx5PMy1b6POCkn7vhb2v.2 2024-09-12T01:37:38.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.739+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~m6Qwi1Aosoz8GdbzjApfZqsPa6f5teb', time=2024-09-12T03:32:30.293032+0000, chain.objs.size()=1 2024-09-12T01:37:38.739 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.739+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.742__multipart_mymultipart2.2~m6Qwi1Aosoz8GdbzjApfZqsPa6f5teb.1 2024-09-12T01:37:38.741 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.742+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.743 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.744+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T01:37:38.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.745+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.744 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.745+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T01:37:38.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4268559257173772474', time=2024-09-12T03:04:39.773013+0000, chain.objs.size()=5 2024-09-12T01:37:38.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__multipart_mymultipart-FROZEN.2~Q6TYnxaP8AFgQErZgKtKZxRmF6zMYJs.1 2024-09-12T01:37:38.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__shadow_mymultipart-FROZEN.2~Q6TYnxaP8AFgQErZgKtKZxRmF6zMYJs.1_1 2024-09-12T01:37:38.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__multipart_mymultipart-FROZEN.2~Q6TYnxaP8AFgQErZgKtKZxRmF6zMYJs.2 2024-09-12T01:37:38.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__shadow_mymultipart-FROZEN.2~Q6TYnxaP8AFgQErZgKtKZxRmF6zMYJs.2_1 2024-09-12T01:37:38.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__multipart_mymultipart-FROZEN.2~Q6TYnxaP8AFgQErZgKtKZxRmF6zMYJs.3 2024-09-12T01:37:38.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12856218314210595804', time=2024-09-12T03:04:53.939211+0000, chain.objs.size()=3 2024-09-12T01:37:38.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.1Uy6G5o2gNtFlhX6Gn9Dnr41cVvzXVF_0 2024-09-12T01:37:38.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.1Uy6G5o2gNtFlhX6Gn9Dnr41cVvzXVF_1 2024-09-12T01:37:38.746 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.1Uy6G5o2gNtFlhX6Gn9Dnr41cVvzXVF_2 2024-09-12T01:37:38.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_qsuwMIxvpTZSwDaaIjTW3AvC0N6yH7w', time=2024-09-12T03:04:56.675751+0000, chain.objs.size()=3 2024-09-12T01:37:38.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.Xlhhp-EUcfR2k4sHWTKUjlyZcaEKG1k_0 2024-09-12T01:37:38.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.Xlhhp-EUcfR2k4sHWTKUjlyZcaEKG1k_1 2024-09-12T01:37:38.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.Xlhhp-EUcfR2k4sHWTKUjlyZcaEKG1k_2 2024-09-12T01:37:38.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~y4Iex_Y3ty204v9FldurjRVVs0Nsyr6', time=2024-09-12T03:18:30.164214+0000, chain.objs.size()=1 2024-09-12T01:37:38.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.746+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~y4Iex_Y3ty204v9FldurjRVVs0Nsyr6.3 2024-09-12T01:37:38.747 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.748+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~2-1qZjWYLijuyFjyM5WPz0rh_ceCkOL', time=2024-09-12T03:20:08.443372+0000, chain.objs.size()=10 2024-09-12T01:37:38.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.748+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.526__multipart_mymultipart.2~2-1qZjWYLijuyFjyM5WPz0rh_ceCkOL.1 2024-09-12T01:37:38.748 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.748+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.526__multipart_mymultipart.2~2-1qZjWYLijuyFjyM5WPz0rh_ceCkOL.2 2024-09-12T01:37:38.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.750+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.526__multipart_mymultipart.2~2-1qZjWYLijuyFjyM5WPz0rh_ceCkOL.3 2024-09-12T01:37:38.749 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.750+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.526__multipart_mymultipart.2~2-1qZjWYLijuyFjyM5WPz0rh_ceCkOL.4 2024-09-12T01:37:38.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.750+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.526__multipart_mymultipart.2~2-1qZjWYLijuyFjyM5WPz0rh_ceCkOL.5 2024-09-12T01:37:38.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.750+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.526__multipart_mymultipart.2~2-1qZjWYLijuyFjyM5WPz0rh_ceCkOL.6 2024-09-12T01:37:38.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.750+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.526__multipart_mymultipart.2~2-1qZjWYLijuyFjyM5WPz0rh_ceCkOL.7 2024-09-12T01:37:38.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.750+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.526__multipart_mymultipart.2~2-1qZjWYLijuyFjyM5WPz0rh_ceCkOL.8 2024-09-12T01:37:38.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.750+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.526__multipart_mymultipart.2~2-1qZjWYLijuyFjyM5WPz0rh_ceCkOL.9 2024-09-12T01:37:38.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.750+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.526__multipart_mymultipart.2~2-1qZjWYLijuyFjyM5WPz0rh_ceCkOL.10 2024-09-12T01:37:38.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.750+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.2123554122258769664', time=2024-09-12T03:20:52.057475+0000, chain.objs.size()=4 2024-09-12T01:37:38.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.750+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.535__multipart_mymultipart.2~QPRNiokxSncsehozYO9HkMJiIAPbn2u.1 2024-09-12T01:37:38.750 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.750+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.535__multipart_mymultipart.2~QPRNiokxSncsehozYO9HkMJiIAPbn2u.2 2024-09-12T01:37:38.751 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.751+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.535__multipart_mymultipart.rSMx3Mm9RyRlkOQdhsbYdZIGqEbH_xf_.3 2024-09-12T01:37:38.752 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.753+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.535__multipart_mymultipart.2~QPRNiokxSncsehozYO9HkMJiIAPbn2u.4 2024-09-12T01:37:38.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.754+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.6692244935329052412', time=2024-09-12T03:29:07.151516+0000, chain.objs.size()=12 2024-09-12T01:37:38.753 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.754+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__multipart_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.1 2024-09-12T01:37:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.756+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__shadow_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.1_1 2024-09-12T01:37:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.756+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__multipart_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.2 2024-09-12T01:37:38.755 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.756+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__shadow_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.2_1 2024-09-12T01:37:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.756+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__multipart_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.3 2024-09-12T01:37:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.756+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__shadow_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.3_1 2024-09-12T01:37:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.756+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__multipart_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.4 2024-09-12T01:37:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.756+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__shadow_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.4_1 2024-09-12T01:37:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.756+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__multipart_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.5 2024-09-12T01:37:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.756+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__shadow_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.5_1 2024-09-12T01:37:38.756 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.756+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__multipart_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.6 2024-09-12T01:37:38.757 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.758+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.623__shadow_multipart_enc.2~O6kvLStdQ0n2Fdkz-e9xRv9VjJuo58F.6_1 2024-09-12T01:37:38.764 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.765+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.766 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.767+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T01:37:38.768 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.769+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.769+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:37:38.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4752538754215479721', time=2024-09-12T03:16:22.461883+0000, chain.objs.size()=6 2024-09-12T01:37:38.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.1 2024-09-12T01:37:38.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.2 2024-09-12T01:37:38.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.3 2024-09-12T01:37:38.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.4 2024-09-12T01:37:38.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.5 2024-09-12T01:37:38.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.6 2024-09-12T01:37:38.770 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13013983610359730302', time=2024-09-12T03:16:41.825150+0000, chain.objs.size()=1 2024-09-12T01:37:38.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.518__multipart_mymultipart.2~ituqGG7pHGE6gu5Nca0OKCZxjKVFdbX.1 2024-09-12T01:37:38.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10163632237231229515', time=2024-09-12T03:25:24.261483+0000, chain.objs.size()=12 2024-09-12T01:37:38.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__multipart_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.1 2024-09-12T01:37:38.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__shadow_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.1_1 2024-09-12T01:37:38.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__multipart_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.2 2024-09-12T01:37:38.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__shadow_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.2_1 2024-09-12T01:37:38.771 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.770+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__multipart_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.3 2024-09-12T01:37:38.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.773+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__shadow_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.3_1 2024-09-12T01:37:38.772 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.773+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__multipart_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.4 2024-09-12T01:37:38.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.774+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__shadow_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.4_1 2024-09-12T01:37:38.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.774+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__multipart_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.5 2024-09-12T01:37:38.773 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.774+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__shadow_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.5_1 2024-09-12T01:37:38.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.775+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__multipart_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.6 2024-09-12T01:37:38.774 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.775+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.613__shadow_multipart_enc.2~xPpKMQvx9Ua0vmFu-Ra4qrPFwql5wZi.6_1 2024-09-12T01:37:38.778 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.779+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.781 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.781+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T01:37:38.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.783+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.782 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.783+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.784+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:37:38.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.784+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_oeCw3eeedb95xR1gxwYVqbzw3ilUwQW', time=2024-09-12T03:05:19.262724+0000, chain.objs.size()=3 2024-09-12T01:37:38.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.784+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.z_CeMsuC-WBG1GhNlL-5IQpsDEegQ7o_0 2024-09-12T01:37:38.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.784+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.z_CeMsuC-WBG1GhNlL-5IQpsDEegQ7o_1 2024-09-12T01:37:38.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.784+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.z_CeMsuC-WBG1GhNlL-5IQpsDEegQ7o_2 2024-09-12T01:37:38.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.784+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3820571150461412318', time=2024-09-12T03:16:24.917643+0000, chain.objs.size()=1 2024-09-12T01:37:38.783 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.784+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.511__multipart_mymultipart.2~5MM_QDeCIK34izmNdn7e0rtZ7-Sp68s.1 2024-09-12T01:37:38.785 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.786+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.787 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.788+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T01:37:38.788 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.789+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.789 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9989787192134211195', time=2024-09-12T03:16:41.591452+0000, chain.objs.size()=1 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.517__shadow_.-kpYDuhMPM43Gxzf1zN_nptkBSaOU7f_1 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4422627253332752460', time=2024-09-12T03:19:40.857307+0000, chain.objs.size()=3 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~xYAd5lSNEhosqSxPzOkM-NPOIS54WKX.1 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~xYAd5lSNEhosqSxPzOkM-NPOIS54WKX.2 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~xYAd5lSNEhosqSxPzOkM-NPOIS54WKX.3 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8516253110032358538', time=2024-09-12T03:19:52.177611+0000, chain.objs.size()=2 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~1xgzl9C3e2bs-9G8s21IvNOuams6XJY.1 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~1xgzl9C3e2bs-9G8s21IvNOuams6XJY.2 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10847592355957166294', time=2024-09-12T03:30:38.924133+0000, chain.objs.size()=6 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.661__multipart_baz.2~RqkQVCmBGzCMFNESlT96LOxIoU0kAxf.1 2024-09-12T01:37:38.790 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.661__multipart_baz.2~RqkQVCmBGzCMFNESlT96LOxIoU0kAxf.2 2024-09-12T01:37:38.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.661__multipart_baz.2~RqkQVCmBGzCMFNESlT96LOxIoU0kAxf.3 2024-09-12T01:37:38.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.661__multipart_baz.2~RqkQVCmBGzCMFNESlT96LOxIoU0kAxf.4 2024-09-12T01:37:38.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.661__multipart_baz.2~RqkQVCmBGzCMFNESlT96LOxIoU0kAxf.5 2024-09-12T01:37:38.791 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.790+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.661__multipart_baz.2~RqkQVCmBGzCMFNESlT96LOxIoU0kAxf.6 2024-09-12T01:37:38.796 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.797+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.798 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.799+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T01:37:38.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.801+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.800 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.801+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:37:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_pIUNYK_DHBNd9oGAZs8rmVrIMtQElMw', time=2024-09-12T03:04:44.007024+0000, chain.objs.size()=1 2024-09-12T01:37:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_.F4CnYBefxGveLds2c-gfVfiKX_uZ8AW_0 2024-09-12T01:37:38.802 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.18065217624923643094', time=2024-09-12T03:17:06.863627+0000, chain.objs.size()=6 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.519__multipart_mymultipart.2~xrnokCXVqNa2SuRi0h-F4da1xzN9bd-.1 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.519__multipart_mymultipart.2~xrnokCXVqNa2SuRi0h-F4da1xzN9bd-.2 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.519__multipart_mymultipart.2~xrnokCXVqNa2SuRi0h-F4da1xzN9bd-.3 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.519__multipart_mymultipart.2~xrnokCXVqNa2SuRi0h-F4da1xzN9bd-.4 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.519__multipart_mymultipart.2~xrnokCXVqNa2SuRi0h-F4da1xzN9bd-.5 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.519__multipart_mymultipart.2~xrnokCXVqNa2SuRi0h-F4da1xzN9bd-.6 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~tGF30AWCD6sxBGbmq0DVffrDdq09kNY', time=2024-09-12T03:20:31.839689+0000, chain.objs.size()=1 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.533__multipart_mymultipart.2~tGF30AWCD6sxBGbmq0DVffrDdq09kNY.1 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5', time=2024-09-12T03:29:25.962666+0000, chain.objs.size()=12 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__multipart_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.1 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__shadow_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.1_1 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__multipart_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.2 2024-09-12T01:37:38.803 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.802+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__shadow_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.2_1 2024-09-12T01:37:38.804 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.804+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__multipart_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.3 2024-09-12T01:37:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.806+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__shadow_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.3_1 2024-09-12T01:37:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.806+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__multipart_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.4 2024-09-12T01:37:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.806+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__shadow_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.4_1 2024-09-12T01:37:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.806+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__multipart_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.5 2024-09-12T01:37:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.807+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__shadow_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.5_1 2024-09-12T01:37:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.807+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__multipart_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.6 2024-09-12T01:37:38.806 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.807+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.625__shadow_multipart_enc.2~6JaJBlDFhLO1fbiGJXp2nqVDzxRljk5.6_1 2024-09-12T01:37:38.808 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.809+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.7961136679072983323', time=2024-09-12T03:31:28.310496+0000, chain.objs.size()=1 2024-09-12T01:37:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.809+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.711__multipart_file1.2~a5e1piXJiNK4Ysjiv9xZF-mBZPerJw2.1 2024-09-12T01:37:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.809+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10671837882307233106', time=2024-09-12T03:32:36.013515+0000, chain.objs.size()=3 2024-09-12T01:37:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.809+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.743__multipart_mymultipart3.2~ek0MzNo4T75yKgVlfOAYXJoDmcRkkWS.1 2024-09-12T01:37:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.809+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.743__multipart_mymultipart3.2~ek0MzNo4T75yKgVlfOAYXJoDmcRkkWS.2 2024-09-12T01:37:38.809 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.809+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.743__multipart_mymultipart3.2~ek0MzNo4T75yKgVlfOAYXJoDmcRkkWS.3 2024-09-12T01:37:38.814 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.815+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.817 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.818+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T01:37:38.818 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.819+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.820+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.820+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:37:38.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.820+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10347614906112346349', time=2024-09-12T03:21:56.606130+0000, chain.objs.size()=1 2024-09-12T01:37:38.819 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.820+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.557__shadow_.yDo3R3GW7lhFXA3KrGD7qzkQOfPUg1y_1 2024-09-12T01:37:38.820 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.821+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.823 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.823+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T01:37:38.824 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.825+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.825+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.826+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T01:37:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.826+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~sWt0YV_bSTT-HlSw3MXCdfpBfy_sioZ', time=2024-09-12T03:17:43.448474+0000, chain.objs.size()=1 2024-09-12T01:37:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.826+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~sWt0YV_bSTT-HlSw3MXCdfpBfy_sioZ.1 2024-09-12T01:37:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.826+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14590874211337727124', time=2024-09-12T03:19:43.261526+0000, chain.objs.size()=2 2024-09-12T01:37:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.826+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~80VKwmeh_6M43TcdS5j4xEESN55gs1C.1 2024-09-12T01:37:38.825 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.826+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~80VKwmeh_6M43TcdS5j4xEESN55gs1C.2 2024-09-12T01:37:38.827 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.828+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.829 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.830+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T01:37:38.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.832+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.831 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.832+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.832+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T01:37:38.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.832+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.12940543943918649168', time=2024-09-12T03:16:41.584150+0000, chain.objs.size()=1 2024-09-12T01:37:38.832 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.832+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.517__shadow_.XQ-OrMAOvdF-jmnr3G1HoAzcoYyUdnX_1 2024-09-12T01:37:38.834 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.835+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.836 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.837+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T01:37:38.837 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.838+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.838 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:37:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_AR_Cw0o9H-bLvg8EBw1vNpelF1aBjnt', time=2024-09-12T03:04:56.647458+0000, chain.objs.size()=3 2024-09-12T01:37:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_._Ux-uaRZzp3orcxvoAZZ8mgbzH54cQ5_0 2024-09-12T01:37:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_._Ux-uaRZzp3orcxvoAZZ8mgbzH54cQ5_1 2024-09-12T01:37:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.160__shadow_._Ux-uaRZzp3orcxvoAZZ8mgbzH54cQ5_2 2024-09-12T01:37:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_V43vISrvuqcs0o2ZSuz7l-XI8XcgsJb', time=2024-09-12T03:05:03.050789+0000, chain.objs.size()=1 2024-09-12T01:37:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_.MGcO39tXSMAd0mLCCBmCPIGocT0DDHx_0 2024-09-12T01:37:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14900413786329363749', time=2024-09-12T03:22:09.979312+0000, chain.objs.size()=1 2024-09-12T01:37:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.561__multipart_mymultipart.AmurZJRFwukx6b5vdpCoDxovAT_S_3qw.1 2024-09-12T01:37:38.839 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.690870672104089185', time=2024-09-12T03:26:26.031141+0000, chain.objs.size()=12 2024-09-12T01:37:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__multipart_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.1 2024-09-12T01:37:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__shadow_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.1_1 2024-09-12T01:37:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__multipart_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.2 2024-09-12T01:37:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.839+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__shadow_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.2_1 2024-09-12T01:37:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.840+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__multipart_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.3 2024-09-12T01:37:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.840+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__shadow_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.3_1 2024-09-12T01:37:38.840 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.840+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__multipart_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.4 2024-09-12T01:37:38.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.843+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__shadow_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.4_1 2024-09-12T01:37:38.842 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.843+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__multipart_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.5 2024-09-12T01:37:38.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.843+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__shadow_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.5_1 2024-09-12T01:37:38.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.843+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__multipart_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.6 2024-09-12T01:37:38.843 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.844+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.615__shadow_multipart_enc.2~DP8hkEOEEsOjrTec8AQ3Gil3FLXEFoi.6_1 2024-09-12T01:37:38.847 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.848+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.850 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.851+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T01:37:38.851 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.852+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.852 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:37:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11649303158663985065', time=2024-09-12T03:17:35.143379+0000, chain.objs.size()=3 2024-09-12T01:37:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.521__multipart_mymultipart.2~z_gBVxqnvVz2ArD9nV-aZ8URAxBxL4c.1 2024-09-12T01:37:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.521__multipart_mymultipart.2~z_gBVxqnvVz2ArD9nV-aZ8URAxBxL4c.2 2024-09-12T01:37:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.521__multipart_mymultipart.2~z_gBVxqnvVz2ArD9nV-aZ8URAxBxL4c.3 2024-09-12T01:37:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~hY2meLqKxlGr24dh9C70ucJbKQyt9RY', time=2024-09-12T03:20:32.883910+0000, chain.objs.size()=1 2024-09-12T01:37:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.534__multipart_mymultipart.2~hY2meLqKxlGr24dh9C70ucJbKQyt9RY.1 2024-09-12T01:37:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11528734105825903272', time=2024-09-12T03:22:09.296769+0000, chain.objs.size()=1 2024-09-12T01:37:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.561__multipart_mymultipart.2~S_K6W0BNseiXMd7woroWcsEdXQWRvfE.1 2024-09-12T01:37:38.853 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17543424641400646459', time=2024-09-12T03:30:39.188515+0000, chain.objs.size()=6 2024-09-12T01:37:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.662__multipart_foo.2~Zs2TpghVjmFeGzMC4sOJAAaf4TQAWD8.1 2024-09-12T01:37:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.662__multipart_foo.2~Zs2TpghVjmFeGzMC4sOJAAaf4TQAWD8.2 2024-09-12T01:37:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.662__multipart_foo.2~Zs2TpghVjmFeGzMC4sOJAAaf4TQAWD8.3 2024-09-12T01:37:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.662__multipart_foo.2~Zs2TpghVjmFeGzMC4sOJAAaf4TQAWD8.4 2024-09-12T01:37:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.662__multipart_foo.2~Zs2TpghVjmFeGzMC4sOJAAaf4TQAWD8.5 2024-09-12T01:37:38.854 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.853+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.662__multipart_foo.2~Zs2TpghVjmFeGzMC4sOJAAaf4TQAWD8.6 2024-09-12T01:37:38.857 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.858+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.859 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.860+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T01:37:38.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.862+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.861 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.862+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.862+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.862 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.863+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T01:37:38.863 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.864+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.864 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.865 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T01:37:38.868 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.17326634526492031497', time=2024-09-12T03:05:08.668972+0000, chain.objs.size()=5 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__multipart_foo-LUKEWARM.2~VrV1XdUUPt4FEYgswxbAtym6x-OVio7.1 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_foo-LUKEWARM.2~VrV1XdUUPt4FEYgswxbAtym6x-OVio7.1_1 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__multipart_foo-LUKEWARM.2~VrV1XdUUPt4FEYgswxbAtym6x-OVio7.2 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__shadow_foo-LUKEWARM.2~VrV1XdUUPt4FEYgswxbAtym6x-OVio7.2_1 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.161__multipart_foo-LUKEWARM.2~VrV1XdUUPt4FEYgswxbAtym6x-OVio7.3 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.11346923758208173466', time=2024-09-12T03:17:24.625437+0000, chain.objs.size()=3 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.521__multipart_mymultipart.2~pq4-iccqeGYYYykkbQ8Txa-ziWkvrY4.1 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.521__multipart_mymultipart.2~pq4-iccqeGYYYykkbQ8Txa-ziWkvrY4.2 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.521__multipart_mymultipart.2~pq4-iccqeGYYYykkbQ8Txa-ziWkvrY4.3 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.14540465651878806477', time=2024-09-12T03:17:34.865735+0000, chain.objs.size()=3 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.520__shadow:OnmDEbe.M3Ncwu0ikrw62a45u6ObLmy_.btoxKppSsUvHbNYx8BHWEvdi1qhwWgz_1 2024-09-12T01:37:38.869 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.520__shadow:OnmDEbe.M3Ncwu0ikrw62a45u6ObLmy_.btoxKppSsUvHbNYx8BHWEvdi1qhwWgz_2 2024-09-12T01:37:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.520__shadow:OnmDEbe.M3Ncwu0ikrw62a45u6ObLmy_.btoxKppSsUvHbNYx8BHWEvdi1qhwWgz_3 2024-09-12T01:37:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~JcqDkSmWohwQybwO6SD4ykGuqyUZbmR', time=2024-09-12T03:18:05.762126+0000, chain.objs.size()=1 2024-09-12T01:37:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.865+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~JcqDkSmWohwQybwO6SD4ykGuqyUZbmR.2 2024-09-12T01:37:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.870+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.541991462244966207', time=2024-09-12T03:19:55.241183+0000, chain.objs.size()=2 2024-09-12T01:37:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.870+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~bcySUjpcCCdrs0CVSh88n6ZwM4KHx7q.1 2024-09-12T01:37:38.870 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.870+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~bcySUjpcCCdrs0CVSh88n6ZwM4KHx7q.2 2024-09-12T01:37:38.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.870+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.13408591214556074621', time=2024-09-12T03:23:53.971023+0000, chain.objs.size()=4 2024-09-12T01:37:38.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.870+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~8gTj71byRc-Bbl2e-PTNWGtidBNF45B.1 2024-09-12T01:37:38.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.870+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~8gTj71byRc-Bbl2e-PTNWGtidBNF45B.2 2024-09-12T01:37:38.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.870+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~8gTj71byRc-Bbl2e-PTNWGtidBNF45B.3 2024-09-12T01:37:38.871 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.870+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~8gTj71byRc-Bbl2e-PTNWGtidBNF45B.4 2024-09-12T01:37:38.872 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.873+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.875 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.876+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T01:37:38.876 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.877+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.877 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:37:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.3837329735040042123', time=2024-09-12T03:16:22.179972+0000, chain.objs.size()=6 2024-09-12T01:37:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.1 2024-09-12T01:37:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.2 2024-09-12T01:37:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.3 2024-09-12T01:37:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.4 2024-09-12T01:37:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.5 2024-09-12T01:37:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.507__multipart_srcmultipart.2~QN_eVUmbHGLAlIwDPGlFjc0t1etsmyD.6 2024-09-12T01:37:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.1358196793490176954', time=2024-09-12T03:16:36.266202+0000, chain.objs.size()=1 2024-09-12T01:37:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.518__multipart_mymultipart.2~5_ZKvLQd0evzm9vqsouhAO2qChAcYSB.1 2024-09-12T01:37:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~6qY-BvCaOrr4cRZIHy7OJdXVY8O1_dt', time=2024-09-12T03:32:30.277752+0000, chain.objs.size()=1 2024-09-12T01:37:38.878 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.878+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.742__multipart_mymultipart.2~6qY-BvCaOrr4cRZIHy7OJdXVY8O1_dt.1 2024-09-12T01:37:38.881 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.882+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.883 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.884+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T01:37:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.886+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.885 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.886+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T01:37:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='_AMomKYvRHncWWPEJ6gYoWVLiggZJgaj', time=2024-09-12T03:05:25.934061+0000, chain.objs.size()=1 2024-09-12T01:37:38.886 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.163__shadow_.i6PHEGIaGVidewaH3gJv0NNoh1lcjZb_0 2024-09-12T01:37:38.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4813513198441337501', time=2024-09-12T03:18:05.782485+0000, chain.objs.size()=6 2024-09-12T01:37:38.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.orkiE-KYLfoToui-jQDSdMFSVpK9UA5f.1 2024-09-12T01:37:38.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~sWt0YV_bSTT-HlSw3MXCdfpBfy_sioZ.2 2024-09-12T01:37:38.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~sWt0YV_bSTT-HlSw3MXCdfpBfy_sioZ.3 2024-09-12T01:37:38.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~sWt0YV_bSTT-HlSw3MXCdfpBfy_sioZ.4 2024-09-12T01:37:38.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~sWt0YV_bSTT-HlSw3MXCdfpBfy_sioZ.5 2024-09-12T01:37:38.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~sWt0YV_bSTT-HlSw3MXCdfpBfy_sioZ.6 2024-09-12T01:37:38.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.9493667385400869007', time=2024-09-12T03:22:18.086847+0000, chain.objs.size()=2 2024-09-12T01:37:38.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.563__shadow_.kvggZOTuKYv37_t2-jH9ofRt8qWmBoy_1 2024-09-12T01:37:38.887 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.887+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.563__shadow_.kvggZOTuKYv37_t2-jH9ofRt8qWmBoy_2 2024-09-12T01:37:38.890 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.891+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.893 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.894+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T01:37:38.894 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.895+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.895 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=10, truncated=0, next_marker='' 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~xu6vxCHBiXojkffuxYPmRyh488tBvEv', time=2024-09-12T03:19:18.016171+0000, chain.objs.size()=1 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~xu6vxCHBiXojkffuxYPmRyh488tBvEv.1 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~xu6vxCHBiXojkffuxYPmRyh488tBvEv', time=2024-09-12T03:19:18.020170+0000, chain.objs.size()=1 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~xu6vxCHBiXojkffuxYPmRyh488tBvEv.2 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~xu6vxCHBiXojkffuxYPmRyh488tBvEv', time=2024-09-12T03:19:18.024042+0000, chain.objs.size()=1 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~xu6vxCHBiXojkffuxYPmRyh488tBvEv.3 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~xu6vxCHBiXojkffuxYPmRyh488tBvEv', time=2024-09-12T03:19:18.027825+0000, chain.objs.size()=1 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~xu6vxCHBiXojkffuxYPmRyh488tBvEv.4 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~xu6vxCHBiXojkffuxYPmRyh488tBvEv', time=2024-09-12T03:19:18.031732+0000, chain.objs.size()=1 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~xu6vxCHBiXojkffuxYPmRyh488tBvEv.5 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~xu6vxCHBiXojkffuxYPmRyh488tBvEv', time=2024-09-12T03:19:18.035742+0000, chain.objs.size()=1 2024-09-12T01:37:38.896 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.522__multipart_mymultipart.2~xu6vxCHBiXojkffuxYPmRyh488tBvEv.6 2024-09-12T01:37:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.4567035148203431142', time=2024-09-12T03:19:34.899689+0000, chain.objs.size()=1 2024-09-12T01:37:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.523__multipart_mymultipart.2~x_G3y39Zw2pvHW8_R3U3CYsYrMec06b.1 2024-09-12T01:37:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.953808748522629764', time=2024-09-12T03:19:49.748941+0000, chain.objs.size()=1 2024-09-12T01:37:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~boAIXf4xW5Pvb1r1E1Ddhwp9O2tJY6J.1 2024-09-12T01:37:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='2~11Ae8k1t0GT41PfJOMfkl8Bk9ts0Dbr', time=2024-09-12T03:20:23.588573+0000, chain.objs.size()=2 2024-09-12T01:37:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.529__multipart_mymultipart.2~11Ae8k1t0GT41PfJOMfkl8Bk9ts0Dbr.1 2024-09-12T01:37:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.529__multipart_mymultipart.2~11Ae8k1t0GT41PfJOMfkl8Bk9ts0Dbr.2 2024-09-12T01:37:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8061936437597162565', time=2024-09-12T03:23:43.424718+0000, chain.objs.size()=4 2024-09-12T01:37:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~id0jYZTSf2IYd5Fpg6uRk7d98ci6Ecn.1 2024-09-12T01:37:38.897 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.896+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~id0jYZTSf2IYd5Fpg6uRk7d98ci6Ecn.2 2024-09-12T01:37:38.899 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.900+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~id0jYZTSf2IYd5Fpg6uRk7d98ci6Ecn.3 2024-09-12T01:37:38.900 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.900+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.578__multipart_testobj.2~id0jYZTSf2IYd5Fpg6uRk7d98ci6Ecn.4 2024-09-12T01:37:38.902 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.903+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.904 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.905+0000 7fc627440800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T01:37:38.905 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.906+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T01:37:38.906 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T01:37:38.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T01:37:38.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.8861997242690808392', time=2024-09-12T03:04:31.053135+0000, chain.objs.size()=3 2024-09-12T01:37:38.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.158__shadow_.y4OaRNTwvEVSAm67PsrCAcUmeQbkWY6_0 2024-09-12T01:37:38.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.158__shadow_.y4OaRNTwvEVSAm67PsrCAcUmeQbkWY6_1 2024-09-12T01:37:38.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.158__shadow_.y4OaRNTwvEVSAm67PsrCAcUmeQbkWY6_2 2024-09-12T01:37:38.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.15205435164250149829', time=2024-09-12T03:04:39.830679+0000, chain.objs.size()=3 2024-09-12T01:37:38.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__multipart_mymultipart-STANDARD.2~BrME5BT3DYZooaDZJ9GlnxKCD9Qis-c.1 2024-09-12T01:37:38.907 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__multipart_mymultipart-STANDARD.2~BrME5BT3DYZooaDZJ9GlnxKCD9Qis-c.2 2024-09-12T01:37:38.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.159__multipart_mymultipart-STANDARD.2~BrME5BT3DYZooaDZJ9GlnxKCD9Qis-c.3 2024-09-12T01:37:38.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.10774614303328492934', time=2024-09-12T03:17:30.439895+0000, chain.objs.size()=3 2024-09-12T01:37:38.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.521__multipart_mymultipart.2~qiLt8sMmcDXXEWmHbCykGbs0gVfY5en.1 2024-09-12T01:37:38.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.521__multipart_mymultipart.2~qiLt8sMmcDXXEWmHbCykGbs0gVfY5en.2 2024-09-12T01:37:38.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.521__multipart_mymultipart.2~qiLt8sMmcDXXEWmHbCykGbs0gVfY5en.3 2024-09-12T01:37:38.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 20 garbage collection: RGWGC::process iterating over entry tag='844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.16606663883207728204', time=2024-09-12T03:20:03.721318+0000, chain.objs.size()=3 2024-09-12T01:37:38.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~yOfoyxzXssHz0_9pcniL9tdWGPCeXXQ.1 2024-09-12T01:37:38.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~yOfoyxzXssHz0_9pcniL9tdWGPCeXXQ.2 2024-09-12T01:37:38.908 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.907+0000 7fc627440800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:844f1394-9f73-45bf-8dcb-b3ca2aab8fdc.4501.525__multipart_mymultipart.2~yOfoyxzXssHz0_9pcniL9tdWGPCeXXQ.3 2024-09-12T01:37:38.911 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.912+0000 7fc627440800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T01:37:38.915 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.916+0000 7fc4dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T01:37:38.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.918+0000 7fc627440800 20 remove_watcher() i=0 2024-09-12T01:37:38.917 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.918+0000 7fc627440800 2 removed watcher, disabling cache 2024-09-12T01:37:38.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.919+0000 7fc627440800 20 remove_watcher() i=1 2024-09-12T01:37:38.918 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.919+0000 7fc627440800 20 remove_watcher() i=2 2024-09-12T01:37:38.920 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.921+0000 7fc627440800 20 remove_watcher() i=3 2024-09-12T01:37:38.921 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.922+0000 7fc627440800 20 remove_watcher() i=4 2024-09-12T01:37:38.922 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.923+0000 7fc627440800 20 remove_watcher() i=5 2024-09-12T01:37:38.923 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.924+0000 7fc627440800 20 remove_watcher() i=6 2024-09-12T01:37:38.924 INFO:teuthology.orchestra.run.smithi019.stderr:2024-09-12T01:37:38.925+0000 7fc627440800 20 remove_watcher() i=7 2024-09-12T01:37:38.936 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T01:37:38.949 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /home/ubuntu/cephtest/ca/root.crt /home/ubuntu/cephtest/ca/root.key 2024-09-12T01:37:38.979 DEBUG:teuthology.orchestra.run.smithi019:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:37:39.048 DEBUG:teuthology.orchestra.run.smithi019:> rm -f /home/ubuntu/cephtest/ca/rgw.client.0.crt /home/ubuntu/cephtest/ca/rgw.client.0.key 2024-09-12T01:37:39.118 DEBUG:teuthology.orchestra.run.smithi019:> rmdir --ignore-fail-on-non-empty /home/ubuntu/cephtest/ca 2024-09-12T01:37:39.189 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm /usr/share/pki/ca-trust-source/anchors/root.crt 2024-09-12T01:37:39.270 DEBUG:teuthology.orchestra.run.smithi019:> sudo update-ca-trust 2024-09-12T01:37:40.324 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T01:37:40.336 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T01:37:40.336 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:37:40.676 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:37:40.688 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:37:40.691 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":2449,"stamp":"2024-09-12T01:37:38.765634+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":474573084,"num_objects":1052,"num_object_clones":0,"num_object_copies":3130,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1052,"num_whiteouts":0,"num_read":279333,"num_read_kb":2386962,"num_write":143869,"num_write_kb":2165283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13664,"ondisk_log_size":13664,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2174408,"kb_used_data":738120,"kb_used_omap":12,"kb_used_meta":1436147,"kb_avail":752800312,"statfs":{"total":773094113280,"available":770867519488,"internally_reserved":0,"allocated":755834880,"data_stored":739573348,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1470615088},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005790"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.977721+0000","last_change":"2024-09-12T01:02:03.926254+0000","last_active":"2024-09-12T01:34:34.977721+0000","last_peered":"2024-09-12T01:34:34.977721+0000","last_clean":"2024-09-12T01:34:34.977721+0000","last_became_active":"2024-09-12T01:02:03.925687+0000","last_became_peered":"2024-09-12T01:02:03.925687+0000","last_unstale":"2024-09-12T01:34:34.977721+0000","last_undegraded":"2024-09-12T01:34:34.977721+0000","last_fullsized":"2024-09-12T01:34:34.977721+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:25.162167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"266'1","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.080100+0000","last_change":"2024-09-12T00:43:43.813662+0000","last_active":"2024-09-12T01:33:44.080100+0000","last_peered":"2024-09-12T01:33:44.080100+0000","last_clean":"2024-09-12T01:33:44.080100+0000","last_became_active":"2024-09-12T00:43:43.812701+0000","last_became_peered":"2024-09-12T00:43:43.812701+0000","last_unstale":"2024-09-12T01:33:44.080100+0000","last_undegraded":"2024-09-12T01:33:44.080100+0000","last_fullsized":"2024-09-12T01:33:44.080100+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:32.083600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.110512+0000","last_change":"2024-09-12T00:43:38.799582+0000","last_active":"2024-09-12T01:33:40.110512+0000","last_peered":"2024-09-12T01:33:40.110512+0000","last_clean":"2024-09-12T01:33:40.110512+0000","last_became_active":"2024-09-12T00:43:38.799322+0000","last_became_peered":"2024-09-12T00:43:38.799322+0000","last_unstale":"2024-09-12T01:33:40.110512+0000","last_undegraded":"2024-09-12T01:33:40.110512+0000","last_fullsized":"2024-09-12T01:33:40.110512+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:52.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.256826+0000","last_change":"2024-09-12T00:39:17.764042+0000","last_active":"2024-09-12T01:35:32.256826+0000","last_peered":"2024-09-12T01:35:32.256826+0000","last_clean":"2024-09-12T01:35:32.256826+0000","last_became_active":"2024-09-12T00:39:17.763761+0000","last_became_peered":"2024-09-12T00:39:17.763761+0000","last_unstale":"2024-09-12T01:35:32.256826+0000","last_undegraded":"2024-09-12T01:35:32.256826+0000","last_fullsized":"2024-09-12T01:35:32.256826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:49.430258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.175890+0000","last_change":"2024-09-12T01:02:03.925619+0000","last_active":"2024-09-12T01:34:34.175890+0000","last_peered":"2024-09-12T01:34:34.175890+0000","last_clean":"2024-09-12T01:34:34.175890+0000","last_became_active":"2024-09-12T01:02:03.925338+0000","last_became_peered":"2024-09-12T01:02:03.925338+0000","last_unstale":"2024-09-12T01:34:34.175890+0000","last_undegraded":"2024-09-12T01:34:34.175890+0000","last_fullsized":"2024-09-12T01:34:34.175890+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:34.463430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"266'4","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079607+0000","last_change":"2024-09-12T00:43:43.822539+0000","last_active":"2024-09-12T01:33:45.079607+0000","last_peered":"2024-09-12T01:33:45.079607+0000","last_clean":"2024-09-12T01:33:45.079607+0000","last_became_active":"2024-09-12T00:43:43.822189+0000","last_became_peered":"2024-09-12T00:43:43.822189+0000","last_unstale":"2024-09-12T01:33:45.079607+0000","last_undegraded":"2024-09-12T01:33:45.079607+0000","last_fullsized":"2024-09-12T01:33:45.079607+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:14.331070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":12284,"num_write":9,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987382+0000","last_change":"2024-09-12T00:43:38.794157+0000","last_active":"2024-09-12T01:33:38.987382+0000","last_peered":"2024-09-12T01:33:38.987382+0000","last_clean":"2024-09-12T01:33:38.987382+0000","last_became_active":"2024-09-12T00:43:38.793866+0000","last_became_peered":"2024-09-12T00:43:38.793866+0000","last_unstale":"2024-09-12T01:33:38.987382+0000","last_undegraded":"2024-09-12T01:33:38.987382+0000","last_fullsized":"2024-09-12T01:33:38.987382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:51.874866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'33","reported_seq":147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256146+0000","last_change":"2024-09-12T00:39:17.769275+0000","last_active":"2024-09-12T01:35:27.256146+0000","last_peered":"2024-09-12T01:35:27.256146+0000","last_clean":"2024-09-12T01:35:27.256146+0000","last_became_active":"2024-09-12T00:39:17.768977+0000","last_became_peered":"2024-09-12T00:39:17.768977+0000","last_unstale":"2024-09-12T01:35:27.256146+0000","last_undegraded":"2024-09-12T01:35:27.256146+0000","last_fullsized":"2024-09-12T01:35:27.256146+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:10.855870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":119,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.078422+0000","last_change":"2024-09-12T01:02:03.922480+0000","last_active":"2024-09-12T01:33:29.078422+0000","last_peered":"2024-09-12T01:33:29.078422+0000","last_clean":"2024-09-12T01:33:29.078422+0000","last_became_active":"2024-09-12T01:02:03.921938+0000","last_became_peered":"2024-09-12T01:02:03.921938+0000","last_unstale":"2024-09-12T01:33:29.078422+0000","last_undegraded":"2024-09-12T01:33:29.078422+0000","last_fullsized":"2024-09-12T01:33:29.078422+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:49.013238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"266'5","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:43.988145+0000","last_change":"2024-09-12T00:43:43.814192+0000","last_active":"2024-09-12T01:33:43.988145+0000","last_peered":"2024-09-12T01:33:43.988145+0000","last_clean":"2024-09-12T01:33:43.988145+0000","last_became_active":"2024-09-12T00:43:43.813568+0000","last_became_peered":"2024-09-12T00:43:43.813568+0000","last_unstale":"2024-09-12T01:33:43.988145+0000","last_undegraded":"2024-09-12T01:33:43.988145+0000","last_fullsized":"2024-09-12T01:33:43.988145+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:58.958483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":6,"num_read_kb":7172,"num_write":5,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'6","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:50.112033+0000","last_change":"2024-09-12T00:43:38.797811+0000","last_active":"2024-09-12T01:33:50.112033+0000","last_peered":"2024-09-12T01:33:50.112033+0000","last_clean":"2024-09-12T01:33:50.112033+0000","last_became_active":"2024-09-12T00:43:38.797520+0000","last_became_peered":"2024-09-12T00:43:38.797520+0000","last_unstale":"2024-09-12T01:33:50.112033+0000","last_undegraded":"2024-09-12T01:33:50.112033+0000","last_fullsized":"2024-09-12T01:33:50.112033+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:56.953531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":16390,"num_write":11,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'41","reported_seq":171,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173586+0000","last_change":"2024-09-12T00:39:17.769080+0000","last_active":"2024-09-12T01:34:19.173586+0000","last_peered":"2024-09-12T01:34:19.173586+0000","last_clean":"2024-09-12T01:34:19.173586+0000","last_became_active":"2024-09-12T00:39:17.768692+0000","last_became_peered":"2024-09-12T00:39:17.768692+0000","last_unstale":"2024-09-12T01:34:19.173586+0000","last_undegraded":"2024-09-12T01:34:19.173586+0000","last_fullsized":"2024-09-12T01:34:19.173586+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:43.550430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":161,"num_write":65,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987313+0000","last_change":"2024-09-12T01:02:03.922647+0000","last_active":"2024-09-12T01:33:38.987313+0000","last_peered":"2024-09-12T01:33:38.987313+0000","last_clean":"2024-09-12T01:33:38.987313+0000","last_became_active":"2024-09-12T01:02:03.922297+0000","last_became_peered":"2024-09-12T01:02:03.922297+0000","last_unstale":"2024-09-12T01:33:38.987313+0000","last_undegraded":"2024-09-12T01:33:38.987313+0000","last_fullsized":"2024-09-12T01:33:38.987313+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:53.989667+0000","last_change":"2024-09-12T00:43:43.819023+0000","last_active":"2024-09-12T01:33:53.989667+0000","last_peered":"2024-09-12T01:33:53.989667+0000","last_clean":"2024-09-12T01:33:53.989667+0000","last_became_active":"2024-09-12T00:43:43.818668+0000","last_became_peered":"2024-09-12T00:43:43.818668+0000","last_unstale":"2024-09-12T01:33:53.989667+0000","last_undegraded":"2024-09-12T01:33:53.989667+0000","last_fullsized":"2024-09-12T01:33:53.989667+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:45.138160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.079562+0000","last_change":"2024-09-12T00:43:38.795677+0000","last_active":"2024-09-12T01:33:39.079562+0000","last_peered":"2024-09-12T01:33:39.079562+0000","last_clean":"2024-09-12T01:33:39.079562+0000","last_became_active":"2024-09-12T00:43:38.794121+0000","last_became_peered":"2024-09-12T00:43:38.794121+0000","last_unstale":"2024-09-12T01:33:39.079562+0000","last_undegraded":"2024-09-12T01:33:39.079562+0000","last_fullsized":"2024-09-12T01:33:39.079562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:33.638934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'16","reported_seq":93,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173559+0000","last_change":"2024-09-12T00:39:17.759626+0000","last_active":"2024-09-12T01:34:19.173559+0000","last_peered":"2024-09-12T01:34:19.173559+0000","last_clean":"2024-09-12T01:34:19.173559+0000","last_became_active":"2024-09-12T00:39:17.759016+0000","last_became_peered":"2024-09-12T00:39:17.759016+0000","last_unstale":"2024-09-12T01:34:19.173559+0000","last_undegraded":"2024-09-12T01:34:19.173559+0000","last_fullsized":"2024-09-12T01:34:19.173559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:25.380216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:15.115873+0000","last_change":"2024-09-12T01:02:03.919665+0000","last_active":"2024-09-12T01:34:15.115873+0000","last_peered":"2024-09-12T01:34:15.115873+0000","last_clean":"2024-09-12T01:34:15.115873+0000","last_became_active":"2024-09-12T01:02:03.919293+0000","last_became_peered":"2024-09-12T01:02:03.919293+0000","last_unstale":"2024-09-12T01:34:15.115873+0000","last_undegraded":"2024-09-12T01:34:15.115873+0000","last_fullsized":"2024-09-12T01:34:15.115873+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:31.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.978417+0000","last_change":"2024-09-12T00:43:43.818041+0000","last_active":"2024-09-12T01:34:39.978417+0000","last_peered":"2024-09-12T01:34:39.978417+0000","last_clean":"2024-09-12T01:34:39.978417+0000","last_became_active":"2024-09-12T00:43:43.817714+0000","last_became_peered":"2024-09-12T00:43:43.817714+0000","last_unstale":"2024-09-12T01:34:39.978417+0000","last_undegraded":"2024-09-12T01:34:39.978417+0000","last_fullsized":"2024-09-12T01:34:39.978417+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:15.291037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'14","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:23.994284+0000","last_change":"2024-09-12T00:43:38.795483+0000","last_active":"2024-09-12T01:34:23.994284+0000","last_peered":"2024-09-12T01:34:23.994284+0000","last_clean":"2024-09-12T01:34:23.994284+0000","last_became_active":"2024-09-12T00:43:38.795206+0000","last_became_peered":"2024-09-12T00:43:38.795206+0000","last_unstale":"2024-09-12T01:34:23.994284+0000","last_undegraded":"2024-09-12T01:34:23.994284+0000","last_fullsized":"2024-09-12T01:34:23.994284+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:51.351578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":25,"num_read_kb":29708,"num_write":19,"num_write_kb":14332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'31","reported_seq":144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173515+0000","last_change":"2024-09-12T00:39:17.762663+0000","last_active":"2024-09-12T01:34:19.173515+0000","last_peered":"2024-09-12T01:34:19.173515+0000","last_clean":"2024-09-12T01:34:19.173515+0000","last_became_active":"2024-09-12T00:39:17.762124+0000","last_became_peered":"2024-09-12T00:39:17.762124+0000","last_unstale":"2024-09-12T01:34:19.173515+0000","last_undegraded":"2024-09-12T01:34:19.173515+0000","last_fullsized":"2024-09-12T01:34:19.173515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:55.240200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256179+0000","last_change":"2024-09-12T01:02:03.915670+0000","last_active":"2024-09-12T01:35:27.256179+0000","last_peered":"2024-09-12T01:35:27.256179+0000","last_clean":"2024-09-12T01:35:27.256179+0000","last_became_active":"2024-09-12T01:02:03.915387+0000","last_became_peered":"2024-09-12T01:02:03.915387+0000","last_unstale":"2024-09-12T01:35:27.256179+0000","last_undegraded":"2024-09-12T01:35:27.256179+0000","last_fullsized":"2024-09-12T01:35:27.256179+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:30.278716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529511+0000","last_change":"2024-09-12T00:43:43.825343+0000","last_active":"2024-09-12T01:34:29.529511+0000","last_peered":"2024-09-12T01:34:29.529511+0000","last_clean":"2024-09-12T01:34:29.529511+0000","last_became_active":"2024-09-12T00:43:43.825054+0000","last_became_peered":"2024-09-12T00:43:43.825054+0000","last_unstale":"2024-09-12T01:34:29.529511+0000","last_undegraded":"2024-09-12T01:34:29.529511+0000","last_fullsized":"2024-09-12T01:34:29.529511+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:57.949570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'1","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529573+0000","last_change":"2024-09-12T00:43:38.794955+0000","last_active":"2024-09-12T01:34:29.529573+0000","last_peered":"2024-09-12T01:34:29.529573+0000","last_clean":"2024-09-12T01:34:29.529573+0000","last_became_active":"2024-09-12T00:43:38.794612+0000","last_became_peered":"2024-09-12T00:43:38.794612+0000","last_unstale":"2024-09-12T01:34:29.529573+0000","last_undegraded":"2024-09-12T01:34:29.529573+0000","last_fullsized":"2024-09-12T01:34:29.529573+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:55.593800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'16","reported_seq":92,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:20.083241+0000","last_change":"2024-09-12T00:39:17.772179+0000","last_active":"2024-09-12T01:34:20.083241+0000","last_peered":"2024-09-12T01:34:20.083241+0000","last_clean":"2024-09-12T01:34:20.083241+0000","last_became_active":"2024-09-12T00:39:17.771839+0000","last_became_peered":"2024-09-12T00:39:17.771839+0000","last_unstale":"2024-09-12T01:34:20.083241+0000","last_undegraded":"2024-09-12T01:34:20.083241+0000","last_fullsized":"2024-09-12T01:34:20.083241+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:56.418566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":43,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.084810+0000","last_change":"2024-09-12T01:02:03.928338+0000","last_active":"2024-09-12T01:34:35.084810+0000","last_peered":"2024-09-12T01:34:35.084810+0000","last_clean":"2024-09-12T01:34:35.084810+0000","last_became_active":"2024-09-12T01:02:03.928036+0000","last_became_peered":"2024-09-12T01:02:03.928036+0000","last_unstale":"2024-09-12T01:34:35.084810+0000","last_undegraded":"2024-09-12T01:34:35.084810+0000","last_fullsized":"2024-09-12T01:34:35.084810+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:58.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079595+0000","last_change":"2024-09-12T00:43:43.819611+0000","last_active":"2024-09-12T01:33:45.079595+0000","last_peered":"2024-09-12T01:33:45.079595+0000","last_clean":"2024-09-12T01:33:45.079595+0000","last_became_active":"2024-09-12T00:43:43.819239+0000","last_became_peered":"2024-09-12T00:43:43.819239+0000","last_unstale":"2024-09-12T01:33:45.079595+0000","last_undegraded":"2024-09-12T01:33:45.079595+0000","last_fullsized":"2024-09-12T01:33:45.079595+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.073168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8210,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"266'9","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.972128+0000","last_change":"2024-09-12T00:43:38.785050+0000","last_active":"2024-09-12T01:33:39.972128+0000","last_peered":"2024-09-12T01:33:39.972128+0000","last_clean":"2024-09-12T01:33:39.972128+0000","last_became_active":"2024-09-12T00:43:38.784746+0000","last_became_peered":"2024-09-12T00:43:38.784746+0000","last_unstale":"2024-09-12T01:33:39.972128+0000","last_undegraded":"2024-09-12T01:33:39.972128+0000","last_fullsized":"2024-09-12T01:33:39.972128+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:12.845708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":5122,"num_write":19,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"257'30","reported_seq":143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123074+0000","last_change":"2024-09-12T00:39:17.764933+0000","last_active":"2024-09-12T01:35:05.123074+0000","last_peered":"2024-09-12T01:35:05.123074+0000","last_clean":"2024-09-12T01:35:05.123074+0000","last_became_active":"2024-09-12T00:39:17.764658+0000","last_became_peered":"2024-09-12T00:39:17.764658+0000","last_unstale":"2024-09-12T01:35:05.123074+0000","last_undegraded":"2024-09-12T01:35:05.123074+0000","last_fullsized":"2024-09-12T01:35:05.123074+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:54.897501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":139,"num_write":41,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.977764+0000","last_change":"2024-09-12T01:02:03.917684+0000","last_active":"2024-09-12T01:34:34.977764+0000","last_peered":"2024-09-12T01:34:34.977764+0000","last_clean":"2024-09-12T01:34:34.977764+0000","last_became_active":"2024-09-12T01:02:03.917362+0000","last_became_peered":"2024-09-12T01:02:03.917362+0000","last_unstale":"2024-09-12T01:34:34.977764+0000","last_undegraded":"2024-09-12T01:34:34.977764+0000","last_fullsized":"2024-09-12T01:34:34.977764+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:13.774129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"266'6","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.111283+0000","last_change":"2024-09-12T00:43:43.822843+0000","last_active":"2024-09-12T01:33:45.111283+0000","last_peered":"2024-09-12T01:33:45.111283+0000","last_clean":"2024-09-12T01:33:45.111283+0000","last_became_active":"2024-09-12T00:43:43.822574+0000","last_became_peered":"2024-09-12T00:43:43.822574+0000","last_unstale":"2024-09-12T01:33:45.111283+0000","last_undegraded":"2024-09-12T01:33:45.111283+0000","last_fullsized":"2024-09-12T01:33:45.111283+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:31.603888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2105344,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":9228,"num_write":6,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'1","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.167303+0000","last_change":"2024-09-12T00:43:38.799826+0000","last_active":"2024-09-12T01:33:39.167303+0000","last_peered":"2024-09-12T01:33:39.167303+0000","last_clean":"2024-09-12T01:33:39.167303+0000","last_became_active":"2024-09-12T00:43:38.799567+0000","last_became_peered":"2024-09-12T00:43:38.799567+0000","last_unstale":"2024-09-12T01:33:39.167303+0000","last_undegraded":"2024-09-12T01:33:39.167303+0000","last_fullsized":"2024-09-12T01:33:39.167303+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:50.512707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'52","reported_seq":196,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.178294+0000","last_change":"2024-09-12T00:39:17.761012+0000","last_active":"2024-09-12T01:34:54.178294+0000","last_peered":"2024-09-12T01:34:54.178294+0000","last_clean":"2024-09-12T01:34:54.178294+0000","last_became_active":"2024-09-12T00:39:17.760735+0000","last_became_peered":"2024-09-12T00:39:17.760735+0000","last_unstale":"2024-09-12T01:34:54.178294+0000","last_undegraded":"2024-09-12T01:34:54.178294+0000","last_fullsized":"2024-09-12T01:34:54.178294+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:37.209781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":192,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997802+0000","last_change":"2024-09-12T01:02:03.925249+0000","last_active":"2024-09-12T01:34:43.997802+0000","last_peered":"2024-09-12T01:34:43.997802+0000","last_clean":"2024-09-12T01:34:43.997802+0000","last_became_active":"2024-09-12T01:02:03.924800+0000","last_became_peered":"2024-09-12T01:02:03.924800+0000","last_unstale":"2024-09-12T01:34:43.997802+0000","last_undegraded":"2024-09-12T01:34:43.997802+0000","last_fullsized":"2024-09-12T01:34:43.997802+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:42.824392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:30.118030+0000","last_change":"2024-09-12T00:43:43.822402+0000","last_active":"2024-09-12T01:34:30.118030+0000","last_peered":"2024-09-12T01:34:30.118030+0000","last_clean":"2024-09-12T01:34:30.118030+0000","last_became_active":"2024-09-12T00:43:43.822130+0000","last_became_peered":"2024-09-12T00:43:43.822130+0000","last_unstale":"2024-09-12T01:34:30.118030+0000","last_undegraded":"2024-09-12T01:34:30.118030+0000","last_fullsized":"2024-09-12T01:34:30.118030+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:52.855759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533810+0000","last_change":"2024-09-12T00:43:38.789538+0000","last_active":"2024-09-12T01:35:04.533810+0000","last_peered":"2024-09-12T01:35:04.533810+0000","last_clean":"2024-09-12T01:35:04.533810+0000","last_became_active":"2024-09-12T00:43:38.789198+0000","last_became_peered":"2024-09-12T00:43:38.789198+0000","last_unstale":"2024-09-12T01:35:04.533810+0000","last_undegraded":"2024-09-12T01:35:04.533810+0000","last_fullsized":"2024-09-12T01:35:04.533810+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:11.316230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'15","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250354+0000","last_change":"2024-09-12T00:39:17.767969+0000","last_active":"2024-09-12T01:34:52.250354+0000","last_peered":"2024-09-12T01:34:52.250354+0000","last_clean":"2024-09-12T01:34:52.250354+0000","last_became_active":"2024-09-12T00:39:17.767662+0000","last_became_peered":"2024-09-12T00:39:17.767662+0000","last_unstale":"2024-09-12T01:34:52.250354+0000","last_undegraded":"2024-09-12T01:34:52.250354+0000","last_fullsized":"2024-09-12T01:34:52.250354+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:30.457902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:44.177191+0000","last_change":"2024-09-12T01:02:03.924577+0000","last_active":"2024-09-12T01:34:44.177191+0000","last_peered":"2024-09-12T01:34:44.177191+0000","last_clean":"2024-09-12T01:34:44.177191+0000","last_became_active":"2024-09-12T01:02:03.924303+0000","last_became_peered":"2024-09-12T01:02:03.924303+0000","last_unstale":"2024-09-12T01:34:44.177191+0000","last_undegraded":"2024-09-12T01:34:44.177191+0000","last_fullsized":"2024-09-12T01:34:44.177191+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:24.298478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'7","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.002995+0000","last_change":"2024-09-12T00:43:43.821003+0000","last_active":"2024-09-12T01:35:14.002995+0000","last_peered":"2024-09-12T01:35:14.002995+0000","last_clean":"2024-09-12T01:35:14.002995+0000","last_became_active":"2024-09-12T00:43:43.819058+0000","last_became_peered":"2024-09-12T00:43:43.819058+0000","last_unstale":"2024-09-12T01:35:14.002995+0000","last_undegraded":"2024-09-12T01:35:14.002995+0000","last_fullsized":"2024-09-12T01:35:14.002995+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:02.246750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":9222,"num_write":12,"num_write_kb":9222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"266'6","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.976780+0000","last_change":"2024-09-12T00:43:38.796717+0000","last_active":"2024-09-12T01:34:24.976780+0000","last_peered":"2024-09-12T01:34:24.976780+0000","last_clean":"2024-09-12T01:34:24.976780+0000","last_became_active":"2024-09-12T00:43:38.796426+0000","last_became_peered":"2024-09-12T00:43:38.796426+0000","last_unstale":"2024-09-12T01:34:24.976780+0000","last_undegraded":"2024-09-12T01:34:24.976780+0000","last_fullsized":"2024-09-12T01:34:24.976780+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:20.544492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4202496,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":9226,"num_write":6,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250340+0000","last_change":"2024-09-12T00:39:17.767397+0000","last_active":"2024-09-12T01:34:52.250340+0000","last_peered":"2024-09-12T01:34:52.250340+0000","last_clean":"2024-09-12T01:34:52.250340+0000","last_became_active":"2024-09-12T00:39:17.767088+0000","last_became_peered":"2024-09-12T00:39:17.767088+0000","last_unstale":"2024-09-12T01:34:52.250340+0000","last_undegraded":"2024-09-12T01:34:52.250340+0000","last_fullsized":"2024-09-12T01:34:52.250340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:12.858828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:45.085791+0000","last_change":"2024-09-12T01:02:03.925759+0000","last_active":"2024-09-12T01:34:45.085791+0000","last_peered":"2024-09-12T01:34:45.085791+0000","last_clean":"2024-09-12T01:34:45.085791+0000","last_became_active":"2024-09-12T01:02:03.925482+0000","last_became_peered":"2024-09-12T01:02:03.925482+0000","last_unstale":"2024-09-12T01:34:45.085791+0000","last_undegraded":"2024-09-12T01:34:45.085791+0000","last_fullsized":"2024-09-12T01:34:45.085791+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:13.030524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"266'1","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:30.118079+0000","last_change":"2024-09-12T00:43:43.820868+0000","last_active":"2024-09-12T01:34:30.118079+0000","last_peered":"2024-09-12T01:34:30.118079+0000","last_clean":"2024-09-12T01:34:30.118079+0000","last_became_active":"2024-09-12T00:43:43.820272+0000","last_became_peered":"2024-09-12T00:43:43.820272+0000","last_unstale":"2024-09-12T01:34:30.118079+0000","last_undegraded":"2024-09-12T01:34:30.118079+0000","last_fullsized":"2024-09-12T01:34:30.118079+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:42.963849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'5","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:25.117367+0000","last_change":"2024-09-12T00:43:38.800018+0000","last_active":"2024-09-12T01:34:25.117367+0000","last_peered":"2024-09-12T01:34:25.117367+0000","last_clean":"2024-09-12T01:34:25.117367+0000","last_became_active":"2024-09-12T00:43:38.799719+0000","last_became_peered":"2024-09-12T00:43:38.799719+0000","last_unstale":"2024-09-12T01:34:25.117367+0000","last_undegraded":"2024-09-12T01:34:25.117367+0000","last_fullsized":"2024-09-12T01:34:25.117367+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:07.155485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20462,"num_write":5,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'32","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:55.121695+0000","last_change":"2024-09-12T00:39:17.762941+0000","last_active":"2024-09-12T01:34:55.121695+0000","last_peered":"2024-09-12T01:34:55.121695+0000","last_clean":"2024-09-12T01:34:55.121695+0000","last_became_active":"2024-09-12T00:39:17.762639+0000","last_became_peered":"2024-09-12T00:39:17.762639+0000","last_unstale":"2024-09-12T01:34:55.121695+0000","last_undegraded":"2024-09-12T01:34:55.121695+0000","last_fullsized":"2024-09-12T01:34:55.121695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:15.974100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:44.978932+0000","last_change":"2024-09-12T01:02:03.925349+0000","last_active":"2024-09-12T01:34:44.978932+0000","last_peered":"2024-09-12T01:34:44.978932+0000","last_clean":"2024-09-12T01:34:44.978932+0000","last_became_active":"2024-09-12T01:02:03.924892+0000","last_became_peered":"2024-09-12T01:02:03.924892+0000","last_unstale":"2024-09-12T01:34:44.978932+0000","last_undegraded":"2024-09-12T01:34:44.978932+0000","last_fullsized":"2024-09-12T01:34:44.978932+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:07.795848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'3","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.977276+0000","last_change":"2024-09-12T00:43:43.819938+0000","last_active":"2024-09-12T01:34:29.977276+0000","last_peered":"2024-09-12T01:34:29.977276+0000","last_clean":"2024-09-12T01:34:29.977276+0000","last_became_active":"2024-09-12T00:43:43.819431+0000","last_became_peered":"2024-09-12T00:43:43.819431+0000","last_unstale":"2024-09-12T01:34:29.977276+0000","last_undegraded":"2024-09-12T01:34:29.977276+0000","last_fullsized":"2024-09-12T01:34:29.977276+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:42.027354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":6148,"num_write":3,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"266'2","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:23.994420+0000","last_change":"2024-09-12T00:43:38.797182+0000","last_active":"2024-09-12T01:34:23.994420+0000","last_peered":"2024-09-12T01:34:23.994420+0000","last_clean":"2024-09-12T01:34:23.994420+0000","last_became_active":"2024-09-12T00:43:38.796894+0000","last_became_peered":"2024-09-12T00:43:38.796894+0000","last_unstale":"2024-09-12T01:34:23.994420+0000","last_undegraded":"2024-09-12T01:34:23.994420+0000","last_fullsized":"2024-09-12T01:34:23.994420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:57.433793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'47","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:04.519365+0000","last_change":"2024-09-12T00:39:17.762269+0000","last_active":"2024-09-12T01:33:04.519365+0000","last_peered":"2024-09-12T01:33:04.519365+0000","last_clean":"2024-09-12T01:33:04.519365+0000","last_became_active":"2024-09-12T00:39:17.761972+0000","last_became_peered":"2024-09-12T00:39:17.761972+0000","last_unstale":"2024-09-12T01:33:04.519365+0000","last_undegraded":"2024-09-12T01:33:04.519365+0000","last_fullsized":"2024-09-12T01:33:04.519365+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:47.885908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":165,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:28.985653+0000","last_change":"2024-09-12T01:02:03.923742+0000","last_active":"2024-09-12T01:33:28.985653+0000","last_peered":"2024-09-12T01:33:28.985653+0000","last_clean":"2024-09-12T01:33:28.985653+0000","last_became_active":"2024-09-12T01:02:03.923464+0000","last_became_peered":"2024-09-12T01:02:03.923464+0000","last_unstale":"2024-09-12T01:33:28.985653+0000","last_undegraded":"2024-09-12T01:33:28.985653+0000","last_fullsized":"2024-09-12T01:33:28.985653+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:44.541153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'8","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.001260+0000","last_change":"2024-09-12T00:43:43.818258+0000","last_active":"2024-09-12T01:35:04.001260+0000","last_peered":"2024-09-12T01:35:04.001260+0000","last_clean":"2024-09-12T01:35:04.001260+0000","last_became_active":"2024-09-12T00:43:43.817990+0000","last_became_peered":"2024-09-12T00:43:43.817990+0000","last_unstale":"2024-09-12T01:35:04.001260+0000","last_undegraded":"2024-09-12T01:35:04.001260+0000","last_fullsized":"2024-09-12T01:35:04.001260+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:00.011210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5299146,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":15,"num_read_kb":14448,"num_write":13,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"266'1","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:59.087723+0000","last_change":"2024-09-12T00:43:38.795940+0000","last_active":"2024-09-12T01:34:59.087723+0000","last_peered":"2024-09-12T01:34:59.087723+0000","last_clean":"2024-09-12T01:34:59.087723+0000","last_became_active":"2024-09-12T00:43:38.793825+0000","last_became_peered":"2024-09-12T00:43:38.793825+0000","last_unstale":"2024-09-12T01:34:59.087723+0000","last_undegraded":"2024-09-12T01:34:59.087723+0000","last_fullsized":"2024-09-12T01:34:59.087723+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:24.205683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'20","reported_seq":110,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:59.518795+0000","last_change":"2024-09-12T00:39:17.770201+0000","last_active":"2024-09-12T01:32:59.518795+0000","last_peered":"2024-09-12T01:32:59.518795+0000","last_clean":"2024-09-12T01:32:59.518795+0000","last_became_active":"2024-09-12T00:39:17.769263+0000","last_became_peered":"2024-09-12T00:39:17.769263+0000","last_unstale":"2024-09-12T01:32:59.518795+0000","last_undegraded":"2024-09-12T01:32:59.518795+0000","last_fullsized":"2024-09-12T01:32:59.518795+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:15.097860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.165777+0000","last_change":"2024-09-12T01:02:03.924548+0000","last_active":"2024-09-12T01:33:29.165777+0000","last_peered":"2024-09-12T01:33:29.165777+0000","last_clean":"2024-09-12T01:33:29.165777+0000","last_became_active":"2024-09-12T01:02:03.924260+0000","last_became_peered":"2024-09-12T01:02:03.924260+0000","last_unstale":"2024-09-12T01:33:29.165777+0000","last_undegraded":"2024-09-12T01:33:29.165777+0000","last_fullsized":"2024-09-12T01:33:29.165777+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:07.250231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"266'2","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.001165+0000","last_change":"2024-09-12T00:43:43.824871+0000","last_active":"2024-09-12T01:35:04.001165+0000","last_peered":"2024-09-12T01:35:04.001165+0000","last_clean":"2024-09-12T01:35:04.001165+0000","last_became_active":"2024-09-12T00:43:43.824567+0000","last_became_peered":"2024-09-12T00:43:43.824567+0000","last_unstale":"2024-09-12T01:35:04.001165+0000","last_undegraded":"2024-09-12T01:35:04.001165+0000","last_fullsized":"2024-09-12T01:35:04.001165+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:24.293339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"266'4","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:59.000438+0000","last_change":"2024-09-12T00:43:38.798453+0000","last_active":"2024-09-12T01:34:59.000438+0000","last_peered":"2024-09-12T01:34:59.000438+0000","last_clean":"2024-09-12T01:34:59.000438+0000","last_became_active":"2024-09-12T00:43:38.798200+0000","last_became_peered":"2024-09-12T00:43:38.798200+0000","last_unstale":"2024-09-12T01:34:59.000438+0000","last_undegraded":"2024-09-12T01:34:59.000438+0000","last_fullsized":"2024-09-12T01:34:59.000438+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:27.881376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"266'30","reported_seq":139,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:00.104641+0000","last_change":"2024-09-12T00:39:17.766861+0000","last_active":"2024-09-12T01:33:00.104641+0000","last_peered":"2024-09-12T01:33:00.104641+0000","last_clean":"2024-09-12T01:33:00.104641+0000","last_became_active":"2024-09-12T00:39:17.766600+0000","last_became_peered":"2024-09-12T00:39:17.766600+0000","last_unstale":"2024-09-12T01:33:00.104641+0000","last_undegraded":"2024-09-12T01:33:00.104641+0000","last_fullsized":"2024-09-12T01:33:00.104641+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:07.049466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":112,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250307+0000","last_change":"2024-09-12T01:02:03.919723+0000","last_active":"2024-09-12T01:34:52.250307+0000","last_peered":"2024-09-12T01:34:52.250307+0000","last_clean":"2024-09-12T01:34:52.250307+0000","last_became_active":"2024-09-12T01:02:03.919377+0000","last_became_peered":"2024-09-12T01:02:03.919377+0000","last_unstale":"2024-09-12T01:34:52.250307+0000","last_undegraded":"2024-09-12T01:34:52.250307+0000","last_fullsized":"2024-09-12T01:34:52.250307+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:59.358385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123101+0000","last_change":"2024-09-12T00:43:43.818424+0000","last_active":"2024-09-12T01:35:05.123101+0000","last_peered":"2024-09-12T01:35:05.123101+0000","last_clean":"2024-09-12T01:35:05.123101+0000","last_became_active":"2024-09-12T00:43:43.818153+0000","last_became_peered":"2024-09-12T00:43:43.818153+0000","last_unstale":"2024-09-12T01:35:05.123101+0000","last_undegraded":"2024-09-12T01:35:05.123101+0000","last_fullsized":"2024-09-12T01:35:05.123101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.787318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'4","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:59.087764+0000","last_change":"2024-09-12T00:43:38.792429+0000","last_active":"2024-09-12T01:34:59.087764+0000","last_peered":"2024-09-12T01:34:59.087764+0000","last_clean":"2024-09-12T01:34:59.087764+0000","last_became_active":"2024-09-12T00:43:38.792135+0000","last_became_peered":"2024-09-12T00:43:38.792135+0000","last_unstale":"2024-09-12T01:34:59.087764+0000","last_undegraded":"2024-09-12T01:34:59.087764+0000","last_fullsized":"2024-09-12T01:34:59.087764+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:11.570953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4238636,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":8232,"num_write":4,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"266'12","reported_seq":88,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:00.074801+0000","last_change":"2024-09-12T00:39:17.768309+0000","last_active":"2024-09-12T01:33:00.074801+0000","last_peered":"2024-09-12T01:33:00.074801+0000","last_clean":"2024-09-12T01:33:00.074801+0000","last_became_active":"2024-09-12T00:39:17.767599+0000","last_became_peered":"2024-09-12T00:39:17.767599+0000","last_unstale":"2024-09-12T01:33:00.074801+0000","last_undegraded":"2024-09-12T01:33:00.074801+0000","last_fullsized":"2024-09-12T01:33:00.074801+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:18.635424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.165738+0000","last_change":"2024-09-12T01:02:03.918519+0000","last_active":"2024-09-12T01:33:29.165738+0000","last_peered":"2024-09-12T01:33:29.165738+0000","last_clean":"2024-09-12T01:33:29.165738+0000","last_became_active":"2024-09-12T01:02:03.918248+0000","last_became_peered":"2024-09-12T01:02:03.918248+0000","last_unstale":"2024-09-12T01:33:29.165738+0000","last_undegraded":"2024-09-12T01:33:29.165738+0000","last_fullsized":"2024-09-12T01:33:29.165738+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:15.650720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533744+0000","last_change":"2024-09-12T00:43:43.825033+0000","last_active":"2024-09-12T01:35:04.533744+0000","last_peered":"2024-09-12T01:35:04.533744+0000","last_clean":"2024-09-12T01:35:04.533744+0000","last_became_active":"2024-09-12T00:43:43.822993+0000","last_became_peered":"2024-09-12T00:43:43.822993+0000","last_unstale":"2024-09-12T01:35:04.533744+0000","last_undegraded":"2024-09-12T01:35:04.533744+0000","last_fullsized":"2024-09-12T01:35:04.533744+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.928486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:59.087781+0000","last_change":"2024-09-12T00:43:38.795993+0000","last_active":"2024-09-12T01:34:59.087781+0000","last_peered":"2024-09-12T01:34:59.087781+0000","last_clean":"2024-09-12T01:34:59.087781+0000","last_became_active":"2024-09-12T00:43:38.795625+0000","last_became_peered":"2024-09-12T00:43:38.795625+0000","last_unstale":"2024-09-12T01:34:59.087781+0000","last_undegraded":"2024-09-12T01:34:59.087781+0000","last_fullsized":"2024-09-12T01:34:59.087781+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:32.904211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'39","reported_seq":160,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:00.104565+0000","last_change":"2024-09-12T00:39:17.761781+0000","last_active":"2024-09-12T01:33:00.104565+0000","last_peered":"2024-09-12T01:33:00.104565+0000","last_clean":"2024-09-12T01:33:00.104565+0000","last_became_active":"2024-09-12T00:39:17.761517+0000","last_became_peered":"2024-09-12T00:39:17.761517+0000","last_unstale":"2024-09-12T01:33:00.104565+0000","last_undegraded":"2024-09-12T01:33:00.104565+0000","last_fullsized":"2024-09-12T01:33:00.104565+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:36.401035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997821+0000","last_change":"2024-09-12T01:02:03.924588+0000","last_active":"2024-09-12T01:34:43.997821+0000","last_peered":"2024-09-12T01:34:43.997821+0000","last_clean":"2024-09-12T01:34:43.997821+0000","last_became_active":"2024-09-12T01:02:03.923808+0000","last_became_peered":"2024-09-12T01:02:03.923808+0000","last_unstale":"2024-09-12T01:34:43.997821+0000","last_undegraded":"2024-09-12T01:34:43.997821+0000","last_fullsized":"2024-09-12T01:34:43.997821+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:42.299573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'5","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:15.106685+0000","last_change":"2024-09-12T00:43:43.819522+0000","last_active":"2024-09-12T01:33:15.106685+0000","last_peered":"2024-09-12T01:33:15.106685+0000","last_clean":"2024-09-12T01:33:15.106685+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:33:15.106685+0000","last_undegraded":"2024-09-12T01:33:15.106685+0000","last_fullsized":"2024-09-12T01:33:15.106685+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:30.323747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:10.075895+0000","last_change":"2024-09-12T00:43:38.795759+0000","last_active":"2024-09-12T01:33:10.075895+0000","last_peered":"2024-09-12T01:33:10.075895+0000","last_clean":"2024-09-12T01:33:10.075895+0000","last_became_active":"2024-09-12T00:43:38.795451+0000","last_became_peered":"2024-09-12T00:43:38.795451+0000","last_unstale":"2024-09-12T01:33:10.075895+0000","last_undegraded":"2024-09-12T01:33:10.075895+0000","last_fullsized":"2024-09-12T01:33:10.075895+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:17.278286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5238784,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":4092,"num_write":2,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'133","reported_seq":488,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:30.109250+0000","last_change":"2024-09-12T00:39:17.763176+0000","last_active":"2024-09-12T01:33:30.109250+0000","last_peered":"2024-09-12T01:33:30.109250+0000","last_clean":"2024-09-12T01:33:30.109250+0000","last_became_active":"2024-09-12T00:39:17.762649+0000","last_became_peered":"2024-09-12T00:39:17.762649+0000","last_unstale":"2024-09-12T01:33:30.109250+0000","last_undegraded":"2024-09-12T01:33:30.109250+0000","last_fullsized":"2024-09-12T01:33:30.109250+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:52.621341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":844,"num_read_kb":585,"num_write":185,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.078996+0000","last_change":"2024-09-12T01:02:03.925718+0000","last_active":"2024-09-12T01:33:34.078996+0000","last_peered":"2024-09-12T01:33:34.078996+0000","last_clean":"2024-09-12T01:33:34.078996+0000","last_became_active":"2024-09-12T01:02:03.924934+0000","last_became_peered":"2024-09-12T01:02:03.924934+0000","last_unstale":"2024-09-12T01:33:34.078996+0000","last_undegraded":"2024-09-12T01:33:34.078996+0000","last_fullsized":"2024-09-12T01:33:34.078996+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:26.933104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:15.106630+0000","last_change":"2024-09-12T00:43:43.822008+0000","last_active":"2024-09-12T01:33:15.106630+0000","last_peered":"2024-09-12T01:33:15.106630+0000","last_clean":"2024-09-12T01:33:15.106630+0000","last_became_active":"2024-09-12T00:43:43.821288+0000","last_became_peered":"2024-09-12T00:43:43.821288+0000","last_unstale":"2024-09-12T01:33:15.106630+0000","last_undegraded":"2024-09-12T01:33:15.106630+0000","last_fullsized":"2024-09-12T01:33:15.106630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:12.223424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:09.162715+0000","last_change":"2024-09-12T00:43:38.798047+0000","last_active":"2024-09-12T01:33:09.162715+0000","last_peered":"2024-09-12T01:33:09.162715+0000","last_clean":"2024-09-12T01:33:09.162715+0000","last_became_active":"2024-09-12T00:43:38.797782+0000","last_became_peered":"2024-09-12T00:43:38.797782+0000","last_unstale":"2024-09-12T01:33:09.162715+0000","last_undegraded":"2024-09-12T01:33:09.162715+0000","last_fullsized":"2024-09-12T01:33:09.162715+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:52.438462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'33","reported_seq":147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.521087+0000","last_change":"2024-09-12T00:39:17.769240+0000","last_active":"2024-09-12T01:33:19.521087+0000","last_peered":"2024-09-12T01:33:19.521087+0000","last_clean":"2024-09-12T01:33:19.521087+0000","last_became_active":"2024-09-12T00:39:17.768151+0000","last_became_peered":"2024-09-12T00:39:17.768151+0000","last_unstale":"2024-09-12T01:33:19.521087+0000","last_undegraded":"2024-09-12T01:33:19.521087+0000","last_fullsized":"2024-09-12T01:33:19.521087+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:44.421190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.530106+0000","last_change":"2024-09-12T01:02:03.922540+0000","last_active":"2024-09-12T01:34:34.530106+0000","last_peered":"2024-09-12T01:34:34.530106+0000","last_clean":"2024-09-12T01:34:34.530106+0000","last_became_active":"2024-09-12T01:02:03.921595+0000","last_became_peered":"2024-09-12T01:02:03.921595+0000","last_unstale":"2024-09-12T01:34:34.530106+0000","last_undegraded":"2024-09-12T01:34:34.530106+0000","last_fullsized":"2024-09-12T01:34:34.530106+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.523672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"266'8","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:25.108448+0000","last_change":"2024-09-12T00:43:43.820529+0000","last_active":"2024-09-12T01:33:25.108448+0000","last_peered":"2024-09-12T01:33:25.108448+0000","last_clean":"2024-09-12T01:33:25.108448+0000","last_became_active":"2024-09-12T00:43:43.819990+0000","last_became_peered":"2024-09-12T00:43:43.819990+0000","last_unstale":"2024-09-12T01:33:25.108448+0000","last_undegraded":"2024-09-12T01:33:25.108448+0000","last_fullsized":"2024-09-12T01:33:25.108448+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:58.280401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":13,"num_read_kb":8217,"num_write":13,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'1","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:10.106015+0000","last_change":"2024-09-12T00:43:38.798676+0000","last_active":"2024-09-12T01:33:10.106015+0000","last_peered":"2024-09-12T01:33:10.106015+0000","last_clean":"2024-09-12T01:33:10.106015+0000","last_became_active":"2024-09-12T00:43:38.798374+0000","last_became_peered":"2024-09-12T00:43:38.798374+0000","last_unstale":"2024-09-12T01:33:10.106015+0000","last_undegraded":"2024-09-12T01:33:10.106015+0000","last_fullsized":"2024-09-12T01:33:10.106015+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:29.029265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":166,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.077519+0000","last_change":"2024-09-12T00:39:17.758205+0000","last_active":"2024-09-12T01:33:19.077519+0000","last_peered":"2024-09-12T01:33:19.077519+0000","last_clean":"2024-09-12T01:33:19.077519+0000","last_became_active":"2024-09-12T00:39:17.757795+0000","last_became_peered":"2024-09-12T00:39:17.757795+0000","last_unstale":"2024-09-12T01:33:19.077519+0000","last_undegraded":"2024-09-12T01:33:19.077519+0000","last_fullsized":"2024-09-12T01:33:19.077519+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:32.214592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.085182+0000","last_change":"2024-09-12T01:02:03.924136+0000","last_active":"2024-09-12T01:34:34.085182+0000","last_peered":"2024-09-12T01:34:34.085182+0000","last_clean":"2024-09-12T01:34:34.085182+0000","last_became_active":"2024-09-12T01:02:03.923774+0000","last_became_peered":"2024-09-12T01:02:03.923774+0000","last_unstale":"2024-09-12T01:34:34.085182+0000","last_undegraded":"2024-09-12T01:34:34.085182+0000","last_fullsized":"2024-09-12T01:34:34.085182+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:13.881070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"266'5","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:13.983282+0000","last_change":"2024-09-12T00:43:43.820925+0000","last_active":"2024-09-12T01:33:13.983282+0000","last_peered":"2024-09-12T01:33:13.983282+0000","last_clean":"2024-09-12T01:33:13.983282+0000","last_became_active":"2024-09-12T00:43:43.819044+0000","last_became_peered":"2024-09-12T00:43:43.819044+0000","last_unstale":"2024-09-12T01:33:13.983282+0000","last_undegraded":"2024-09-12T01:33:13.983282+0000","last_fullsized":"2024-09-12T01:33:13.983282+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:51.315359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9453568,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":4,"num_read_kb":6160,"num_write":10,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:20.107587+0000","last_change":"2024-09-12T00:43:38.797698+0000","last_active":"2024-09-12T01:33:20.107587+0000","last_peered":"2024-09-12T01:33:20.107587+0000","last_clean":"2024-09-12T01:33:20.107587+0000","last_became_active":"2024-09-12T00:43:38.797343+0000","last_became_peered":"2024-09-12T00:43:38.797343+0000","last_unstale":"2024-09-12T01:33:20.107587+0000","last_undegraded":"2024-09-12T01:33:20.107587+0000","last_fullsized":"2024-09-12T01:33:20.107587+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:07.327017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'33","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.164334+0000","last_change":"2024-09-12T00:39:17.760056+0000","last_active":"2024-09-12T01:33:19.164334+0000","last_peered":"2024-09-12T01:33:19.164334+0000","last_clean":"2024-09-12T01:33:19.164334+0000","last_became_active":"2024-09-12T00:39:17.759701+0000","last_became_peered":"2024-09-12T00:39:17.759701+0000","last_unstale":"2024-09-12T01:33:19.164334+0000","last_undegraded":"2024-09-12T01:33:19.164334+0000","last_fullsized":"2024-09-12T01:33:19.164334+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:36.105302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":64,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:33.986537+0000","last_change":"2024-09-12T01:02:03.923765+0000","last_active":"2024-09-12T01:33:33.986537+0000","last_peered":"2024-09-12T01:33:33.986537+0000","last_clean":"2024-09-12T01:33:33.986537+0000","last_became_active":"2024-09-12T01:02:03.923440+0000","last_became_peered":"2024-09-12T01:02:03.923440+0000","last_unstale":"2024-09-12T01:33:33.986537+0000","last_undegraded":"2024-09-12T01:33:33.986537+0000","last_fullsized":"2024-09-12T01:33:33.986537+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:46.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'4","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.522920+0000","last_change":"2024-09-12T00:43:43.819656+0000","last_active":"2024-09-12T01:33:34.522920+0000","last_peered":"2024-09-12T01:33:34.522920+0000","last_clean":"2024-09-12T01:33:34.522920+0000","last_became_active":"2024-09-12T00:43:43.819247+0000","last_became_peered":"2024-09-12T00:43:43.819247+0000","last_unstale":"2024-09-12T01:33:34.522920+0000","last_undegraded":"2024-09-12T01:33:34.522920+0000","last_fullsized":"2024-09-12T01:33:34.522920+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:00.847535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3207,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":1032,"num_write":9,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"266'4","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:30.109087+0000","last_change":"2024-09-12T00:43:38.794688+0000","last_active":"2024-09-12T01:33:30.109087+0000","last_peered":"2024-09-12T01:33:30.109087+0000","last_clean":"2024-09-12T01:33:30.109087+0000","last_became_active":"2024-09-12T00:43:38.794286+0000","last_became_peered":"2024-09-12T00:43:38.794286+0000","last_unstale":"2024-09-12T01:33:30.109087+0000","last_undegraded":"2024-09-12T01:33:30.109087+0000","last_fullsized":"2024-09-12T01:33:30.109087+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:52.618143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":6160,"num_write":9,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'28","reported_seq":129,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.164290+0000","last_change":"2024-09-12T00:39:17.762387+0000","last_active":"2024-09-12T01:33:19.164290+0000","last_peered":"2024-09-12T01:33:19.164290+0000","last_clean":"2024-09-12T01:33:19.164290+0000","last_became_active":"2024-09-12T00:39:17.761738+0000","last_became_peered":"2024-09-12T00:39:17.761738+0000","last_unstale":"2024-09-12T01:33:19.164290+0000","last_undegraded":"2024-09-12T01:33:19.164290+0000","last_fullsized":"2024-09-12T01:33:19.164290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:49.875350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":96,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.079050+0000","last_change":"2024-09-12T01:02:03.928768+0000","last_active":"2024-09-12T01:33:40.079050+0000","last_peered":"2024-09-12T01:33:40.079050+0000","last_clean":"2024-09-12T01:33:40.079050+0000","last_became_active":"2024-09-12T01:02:03.928475+0000","last_became_peered":"2024-09-12T01:02:03.928475+0000","last_unstale":"2024-09-12T01:33:40.079050+0000","last_undegraded":"2024-09-12T01:33:40.079050+0000","last_fullsized":"2024-09-12T01:33:40.079050+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:39.969871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'2","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:35.078402+0000","last_change":"2024-09-12T00:43:43.821438+0000","last_active":"2024-09-12T01:33:35.078402+0000","last_peered":"2024-09-12T01:33:35.078402+0000","last_clean":"2024-09-12T01:33:35.078402+0000","last_became_active":"2024-09-12T00:43:43.821149+0000","last_became_peered":"2024-09-12T00:43:43.821149+0000","last_unstale":"2024-09-12T01:33:35.078402+0000","last_undegraded":"2024-09-12T01:33:35.078402+0000","last_fullsized":"2024-09-12T01:33:35.078402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:02.729782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'7","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:28.985571+0000","last_change":"2024-09-12T00:43:38.799268+0000","last_active":"2024-09-12T01:33:28.985571+0000","last_peered":"2024-09-12T01:33:28.985571+0000","last_clean":"2024-09-12T01:33:28.985571+0000","last_became_active":"2024-09-12T00:43:38.798510+0000","last_became_peered":"2024-09-12T00:43:38.798510+0000","last_unstale":"2024-09-12T01:33:28.985571+0000","last_undegraded":"2024-09-12T01:33:28.985571+0000","last_fullsized":"2024-09-12T01:33:28.985571+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:19.360861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4234449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":9,"num_read_kb":16416,"num_write":12,"num_write_kb":12320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'28","reported_seq":135,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.078974+0000","last_change":"2024-09-12T00:39:17.771090+0000","last_active":"2024-09-12T01:33:40.078974+0000","last_peered":"2024-09-12T01:33:40.078974+0000","last_clean":"2024-09-12T01:33:40.078974+0000","last_became_active":"2024-09-12T00:39:17.770779+0000","last_became_peered":"2024-09-12T00:39:17.770779+0000","last_unstale":"2024-09-12T01:33:40.078974+0000","last_undegraded":"2024-09-12T01:33:40.078974+0000","last_fullsized":"2024-09-12T01:33:40.078974+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:45.806957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.971578+0000","last_change":"2024-09-12T01:02:03.925931+0000","last_active":"2024-09-12T01:33:34.971578+0000","last_peered":"2024-09-12T01:33:34.971578+0000","last_clean":"2024-09-12T01:33:34.971578+0000","last_became_active":"2024-09-12T01:02:03.925618+0000","last_became_peered":"2024-09-12T01:02:03.925618+0000","last_unstale":"2024-09-12T01:33:34.971578+0000","last_undegraded":"2024-09-12T01:33:34.971578+0000","last_fullsized":"2024-09-12T01:33:34.971578+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:46.274807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"266'3","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:14.163453+0000","last_change":"2024-09-12T00:43:43.825678+0000","last_active":"2024-09-12T01:33:14.163453+0000","last_peered":"2024-09-12T01:33:14.163453+0000","last_clean":"2024-09-12T01:33:14.163453+0000","last_became_active":"2024-09-12T00:43:43.825380+0000","last_became_peered":"2024-09-12T00:43:43.825380+0000","last_unstale":"2024-09-12T01:33:14.163453+0000","last_undegraded":"2024-09-12T01:33:14.163453+0000","last_fullsized":"2024-09-12T01:33:14.163453+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:38.026807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4234449,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":8232,"num_write":8,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.110471+0000","last_change":"2024-09-12T00:43:38.791841+0000","last_active":"2024-09-12T01:33:40.110471+0000","last_peered":"2024-09-12T01:33:40.110471+0000","last_clean":"2024-09-12T01:33:40.110471+0000","last_became_active":"2024-09-12T00:43:38.791586+0000","last_became_peered":"2024-09-12T00:43:38.791586+0000","last_unstale":"2024-09-12T01:33:40.110471+0000","last_undegraded":"2024-09-12T01:33:40.110471+0000","last_fullsized":"2024-09-12T01:33:40.110471+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:32.346959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'54","reported_seq":205,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:28.985589+0000","last_change":"2024-09-12T00:39:17.762695+0000","last_active":"2024-09-12T01:33:28.985589+0000","last_peered":"2024-09-12T01:33:28.985589+0000","last_clean":"2024-09-12T01:33:28.985589+0000","last_became_active":"2024-09-12T00:39:17.762435+0000","last_became_peered":"2024-09-12T00:39:17.762435+0000","last_unstale":"2024-09-12T01:33:28.985589+0000","last_undegraded":"2024-09-12T01:33:28.985589+0000","last_fullsized":"2024-09-12T01:33:28.985589+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:26.720224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":202,"num_write":91,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:35.109860+0000","last_change":"2024-09-12T01:02:03.926151+0000","last_active":"2024-09-12T01:33:35.109860+0000","last_peered":"2024-09-12T01:33:35.109860+0000","last_clean":"2024-09-12T01:33:35.109860+0000","last_became_active":"2024-09-12T01:02:03.925866+0000","last_became_peered":"2024-09-12T01:02:03.925866+0000","last_unstale":"2024-09-12T01:33:35.109860+0000","last_undegraded":"2024-09-12T01:33:35.109860+0000","last_fullsized":"2024-09-12T01:33:35.109860+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:41.925257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'2","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.972646+0000","last_change":"2024-09-12T00:43:43.820437+0000","last_active":"2024-09-12T01:33:44.972646+0000","last_peered":"2024-09-12T01:33:44.972646+0000","last_clean":"2024-09-12T01:33:44.972646+0000","last_became_active":"2024-09-12T00:43:43.820153+0000","last_became_peered":"2024-09-12T00:43:43.820153+0000","last_unstale":"2024-09-12T01:33:44.972646+0000","last_undegraded":"2024-09-12T01:33:44.972646+0000","last_fullsized":"2024-09-12T01:33:44.972646+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:49.421817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:09.519945+0000","last_change":"2024-09-12T00:43:38.790234+0000","last_active":"2024-09-12T01:33:09.519945+0000","last_peered":"2024-09-12T01:33:09.519945+0000","last_clean":"2024-09-12T01:33:09.519945+0000","last_became_active":"2024-09-12T00:43:38.789945+0000","last_became_peered":"2024-09-12T00:43:38.789945+0000","last_unstale":"2024-09-12T01:33:09.519945+0000","last_undegraded":"2024-09-12T01:33:09.519945+0000","last_fullsized":"2024-09-12T01:33:09.519945+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.330002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":7,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'34","reported_seq":150,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.970915+0000","last_change":"2024-09-12T00:39:17.760033+0000","last_active":"2024-09-12T01:33:29.970915+0000","last_peered":"2024-09-12T01:33:29.970915+0000","last_clean":"2024-09-12T01:33:29.970915+0000","last_became_active":"2024-09-12T00:39:17.759741+0000","last_became_peered":"2024-09-12T00:39:17.759741+0000","last_unstale":"2024-09-12T01:33:29.970915+0000","last_undegraded":"2024-09-12T01:33:29.970915+0000","last_fullsized":"2024-09-12T01:33:29.970915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:16.079518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.983140+0000","last_change":"2024-09-12T01:02:03.919303+0000","last_active":"2024-09-12T01:35:24.983140+0000","last_peered":"2024-09-12T01:35:24.983140+0000","last_clean":"2024-09-12T01:35:24.983140+0000","last_became_active":"2024-09-12T01:02:03.918998+0000","last_became_peered":"2024-09-12T01:02:03.918998+0000","last_unstale":"2024-09-12T01:35:24.983140+0000","last_undegraded":"2024-09-12T01:35:24.983140+0000","last_fullsized":"2024-09-12T01:35:24.983140+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:39.378429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:53.989633+0000","last_change":"2024-09-12T00:43:43.822054+0000","last_active":"2024-09-12T01:33:53.989633+0000","last_peered":"2024-09-12T01:33:53.989633+0000","last_clean":"2024-09-12T01:33:53.989633+0000","last_became_active":"2024-09-12T00:43:43.821691+0000","last_became_peered":"2024-09-12T00:43:43.821691+0000","last_unstale":"2024-09-12T01:33:53.989633+0000","last_undegraded":"2024-09-12T01:33:53.989633+0000","last_fullsized":"2024-09-12T01:33:53.989633+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:18.745231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523665+0000","last_change":"2024-09-12T00:43:38.798045+0000","last_active":"2024-09-12T01:33:39.523665+0000","last_peered":"2024-09-12T01:33:39.523665+0000","last_clean":"2024-09-12T01:33:39.523665+0000","last_became_active":"2024-09-12T00:43:38.797711+0000","last_became_peered":"2024-09-12T00:43:38.797711+0000","last_unstale":"2024-09-12T01:33:39.523665+0000","last_undegraded":"2024-09-12T01:33:39.523665+0000","last_fullsized":"2024-09-12T01:33:39.523665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:56.223002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'32","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:27.237937+0000","last_change":"2024-09-12T00:39:17.761142+0000","last_active":"2024-09-12T01:33:27.237937+0000","last_peered":"2024-09-12T01:33:27.237937+0000","last_clean":"2024-09-12T01:33:27.237937+0000","last_became_active":"2024-09-12T00:39:17.760839+0000","last_became_peered":"2024-09-12T00:39:17.760839+0000","last_unstale":"2024-09-12T01:33:27.237937+0000","last_undegraded":"2024-09-12T01:33:27.237937+0000","last_fullsized":"2024-09-12T01:33:27.237937+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:10.465344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.983164+0000","last_change":"2024-09-12T01:02:03.920002+0000","last_active":"2024-09-12T01:35:24.983164+0000","last_peered":"2024-09-12T01:35:24.983164+0000","last_clean":"2024-09-12T01:35:24.983164+0000","last_became_active":"2024-09-12T01:02:03.919706+0000","last_became_peered":"2024-09-12T01:02:03.919706+0000","last_unstale":"2024-09-12T01:35:24.983164+0000","last_undegraded":"2024-09-12T01:35:24.983164+0000","last_fullsized":"2024-09-12T01:35:24.983164+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:03.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"266'1","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:43.988084+0000","last_change":"2024-09-12T00:43:43.818598+0000","last_active":"2024-09-12T01:33:43.988084+0000","last_peered":"2024-09-12T01:33:43.988084+0000","last_clean":"2024-09-12T01:33:43.988084+0000","last_became_active":"2024-09-12T00:43:43.818321+0000","last_became_peered":"2024-09-12T00:43:43.818321+0000","last_unstale":"2024-09-12T01:33:43.988084+0000","last_undegraded":"2024-09-12T01:33:43.988084+0000","last_fullsized":"2024-09-12T01:33:43.988084+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:55.640954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48428,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":96,"num_write":1,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'3","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.241650+0000","last_change":"2024-09-12T00:43:38.792440+0000","last_active":"2024-09-12T01:33:52.241650+0000","last_peered":"2024-09-12T01:33:52.241650+0000","last_clean":"2024-09-12T01:33:52.241650+0000","last_became_active":"2024-09-12T00:43:38.792154+0000","last_became_peered":"2024-09-12T00:43:38.792154+0000","last_unstale":"2024-09-12T01:33:52.241650+0000","last_undegraded":"2024-09-12T01:33:52.241650+0000","last_fullsized":"2024-09-12T01:33:52.241650+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:59.352763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1034,"num_write":3,"num_write_kb":1034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"266'40","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.522358+0000","last_change":"2024-09-12T00:39:17.770041+0000","last_active":"2024-09-12T01:33:29.522358+0000","last_peered":"2024-09-12T01:33:29.522358+0000","last_clean":"2024-09-12T01:33:29.522358+0000","last_became_active":"2024-09-12T00:39:17.767962+0000","last_became_peered":"2024-09-12T00:39:17.767962+0000","last_unstale":"2024-09-12T01:33:29.522358+0000","last_undegraded":"2024-09-12T01:33:29.522358+0000","last_fullsized":"2024-09-12T01:33:29.522358+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:38.083643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":136,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:13.992744+0000","last_change":"2024-09-12T01:02:03.922136+0000","last_active":"2024-09-12T01:34:13.992744+0000","last_peered":"2024-09-12T01:34:13.992744+0000","last_clean":"2024-09-12T01:34:13.992744+0000","last_became_active":"2024-09-12T01:02:03.918216+0000","last_became_peered":"2024-09-12T01:02:03.918216+0000","last_unstale":"2024-09-12T01:34:13.992744+0000","last_undegraded":"2024-09-12T01:34:13.992744+0000","last_fullsized":"2024-09-12T01:34:13.992744+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:26.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'9","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.971645+0000","last_change":"2024-09-12T00:43:43.820490+0000","last_active":"2024-09-12T01:33:34.971645+0000","last_peered":"2024-09-12T01:33:34.971645+0000","last_clean":"2024-09-12T01:33:34.971645+0000","last_became_active":"2024-09-12T00:43:43.820194+0000","last_became_peered":"2024-09-12T00:43:43.820194+0000","last_unstale":"2024-09-12T01:33:34.971645+0000","last_undegraded":"2024-09-12T01:33:34.971645+0000","last_fullsized":"2024-09-12T01:33:34.971645+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:54.662468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":10242,"num_write":9,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"266'8","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:30.077958+0000","last_change":"2024-09-12T00:43:38.797923+0000","last_active":"2024-09-12T01:33:30.077958+0000","last_peered":"2024-09-12T01:33:30.077958+0000","last_clean":"2024-09-12T01:33:30.077958+0000","last_became_active":"2024-09-12T00:43:38.797428+0000","last_became_peered":"2024-09-12T00:43:38.797428+0000","last_unstale":"2024-09-12T01:33:30.077958+0000","last_undegraded":"2024-09-12T01:33:30.077958+0000","last_fullsized":"2024-09-12T01:33:30.077958+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:07.995028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8384512,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":12282,"num_write":18,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'85","reported_seq":370,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.079026+0000","last_change":"2024-09-12T00:39:17.767845+0000","last_active":"2024-09-12T01:33:40.079026+0000","last_peered":"2024-09-12T01:33:40.079026+0000","last_clean":"2024-09-12T01:33:40.079026+0000","last_became_active":"2024-09-12T00:39:17.767517+0000","last_became_peered":"2024-09-12T00:39:17.767517+0000","last_unstale":"2024-09-12T01:33:40.079026+0000","last_undegraded":"2024-09-12T01:33:40.079026+0000","last_fullsized":"2024-09-12T01:33:40.079026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:44.733701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":615,"num_read_kb":395,"num_write":114,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536407+0000","last_change":"2024-09-12T01:02:03.922775+0000","last_active":"2024-09-12T01:35:24.536407+0000","last_peered":"2024-09-12T01:35:24.536407+0000","last_clean":"2024-09-12T01:35:24.536407+0000","last_became_active":"2024-09-12T01:02:03.922479+0000","last_became_peered":"2024-09-12T01:02:03.922479+0000","last_unstale":"2024-09-12T01:35:24.536407+0000","last_undegraded":"2024-09-12T01:35:24.536407+0000","last_fullsized":"2024-09-12T01:35:24.536407+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.011531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"263'4","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.523080+0000","last_change":"2024-09-12T00:43:43.821630+0000","last_active":"2024-09-12T01:33:34.523080+0000","last_peered":"2024-09-12T01:33:34.523080+0000","last_clean":"2024-09-12T01:33:34.523080+0000","last_became_active":"2024-09-12T00:43:43.821303+0000","last_became_peered":"2024-09-12T00:43:43.821303+0000","last_unstale":"2024-09-12T01:33:34.523080+0000","last_undegraded":"2024-09-12T01:33:34.523080+0000","last_fullsized":"2024-09-12T01:33:34.523080+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:56.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16370,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'1","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.522372+0000","last_change":"2024-09-12T00:43:38.800008+0000","last_active":"2024-09-12T01:33:29.522372+0000","last_peered":"2024-09-12T01:33:29.522372+0000","last_clean":"2024-09-12T01:33:29.522372+0000","last_became_active":"2024-09-12T00:43:38.799623+0000","last_became_peered":"2024-09-12T00:43:38.799623+0000","last_unstale":"2024-09-12T01:33:29.522372+0000","last_undegraded":"2024-09-12T01:33:29.522372+0000","last_fullsized":"2024-09-12T01:33:29.522372+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:26.934976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":60362,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":59,"num_write":1,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'30","reported_seq":139,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:30.109177+0000","last_change":"2024-09-12T00:39:17.768450+0000","last_active":"2024-09-12T01:33:30.109177+0000","last_peered":"2024-09-12T01:33:30.109177+0000","last_clean":"2024-09-12T01:33:30.109177+0000","last_became_active":"2024-09-12T00:39:17.768143+0000","last_became_peered":"2024-09-12T00:39:17.768143+0000","last_unstale":"2024-09-12T01:33:30.109177+0000","last_undegraded":"2024-09-12T01:33:30.109177+0000","last_fullsized":"2024-09-12T01:33:30.109177+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:16.633147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":109,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.118947+0000","last_change":"2024-09-12T01:02:03.927047+0000","last_active":"2024-09-12T01:34:35.118947+0000","last_peered":"2024-09-12T01:34:35.118947+0000","last_clean":"2024-09-12T01:34:35.118947+0000","last_became_active":"2024-09-12T01:02:03.926699+0000","last_became_peered":"2024-09-12T01:02:03.926699+0000","last_unstale":"2024-09-12T01:34:35.118947+0000","last_undegraded":"2024-09-12T01:34:35.118947+0000","last_fullsized":"2024-09-12T01:34:35.118947+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:16.113729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'6","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.240897+0000","last_change":"2024-09-12T00:43:43.819559+0000","last_active":"2024-09-12T01:33:47.240897+0000","last_peered":"2024-09-12T01:33:47.240897+0000","last_clean":"2024-09-12T01:33:47.240897+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:33:47.240897+0000","last_undegraded":"2024-09-12T01:33:47.240897+0000","last_fullsized":"2024-09-12T01:33:47.240897+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:15.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24570,"num_write":11,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:50.080070+0000","last_change":"2024-09-12T00:43:38.798764+0000","last_active":"2024-09-12T01:33:50.080070+0000","last_peered":"2024-09-12T01:33:50.080070+0000","last_clean":"2024-09-12T01:33:50.080070+0000","last_became_active":"2024-09-12T00:43:38.798431+0000","last_became_peered":"2024-09-12T00:43:38.798431+0000","last_unstale":"2024-09-12T01:33:50.080070+0000","last_undegraded":"2024-09-12T01:33:50.080070+0000","last_fullsized":"2024-09-12T01:33:50.080070+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:19.004021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":123,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:30.077916+0000","last_change":"2024-09-12T00:39:17.769932+0000","last_active":"2024-09-12T01:33:30.077916+0000","last_peered":"2024-09-12T01:33:30.077916+0000","last_clean":"2024-09-12T01:33:30.077916+0000","last_became_active":"2024-09-12T00:39:17.768901+0000","last_became_peered":"2024-09-12T00:39:17.768901+0000","last_unstale":"2024-09-12T01:33:30.077916+0000","last_undegraded":"2024-09-12T01:33:30.077916+0000","last_fullsized":"2024-09-12T01:33:30.077916+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:49.443724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.248104+0000","last_change":"2024-09-12T01:02:03.922843+0000","last_active":"2024-09-12T01:34:37.248104+0000","last_peered":"2024-09-12T01:34:37.248104+0000","last_clean":"2024-09-12T01:34:37.248104+0000","last_became_active":"2024-09-12T01:02:03.922500+0000","last_became_peered":"2024-09-12T01:02:03.922500+0000","last_unstale":"2024-09-12T01:34:37.248104+0000","last_undegraded":"2024-09-12T01:34:37.248104+0000","last_fullsized":"2024-09-12T01:34:37.248104+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:26.949487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.524780+0000","last_change":"2024-09-12T00:43:43.824719+0000","last_active":"2024-09-12T01:33:49.524780+0000","last_peered":"2024-09-12T01:33:49.524780+0000","last_clean":"2024-09-12T01:33:49.524780+0000","last_became_active":"2024-09-12T00:43:43.823554+0000","last_became_peered":"2024-09-12T00:43:43.823554+0000","last_unstale":"2024-09-12T01:33:49.524780+0000","last_undegraded":"2024-09-12T01:33:49.524780+0000","last_fullsized":"2024-09-12T01:33:49.524780+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:47.954677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523603+0000","last_change":"2024-09-12T00:43:38.798395+0000","last_active":"2024-09-12T01:33:39.523603+0000","last_peered":"2024-09-12T01:33:39.523603+0000","last_clean":"2024-09-12T01:33:39.523603+0000","last_became_active":"2024-09-12T00:43:38.798117+0000","last_became_peered":"2024-09-12T00:43:38.798117+0000","last_unstale":"2024-09-12T01:33:39.523603+0000","last_undegraded":"2024-09-12T01:33:39.523603+0000","last_fullsized":"2024-09-12T01:33:39.523603+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:43.142516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'16","reported_seq":98,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.522300+0000","last_change":"2024-09-12T00:39:17.768795+0000","last_active":"2024-09-12T01:33:29.522300+0000","last_peered":"2024-09-12T01:33:29.522300+0000","last_clean":"2024-09-12T01:33:29.522300+0000","last_became_active":"2024-09-12T00:39:17.768503+0000","last_became_peered":"2024-09-12T00:39:17.768503+0000","last_unstale":"2024-09-12T01:33:29.522300+0000","last_undegraded":"2024-09-12T01:33:29.522300+0000","last_fullsized":"2024-09-12T01:33:29.522300+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:49.617037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.004612+0000","last_change":"2024-09-12T01:02:03.928738+0000","last_active":"2024-09-12T01:35:24.004612+0000","last_peered":"2024-09-12T01:35:24.004612+0000","last_clean":"2024-09-12T01:35:24.004612+0000","last_became_active":"2024-09-12T01:02:03.928430+0000","last_became_peered":"2024-09-12T01:02:03.928430+0000","last_unstale":"2024-09-12T01:35:24.004612+0000","last_undegraded":"2024-09-12T01:35:24.004612+0000","last_fullsized":"2024-09-12T01:35:24.004612+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:55.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079580+0000","last_change":"2024-09-12T00:43:43.823435+0000","last_active":"2024-09-12T01:33:45.079580+0000","last_peered":"2024-09-12T01:33:45.079580+0000","last_clean":"2024-09-12T01:33:45.079580+0000","last_became_active":"2024-09-12T00:43:43.822996+0000","last_became_peered":"2024-09-12T00:43:43.822996+0000","last_unstale":"2024-09-12T01:33:45.079580+0000","last_undegraded":"2024-09-12T01:33:45.079580+0000","last_fullsized":"2024-09-12T01:33:45.079580+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:25.064321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'2","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.167242+0000","last_change":"2024-09-12T00:43:38.797634+0000","last_active":"2024-09-12T01:33:39.167242+0000","last_peered":"2024-09-12T01:33:39.167242+0000","last_clean":"2024-09-12T01:33:39.167242+0000","last_became_active":"2024-09-12T00:43:38.797367+0000","last_became_peered":"2024-09-12T00:43:38.797367+0000","last_unstale":"2024-09-12T01:33:39.167242+0000","last_undegraded":"2024-09-12T01:33:39.167242+0000","last_fullsized":"2024-09-12T01:33:39.167242+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.679006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'9","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.522263+0000","last_change":"2024-09-12T00:39:17.759644+0000","last_active":"2024-09-12T01:33:29.522263+0000","last_peered":"2024-09-12T01:33:29.522263+0000","last_clean":"2024-09-12T01:33:29.522263+0000","last_became_active":"2024-09-12T00:39:17.759327+0000","last_became_peered":"2024-09-12T00:39:17.759327+0000","last_unstale":"2024-09-12T01:33:29.522263+0000","last_undegraded":"2024-09-12T01:33:29.522263+0000","last_fullsized":"2024-09-12T01:33:29.522263+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:23.808909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":31,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536493+0000","last_change":"2024-09-12T01:02:03.925373+0000","last_active":"2024-09-12T01:35:24.536493+0000","last_peered":"2024-09-12T01:35:24.536493+0000","last_clean":"2024-09-12T01:35:24.536493+0000","last_became_active":"2024-09-12T01:02:03.925081+0000","last_became_peered":"2024-09-12T01:02:03.925081+0000","last_unstale":"2024-09-12T01:35:24.536493+0000","last_undegraded":"2024-09-12T01:35:24.536493+0000","last_fullsized":"2024-09-12T01:35:24.536493+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:09.007940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'3","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079559+0000","last_change":"2024-09-12T00:43:43.822771+0000","last_active":"2024-09-12T01:33:45.079559+0000","last_peered":"2024-09-12T01:33:45.079559+0000","last_clean":"2024-09-12T01:33:45.079559+0000","last_became_active":"2024-09-12T00:43:43.822237+0000","last_became_peered":"2024-09-12T00:43:43.822237+0000","last_unstale":"2024-09-12T01:33:45.079559+0000","last_undegraded":"2024-09-12T01:33:45.079559+0000","last_fullsized":"2024-09-12T01:33:45.079559+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:25.025447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8184,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'4","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.079514+0000","last_change":"2024-09-12T00:43:38.794264+0000","last_active":"2024-09-12T01:33:39.079514+0000","last_peered":"2024-09-12T01:33:39.079514+0000","last_clean":"2024-09-12T01:33:39.079514+0000","last_became_active":"2024-09-12T00:43:38.793943+0000","last_became_peered":"2024-09-12T00:43:38.793943+0000","last_unstale":"2024-09-12T01:33:39.079514+0000","last_undegraded":"2024-09-12T01:33:39.079514+0000","last_fullsized":"2024-09-12T01:33:39.079514+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:15.467403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5246976,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":11272,"num_write":4,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"266'26","reported_seq":130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:30.090680+0000","last_change":"2024-09-12T00:39:17.770362+0000","last_active":"2024-09-12T01:35:30.090680+0000","last_peered":"2024-09-12T01:35:30.090680+0000","last_clean":"2024-09-12T01:35:30.090680+0000","last_became_active":"2024-09-12T00:39:17.770093+0000","last_became_peered":"2024-09-12T00:39:17.770093+0000","last_unstale":"2024-09-12T01:35:30.090680+0000","last_undegraded":"2024-09-12T01:35:30.090680+0000","last_fullsized":"2024-09-12T01:35:30.090680+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:56.241617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'190","reported_seq":839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.972715+0000","last_change":"2024-09-12T00:25:00.480152+0000","last_active":"2024-09-12T01:33:44.972715+0000","last_peered":"2024-09-12T01:33:44.972715+0000","last_clean":"2024-09-12T01:33:44.972715+0000","last_became_active":"2024-09-12T00:25:00.479764+0000","last_became_peered":"2024-09-12T00:25:00.479764+0000","last_unstale":"2024-09-12T01:33:44.972715+0000","last_undegraded":"2024-09-12T01:33:44.972715+0000","last_fullsized":"2024-09-12T01:33:44.972715+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:56.463852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1448446,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":442,"num_read_kb":6490,"num_write":858,"num_write_kb":17717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'383","reported_seq":1929,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194930+0000","last_change":"2024-09-12T00:25:02.474787+0000","last_active":"2024-09-12T01:36:11.194930+0000","last_peered":"2024-09-12T01:36:11.194930+0000","last_clean":"2024-09-12T01:36:11.194930+0000","last_became_active":"2024-09-12T00:25:02.474473+0000","last_became_peered":"2024-09-12T00:25:02.474473+0000","last_unstale":"2024-09-12T01:36:11.194930+0000","last_undegraded":"2024-09-12T01:36:11.194930+0000","last_fullsized":"2024-09-12T01:36:11.194930+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.534016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2167,"num_read_kb":2073,"num_write":418,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'223","reported_seq":963,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:07.961133+0000","last_change":"2024-09-12T00:25:00.469978+0000","last_active":"2024-09-12T01:35:07.961133+0000","last_peered":"2024-09-12T01:35:07.961133+0000","last_clean":"2024-09-12T01:35:07.961133+0000","last_became_active":"2024-09-12T00:25:00.469588+0000","last_became_peered":"2024-09-12T00:25:00.469588+0000","last_unstale":"2024-09-12T01:35:07.961133+0000","last_undegraded":"2024-09-12T01:35:07.961133+0000","last_fullsized":"2024-09-12T01:35:07.961133+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.105712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6957559,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":688,"num_read_kb":64062,"num_write":1092,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'889","reported_seq":2575,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491254+0000","last_change":"2024-09-12T00:25:02.476425+0000","last_active":"2024-09-12T01:35:23.491254+0000","last_peered":"2024-09-12T01:35:23.491254+0000","last_clean":"2024-09-12T01:35:23.491254+0000","last_became_active":"2024-09-12T00:25:02.476131+0000","last_became_peered":"2024-09-12T00:25:02.476131+0000","last_unstale":"2024-09-12T01:35:23.491254+0000","last_undegraded":"2024-09-12T01:35:23.491254+0000","last_fullsized":"2024-09-12T01:35:23.491254+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:34.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4103,"num_read_kb":3695,"num_write":1128,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'204","reported_seq":837,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:48.988858+0000","last_change":"2024-09-12T00:25:00.458464+0000","last_active":"2024-09-12T01:33:48.988858+0000","last_peered":"2024-09-12T01:33:48.988858+0000","last_clean":"2024-09-12T01:33:48.988858+0000","last_became_active":"2024-09-12T00:25:00.458072+0000","last_became_peered":"2024-09-12T00:25:00.458072+0000","last_unstale":"2024-09-12T01:33:48.988858+0000","last_undegraded":"2024-09-12T01:33:48.988858+0000","last_fullsized":"2024-09-12T01:33:48.988858+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:23.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8713239,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":477,"num_read_kb":12854,"num_write":978,"num_write_kb":25223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1325","reported_seq":2879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338584+0000","last_change":"2024-09-12T00:25:02.470846+0000","last_active":"2024-09-12T01:36:12.338584+0000","last_peered":"2024-09-12T01:36:12.338584+0000","last_clean":"2024-09-12T01:36:12.338584+0000","last_became_active":"2024-09-12T00:25:02.470249+0000","last_became_peered":"2024-09-12T00:25:02.470249+0000","last_unstale":"2024-09-12T01:36:12.338584+0000","last_undegraded":"2024-09-12T01:36:12.338584+0000","last_fullsized":"2024-09-12T01:36:12.338584+0000","mapping_epoch":28,"log_start":"266'1300","ondisk_log_start":"266'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:00.680374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5936,"num_read_kb":5183,"num_write":1890,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'192","reported_seq":827,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088687+0000","last_change":"2024-09-12T00:25:00.484283+0000","last_active":"2024-09-12T01:35:10.088687+0000","last_peered":"2024-09-12T01:35:10.088687+0000","last_clean":"2024-09-12T01:35:10.088687+0000","last_became_active":"2024-09-12T00:25:00.482357+0000","last_became_peered":"2024-09-12T00:25:00.482357+0000","last_unstale":"2024-09-12T01:35:10.088687+0000","last_undegraded":"2024-09-12T01:35:10.088687+0000","last_fullsized":"2024-09-12T01:35:10.088687+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:35.608009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4871869,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":398,"num_read_kb":30861,"num_write":862,"num_write_kb":33122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'567","reported_seq":2114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.489600+0000","last_change":"2024-09-12T00:25:02.467647+0000","last_active":"2024-09-12T01:35:23.489600+0000","last_peered":"2024-09-12T01:35:23.489600+0000","last_clean":"2024-09-12T01:35:23.489600+0000","last_became_active":"2024-09-12T00:25:02.467378+0000","last_became_peered":"2024-09-12T00:25:02.467378+0000","last_unstale":"2024-09-12T01:35:23.489600+0000","last_undegraded":"2024-09-12T01:35:23.489600+0000","last_fullsized":"2024-09-12T01:35:23.489600+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:08.109241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2918,"num_read_kb":2656,"num_write":743,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'205","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:59.980509+0000","last_change":"2024-09-12T00:25:00.478922+0000","last_active":"2024-09-12T01:34:59.980509+0000","last_peered":"2024-09-12T01:34:59.980509+0000","last_clean":"2024-09-12T01:34:59.980509+0000","last_became_active":"2024-09-12T00:25:00.475340+0000","last_became_peered":"2024-09-12T00:25:00.475340+0000","last_unstale":"2024-09-12T01:34:59.980509+0000","last_undegraded":"2024-09-12T01:34:59.980509+0000","last_fullsized":"2024-09-12T01:34:59.980509+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:27.145736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9556415,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":446,"num_read_kb":13966,"num_write":1009,"num_write_kb":23620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'571","reported_seq":2274,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428973+0000","last_change":"2024-09-12T00:25:02.474521+0000","last_active":"2024-09-12T01:37:18.428973+0000","last_peered":"2024-09-12T01:37:18.428973+0000","last_clean":"2024-09-12T01:37:18.428973+0000","last_became_active":"2024-09-12T00:25:02.474229+0000","last_became_peered":"2024-09-12T00:25:02.474229+0000","last_unstale":"2024-09-12T01:37:18.428973+0000","last_undegraded":"2024-09-12T01:37:18.428973+0000","last_fullsized":"2024-09-12T01:37:18.428973+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:59.636555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2896,"num_write":736,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'185","reported_seq":928,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:53.255873+0000","last_change":"2024-09-12T00:25:00.488194+0000","last_active":"2024-09-12T01:35:53.255873+0000","last_peered":"2024-09-12T01:35:53.255873+0000","last_clean":"2024-09-12T01:35:53.255873+0000","last_became_active":"2024-09-12T00:25:00.487589+0000","last_became_peered":"2024-09-12T00:25:00.487589+0000","last_unstale":"2024-09-12T01:35:53.255873+0000","last_undegraded":"2024-09-12T01:35:53.255873+0000","last_fullsized":"2024-09-12T01:35:53.255873+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:00.587126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13353834,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":939,"num_read_kb":45033,"num_write":951,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'522","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.489583+0000","last_change":"2024-09-12T00:25:02.477683+0000","last_active":"2024-09-12T01:35:23.489583+0000","last_peered":"2024-09-12T01:35:23.489583+0000","last_clean":"2024-09-12T01:35:23.489583+0000","last_became_active":"2024-09-12T00:25:02.477395+0000","last_became_peered":"2024-09-12T00:25:02.477395+0000","last_unstale":"2024-09-12T01:35:23.489583+0000","last_undegraded":"2024-09-12T01:35:23.489583+0000","last_fullsized":"2024-09-12T01:35:23.489583+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:51.177502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3189,"num_read_kb":3033,"num_write":616,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'230","reported_seq":891,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:59.980466+0000","last_change":"2024-09-12T00:25:00.478053+0000","last_active":"2024-09-12T01:34:59.980466+0000","last_peered":"2024-09-12T01:34:59.980466+0000","last_clean":"2024-09-12T01:34:59.980466+0000","last_became_active":"2024-09-12T00:25:00.477590+0000","last_became_peered":"2024-09-12T00:25:00.477590+0000","last_unstale":"2024-09-12T01:34:59.980466+0000","last_undegraded":"2024-09-12T01:34:59.980466+0000","last_fullsized":"2024-09-12T01:34:59.980466+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:08.585286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6331086,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":499,"num_read_kb":24485,"num_write":1035,"num_write_kb":27596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'375","reported_seq":1757,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.789775+0000","last_change":"2024-09-12T00:25:02.466712+0000","last_active":"2024-09-12T01:34:32.789775+0000","last_peered":"2024-09-12T01:34:32.789775+0000","last_clean":"2024-09-12T01:34:32.789775+0000","last_became_active":"2024-09-12T00:25:02.466439+0000","last_became_peered":"2024-09-12T00:25:02.466439+0000","last_unstale":"2024-09-12T01:34:32.789775+0000","last_undegraded":"2024-09-12T01:34:32.789775+0000","last_fullsized":"2024-09-12T01:34:32.789775+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:59.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1739,"num_write":422,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'187","reported_seq":792,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.001233+0000","last_change":"2024-09-12T00:25:00.472775+0000","last_active":"2024-09-12T01:35:04.001233+0000","last_peered":"2024-09-12T01:35:04.001233+0000","last_clean":"2024-09-12T01:35:04.001233+0000","last_became_active":"2024-09-12T00:25:00.472046+0000","last_became_peered":"2024-09-12T00:25:00.472046+0000","last_unstale":"2024-09-12T01:35:04.001233+0000","last_undegraded":"2024-09-12T01:35:04.001233+0000","last_fullsized":"2024-09-12T01:35:04.001233+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.088983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20628,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":377,"num_read_kb":23076,"num_write":836,"num_write_kb":28135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'364","reported_seq":1839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428522+0000","last_change":"2024-09-12T00:25:02.475079+0000","last_active":"2024-09-12T01:37:18.428522+0000","last_peered":"2024-09-12T01:37:18.428522+0000","last_clean":"2024-09-12T01:37:18.428522+0000","last_became_active":"2024-09-12T00:25:02.474791+0000","last_became_peered":"2024-09-12T00:25:02.474791+0000","last_unstale":"2024-09-12T01:37:18.428522+0000","last_undegraded":"2024-09-12T01:37:18.428522+0000","last_fullsized":"2024-09-12T01:37:18.428522+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:06.924137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2089,"num_read_kb":2020,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'476","reported_seq":2145,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428799+0000","last_change":"2024-09-12T00:25:02.471996+0000","last_active":"2024-09-12T01:37:18.428799+0000","last_peered":"2024-09-12T01:37:18.428799+0000","last_clean":"2024-09-12T01:37:18.428799+0000","last_became_active":"2024-09-12T00:25:02.471545+0000","last_became_peered":"2024-09-12T00:25:02.471545+0000","last_unstale":"2024-09-12T01:37:18.428799+0000","last_undegraded":"2024-09-12T01:37:18.428799+0000","last_fullsized":"2024-09-12T01:37:18.428799+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:19.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2642,"num_read_kb":2498,"num_write":559,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'201","reported_seq":1060,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:15.568926+0000","last_change":"2024-09-12T00:25:00.465180+0000","last_active":"2024-09-12T01:35:15.568926+0000","last_peered":"2024-09-12T01:35:15.568926+0000","last_clean":"2024-09-12T01:35:15.568926+0000","last_became_active":"2024-09-12T00:25:00.464783+0000","last_became_peered":"2024-09-12T00:25:00.464783+0000","last_unstale":"2024-09-12T01:35:15.568926+0000","last_undegraded":"2024-09-12T01:35:15.568926+0000","last_fullsized":"2024-09-12T01:35:15.568926+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:29.682704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35256,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":966,"num_read_kb":27994,"num_write":1072,"num_write_kb":26373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'501","reported_seq":2068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.981007+0000","last_change":"2024-09-12T00:25:02.475307+0000","last_active":"2024-09-12T01:35:04.981007+0000","last_peered":"2024-09-12T01:35:04.981007+0000","last_clean":"2024-09-12T01:35:04.981007+0000","last_became_active":"2024-09-12T00:25:02.475032+0000","last_became_peered":"2024-09-12T00:25:02.475032+0000","last_unstale":"2024-09-12T01:35:04.981007+0000","last_undegraded":"2024-09-12T01:35:04.981007+0000","last_fullsized":"2024-09-12T01:35:04.981007+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:48.727325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2653,"num_read_kb":2473,"num_write":625,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'206","reported_seq":839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.981101+0000","last_change":"2024-09-12T00:25:00.480048+0000","last_active":"2024-09-12T01:35:04.981101+0000","last_peered":"2024-09-12T01:35:04.981101+0000","last_clean":"2024-09-12T01:35:04.981101+0000","last_became_active":"2024-09-12T00:25:00.479635+0000","last_became_peered":"2024-09-12T00:25:00.479635+0000","last_unstale":"2024-09-12T01:35:04.981101+0000","last_undegraded":"2024-09-12T01:35:04.981101+0000","last_fullsized":"2024-09-12T01:35:04.981101+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:28.545600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14904510,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":504,"num_read_kb":30051,"num_write":932,"num_write_kb":51711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'1150","reported_seq":2931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801039+0000","last_change":"2024-09-12T00:25:02.467494+0000","last_active":"2024-09-12T01:35:34.801039+0000","last_peered":"2024-09-12T01:35:34.801039+0000","last_clean":"2024-09-12T01:35:34.801039+0000","last_became_active":"2024-09-12T00:25:02.467224+0000","last_became_peered":"2024-09-12T00:25:02.467224+0000","last_unstale":"2024-09-12T01:35:34.801039+0000","last_undegraded":"2024-09-12T01:35:34.801039+0000","last_fullsized":"2024-09-12T01:35:34.801039+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:38.270517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5645,"num_read_kb":4973,"num_write":1729,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'205","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.981090+0000","last_change":"2024-09-12T00:25:00.477548+0000","last_active":"2024-09-12T01:35:04.981090+0000","last_peered":"2024-09-12T01:35:04.981090+0000","last_clean":"2024-09-12T01:35:04.981090+0000","last_became_active":"2024-09-12T00:25:00.477184+0000","last_became_peered":"2024-09-12T00:25:00.477184+0000","last_unstale":"2024-09-12T01:35:04.981090+0000","last_undegraded":"2024-09-12T01:35:04.981090+0000","last_fullsized":"2024-09-12T01:35:04.981090+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:16.176834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5375468,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":403,"num_read_kb":20227,"num_write":1010,"num_write_kb":31572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'485","reported_seq":2016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.490363+0000","last_change":"2024-09-12T00:25:02.469723+0000","last_active":"2024-09-12T01:35:19.490363+0000","last_peered":"2024-09-12T01:35:19.490363+0000","last_clean":"2024-09-12T01:35:19.490363+0000","last_became_active":"2024-09-12T00:25:02.469463+0000","last_became_peered":"2024-09-12T00:25:02.469463+0000","last_unstale":"2024-09-12T01:35:19.490363+0000","last_undegraded":"2024-09-12T01:35:19.490363+0000","last_fullsized":"2024-09-12T01:35:19.490363+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:41.693227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2387,"num_write":615,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'186","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.981060+0000","last_change":"2024-09-12T00:25:00.483752+0000","last_active":"2024-09-12T01:35:04.981060+0000","last_peered":"2024-09-12T01:35:04.981060+0000","last_clean":"2024-09-12T01:35:04.981060+0000","last_became_active":"2024-09-12T00:25:00.483327+0000","last_became_peered":"2024-09-12T00:25:00.483327+0000","last_unstale":"2024-09-12T01:35:04.981060+0000","last_undegraded":"2024-09-12T01:35:04.981060+0000","last_fullsized":"2024-09-12T01:35:04.981060+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.085933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5505296,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":528,"num_read_kb":12020,"num_write":918,"num_write_kb":12011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'406","reported_seq":1997,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491334+0000","last_change":"2024-09-12T00:25:02.472828+0000","last_active":"2024-09-12T01:35:23.491334+0000","last_peered":"2024-09-12T01:35:23.491334+0000","last_clean":"2024-09-12T01:35:23.491334+0000","last_became_active":"2024-09-12T00:25:02.471598+0000","last_became_peered":"2024-09-12T00:25:02.471598+0000","last_unstale":"2024-09-12T01:35:23.491334+0000","last_undegraded":"2024-09-12T01:35:23.491334+0000","last_fullsized":"2024-09-12T01:35:23.491334+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:34.396174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2389,"num_read_kb":2272,"num_write":462,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'170","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.180543+0000","last_change":"2024-09-12T00:25:00.478611+0000","last_active":"2024-09-12T01:35:09.180543+0000","last_peered":"2024-09-12T01:35:09.180543+0000","last_clean":"2024-09-12T01:35:09.180543+0000","last_became_active":"2024-09-12T00:25:00.478202+0000","last_became_peered":"2024-09-12T00:25:00.478202+0000","last_unstale":"2024-09-12T01:35:09.180543+0000","last_undegraded":"2024-09-12T01:35:09.180543+0000","last_fullsized":"2024-09-12T01:35:09.180543+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:15.648085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6322339,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":438,"num_read_kb":78408,"num_write":830,"num_write_kb":24955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'664","reported_seq":2197,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088854+0000","last_change":"2024-09-12T00:25:02.470543+0000","last_active":"2024-09-12T01:35:09.088854+0000","last_peered":"2024-09-12T01:35:09.088854+0000","last_clean":"2024-09-12T01:35:09.088854+0000","last_became_active":"2024-09-12T00:25:02.470278+0000","last_became_peered":"2024-09-12T00:25:02.470278+0000","last_unstale":"2024-09-12T01:35:09.088854+0000","last_undegraded":"2024-09-12T01:35:09.088854+0000","last_fullsized":"2024-09-12T01:35:09.088854+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:56.843342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3455,"num_read_kb":3151,"num_write":936,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'232","reported_seq":900,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:46.308491+0000","last_change":"2024-09-12T00:25:00.457125+0000","last_active":"2024-09-12T01:35:46.308491+0000","last_peered":"2024-09-12T01:35:46.308491+0000","last_clean":"2024-09-12T01:35:46.308491+0000","last_became_active":"2024-09-12T00:25:00.456765+0000","last_became_peered":"2024-09-12T00:25:00.456765+0000","last_unstale":"2024-09-12T01:35:46.308491+0000","last_undegraded":"2024-09-12T01:35:46.308491+0000","last_fullsized":"2024-09-12T01:35:46.308491+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:03.452813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6612972,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":622,"num_read_kb":22861,"num_write":1206,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'129","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.448451+0000","last_change":"2024-09-12T00:25:10.523473+0000","last_active":"2024-09-12T01:36:12.448451+0000","last_peered":"2024-09-12T01:36:12.448451+0000","last_clean":"2024-09-12T01:36:12.448451+0000","last_became_active":"2024-09-12T00:25:10.523187+0000","last_became_peered":"2024-09-12T00:25:10.523187+0000","last_unstale":"2024-09-12T01:36:12.448451+0000","last_undegraded":"2024-09-12T01:36:12.448451+0000","last_fullsized":"2024-09-12T01:36:12.448451+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:03.075928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'447","reported_seq":2133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.833875+0000","last_change":"2024-09-12T00:25:02.464400+0000","last_active":"2024-09-12T01:35:16.833875+0000","last_peered":"2024-09-12T01:35:16.833875+0000","last_clean":"2024-09-12T01:35:16.833875+0000","last_became_active":"2024-09-12T00:25:02.464035+0000","last_became_peered":"2024-09-12T00:25:02.464035+0000","last_unstale":"2024-09-12T01:35:16.833875+0000","last_undegraded":"2024-09-12T01:35:16.833875+0000","last_fullsized":"2024-09-12T01:35:16.833875+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.803044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2614,"num_read_kb":2487,"num_write":526,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'211","reported_seq":839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533794+0000","last_change":"2024-09-12T00:25:00.479724+0000","last_active":"2024-09-12T01:35:04.533794+0000","last_peered":"2024-09-12T01:35:04.533794+0000","last_clean":"2024-09-12T01:35:04.533794+0000","last_became_active":"2024-09-12T00:25:00.479335+0000","last_became_peered":"2024-09-12T00:25:00.479335+0000","last_unstale":"2024-09-12T01:35:04.533794+0000","last_undegraded":"2024-09-12T01:35:04.533794+0000","last_fullsized":"2024-09-12T01:35:04.533794+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:52.582972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2248209,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":441,"num_read_kb":7515,"num_write":981,"num_write_kb":32910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534500+0000","last_change":"2024-09-12T00:25:04.485699+0000","last_active":"2024-09-12T01:35:09.534500+0000","last_peered":"2024-09-12T01:35:09.534500+0000","last_clean":"2024-09-12T01:35:09.534500+0000","last_became_active":"2024-09-12T00:25:04.485389+0000","last_became_peered":"2024-09-12T00:25:04.485389+0000","last_unstale":"2024-09-12T01:35:09.534500+0000","last_undegraded":"2024-09-12T01:35:09.534500+0000","last_fullsized":"2024-09-12T01:35:09.534500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:42.240804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'216","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.546231+0000","last_change":"2024-09-12T00:25:06.500211+0000","last_active":"2024-09-12T01:37:19.546231+0000","last_peered":"2024-09-12T01:37:19.546231+0000","last_clean":"2024-09-12T01:37:19.546231+0000","last_became_active":"2024-09-12T00:25:06.499933+0000","last_became_peered":"2024-09-12T00:25:06.499933+0000","last_unstale":"2024-09-12T01:37:19.546231+0000","last_undegraded":"2024-09-12T01:37:19.546231+0000","last_fullsized":"2024-09-12T01:37:19.546231+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:46.967892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13196,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":351,"num_write":172,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:49.073779+0000","last_change":"2024-09-12T00:25:08.501552+0000","last_active":"2024-09-12T01:32:49.073779+0000","last_peered":"2024-09-12T01:32:49.073779+0000","last_clean":"2024-09-12T01:32:49.073779+0000","last_became_active":"2024-09-12T00:25:08.501137+0000","last_became_peered":"2024-09-12T00:25:08.501137+0000","last_unstale":"2024-09-12T01:32:49.073779+0000","last_undegraded":"2024-09-12T01:32:49.073779+0000","last_fullsized":"2024-09-12T01:32:49.073779+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:02.147605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2435","reported_seq":4332,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.040799+0000","last_change":"2024-09-12T00:25:10.526327+0000","last_active":"2024-09-12T01:36:12.040799+0000","last_peered":"2024-09-12T01:36:12.040799+0000","last_clean":"2024-09-12T01:36:12.040799+0000","last_became_active":"2024-09-12T00:25:10.526016+0000","last_became_peered":"2024-09-12T00:25:10.526016+0000","last_unstale":"2024-09-12T01:36:12.040799+0000","last_undegraded":"2024-09-12T01:36:12.040799+0000","last_fullsized":"2024-09-12T01:36:12.040799+0000","mapping_epoch":36,"log_start":"266'2400","ondisk_log_start":"266'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":2400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:25.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6097,"num_read_kb":6097,"num_write":4851,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'891","reported_seq":2330,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428993+0000","last_change":"2024-09-12T00:25:02.477964+0000","last_active":"2024-09-12T01:37:18.428993+0000","last_peered":"2024-09-12T01:37:18.428993+0000","last_clean":"2024-09-12T01:37:18.428993+0000","last_became_active":"2024-09-12T00:25:02.477360+0000","last_became_peered":"2024-09-12T00:25:02.477360+0000","last_unstale":"2024-09-12T01:37:18.428993+0000","last_undegraded":"2024-09-12T01:37:18.428993+0000","last_fullsized":"2024-09-12T01:37:18.428993+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:52.094792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4073,"num_read_kb":3587,"num_write":1238,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'210","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.208582+0000","last_change":"2024-09-12T00:25:00.452665+0000","last_active":"2024-09-12T01:35:24.208582+0000","last_peered":"2024-09-12T01:35:24.208582+0000","last_clean":"2024-09-12T01:35:24.208582+0000","last_became_active":"2024-09-12T00:25:00.452236+0000","last_became_peered":"2024-09-12T00:25:00.452236+0000","last_unstale":"2024-09-12T01:35:24.208582+0000","last_undegraded":"2024-09-12T01:35:24.208582+0000","last_fullsized":"2024-09-12T01:35:24.208582+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:05.744126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10464465,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":474,"num_read_kb":27979,"num_write":1019,"num_write_kb":43410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.254402+0000","last_change":"2024-09-12T00:25:04.481555+0000","last_active":"2024-09-12T01:35:17.254402+0000","last_peered":"2024-09-12T01:35:17.254402+0000","last_clean":"2024-09-12T01:35:17.254402+0000","last_became_active":"2024-09-12T00:25:04.481218+0000","last_became_peered":"2024-09-12T00:25:04.481218+0000","last_unstale":"2024-09-12T01:35:17.254402+0000","last_undegraded":"2024-09-12T01:35:17.254402+0000","last_fullsized":"2024-09-12T01:35:17.254402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:06.324093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'127","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:53.464642+0000","last_change":"2024-09-12T00:25:06.490765+0000","last_active":"2024-09-12T01:35:53.464642+0000","last_peered":"2024-09-12T01:35:53.464642+0000","last_clean":"2024-09-12T01:35:53.464642+0000","last_became_active":"2024-09-12T00:25:06.490463+0000","last_became_peered":"2024-09-12T00:25:06.490463+0000","last_unstale":"2024-09-12T01:35:53.464642+0000","last_undegraded":"2024-09-12T01:35:53.464642+0000","last_fullsized":"2024-09-12T01:35:53.464642+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:30.310748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":131,"num_write":102,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:49.073715+0000","last_change":"2024-09-12T00:25:08.505822+0000","last_active":"2024-09-12T01:32:49.073715+0000","last_peered":"2024-09-12T01:32:49.073715+0000","last_clean":"2024-09-12T01:32:49.073715+0000","last_became_active":"2024-09-12T00:25:08.505492+0000","last_became_peered":"2024-09-12T00:25:08.505492+0000","last_unstale":"2024-09-12T01:32:49.073715+0000","last_undegraded":"2024-09-12T01:32:49.073715+0000","last_fullsized":"2024-09-12T01:32:49.073715+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:49.241744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'139","reported_seq":659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.247384+0000","last_change":"2024-09-12T00:25:10.523127+0000","last_active":"2024-09-12T01:37:18.247384+0000","last_peered":"2024-09-12T01:37:18.247384+0000","last_clean":"2024-09-12T01:37:18.247384+0000","last_became_active":"2024-09-12T00:25:10.522822+0000","last_became_peered":"2024-09-12T00:25:10.522822+0000","last_unstale":"2024-09-12T01:37:18.247384+0000","last_undegraded":"2024-09-12T01:37:18.247384+0000","last_fullsized":"2024-09-12T01:37:18.247384+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:39.986321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":196,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'482","reported_seq":2022,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.002276+0000","last_change":"2024-09-12T00:25:02.479138+0000","last_active":"2024-09-12T01:35:09.002276+0000","last_peered":"2024-09-12T01:35:09.002276+0000","last_clean":"2024-09-12T01:35:09.002276+0000","last_became_active":"2024-09-12T00:25:02.478850+0000","last_became_peered":"2024-09-12T00:25:02.478850+0000","last_unstale":"2024-09-12T01:35:09.002276+0000","last_undegraded":"2024-09-12T01:35:09.002276+0000","last_fullsized":"2024-09-12T01:35:09.002276+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:31.778936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2311,"num_write":575,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'198","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:17.299617+0000","last_change":"2024-09-12T00:25:00.476041+0000","last_active":"2024-09-12T01:37:17.299617+0000","last_peered":"2024-09-12T01:37:17.299617+0000","last_clean":"2024-09-12T01:37:17.299617+0000","last_became_active":"2024-09-12T00:25:00.475628+0000","last_became_peered":"2024-09-12T00:25:00.475628+0000","last_unstale":"2024-09-12T01:37:17.299617+0000","last_undegraded":"2024-09-12T01:37:17.299617+0000","last_fullsized":"2024-09-12T01:37:17.299617+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:14.169208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":379122,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":482,"num_read_kb":1110,"num_write":846,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:12.253498+0000","last_change":"2024-09-12T00:25:04.484287+0000","last_active":"2024-09-12T01:35:12.253498+0000","last_peered":"2024-09-12T01:35:12.253498+0000","last_clean":"2024-09-12T01:35:12.253498+0000","last_became_active":"2024-09-12T00:25:04.483774+0000","last_became_peered":"2024-09-12T00:25:04.483774+0000","last_unstale":"2024-09-12T01:35:12.253498+0000","last_undegraded":"2024-09-12T01:35:12.253498+0000","last_fullsized":"2024-09-12T01:35:12.253498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:26.376424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'143","reported_seq":719,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.415267+0000","last_change":"2024-09-12T00:25:06.501549+0000","last_active":"2024-09-12T01:36:07.415267+0000","last_peered":"2024-09-12T01:36:07.415267+0000","last_clean":"2024-09-12T01:36:07.415267+0000","last_became_active":"2024-09-12T00:25:06.500991+0000","last_became_peered":"2024-09-12T00:25:06.500991+0000","last_unstale":"2024-09-12T01:36:07.415267+0000","last_undegraded":"2024-09-12T01:36:07.415267+0000","last_fullsized":"2024-09-12T01:36:07.415267+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:31.699237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'794","reported_seq":4862,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.960878+0000","last_change":"2024-09-12T00:25:08.514676+0000","last_active":"2024-09-12T01:37:19.960878+0000","last_peered":"2024-09-12T01:37:19.960878+0000","last_clean":"2024-09-12T01:37:19.960878+0000","last_became_active":"2024-09-12T00:25:08.514360+0000","last_became_peered":"2024-09-12T00:25:08.514360+0000","last_unstale":"2024-09-12T01:37:19.960878+0000","last_undegraded":"2024-09-12T01:37:19.960878+0000","last_fullsized":"2024-09-12T01:37:19.960878+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":700,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:19.747805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'202","reported_seq":1036,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.315114+0000","last_change":"2024-09-12T00:25:10.519173+0000","last_active":"2024-09-12T01:36:11.315114+0000","last_peered":"2024-09-12T01:36:11.315114+0000","last_clean":"2024-09-12T01:36:11.315114+0000","last_became_active":"2024-09-12T00:25:10.518861+0000","last_became_peered":"2024-09-12T00:25:10.518861+0000","last_unstale":"2024-09-12T01:36:11.315114+0000","last_undegraded":"2024-09-12T01:36:11.315114+0000","last_fullsized":"2024-09-12T01:36:11.315114+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:28.784023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":600,"num_write":435,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'466","reported_seq":1986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491174+0000","last_change":"2024-09-12T00:25:02.477428+0000","last_active":"2024-09-12T01:35:23.491174+0000","last_peered":"2024-09-12T01:35:23.491174+0000","last_clean":"2024-09-12T01:35:23.491174+0000","last_became_active":"2024-09-12T00:25:02.477052+0000","last_became_peered":"2024-09-12T00:25:02.477052+0000","last_unstale":"2024-09-12T01:35:23.491174+0000","last_undegraded":"2024-09-12T01:35:23.491174+0000","last_fullsized":"2024-09-12T01:35:23.491174+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:47.054845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2388,"num_read_kb":2234,"num_write":549,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'221","reported_seq":866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:13.000150+0000","last_change":"2024-09-12T00:25:00.458865+0000","last_active":"2024-09-12T01:37:13.000150+0000","last_peered":"2024-09-12T01:37:13.000150+0000","last_clean":"2024-09-12T01:37:13.000150+0000","last_became_active":"2024-09-12T00:25:00.457828+0000","last_became_peered":"2024-09-12T00:25:00.457828+0000","last_unstale":"2024-09-12T01:37:13.000150+0000","last_undegraded":"2024-09-12T01:37:13.000150+0000","last_fullsized":"2024-09-12T01:37:13.000150+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:20.656353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8382516,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":456,"num_read_kb":9782,"num_write":1036,"num_write_kb":35060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534518+0000","last_change":"2024-09-12T00:25:04.482494+0000","last_active":"2024-09-12T01:35:09.534518+0000","last_peered":"2024-09-12T01:35:09.534518+0000","last_clean":"2024-09-12T01:35:09.534518+0000","last_became_active":"2024-09-12T00:25:04.482173+0000","last_became_peered":"2024-09-12T00:25:04.482173+0000","last_unstale":"2024-09-12T01:35:09.534518+0000","last_undegraded":"2024-09-12T01:35:09.534518+0000","last_fullsized":"2024-09-12T01:35:09.534518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:38.300401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'154","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.419542+0000","last_change":"2024-09-12T00:25:06.491652+0000","last_active":"2024-09-12T01:36:07.419542+0000","last_peered":"2024-09-12T01:36:07.419542+0000","last_clean":"2024-09-12T01:36:07.419542+0000","last_became_active":"2024-09-12T00:25:06.491337+0000","last_became_peered":"2024-09-12T00:25:06.491337+0000","last_unstale":"2024-09-12T01:36:07.419542+0000","last_undegraded":"2024-09-12T01:36:07.419542+0000","last_fullsized":"2024-09-12T01:36:07.419542+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":100,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:08.948500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9161,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":198,"num_read_kb":259,"num_write":114,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'798","reported_seq":2764,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.962257+0000","last_change":"2024-09-12T00:25:08.512430+0000","last_active":"2024-09-12T01:37:19.962257+0000","last_peered":"2024-09-12T01:37:19.962257+0000","last_clean":"2024-09-12T01:37:19.962257+0000","last_became_active":"2024-09-12T00:25:08.512125+0000","last_became_peered":"2024-09-12T00:25:08.512125+0000","last_unstale":"2024-09-12T01:37:19.962257+0000","last_undegraded":"2024-09-12T01:37:19.962257+0000","last_fullsized":"2024-09-12T01:37:19.962257+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:52.436088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'2025","reported_seq":3645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338541+0000","last_change":"2024-09-12T00:25:02.465523+0000","last_active":"2024-09-12T01:36:12.338541+0000","last_peered":"2024-09-12T01:36:12.338541+0000","last_clean":"2024-09-12T01:36:12.338541+0000","last_became_active":"2024-09-12T00:25:02.465239+0000","last_became_peered":"2024-09-12T00:25:02.465239+0000","last_unstale":"2024-09-12T01:36:12.338541+0000","last_undegraded":"2024-09-12T01:36:12.338541+0000","last_fullsized":"2024-09-12T01:36:12.338541+0000","mapping_epoch":28,"log_start":"266'2000","ondisk_log_start":"266'2000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:57.527506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8773,"num_read_kb":7539,"num_write":2902,"num_write_kb":1299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'177","reported_seq":789,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:59.980549+0000","last_change":"2024-09-12T00:25:00.467280+0000","last_active":"2024-09-12T01:34:59.980549+0000","last_peered":"2024-09-12T01:34:59.980549+0000","last_clean":"2024-09-12T01:34:59.980549+0000","last_became_active":"2024-09-12T00:25:00.466899+0000","last_became_peered":"2024-09-12T00:25:00.466899+0000","last_unstale":"2024-09-12T01:34:59.980549+0000","last_undegraded":"2024-09-12T01:34:59.980549+0000","last_fullsized":"2024-09-12T01:34:59.980549+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:56.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2213087,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":364,"num_read_kb":8806,"num_write":849,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.084136+0000","last_change":"2024-09-12T00:25:04.483191+0000","last_active":"2024-09-12T01:34:24.084136+0000","last_peered":"2024-09-12T01:34:24.084136+0000","last_clean":"2024-09-12T01:34:24.084136+0000","last_became_active":"2024-09-12T00:25:04.482885+0000","last_became_peered":"2024-09-12T00:25:04.482885+0000","last_unstale":"2024-09-12T01:34:24.084136+0000","last_undegraded":"2024-09-12T01:34:24.084136+0000","last_fullsized":"2024-09-12T01:34:24.084136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:29.397137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'260","reported_seq":909,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:54.994203+0000","last_change":"2024-09-12T00:25:06.498236+0000","last_active":"2024-09-12T01:36:54.994203+0000","last_peered":"2024-09-12T01:36:54.994203+0000","last_clean":"2024-09-12T01:36:54.994203+0000","last_became_active":"2024-09-12T00:25:06.497881+0000","last_became_peered":"2024-09-12T00:25:06.497881+0000","last_unstale":"2024-09-12T01:36:54.994203+0000","last_undegraded":"2024-09-12T01:36:54.994203+0000","last_fullsized":"2024-09-12T01:36:54.994203+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":200,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:36.459394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22331,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":362,"num_read_kb":453,"num_write":218,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.178342+0000","last_change":"2024-09-12T00:25:08.508274+0000","last_active":"2024-09-12T01:34:54.178342+0000","last_peered":"2024-09-12T01:34:54.178342+0000","last_clean":"2024-09-12T01:34:54.178342+0000","last_became_active":"2024-09-12T00:25:08.507993+0000","last_became_peered":"2024-09-12T00:25:08.507993+0000","last_unstale":"2024-09-12T01:34:54.178342+0000","last_undegraded":"2024-09-12T01:34:54.178342+0000","last_fullsized":"2024-09-12T01:34:54.178342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:26.028970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'572","reported_seq":1417,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.565060+0000","last_change":"2024-09-12T00:25:10.528237+0000","last_active":"2024-09-12T01:37:19.565060+0000","last_peered":"2024-09-12T01:37:19.565060+0000","last_clean":"2024-09-12T01:37:19.565060+0000","last_became_active":"2024-09-12T00:25:10.528021+0000","last_became_peered":"2024-09-12T00:25:10.528021+0000","last_unstale":"2024-09-12T01:37:19.565060+0000","last_undegraded":"2024-09-12T01:37:19.565060+0000","last_fullsized":"2024-09-12T01:37:19.565060+0000","mapping_epoch":36,"log_start":"266'500","ondisk_log_start":"266'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:14.269299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1390,"num_read_kb":1363,"num_write":1223,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'492","reported_seq":2153,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.488491+0000","last_change":"2024-09-12T00:25:02.468103+0000","last_active":"2024-09-12T01:35:19.488491+0000","last_peered":"2024-09-12T01:35:19.488491+0000","last_clean":"2024-09-12T01:35:19.488491+0000","last_became_active":"2024-09-12T00:25:02.467846+0000","last_became_peered":"2024-09-12T00:25:02.467846+0000","last_unstale":"2024-09-12T01:35:19.488491+0000","last_undegraded":"2024-09-12T01:35:19.488491+0000","last_fullsized":"2024-09-12T01:35:19.488491+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:33.654734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2600,"num_read_kb":2447,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'201","reported_seq":845,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.621187+0000","last_change":"2024-09-12T00:25:00.486904+0000","last_active":"2024-09-12T01:35:51.621187+0000","last_peered":"2024-09-12T01:35:51.621187+0000","last_clean":"2024-09-12T01:35:51.621187+0000","last_became_active":"2024-09-12T00:25:00.486471+0000","last_became_peered":"2024-09-12T00:25:00.486471+0000","last_unstale":"2024-09-12T01:35:51.621187+0000","last_undegraded":"2024-09-12T01:35:51.621187+0000","last_fullsized":"2024-09-12T01:35:51.621187+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:35.328875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10011667,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":451,"num_read_kb":18784,"num_write":962,"num_write_kb":38470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.174174+0000","last_change":"2024-09-12T00:25:04.480755+0000","last_active":"2024-09-12T01:34:24.174174+0000","last_peered":"2024-09-12T01:34:24.174174+0000","last_clean":"2024-09-12T01:34:24.174174+0000","last_became_active":"2024-09-12T00:25:04.480469+0000","last_became_peered":"2024-09-12T00:25:04.480469+0000","last_unstale":"2024-09-12T01:34:24.174174+0000","last_undegraded":"2024-09-12T01:34:24.174174+0000","last_fullsized":"2024-09-12T01:34:24.174174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:20.229017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'144","reported_seq":740,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:07.269941+0000","last_change":"2024-09-12T00:25:06.500291+0000","last_active":"2024-09-12T01:37:07.269941+0000","last_peered":"2024-09-12T01:37:07.269941+0000","last_clean":"2024-09-12T01:37:07.269941+0000","last_became_active":"2024-09-12T00:25:06.500036+0000","last_became_peered":"2024-09-12T00:25:06.500036+0000","last_unstale":"2024-09-12T01:37:07.269941+0000","last_undegraded":"2024-09-12T01:37:07.269941+0000","last_fullsized":"2024-09-12T01:37:07.269941+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:40.715748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11550,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":233,"num_write":96,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:42.248759+0000","last_change":"2024-09-12T00:25:08.510086+0000","last_active":"2024-09-12T01:34:42.248759+0000","last_peered":"2024-09-12T01:34:42.248759+0000","last_clean":"2024-09-12T01:34:42.248759+0000","last_became_active":"2024-09-12T00:25:08.509780+0000","last_became_peered":"2024-09-12T00:25:08.509780+0000","last_unstale":"2024-09-12T01:34:42.248759+0000","last_undegraded":"2024-09-12T01:34:42.248759+0000","last_fullsized":"2024-09-12T01:34:42.248759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:23.294463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'144","reported_seq":649,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:14.095922+0000","last_change":"2024-09-12T00:25:10.528275+0000","last_active":"2024-09-12T01:36:14.095922+0000","last_peered":"2024-09-12T01:36:14.095922+0000","last_clean":"2024-09-12T01:36:14.095922+0000","last_became_active":"2024-09-12T00:25:10.527984+0000","last_became_peered":"2024-09-12T00:25:10.527984+0000","last_unstale":"2024-09-12T01:36:14.095922+0000","last_undegraded":"2024-09-12T01:36:14.095922+0000","last_fullsized":"2024-09-12T01:36:14.095922+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:42.118932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":124,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'452","reported_seq":2015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801286+0000","last_change":"2024-09-12T00:25:02.469437+0000","last_active":"2024-09-12T01:35:34.801286+0000","last_peered":"2024-09-12T01:35:34.801286+0000","last_clean":"2024-09-12T01:35:34.801286+0000","last_became_active":"2024-09-12T00:25:02.469155+0000","last_became_peered":"2024-09-12T00:25:02.469155+0000","last_unstale":"2024-09-12T01:35:34.801286+0000","last_undegraded":"2024-09-12T01:35:34.801286+0000","last_fullsized":"2024-09-12T01:35:34.801286+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:28.701935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2451,"num_write":541,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'223","reported_seq":899,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.531966+0000","last_change":"2024-09-12T00:25:32.564364+0000","last_active":"2024-09-12T01:34:49.531966+0000","last_peered":"2024-09-12T01:34:49.531966+0000","last_clean":"2024-09-12T01:34:49.531966+0000","last_became_active":"2024-09-12T00:25:32.563811+0000","last_became_peered":"2024-09-12T00:25:32.563811+0000","last_unstale":"2024-09-12T01:34:49.531966+0000","last_undegraded":"2024-09-12T01:34:49.531966+0000","last_fullsized":"2024-09-12T01:34:49.531966+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:39.825680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5705657,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":559,"num_read_kb":15150,"num_write":1087,"num_write_kb":21884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:48.998771+0000","last_change":"2024-09-12T00:25:04.484649+0000","last_active":"2024-09-12T01:34:48.998771+0000","last_peered":"2024-09-12T01:34:48.998771+0000","last_clean":"2024-09-12T01:34:48.998771+0000","last_became_active":"2024-09-12T00:25:04.484029+0000","last_became_peered":"2024-09-12T00:25:04.484029+0000","last_unstale":"2024-09-12T01:34:48.998771+0000","last_undegraded":"2024-09-12T01:34:48.998771+0000","last_fullsized":"2024-09-12T01:34:48.998771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:29.267578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'213","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.545664+0000","last_change":"2024-09-12T00:25:06.496644+0000","last_active":"2024-09-12T01:36:39.545664+0000","last_peered":"2024-09-12T01:36:39.545664+0000","last_clean":"2024-09-12T01:36:39.545664+0000","last_became_active":"2024-09-12T00:25:06.496348+0000","last_became_peered":"2024-09-12T00:25:06.496348+0000","last_unstale":"2024-09-12T01:36:39.545664+0000","last_undegraded":"2024-09-12T01:36:39.545664+0000","last_fullsized":"2024-09-12T01:36:39.545664+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:12.917394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31775,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":284,"num_read_kb":387,"num_write":172,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'797","reported_seq":4585,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.962280+0000","last_change":"2024-09-12T00:25:08.512365+0000","last_active":"2024-09-12T01:37:19.962280+0000","last_peered":"2024-09-12T01:37:19.962280+0000","last_clean":"2024-09-12T01:37:19.962280+0000","last_became_active":"2024-09-12T00:25:08.512086+0000","last_became_peered":"2024-09-12T00:25:08.512086+0000","last_unstale":"2024-09-12T01:37:19.962280+0000","last_undegraded":"2024-09-12T01:37:19.962280+0000","last_fullsized":"2024-09-12T01:37:19.962280+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:45.064721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'130","reported_seq":630,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.246800+0000","last_change":"2024-09-12T00:25:10.521608+0000","last_active":"2024-09-12T01:37:18.246800+0000","last_peered":"2024-09-12T01:37:18.246800+0000","last_clean":"2024-09-12T01:37:18.246800+0000","last_became_active":"2024-09-12T00:25:10.521322+0000","last_became_peered":"2024-09-12T00:25:10.521322+0000","last_unstale":"2024-09-12T01:37:18.246800+0000","last_undegraded":"2024-09-12T01:37:18.246800+0000","last_fullsized":"2024-09-12T01:37:18.246800+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.501352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":104,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'389","reported_seq":1833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.490823+0000","last_change":"2024-09-12T00:25:02.468886+0000","last_active":"2024-09-12T01:35:19.490823+0000","last_peered":"2024-09-12T01:35:19.490823+0000","last_clean":"2024-09-12T01:35:19.490823+0000","last_became_active":"2024-09-12T00:25:02.468609+0000","last_became_peered":"2024-09-12T00:25:02.468609+0000","last_unstale":"2024-09-12T01:35:19.490823+0000","last_undegraded":"2024-09-12T01:35:19.490823+0000","last_fullsized":"2024-09-12T01:35:19.490823+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:52.563826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2038,"num_read_kb":1930,"num_write":430,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'215","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:53.460733+0000","last_change":"2024-09-12T00:25:00.473333+0000","last_active":"2024-09-12T01:35:53.460733+0000","last_peered":"2024-09-12T01:35:53.460733+0000","last_clean":"2024-09-12T01:35:53.460733+0000","last_became_active":"2024-09-12T00:25:00.472065+0000","last_became_peered":"2024-09-12T00:25:00.472065+0000","last_unstale":"2024-09-12T01:35:53.460733+0000","last_undegraded":"2024-09-12T01:35:53.460733+0000","last_fullsized":"2024-09-12T01:35:53.460733+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:52.897931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10659106,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":996,"num_read_kb":31471,"num_write":990,"num_write_kb":39869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"38'4","reported_seq":975,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.282494+0000","last_change":"2024-09-12T00:25:04.482765+0000","last_active":"2024-09-12T01:37:19.282494+0000","last_peered":"2024-09-12T01:37:19.282494+0000","last_clean":"2024-09-12T01:37:19.282494+0000","last_became_active":"2024-09-12T00:25:04.482518+0000","last_became_peered":"2024-09-12T00:25:04.482518+0000","last_unstale":"2024-09-12T01:37:19.282494+0000","last_undegraded":"2024-09-12T01:37:19.282494+0000","last_fullsized":"2024-09-12T01:37:19.282494+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.317643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":712,"num_read_kb":1172,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'216","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.532689+0000","last_change":"2024-09-12T00:25:06.497612+0000","last_active":"2024-09-12T01:37:19.532689+0000","last_peered":"2024-09-12T01:37:19.532689+0000","last_clean":"2024-09-12T01:37:19.532689+0000","last_became_active":"2024-09-12T00:25:06.497269+0000","last_became_peered":"2024-09-12T00:25:06.497269+0000","last_unstale":"2024-09-12T01:37:19.532689+0000","last_undegraded":"2024-09-12T01:37:19.532689+0000","last_fullsized":"2024-09-12T01:37:19.532689+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:15.450749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19882,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":301,"num_read_kb":401,"num_write":154,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:28.995211+0000","last_change":"2024-09-12T00:25:08.514101+0000","last_active":"2024-09-12T01:34:28.995211+0000","last_peered":"2024-09-12T01:34:28.995211+0000","last_clean":"2024-09-12T01:34:28.995211+0000","last_became_active":"2024-09-12T00:25:08.513758+0000","last_became_peered":"2024-09-12T00:25:08.513758+0000","last_unstale":"2024-09-12T01:34:28.995211+0000","last_undegraded":"2024-09-12T01:34:28.995211+0000","last_fullsized":"2024-09-12T01:34:28.995211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:44.229276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'131","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.673372+0000","last_change":"2024-09-12T00:25:10.525073+0000","last_active":"2024-09-12T01:36:07.673372+0000","last_peered":"2024-09-12T01:36:07.673372+0000","last_clean":"2024-09-12T01:36:07.673372+0000","last_became_active":"2024-09-12T00:25:10.524500+0000","last_became_peered":"2024-09-12T00:25:10.524500+0000","last_unstale":"2024-09-12T01:36:07.673372+0000","last_undegraded":"2024-09-12T01:36:07.673372+0000","last_fullsized":"2024-09-12T01:36:07.673372+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:33.151875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":199,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'393","reported_seq":2026,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.195471+0000","last_change":"2024-09-12T00:25:02.476800+0000","last_active":"2024-09-12T01:36:11.195471+0000","last_peered":"2024-09-12T01:36:11.195471+0000","last_clean":"2024-09-12T01:36:11.195471+0000","last_became_active":"2024-09-12T00:25:02.476549+0000","last_became_peered":"2024-09-12T00:25:02.476549+0000","last_unstale":"2024-09-12T01:36:11.195471+0000","last_undegraded":"2024-09-12T01:36:11.195471+0000","last_fullsized":"2024-09-12T01:36:11.195471+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:16.691928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2368,"num_read_kb":2274,"num_write":449,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'192","reported_seq":821,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:53.258107+0000","last_change":"2024-09-12T00:25:00.471698+0000","last_active":"2024-09-12T01:35:53.258107+0000","last_peered":"2024-09-12T01:35:53.258107+0000","last_clean":"2024-09-12T01:35:53.258107+0000","last_became_active":"2024-09-12T00:25:00.471314+0000","last_became_peered":"2024-09-12T00:25:00.471314+0000","last_unstale":"2024-09-12T01:35:53.258107+0000","last_undegraded":"2024-09-12T01:35:53.258107+0000","last_fullsized":"2024-09-12T01:35:53.258107+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:13.302458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4515245,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":435,"num_read_kb":11373,"num_write":888,"num_write_kb":19982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:50.121029+0000","last_change":"2024-09-12T00:25:04.486405+0000","last_active":"2024-09-12T01:34:50.121029+0000","last_peered":"2024-09-12T01:34:50.121029+0000","last_clean":"2024-09-12T01:34:50.121029+0000","last_became_active":"2024-09-12T00:25:04.486111+0000","last_became_peered":"2024-09-12T00:25:04.486111+0000","last_unstale":"2024-09-12T01:34:50.121029+0000","last_undegraded":"2024-09-12T01:34:50.121029+0000","last_fullsized":"2024-09-12T01:34:50.121029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:49.097494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'198","reported_seq":798,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:09.102289+0000","last_change":"2024-09-12T00:25:06.497567+0000","last_active":"2024-09-12T01:37:09.102289+0000","last_peered":"2024-09-12T01:37:09.102289+0000","last_clean":"2024-09-12T01:37:09.102289+0000","last_became_active":"2024-09-12T00:25:06.497247+0000","last_became_peered":"2024-09-12T00:25:06.497247+0000","last_unstale":"2024-09-12T01:37:09.102289+0000","last_undegraded":"2024-09-12T01:37:09.102289+0000","last_fullsized":"2024-09-12T01:37:09.102289+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:35.152802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15291,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":260,"num_read_kb":326,"num_write":204,"num_write_kb":97,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123202+0000","last_change":"2024-09-12T00:25:08.517282+0000","last_active":"2024-09-12T01:35:05.123202+0000","last_peered":"2024-09-12T01:35:05.123202+0000","last_clean":"2024-09-12T01:35:05.123202+0000","last_became_active":"2024-09-12T00:25:08.516949+0000","last_became_peered":"2024-09-12T00:25:08.516949+0000","last_unstale":"2024-09-12T01:35:05.123202+0000","last_undegraded":"2024-09-12T01:35:05.123202+0000","last_fullsized":"2024-09-12T01:35:05.123202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:05.996838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'123","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:08.018005+0000","last_change":"2024-09-12T00:25:10.531019+0000","last_active":"2024-09-12T01:37:08.018005+0000","last_peered":"2024-09-12T01:37:08.018005+0000","last_clean":"2024-09-12T01:37:08.018005+0000","last_became_active":"2024-09-12T00:25:10.530731+0000","last_became_peered":"2024-09-12T00:25:10.530731+0000","last_unstale":"2024-09-12T01:37:08.018005+0000","last_undegraded":"2024-09-12T01:37:08.018005+0000","last_fullsized":"2024-09-12T01:37:08.018005+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.713991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":124,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'665","reported_seq":2301,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.803243+0000","last_change":"2024-09-12T00:25:02.474838+0000","last_active":"2024-09-12T01:35:34.803243+0000","last_peered":"2024-09-12T01:35:34.803243+0000","last_clean":"2024-09-12T01:35:34.803243+0000","last_became_active":"2024-09-12T00:25:02.474113+0000","last_became_peered":"2024-09-12T00:25:02.474113+0000","last_unstale":"2024-09-12T01:35:34.803243+0000","last_undegraded":"2024-09-12T01:35:34.803243+0000","last_fullsized":"2024-09-12T01:35:34.803243+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":600,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:02.950937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3250,"num_read_kb":2990,"num_write":879,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'184","reported_seq":896,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529592+0000","last_change":"2024-09-12T00:25:32.562365+0000","last_active":"2024-09-12T01:34:29.529592+0000","last_peered":"2024-09-12T01:34:29.529592+0000","last_clean":"2024-09-12T01:34:29.529592+0000","last_became_active":"2024-09-12T00:25:32.562005+0000","last_became_peered":"2024-09-12T00:25:32.562005+0000","last_unstale":"2024-09-12T01:34:29.529592+0000","last_undegraded":"2024-09-12T01:34:29.529592+0000","last_fullsized":"2024-09-12T01:34:29.529592+0000","mapping_epoch":39,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:04.047110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":589375,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":642,"num_read_kb":135425,"num_write":897,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:48.998802+0000","last_change":"2024-09-12T00:25:04.483049+0000","last_active":"2024-09-12T01:34:48.998802+0000","last_peered":"2024-09-12T01:34:48.998802+0000","last_clean":"2024-09-12T01:34:48.998802+0000","last_became_active":"2024-09-12T00:25:04.482744+0000","last_became_peered":"2024-09-12T00:25:04.482744+0000","last_unstale":"2024-09-12T01:34:48.998802+0000","last_undegraded":"2024-09-12T01:34:48.998802+0000","last_fullsized":"2024-09-12T01:34:48.998802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:16.996020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'188","reported_seq":791,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.563337+0000","last_change":"2024-09-12T00:25:06.497726+0000","last_active":"2024-09-12T01:37:19.563337+0000","last_peered":"2024-09-12T01:37:19.563337+0000","last_clean":"2024-09-12T01:37:19.563337+0000","last_became_active":"2024-09-12T00:25:06.497448+0000","last_became_peered":"2024-09-12T00:25:06.497448+0000","last_unstale":"2024-09-12T01:37:19.563337+0000","last_undegraded":"2024-09-12T01:37:19.563337+0000","last_fullsized":"2024-09-12T01:37:19.563337+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:20.638948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5248,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":238,"num_read_kb":236,"num_write":132,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'761","reported_seq":2718,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.963651+0000","last_change":"2024-09-12T00:25:08.510452+0000","last_active":"2024-09-12T01:37:19.963651+0000","last_peered":"2024-09-12T01:37:19.963651+0000","last_clean":"2024-09-12T01:37:19.963651+0000","last_became_active":"2024-09-12T00:25:08.510134+0000","last_became_peered":"2024-09-12T00:25:08.510134+0000","last_unstale":"2024-09-12T01:37:19.963651+0000","last_undegraded":"2024-09-12T01:37:19.963651+0000","last_fullsized":"2024-09-12T01:37:19.963651+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:11.026047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'125","reported_seq":627,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.054270+0000","last_change":"2024-09-12T00:25:10.522261+0000","last_active":"2024-09-12T01:36:09.054270+0000","last_peered":"2024-09-12T01:36:09.054270+0000","last_clean":"2024-09-12T01:36:09.054270+0000","last_became_active":"2024-09-12T00:25:10.521992+0000","last_became_peered":"2024-09-12T00:25:10.521992+0000","last_unstale":"2024-09-12T01:36:09.054270+0000","last_undegraded":"2024-09-12T01:36:09.054270+0000","last_fullsized":"2024-09-12T01:36:09.054270+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:39.515026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":300,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801315+0000","last_change":"2024-09-12T00:25:02.468698+0000","last_active":"2024-09-12T01:35:34.801315+0000","last_peered":"2024-09-12T01:35:34.801315+0000","last_clean":"2024-09-12T01:35:34.801315+0000","last_became_active":"2024-09-12T00:25:02.468401+0000","last_became_peered":"2024-09-12T00:25:02.468401+0000","last_unstale":"2024-09-12T01:35:34.801315+0000","last_undegraded":"2024-09-12T01:35:34.801315+0000","last_fullsized":"2024-09-12T01:35:34.801315+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:25.428427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2162,"num_read_kb":2053,"num_write":481,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'261","reported_seq":931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:00.213726+0000","last_change":"2024-09-12T00:25:00.474914+0000","last_active":"2024-09-12T01:36:00.213726+0000","last_peered":"2024-09-12T01:36:00.213726+0000","last_clean":"2024-09-12T01:36:00.213726+0000","last_became_active":"2024-09-12T00:25:00.474471+0000","last_became_peered":"2024-09-12T00:25:00.474471+0000","last_unstale":"2024-09-12T01:36:00.213726+0000","last_undegraded":"2024-09-12T01:36:00.213726+0000","last_fullsized":"2024-09-12T01:36:00.213726+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:32.026867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6852134,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":555,"num_read_kb":17654,"num_write":1149,"num_write_kb":37946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1449,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.294554+0000","last_change":"2024-09-12T00:25:04.483123+0000","last_active":"2024-09-12T01:37:19.294554+0000","last_peered":"2024-09-12T01:37:19.294554+0000","last_clean":"2024-09-12T01:37:19.294554+0000","last_became_active":"2024-09-12T00:25:04.482824+0000","last_became_peered":"2024-09-12T00:25:04.482824+0000","last_unstale":"2024-09-12T01:37:19.294554+0000","last_undegraded":"2024-09-12T01:37:19.294554+0000","last_fullsized":"2024-09-12T01:37:19.294554+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:35.937773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":938,"num_read_kb":938,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'103","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.535072+0000","last_change":"2024-09-12T00:25:06.500248+0000","last_active":"2024-09-12T01:35:51.535072+0000","last_peered":"2024-09-12T01:35:51.535072+0000","last_clean":"2024-09-12T01:35:51.535072+0000","last_became_active":"2024-09-12T00:25:06.499937+0000","last_became_peered":"2024-09-12T00:25:06.499937+0000","last_unstale":"2024-09-12T01:35:51.535072+0000","last_undegraded":"2024-09-12T01:35:51.535072+0000","last_fullsized":"2024-09-12T01:35:51.535072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:31.323131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'771","reported_seq":2629,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.963687+0000","last_change":"2024-09-12T00:25:08.502922+0000","last_active":"2024-09-12T01:37:19.963687+0000","last_peered":"2024-09-12T01:37:19.963687+0000","last_clean":"2024-09-12T01:37:19.963687+0000","last_became_active":"2024-09-12T00:25:08.501192+0000","last_became_peered":"2024-09-12T00:25:08.501192+0000","last_unstale":"2024-09-12T01:37:19.963687+0000","last_undegraded":"2024-09-12T01:37:19.963687+0000","last_fullsized":"2024-09-12T01:37:19.963687+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:55.381458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'106","reported_seq":611,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:55.080615+0000","last_change":"2024-09-12T00:25:10.524909+0000","last_active":"2024-09-12T01:33:55.080615+0000","last_peered":"2024-09-12T01:33:55.080615+0000","last_clean":"2024-09-12T01:33:55.080615+0000","last_became_active":"2024-09-12T00:25:10.524610+0000","last_became_peered":"2024-09-12T00:25:10.524610+0000","last_unstale":"2024-09-12T01:33:55.080615+0000","last_undegraded":"2024-09-12T01:33:55.080615+0000","last_fullsized":"2024-09-12T01:33:55.080615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:08.033152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'789","reported_seq":2436,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.408526+0000","last_change":"2024-09-12T00:25:02.479122+0000","last_active":"2024-09-12T01:37:18.408526+0000","last_peered":"2024-09-12T01:37:18.408526+0000","last_clean":"2024-09-12T01:37:18.408526+0000","last_became_active":"2024-09-12T00:25:02.478793+0000","last_became_peered":"2024-09-12T00:25:02.478793+0000","last_unstale":"2024-09-12T01:37:18.408526+0000","last_undegraded":"2024-09-12T01:37:18.408526+0000","last_fullsized":"2024-09-12T01:37:18.408526+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:57.070249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3638,"num_write":1039,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'220","reported_seq":937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.245709+0000","last_change":"2024-09-12T00:25:32.561533+0000","last_active":"2024-09-12T01:34:22.245709+0000","last_peered":"2024-09-12T01:34:22.245709+0000","last_clean":"2024-09-12T01:34:22.245709+0000","last_became_active":"2024-09-12T00:25:32.561102+0000","last_became_peered":"2024-09-12T00:25:32.561102+0000","last_unstale":"2024-09-12T01:34:22.245709+0000","last_undegraded":"2024-09-12T01:34:22.245709+0000","last_fullsized":"2024-09-12T01:34:22.245709+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:17.692906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8796046,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":546,"num_read_kb":71561,"num_write":1039,"num_write_kb":46306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6,0],"acting":[4,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.532031+0000","last_change":"2024-09-12T00:25:04.484834+0000","last_active":"2024-09-12T01:34:49.532031+0000","last_peered":"2024-09-12T01:34:49.532031+0000","last_clean":"2024-09-12T01:34:49.532031+0000","last_became_active":"2024-09-12T00:25:04.484543+0000","last_became_peered":"2024-09-12T00:25:04.484543+0000","last_unstale":"2024-09-12T01:34:49.532031+0000","last_undegraded":"2024-09-12T01:34:49.532031+0000","last_fullsized":"2024-09-12T01:34:49.532031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:42.025957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'301","reported_seq":935,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:09.102255+0000","last_change":"2024-09-12T00:25:06.497244+0000","last_active":"2024-09-12T01:37:09.102255+0000","last_peered":"2024-09-12T01:37:09.102255+0000","last_clean":"2024-09-12T01:37:09.102255+0000","last_became_active":"2024-09-12T00:25:06.496949+0000","last_became_peered":"2024-09-12T00:25:06.496949+0000","last_unstale":"2024-09-12T01:37:09.102255+0000","last_undegraded":"2024-09-12T01:37:09.102255+0000","last_fullsized":"2024-09-12T01:37:09.102255+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":200,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.596588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10350,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1005,"num_read_kb":1065,"num_write":1552,"num_write_kb":1378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:55.086981+0000","last_change":"2024-09-12T00:25:08.511378+0000","last_active":"2024-09-12T01:34:55.086981+0000","last_peered":"2024-09-12T01:34:55.086981+0000","last_clean":"2024-09-12T01:34:55.086981+0000","last_became_active":"2024-09-12T00:25:08.511103+0000","last_became_peered":"2024-09-12T00:25:08.511103+0000","last_unstale":"2024-09-12T01:34:55.086981+0000","last_undegraded":"2024-09-12T01:34:55.086981+0000","last_fullsized":"2024-09-12T01:34:55.086981+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:15.770737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'155","reported_seq":659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.023949+0000","last_change":"2024-09-12T00:25:10.524712+0000","last_active":"2024-09-12T01:35:02.023949+0000","last_peered":"2024-09-12T01:35:02.023949+0000","last_clean":"2024-09-12T01:35:02.023949+0000","last_became_active":"2024-09-12T00:25:10.524399+0000","last_became_peered":"2024-09-12T00:25:10.524399+0000","last_unstale":"2024-09-12T01:35:02.023949+0000","last_undegraded":"2024-09-12T01:35:02.023949+0000","last_fullsized":"2024-09-12T01:35:02.023949+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:02.179754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":348,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'525","reported_seq":2110,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.802899+0000","last_change":"2024-09-12T00:25:02.470865+0000","last_active":"2024-09-12T01:35:34.802899+0000","last_peered":"2024-09-12T01:35:34.802899+0000","last_clean":"2024-09-12T01:35:34.802899+0000","last_became_active":"2024-09-12T00:25:02.470508+0000","last_became_peered":"2024-09-12T00:25:02.470508+0000","last_unstale":"2024-09-12T01:35:34.802899+0000","last_undegraded":"2024-09-12T01:35:34.802899+0000","last_fullsized":"2024-09-12T01:35:34.802899+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:21.513113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2852,"num_read_kb":2640,"num_write":653,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":631,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.087190+0000","last_change":"2024-09-12T00:24:40.256272+0000","last_active":"2024-09-12T01:34:54.087190+0000","last_peered":"2024-09-12T01:34:54.087190+0000","last_clean":"2024-09-12T01:34:54.087190+0000","last_became_active":"2024-09-12T00:24:40.255060+0000","last_became_peered":"2024-09-12T00:24:40.255060+0000","last_unstale":"2024-09-12T01:34:54.087190+0000","last_undegraded":"2024-09-12T01:34:54.087190+0000","last_fullsized":"2024-09-12T01:34:54.087190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:39.174906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:39.174906+0000","last_clean_scrub_stamp":"2024-09-12T00:24:39.174906+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:43.340341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.523015+0000","last_change":"2024-09-12T00:24:48.219201+0000","last_active":"2024-09-12T01:33:34.523015+0000","last_peered":"2024-09-12T01:33:34.523015+0000","last_clean":"2024-09-12T01:33:34.523015+0000","last_became_active":"2024-09-12T00:24:46.449286+0000","last_became_peered":"2024-09-12T00:24:46.449286+0000","last_unstale":"2024-09-12T01:33:34.523015+0000","last_undegraded":"2024-09-12T01:33:34.523015+0000","last_fullsized":"2024-09-12T01:33:34.523015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:20.504679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001069263,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'198","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.240940+0000","last_change":"2024-09-12T00:25:00.466263+0000","last_active":"2024-09-12T01:33:47.240940+0000","last_peered":"2024-09-12T01:33:47.240940+0000","last_clean":"2024-09-12T01:33:47.240940+0000","last_became_active":"2024-09-12T00:25:00.465691+0000","last_became_peered":"2024-09-12T00:25:00.465691+0000","last_unstale":"2024-09-12T01:33:47.240940+0000","last_undegraded":"2024-09-12T01:33:47.240940+0000","last_fullsized":"2024-09-12T01:33:47.240940+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:44.824605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588854,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":386,"num_read_kb":3125,"num_write":967,"num_write_kb":16262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.973231+0000","last_change":"2024-09-12T00:25:04.484191+0000","last_active":"2024-09-12T01:33:49.973231+0000","last_peered":"2024-09-12T01:33:49.973231+0000","last_clean":"2024-09-12T01:33:49.973231+0000","last_became_active":"2024-09-12T00:25:04.483893+0000","last_became_peered":"2024-09-12T00:25:04.483893+0000","last_unstale":"2024-09-12T01:33:49.973231+0000","last_undegraded":"2024-09-12T01:33:49.973231+0000","last_fullsized":"2024-09-12T01:33:49.973231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:57.380284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'322","reported_seq":1033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.550912+0000","last_change":"2024-09-12T00:25:06.497651+0000","last_active":"2024-09-12T01:37:19.550912+0000","last_peered":"2024-09-12T01:37:19.550912+0000","last_clean":"2024-09-12T01:37:19.550912+0000","last_became_active":"2024-09-12T00:25:06.497261+0000","last_became_peered":"2024-09-12T00:25:06.497261+0000","last_unstale":"2024-09-12T01:37:19.550912+0000","last_undegraded":"2024-09-12T01:37:19.550912+0000","last_fullsized":"2024-09-12T01:37:19.550912+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":300,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:29.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53359,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":593,"num_read_kb":798,"num_write":528,"num_write_kb":384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:28.995333+0000","last_change":"2024-09-12T00:25:08.509443+0000","last_active":"2024-09-12T01:34:28.995333+0000","last_peered":"2024-09-12T01:34:28.995333+0000","last_clean":"2024-09-12T01:34:28.995333+0000","last_became_active":"2024-09-12T00:25:08.509183+0000","last_became_peered":"2024-09-12T00:25:08.509183+0000","last_unstale":"2024-09-12T01:34:28.995333+0000","last_undegraded":"2024-09-12T01:34:28.995333+0000","last_fullsized":"2024-09-12T01:34:28.995333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:07.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'216","reported_seq":927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.368080+0000","last_change":"2024-09-12T00:25:10.525926+0000","last_active":"2024-09-12T01:36:12.368080+0000","last_peered":"2024-09-12T01:36:12.368080+0000","last_clean":"2024-09-12T01:36:12.368080+0000","last_became_active":"2024-09-12T00:25:10.525441+0000","last_became_peered":"2024-09-12T00:25:10.525441+0000","last_unstale":"2024-09-12T01:36:12.368080+0000","last_undegraded":"2024-09-12T01:36:12.368080+0000","last_fullsized":"2024-09-12T01:36:12.368080+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:21.545364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":453,"num_read_kb":448,"num_write":488,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'808","reported_seq":2391,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.675442+0000","last_change":"2024-09-12T00:25:02.479220+0000","last_active":"2024-09-12T01:35:04.675442+0000","last_peered":"2024-09-12T01:35:04.675442+0000","last_clean":"2024-09-12T01:35:04.675442+0000","last_became_active":"2024-09-12T00:25:02.478919+0000","last_became_peered":"2024-09-12T00:25:02.478919+0000","last_unstale":"2024-09-12T01:35:04.675442+0000","last_undegraded":"2024-09-12T01:35:04.675442+0000","last_fullsized":"2024-09-12T01:35:04.675442+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:03.891856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4003,"num_read_kb":3616,"num_write":1060,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.532517+0000","last_change":"2024-09-12T00:24:48.218739+0000","last_active":"2024-09-12T01:34:54.532517+0000","last_peered":"2024-09-12T01:34:54.532517+0000","last_clean":"2024-09-12T01:34:54.532517+0000","last_became_active":"2024-09-12T00:24:46.216398+0000","last_became_peered":"2024-09-12T00:24:46.216398+0000","last_unstale":"2024-09-12T01:34:54.532517+0000","last_undegraded":"2024-09-12T01:34:54.532517+0000","last_fullsized":"2024-09-12T01:34:54.532517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:54.142561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080348300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'222","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.729138+0000","last_change":"2024-09-12T00:25:00.468216+0000","last_active":"2024-09-12T01:34:52.729138+0000","last_peered":"2024-09-12T01:34:52.729138+0000","last_clean":"2024-09-12T01:34:52.729138+0000","last_became_active":"2024-09-12T00:25:00.467622+0000","last_became_peered":"2024-09-12T00:25:00.467622+0000","last_unstale":"2024-09-12T01:34:52.729138+0000","last_undegraded":"2024-09-12T01:34:52.729138+0000","last_fullsized":"2024-09-12T01:34:52.729138+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:47.186663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6953241,"num_objects":15,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":551,"num_read_kb":22637,"num_write":1033,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.529037+0000","last_change":"2024-09-12T00:25:04.484033+0000","last_active":"2024-09-12T01:34:24.529037+0000","last_peered":"2024-09-12T01:34:24.529037+0000","last_clean":"2024-09-12T01:34:24.529037+0000","last_became_active":"2024-09-12T00:25:04.483752+0000","last_became_peered":"2024-09-12T00:25:04.483752+0000","last_unstale":"2024-09-12T01:34:24.529037+0000","last_undegraded":"2024-09-12T01:34:24.529037+0000","last_fullsized":"2024-09-12T01:34:24.529037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:45.784755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'913","reported_seq":2724,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.963611+0000","last_change":"2024-09-12T00:25:06.492242+0000","last_active":"2024-09-12T01:37:19.963611+0000","last_peered":"2024-09-12T01:37:19.963611+0000","last_clean":"2024-09-12T01:37:19.963611+0000","last_became_active":"2024-09-12T00:25:06.491919+0000","last_became_peered":"2024-09-12T00:25:06.491919+0000","last_unstale":"2024-09-12T01:37:19.963611+0000","last_undegraded":"2024-09-12T01:37:19.963611+0000","last_fullsized":"2024-09-12T01:37:19.963611+0000","mapping_epoch":32,"log_start":"266'900","ondisk_log_start":"266'900","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":900,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:27.174380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32996,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1233,"num_read_kb":1408,"num_write":366,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.525990+0000","last_change":"2024-09-12T00:25:08.514605+0000","last_active":"2024-09-12T01:33:59.525990+0000","last_peered":"2024-09-12T01:33:59.525990+0000","last_clean":"2024-09-12T01:33:59.525990+0000","last_became_active":"2024-09-12T00:25:08.514284+0000","last_became_peered":"2024-09-12T00:25:08.514284+0000","last_unstale":"2024-09-12T01:33:59.525990+0000","last_undegraded":"2024-09-12T01:33:59.525990+0000","last_fullsized":"2024-09-12T01:33:59.525990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:57.005332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'199","reported_seq":729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.179557+0000","last_change":"2024-09-12T00:25:10.521984+0000","last_active":"2024-09-12T01:36:11.179557+0000","last_peered":"2024-09-12T01:36:11.179557+0000","last_clean":"2024-09-12T01:36:11.179557+0000","last_became_active":"2024-09-12T00:25:10.521686+0000","last_became_peered":"2024-09-12T00:25:10.521686+0000","last_unstale":"2024-09-12T01:36:11.179557+0000","last_undegraded":"2024-09-12T01:36:11.179557+0000","last_fullsized":"2024-09-12T01:36:11.179557+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:44.218223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":329,"num_write":450,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'457","reported_seq":1918,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338325+0000","last_change":"2024-09-12T00:25:02.472659+0000","last_active":"2024-09-12T01:36:12.338325+0000","last_peered":"2024-09-12T01:36:12.338325+0000","last_clean":"2024-09-12T01:36:12.338325+0000","last_became_active":"2024-09-12T00:25:02.472379+0000","last_became_peered":"2024-09-12T00:25:02.472379+0000","last_unstale":"2024-09-12T01:36:12.338325+0000","last_undegraded":"2024-09-12T01:36:12.338325+0000","last_fullsized":"2024-09-12T01:36:12.338325+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:11.033418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2328,"num_read_kb":2161,"num_write":552,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:35.109804+0000","last_change":"2024-09-12T00:24:48.293366+0000","last_active":"2024-09-12T01:33:35.109804+0000","last_peered":"2024-09-12T01:33:35.109804+0000","last_clean":"2024-09-12T01:33:35.109804+0000","last_became_active":"2024-09-12T00:24:46.219148+0000","last_became_peered":"2024-09-12T00:24:46.219148+0000","last_unstale":"2024-09-12T01:33:35.109804+0000","last_undegraded":"2024-09-12T01:33:35.109804+0000","last_fullsized":"2024-09-12T01:33:35.109804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:43.132714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040735800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'215","reported_seq":895,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.003746+0000","last_change":"2024-09-12T00:25:00.468826+0000","last_active":"2024-09-12T01:35:19.003746+0000","last_peered":"2024-09-12T01:35:19.003746+0000","last_clean":"2024-09-12T01:35:19.003746+0000","last_became_active":"2024-09-12T00:25:00.468270+0000","last_became_peered":"2024-09-12T00:25:00.468270+0000","last_unstale":"2024-09-12T01:35:19.003746+0000","last_undegraded":"2024-09-12T01:35:19.003746+0000","last_fullsized":"2024-09-12T01:35:19.003746+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.482218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7383289,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":506,"num_read_kb":34464,"num_write":944,"num_write_kb":30398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:25.117408+0000","last_change":"2024-09-12T00:25:04.486850+0000","last_active":"2024-09-12T01:34:25.117408+0000","last_peered":"2024-09-12T01:34:25.117408+0000","last_clean":"2024-09-12T01:34:25.117408+0000","last_became_active":"2024-09-12T00:25:04.486554+0000","last_became_peered":"2024-09-12T00:25:04.486554+0000","last_unstale":"2024-09-12T01:34:25.117408+0000","last_undegraded":"2024-09-12T01:34:25.117408+0000","last_fullsized":"2024-09-12T01:34:25.117408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.290712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'310","reported_seq":1743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:14.925557+0000","last_change":"2024-09-12T00:25:06.495614+0000","last_active":"2024-09-12T01:37:14.925557+0000","last_peered":"2024-09-12T01:37:14.925557+0000","last_clean":"2024-09-12T01:37:14.925557+0000","last_became_active":"2024-09-12T00:25:06.495269+0000","last_became_peered":"2024-09-12T00:25:06.495269+0000","last_unstale":"2024-09-12T01:37:14.925557+0000","last_undegraded":"2024-09-12T01:37:14.925557+0000","last_fullsized":"2024-09-12T01:37:14.925557+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:38.976235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":267,"num_read_kb":257,"num_write":249,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.242368+0000","last_change":"2024-09-12T00:25:08.512053+0000","last_active":"2024-09-12T01:33:57.242368+0000","last_peered":"2024-09-12T01:33:57.242368+0000","last_clean":"2024-09-12T01:33:57.242368+0000","last_became_active":"2024-09-12T00:25:08.511783+0000","last_became_peered":"2024-09-12T00:25:08.511783+0000","last_unstale":"2024-09-12T01:33:57.242368+0000","last_undegraded":"2024-09-12T01:33:57.242368+0000","last_fullsized":"2024-09-12T01:33:57.242368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.395473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'269","reported_seq":883,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:12.270641+0000","last_change":"2024-09-12T00:25:10.525964+0000","last_active":"2024-09-12T01:37:12.270641+0000","last_peered":"2024-09-12T01:37:12.270641+0000","last_clean":"2024-09-12T01:37:12.270641+0000","last_became_active":"2024-09-12T00:25:10.525594+0000","last_became_peered":"2024-09-12T00:25:10.525594+0000","last_unstale":"2024-09-12T01:37:12.270641+0000","last_undegraded":"2024-09-12T01:37:12.270641+0000","last_fullsized":"2024-09-12T01:37:12.270641+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:12.216646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":513,"num_write":584,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'412","reported_seq":1889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.018009+0000","last_change":"2024-09-12T00:25:02.467324+0000","last_active":"2024-09-12T01:35:02.018009+0000","last_peered":"2024-09-12T01:35:02.018009+0000","last_clean":"2024-09-12T01:35:02.018009+0000","last_became_active":"2024-09-12T00:25:02.467022+0000","last_became_peered":"2024-09-12T00:25:02.467022+0000","last_unstale":"2024-09-12T01:35:02.018009+0000","last_undegraded":"2024-09-12T01:35:02.018009+0000","last_fullsized":"2024-09-12T01:35:02.018009+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.341992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2131,"num_read_kb":2016,"num_write":472,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.522983+0000","last_change":"2024-09-12T00:24:48.218472+0000","last_active":"2024-09-12T01:33:34.522983+0000","last_peered":"2024-09-12T01:33:34.522983+0000","last_clean":"2024-09-12T01:33:34.522983+0000","last_became_active":"2024-09-12T00:24:46.296014+0000","last_became_peered":"2024-09-12T00:24:46.296014+0000","last_unstale":"2024-09-12T01:33:34.522983+0000","last_undegraded":"2024-09-12T01:33:34.522983+0000","last_fullsized":"2024-09-12T01:33:34.522983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:16.575080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055221999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'224","reported_seq":856,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:44.972675+0000","last_change":"2024-09-12T00:25:00.480960+0000","last_active":"2024-09-12T01:33:44.972675+0000","last_peered":"2024-09-12T01:33:44.972675+0000","last_clean":"2024-09-12T01:33:44.972675+0000","last_became_active":"2024-09-12T00:25:00.480242+0000","last_became_peered":"2024-09-12T00:25:00.480242+0000","last_unstale":"2024-09-12T01:33:44.972675+0000","last_undegraded":"2024-09-12T01:33:44.972675+0000","last_fullsized":"2024-09-12T01:33:44.972675+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:45.844641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3160134,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":8697,"num_write":1013,"num_write_kb":33114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:00.113567+0000","last_change":"2024-09-12T00:25:04.483695+0000","last_active":"2024-09-12T01:34:00.113567+0000","last_peered":"2024-09-12T01:34:00.113567+0000","last_clean":"2024-09-12T01:34:00.113567+0000","last_became_active":"2024-09-12T00:25:04.483224+0000","last_became_peered":"2024-09-12T00:25:04.483224+0000","last_unstale":"2024-09-12T01:34:00.113567+0000","last_undegraded":"2024-09-12T01:34:00.113567+0000","last_fullsized":"2024-09-12T01:34:00.113567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:36.407261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'161","reported_seq":724,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.016537+0000","last_change":"2024-09-12T00:25:06.500894+0000","last_active":"2024-09-12T01:36:39.016537+0000","last_peered":"2024-09-12T01:36:39.016537+0000","last_clean":"2024-09-12T01:36:39.016537+0000","last_became_active":"2024-09-12T00:25:06.500406+0000","last_became_peered":"2024-09-12T00:25:06.500406+0000","last_unstale":"2024-09-12T01:36:39.016537+0000","last_undegraded":"2024-09-12T01:36:39.016537+0000","last_fullsized":"2024-09-12T01:36:39.016537+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:01.547439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":204,"num_read_kb":195,"num_write":150,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529656+0000","last_change":"2024-09-12T00:25:08.510581+0000","last_active":"2024-09-12T01:34:29.529656+0000","last_peered":"2024-09-12T01:34:29.529656+0000","last_clean":"2024-09-12T01:34:29.529656+0000","last_became_active":"2024-09-12T00:25:08.510287+0000","last_became_peered":"2024-09-12T00:25:08.510287+0000","last_unstale":"2024-09-12T01:34:29.529656+0000","last_undegraded":"2024-09-12T01:34:29.529656+0000","last_fullsized":"2024-09-12T01:34:29.529656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:48.633444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'158","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.085171+0000","last_change":"2024-09-12T00:25:10.523899+0000","last_active":"2024-09-12T01:34:34.085171+0000","last_peered":"2024-09-12T01:34:34.085171+0000","last_clean":"2024-09-12T01:34:34.085171+0000","last_became_active":"2024-09-12T00:25:10.523589+0000","last_became_peered":"2024-09-12T00:25:10.523589+0000","last_unstale":"2024-09-12T01:34:34.085171+0000","last_undegraded":"2024-09-12T01:34:34.085171+0000","last_fullsized":"2024-09-12T01:34:34.085171+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:20.406801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":189,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'1613","reported_seq":3209,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.172043+0000","last_change":"2024-09-12T00:25:02.471771+0000","last_active":"2024-09-12T01:36:11.172043+0000","last_peered":"2024-09-12T01:36:11.172043+0000","last_clean":"2024-09-12T01:36:11.172043+0000","last_became_active":"2024-09-12T00:25:02.471491+0000","last_became_peered":"2024-09-12T00:25:02.471491+0000","last_unstale":"2024-09-12T01:36:11.172043+0000","last_undegraded":"2024-09-12T01:36:11.172043+0000","last_fullsized":"2024-09-12T01:36:11.172043+0000","mapping_epoch":28,"log_start":"266'1600","ondisk_log_start":"266'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:00.651310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7163,"num_read_kb":6213,"num_write":2294,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'232","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:55.080658+0000","last_change":"2024-09-12T00:25:00.485158+0000","last_active":"2024-09-12T01:33:55.080658+0000","last_peered":"2024-09-12T01:33:55.080658+0000","last_clean":"2024-09-12T01:33:55.080658+0000","last_became_active":"2024-09-12T00:25:00.484147+0000","last_became_peered":"2024-09-12T00:25:00.484147+0000","last_unstale":"2024-09-12T01:33:55.080658+0000","last_undegraded":"2024-09-12T01:33:55.080658+0000","last_fullsized":"2024-09-12T01:33:55.080658+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":200,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:09.449162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14255589,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":488,"num_read_kb":38062,"num_write":1124,"num_write_kb":41091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:33.986492+0000","last_change":"2024-09-12T00:24:48.266785+0000","last_active":"2024-09-12T01:33:33.986492+0000","last_peered":"2024-09-12T01:33:33.986492+0000","last_clean":"2024-09-12T01:33:33.986492+0000","last_became_active":"2024-09-12T00:24:46.295839+0000","last_became_peered":"2024-09-12T00:24:46.295839+0000","last_unstale":"2024-09-12T01:33:33.986492+0000","last_undegraded":"2024-09-12T01:33:33.986492+0000","last_fullsized":"2024-09-12T01:33:33.986492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:07.950890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045367200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.241588+0000","last_change":"2024-09-12T00:25:04.479203+0000","last_active":"2024-09-12T01:33:52.241588+0000","last_peered":"2024-09-12T01:33:52.241588+0000","last_clean":"2024-09-12T01:33:52.241588+0000","last_became_active":"2024-09-12T00:25:04.478947+0000","last_became_peered":"2024-09-12T00:25:04.478947+0000","last_unstale":"2024-09-12T01:33:52.241588+0000","last_undegraded":"2024-09-12T01:33:52.241588+0000","last_fullsized":"2024-09-12T01:33:52.241588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:57.527013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'307","reported_seq":1000,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.561989+0000","last_change":"2024-09-12T00:25:06.497179+0000","last_active":"2024-09-12T01:37:19.561989+0000","last_peered":"2024-09-12T01:37:19.561989+0000","last_clean":"2024-09-12T01:37:19.561989+0000","last_became_active":"2024-09-12T00:25:06.496693+0000","last_became_peered":"2024-09-12T00:25:06.496693+0000","last_unstale":"2024-09-12T01:37:19.561989+0000","last_undegraded":"2024-09-12T01:37:19.561989+0000","last_fullsized":"2024-09-12T01:37:19.561989+0000","mapping_epoch":32,"log_start":"263'200","ondisk_log_start":"263'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":200,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:55.147097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24832,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":440,"num_read_kb":542,"num_write":258,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:55.080589+0000","last_change":"2024-09-12T00:25:08.510222+0000","last_active":"2024-09-12T01:33:55.080589+0000","last_peered":"2024-09-12T01:33:55.080589+0000","last_clean":"2024-09-12T01:33:55.080589+0000","last_became_active":"2024-09-12T00:25:08.509962+0000","last_became_peered":"2024-09-12T00:25:08.509962+0000","last_unstale":"2024-09-12T01:33:55.080589+0000","last_undegraded":"2024-09-12T01:33:55.080589+0000","last_fullsized":"2024-09-12T01:33:55.080589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:01.318302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'143","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.243688+0000","last_change":"2024-09-12T00:25:10.522132+0000","last_active":"2024-09-12T01:36:11.243688+0000","last_peered":"2024-09-12T01:36:11.243688+0000","last_clean":"2024-09-12T01:36:11.243688+0000","last_became_active":"2024-09-12T00:25:10.521670+0000","last_became_peered":"2024-09-12T00:25:10.521670+0000","last_unstale":"2024-09-12T01:36:11.243688+0000","last_undegraded":"2024-09-12T01:36:11.243688+0000","last_fullsized":"2024-09-12T01:36:11.243688+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.340900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":347,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'1208","reported_seq":2855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:02.222588+0000","last_change":"2024-09-12T00:25:02.473486+0000","last_active":"2024-09-12T01:34:02.222588+0000","last_peered":"2024-09-12T01:34:02.222588+0000","last_clean":"2024-09-12T01:34:02.222588+0000","last_became_active":"2024-09-12T00:25:02.473158+0000","last_became_peered":"2024-09-12T00:25:02.473158+0000","last_unstale":"2024-09-12T01:34:02.222588+0000","last_undegraded":"2024-09-12T01:34:02.222588+0000","last_fullsized":"2024-09-12T01:34:02.222588+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:11.141082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5007,"num_write":1669,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'183","reported_seq":821,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:56.214030+0000","last_change":"2024-09-12T00:25:00.466317+0000","last_active":"2024-09-12T01:34:56.214030+0000","last_peered":"2024-09-12T01:34:56.214030+0000","last_clean":"2024-09-12T01:34:56.214030+0000","last_became_active":"2024-09-12T00:25:00.465896+0000","last_became_peered":"2024-09-12T00:25:00.465896+0000","last_unstale":"2024-09-12T01:34:56.214030+0000","last_undegraded":"2024-09-12T01:34:56.214030+0000","last_fullsized":"2024-09-12T01:34:56.214030+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:09.955689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2050268,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":430,"num_read_kb":13297,"num_write":923,"num_write_kb":18974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523688+0000","last_change":"2024-09-12T00:24:48.218424+0000","last_active":"2024-09-12T01:33:39.523688+0000","last_peered":"2024-09-12T01:33:39.523688+0000","last_clean":"2024-09-12T01:33:39.523688+0000","last_became_active":"2024-09-12T00:24:46.213839+0000","last_became_peered":"2024-09-12T00:24:46.213839+0000","last_unstale":"2024-09-12T01:33:39.523688+0000","last_undegraded":"2024-09-12T01:33:39.523688+0000","last_fullsized":"2024-09-12T01:33:39.523688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.527991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050495300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.973182+0000","last_change":"2024-09-12T00:25:04.481438+0000","last_active":"2024-09-12T01:33:49.973182+0000","last_peered":"2024-09-12T01:33:49.973182+0000","last_clean":"2024-09-12T01:33:49.973182+0000","last_became_active":"2024-09-12T00:25:04.481137+0000","last_became_peered":"2024-09-12T00:25:04.481137+0000","last_unstale":"2024-09-12T01:33:49.973182+0000","last_undegraded":"2024-09-12T01:33:49.973182+0000","last_fullsized":"2024-09-12T01:33:49.973182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:00.812394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'252","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:18.697355+0000","last_change":"2024-09-12T00:25:06.501412+0000","last_active":"2024-09-12T01:36:18.697355+0000","last_peered":"2024-09-12T01:36:18.697355+0000","last_clean":"2024-09-12T01:36:18.697355+0000","last_became_active":"2024-09-12T00:25:06.501118+0000","last_became_peered":"2024-09-12T00:25:06.501118+0000","last_unstale":"2024-09-12T01:36:18.697355+0000","last_undegraded":"2024-09-12T01:36:18.697355+0000","last_fullsized":"2024-09-12T01:36:18.697355+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:25.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":326,"num_read_kb":318,"num_write":296,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'771","reported_seq":2922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.963662+0000","last_change":"2024-09-12T00:25:08.509879+0000","last_active":"2024-09-12T01:37:19.963662+0000","last_peered":"2024-09-12T01:37:19.963662+0000","last_clean":"2024-09-12T01:37:19.963662+0000","last_became_active":"2024-09-12T00:25:08.509511+0000","last_became_peered":"2024-09-12T00:25:08.509511+0000","last_unstale":"2024-09-12T01:37:19.963662+0000","last_undegraded":"2024-09-12T01:37:19.963662+0000","last_fullsized":"2024-09-12T01:37:19.963662+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:11.392274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'129","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.569096+0000","last_change":"2024-09-12T00:25:10.525336+0000","last_active":"2024-09-12T01:37:19.569096+0000","last_peered":"2024-09-12T01:37:19.569096+0000","last_clean":"2024-09-12T01:37:19.569096+0000","last_became_active":"2024-09-12T00:25:10.524804+0000","last_became_peered":"2024-09-12T00:25:10.524804+0000","last_unstale":"2024-09-12T01:37:19.569096+0000","last_undegraded":"2024-09-12T01:37:19.569096+0000","last_fullsized":"2024-09-12T01:37:19.569096+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:29.933357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'465","reported_seq":2156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801739+0000","last_change":"2024-09-12T00:25:02.463524+0000","last_active":"2024-09-12T01:35:34.801739+0000","last_peered":"2024-09-12T01:35:34.801739+0000","last_clean":"2024-09-12T01:35:34.801739+0000","last_became_active":"2024-09-12T00:25:02.463232+0000","last_became_peered":"2024-09-12T00:25:02.463232+0000","last_unstale":"2024-09-12T01:35:34.801739+0000","last_undegraded":"2024-09-12T01:35:34.801739+0000","last_fullsized":"2024-09-12T01:35:34.801739+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:51.011943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2494,"num_read_kb":2382,"num_write":536,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'237","reported_seq":937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.245831+0000","last_change":"2024-09-12T00:25:00.453017+0000","last_active":"2024-09-12T01:34:22.245831+0000","last_peered":"2024-09-12T01:34:22.245831+0000","last_clean":"2024-09-12T01:34:22.245831+0000","last_became_active":"2024-09-12T00:25:00.452591+0000","last_became_peered":"2024-09-12T00:25:00.452591+0000","last_unstale":"2024-09-12T01:34:22.245831+0000","last_undegraded":"2024-09-12T01:34:22.245831+0000","last_fullsized":"2024-09-12T01:34:22.245831+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:36.167076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8400964,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":773,"num_read_kb":13125,"num_write":980,"num_write_kb":40186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:07.243705+0000","last_change":"2024-09-12T00:24:48.220966+0000","last_active":"2024-09-12T01:34:07.243705+0000","last_peered":"2024-09-12T01:34:07.243705+0000","last_clean":"2024-09-12T01:34:07.243705+0000","last_became_active":"2024-09-12T00:24:46.426160+0000","last_became_peered":"2024-09-12T00:24:46.426160+0000","last_unstale":"2024-09-12T01:34:07.243705+0000","last_undegraded":"2024-09-12T01:34:07.243705+0000","last_fullsized":"2024-09-12T01:34:07.243705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.751628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.524827+0000","last_change":"2024-09-12T00:25:04.483165+0000","last_active":"2024-09-12T01:33:49.524827+0000","last_peered":"2024-09-12T01:33:49.524827+0000","last_clean":"2024-09-12T01:33:49.524827+0000","last_became_active":"2024-09-12T00:25:04.482856+0000","last_became_peered":"2024-09-12T00:25:04.482856+0000","last_unstale":"2024-09-12T01:33:49.524827+0000","last_undegraded":"2024-09-12T01:33:49.524827+0000","last_fullsized":"2024-09-12T01:33:49.524827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:17.015689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'141","reported_seq":706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.422769+0000","last_change":"2024-09-12T00:25:06.498471+0000","last_active":"2024-09-12T01:36:07.422769+0000","last_peered":"2024-09-12T01:36:07.422769+0000","last_clean":"2024-09-12T01:36:07.422769+0000","last_became_active":"2024-09-12T00:25:06.497888+0000","last_became_peered":"2024-09-12T00:25:06.497888+0000","last_unstale":"2024-09-12T01:36:07.422769+0000","last_undegraded":"2024-09-12T01:36:07.422769+0000","last_fullsized":"2024-09-12T01:36:07.422769+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:52.806203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":168,"num_write":116,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'799","reported_seq":2653,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.962301+0000","last_change":"2024-09-12T00:25:08.513106+0000","last_active":"2024-09-12T01:37:19.962301+0000","last_peered":"2024-09-12T01:37:19.962301+0000","last_clean":"2024-09-12T01:37:19.962301+0000","last_became_active":"2024-09-12T00:25:08.512784+0000","last_became_peered":"2024-09-12T00:25:08.512784+0000","last_unstale":"2024-09-12T01:37:19.962301+0000","last_undegraded":"2024-09-12T01:37:19.962301+0000","last_fullsized":"2024-09-12T01:37:19.962301+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:47.339140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'243","reported_seq":771,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:10.294224+0000","last_change":"2024-09-12T00:25:10.523553+0000","last_active":"2024-09-12T01:36:10.294224+0000","last_peered":"2024-09-12T01:36:10.294224+0000","last_clean":"2024-09-12T01:36:10.294224+0000","last_became_active":"2024-09-12T00:25:10.523258+0000","last_became_peered":"2024-09-12T00:25:10.523258+0000","last_unstale":"2024-09-12T01:36:10.294224+0000","last_undegraded":"2024-09-12T01:36:10.294224+0000","last_fullsized":"2024-09-12T01:36:10.294224+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:05.850202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'489","reported_seq":2075,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.600382+0000","last_change":"2024-09-12T00:25:02.468737+0000","last_active":"2024-09-12T01:33:56.600382+0000","last_peered":"2024-09-12T01:33:56.600382+0000","last_clean":"2024-09-12T01:33:56.600382+0000","last_became_active":"2024-09-12T00:25:02.468436+0000","last_became_peered":"2024-09-12T00:25:02.468436+0000","last_unstale":"2024-09-12T01:33:56.600382+0000","last_undegraded":"2024-09-12T01:33:56.600382+0000","last_fullsized":"2024-09-12T01:33:56.600382+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:34.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2713,"num_read_kb":2534,"num_write":588,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'188","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.245804+0000","last_change":"2024-09-12T00:25:00.456455+0000","last_active":"2024-09-12T01:34:22.245804+0000","last_peered":"2024-09-12T01:34:22.245804+0000","last_clean":"2024-09-12T01:34:22.245804+0000","last_became_active":"2024-09-12T00:25:00.456071+0000","last_became_peered":"2024-09-12T00:25:00.456071+0000","last_unstale":"2024-09-12T01:34:22.245804+0000","last_undegraded":"2024-09-12T01:34:22.245804+0000","last_fullsized":"2024-09-12T01:34:22.245804+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:15.020137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6637754,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":419,"num_read_kb":39651,"num_write":889,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.527303+0000","last_change":"2024-09-12T00:24:48.218804+0000","last_active":"2024-09-12T01:34:09.527303+0000","last_peered":"2024-09-12T01:34:09.527303+0000","last_clean":"2024-09-12T01:34:09.527303+0000","last_became_active":"2024-09-12T00:24:46.425908+0000","last_became_peered":"2024-09-12T00:24:46.425908+0000","last_unstale":"2024-09-12T01:34:09.527303+0000","last_undegraded":"2024-09-12T01:34:09.527303+0000","last_fullsized":"2024-09-12T01:34:09.527303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:43.693370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085110299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"38'3","reported_seq":990,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.283815+0000","last_change":"2024-09-12T00:25:04.482182+0000","last_active":"2024-09-12T01:37:19.283815+0000","last_peered":"2024-09-12T01:37:19.283815+0000","last_clean":"2024-09-12T01:37:19.283815+0000","last_became_active":"2024-09-12T00:25:04.481193+0000","last_became_peered":"2024-09-12T00:25:04.481193+0000","last_unstale":"2024-09-12T01:37:19.283815+0000","last_undegraded":"2024-09-12T01:37:19.283815+0000","last_fullsized":"2024-09-12T01:37:19.283815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:59.006487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":711,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'345","reported_seq":1085,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.537992+0000","last_change":"2024-09-12T00:25:06.492488+0000","last_active":"2024-09-12T01:37:19.537992+0000","last_peered":"2024-09-12T01:37:19.537992+0000","last_clean":"2024-09-12T01:37:19.537992+0000","last_became_active":"2024-09-12T00:25:06.492189+0000","last_became_peered":"2024-09-12T00:25:06.492189+0000","last_unstale":"2024-09-12T01:37:19.537992+0000","last_undegraded":"2024-09-12T01:37:19.537992+0000","last_fullsized":"2024-09-12T01:37:19.537992+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":300,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:44.290586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40983,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":507,"num_read_kb":676,"num_write":270,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.242319+0000","last_change":"2024-09-12T00:25:08.510520+0000","last_active":"2024-09-12T01:33:57.242319+0000","last_peered":"2024-09-12T01:33:57.242319+0000","last_clean":"2024-09-12T01:33:57.242319+0000","last_became_active":"2024-09-12T00:25:08.510167+0000","last_became_peered":"2024-09-12T00:25:08.510167+0000","last_unstale":"2024-09-12T01:33:57.242319+0000","last_undegraded":"2024-09-12T01:33:57.242319+0000","last_fullsized":"2024-09-12T01:33:57.242319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:02.351709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'112","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.478978+0000","last_change":"2024-09-12T00:25:10.526124+0000","last_active":"2024-09-12T01:36:12.478978+0000","last_peered":"2024-09-12T01:36:12.478978+0000","last_clean":"2024-09-12T01:36:12.478978+0000","last_became_active":"2024-09-12T00:25:10.525850+0000","last_became_peered":"2024-09-12T00:25:10.525850+0000","last_unstale":"2024-09-12T01:36:12.478978+0000","last_undegraded":"2024-09-12T01:36:12.478978+0000","last_fullsized":"2024-09-12T01:36:12.478978+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:52.252550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'144","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.336165+0000","last_change":"2024-09-12T00:25:10.527379+0000","last_active":"2024-09-12T01:36:11.336165+0000","last_peered":"2024-09-12T01:36:11.336165+0000","last_clean":"2024-09-12T01:36:11.336165+0000","last_became_active":"2024-09-12T00:25:10.526982+0000","last_became_peered":"2024-09-12T00:25:10.526982+0000","last_unstale":"2024-09-12T01:36:11.336165+0000","last_undegraded":"2024-09-12T01:36:11.336165+0000","last_fullsized":"2024-09-12T01:36:11.336165+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:40.227802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":212,"num_write":342,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'493","reported_seq":2074,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.878429+0000","last_change":"2024-09-12T00:25:02.472468+0000","last_active":"2024-09-12T01:35:08.878429+0000","last_peered":"2024-09-12T01:35:08.878429+0000","last_clean":"2024-09-12T01:35:08.878429+0000","last_became_active":"2024-09-12T00:25:02.472013+0000","last_became_peered":"2024-09-12T00:25:02.472013+0000","last_unstale":"2024-09-12T01:35:08.878429+0000","last_undegraded":"2024-09-12T01:35:08.878429+0000","last_fullsized":"2024-09-12T01:35:08.878429+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:27.839901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2517,"num_read_kb":2353,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'213","reported_seq":915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534456+0000","last_change":"2024-09-12T00:25:00.473993+0000","last_active":"2024-09-12T01:35:09.534456+0000","last_peered":"2024-09-12T01:35:09.534456+0000","last_clean":"2024-09-12T01:35:09.534456+0000","last_became_active":"2024-09-12T00:25:00.473591+0000","last_became_peered":"2024-09-12T00:25:00.473591+0000","last_unstale":"2024-09-12T01:35:09.534456+0000","last_undegraded":"2024-09-12T01:35:09.534456+0000","last_fullsized":"2024-09-12T01:35:09.534456+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:13.812127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6551326,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":605,"num_read_kb":52508,"num_write":915,"num_write_kb":35191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.179649+0000","last_change":"2024-09-12T00:25:04.480021+0000","last_active":"2024-09-12T01:35:04.179649+0000","last_peered":"2024-09-12T01:35:04.179649+0000","last_clean":"2024-09-12T01:35:04.179649+0000","last_became_active":"2024-09-12T00:25:04.479701+0000","last_became_peered":"2024-09-12T00:25:04.479701+0000","last_unstale":"2024-09-12T01:35:04.179649+0000","last_undegraded":"2024-09-12T01:35:04.179649+0000","last_fullsized":"2024-09-12T01:35:04.179649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:14.742672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'156","reported_seq":748,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.553119+0000","last_change":"2024-09-12T00:25:06.500803+0000","last_active":"2024-09-12T01:37:19.553119+0000","last_peered":"2024-09-12T01:37:19.553119+0000","last_clean":"2024-09-12T01:37:19.553119+0000","last_became_active":"2024-09-12T00:25:06.500315+0000","last_became_peered":"2024-09-12T00:25:06.500315+0000","last_unstale":"2024-09-12T01:37:19.553119+0000","last_undegraded":"2024-09-12T01:37:19.553119+0000","last_fullsized":"2024-09-12T01:37:19.553119+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:36.321812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11830,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":212,"num_read_kb":239,"num_write":118,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.123727+0000","last_change":"2024-09-12T00:25:08.517253+0000","last_active":"2024-09-12T01:35:10.123727+0000","last_peered":"2024-09-12T01:35:10.123727+0000","last_clean":"2024-09-12T01:35:10.123727+0000","last_became_active":"2024-09-12T00:25:08.516921+0000","last_became_peered":"2024-09-12T00:25:08.516921+0000","last_unstale":"2024-09-12T01:35:10.123727+0000","last_undegraded":"2024-09-12T01:35:10.123727+0000","last_fullsized":"2024-09-12T01:35:10.123727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:11.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'115","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:25.126051+0000","last_change":"2024-09-12T00:25:10.525063+0000","last_active":"2024-09-12T01:35:25.126051+0000","last_peered":"2024-09-12T01:35:25.126051+0000","last_clean":"2024-09-12T01:35:25.126051+0000","last_became_active":"2024-09-12T00:25:10.524416+0000","last_became_peered":"2024-09-12T00:25:10.524416+0000","last_unstale":"2024-09-12T01:35:25.126051+0000","last_undegraded":"2024-09-12T01:35:25.126051+0000","last_fullsized":"2024-09-12T01:35:25.126051+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:13.897999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":157,"num_read_kb":134,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'449","reported_seq":2012,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.193697+0000","last_change":"2024-09-12T00:25:02.473711+0000","last_active":"2024-09-12T01:36:11.193697+0000","last_peered":"2024-09-12T01:36:11.193697+0000","last_clean":"2024-09-12T01:36:11.193697+0000","last_became_active":"2024-09-12T00:25:02.471242+0000","last_became_peered":"2024-09-12T00:25:02.471242+0000","last_unstale":"2024-09-12T01:36:11.193697+0000","last_undegraded":"2024-09-12T01:36:11.193697+0000","last_fullsized":"2024-09-12T01:36:11.193697+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:25.707605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2437,"num_read_kb":2317,"num_write":523,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'215","reported_seq":875,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.981081+0000","last_change":"2024-09-12T00:25:00.481178+0000","last_active":"2024-09-12T01:35:04.981081+0000","last_peered":"2024-09-12T01:35:04.981081+0000","last_clean":"2024-09-12T01:35:04.981081+0000","last_became_active":"2024-09-12T00:25:00.480801+0000","last_became_peered":"2024-09-12T00:25:00.480801+0000","last_unstale":"2024-09-12T01:35:04.981081+0000","last_undegraded":"2024-09-12T01:35:04.981081+0000","last_fullsized":"2024-09-12T01:35:04.981081+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:23.032999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":939662,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":552,"num_read_kb":14522,"num_write":921,"num_write_kb":19421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:07.252680+0000","last_change":"2024-09-12T00:25:04.484027+0000","last_active":"2024-09-12T01:35:07.252680+0000","last_peered":"2024-09-12T01:35:07.252680+0000","last_clean":"2024-09-12T01:35:07.252680+0000","last_became_active":"2024-09-12T00:25:04.482891+0000","last_became_peered":"2024-09-12T00:25:04.482891+0000","last_unstale":"2024-09-12T01:35:07.252680+0000","last_undegraded":"2024-09-12T01:35:07.252680+0000","last_fullsized":"2024-09-12T01:35:07.252680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:48.325429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'68","reported_seq":592,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:43.925146+0000","last_change":"2024-09-12T00:25:06.501436+0000","last_active":"2024-09-12T01:35:43.925146+0000","last_peered":"2024-09-12T01:35:43.925146+0000","last_clean":"2024-09-12T01:35:43.925146+0000","last_became_active":"2024-09-12T00:25:06.501049+0000","last_became_peered":"2024-09-12T00:25:06.501049+0000","last_unstale":"2024-09-12T01:35:43.925146+0000","last_undegraded":"2024-09-12T01:35:43.925146+0000","last_fullsized":"2024-09-12T01:35:43.925146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:39.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":50,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088627+0000","last_change":"2024-09-12T00:25:08.506372+0000","last_active":"2024-09-12T01:35:10.088627+0000","last_peered":"2024-09-12T01:35:10.088627+0000","last_clean":"2024-09-12T01:35:10.088627+0000","last_became_active":"2024-09-12T00:25:08.506052+0000","last_became_peered":"2024-09-12T00:25:08.506052+0000","last_unstale":"2024-09-12T01:35:10.088627+0000","last_undegraded":"2024-09-12T01:35:10.088627+0000","last_fullsized":"2024-09-12T01:35:10.088627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:29.150145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'177","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.160319+0000","last_change":"2024-09-12T00:25:10.525258+0000","last_active":"2024-09-12T01:36:11.160319+0000","last_peered":"2024-09-12T01:36:11.160319+0000","last_clean":"2024-09-12T01:36:11.160319+0000","last_became_active":"2024-09-12T00:25:10.524992+0000","last_became_peered":"2024-09-12T00:25:10.524992+0000","last_unstale":"2024-09-12T01:36:11.160319+0000","last_undegraded":"2024-09-12T01:36:11.160319+0000","last_fullsized":"2024-09-12T01:36:11.160319+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:04.187071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":300,"num_read_kb":289,"num_write":406,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'593","reported_seq":2213,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428085+0000","last_change":"2024-09-12T00:25:02.468999+0000","last_active":"2024-09-12T01:37:18.428085+0000","last_peered":"2024-09-12T01:37:18.428085+0000","last_clean":"2024-09-12T01:37:18.428085+0000","last_became_active":"2024-09-12T00:25:02.468715+0000","last_became_peered":"2024-09-12T00:25:02.468715+0000","last_unstale":"2024-09-12T01:37:18.428085+0000","last_undegraded":"2024-09-12T01:37:18.428085+0000","last_fullsized":"2024-09-12T01:37:18.428085+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:09.616582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2927,"num_read_kb":2680,"num_write":750,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'252","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088110+0000","last_change":"2024-09-12T00:25:00.482223+0000","last_active":"2024-09-12T01:35:05.088110+0000","last_peered":"2024-09-12T01:35:05.088110+0000","last_clean":"2024-09-12T01:35:05.088110+0000","last_became_active":"2024-09-12T00:25:00.481741+0000","last_became_peered":"2024-09-12T00:25:00.481741+0000","last_unstale":"2024-09-12T01:35:05.088110+0000","last_undegraded":"2024-09-12T01:35:05.088110+0000","last_fullsized":"2024-09-12T01:35:05.088110+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:46.144319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6482205,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":531,"num_read_kb":2782,"num_write":1083,"num_write_kb":27824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088007+0000","last_change":"2024-09-12T00:25:04.476625+0000","last_active":"2024-09-12T01:35:05.088007+0000","last_peered":"2024-09-12T01:35:05.088007+0000","last_clean":"2024-09-12T01:35:05.088007+0000","last_became_active":"2024-09-12T00:25:04.476356+0000","last_became_peered":"2024-09-12T00:25:04.476356+0000","last_unstale":"2024-09-12T01:35:05.088007+0000","last_undegraded":"2024-09-12T01:35:05.088007+0000","last_fullsized":"2024-09-12T01:35:05.088007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.898254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'182","reported_seq":785,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.539255+0000","last_change":"2024-09-12T00:25:06.496641+0000","last_active":"2024-09-12T01:37:19.539255+0000","last_peered":"2024-09-12T01:37:19.539255+0000","last_clean":"2024-09-12T01:37:19.539255+0000","last_became_active":"2024-09-12T00:25:06.496372+0000","last_became_peered":"2024-09-12T00:25:06.496372+0000","last_unstale":"2024-09-12T01:37:19.539255+0000","last_undegraded":"2024-09-12T01:37:19.539255+0000","last_fullsized":"2024-09-12T01:37:19.539255+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:02.866379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15592,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":265,"num_read_kb":356,"num_write":156,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088829+0000","last_change":"2024-09-12T00:25:08.509562+0000","last_active":"2024-09-12T01:35:09.088829+0000","last_peered":"2024-09-12T01:35:09.088829+0000","last_clean":"2024-09-12T01:35:09.088829+0000","last_became_active":"2024-09-12T00:25:08.508336+0000","last_became_peered":"2024-09-12T00:25:08.508336+0000","last_unstale":"2024-09-12T01:35:09.088829+0000","last_undegraded":"2024-09-12T01:35:09.088829+0000","last_fullsized":"2024-09-12T01:35:09.088829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:42.261339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'122","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:53.484506+0000","last_change":"2024-09-12T00:25:10.524167+0000","last_active":"2024-09-12T01:34:53.484506+0000","last_peered":"2024-09-12T01:34:53.484506+0000","last_clean":"2024-09-12T01:34:53.484506+0000","last_became_active":"2024-09-12T00:25:10.522375+0000","last_became_peered":"2024-09-12T00:25:10.522375+0000","last_unstale":"2024-09-12T01:34:53.484506+0000","last_undegraded":"2024-09-12T01:34:53.484506+0000","last_fullsized":"2024-09-12T01:34:53.484506+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:07.393133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":308,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'819","reported_seq":2384,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.833892+0000","last_change":"2024-09-12T00:25:02.473893+0000","last_active":"2024-09-12T01:35:16.833892+0000","last_peered":"2024-09-12T01:35:16.833892+0000","last_clean":"2024-09-12T01:35:16.833892+0000","last_became_active":"2024-09-12T00:25:02.473631+0000","last_became_peered":"2024-09-12T00:25:02.473631+0000","last_unstale":"2024-09-12T01:35:16.833892+0000","last_undegraded":"2024-09-12T01:35:16.833892+0000","last_fullsized":"2024-09-12T01:35:16.833892+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:23.372646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3838,"num_read_kb":3448,"num_write":1071,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'210","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.002301+0000","last_change":"2024-09-12T00:25:00.462263+0000","last_active":"2024-09-12T01:35:09.002301+0000","last_peered":"2024-09-12T01:35:09.002301+0000","last_clean":"2024-09-12T01:35:09.002301+0000","last_became_active":"2024-09-12T00:25:00.461875+0000","last_became_peered":"2024-09-12T00:25:00.461875+0000","last_unstale":"2024-09-12T01:35:09.002301+0000","last_undegraded":"2024-09-12T01:35:09.002301+0000","last_fullsized":"2024-09-12T01:35:09.002301+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:08.987863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":294650,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":462,"num_read_kb":40693,"num_write":995,"num_write_kb":39273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533703+0000","last_change":"2024-09-12T00:25:04.486530+0000","last_active":"2024-09-12T01:35:04.533703+0000","last_peered":"2024-09-12T01:35:04.533703+0000","last_clean":"2024-09-12T01:35:04.533703+0000","last_became_active":"2024-09-12T00:25:04.486195+0000","last_became_peered":"2024-09-12T00:25:04.486195+0000","last_unstale":"2024-09-12T01:35:04.533703+0000","last_undegraded":"2024-09-12T01:35:04.533703+0000","last_fullsized":"2024-09-12T01:35:04.533703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:28.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'149","reported_seq":734,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.535960+0000","last_change":"2024-09-12T00:25:06.493690+0000","last_active":"2024-09-12T01:37:19.535960+0000","last_peered":"2024-09-12T01:37:19.535960+0000","last_clean":"2024-09-12T01:37:19.535960+0000","last_became_active":"2024-09-12T00:25:06.493276+0000","last_became_peered":"2024-09-12T00:25:06.493276+0000","last_unstale":"2024-09-12T01:37:19.535960+0000","last_undegraded":"2024-09-12T01:37:19.535960+0000","last_fullsized":"2024-09-12T01:37:19.535960+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:57.912640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13322,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":187,"num_read_kb":257,"num_write":104,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.123775+0000","last_change":"2024-09-12T00:25:08.513038+0000","last_active":"2024-09-12T01:35:10.123775+0000","last_peered":"2024-09-12T01:35:10.123775+0000","last_clean":"2024-09-12T01:35:10.123775+0000","last_became_active":"2024-09-12T00:25:08.512647+0000","last_became_peered":"2024-09-12T00:25:08.512647+0000","last_unstale":"2024-09-12T01:35:10.123775+0000","last_undegraded":"2024-09-12T01:35:10.123775+0000","last_fullsized":"2024-09-12T01:35:10.123775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:28.714653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'319","reported_seq":1615,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.676199+0000","last_change":"2024-09-12T00:25:02.475789+0000","last_active":"2024-09-12T01:35:04.676199+0000","last_peered":"2024-09-12T01:35:04.676199+0000","last_clean":"2024-09-12T01:35:04.676199+0000","last_became_active":"2024-09-12T00:25:02.475490+0000","last_became_peered":"2024-09-12T00:25:02.475490+0000","last_unstale":"2024-09-12T01:35:04.676199+0000","last_undegraded":"2024-09-12T01:35:04.676199+0000","last_fullsized":"2024-09-12T01:35:04.676199+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:44.106869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1691,"num_read_kb":1609,"num_write":373,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'208","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.002158+0000","last_change":"2024-09-12T00:25:00.462380+0000","last_active":"2024-09-12T01:35:09.002158+0000","last_peered":"2024-09-12T01:35:09.002158+0000","last_clean":"2024-09-12T01:35:09.002158+0000","last_became_active":"2024-09-12T00:25:00.462022+0000","last_became_peered":"2024-09-12T00:25:00.462022+0000","last_unstale":"2024-09-12T01:35:09.002158+0000","last_undegraded":"2024-09-12T01:35:09.002158+0000","last_fullsized":"2024-09-12T01:35:09.002158+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:53.418485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1400002,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":371,"num_read_kb":5153,"num_write":1013,"num_write_kb":32149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.182675+0000","last_change":"2024-09-12T00:25:04.487420+0000","last_active":"2024-09-12T01:35:24.182675+0000","last_peered":"2024-09-12T01:35:24.182675+0000","last_clean":"2024-09-12T01:35:24.182675+0000","last_became_active":"2024-09-12T00:25:04.487192+0000","last_became_peered":"2024-09-12T00:25:04.487192+0000","last_unstale":"2024-09-12T01:35:24.182675+0000","last_undegraded":"2024-09-12T01:35:24.182675+0000","last_fullsized":"2024-09-12T01:35:24.182675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:45.179481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'222","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.534920+0000","last_change":"2024-09-12T00:25:06.498928+0000","last_active":"2024-09-12T01:37:19.534920+0000","last_peered":"2024-09-12T01:37:19.534920+0000","last_clean":"2024-09-12T01:37:19.534920+0000","last_became_active":"2024-09-12T00:25:06.498651+0000","last_became_peered":"2024-09-12T00:25:06.498651+0000","last_unstale":"2024-09-12T01:37:19.534920+0000","last_undegraded":"2024-09-12T01:37:19.534920+0000","last_fullsized":"2024-09-12T01:37:19.534920+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:22.315708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11095,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":317,"num_read_kb":399,"num_write":204,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:40.072723+0000","last_change":"2024-09-12T00:25:08.507366+0000","last_active":"2024-09-12T01:32:40.072723+0000","last_peered":"2024-09-12T01:32:40.072723+0000","last_clean":"2024-09-12T01:32:40.072723+0000","last_became_active":"2024-09-12T00:25:08.507090+0000","last_became_peered":"2024-09-12T00:25:08.507090+0000","last_unstale":"2024-09-12T01:32:40.072723+0000","last_undegraded":"2024-09-12T01:32:40.072723+0000","last_fullsized":"2024-09-12T01:32:40.072723+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:09.874475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'186","reported_seq":707,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.725493+0000","last_change":"2024-09-12T00:25:10.522192+0000","last_active":"2024-09-12T01:36:09.725493+0000","last_peered":"2024-09-12T01:36:09.725493+0000","last_clean":"2024-09-12T01:36:09.725493+0000","last_became_active":"2024-09-12T00:25:10.521886+0000","last_became_peered":"2024-09-12T00:25:10.521886+0000","last_unstale":"2024-09-12T01:36:09.725493+0000","last_undegraded":"2024-09-12T01:36:09.725493+0000","last_fullsized":"2024-09-12T01:36:09.725493+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.743861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":280,"num_read_kb":274,"num_write":435,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'456","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.411387+0000","last_change":"2024-09-12T00:25:02.463605+0000","last_active":"2024-09-12T01:37:18.411387+0000","last_peered":"2024-09-12T01:37:18.411387+0000","last_clean":"2024-09-12T01:37:18.411387+0000","last_became_active":"2024-09-12T00:25:02.463187+0000","last_became_peered":"2024-09-12T00:25:02.463187+0000","last_unstale":"2024-09-12T01:37:18.411387+0000","last_undegraded":"2024-09-12T01:37:18.411387+0000","last_fullsized":"2024-09-12T01:37:18.411387+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:03.195160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2353,"num_read_kb":2190,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'296","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:52.232470+0000","last_change":"2024-09-12T00:25:00.469310+0000","last_active":"2024-09-12T01:32:52.232470+0000","last_peered":"2024-09-12T01:32:52.232470+0000","last_clean":"2024-09-12T01:32:52.232470+0000","last_became_active":"2024-09-12T00:25:00.467785+0000","last_became_peered":"2024-09-12T00:25:00.467785+0000","last_unstale":"2024-09-12T01:32:52.232470+0000","last_undegraded":"2024-09-12T01:32:52.232470+0000","last_fullsized":"2024-09-12T01:32:52.232470+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:53.465549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65959,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":728,"num_read_kb":946,"num_write":1130,"num_write_kb":20145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:50.080174+0000","last_change":"2024-09-12T00:25:04.484951+0000","last_active":"2024-09-12T01:33:50.080174+0000","last_peered":"2024-09-12T01:33:50.080174+0000","last_clean":"2024-09-12T01:33:50.080174+0000","last_became_active":"2024-09-12T00:25:04.484608+0000","last_became_peered":"2024-09-12T00:25:04.484608+0000","last_unstale":"2024-09-12T01:33:50.080174+0000","last_undegraded":"2024-09-12T01:33:50.080174+0000","last_fullsized":"2024-09-12T01:33:50.080174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:12.048616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'194","reported_seq":796,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.925843+0000","last_change":"2024-09-12T00:25:06.490294+0000","last_active":"2024-09-12T01:35:50.925843+0000","last_peered":"2024-09-12T01:35:50.925843+0000","last_clean":"2024-09-12T01:35:50.925843+0000","last_became_active":"2024-09-12T00:25:06.489578+0000","last_became_peered":"2024-09-12T00:25:06.489578+0000","last_unstale":"2024-09-12T01:35:50.925843+0000","last_undegraded":"2024-09-12T01:35:50.925843+0000","last_fullsized":"2024-09-12T01:35:50.925843+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:10.076563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10186,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":275,"num_read_kb":323,"num_write":188,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":490,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:38.977594+0000","last_change":"2024-09-12T00:25:08.513646+0000","last_active":"2024-09-12T01:32:38.977594+0000","last_peered":"2024-09-12T01:32:38.977594+0000","last_clean":"2024-09-12T01:32:38.977594+0000","last_became_active":"2024-09-12T00:25:08.513330+0000","last_became_peered":"2024-09-12T00:25:08.513330+0000","last_unstale":"2024-09-12T01:32:38.977594+0000","last_undegraded":"2024-09-12T01:32:38.977594+0000","last_fullsized":"2024-09-12T01:32:38.977594+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:40.371456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'218","reported_seq":1100,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:08.536614+0000","last_change":"2024-09-12T00:25:10.527941+0000","last_active":"2024-09-12T01:36:08.536614+0000","last_peered":"2024-09-12T01:36:08.536614+0000","last_clean":"2024-09-12T01:36:08.536614+0000","last_became_active":"2024-09-12T00:25:10.527649+0000","last_became_peered":"2024-09-12T00:25:10.527649+0000","last_unstale":"2024-09-12T01:36:08.536614+0000","last_undegraded":"2024-09-12T01:36:08.536614+0000","last_fullsized":"2024-09-12T01:36:08.536614+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:30.223583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":648,"num_write":596,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'365","reported_seq":1815,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.802431+0000","last_change":"2024-09-12T00:25:02.479298+0000","last_active":"2024-09-12T01:35:34.802431+0000","last_peered":"2024-09-12T01:35:34.802431+0000","last_clean":"2024-09-12T01:35:34.802431+0000","last_became_active":"2024-09-12T00:25:02.479051+0000","last_became_peered":"2024-09-12T00:25:02.479051+0000","last_unstale":"2024-09-12T01:35:34.802431+0000","last_undegraded":"2024-09-12T01:35:34.802431+0000","last_fullsized":"2024-09-12T01:35:34.802431+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:59.990966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1824,"num_write":392,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'192","reported_seq":825,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.088283+0000","last_change":"2024-09-12T00:25:00.455462+0000","last_active":"2024-09-12T01:35:04.088283+0000","last_peered":"2024-09-12T01:35:04.088283+0000","last_clean":"2024-09-12T01:35:04.088283+0000","last_became_active":"2024-09-12T00:25:00.454796+0000","last_became_peered":"2024-09-12T00:25:00.454796+0000","last_unstale":"2024-09-12T01:35:04.088283+0000","last_undegraded":"2024-09-12T01:35:04.088283+0000","last_fullsized":"2024-09-12T01:35:04.088283+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:11.220113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":698757,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":454,"num_read_kb":2462,"num_write":971,"num_write_kb":27053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088088+0000","last_change":"2024-09-12T00:25:04.475794+0000","last_active":"2024-09-12T01:35:05.088088+0000","last_peered":"2024-09-12T01:35:05.088088+0000","last_clean":"2024-09-12T01:35:05.088088+0000","last_became_active":"2024-09-12T00:25:04.475432+0000","last_became_peered":"2024-09-12T00:25:04.475432+0000","last_unstale":"2024-09-12T01:35:05.088088+0000","last_undegraded":"2024-09-12T01:35:05.088088+0000","last_fullsized":"2024-09-12T01:35:05.088088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:40.125056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'170","reported_seq":765,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.601010+0000","last_change":"2024-09-12T00:25:06.500060+0000","last_active":"2024-09-12T01:36:07.601010+0000","last_peered":"2024-09-12T01:36:07.601010+0000","last_clean":"2024-09-12T01:36:07.601010+0000","last_became_active":"2024-09-12T00:25:06.499452+0000","last_became_peered":"2024-09-12T00:25:06.499452+0000","last_unstale":"2024-09-12T01:36:07.601010+0000","last_undegraded":"2024-09-12T01:36:07.601010+0000","last_fullsized":"2024-09-12T01:36:07.601010+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:39.160375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10161,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":220,"num_read_kb":281,"num_write":128,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125335+0000","last_change":"2024-09-12T00:25:08.514860+0000","last_active":"2024-09-12T01:35:20.125335+0000","last_peered":"2024-09-12T01:35:20.125335+0000","last_clean":"2024-09-12T01:35:20.125335+0000","last_became_active":"2024-09-12T00:25:08.514591+0000","last_became_peered":"2024-09-12T00:25:08.514591+0000","last_unstale":"2024-09-12T01:35:20.125335+0000","last_undegraded":"2024-09-12T01:35:20.125335+0000","last_fullsized":"2024-09-12T01:35:20.125335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:20.635770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'120","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.574196+0000","last_change":"2024-09-12T00:25:10.527404+0000","last_active":"2024-09-12T01:37:19.574196+0000","last_peered":"2024-09-12T01:37:19.574196+0000","last_clean":"2024-09-12T01:37:19.574196+0000","last_became_active":"2024-09-12T00:25:10.527125+0000","last_became_peered":"2024-09-12T00:25:10.527125+0000","last_unstale":"2024-09-12T01:37:19.574196+0000","last_undegraded":"2024-09-12T01:37:19.574196+0000","last_fullsized":"2024-09-12T01:37:19.574196+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:04.270864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":179,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'797","reported_seq":2247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.251816+0000","last_change":"2024-09-12T00:25:02.464662+0000","last_active":"2024-09-12T01:35:02.251816+0000","last_peered":"2024-09-12T01:35:02.251816+0000","last_clean":"2024-09-12T01:35:02.251816+0000","last_became_active":"2024-09-12T00:25:02.464409+0000","last_became_peered":"2024-09-12T00:25:02.464409+0000","last_unstale":"2024-09-12T01:35:02.251816+0000","last_undegraded":"2024-09-12T01:35:02.251816+0000","last_fullsized":"2024-09-12T01:35:02.251816+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:53.007518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3724,"num_read_kb":3326,"num_write":1070,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'240","reported_seq":920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.251765+0000","last_change":"2024-09-12T00:25:00.466956+0000","last_active":"2024-09-12T01:35:02.251765+0000","last_peered":"2024-09-12T01:35:02.251765+0000","last_clean":"2024-09-12T01:35:02.251765+0000","last_became_active":"2024-09-12T00:25:00.466015+0000","last_became_peered":"2024-09-12T00:25:00.466015+0000","last_unstale":"2024-09-12T01:35:02.251765+0000","last_undegraded":"2024-09-12T01:35:02.251765+0000","last_fullsized":"2024-09-12T01:35:02.251765+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:26.695504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6701232,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":59877,"num_write":1078,"num_write_kb":30675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:07.252715+0000","last_change":"2024-09-12T00:25:04.482399+0000","last_active":"2024-09-12T01:35:07.252715+0000","last_peered":"2024-09-12T01:35:07.252715+0000","last_clean":"2024-09-12T01:35:07.252715+0000","last_became_active":"2024-09-12T00:25:04.482091+0000","last_became_peered":"2024-09-12T00:25:04.482091+0000","last_unstale":"2024-09-12T01:35:07.252715+0000","last_undegraded":"2024-09-12T01:35:07.252715+0000","last_fullsized":"2024-09-12T01:35:07.252715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.772204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'124","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.560906+0000","last_change":"2024-09-12T00:25:06.492106+0000","last_active":"2024-09-12T01:36:07.560906+0000","last_peered":"2024-09-12T01:36:07.560906+0000","last_clean":"2024-09-12T01:36:07.560906+0000","last_became_active":"2024-09-12T00:25:06.491582+0000","last_became_peered":"2024-09-12T00:25:06.491582+0000","last_unstale":"2024-09-12T01:36:07.560906+0000","last_undegraded":"2024-09-12T01:36:07.560906+0000","last_fullsized":"2024-09-12T01:36:07.560906+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:35.340695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":169,"num_read_kb":163,"num_write":166,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'762","reported_seq":2552,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.961414+0000","last_change":"2024-09-12T00:25:08.507545+0000","last_active":"2024-09-12T01:37:19.961414+0000","last_peered":"2024-09-12T01:37:19.961414+0000","last_clean":"2024-09-12T01:37:19.961414+0000","last_became_active":"2024-09-12T00:25:08.506288+0000","last_became_peered":"2024-09-12T00:25:08.506288+0000","last_unstale":"2024-09-12T01:37:19.961414+0000","last_undegraded":"2024-09-12T01:37:19.961414+0000","last_fullsized":"2024-09-12T01:37:19.961414+0000","mapping_epoch":34,"log_start":"266'701","ondisk_log_start":"266'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":701,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:41.048601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'126","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.534992+0000","last_change":"2024-09-12T00:25:10.525346+0000","last_active":"2024-09-12T01:35:14.534992+0000","last_peered":"2024-09-12T01:35:14.534992+0000","last_clean":"2024-09-12T01:35:14.534992+0000","last_became_active":"2024-09-12T00:25:10.525045+0000","last_became_peered":"2024-09-12T00:25:10.525045+0000","last_unstale":"2024-09-12T01:35:14.534992+0000","last_undegraded":"2024-09-12T01:35:14.534992+0000","last_fullsized":"2024-09-12T01:35:14.534992+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:19.669222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'457","reported_seq":2071,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.489386+0000","last_change":"2024-09-12T00:25:02.471992+0000","last_active":"2024-09-12T01:35:19.489386+0000","last_peered":"2024-09-12T01:35:19.489386+0000","last_clean":"2024-09-12T01:35:19.489386+0000","last_became_active":"2024-09-12T00:25:02.471255+0000","last_became_peered":"2024-09-12T00:25:02.471255+0000","last_unstale":"2024-09-12T01:35:19.489386+0000","last_undegraded":"2024-09-12T01:35:19.489386+0000","last_fullsized":"2024-09-12T01:35:19.489386+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:31.823002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2599,"num_read_kb":2460,"num_write":533,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'168","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.088315+0000","last_change":"2024-09-12T00:25:00.458803+0000","last_active":"2024-09-12T01:35:04.088315+0000","last_peered":"2024-09-12T01:35:04.088315+0000","last_clean":"2024-09-12T01:35:04.088315+0000","last_became_active":"2024-09-12T00:25:00.456853+0000","last_became_peered":"2024-09-12T00:25:00.456853+0000","last_unstale":"2024-09-12T01:35:04.088315+0000","last_undegraded":"2024-09-12T01:35:04.088315+0000","last_fullsized":"2024-09-12T01:35:04.088315+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:13.587033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3956225,"num_objects":13,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":397,"num_read_kb":16809,"num_write":834,"num_write_kb":28613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.088296+0000","last_change":"2024-09-12T00:25:04.482756+0000","last_active":"2024-09-12T01:35:04.088296+0000","last_peered":"2024-09-12T01:35:04.088296+0000","last_clean":"2024-09-12T01:35:04.088296+0000","last_became_active":"2024-09-12T00:25:04.482441+0000","last_became_peered":"2024-09-12T00:25:04.482441+0000","last_unstale":"2024-09-12T01:35:04.088296+0000","last_undegraded":"2024-09-12T01:35:04.088296+0000","last_fullsized":"2024-09-12T01:35:04.088296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:06.666983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'215","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.610720+0000","last_change":"2024-09-12T00:25:06.494170+0000","last_active":"2024-09-12T01:36:07.610720+0000","last_peered":"2024-09-12T01:36:07.610720+0000","last_clean":"2024-09-12T01:36:07.610720+0000","last_became_active":"2024-09-12T00:25:06.493625+0000","last_became_peered":"2024-09-12T00:25:06.493625+0000","last_unstale":"2024-09-12T01:36:07.610720+0000","last_undegraded":"2024-09-12T01:36:07.610720+0000","last_fullsized":"2024-09-12T01:36:07.610720+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:01.532658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12749,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":294,"num_read_kb":353,"num_write":176,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:52.232442+0000","last_change":"2024-09-12T00:25:08.511276+0000","last_active":"2024-09-12T01:32:52.232442+0000","last_peered":"2024-09-12T01:32:52.232442+0000","last_clean":"2024-09-12T01:32:52.232442+0000","last_became_active":"2024-09-12T00:25:08.511024+0000","last_became_peered":"2024-09-12T00:25:08.511024+0000","last_unstale":"2024-09-12T01:32:52.232442+0000","last_undegraded":"2024-09-12T01:32:52.232442+0000","last_fullsized":"2024-09-12T01:32:52.232442+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:18.243804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'102","reported_seq":610,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.090066+0000","last_change":"2024-09-12T00:25:10.526277+0000","last_active":"2024-09-12T01:35:19.090066+0000","last_peered":"2024-09-12T01:35:19.090066+0000","last_clean":"2024-09-12T01:35:19.090066+0000","last_became_active":"2024-09-12T00:25:10.525981+0000","last_became_peered":"2024-09-12T00:25:10.525981+0000","last_unstale":"2024-09-12T01:35:19.090066+0000","last_undegraded":"2024-09-12T01:35:19.090066+0000","last_fullsized":"2024-09-12T01:35:19.090066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:24.715656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":244,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'801","reported_seq":2397,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.430285+0000","last_change":"2024-09-12T00:25:02.463863+0000","last_active":"2024-09-12T01:37:18.430285+0000","last_peered":"2024-09-12T01:37:18.430285+0000","last_clean":"2024-09-12T01:37:18.430285+0000","last_became_active":"2024-09-12T00:25:02.463545+0000","last_became_peered":"2024-09-12T00:25:02.463545+0000","last_unstale":"2024-09-12T01:37:18.430285+0000","last_undegraded":"2024-09-12T01:37:18.430285+0000","last_fullsized":"2024-09-12T01:37:18.430285+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:38.345347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3630,"num_write":1061,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'198","reported_seq":813,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:10.595211+0000","last_change":"2024-09-12T00:25:00.479118+0000","last_active":"2024-09-12T01:37:10.595211+0000","last_peered":"2024-09-12T01:37:10.595211+0000","last_clean":"2024-09-12T01:37:10.595211+0000","last_became_active":"2024-09-12T00:25:00.478561+0000","last_became_peered":"2024-09-12T00:25:00.478561+0000","last_unstale":"2024-09-12T01:37:10.595211+0000","last_undegraded":"2024-09-12T01:37:10.595211+0000","last_fullsized":"2024-09-12T01:37:10.595211+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:02.954102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5813186,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":428,"num_read_kb":8616,"num_write":920,"num_write_kb":24681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088076+0000","last_change":"2024-09-12T00:25:04.481420+0000","last_active":"2024-09-12T01:35:05.088076+0000","last_peered":"2024-09-12T01:35:05.088076+0000","last_clean":"2024-09-12T01:35:05.088076+0000","last_became_active":"2024-09-12T00:25:04.481146+0000","last_became_peered":"2024-09-12T00:25:04.481146+0000","last_unstale":"2024-09-12T01:35:05.088076+0000","last_undegraded":"2024-09-12T01:35:05.088076+0000","last_fullsized":"2024-09-12T01:35:05.088076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:58.000768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'151","reported_seq":745,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.528032+0000","last_change":"2024-09-12T00:25:06.499351+0000","last_active":"2024-09-12T01:37:19.528032+0000","last_peered":"2024-09-12T01:37:19.528032+0000","last_clean":"2024-09-12T01:37:19.528032+0000","last_became_active":"2024-09-12T00:25:06.499065+0000","last_became_peered":"2024-09-12T00:25:06.499065+0000","last_unstale":"2024-09-12T01:37:19.528032+0000","last_undegraded":"2024-09-12T01:37:19.528032+0000","last_fullsized":"2024-09-12T01:37:19.528032+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:00.555004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25525,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":203,"num_read_kb":299,"num_write":116,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:54.518132+0000","last_change":"2024-09-12T00:25:08.510993+0000","last_active":"2024-09-12T01:32:54.518132+0000","last_peered":"2024-09-12T01:32:54.518132+0000","last_clean":"2024-09-12T01:32:54.518132+0000","last_became_active":"2024-09-12T00:25:08.510416+0000","last_became_peered":"2024-09-12T00:25:08.510416+0000","last_unstale":"2024-09-12T01:32:54.518132+0000","last_undegraded":"2024-09-12T01:32:54.518132+0000","last_fullsized":"2024-09-12T01:32:54.518132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:07.820462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'116","reported_seq":637,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.003868+0000","last_change":"2024-09-12T00:25:10.521269+0000","last_active":"2024-09-12T01:35:19.003868+0000","last_peered":"2024-09-12T01:35:19.003868+0000","last_clean":"2024-09-12T01:35:19.003868+0000","last_became_active":"2024-09-12T00:25:10.520808+0000","last_became_peered":"2024-09-12T00:25:10.520808+0000","last_unstale":"2024-09-12T01:35:19.003868+0000","last_undegraded":"2024-09-12T01:35:19.003868+0000","last_fullsized":"2024-09-12T01:35:19.003868+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:03.946656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1152,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":290,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'797","reported_seq":2307,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.315904+0000","last_change":"2024-09-12T00:25:02.470881+0000","last_active":"2024-09-12T01:36:12.315904+0000","last_peered":"2024-09-12T01:36:12.315904+0000","last_clean":"2024-09-12T01:36:12.315904+0000","last_became_active":"2024-09-12T00:25:02.470607+0000","last_became_peered":"2024-09-12T00:25:02.470607+0000","last_unstale":"2024-09-12T01:36:12.315904+0000","last_undegraded":"2024-09-12T01:36:12.315904+0000","last_fullsized":"2024-09-12T01:36:12.315904+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:49.586235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3788,"num_read_kb":3387,"num_write":1064,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'174","reported_seq":839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.003841+0000","last_change":"2024-09-12T00:25:00.465714+0000","last_active":"2024-09-12T01:35:19.003841+0000","last_peered":"2024-09-12T01:35:19.003841+0000","last_clean":"2024-09-12T01:35:19.003841+0000","last_became_active":"2024-09-12T00:25:00.465095+0000","last_became_peered":"2024-09-12T00:25:00.465095+0000","last_unstale":"2024-09-12T01:35:19.003841+0000","last_undegraded":"2024-09-12T01:35:19.003841+0000","last_fullsized":"2024-09-12T01:35:19.003841+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:10.785936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4537563,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":87968,"num_write":858,"num_write_kb":34661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088796+0000","last_change":"2024-09-12T00:25:04.483527+0000","last_active":"2024-09-12T01:35:09.088796+0000","last_peered":"2024-09-12T01:35:09.088796+0000","last_clean":"2024-09-12T01:35:09.088796+0000","last_became_active":"2024-09-12T00:25:04.483232+0000","last_became_peered":"2024-09-12T00:25:04.483232+0000","last_unstale":"2024-09-12T01:35:09.088796+0000","last_undegraded":"2024-09-12T01:35:09.088796+0000","last_fullsized":"2024-09-12T01:35:09.088796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:29.187018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'116","reported_seq":681,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:45.676034+0000","last_change":"2024-09-12T00:25:06.500325+0000","last_active":"2024-09-12T01:35:45.676034+0000","last_peered":"2024-09-12T01:35:45.676034+0000","last_clean":"2024-09-12T01:35:45.676034+0000","last_became_active":"2024-09-12T00:25:06.499749+0000","last_became_peered":"2024-09-12T00:25:06.499749+0000","last_unstale":"2024-09-12T01:35:45.676034+0000","last_undegraded":"2024-09-12T01:35:45.676034+0000","last_fullsized":"2024-09-12T01:35:45.676034+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:39.445969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9804,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":143,"num_read_kb":200,"num_write":72,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:39.516081+0000","last_change":"2024-09-12T00:25:08.514387+0000","last_active":"2024-09-12T01:32:39.516081+0000","last_peered":"2024-09-12T01:32:39.516081+0000","last_clean":"2024-09-12T01:32:39.516081+0000","last_became_active":"2024-09-12T00:25:08.513977+0000","last_became_peered":"2024-09-12T00:25:08.513977+0000","last_unstale":"2024-09-12T01:32:39.516081+0000","last_undegraded":"2024-09-12T01:32:39.516081+0000","last_fullsized":"2024-09-12T01:32:39.516081+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.665951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'144","reported_seq":1247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:10.909919+0000","last_change":"2024-09-12T00:25:10.530536+0000","last_active":"2024-09-12T01:36:10.909919+0000","last_peered":"2024-09-12T01:36:10.909919+0000","last_clean":"2024-09-12T01:36:10.909919+0000","last_became_active":"2024-09-12T00:25:10.530103+0000","last_became_peered":"2024-09-12T00:25:10.530103+0000","last_unstale":"2024-09-12T01:36:10.909919+0000","last_undegraded":"2024-09-12T01:36:10.909919+0000","last_fullsized":"2024-09-12T01:36:10.909919+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.601805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":760,"num_write":344,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'1249","reported_seq":2942,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088591+0000","last_change":"2024-09-12T00:25:02.467411+0000","last_active":"2024-09-12T01:35:10.088591+0000","last_peered":"2024-09-12T01:35:10.088591+0000","last_clean":"2024-09-12T01:35:10.088591+0000","last_became_active":"2024-09-12T00:25:02.467159+0000","last_became_peered":"2024-09-12T00:25:02.467159+0000","last_unstale":"2024-09-12T01:35:10.088591+0000","last_undegraded":"2024-09-12T01:35:10.088591+0000","last_fullsized":"2024-09-12T01:35:10.088591+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:32.592501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5713,"num_read_kb":5033,"num_write":1731,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'178","reported_seq":792,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:33.326735+0000","last_change":"2024-09-12T00:25:00.458860+0000","last_active":"2024-09-12T01:34:33.326735+0000","last_peered":"2024-09-12T01:34:33.326735+0000","last_clean":"2024-09-12T01:34:33.326735+0000","last_became_active":"2024-09-12T00:25:00.458519+0000","last_became_peered":"2024-09-12T00:25:00.458519+0000","last_unstale":"2024-09-12T01:34:33.326735+0000","last_undegraded":"2024-09-12T01:34:33.326735+0000","last_fullsized":"2024-09-12T01:34:33.326735+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:29.743861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":217845,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":381,"num_read_kb":854,"num_write":910,"num_write_kb":13833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:57.233292+0000","last_change":"2024-09-12T00:25:04.482146+0000","last_active":"2024-09-12T01:32:57.233292+0000","last_peered":"2024-09-12T01:32:57.233292+0000","last_clean":"2024-09-12T01:32:57.233292+0000","last_became_active":"2024-09-12T00:25:04.481393+0000","last_became_peered":"2024-09-12T00:25:04.481393+0000","last_unstale":"2024-09-12T01:32:57.233292+0000","last_undegraded":"2024-09-12T01:32:57.233292+0000","last_fullsized":"2024-09-12T01:32:57.233292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:22.018902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'189","reported_seq":795,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:47.569578+0000","last_change":"2024-09-12T00:25:06.490707+0000","last_active":"2024-09-12T01:35:47.569578+0000","last_peered":"2024-09-12T01:35:47.569578+0000","last_clean":"2024-09-12T01:35:47.569578+0000","last_became_active":"2024-09-12T00:25:06.490384+0000","last_became_peered":"2024-09-12T00:25:06.490384+0000","last_unstale":"2024-09-12T01:35:47.569578+0000","last_undegraded":"2024-09-12T01:35:47.569578+0000","last_fullsized":"2024-09-12T01:35:47.569578+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:11.867492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11558,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":246,"num_read_kb":300,"num_write":140,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:42.230896+0000","last_change":"2024-09-12T00:25:08.508294+0000","last_active":"2024-09-12T01:32:42.230896+0000","last_peered":"2024-09-12T01:32:42.230896+0000","last_clean":"2024-09-12T01:32:42.230896+0000","last_became_active":"2024-09-12T00:25:08.507837+0000","last_became_peered":"2024-09-12T00:25:08.507837+0000","last_unstale":"2024-09-12T01:32:42.230896+0000","last_undegraded":"2024-09-12T01:32:42.230896+0000","last_fullsized":"2024-09-12T01:32:42.230896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:13.827697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'136","reported_seq":682,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.395437+0000","last_change":"2024-09-12T00:25:10.528310+0000","last_active":"2024-09-12T01:37:18.395437+0000","last_peered":"2024-09-12T01:37:18.395437+0000","last_clean":"2024-09-12T01:37:18.395437+0000","last_became_active":"2024-09-12T00:25:10.528040+0000","last_became_peered":"2024-09-12T00:25:10.528040+0000","last_unstale":"2024-09-12T01:37:18.395437+0000","last_undegraded":"2024-09-12T01:37:18.395437+0000","last_fullsized":"2024-09-12T01:37:18.395437+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:22.655533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":238,"num_write":307,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'1096","reported_seq":2607,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.781254+0000","last_change":"2024-09-12T00:25:02.474566+0000","last_active":"2024-09-12T01:34:39.781254+0000","last_peered":"2024-09-12T01:34:39.781254+0000","last_clean":"2024-09-12T01:34:39.781254+0000","last_became_active":"2024-09-12T00:25:02.474282+0000","last_became_peered":"2024-09-12T00:25:02.474282+0000","last_unstale":"2024-09-12T01:34:39.781254+0000","last_undegraded":"2024-09-12T01:34:39.781254+0000","last_fullsized":"2024-09-12T01:34:39.781254+0000","mapping_epoch":28,"log_start":"266'1000","ondisk_log_start":"266'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:37.444902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4398,"num_write":1510,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'174","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079513+0000","last_change":"2024-09-12T00:25:00.478653+0000","last_active":"2024-09-12T01:33:45.079513+0000","last_peered":"2024-09-12T01:33:45.079513+0000","last_clean":"2024-09-12T01:33:45.079513+0000","last_became_active":"2024-09-12T00:25:00.478259+0000","last_became_peered":"2024-09-12T00:25:00.478259+0000","last_unstale":"2024-09-12T01:33:45.079513+0000","last_undegraded":"2024-09-12T01:33:45.079513+0000","last_fullsized":"2024-09-12T01:33:45.079513+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:16.754223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9309587,"num_objects":11,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":470,"num_read_kb":41138,"num_write":862,"num_write_kb":35919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'752","reported_seq":2230,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.789666+0000","last_change":"2024-09-12T00:25:02.479779+0000","last_active":"2024-09-12T01:34:32.789666+0000","last_peered":"2024-09-12T01:34:32.789666+0000","last_clean":"2024-09-12T01:34:32.789666+0000","last_became_active":"2024-09-12T00:25:02.479450+0000","last_became_peered":"2024-09-12T00:25:02.479450+0000","last_unstale":"2024-09-12T01:34:32.789666+0000","last_undegraded":"2024-09-12T01:34:32.789666+0000","last_fullsized":"2024-09-12T01:34:32.789666+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:48.463312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3526,"num_read_kb":3183,"num_write":976,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'202","reported_seq":837,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:50.111946+0000","last_change":"2024-09-12T00:25:00.468633+0000","last_active":"2024-09-12T01:33:50.111946+0000","last_peered":"2024-09-12T01:33:50.111946+0000","last_clean":"2024-09-12T01:33:50.111946+0000","last_became_active":"2024-09-12T00:25:00.468280+0000","last_became_peered":"2024-09-12T00:25:00.468280+0000","last_unstale":"2024-09-12T01:33:50.111946+0000","last_undegraded":"2024-09-12T01:33:50.111946+0000","last_fullsized":"2024-09-12T01:33:50.111946+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:45.872366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6405808,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":416,"num_read_kb":15096,"num_write":1001,"num_write_kb":29184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'365","reported_seq":1884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.192081+0000","last_change":"2024-09-12T00:25:02.477649+0000","last_active":"2024-09-12T01:36:11.192081+0000","last_peered":"2024-09-12T01:36:11.192081+0000","last_clean":"2024-09-12T01:36:11.192081+0000","last_became_active":"2024-09-12T00:25:02.476993+0000","last_became_peered":"2024-09-12T00:25:02.476993+0000","last_unstale":"2024-09-12T01:36:11.192081+0000","last_undegraded":"2024-09-12T01:36:11.192081+0000","last_fullsized":"2024-09-12T01:36:11.192081+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:43.749594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2221,"num_read_kb":2131,"num_write":417,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'195","reported_seq":879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:18.540100+0000","last_change":"2024-09-12T00:25:00.478242+0000","last_active":"2024-09-12T01:35:18.540100+0000","last_peered":"2024-09-12T01:35:18.540100+0000","last_clean":"2024-09-12T01:35:18.540100+0000","last_became_active":"2024-09-12T00:25:00.477872+0000","last_became_peered":"2024-09-12T00:25:00.477872+0000","last_unstale":"2024-09-12T01:35:18.540100+0000","last_undegraded":"2024-09-12T01:35:18.540100+0000","last_fullsized":"2024-09-12T01:35:18.540100+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:04.405196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1696815,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":686,"num_read_kb":9353,"num_write":793,"num_write_kb":34820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'478","reported_seq":1981,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.192692+0000","last_change":"2024-09-12T00:25:02.468462+0000","last_active":"2024-09-12T01:36:11.192692+0000","last_peered":"2024-09-12T01:36:11.192692+0000","last_clean":"2024-09-12T01:36:11.192692+0000","last_became_active":"2024-09-12T00:25:02.468180+0000","last_became_peered":"2024-09-12T00:25:02.468180+0000","last_unstale":"2024-09-12T01:36:11.192692+0000","last_undegraded":"2024-09-12T01:36:11.192692+0000","last_fullsized":"2024-09-12T01:36:11.192692+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:04.921278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2321,"num_read_kb":2166,"num_write":540,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'175","reported_seq":784,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:21.357136+0000","last_change":"2024-09-12T00:25:00.472077+0000","last_active":"2024-09-12T01:35:21.357136+0000","last_peered":"2024-09-12T01:35:21.357136+0000","last_clean":"2024-09-12T01:35:21.357136+0000","last_became_active":"2024-09-12T00:25:00.471412+0000","last_became_peered":"2024-09-12T00:25:00.471412+0000","last_unstale":"2024-09-12T01:35:21.357136+0000","last_undegraded":"2024-09-12T01:35:21.357136+0000","last_fullsized":"2024-09-12T01:35:21.357136+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:10.903274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4655225,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":350,"num_read_kb":25493,"num_write":894,"num_write_kb":19511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'498","reported_seq":2184,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.646707+0000","last_change":"2024-09-12T00:25:02.469514+0000","last_active":"2024-09-12T01:35:23.646707+0000","last_peered":"2024-09-12T01:35:23.646707+0000","last_clean":"2024-09-12T01:35:23.646707+0000","last_became_active":"2024-09-12T00:25:02.469251+0000","last_became_peered":"2024-09-12T00:25:02.469251+0000","last_unstale":"2024-09-12T01:35:23.646707+0000","last_undegraded":"2024-09-12T01:35:23.646707+0000","last_fullsized":"2024-09-12T01:35:23.646707+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:47.158487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2750,"num_read_kb":2605,"num_write":624,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'200","reported_seq":826,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.174267+0000","last_change":"2024-09-12T00:25:00.467331+0000","last_active":"2024-09-12T01:34:24.174267+0000","last_peered":"2024-09-12T01:34:24.174267+0000","last_clean":"2024-09-12T01:34:24.174267+0000","last_became_active":"2024-09-12T00:25:00.466945+0000","last_became_peered":"2024-09-12T00:25:00.466945+0000","last_unstale":"2024-09-12T01:34:24.174267+0000","last_undegraded":"2024-09-12T01:34:24.174267+0000","last_fullsized":"2024-09-12T01:34:24.174267+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:39.900588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6892635,"num_objects":9,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":388,"num_read_kb":18851,"num_write":959,"num_write_kb":35048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'496","reported_seq":2036,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.880849+0000","last_change":"2024-09-12T00:25:02.475541+0000","last_active":"2024-09-12T01:35:08.880849+0000","last_peered":"2024-09-12T01:35:08.880849+0000","last_clean":"2024-09-12T01:35:08.880849+0000","last_became_active":"2024-09-12T00:25:02.475225+0000","last_became_peered":"2024-09-12T00:25:02.475225+0000","last_unstale":"2024-09-12T01:35:08.880849+0000","last_undegraded":"2024-09-12T01:35:08.880849+0000","last_fullsized":"2024-09-12T01:35:08.880849+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.705825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2326,"num_write":604,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'190","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.174299+0000","last_change":"2024-09-12T00:25:00.468589+0000","last_active":"2024-09-12T01:34:24.174299+0000","last_peered":"2024-09-12T01:34:24.174299+0000","last_clean":"2024-09-12T01:34:24.174299+0000","last_became_active":"2024-09-12T00:25:00.468245+0000","last_became_peered":"2024-09-12T00:25:00.468245+0000","last_unstale":"2024-09-12T01:34:24.174299+0000","last_undegraded":"2024-09-12T01:34:24.174299+0000","last_fullsized":"2024-09-12T01:34:24.174299+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:59.481921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11072607,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":393,"num_read_kb":27275,"num_write":955,"num_write_kb":19137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'527","reported_seq":2284,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:53.479407+0000","last_change":"2024-09-12T00:25:02.469328+0000","last_active":"2024-09-12T01:34:53.479407+0000","last_peered":"2024-09-12T01:34:53.479407+0000","last_clean":"2024-09-12T01:34:53.479407+0000","last_became_active":"2024-09-12T00:25:02.469044+0000","last_became_peered":"2024-09-12T00:25:02.469044+0000","last_unstale":"2024-09-12T01:34:53.479407+0000","last_undegraded":"2024-09-12T01:34:53.479407+0000","last_fullsized":"2024-09-12T01:34:53.479407+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:12.185074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2889,"num_read_kb":2724,"num_write":624,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'180","reported_seq":805,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:13.713475+0000","last_change":"2024-09-12T00:25:00.487875+0000","last_active":"2024-09-12T01:37:13.713475+0000","last_peered":"2024-09-12T01:37:13.713475+0000","last_clean":"2024-09-12T01:37:13.713475+0000","last_became_active":"2024-09-12T00:25:00.487526+0000","last_became_peered":"2024-09-12T00:25:00.487526+0000","last_unstale":"2024-09-12T01:37:13.713475+0000","last_undegraded":"2024-09-12T01:37:13.713475+0000","last_fullsized":"2024-09-12T01:37:13.713475+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:49.142939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1386074,"num_objects":10,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":425,"num_read_kb":3010,"num_write":918,"num_write_kb":19090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1186","reported_seq":2778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.404544+0000","last_change":"2024-09-12T00:25:02.465875+0000","last_active":"2024-09-12T01:37:18.404544+0000","last_peered":"2024-09-12T01:37:18.404544+0000","last_clean":"2024-09-12T01:37:18.404544+0000","last_became_active":"2024-09-12T00:25:02.465257+0000","last_became_peered":"2024-09-12T00:25:02.465257+0000","last_unstale":"2024-09-12T01:37:18.404544+0000","last_undegraded":"2024-09-12T01:37:18.404544+0000","last_fullsized":"2024-09-12T01:37:18.404544+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:04.981975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5507,"num_read_kb":4876,"num_write":1621,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'259","reported_seq":907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:23.994435+0000","last_change":"2024-09-12T00:25:00.469603+0000","last_active":"2024-09-12T01:34:23.994435+0000","last_peered":"2024-09-12T01:34:23.994435+0000","last_clean":"2024-09-12T01:34:23.994435+0000","last_became_active":"2024-09-12T00:25:00.469159+0000","last_became_peered":"2024-09-12T00:25:00.469159+0000","last_unstale":"2024-09-12T01:34:23.994435+0000","last_undegraded":"2024-09-12T01:34:23.994435+0000","last_fullsized":"2024-09-12T01:34:23.994435+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":200,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:29.592131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12832813,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":500,"num_read_kb":57821,"num_write":1098,"num_write_kb":41989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'486","reported_seq":1921,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123191+0000","last_change":"2024-09-12T00:25:02.470885+0000","last_active":"2024-09-12T01:35:05.123191+0000","last_peered":"2024-09-12T01:35:05.123191+0000","last_clean":"2024-09-12T01:35:05.123191+0000","last_became_active":"2024-09-12T00:25:02.470623+0000","last_became_peered":"2024-09-12T00:25:02.470623+0000","last_unstale":"2024-09-12T01:35:05.123191+0000","last_undegraded":"2024-09-12T01:35:05.123191+0000","last_fullsized":"2024-09-12T01:35:05.123191+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:25.739488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2404,"num_read_kb":2207,"num_write":594,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'234","reported_seq":899,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529532+0000","last_change":"2024-09-12T00:25:00.470643+0000","last_active":"2024-09-12T01:34:29.529532+0000","last_peered":"2024-09-12T01:34:29.529532+0000","last_clean":"2024-09-12T01:34:29.529532+0000","last_became_active":"2024-09-12T00:25:00.469918+0000","last_became_peered":"2024-09-12T00:25:00.469918+0000","last_unstale":"2024-09-12T01:34:29.529532+0000","last_undegraded":"2024-09-12T01:34:29.529532+0000","last_fullsized":"2024-09-12T01:34:29.529532+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:08.268473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10305661,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":480,"num_read_kb":51750,"num_write":1095,"num_write_kb":39694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'612","reported_seq":2412,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801716+0000","last_change":"2024-09-12T00:25:02.476152+0000","last_active":"2024-09-12T01:35:34.801716+0000","last_peered":"2024-09-12T01:35:34.801716+0000","last_clean":"2024-09-12T01:35:34.801716+0000","last_became_active":"2024-09-12T00:25:02.475864+0000","last_became_peered":"2024-09-12T00:25:02.475864+0000","last_unstale":"2024-09-12T01:35:34.801716+0000","last_undegraded":"2024-09-12T01:35:34.801716+0000","last_fullsized":"2024-09-12T01:35:34.801716+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:31.109147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3105,"num_read_kb":2885,"num_write":734,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'280","reported_seq":979,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:48.998688+0000","last_change":"2024-09-12T00:25:00.468654+0000","last_active":"2024-09-12T01:34:48.998688+0000","last_peered":"2024-09-12T01:34:48.998688+0000","last_clean":"2024-09-12T01:34:48.998688+0000","last_became_active":"2024-09-12T00:25:00.468228+0000","last_became_peered":"2024-09-12T00:25:00.468228+0000","last_unstale":"2024-09-12T01:34:48.998688+0000","last_undegraded":"2024-09-12T01:34:48.998688+0000","last_fullsized":"2024-09-12T01:34:48.998688+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":200,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:04.194595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5899816,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":674,"num_read_kb":67032,"num_write":1223,"num_write_kb":28377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'949","reported_seq":2514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.490891+0000","last_change":"2024-09-12T00:25:02.476025+0000","last_active":"2024-09-12T01:35:23.490891+0000","last_peered":"2024-09-12T01:35:23.490891+0000","last_clean":"2024-09-12T01:35:23.490891+0000","last_became_active":"2024-09-12T00:25:02.473441+0000","last_became_peered":"2024-09-12T00:25:02.473441+0000","last_unstale":"2024-09-12T01:35:23.490891+0000","last_undegraded":"2024-09-12T01:35:23.490891+0000","last_fullsized":"2024-09-12T01:35:23.490891+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:50.101335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4462,"num_read_kb":3929,"num_write":1316,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'212","reported_seq":865,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.086696+0000","last_change":"2024-09-12T00:25:00.465738+0000","last_active":"2024-09-12T01:34:49.086696+0000","last_peered":"2024-09-12T01:34:49.086696+0000","last_clean":"2024-09-12T01:34:49.086696+0000","last_became_active":"2024-09-12T00:25:00.465127+0000","last_became_peered":"2024-09-12T00:25:00.465127+0000","last_unstale":"2024-09-12T01:34:49.086696+0000","last_undegraded":"2024-09-12T01:34:49.086696+0000","last_fullsized":"2024-09-12T01:34:49.086696+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:37.553300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1093925,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":475,"num_read_kb":16638,"num_write":1046,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'828","reported_seq":2449,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.834057+0000","last_change":"2024-09-12T00:25:02.464676+0000","last_active":"2024-09-12T01:35:16.834057+0000","last_peered":"2024-09-12T01:35:16.834057+0000","last_clean":"2024-09-12T01:35:16.834057+0000","last_became_active":"2024-09-12T00:25:02.464386+0000","last_became_peered":"2024-09-12T00:25:02.464386+0000","last_unstale":"2024-09-12T01:35:16.834057+0000","last_undegraded":"2024-09-12T01:35:16.834057+0000","last_fullsized":"2024-09-12T01:35:16.834057+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:41.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3522,"num_write":1059,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'163","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:47.249575+0000","last_change":"2024-09-12T00:25:00.465954+0000","last_active":"2024-09-12T01:34:47.249575+0000","last_peered":"2024-09-12T01:34:47.249575+0000","last_clean":"2024-09-12T01:34:47.249575+0000","last_became_active":"2024-09-12T00:25:00.465400+0000","last_became_peered":"2024-09-12T00:25:00.465400+0000","last_unstale":"2024-09-12T01:34:47.249575+0000","last_undegraded":"2024-09-12T01:34:47.249575+0000","last_fullsized":"2024-09-12T01:34:47.249575+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:52.577671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079914,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":437,"num_read_kb":4582,"num_write":825,"num_write_kb":26519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'779","reported_seq":2416,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194962+0000","last_change":"2024-09-12T00:25:02.469311+0000","last_active":"2024-09-12T01:36:11.194962+0000","last_peered":"2024-09-12T01:36:11.194962+0000","last_clean":"2024-09-12T01:36:11.194962+0000","last_became_active":"2024-09-12T00:25:02.469046+0000","last_became_peered":"2024-09-12T00:25:02.469046+0000","last_unstale":"2024-09-12T01:36:11.194962+0000","last_undegraded":"2024-09-12T01:36:11.194962+0000","last_fullsized":"2024-09-12T01:36:11.194962+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.426796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3834,"num_read_kb":3478,"num_write":1008,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'205","reported_seq":875,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.199934+0000","last_change":"2024-09-12T00:25:00.469566+0000","last_active":"2024-09-12T01:35:55.199934+0000","last_peered":"2024-09-12T01:35:55.199934+0000","last_clean":"2024-09-12T01:35:55.199934+0000","last_became_active":"2024-09-12T00:25:00.468581+0000","last_became_peered":"2024-09-12T00:25:00.468581+0000","last_unstale":"2024-09-12T01:35:55.199934+0000","last_undegraded":"2024-09-12T01:35:55.199934+0000","last_fullsized":"2024-09-12T01:35:55.199934+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:58.853274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5974074,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":512,"num_read_kb":48643,"num_write":1008,"num_write_kb":19361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'797","reported_seq":2362,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.397154+0000","last_change":"2024-09-12T00:25:02.477178+0000","last_active":"2024-09-12T01:37:18.397154+0000","last_peered":"2024-09-12T01:37:18.397154+0000","last_clean":"2024-09-12T01:37:18.397154+0000","last_became_active":"2024-09-12T00:25:02.476825+0000","last_became_peered":"2024-09-12T00:25:02.476825+0000","last_unstale":"2024-09-12T01:37:18.397154+0000","last_undegraded":"2024-09-12T01:37:18.397154+0000","last_fullsized":"2024-09-12T01:37:18.397154+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:53.361725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3888,"num_read_kb":3500,"num_write":1075,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'185","reported_seq":861,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.532592+0000","last_change":"2024-09-12T00:25:00.480493+0000","last_active":"2024-09-12T01:34:54.532592+0000","last_peered":"2024-09-12T01:34:54.532592+0000","last_clean":"2024-09-12T01:34:54.532592+0000","last_became_active":"2024-09-12T00:25:00.480122+0000","last_became_peered":"2024-09-12T00:25:00.480122+0000","last_unstale":"2024-09-12T01:34:54.532592+0000","last_undegraded":"2024-09-12T01:34:54.532592+0000","last_fullsized":"2024-09-12T01:34:54.532592+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:57.940376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":417440,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":550,"num_read_kb":7914,"num_write":892,"num_write_kb":29144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'690","reported_seq":2144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.193773+0000","last_change":"2024-09-12T00:25:02.467034+0000","last_active":"2024-09-12T01:36:11.193773+0000","last_peered":"2024-09-12T01:36:11.193773+0000","last_clean":"2024-09-12T01:36:11.193773+0000","last_became_active":"2024-09-12T00:25:02.465790+0000","last_became_peered":"2024-09-12T00:25:02.465790+0000","last_unstale":"2024-09-12T01:36:11.193773+0000","last_undegraded":"2024-09-12T01:36:11.193773+0000","last_fullsized":"2024-09-12T01:36:11.193773+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:47.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3268,"num_read_kb":2971,"num_write":903,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'256","reported_seq":900,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123154+0000","last_change":"2024-09-12T00:25:00.469984+0000","last_active":"2024-09-12T01:35:05.123154+0000","last_peered":"2024-09-12T01:35:05.123154+0000","last_clean":"2024-09-12T01:35:05.123154+0000","last_became_active":"2024-09-12T00:25:00.469634+0000","last_became_peered":"2024-09-12T00:25:00.469634+0000","last_unstale":"2024-09-12T01:35:05.123154+0000","last_undegraded":"2024-09-12T01:35:05.123154+0000","last_fullsized":"2024-09-12T01:35:05.123154+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:05.806256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2231079,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":508,"num_read_kb":1718,"num_write":1160,"num_write_kb":27079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'434","reported_seq":2042,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.340373+0000","last_change":"2024-09-12T00:25:02.465571+0000","last_active":"2024-09-12T01:36:12.340373+0000","last_peered":"2024-09-12T01:36:12.340373+0000","last_clean":"2024-09-12T01:36:12.340373+0000","last_became_active":"2024-09-12T00:25:02.464112+0000","last_became_peered":"2024-09-12T00:25:02.464112+0000","last_unstale":"2024-09-12T01:36:12.340373+0000","last_undegraded":"2024-09-12T01:36:12.340373+0000","last_fullsized":"2024-09-12T01:36:12.340373+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:22.009640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2410,"num_read_kb":2284,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'224","reported_seq":874,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533880+0000","last_change":"2024-09-12T00:25:00.469057+0000","last_active":"2024-09-12T01:35:04.533880+0000","last_peered":"2024-09-12T01:35:04.533880+0000","last_clean":"2024-09-12T01:35:04.533880+0000","last_became_active":"2024-09-12T00:25:00.468600+0000","last_became_peered":"2024-09-12T00:25:00.468600+0000","last_unstale":"2024-09-12T01:35:04.533880+0000","last_undegraded":"2024-09-12T01:35:04.533880+0000","last_fullsized":"2024-09-12T01:35:04.533880+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:05.715126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6376643,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":505,"num_read_kb":7263,"num_write":1145,"num_write_kb":27569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'174","reported_seq":818,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533618+0000","last_change":"2024-09-12T00:25:00.470300+0000","last_active":"2024-09-12T01:35:04.533618+0000","last_peered":"2024-09-12T01:35:04.533618+0000","last_clean":"2024-09-12T01:35:04.533618+0000","last_became_active":"2024-09-12T00:25:00.469382+0000","last_became_peered":"2024-09-12T00:25:00.469382+0000","last_unstale":"2024-09-12T01:35:04.533618+0000","last_undegraded":"2024-09-12T01:35:04.533618+0000","last_fullsized":"2024-09-12T01:35:04.533618+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:57.619429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1964154,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":432,"num_read_kb":14405,"num_write":852,"num_write_kb":23706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'916","reported_seq":2485,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.307264+0000","last_change":"2024-09-12T00:25:02.475301+0000","last_active":"2024-09-12T01:36:12.307264+0000","last_peered":"2024-09-12T01:36:12.307264+0000","last_clean":"2024-09-12T01:36:12.307264+0000","last_became_active":"2024-09-12T00:25:02.475004+0000","last_became_peered":"2024-09-12T00:25:02.475004+0000","last_unstale":"2024-09-12T01:36:12.307264+0000","last_undegraded":"2024-09-12T01:36:12.307264+0000","last_fullsized":"2024-09-12T01:36:12.307264+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:17.094814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4224,"num_read_kb":3778,"num_write":1247,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'224","reported_seq":949,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.001276+0000","last_change":"2024-09-12T00:25:00.472266+0000","last_active":"2024-09-12T01:35:04.001276+0000","last_peered":"2024-09-12T01:35:04.001276+0000","last_clean":"2024-09-12T01:35:04.001276+0000","last_became_active":"2024-09-12T00:25:00.471411+0000","last_became_peered":"2024-09-12T00:25:00.471411+0000","last_unstale":"2024-09-12T01:35:04.001276+0000","last_undegraded":"2024-09-12T01:35:04.001276+0000","last_fullsized":"2024-09-12T01:35:04.001276+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:34.132087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9900854,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":688,"num_read_kb":157504,"num_write":948,"num_write_kb":45267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'647","reported_seq":2390,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194867+0000","last_change":"2024-09-12T00:25:02.463284+0000","last_active":"2024-09-12T01:36:11.194867+0000","last_peered":"2024-09-12T01:36:11.194867+0000","last_clean":"2024-09-12T01:36:11.194867+0000","last_became_active":"2024-09-12T00:25:02.462993+0000","last_became_peered":"2024-09-12T00:25:02.462993+0000","last_unstale":"2024-09-12T01:36:11.194867+0000","last_undegraded":"2024-09-12T01:36:11.194867+0000","last_fullsized":"2024-09-12T01:36:11.194867+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":600,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:48.709170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3586,"num_read_kb":3293,"num_write":883,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5955,"num_read_kb":4160,"num_write":1937,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15084,"num_read_kb":14735,"num_write":16735,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1466,"ondisk_log_size":1466,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":652,"ondisk_log_size":652,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":422930,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":9899,"num_read_kb":11716,"num_write":6961,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":737280,"data_stored":215758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1750,"ondisk_log_size":1750,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2363,"num_read_kb":2821,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212728,"num_read_kb":194072,"num_write":55276,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4200,"ondisk_log_size":4200,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":347409375,"num_objects":513,"num_object_clones":0,"num_object_copies":2052,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":513,"num_whiteouts":0,"num_read":32949,"num_read_kb":1810732,"num_write":62507,"num_write_kb":1904228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":468025344,"data_stored":468025344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4304,"ondisk_log_size":4304,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":63066702,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":140,"num_read_kb":174385,"num_write":156,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126140416,"data_stored":126133404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":63066702,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":137,"num_read_kb":174274,"num_write":156,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":126140416,"data_stored":126133404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477618,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":224092,"kb_used_data":98508,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94147748,"statfs":{"total":96636764160,"available":96407293952,"internally_reserved":0,"allocated":100872192,"data_stored":98867366,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477616,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":211600,"kb_used_data":99904,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94160240,"statfs":{"total":96636764160,"available":96420085760,"internally_reserved":0,"allocated":102301696,"data_stored":100268263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424510321,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":283432,"kb_used_data":85720,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94088408,"statfs":{"total":96636764160,"available":96346529792,"internally_reserved":0,"allocated":87777280,"data_stored":85753600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510319,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":182772,"kb_used_data":93284,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94189068,"statfs":{"total":96636764160,"available":96449605632,"internally_reserved":0,"allocated":95522816,"data_stored":93475520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510320,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":353072,"kb_used_data":110880,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94018768,"statfs":{"total":96636764160,"available":96275218432,"internally_reserved":0,"allocated":113541120,"data_stored":111499227,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":247986629},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510321,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":322816,"kb_used_data":93104,"kb_used_omap":1,"kb_used_meta":229694,"kb_avail":94049024,"statfs":{"total":96636764160,"available":96306200576,"internally_reserved":0,"allocated":95338496,"data_stored":93315632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":235207111},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510321,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":353800,"kb_used_data":79672,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94018040,"statfs":{"total":96636764160,"available":96274472960,"internally_reserved":0,"allocated":81584128,"data_stored":79533795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575733,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242824,"kb_used_data":77048,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94129016,"statfs":{"total":96636764160,"available":96388112384,"internally_reserved":0,"allocated":78897152,"data_stored":76859945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":73883648,"data_stored":73883648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":51404800,"data_stored":51404800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":60899328,"data_stored":60899328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":62664704,"data_stored":62664704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53620736,"data_stored":53620736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":48664576,"data_stored":48664576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":58609664,"data_stored":58609664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":58277888,"data_stored":58277888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":28178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":30101,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":7957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":32198,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":28638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":34747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":29835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":24104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":10502144,"data_stored":10502144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":18927616,"data_stored":18926892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":18911232,"data_stored":18910508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14737408,"data_stored":14736330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6303744,"data_stored":6302855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":26304512,"data_stored":26302619,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":15724544,"data_stored":15724544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14729216,"data_stored":14727512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":13619200,"data_stored":13619200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":6348800,"data_stored":6347722,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16814080,"data_stored":16813265,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":13647872,"data_stored":13646983,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14671872,"data_stored":14671872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":33673216,"data_stored":33671414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16875520,"data_stored":16873981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":10489856,"data_stored":10488967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:37:40.714 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:37:41.060 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:37:41.071 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:37:41.073 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":2450,"stamp":"2024-09-12T01:37:40.766259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":116612916,"num_objects":753,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":753,"num_whiteouts":0,"num_read":279907,"num_read_kb":2387549,"num_write":144299,"num_write_kb":2165309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13521,"ondisk_log_size":13521,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1822120,"kb_used_data":381436,"kb_used_omap":12,"kb_used_meta":1440307,"kb_avail":753152600,"statfs":{"total":773094113280,"available":771228262400,"internally_reserved":0,"allocated":390590464,"data_stored":374467952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1474874928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-357960168,"num_objects":-299,"num_object_clones":0,"num_object_copies":-1096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-299,"num_whiteouts":0,"num_read":574,"num_read_kb":587,"num_write":430,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005485"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.977721+0000","last_change":"2024-09-12T01:02:03.926254+0000","last_active":"2024-09-12T01:34:34.977721+0000","last_peered":"2024-09-12T01:34:34.977721+0000","last_clean":"2024-09-12T01:34:34.977721+0000","last_became_active":"2024-09-12T01:02:03.925687+0000","last_became_peered":"2024-09-12T01:02:03.925687+0000","last_unstale":"2024-09-12T01:34:34.977721+0000","last_undegraded":"2024-09-12T01:34:34.977721+0000","last_fullsized":"2024-09-12T01:34:34.977721+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:25.162167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"266'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:14.095890+0000","last_change":"2024-09-12T00:43:43.813662+0000","last_active":"2024-09-12T01:36:14.095890+0000","last_peered":"2024-09-12T01:36:14.095890+0000","last_clean":"2024-09-12T01:36:14.095890+0000","last_became_active":"2024-09-12T00:43:43.812701+0000","last_became_peered":"2024-09-12T00:43:43.812701+0000","last_unstale":"2024-09-12T01:36:14.095890+0000","last_undegraded":"2024-09-12T01:36:14.095890+0000","last_fullsized":"2024-09-12T01:36:14.095890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:32.083600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.110512+0000","last_change":"2024-09-12T00:43:38.799582+0000","last_active":"2024-09-12T01:33:40.110512+0000","last_peered":"2024-09-12T01:33:40.110512+0000","last_clean":"2024-09-12T01:33:40.110512+0000","last_became_active":"2024-09-12T00:43:38.799322+0000","last_became_peered":"2024-09-12T00:43:38.799322+0000","last_unstale":"2024-09-12T01:33:40.110512+0000","last_undegraded":"2024-09-12T01:33:40.110512+0000","last_fullsized":"2024-09-12T01:33:40.110512+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:52.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.256826+0000","last_change":"2024-09-12T00:39:17.764042+0000","last_active":"2024-09-12T01:35:32.256826+0000","last_peered":"2024-09-12T01:35:32.256826+0000","last_clean":"2024-09-12T01:35:32.256826+0000","last_became_active":"2024-09-12T00:39:17.763761+0000","last_became_peered":"2024-09-12T00:39:17.763761+0000","last_unstale":"2024-09-12T01:35:32.256826+0000","last_undegraded":"2024-09-12T01:35:32.256826+0000","last_fullsized":"2024-09-12T01:35:32.256826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:49.430258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.175890+0000","last_change":"2024-09-12T01:02:03.925619+0000","last_active":"2024-09-12T01:34:34.175890+0000","last_peered":"2024-09-12T01:34:34.175890+0000","last_clean":"2024-09-12T01:34:34.175890+0000","last_became_active":"2024-09-12T01:02:03.925338+0000","last_became_peered":"2024-09-12T01:02:03.925338+0000","last_unstale":"2024-09-12T01:34:34.175890+0000","last_undegraded":"2024-09-12T01:34:34.175890+0000","last_fullsized":"2024-09-12T01:34:34.175890+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:34.463430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"266'5","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:15.095648+0000","last_change":"2024-09-12T00:43:43.822539+0000","last_active":"2024-09-12T01:36:15.095648+0000","last_peered":"2024-09-12T01:36:15.095648+0000","last_clean":"2024-09-12T01:36:15.095648+0000","last_became_active":"2024-09-12T00:43:43.822189+0000","last_became_peered":"2024-09-12T00:43:43.822189+0000","last_unstale":"2024-09-12T01:36:15.095648+0000","last_undegraded":"2024-09-12T01:36:15.095648+0000","last_fullsized":"2024-09-12T01:36:15.095648+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:14.331070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987382+0000","last_change":"2024-09-12T00:43:38.794157+0000","last_active":"2024-09-12T01:33:38.987382+0000","last_peered":"2024-09-12T01:33:38.987382+0000","last_clean":"2024-09-12T01:33:38.987382+0000","last_became_active":"2024-09-12T00:43:38.793866+0000","last_became_peered":"2024-09-12T00:43:38.793866+0000","last_unstale":"2024-09-12T01:33:38.987382+0000","last_undegraded":"2024-09-12T01:33:38.987382+0000","last_fullsized":"2024-09-12T01:33:38.987382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:51.874866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'33","reported_seq":147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256146+0000","last_change":"2024-09-12T00:39:17.769275+0000","last_active":"2024-09-12T01:35:27.256146+0000","last_peered":"2024-09-12T01:35:27.256146+0000","last_clean":"2024-09-12T01:35:27.256146+0000","last_became_active":"2024-09-12T00:39:17.768977+0000","last_became_peered":"2024-09-12T00:39:17.768977+0000","last_unstale":"2024-09-12T01:35:27.256146+0000","last_undegraded":"2024-09-12T01:35:27.256146+0000","last_fullsized":"2024-09-12T01:35:27.256146+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:10.855870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":119,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.078422+0000","last_change":"2024-09-12T01:02:03.922480+0000","last_active":"2024-09-12T01:33:29.078422+0000","last_peered":"2024-09-12T01:33:29.078422+0000","last_clean":"2024-09-12T01:33:29.078422+0000","last_became_active":"2024-09-12T01:02:03.921938+0000","last_became_peered":"2024-09-12T01:02:03.921938+0000","last_unstale":"2024-09-12T01:33:29.078422+0000","last_undegraded":"2024-09-12T01:33:29.078422+0000","last_fullsized":"2024-09-12T01:33:29.078422+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:49.013238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"266'6","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.008891+0000","last_change":"2024-09-12T00:43:43.814192+0000","last_active":"2024-09-12T01:35:49.008891+0000","last_peered":"2024-09-12T01:35:49.008891+0000","last_clean":"2024-09-12T01:35:49.008891+0000","last_became_active":"2024-09-12T00:43:43.813568+0000","last_became_peered":"2024-09-12T00:43:43.813568+0000","last_unstale":"2024-09-12T01:35:49.008891+0000","last_undegraded":"2024-09-12T01:35:49.008891+0000","last_fullsized":"2024-09-12T01:35:49.008891+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:58.958483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7172,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'7","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.129688+0000","last_change":"2024-09-12T00:43:38.797811+0000","last_active":"2024-09-12T01:35:50.129688+0000","last_peered":"2024-09-12T01:35:50.129688+0000","last_clean":"2024-09-12T01:35:50.129688+0000","last_became_active":"2024-09-12T00:43:38.797520+0000","last_became_peered":"2024-09-12T00:43:38.797520+0000","last_unstale":"2024-09-12T01:35:50.129688+0000","last_undegraded":"2024-09-12T01:35:50.129688+0000","last_fullsized":"2024-09-12T01:35:50.129688+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:56.953531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16390,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'41","reported_seq":171,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173586+0000","last_change":"2024-09-12T00:39:17.769080+0000","last_active":"2024-09-12T01:34:19.173586+0000","last_peered":"2024-09-12T01:34:19.173586+0000","last_clean":"2024-09-12T01:34:19.173586+0000","last_became_active":"2024-09-12T00:39:17.768692+0000","last_became_peered":"2024-09-12T00:39:17.768692+0000","last_unstale":"2024-09-12T01:34:19.173586+0000","last_undegraded":"2024-09-12T01:34:19.173586+0000","last_fullsized":"2024-09-12T01:34:19.173586+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:43.550430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":161,"num_write":65,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987313+0000","last_change":"2024-09-12T01:02:03.922647+0000","last_active":"2024-09-12T01:33:38.987313+0000","last_peered":"2024-09-12T01:33:38.987313+0000","last_clean":"2024-09-12T01:33:38.987313+0000","last_became_active":"2024-09-12T01:02:03.922297+0000","last_became_peered":"2024-09-12T01:02:03.922297+0000","last_unstale":"2024-09-12T01:33:38.987313+0000","last_undegraded":"2024-09-12T01:33:38.987313+0000","last_fullsized":"2024-09-12T01:33:38.987313+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:53.989667+0000","last_change":"2024-09-12T00:43:43.819023+0000","last_active":"2024-09-12T01:33:53.989667+0000","last_peered":"2024-09-12T01:33:53.989667+0000","last_clean":"2024-09-12T01:33:53.989667+0000","last_became_active":"2024-09-12T00:43:43.818668+0000","last_became_peered":"2024-09-12T00:43:43.818668+0000","last_unstale":"2024-09-12T01:33:53.989667+0000","last_undegraded":"2024-09-12T01:33:53.989667+0000","last_fullsized":"2024-09-12T01:33:53.989667+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:45.138160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.079562+0000","last_change":"2024-09-12T00:43:38.795677+0000","last_active":"2024-09-12T01:33:39.079562+0000","last_peered":"2024-09-12T01:33:39.079562+0000","last_clean":"2024-09-12T01:33:39.079562+0000","last_became_active":"2024-09-12T00:43:38.794121+0000","last_became_peered":"2024-09-12T00:43:38.794121+0000","last_unstale":"2024-09-12T01:33:39.079562+0000","last_undegraded":"2024-09-12T01:33:39.079562+0000","last_fullsized":"2024-09-12T01:33:39.079562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:33.638934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'16","reported_seq":93,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173559+0000","last_change":"2024-09-12T00:39:17.759626+0000","last_active":"2024-09-12T01:34:19.173559+0000","last_peered":"2024-09-12T01:34:19.173559+0000","last_clean":"2024-09-12T01:34:19.173559+0000","last_became_active":"2024-09-12T00:39:17.759016+0000","last_became_peered":"2024-09-12T00:39:17.759016+0000","last_unstale":"2024-09-12T01:34:19.173559+0000","last_undegraded":"2024-09-12T01:34:19.173559+0000","last_fullsized":"2024-09-12T01:34:19.173559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:25.380216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:15.115873+0000","last_change":"2024-09-12T01:02:03.919665+0000","last_active":"2024-09-12T01:34:15.115873+0000","last_peered":"2024-09-12T01:34:15.115873+0000","last_clean":"2024-09-12T01:34:15.115873+0000","last_became_active":"2024-09-12T01:02:03.919293+0000","last_became_peered":"2024-09-12T01:02:03.919293+0000","last_unstale":"2024-09-12T01:34:15.115873+0000","last_undegraded":"2024-09-12T01:34:15.115873+0000","last_fullsized":"2024-09-12T01:34:15.115873+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:31.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.978417+0000","last_change":"2024-09-12T00:43:43.818041+0000","last_active":"2024-09-12T01:34:39.978417+0000","last_peered":"2024-09-12T01:34:39.978417+0000","last_clean":"2024-09-12T01:34:39.978417+0000","last_became_active":"2024-09-12T00:43:43.817714+0000","last_became_peered":"2024-09-12T00:43:43.817714+0000","last_unstale":"2024-09-12T01:34:39.978417+0000","last_undegraded":"2024-09-12T01:34:39.978417+0000","last_fullsized":"2024-09-12T01:34:39.978417+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:15.291037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'15","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:49.017973+0000","last_change":"2024-09-12T00:43:38.795483+0000","last_active":"2024-09-12T01:36:49.017973+0000","last_peered":"2024-09-12T01:36:49.017973+0000","last_clean":"2024-09-12T01:36:49.017973+0000","last_became_active":"2024-09-12T00:43:38.795206+0000","last_became_peered":"2024-09-12T00:43:38.795206+0000","last_unstale":"2024-09-12T01:36:49.017973+0000","last_undegraded":"2024-09-12T01:36:49.017973+0000","last_fullsized":"2024-09-12T01:36:49.017973+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:51.351578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":29708,"num_write":20,"num_write_kb":14332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'31","reported_seq":144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173515+0000","last_change":"2024-09-12T00:39:17.762663+0000","last_active":"2024-09-12T01:34:19.173515+0000","last_peered":"2024-09-12T01:34:19.173515+0000","last_clean":"2024-09-12T01:34:19.173515+0000","last_became_active":"2024-09-12T00:39:17.762124+0000","last_became_peered":"2024-09-12T00:39:17.762124+0000","last_unstale":"2024-09-12T01:34:19.173515+0000","last_undegraded":"2024-09-12T01:34:19.173515+0000","last_fullsized":"2024-09-12T01:34:19.173515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:55.240200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256179+0000","last_change":"2024-09-12T01:02:03.915670+0000","last_active":"2024-09-12T01:35:27.256179+0000","last_peered":"2024-09-12T01:35:27.256179+0000","last_clean":"2024-09-12T01:35:27.256179+0000","last_became_active":"2024-09-12T01:02:03.915387+0000","last_became_peered":"2024-09-12T01:02:03.915387+0000","last_unstale":"2024-09-12T01:35:27.256179+0000","last_undegraded":"2024-09-12T01:35:27.256179+0000","last_fullsized":"2024-09-12T01:35:27.256179+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:30.278716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529511+0000","last_change":"2024-09-12T00:43:43.825343+0000","last_active":"2024-09-12T01:34:29.529511+0000","last_peered":"2024-09-12T01:34:29.529511+0000","last_clean":"2024-09-12T01:34:29.529511+0000","last_became_active":"2024-09-12T00:43:43.825054+0000","last_became_peered":"2024-09-12T00:43:43.825054+0000","last_unstale":"2024-09-12T01:34:29.529511+0000","last_undegraded":"2024-09-12T01:34:29.529511+0000","last_fullsized":"2024-09-12T01:34:29.529511+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:57.949570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:54.547748+0000","last_change":"2024-09-12T00:43:38.794955+0000","last_active":"2024-09-12T01:36:54.547748+0000","last_peered":"2024-09-12T01:36:54.547748+0000","last_clean":"2024-09-12T01:36:54.547748+0000","last_became_active":"2024-09-12T00:43:38.794612+0000","last_became_peered":"2024-09-12T00:43:38.794612+0000","last_unstale":"2024-09-12T01:36:54.547748+0000","last_undegraded":"2024-09-12T01:36:54.547748+0000","last_fullsized":"2024-09-12T01:36:54.547748+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:55.593800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'16","reported_seq":92,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:20.083241+0000","last_change":"2024-09-12T00:39:17.772179+0000","last_active":"2024-09-12T01:34:20.083241+0000","last_peered":"2024-09-12T01:34:20.083241+0000","last_clean":"2024-09-12T01:34:20.083241+0000","last_became_active":"2024-09-12T00:39:17.771839+0000","last_became_peered":"2024-09-12T00:39:17.771839+0000","last_unstale":"2024-09-12T01:34:20.083241+0000","last_undegraded":"2024-09-12T01:34:20.083241+0000","last_fullsized":"2024-09-12T01:34:20.083241+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:56.418566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":43,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.084810+0000","last_change":"2024-09-12T01:02:03.928338+0000","last_active":"2024-09-12T01:34:35.084810+0000","last_peered":"2024-09-12T01:34:35.084810+0000","last_clean":"2024-09-12T01:34:35.084810+0000","last_became_active":"2024-09-12T01:02:03.928036+0000","last_became_peered":"2024-09-12T01:02:03.928036+0000","last_unstale":"2024-09-12T01:34:35.084810+0000","last_undegraded":"2024-09-12T01:34:35.084810+0000","last_fullsized":"2024-09-12T01:34:35.084810+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:58.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079595+0000","last_change":"2024-09-12T00:43:43.819611+0000","last_active":"2024-09-12T01:33:45.079595+0000","last_peered":"2024-09-12T01:33:45.079595+0000","last_clean":"2024-09-12T01:33:45.079595+0000","last_became_active":"2024-09-12T00:43:43.819239+0000","last_became_peered":"2024-09-12T00:43:43.819239+0000","last_unstale":"2024-09-12T01:33:45.079595+0000","last_undegraded":"2024-09-12T01:33:45.079595+0000","last_fullsized":"2024-09-12T01:33:45.079595+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.073168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8210,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"266'10","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.988208+0000","last_change":"2024-09-12T00:43:38.785050+0000","last_active":"2024-09-12T01:36:09.988208+0000","last_peered":"2024-09-12T01:36:09.988208+0000","last_clean":"2024-09-12T01:36:09.988208+0000","last_became_active":"2024-09-12T00:43:38.784746+0000","last_became_peered":"2024-09-12T00:43:38.784746+0000","last_unstale":"2024-09-12T01:36:09.988208+0000","last_undegraded":"2024-09-12T01:36:09.988208+0000","last_fullsized":"2024-09-12T01:36:09.988208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:12.845708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"257'30","reported_seq":143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123074+0000","last_change":"2024-09-12T00:39:17.764933+0000","last_active":"2024-09-12T01:35:05.123074+0000","last_peered":"2024-09-12T01:35:05.123074+0000","last_clean":"2024-09-12T01:35:05.123074+0000","last_became_active":"2024-09-12T00:39:17.764658+0000","last_became_peered":"2024-09-12T00:39:17.764658+0000","last_unstale":"2024-09-12T01:35:05.123074+0000","last_undegraded":"2024-09-12T01:35:05.123074+0000","last_fullsized":"2024-09-12T01:35:05.123074+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:54.897501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":139,"num_write":41,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.977764+0000","last_change":"2024-09-12T01:02:03.917684+0000","last_active":"2024-09-12T01:34:34.977764+0000","last_peered":"2024-09-12T01:34:34.977764+0000","last_clean":"2024-09-12T01:34:34.977764+0000","last_became_active":"2024-09-12T01:02:03.917362+0000","last_became_peered":"2024-09-12T01:02:03.917362+0000","last_unstale":"2024-09-12T01:34:34.977764+0000","last_undegraded":"2024-09-12T01:34:34.977764+0000","last_fullsized":"2024-09-12T01:34:34.977764+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:13.774129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"266'8","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.668909+0000","last_change":"2024-09-12T00:43:43.822843+0000","last_active":"2024-09-12T01:37:38.668909+0000","last_peered":"2024-09-12T01:37:38.668909+0000","last_clean":"2024-09-12T01:37:38.668909+0000","last_became_active":"2024-09-12T00:43:43.822574+0000","last_became_peered":"2024-09-12T00:43:43.822574+0000","last_unstale":"2024-09-12T01:37:38.668909+0000","last_undegraded":"2024-09-12T01:37:38.668909+0000","last_fullsized":"2024-09-12T01:37:38.668909+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:31.603888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9228,"num_write":8,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.189305+0000","last_change":"2024-09-12T00:43:38.799826+0000","last_active":"2024-09-12T01:36:09.189305+0000","last_peered":"2024-09-12T01:36:09.189305+0000","last_clean":"2024-09-12T01:36:09.189305+0000","last_became_active":"2024-09-12T00:43:38.799567+0000","last_became_peered":"2024-09-12T00:43:38.799567+0000","last_unstale":"2024-09-12T01:36:09.189305+0000","last_undegraded":"2024-09-12T01:36:09.189305+0000","last_fullsized":"2024-09-12T01:36:09.189305+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:50.512707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'52","reported_seq":196,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.178294+0000","last_change":"2024-09-12T00:39:17.761012+0000","last_active":"2024-09-12T01:34:54.178294+0000","last_peered":"2024-09-12T01:34:54.178294+0000","last_clean":"2024-09-12T01:34:54.178294+0000","last_became_active":"2024-09-12T00:39:17.760735+0000","last_became_peered":"2024-09-12T00:39:17.760735+0000","last_unstale":"2024-09-12T01:34:54.178294+0000","last_undegraded":"2024-09-12T01:34:54.178294+0000","last_fullsized":"2024-09-12T01:34:54.178294+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:37.209781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":192,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997802+0000","last_change":"2024-09-12T01:02:03.925249+0000","last_active":"2024-09-12T01:34:43.997802+0000","last_peered":"2024-09-12T01:34:43.997802+0000","last_clean":"2024-09-12T01:34:43.997802+0000","last_became_active":"2024-09-12T01:02:03.924800+0000","last_became_peered":"2024-09-12T01:02:03.924800+0000","last_unstale":"2024-09-12T01:34:43.997802+0000","last_undegraded":"2024-09-12T01:34:43.997802+0000","last_fullsized":"2024-09-12T01:34:43.997802+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:42.824392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:30.118030+0000","last_change":"2024-09-12T00:43:43.822402+0000","last_active":"2024-09-12T01:34:30.118030+0000","last_peered":"2024-09-12T01:34:30.118030+0000","last_clean":"2024-09-12T01:34:30.118030+0000","last_became_active":"2024-09-12T00:43:43.822130+0000","last_became_peered":"2024-09-12T00:43:43.822130+0000","last_unstale":"2024-09-12T01:34:30.118030+0000","last_undegraded":"2024-09-12T01:34:30.118030+0000","last_fullsized":"2024-09-12T01:34:30.118030+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:52.855759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533810+0000","last_change":"2024-09-12T00:43:38.789538+0000","last_active":"2024-09-12T01:35:04.533810+0000","last_peered":"2024-09-12T01:35:04.533810+0000","last_clean":"2024-09-12T01:35:04.533810+0000","last_became_active":"2024-09-12T00:43:38.789198+0000","last_became_peered":"2024-09-12T00:43:38.789198+0000","last_unstale":"2024-09-12T01:35:04.533810+0000","last_undegraded":"2024-09-12T01:35:04.533810+0000","last_fullsized":"2024-09-12T01:35:04.533810+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:11.316230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'15","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250354+0000","last_change":"2024-09-12T00:39:17.767969+0000","last_active":"2024-09-12T01:34:52.250354+0000","last_peered":"2024-09-12T01:34:52.250354+0000","last_clean":"2024-09-12T01:34:52.250354+0000","last_became_active":"2024-09-12T00:39:17.767662+0000","last_became_peered":"2024-09-12T00:39:17.767662+0000","last_unstale":"2024-09-12T01:34:52.250354+0000","last_undegraded":"2024-09-12T01:34:52.250354+0000","last_fullsized":"2024-09-12T01:34:52.250354+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:30.457902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:44.177191+0000","last_change":"2024-09-12T01:02:03.924577+0000","last_active":"2024-09-12T01:34:44.177191+0000","last_peered":"2024-09-12T01:34:44.177191+0000","last_clean":"2024-09-12T01:34:44.177191+0000","last_became_active":"2024-09-12T01:02:03.924303+0000","last_became_peered":"2024-09-12T01:02:03.924303+0000","last_unstale":"2024-09-12T01:34:44.177191+0000","last_undegraded":"2024-09-12T01:34:44.177191+0000","last_fullsized":"2024-09-12T01:34:44.177191+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:24.298478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'9","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.843719+0000","last_change":"2024-09-12T00:43:43.821003+0000","last_active":"2024-09-12T01:37:38.843719+0000","last_peered":"2024-09-12T01:37:38.843719+0000","last_clean":"2024-09-12T01:37:38.843719+0000","last_became_active":"2024-09-12T00:43:43.819058+0000","last_became_peered":"2024-09-12T00:43:43.819058+0000","last_unstale":"2024-09-12T01:37:38.843719+0000","last_undegraded":"2024-09-12T01:37:38.843719+0000","last_fullsized":"2024-09-12T01:37:38.843719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:02.246750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9222,"num_write":14,"num_write_kb":9222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"266'8","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.626218+0000","last_change":"2024-09-12T00:43:38.796717+0000","last_active":"2024-09-12T01:37:38.626218+0000","last_peered":"2024-09-12T01:37:38.626218+0000","last_clean":"2024-09-12T01:37:38.626218+0000","last_became_active":"2024-09-12T00:43:38.796426+0000","last_became_peered":"2024-09-12T00:43:38.796426+0000","last_unstale":"2024-09-12T01:37:38.626218+0000","last_undegraded":"2024-09-12T01:37:38.626218+0000","last_fullsized":"2024-09-12T01:37:38.626218+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:20.544492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9226,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250340+0000","last_change":"2024-09-12T00:39:17.767397+0000","last_active":"2024-09-12T01:34:52.250340+0000","last_peered":"2024-09-12T01:34:52.250340+0000","last_clean":"2024-09-12T01:34:52.250340+0000","last_became_active":"2024-09-12T00:39:17.767088+0000","last_became_peered":"2024-09-12T00:39:17.767088+0000","last_unstale":"2024-09-12T01:34:52.250340+0000","last_undegraded":"2024-09-12T01:34:52.250340+0000","last_fullsized":"2024-09-12T01:34:52.250340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:12.858828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:45.085791+0000","last_change":"2024-09-12T01:02:03.925759+0000","last_active":"2024-09-12T01:34:45.085791+0000","last_peered":"2024-09-12T01:34:45.085791+0000","last_clean":"2024-09-12T01:34:45.085791+0000","last_became_active":"2024-09-12T01:02:03.925482+0000","last_became_peered":"2024-09-12T01:02:03.925482+0000","last_unstale":"2024-09-12T01:34:45.085791+0000","last_undegraded":"2024-09-12T01:34:45.085791+0000","last_fullsized":"2024-09-12T01:34:45.085791+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:13.030524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:55.139373+0000","last_change":"2024-09-12T00:43:43.820868+0000","last_active":"2024-09-12T01:36:55.139373+0000","last_peered":"2024-09-12T01:36:55.139373+0000","last_clean":"2024-09-12T01:36:55.139373+0000","last_became_active":"2024-09-12T00:43:43.820272+0000","last_became_peered":"2024-09-12T00:43:43.820272+0000","last_unstale":"2024-09-12T01:36:55.139373+0000","last_undegraded":"2024-09-12T01:36:55.139373+0000","last_fullsized":"2024-09-12T01:36:55.139373+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:42.963849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'6","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:50.138568+0000","last_change":"2024-09-12T00:43:38.800018+0000","last_active":"2024-09-12T01:36:50.138568+0000","last_peered":"2024-09-12T01:36:50.138568+0000","last_clean":"2024-09-12T01:36:50.138568+0000","last_became_active":"2024-09-12T00:43:38.799719+0000","last_became_peered":"2024-09-12T00:43:38.799719+0000","last_unstale":"2024-09-12T01:36:50.138568+0000","last_undegraded":"2024-09-12T01:36:50.138568+0000","last_fullsized":"2024-09-12T01:36:50.138568+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:07.155485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20462,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'32","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:55.121695+0000","last_change":"2024-09-12T00:39:17.762941+0000","last_active":"2024-09-12T01:34:55.121695+0000","last_peered":"2024-09-12T01:34:55.121695+0000","last_clean":"2024-09-12T01:34:55.121695+0000","last_became_active":"2024-09-12T00:39:17.762639+0000","last_became_peered":"2024-09-12T00:39:17.762639+0000","last_unstale":"2024-09-12T01:34:55.121695+0000","last_undegraded":"2024-09-12T01:34:55.121695+0000","last_fullsized":"2024-09-12T01:34:55.121695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:15.974100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:44.978932+0000","last_change":"2024-09-12T01:02:03.925349+0000","last_active":"2024-09-12T01:34:44.978932+0000","last_peered":"2024-09-12T01:34:44.978932+0000","last_clean":"2024-09-12T01:34:44.978932+0000","last_became_active":"2024-09-12T01:02:03.924892+0000","last_became_peered":"2024-09-12T01:02:03.924892+0000","last_unstale":"2024-09-12T01:34:44.978932+0000","last_undegraded":"2024-09-12T01:34:44.978932+0000","last_fullsized":"2024-09-12T01:34:44.978932+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:07.795848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'4","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:54.994285+0000","last_change":"2024-09-12T00:43:43.819938+0000","last_active":"2024-09-12T01:36:54.994285+0000","last_peered":"2024-09-12T01:36:54.994285+0000","last_clean":"2024-09-12T01:36:54.994285+0000","last_became_active":"2024-09-12T00:43:43.819431+0000","last_became_peered":"2024-09-12T00:43:43.819431+0000","last_unstale":"2024-09-12T01:36:54.994285+0000","last_undegraded":"2024-09-12T01:36:54.994285+0000","last_fullsized":"2024-09-12T01:36:54.994285+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:42.027354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"266'3","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:49.018108+0000","last_change":"2024-09-12T00:43:38.797182+0000","last_active":"2024-09-12T01:36:49.018108+0000","last_peered":"2024-09-12T01:36:49.018108+0000","last_clean":"2024-09-12T01:36:49.018108+0000","last_became_active":"2024-09-12T00:43:38.796894+0000","last_became_peered":"2024-09-12T00:43:38.796894+0000","last_unstale":"2024-09-12T01:36:49.018108+0000","last_undegraded":"2024-09-12T01:36:49.018108+0000","last_fullsized":"2024-09-12T01:36:49.018108+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:57.433793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'47","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:04.519365+0000","last_change":"2024-09-12T00:39:17.762269+0000","last_active":"2024-09-12T01:33:04.519365+0000","last_peered":"2024-09-12T01:33:04.519365+0000","last_clean":"2024-09-12T01:33:04.519365+0000","last_became_active":"2024-09-12T00:39:17.761972+0000","last_became_peered":"2024-09-12T00:39:17.761972+0000","last_unstale":"2024-09-12T01:33:04.519365+0000","last_undegraded":"2024-09-12T01:33:04.519365+0000","last_fullsized":"2024-09-12T01:33:04.519365+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:47.885908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":165,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:28.985653+0000","last_change":"2024-09-12T01:02:03.923742+0000","last_active":"2024-09-12T01:33:28.985653+0000","last_peered":"2024-09-12T01:33:28.985653+0000","last_clean":"2024-09-12T01:33:28.985653+0000","last_became_active":"2024-09-12T01:02:03.923464+0000","last_became_peered":"2024-09-12T01:02:03.923464+0000","last_unstale":"2024-09-12T01:33:28.985653+0000","last_undegraded":"2024-09-12T01:33:28.985653+0000","last_fullsized":"2024-09-12T01:33:28.985653+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:44.541153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'11","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.842146+0000","last_change":"2024-09-12T00:43:43.818258+0000","last_active":"2024-09-12T01:37:38.842146+0000","last_peered":"2024-09-12T01:37:38.842146+0000","last_clean":"2024-09-12T01:37:38.842146+0000","last_became_active":"2024-09-12T00:43:43.817990+0000","last_became_peered":"2024-09-12T00:43:43.817990+0000","last_unstale":"2024-09-12T01:37:38.842146+0000","last_undegraded":"2024-09-12T01:37:38.842146+0000","last_fullsized":"2024-09-12T01:37:38.842146+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:00.011210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14448,"num_write":16,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"266'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.103250+0000","last_change":"2024-09-12T00:43:38.795940+0000","last_active":"2024-09-12T01:37:19.103250+0000","last_peered":"2024-09-12T01:37:19.103250+0000","last_clean":"2024-09-12T01:37:19.103250+0000","last_became_active":"2024-09-12T00:43:38.793825+0000","last_became_peered":"2024-09-12T00:43:38.793825+0000","last_unstale":"2024-09-12T01:37:19.103250+0000","last_undegraded":"2024-09-12T01:37:19.103250+0000","last_fullsized":"2024-09-12T01:37:19.103250+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:24.205683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'20","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.535804+0000","last_change":"2024-09-12T00:39:17.770201+0000","last_active":"2024-09-12T01:35:19.535804+0000","last_peered":"2024-09-12T01:35:19.535804+0000","last_clean":"2024-09-12T01:35:19.535804+0000","last_became_active":"2024-09-12T00:39:17.769263+0000","last_became_peered":"2024-09-12T00:39:17.769263+0000","last_unstale":"2024-09-12T01:35:19.535804+0000","last_undegraded":"2024-09-12T01:35:19.535804+0000","last_fullsized":"2024-09-12T01:35:19.535804+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:15.097860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.165777+0000","last_change":"2024-09-12T01:02:03.924548+0000","last_active":"2024-09-12T01:33:29.165777+0000","last_peered":"2024-09-12T01:33:29.165777+0000","last_clean":"2024-09-12T01:33:29.165777+0000","last_became_active":"2024-09-12T01:02:03.924260+0000","last_became_peered":"2024-09-12T01:02:03.924260+0000","last_unstale":"2024-09-12T01:33:29.165777+0000","last_undegraded":"2024-09-12T01:33:29.165777+0000","last_fullsized":"2024-09-12T01:33:29.165777+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:07.250231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"266'3","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:24.023301+0000","last_change":"2024-09-12T00:43:43.824871+0000","last_active":"2024-09-12T01:37:24.023301+0000","last_peered":"2024-09-12T01:37:24.023301+0000","last_clean":"2024-09-12T01:37:24.023301+0000","last_became_active":"2024-09-12T00:43:43.824567+0000","last_became_peered":"2024-09-12T00:43:43.824567+0000","last_unstale":"2024-09-12T01:37:24.023301+0000","last_undegraded":"2024-09-12T01:37:24.023301+0000","last_fullsized":"2024-09-12T01:37:24.023301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:24.293339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"266'5","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.022626+0000","last_change":"2024-09-12T00:43:38.798453+0000","last_active":"2024-09-12T01:37:19.022626+0000","last_peered":"2024-09-12T01:37:19.022626+0000","last_clean":"2024-09-12T01:37:19.022626+0000","last_became_active":"2024-09-12T00:43:38.798200+0000","last_became_peered":"2024-09-12T00:43:38.798200+0000","last_unstale":"2024-09-12T01:37:19.022626+0000","last_undegraded":"2024-09-12T01:37:19.022626+0000","last_fullsized":"2024-09-12T01:37:19.022626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:27.881376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"266'30","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125273+0000","last_change":"2024-09-12T00:39:17.766861+0000","last_active":"2024-09-12T01:35:20.125273+0000","last_peered":"2024-09-12T01:35:20.125273+0000","last_clean":"2024-09-12T01:35:20.125273+0000","last_became_active":"2024-09-12T00:39:17.766600+0000","last_became_peered":"2024-09-12T00:39:17.766600+0000","last_unstale":"2024-09-12T01:35:20.125273+0000","last_undegraded":"2024-09-12T01:35:20.125273+0000","last_fullsized":"2024-09-12T01:35:20.125273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:07.049466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":112,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250307+0000","last_change":"2024-09-12T01:02:03.919723+0000","last_active":"2024-09-12T01:34:52.250307+0000","last_peered":"2024-09-12T01:34:52.250307+0000","last_clean":"2024-09-12T01:34:52.250307+0000","last_became_active":"2024-09-12T01:02:03.919377+0000","last_became_peered":"2024-09-12T01:02:03.919377+0000","last_unstale":"2024-09-12T01:34:52.250307+0000","last_undegraded":"2024-09-12T01:34:52.250307+0000","last_fullsized":"2024-09-12T01:34:52.250307+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:59.358385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123101+0000","last_change":"2024-09-12T00:43:43.818424+0000","last_active":"2024-09-12T01:35:05.123101+0000","last_peered":"2024-09-12T01:35:05.123101+0000","last_clean":"2024-09-12T01:35:05.123101+0000","last_became_active":"2024-09-12T00:43:43.818153+0000","last_became_peered":"2024-09-12T00:43:43.818153+0000","last_unstale":"2024-09-12T01:35:05.123101+0000","last_undegraded":"2024-09-12T01:35:05.123101+0000","last_fullsized":"2024-09-12T01:35:05.123101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.787318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'6","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.890420+0000","last_change":"2024-09-12T00:43:38.792429+0000","last_active":"2024-09-12T01:37:38.890420+0000","last_peered":"2024-09-12T01:37:38.890420+0000","last_clean":"2024-09-12T01:37:38.890420+0000","last_became_active":"2024-09-12T00:43:38.792135+0000","last_became_peered":"2024-09-12T00:43:38.792135+0000","last_unstale":"2024-09-12T01:37:38.890420+0000","last_undegraded":"2024-09-12T01:37:38.890420+0000","last_fullsized":"2024-09-12T01:37:38.890420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:11.570953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8232,"num_write":6,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"266'12","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.089651+0000","last_change":"2024-09-12T00:39:17.768309+0000","last_active":"2024-09-12T01:35:20.089651+0000","last_peered":"2024-09-12T01:35:20.089651+0000","last_clean":"2024-09-12T01:35:20.089651+0000","last_became_active":"2024-09-12T00:39:17.767599+0000","last_became_peered":"2024-09-12T00:39:17.767599+0000","last_unstale":"2024-09-12T01:35:20.089651+0000","last_undegraded":"2024-09-12T01:35:20.089651+0000","last_fullsized":"2024-09-12T01:35:20.089651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:18.635424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.165738+0000","last_change":"2024-09-12T01:02:03.918519+0000","last_active":"2024-09-12T01:33:29.165738+0000","last_peered":"2024-09-12T01:33:29.165738+0000","last_clean":"2024-09-12T01:33:29.165738+0000","last_became_active":"2024-09-12T01:02:03.918248+0000","last_became_peered":"2024-09-12T01:02:03.918248+0000","last_unstale":"2024-09-12T01:33:29.165738+0000","last_undegraded":"2024-09-12T01:33:29.165738+0000","last_fullsized":"2024-09-12T01:33:29.165738+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:15.650720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533744+0000","last_change":"2024-09-12T00:43:43.825033+0000","last_active":"2024-09-12T01:35:04.533744+0000","last_peered":"2024-09-12T01:35:04.533744+0000","last_clean":"2024-09-12T01:35:04.533744+0000","last_became_active":"2024-09-12T00:43:43.822993+0000","last_became_peered":"2024-09-12T00:43:43.822993+0000","last_unstale":"2024-09-12T01:35:04.533744+0000","last_undegraded":"2024-09-12T01:35:04.533744+0000","last_fullsized":"2024-09-12T01:35:04.533744+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.928486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:59.087781+0000","last_change":"2024-09-12T00:43:38.795993+0000","last_active":"2024-09-12T01:34:59.087781+0000","last_peered":"2024-09-12T01:34:59.087781+0000","last_clean":"2024-09-12T01:34:59.087781+0000","last_became_active":"2024-09-12T00:43:38.795625+0000","last_became_peered":"2024-09-12T00:43:38.795625+0000","last_unstale":"2024-09-12T01:34:59.087781+0000","last_undegraded":"2024-09-12T01:34:59.087781+0000","last_fullsized":"2024-09-12T01:34:59.087781+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:32.904211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'39","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125177+0000","last_change":"2024-09-12T00:39:17.761781+0000","last_active":"2024-09-12T01:35:20.125177+0000","last_peered":"2024-09-12T01:35:20.125177+0000","last_clean":"2024-09-12T01:35:20.125177+0000","last_became_active":"2024-09-12T00:39:17.761517+0000","last_became_peered":"2024-09-12T00:39:17.761517+0000","last_unstale":"2024-09-12T01:35:20.125177+0000","last_undegraded":"2024-09-12T01:35:20.125177+0000","last_fullsized":"2024-09-12T01:35:20.125177+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:36.401035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997821+0000","last_change":"2024-09-12T01:02:03.924588+0000","last_active":"2024-09-12T01:34:43.997821+0000","last_peered":"2024-09-12T01:34:43.997821+0000","last_clean":"2024-09-12T01:34:43.997821+0000","last_became_active":"2024-09-12T01:02:03.923808+0000","last_became_peered":"2024-09-12T01:02:03.923808+0000","last_unstale":"2024-09-12T01:34:43.997821+0000","last_undegraded":"2024-09-12T01:34:43.997821+0000","last_fullsized":"2024-09-12T01:34:43.997821+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:42.299573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'5","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:15.106685+0000","last_change":"2024-09-12T00:43:43.819522+0000","last_active":"2024-09-12T01:33:15.106685+0000","last_peered":"2024-09-12T01:33:15.106685+0000","last_clean":"2024-09-12T01:33:15.106685+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:33:15.106685+0000","last_undegraded":"2024-09-12T01:33:15.106685+0000","last_fullsized":"2024-09-12T01:33:15.106685+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:30.323747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'4","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.786735+0000","last_change":"2024-09-12T00:43:38.795759+0000","last_active":"2024-09-12T01:37:38.786735+0000","last_peered":"2024-09-12T01:37:38.786735+0000","last_clean":"2024-09-12T01:37:38.786735+0000","last_became_active":"2024-09-12T00:43:38.795451+0000","last_became_peered":"2024-09-12T00:43:38.795451+0000","last_unstale":"2024-09-12T01:37:38.786735+0000","last_undegraded":"2024-09-12T01:37:38.786735+0000","last_fullsized":"2024-09-12T01:37:38.786735+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:17.278286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'133","reported_seq":488,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:30.109250+0000","last_change":"2024-09-12T00:39:17.763176+0000","last_active":"2024-09-12T01:33:30.109250+0000","last_peered":"2024-09-12T01:33:30.109250+0000","last_clean":"2024-09-12T01:33:30.109250+0000","last_became_active":"2024-09-12T00:39:17.762649+0000","last_became_peered":"2024-09-12T00:39:17.762649+0000","last_unstale":"2024-09-12T01:33:30.109250+0000","last_undegraded":"2024-09-12T01:33:30.109250+0000","last_fullsized":"2024-09-12T01:33:30.109250+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:52.621341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":844,"num_read_kb":585,"num_write":185,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.078996+0000","last_change":"2024-09-12T01:02:03.925718+0000","last_active":"2024-09-12T01:33:34.078996+0000","last_peered":"2024-09-12T01:33:34.078996+0000","last_clean":"2024-09-12T01:33:34.078996+0000","last_became_active":"2024-09-12T01:02:03.924934+0000","last_became_peered":"2024-09-12T01:02:03.924934+0000","last_unstale":"2024-09-12T01:33:34.078996+0000","last_undegraded":"2024-09-12T01:33:34.078996+0000","last_fullsized":"2024-09-12T01:33:34.078996+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:26.933104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:15.106630+0000","last_change":"2024-09-12T00:43:43.822008+0000","last_active":"2024-09-12T01:33:15.106630+0000","last_peered":"2024-09-12T01:33:15.106630+0000","last_clean":"2024-09-12T01:33:15.106630+0000","last_became_active":"2024-09-12T00:43:43.821288+0000","last_became_peered":"2024-09-12T00:43:43.821288+0000","last_unstale":"2024-09-12T01:33:15.106630+0000","last_undegraded":"2024-09-12T01:33:15.106630+0000","last_fullsized":"2024-09-12T01:33:15.106630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:12.223424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.182657+0000","last_change":"2024-09-12T00:43:38.798047+0000","last_active":"2024-09-12T01:35:24.182657+0000","last_peered":"2024-09-12T01:35:24.182657+0000","last_clean":"2024-09-12T01:35:24.182657+0000","last_became_active":"2024-09-12T00:43:38.797782+0000","last_became_peered":"2024-09-12T00:43:38.797782+0000","last_unstale":"2024-09-12T01:35:24.182657+0000","last_undegraded":"2024-09-12T01:35:24.182657+0000","last_fullsized":"2024-09-12T01:35:24.182657+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:52.438462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'33","reported_seq":147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.521087+0000","last_change":"2024-09-12T00:39:17.769240+0000","last_active":"2024-09-12T01:33:19.521087+0000","last_peered":"2024-09-12T01:33:19.521087+0000","last_clean":"2024-09-12T01:33:19.521087+0000","last_became_active":"2024-09-12T00:39:17.768151+0000","last_became_peered":"2024-09-12T00:39:17.768151+0000","last_unstale":"2024-09-12T01:33:19.521087+0000","last_undegraded":"2024-09-12T01:33:19.521087+0000","last_fullsized":"2024-09-12T01:33:19.521087+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:44.421190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.530106+0000","last_change":"2024-09-12T01:02:03.922540+0000","last_active":"2024-09-12T01:34:34.530106+0000","last_peered":"2024-09-12T01:34:34.530106+0000","last_clean":"2024-09-12T01:34:34.530106+0000","last_became_active":"2024-09-12T01:02:03.921595+0000","last_became_peered":"2024-09-12T01:02:03.921595+0000","last_unstale":"2024-09-12T01:34:34.530106+0000","last_undegraded":"2024-09-12T01:34:34.530106+0000","last_fullsized":"2024-09-12T01:34:34.530106+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.523672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"266'9","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:40.128350+0000","last_change":"2024-09-12T00:43:43.820529+0000","last_active":"2024-09-12T01:35:40.128350+0000","last_peered":"2024-09-12T01:35:40.128350+0000","last_clean":"2024-09-12T01:35:40.128350+0000","last_became_active":"2024-09-12T00:43:43.819990+0000","last_became_peered":"2024-09-12T00:43:43.819990+0000","last_unstale":"2024-09-12T01:35:40.128350+0000","last_undegraded":"2024-09-12T01:35:40.128350+0000","last_fullsized":"2024-09-12T01:35:40.128350+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:58.280401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8217,"num_write":14,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.750005+0000","last_change":"2024-09-12T00:43:38.798676+0000","last_active":"2024-09-12T01:37:38.750005+0000","last_peered":"2024-09-12T01:37:38.750005+0000","last_clean":"2024-09-12T01:37:38.750005+0000","last_became_active":"2024-09-12T00:43:38.798374+0000","last_became_peered":"2024-09-12T00:43:38.798374+0000","last_unstale":"2024-09-12T01:37:38.750005+0000","last_undegraded":"2024-09-12T01:37:38.750005+0000","last_fullsized":"2024-09-12T01:37:38.750005+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:29.029265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":166,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.077519+0000","last_change":"2024-09-12T00:39:17.758205+0000","last_active":"2024-09-12T01:33:19.077519+0000","last_peered":"2024-09-12T01:33:19.077519+0000","last_clean":"2024-09-12T01:33:19.077519+0000","last_became_active":"2024-09-12T00:39:17.757795+0000","last_became_peered":"2024-09-12T00:39:17.757795+0000","last_unstale":"2024-09-12T01:33:19.077519+0000","last_undegraded":"2024-09-12T01:33:19.077519+0000","last_fullsized":"2024-09-12T01:33:19.077519+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:32.214592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.085182+0000","last_change":"2024-09-12T01:02:03.924136+0000","last_active":"2024-09-12T01:34:34.085182+0000","last_peered":"2024-09-12T01:34:34.085182+0000","last_clean":"2024-09-12T01:34:34.085182+0000","last_became_active":"2024-09-12T01:02:03.923774+0000","last_became_peered":"2024-09-12T01:02:03.923774+0000","last_unstale":"2024-09-12T01:34:34.085182+0000","last_undegraded":"2024-09-12T01:34:34.085182+0000","last_fullsized":"2024-09-12T01:34:34.085182+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:13.881070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.741914+0000","last_change":"2024-09-12T00:43:43.820925+0000","last_active":"2024-09-12T01:37:38.741914+0000","last_peered":"2024-09-12T01:37:38.741914+0000","last_clean":"2024-09-12T01:37:38.741914+0000","last_became_active":"2024-09-12T00:43:43.819044+0000","last_became_peered":"2024-09-12T00:43:43.819044+0000","last_unstale":"2024-09-12T01:37:38.741914+0000","last_undegraded":"2024-09-12T01:37:38.741914+0000","last_fullsized":"2024-09-12T01:37:38.741914+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:51.315359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6160,"num_write":14,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:20.107587+0000","last_change":"2024-09-12T00:43:38.797698+0000","last_active":"2024-09-12T01:33:20.107587+0000","last_peered":"2024-09-12T01:33:20.107587+0000","last_clean":"2024-09-12T01:33:20.107587+0000","last_became_active":"2024-09-12T00:43:38.797343+0000","last_became_peered":"2024-09-12T00:43:38.797343+0000","last_unstale":"2024-09-12T01:33:20.107587+0000","last_undegraded":"2024-09-12T01:33:20.107587+0000","last_fullsized":"2024-09-12T01:33:20.107587+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:07.327017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'33","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.164334+0000","last_change":"2024-09-12T00:39:17.760056+0000","last_active":"2024-09-12T01:33:19.164334+0000","last_peered":"2024-09-12T01:33:19.164334+0000","last_clean":"2024-09-12T01:33:19.164334+0000","last_became_active":"2024-09-12T00:39:17.759701+0000","last_became_peered":"2024-09-12T00:39:17.759701+0000","last_unstale":"2024-09-12T01:33:19.164334+0000","last_undegraded":"2024-09-12T01:33:19.164334+0000","last_fullsized":"2024-09-12T01:33:19.164334+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:36.105302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":64,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:33.986537+0000","last_change":"2024-09-12T01:02:03.923765+0000","last_active":"2024-09-12T01:33:33.986537+0000","last_peered":"2024-09-12T01:33:33.986537+0000","last_clean":"2024-09-12T01:33:33.986537+0000","last_became_active":"2024-09-12T01:02:03.923440+0000","last_became_peered":"2024-09-12T01:02:03.923440+0000","last_unstale":"2024-09-12T01:33:33.986537+0000","last_undegraded":"2024-09-12T01:33:33.986537+0000","last_fullsized":"2024-09-12T01:33:33.986537+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:46.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'5","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.538821+0000","last_change":"2024-09-12T00:43:43.819656+0000","last_active":"2024-09-12T01:35:44.538821+0000","last_peered":"2024-09-12T01:35:44.538821+0000","last_clean":"2024-09-12T01:35:44.538821+0000","last_became_active":"2024-09-12T00:43:43.819247+0000","last_became_peered":"2024-09-12T00:43:43.819247+0000","last_unstale":"2024-09-12T01:35:44.538821+0000","last_undegraded":"2024-09-12T01:35:44.538821+0000","last_fullsized":"2024-09-12T01:35:44.538821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:00.847535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"266'5","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:40.128225+0000","last_change":"2024-09-12T00:43:38.794688+0000","last_active":"2024-09-12T01:35:40.128225+0000","last_peered":"2024-09-12T01:35:40.128225+0000","last_clean":"2024-09-12T01:35:40.128225+0000","last_became_active":"2024-09-12T00:43:38.794286+0000","last_became_peered":"2024-09-12T00:43:38.794286+0000","last_unstale":"2024-09-12T01:35:40.128225+0000","last_undegraded":"2024-09-12T01:35:40.128225+0000","last_fullsized":"2024-09-12T01:35:40.128225+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:52.618143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'28","reported_seq":129,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.164290+0000","last_change":"2024-09-12T00:39:17.762387+0000","last_active":"2024-09-12T01:33:19.164290+0000","last_peered":"2024-09-12T01:33:19.164290+0000","last_clean":"2024-09-12T01:33:19.164290+0000","last_became_active":"2024-09-12T00:39:17.761738+0000","last_became_peered":"2024-09-12T00:39:17.761738+0000","last_unstale":"2024-09-12T01:33:19.164290+0000","last_undegraded":"2024-09-12T01:33:19.164290+0000","last_fullsized":"2024-09-12T01:33:19.164290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:49.875350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":96,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.079050+0000","last_change":"2024-09-12T01:02:03.928768+0000","last_active":"2024-09-12T01:33:40.079050+0000","last_peered":"2024-09-12T01:33:40.079050+0000","last_clean":"2024-09-12T01:33:40.079050+0000","last_became_active":"2024-09-12T01:02:03.928475+0000","last_became_peered":"2024-09-12T01:02:03.928475+0000","last_unstale":"2024-09-12T01:33:40.079050+0000","last_undegraded":"2024-09-12T01:33:40.079050+0000","last_fullsized":"2024-09-12T01:33:40.079050+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:39.969871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'2","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:35.078402+0000","last_change":"2024-09-12T00:43:43.821438+0000","last_active":"2024-09-12T01:33:35.078402+0000","last_peered":"2024-09-12T01:33:35.078402+0000","last_clean":"2024-09-12T01:33:35.078402+0000","last_became_active":"2024-09-12T00:43:43.821149+0000","last_became_peered":"2024-09-12T00:43:43.821149+0000","last_unstale":"2024-09-12T01:33:35.078402+0000","last_undegraded":"2024-09-12T01:33:35.078402+0000","last_fullsized":"2024-09-12T01:33:35.078402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:02.729782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'9","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.627920+0000","last_change":"2024-09-12T00:43:38.799268+0000","last_active":"2024-09-12T01:37:38.627920+0000","last_peered":"2024-09-12T01:37:38.627920+0000","last_clean":"2024-09-12T01:37:38.627920+0000","last_became_active":"2024-09-12T00:43:38.798510+0000","last_became_peered":"2024-09-12T00:43:38.798510+0000","last_unstale":"2024-09-12T01:37:38.627920+0000","last_undegraded":"2024-09-12T01:37:38.627920+0000","last_fullsized":"2024-09-12T01:37:38.627920+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:19.360861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16416,"num_write":14,"num_write_kb":12320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'28","reported_seq":135,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.078974+0000","last_change":"2024-09-12T00:39:17.771090+0000","last_active":"2024-09-12T01:33:40.078974+0000","last_peered":"2024-09-12T01:33:40.078974+0000","last_clean":"2024-09-12T01:33:40.078974+0000","last_became_active":"2024-09-12T00:39:17.770779+0000","last_became_peered":"2024-09-12T00:39:17.770779+0000","last_unstale":"2024-09-12T01:33:40.078974+0000","last_undegraded":"2024-09-12T01:33:40.078974+0000","last_fullsized":"2024-09-12T01:33:40.078974+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:45.806957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.971578+0000","last_change":"2024-09-12T01:02:03.925931+0000","last_active":"2024-09-12T01:33:34.971578+0000","last_peered":"2024-09-12T01:33:34.971578+0000","last_clean":"2024-09-12T01:33:34.971578+0000","last_became_active":"2024-09-12T01:02:03.925618+0000","last_became_peered":"2024-09-12T01:02:03.925618+0000","last_unstale":"2024-09-12T01:33:34.971578+0000","last_undegraded":"2024-09-12T01:33:34.971578+0000","last_fullsized":"2024-09-12T01:33:34.971578+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:46.274807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"266'5","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.652986+0000","last_change":"2024-09-12T00:43:43.825678+0000","last_active":"2024-09-12T01:37:38.652986+0000","last_peered":"2024-09-12T01:37:38.652986+0000","last_clean":"2024-09-12T01:37:38.652986+0000","last_became_active":"2024-09-12T00:43:43.825380+0000","last_became_peered":"2024-09-12T00:43:43.825380+0000","last_unstale":"2024-09-12T01:37:38.652986+0000","last_undegraded":"2024-09-12T01:37:38.652986+0000","last_fullsized":"2024-09-12T01:37:38.652986+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:38.026807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8232,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.110471+0000","last_change":"2024-09-12T00:43:38.791841+0000","last_active":"2024-09-12T01:33:40.110471+0000","last_peered":"2024-09-12T01:33:40.110471+0000","last_clean":"2024-09-12T01:33:40.110471+0000","last_became_active":"2024-09-12T00:43:38.791586+0000","last_became_peered":"2024-09-12T00:43:38.791586+0000","last_unstale":"2024-09-12T01:33:40.110471+0000","last_undegraded":"2024-09-12T01:33:40.110471+0000","last_fullsized":"2024-09-12T01:33:40.110471+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:32.346959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'54","reported_seq":205,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:28.985589+0000","last_change":"2024-09-12T00:39:17.762695+0000","last_active":"2024-09-12T01:33:28.985589+0000","last_peered":"2024-09-12T01:33:28.985589+0000","last_clean":"2024-09-12T01:33:28.985589+0000","last_became_active":"2024-09-12T00:39:17.762435+0000","last_became_peered":"2024-09-12T00:39:17.762435+0000","last_unstale":"2024-09-12T01:33:28.985589+0000","last_undegraded":"2024-09-12T01:33:28.985589+0000","last_fullsized":"2024-09-12T01:33:28.985589+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:26.720224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":202,"num_write":91,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:35.109860+0000","last_change":"2024-09-12T01:02:03.926151+0000","last_active":"2024-09-12T01:33:35.109860+0000","last_peered":"2024-09-12T01:33:35.109860+0000","last_clean":"2024-09-12T01:33:35.109860+0000","last_became_active":"2024-09-12T01:02:03.925866+0000","last_became_peered":"2024-09-12T01:02:03.925866+0000","last_unstale":"2024-09-12T01:33:35.109860+0000","last_undegraded":"2024-09-12T01:33:35.109860+0000","last_fullsized":"2024-09-12T01:33:35.109860+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:41.925257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'3","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:54.986356+0000","last_change":"2024-09-12T00:43:43.820437+0000","last_active":"2024-09-12T01:35:54.986356+0000","last_peered":"2024-09-12T01:35:54.986356+0000","last_clean":"2024-09-12T01:35:54.986356+0000","last_became_active":"2024-09-12T00:43:43.820153+0000","last_became_peered":"2024-09-12T00:43:43.820153+0000","last_unstale":"2024-09-12T01:35:54.986356+0000","last_undegraded":"2024-09-12T01:35:54.986356+0000","last_fullsized":"2024-09-12T01:35:54.986356+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:49.421817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'3","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.628485+0000","last_change":"2024-09-12T00:43:38.790234+0000","last_active":"2024-09-12T01:37:38.628485+0000","last_peered":"2024-09-12T01:37:38.628485+0000","last_clean":"2024-09-12T01:37:38.628485+0000","last_became_active":"2024-09-12T00:43:38.789945+0000","last_became_peered":"2024-09-12T00:43:38.789945+0000","last_unstale":"2024-09-12T01:37:38.628485+0000","last_undegraded":"2024-09-12T01:37:38.628485+0000","last_fullsized":"2024-09-12T01:37:38.628485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.330002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'34","reported_seq":150,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.970915+0000","last_change":"2024-09-12T00:39:17.760033+0000","last_active":"2024-09-12T01:33:29.970915+0000","last_peered":"2024-09-12T01:33:29.970915+0000","last_clean":"2024-09-12T01:33:29.970915+0000","last_became_active":"2024-09-12T00:39:17.759741+0000","last_became_peered":"2024-09-12T00:39:17.759741+0000","last_unstale":"2024-09-12T01:33:29.970915+0000","last_undegraded":"2024-09-12T01:33:29.970915+0000","last_fullsized":"2024-09-12T01:33:29.970915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:16.079518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.983140+0000","last_change":"2024-09-12T01:02:03.919303+0000","last_active":"2024-09-12T01:35:24.983140+0000","last_peered":"2024-09-12T01:35:24.983140+0000","last_clean":"2024-09-12T01:35:24.983140+0000","last_became_active":"2024-09-12T01:02:03.918998+0000","last_became_peered":"2024-09-12T01:02:03.918998+0000","last_unstale":"2024-09-12T01:35:24.983140+0000","last_undegraded":"2024-09-12T01:35:24.983140+0000","last_fullsized":"2024-09-12T01:35:24.983140+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:39.378429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:53.989633+0000","last_change":"2024-09-12T00:43:43.822054+0000","last_active":"2024-09-12T01:33:53.989633+0000","last_peered":"2024-09-12T01:33:53.989633+0000","last_clean":"2024-09-12T01:33:53.989633+0000","last_became_active":"2024-09-12T00:43:43.821691+0000","last_became_peered":"2024-09-12T00:43:43.821691+0000","last_unstale":"2024-09-12T01:33:53.989633+0000","last_undegraded":"2024-09-12T01:33:53.989633+0000","last_fullsized":"2024-09-12T01:33:53.989633+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:18.745231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523665+0000","last_change":"2024-09-12T00:43:38.798045+0000","last_active":"2024-09-12T01:33:39.523665+0000","last_peered":"2024-09-12T01:33:39.523665+0000","last_clean":"2024-09-12T01:33:39.523665+0000","last_became_active":"2024-09-12T00:43:38.797711+0000","last_became_peered":"2024-09-12T00:43:38.797711+0000","last_unstale":"2024-09-12T01:33:39.523665+0000","last_undegraded":"2024-09-12T01:33:39.523665+0000","last_fullsized":"2024-09-12T01:33:39.523665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:56.223002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'32","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:27.237937+0000","last_change":"2024-09-12T00:39:17.761142+0000","last_active":"2024-09-12T01:33:27.237937+0000","last_peered":"2024-09-12T01:33:27.237937+0000","last_clean":"2024-09-12T01:33:27.237937+0000","last_became_active":"2024-09-12T00:39:17.760839+0000","last_became_peered":"2024-09-12T00:39:17.760839+0000","last_unstale":"2024-09-12T01:33:27.237937+0000","last_undegraded":"2024-09-12T01:33:27.237937+0000","last_fullsized":"2024-09-12T01:33:27.237937+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:10.465344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.983164+0000","last_change":"2024-09-12T01:02:03.920002+0000","last_active":"2024-09-12T01:35:24.983164+0000","last_peered":"2024-09-12T01:35:24.983164+0000","last_clean":"2024-09-12T01:35:24.983164+0000","last_became_active":"2024-09-12T01:02:03.919706+0000","last_became_peered":"2024-09-12T01:02:03.919706+0000","last_unstale":"2024-09-12T01:35:24.983164+0000","last_undegraded":"2024-09-12T01:35:24.983164+0000","last_fullsized":"2024-09-12T01:35:24.983164+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:03.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.008824+0000","last_change":"2024-09-12T00:43:43.818598+0000","last_active":"2024-09-12T01:35:49.008824+0000","last_peered":"2024-09-12T01:35:49.008824+0000","last_clean":"2024-09-12T01:35:49.008824+0000","last_became_active":"2024-09-12T00:43:43.818321+0000","last_became_peered":"2024-09-12T00:43:43.818321+0000","last_unstale":"2024-09-12T01:35:49.008824+0000","last_undegraded":"2024-09-12T01:35:49.008824+0000","last_fullsized":"2024-09-12T01:35:49.008824+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:55.640954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":96,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'3","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.241650+0000","last_change":"2024-09-12T00:43:38.792440+0000","last_active":"2024-09-12T01:33:52.241650+0000","last_peered":"2024-09-12T01:33:52.241650+0000","last_clean":"2024-09-12T01:33:52.241650+0000","last_became_active":"2024-09-12T00:43:38.792154+0000","last_became_peered":"2024-09-12T00:43:38.792154+0000","last_unstale":"2024-09-12T01:33:52.241650+0000","last_undegraded":"2024-09-12T01:33:52.241650+0000","last_fullsized":"2024-09-12T01:33:52.241650+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:59.352763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1034,"num_write":3,"num_write_kb":1034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"266'40","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.522358+0000","last_change":"2024-09-12T00:39:17.770041+0000","last_active":"2024-09-12T01:33:29.522358+0000","last_peered":"2024-09-12T01:33:29.522358+0000","last_clean":"2024-09-12T01:33:29.522358+0000","last_became_active":"2024-09-12T00:39:17.767962+0000","last_became_peered":"2024-09-12T00:39:17.767962+0000","last_unstale":"2024-09-12T01:33:29.522358+0000","last_undegraded":"2024-09-12T01:33:29.522358+0000","last_fullsized":"2024-09-12T01:33:29.522358+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:38.083643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":136,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:13.992744+0000","last_change":"2024-09-12T01:02:03.922136+0000","last_active":"2024-09-12T01:34:13.992744+0000","last_peered":"2024-09-12T01:34:13.992744+0000","last_clean":"2024-09-12T01:34:13.992744+0000","last_became_active":"2024-09-12T01:02:03.918216+0000","last_became_peered":"2024-09-12T01:02:03.918216+0000","last_unstale":"2024-09-12T01:34:13.992744+0000","last_undegraded":"2024-09-12T01:34:13.992744+0000","last_fullsized":"2024-09-12T01:34:13.992744+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:26.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'10","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.985350+0000","last_change":"2024-09-12T00:43:43.820490+0000","last_active":"2024-09-12T01:35:44.985350+0000","last_peered":"2024-09-12T01:35:44.985350+0000","last_clean":"2024-09-12T01:35:44.985350+0000","last_became_active":"2024-09-12T00:43:43.820194+0000","last_became_peered":"2024-09-12T00:43:43.820194+0000","last_unstale":"2024-09-12T01:35:44.985350+0000","last_undegraded":"2024-09-12T01:35:44.985350+0000","last_fullsized":"2024-09-12T01:35:44.985350+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:54.662468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"266'10","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.750798+0000","last_change":"2024-09-12T00:43:38.797923+0000","last_active":"2024-09-12T01:37:38.750798+0000","last_peered":"2024-09-12T01:37:38.750798+0000","last_clean":"2024-09-12T01:37:38.750798+0000","last_became_active":"2024-09-12T00:43:38.797428+0000","last_became_peered":"2024-09-12T00:43:38.797428+0000","last_unstale":"2024-09-12T01:37:38.750798+0000","last_undegraded":"2024-09-12T01:37:38.750798+0000","last_fullsized":"2024-09-12T01:37:38.750798+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:07.995028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12282,"num_write":20,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'85","reported_seq":370,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.079026+0000","last_change":"2024-09-12T00:39:17.767845+0000","last_active":"2024-09-12T01:33:40.079026+0000","last_peered":"2024-09-12T01:33:40.079026+0000","last_clean":"2024-09-12T01:33:40.079026+0000","last_became_active":"2024-09-12T00:39:17.767517+0000","last_became_peered":"2024-09-12T00:39:17.767517+0000","last_unstale":"2024-09-12T01:33:40.079026+0000","last_undegraded":"2024-09-12T01:33:40.079026+0000","last_fullsized":"2024-09-12T01:33:40.079026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:44.733701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":615,"num_read_kb":395,"num_write":114,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536407+0000","last_change":"2024-09-12T01:02:03.922775+0000","last_active":"2024-09-12T01:35:24.536407+0000","last_peered":"2024-09-12T01:35:24.536407+0000","last_clean":"2024-09-12T01:35:24.536407+0000","last_became_active":"2024-09-12T01:02:03.922479+0000","last_became_peered":"2024-09-12T01:02:03.922479+0000","last_unstale":"2024-09-12T01:35:24.536407+0000","last_undegraded":"2024-09-12T01:35:24.536407+0000","last_fullsized":"2024-09-12T01:35:24.536407+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.011531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"263'4","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.523080+0000","last_change":"2024-09-12T00:43:43.821630+0000","last_active":"2024-09-12T01:33:34.523080+0000","last_peered":"2024-09-12T01:33:34.523080+0000","last_clean":"2024-09-12T01:33:34.523080+0000","last_became_active":"2024-09-12T00:43:43.821303+0000","last_became_peered":"2024-09-12T00:43:43.821303+0000","last_unstale":"2024-09-12T01:33:34.523080+0000","last_undegraded":"2024-09-12T01:33:34.523080+0000","last_fullsized":"2024-09-12T01:33:34.523080+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:56.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16370,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.538301+0000","last_change":"2024-09-12T00:43:38.800008+0000","last_active":"2024-09-12T01:35:39.538301+0000","last_peered":"2024-09-12T01:35:39.538301+0000","last_clean":"2024-09-12T01:35:39.538301+0000","last_became_active":"2024-09-12T00:43:38.799623+0000","last_became_peered":"2024-09-12T00:43:38.799623+0000","last_unstale":"2024-09-12T01:35:39.538301+0000","last_undegraded":"2024-09-12T01:35:39.538301+0000","last_fullsized":"2024-09-12T01:35:39.538301+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:26.934976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'30","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:35.127450+0000","last_change":"2024-09-12T00:39:17.768450+0000","last_active":"2024-09-12T01:35:35.127450+0000","last_peered":"2024-09-12T01:35:35.127450+0000","last_clean":"2024-09-12T01:35:35.127450+0000","last_became_active":"2024-09-12T00:39:17.768143+0000","last_became_peered":"2024-09-12T00:39:17.768143+0000","last_unstale":"2024-09-12T01:35:35.127450+0000","last_undegraded":"2024-09-12T01:35:35.127450+0000","last_fullsized":"2024-09-12T01:35:35.127450+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:16.633147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":109,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.118947+0000","last_change":"2024-09-12T01:02:03.927047+0000","last_active":"2024-09-12T01:34:35.118947+0000","last_peered":"2024-09-12T01:34:35.118947+0000","last_clean":"2024-09-12T01:34:35.118947+0000","last_became_active":"2024-09-12T01:02:03.926699+0000","last_became_peered":"2024-09-12T01:02:03.926699+0000","last_unstale":"2024-09-12T01:34:35.118947+0000","last_undegraded":"2024-09-12T01:34:35.118947+0000","last_fullsized":"2024-09-12T01:34:35.118947+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:16.113729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'6","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.240897+0000","last_change":"2024-09-12T00:43:43.819559+0000","last_active":"2024-09-12T01:33:47.240897+0000","last_peered":"2024-09-12T01:33:47.240897+0000","last_clean":"2024-09-12T01:33:47.240897+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:33:47.240897+0000","last_undegraded":"2024-09-12T01:33:47.240897+0000","last_fullsized":"2024-09-12T01:33:47.240897+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:15.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24570,"num_write":11,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:50.080070+0000","last_change":"2024-09-12T00:43:38.798764+0000","last_active":"2024-09-12T01:33:50.080070+0000","last_peered":"2024-09-12T01:33:50.080070+0000","last_clean":"2024-09-12T01:33:50.080070+0000","last_became_active":"2024-09-12T00:43:38.798431+0000","last_became_peered":"2024-09-12T00:43:38.798431+0000","last_unstale":"2024-09-12T01:33:50.080070+0000","last_undegraded":"2024-09-12T01:33:50.080070+0000","last_fullsized":"2024-09-12T01:33:50.080070+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:19.004021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:35.091204+0000","last_change":"2024-09-12T00:39:17.769932+0000","last_active":"2024-09-12T01:35:35.091204+0000","last_peered":"2024-09-12T01:35:35.091204+0000","last_clean":"2024-09-12T01:35:35.091204+0000","last_became_active":"2024-09-12T00:39:17.768901+0000","last_became_peered":"2024-09-12T00:39:17.768901+0000","last_unstale":"2024-09-12T01:35:35.091204+0000","last_undegraded":"2024-09-12T01:35:35.091204+0000","last_fullsized":"2024-09-12T01:35:35.091204+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:49.443724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.248104+0000","last_change":"2024-09-12T01:02:03.922843+0000","last_active":"2024-09-12T01:34:37.248104+0000","last_peered":"2024-09-12T01:34:37.248104+0000","last_clean":"2024-09-12T01:34:37.248104+0000","last_became_active":"2024-09-12T01:02:03.922500+0000","last_became_peered":"2024-09-12T01:02:03.922500+0000","last_unstale":"2024-09-12T01:34:37.248104+0000","last_undegraded":"2024-09-12T01:34:37.248104+0000","last_fullsized":"2024-09-12T01:34:37.248104+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:26.949487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.524780+0000","last_change":"2024-09-12T00:43:43.824719+0000","last_active":"2024-09-12T01:33:49.524780+0000","last_peered":"2024-09-12T01:33:49.524780+0000","last_clean":"2024-09-12T01:33:49.524780+0000","last_became_active":"2024-09-12T00:43:43.823554+0000","last_became_peered":"2024-09-12T00:43:43.823554+0000","last_unstale":"2024-09-12T01:33:49.524780+0000","last_undegraded":"2024-09-12T01:33:49.524780+0000","last_fullsized":"2024-09-12T01:33:49.524780+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:47.954677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523603+0000","last_change":"2024-09-12T00:43:38.798395+0000","last_active":"2024-09-12T01:33:39.523603+0000","last_peered":"2024-09-12T01:33:39.523603+0000","last_clean":"2024-09-12T01:33:39.523603+0000","last_became_active":"2024-09-12T00:43:38.798117+0000","last_became_peered":"2024-09-12T00:43:38.798117+0000","last_unstale":"2024-09-12T01:33:39.523603+0000","last_undegraded":"2024-09-12T01:33:39.523603+0000","last_fullsized":"2024-09-12T01:33:39.523603+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:43.142516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'16","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537633+0000","last_change":"2024-09-12T00:39:17.768795+0000","last_active":"2024-09-12T01:35:34.537633+0000","last_peered":"2024-09-12T01:35:34.537633+0000","last_clean":"2024-09-12T01:35:34.537633+0000","last_became_active":"2024-09-12T00:39:17.768503+0000","last_became_peered":"2024-09-12T00:39:17.768503+0000","last_unstale":"2024-09-12T01:35:34.537633+0000","last_undegraded":"2024-09-12T01:35:34.537633+0000","last_fullsized":"2024-09-12T01:35:34.537633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:49.617037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.004612+0000","last_change":"2024-09-12T01:02:03.928738+0000","last_active":"2024-09-12T01:35:24.004612+0000","last_peered":"2024-09-12T01:35:24.004612+0000","last_clean":"2024-09-12T01:35:24.004612+0000","last_became_active":"2024-09-12T01:02:03.928430+0000","last_became_peered":"2024-09-12T01:02:03.928430+0000","last_unstale":"2024-09-12T01:35:24.004612+0000","last_undegraded":"2024-09-12T01:35:24.004612+0000","last_fullsized":"2024-09-12T01:35:24.004612+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:55.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079580+0000","last_change":"2024-09-12T00:43:43.823435+0000","last_active":"2024-09-12T01:33:45.079580+0000","last_peered":"2024-09-12T01:33:45.079580+0000","last_clean":"2024-09-12T01:33:45.079580+0000","last_became_active":"2024-09-12T00:43:43.822996+0000","last_became_peered":"2024-09-12T00:43:43.822996+0000","last_unstale":"2024-09-12T01:33:45.079580+0000","last_undegraded":"2024-09-12T01:33:45.079580+0000","last_fullsized":"2024-09-12T01:33:45.079580+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:25.064321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'2","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.167242+0000","last_change":"2024-09-12T00:43:38.797634+0000","last_active":"2024-09-12T01:33:39.167242+0000","last_peered":"2024-09-12T01:33:39.167242+0000","last_clean":"2024-09-12T01:33:39.167242+0000","last_became_active":"2024-09-12T00:43:38.797367+0000","last_became_peered":"2024-09-12T00:43:38.797367+0000","last_unstale":"2024-09-12T01:33:39.167242+0000","last_undegraded":"2024-09-12T01:33:39.167242+0000","last_fullsized":"2024-09-12T01:33:39.167242+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.679006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'9","reported_seq":83,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537587+0000","last_change":"2024-09-12T00:39:17.759644+0000","last_active":"2024-09-12T01:35:34.537587+0000","last_peered":"2024-09-12T01:35:34.537587+0000","last_clean":"2024-09-12T01:35:34.537587+0000","last_became_active":"2024-09-12T00:39:17.759327+0000","last_became_peered":"2024-09-12T00:39:17.759327+0000","last_unstale":"2024-09-12T01:35:34.537587+0000","last_undegraded":"2024-09-12T01:35:34.537587+0000","last_fullsized":"2024-09-12T01:35:34.537587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:23.808909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":31,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536493+0000","last_change":"2024-09-12T01:02:03.925373+0000","last_active":"2024-09-12T01:35:24.536493+0000","last_peered":"2024-09-12T01:35:24.536493+0000","last_clean":"2024-09-12T01:35:24.536493+0000","last_became_active":"2024-09-12T01:02:03.925081+0000","last_became_peered":"2024-09-12T01:02:03.925081+0000","last_unstale":"2024-09-12T01:35:24.536493+0000","last_undegraded":"2024-09-12T01:35:24.536493+0000","last_fullsized":"2024-09-12T01:35:24.536493+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:09.007940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'4","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.092766+0000","last_change":"2024-09-12T00:43:43.822771+0000","last_active":"2024-09-12T01:35:50.092766+0000","last_peered":"2024-09-12T01:35:50.092766+0000","last_clean":"2024-09-12T01:35:50.092766+0000","last_became_active":"2024-09-12T00:43:43.822237+0000","last_became_peered":"2024-09-12T00:43:43.822237+0000","last_unstale":"2024-09-12T01:35:50.092766+0000","last_undegraded":"2024-09-12T01:35:50.092766+0000","last_fullsized":"2024-09-12T01:35:50.092766+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:25.025447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'6","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.749584+0000","last_change":"2024-09-12T00:43:38.794264+0000","last_active":"2024-09-12T01:37:38.749584+0000","last_peered":"2024-09-12T01:37:38.749584+0000","last_clean":"2024-09-12T01:37:38.749584+0000","last_became_active":"2024-09-12T00:43:38.793943+0000","last_became_peered":"2024-09-12T00:43:38.793943+0000","last_unstale":"2024-09-12T01:37:38.749584+0000","last_undegraded":"2024-09-12T01:37:38.749584+0000","last_fullsized":"2024-09-12T01:37:38.749584+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:15.467403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11272,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"266'26","reported_seq":130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:30.090680+0000","last_change":"2024-09-12T00:39:17.770362+0000","last_active":"2024-09-12T01:35:30.090680+0000","last_peered":"2024-09-12T01:35:30.090680+0000","last_clean":"2024-09-12T01:35:30.090680+0000","last_became_active":"2024-09-12T00:39:17.770093+0000","last_became_peered":"2024-09-12T00:39:17.770093+0000","last_unstale":"2024-09-12T01:35:30.090680+0000","last_undegraded":"2024-09-12T01:35:30.090680+0000","last_fullsized":"2024-09-12T01:35:30.090680+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:56.241617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'194","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.691922+0000","last_change":"2024-09-12T00:25:00.480152+0000","last_active":"2024-09-12T01:37:38.691922+0000","last_peered":"2024-09-12T01:37:38.691922+0000","last_clean":"2024-09-12T01:37:38.691922+0000","last_became_active":"2024-09-12T00:25:00.479764+0000","last_became_peered":"2024-09-12T00:25:00.479764+0000","last_unstale":"2024-09-12T01:37:38.691922+0000","last_undegraded":"2024-09-12T01:37:38.691922+0000","last_fullsized":"2024-09-12T01:37:38.691922+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:56.463852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":6490,"num_write":862,"num_write_kb":17717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'383","reported_seq":1929,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194930+0000","last_change":"2024-09-12T00:25:02.474787+0000","last_active":"2024-09-12T01:36:11.194930+0000","last_peered":"2024-09-12T01:36:11.194930+0000","last_clean":"2024-09-12T01:36:11.194930+0000","last_became_active":"2024-09-12T00:25:02.474473+0000","last_became_peered":"2024-09-12T00:25:02.474473+0000","last_unstale":"2024-09-12T01:36:11.194930+0000","last_undegraded":"2024-09-12T01:36:11.194930+0000","last_fullsized":"2024-09-12T01:36:11.194930+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.534016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2167,"num_read_kb":2073,"num_write":418,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'235","reported_seq":975,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.882587+0000","last_change":"2024-09-12T00:25:00.469978+0000","last_active":"2024-09-12T01:37:38.882587+0000","last_peered":"2024-09-12T01:37:38.882587+0000","last_clean":"2024-09-12T01:37:38.882587+0000","last_became_active":"2024-09-12T00:25:00.469588+0000","last_became_peered":"2024-09-12T00:25:00.469588+0000","last_unstale":"2024-09-12T01:37:38.882587+0000","last_undegraded":"2024-09-12T01:37:38.882587+0000","last_fullsized":"2024-09-12T01:37:38.882587+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.105712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038976,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":700,"num_read_kb":64068,"num_write":1104,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'889","reported_seq":2575,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491254+0000","last_change":"2024-09-12T00:25:02.476425+0000","last_active":"2024-09-12T01:35:23.491254+0000","last_peered":"2024-09-12T01:35:23.491254+0000","last_clean":"2024-09-12T01:35:23.491254+0000","last_became_active":"2024-09-12T00:25:02.476131+0000","last_became_peered":"2024-09-12T00:25:02.476131+0000","last_unstale":"2024-09-12T01:35:23.491254+0000","last_undegraded":"2024-09-12T01:35:23.491254+0000","last_fullsized":"2024-09-12T01:35:23.491254+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:34.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4103,"num_read_kb":3695,"num_write":1128,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'210","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.856883+0000","last_change":"2024-09-12T00:25:00.458464+0000","last_active":"2024-09-12T01:37:38.856883+0000","last_peered":"2024-09-12T01:37:38.856883+0000","last_clean":"2024-09-12T01:37:38.856883+0000","last_became_active":"2024-09-12T00:25:00.458072+0000","last_became_peered":"2024-09-12T00:25:00.458072+0000","last_unstale":"2024-09-12T01:37:38.856883+0000","last_undegraded":"2024-09-12T01:37:38.856883+0000","last_fullsized":"2024-09-12T01:37:38.856883+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:23.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":12854,"num_write":984,"num_write_kb":25223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1325","reported_seq":2879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338584+0000","last_change":"2024-09-12T00:25:02.470846+0000","last_active":"2024-09-12T01:36:12.338584+0000","last_peered":"2024-09-12T01:36:12.338584+0000","last_clean":"2024-09-12T01:36:12.338584+0000","last_became_active":"2024-09-12T00:25:02.470249+0000","last_became_peered":"2024-09-12T00:25:02.470249+0000","last_unstale":"2024-09-12T01:36:12.338584+0000","last_undegraded":"2024-09-12T01:36:12.338584+0000","last_fullsized":"2024-09-12T01:36:12.338584+0000","mapping_epoch":28,"log_start":"266'1300","ondisk_log_start":"266'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:00.680374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5936,"num_read_kb":5183,"num_write":1890,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'198","reported_seq":833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.756641+0000","last_change":"2024-09-12T00:25:00.484283+0000","last_active":"2024-09-12T01:37:38.756641+0000","last_peered":"2024-09-12T01:37:38.756641+0000","last_clean":"2024-09-12T01:37:38.756641+0000","last_became_active":"2024-09-12T00:25:00.482357+0000","last_became_peered":"2024-09-12T00:25:00.482357+0000","last_unstale":"2024-09-12T01:37:38.756641+0000","last_undegraded":"2024-09-12T01:37:38.756641+0000","last_fullsized":"2024-09-12T01:37:38.756641+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:35.608009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":30861,"num_write":868,"num_write_kb":33122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'567","reported_seq":2114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.489600+0000","last_change":"2024-09-12T00:25:02.467647+0000","last_active":"2024-09-12T01:35:23.489600+0000","last_peered":"2024-09-12T01:35:23.489600+0000","last_clean":"2024-09-12T01:35:23.489600+0000","last_became_active":"2024-09-12T00:25:02.467378+0000","last_became_peered":"2024-09-12T00:25:02.467378+0000","last_unstale":"2024-09-12T01:35:23.489600+0000","last_undegraded":"2024-09-12T01:35:23.489600+0000","last_fullsized":"2024-09-12T01:35:23.489600+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:08.109241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2918,"num_read_kb":2656,"num_write":743,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'211","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.811655+0000","last_change":"2024-09-12T00:25:00.478922+0000","last_active":"2024-09-12T01:37:38.811655+0000","last_peered":"2024-09-12T01:37:38.811655+0000","last_clean":"2024-09-12T01:37:38.811655+0000","last_became_active":"2024-09-12T00:25:00.475340+0000","last_became_peered":"2024-09-12T00:25:00.475340+0000","last_unstale":"2024-09-12T01:37:38.811655+0000","last_undegraded":"2024-09-12T01:37:38.811655+0000","last_fullsized":"2024-09-12T01:37:38.811655+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:27.145736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":13966,"num_write":1015,"num_write_kb":23620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'571","reported_seq":2274,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428973+0000","last_change":"2024-09-12T00:25:02.474521+0000","last_active":"2024-09-12T01:37:18.428973+0000","last_peered":"2024-09-12T01:37:18.428973+0000","last_clean":"2024-09-12T01:37:18.428973+0000","last_became_active":"2024-09-12T00:25:02.474229+0000","last_became_peered":"2024-09-12T00:25:02.474229+0000","last_unstale":"2024-09-12T01:37:18.428973+0000","last_undegraded":"2024-09-12T01:37:18.428973+0000","last_fullsized":"2024-09-12T01:37:18.428973+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:59.636555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2896,"num_write":736,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'188","reported_seq":931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.689331+0000","last_change":"2024-09-12T00:25:00.488194+0000","last_active":"2024-09-12T01:37:38.689331+0000","last_peered":"2024-09-12T01:37:38.689331+0000","last_clean":"2024-09-12T01:37:38.689331+0000","last_became_active":"2024-09-12T00:25:00.487589+0000","last_became_peered":"2024-09-12T00:25:00.487589+0000","last_unstale":"2024-09-12T01:37:38.689331+0000","last_undegraded":"2024-09-12T01:37:38.689331+0000","last_fullsized":"2024-09-12T01:37:38.689331+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:00.587126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8822595,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":942,"num_read_kb":45033,"num_write":954,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'522","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.489583+0000","last_change":"2024-09-12T00:25:02.477683+0000","last_active":"2024-09-12T01:35:23.489583+0000","last_peered":"2024-09-12T01:35:23.489583+0000","last_clean":"2024-09-12T01:35:23.489583+0000","last_became_active":"2024-09-12T00:25:02.477395+0000","last_became_peered":"2024-09-12T00:25:02.477395+0000","last_unstale":"2024-09-12T01:35:23.489583+0000","last_undegraded":"2024-09-12T01:35:23.489583+0000","last_fullsized":"2024-09-12T01:35:23.489583+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:51.177502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3189,"num_read_kb":3033,"num_write":616,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'234","reported_seq":895,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.765765+0000","last_change":"2024-09-12T00:25:00.478053+0000","last_active":"2024-09-12T01:37:38.765765+0000","last_peered":"2024-09-12T01:37:38.765765+0000","last_clean":"2024-09-12T01:37:38.765765+0000","last_became_active":"2024-09-12T00:25:00.477590+0000","last_became_peered":"2024-09-12T00:25:00.477590+0000","last_unstale":"2024-09-12T01:37:38.765765+0000","last_undegraded":"2024-09-12T01:37:38.765765+0000","last_fullsized":"2024-09-12T01:37:38.765765+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:08.585286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048652,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":24485,"num_write":1039,"num_write_kb":27596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'375","reported_seq":1757,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.789775+0000","last_change":"2024-09-12T00:25:02.466712+0000","last_active":"2024-09-12T01:34:32.789775+0000","last_peered":"2024-09-12T01:34:32.789775+0000","last_clean":"2024-09-12T01:34:32.789775+0000","last_became_active":"2024-09-12T00:25:02.466439+0000","last_became_peered":"2024-09-12T00:25:02.466439+0000","last_unstale":"2024-09-12T01:34:32.789775+0000","last_undegraded":"2024-09-12T01:34:32.789775+0000","last_fullsized":"2024-09-12T01:34:32.789775+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:59.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1739,"num_write":422,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'188","reported_seq":793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:34.025271+0000","last_change":"2024-09-12T00:25:00.472775+0000","last_active":"2024-09-12T01:37:34.025271+0000","last_peered":"2024-09-12T01:37:34.025271+0000","last_clean":"2024-09-12T01:37:34.025271+0000","last_became_active":"2024-09-12T00:25:00.472046+0000","last_became_peered":"2024-09-12T00:25:00.472046+0000","last_unstale":"2024-09-12T01:37:34.025271+0000","last_undegraded":"2024-09-12T01:37:34.025271+0000","last_fullsized":"2024-09-12T01:37:34.025271+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.088983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":23076,"num_write":837,"num_write_kb":28135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'364","reported_seq":1839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428522+0000","last_change":"2024-09-12T00:25:02.475079+0000","last_active":"2024-09-12T01:37:18.428522+0000","last_peered":"2024-09-12T01:37:18.428522+0000","last_clean":"2024-09-12T01:37:18.428522+0000","last_became_active":"2024-09-12T00:25:02.474791+0000","last_became_peered":"2024-09-12T00:25:02.474791+0000","last_unstale":"2024-09-12T01:37:18.428522+0000","last_undegraded":"2024-09-12T01:37:18.428522+0000","last_fullsized":"2024-09-12T01:37:18.428522+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:06.924137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2089,"num_read_kb":2020,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'476","reported_seq":2145,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428799+0000","last_change":"2024-09-12T00:25:02.471996+0000","last_active":"2024-09-12T01:37:18.428799+0000","last_peered":"2024-09-12T01:37:18.428799+0000","last_clean":"2024-09-12T01:37:18.428799+0000","last_became_active":"2024-09-12T00:25:02.471545+0000","last_became_peered":"2024-09-12T00:25:02.471545+0000","last_unstale":"2024-09-12T01:37:18.428799+0000","last_undegraded":"2024-09-12T01:37:18.428799+0000","last_fullsized":"2024-09-12T01:37:18.428799+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:19.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2642,"num_read_kb":2498,"num_write":559,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'202","reported_seq":1061,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.090055+0000","last_change":"2024-09-12T00:25:00.465180+0000","last_active":"2024-09-12T01:35:19.090055+0000","last_peered":"2024-09-12T01:35:19.090055+0000","last_clean":"2024-09-12T01:35:19.090055+0000","last_became_active":"2024-09-12T00:25:00.464783+0000","last_became_peered":"2024-09-12T00:25:00.464783+0000","last_unstale":"2024-09-12T01:35:19.090055+0000","last_undegraded":"2024-09-12T01:35:19.090055+0000","last_fullsized":"2024-09-12T01:35:19.090055+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:29.682704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":967,"num_read_kb":27994,"num_write":1073,"num_write_kb":26373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'501","reported_seq":2068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.981007+0000","last_change":"2024-09-12T00:25:02.475307+0000","last_active":"2024-09-12T01:35:04.981007+0000","last_peered":"2024-09-12T01:35:04.981007+0000","last_clean":"2024-09-12T01:35:04.981007+0000","last_became_active":"2024-09-12T00:25:02.475032+0000","last_became_peered":"2024-09-12T00:25:02.475032+0000","last_unstale":"2024-09-12T01:35:04.981007+0000","last_undegraded":"2024-09-12T01:35:04.981007+0000","last_fullsized":"2024-09-12T01:35:04.981007+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:48.727325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2653,"num_read_kb":2473,"num_write":625,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'211","reported_seq":844,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.847224+0000","last_change":"2024-09-12T00:25:00.480048+0000","last_active":"2024-09-12T01:37:38.847224+0000","last_peered":"2024-09-12T01:37:38.847224+0000","last_clean":"2024-09-12T01:37:38.847224+0000","last_became_active":"2024-09-12T00:25:00.479635+0000","last_became_peered":"2024-09-12T00:25:00.479635+0000","last_unstale":"2024-09-12T01:37:38.847224+0000","last_undegraded":"2024-09-12T01:37:38.847224+0000","last_fullsized":"2024-09-12T01:37:38.847224+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:28.545600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279168,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":30051,"num_write":937,"num_write_kb":51711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'1150","reported_seq":2931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801039+0000","last_change":"2024-09-12T00:25:02.467494+0000","last_active":"2024-09-12T01:35:34.801039+0000","last_peered":"2024-09-12T01:35:34.801039+0000","last_clean":"2024-09-12T01:35:34.801039+0000","last_became_active":"2024-09-12T00:25:02.467224+0000","last_became_peered":"2024-09-12T00:25:02.467224+0000","last_unstale":"2024-09-12T01:35:34.801039+0000","last_undegraded":"2024-09-12T01:35:34.801039+0000","last_fullsized":"2024-09-12T01:35:34.801039+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:38.270517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5645,"num_read_kb":4973,"num_write":1729,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'210","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.858824+0000","last_change":"2024-09-12T00:25:00.477548+0000","last_active":"2024-09-12T01:37:38.858824+0000","last_peered":"2024-09-12T01:37:38.858824+0000","last_clean":"2024-09-12T01:37:38.858824+0000","last_became_active":"2024-09-12T00:25:00.477184+0000","last_became_peered":"2024-09-12T00:25:00.477184+0000","last_unstale":"2024-09-12T01:37:38.858824+0000","last_undegraded":"2024-09-12T01:37:38.858824+0000","last_fullsized":"2024-09-12T01:37:38.858824+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:16.176834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3321654,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":408,"num_read_kb":20227,"num_write":1015,"num_write_kb":31572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'485","reported_seq":2016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.490363+0000","last_change":"2024-09-12T00:25:02.469723+0000","last_active":"2024-09-12T01:35:19.490363+0000","last_peered":"2024-09-12T01:35:19.490363+0000","last_clean":"2024-09-12T01:35:19.490363+0000","last_became_active":"2024-09-12T00:25:02.469463+0000","last_became_peered":"2024-09-12T00:25:02.469463+0000","last_unstale":"2024-09-12T01:35:19.490363+0000","last_undegraded":"2024-09-12T01:35:19.490363+0000","last_fullsized":"2024-09-12T01:35:19.490363+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:41.693227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2387,"num_write":615,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'190","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.733785+0000","last_change":"2024-09-12T00:25:00.483752+0000","last_active":"2024-09-12T01:37:38.733785+0000","last_peered":"2024-09-12T01:37:38.733785+0000","last_clean":"2024-09-12T01:37:38.733785+0000","last_became_active":"2024-09-12T00:25:00.483327+0000","last_became_peered":"2024-09-12T00:25:00.483327+0000","last_unstale":"2024-09-12T01:37:38.733785+0000","last_undegraded":"2024-09-12T01:37:38.733785+0000","last_fullsized":"2024-09-12T01:37:38.733785+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.085933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395812,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":12020,"num_write":922,"num_write_kb":12011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'406","reported_seq":1997,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491334+0000","last_change":"2024-09-12T00:25:02.472828+0000","last_active":"2024-09-12T01:35:23.491334+0000","last_peered":"2024-09-12T01:35:23.491334+0000","last_clean":"2024-09-12T01:35:23.491334+0000","last_became_active":"2024-09-12T00:25:02.471598+0000","last_became_peered":"2024-09-12T00:25:02.471598+0000","last_unstale":"2024-09-12T01:35:23.491334+0000","last_undegraded":"2024-09-12T01:35:23.491334+0000","last_fullsized":"2024-09-12T01:35:23.491334+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:34.396174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2389,"num_read_kb":2272,"num_write":462,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'177","reported_seq":836,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.857878+0000","last_change":"2024-09-12T00:25:00.478611+0000","last_active":"2024-09-12T01:37:38.857878+0000","last_peered":"2024-09-12T01:37:38.857878+0000","last_clean":"2024-09-12T01:37:38.857878+0000","last_became_active":"2024-09-12T00:25:00.478202+0000","last_became_peered":"2024-09-12T00:25:00.478202+0000","last_unstale":"2024-09-12T01:37:38.857878+0000","last_undegraded":"2024-09-12T01:37:38.857878+0000","last_fullsized":"2024-09-12T01:37:38.857878+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:15.648085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":78408,"num_write":837,"num_write_kb":24955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'664","reported_seq":2197,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088854+0000","last_change":"2024-09-12T00:25:02.470543+0000","last_active":"2024-09-12T01:35:09.088854+0000","last_peered":"2024-09-12T01:35:09.088854+0000","last_clean":"2024-09-12T01:35:09.088854+0000","last_became_active":"2024-09-12T00:25:02.470278+0000","last_became_peered":"2024-09-12T00:25:02.470278+0000","last_unstale":"2024-09-12T01:35:09.088854+0000","last_undegraded":"2024-09-12T01:35:09.088854+0000","last_fullsized":"2024-09-12T01:35:09.088854+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:56.843342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3455,"num_read_kb":3151,"num_write":936,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'238","reported_seq":906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.807799+0000","last_change":"2024-09-12T00:25:00.457125+0000","last_active":"2024-09-12T01:37:38.807799+0000","last_peered":"2024-09-12T01:37:38.807799+0000","last_clean":"2024-09-12T01:37:38.807799+0000","last_became_active":"2024-09-12T00:25:00.456765+0000","last_became_peered":"2024-09-12T00:25:00.456765+0000","last_unstale":"2024-09-12T01:37:38.807799+0000","last_undegraded":"2024-09-12T01:37:38.807799+0000","last_fullsized":"2024-09-12T01:37:38.807799+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:03.452813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496550,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":628,"num_read_kb":22861,"num_write":1212,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'129","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.484498+0000","last_change":"2024-09-12T00:25:10.523473+0000","last_active":"2024-09-12T01:36:12.484498+0000","last_peered":"2024-09-12T01:36:12.484498+0000","last_clean":"2024-09-12T01:36:12.484498+0000","last_became_active":"2024-09-12T00:25:10.523187+0000","last_became_peered":"2024-09-12T00:25:10.523187+0000","last_unstale":"2024-09-12T01:36:12.484498+0000","last_undegraded":"2024-09-12T01:36:12.484498+0000","last_fullsized":"2024-09-12T01:36:12.484498+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:03.075928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'447","reported_seq":2133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.833875+0000","last_change":"2024-09-12T00:25:02.464400+0000","last_active":"2024-09-12T01:35:16.833875+0000","last_peered":"2024-09-12T01:35:16.833875+0000","last_clean":"2024-09-12T01:35:16.833875+0000","last_became_active":"2024-09-12T00:25:02.464035+0000","last_became_peered":"2024-09-12T00:25:02.464035+0000","last_unstale":"2024-09-12T01:35:16.833875+0000","last_undegraded":"2024-09-12T01:35:16.833875+0000","last_fullsized":"2024-09-12T01:35:16.833875+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.803044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2614,"num_read_kb":2487,"num_write":526,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'214","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.794938+0000","last_change":"2024-09-12T00:25:00.479724+0000","last_active":"2024-09-12T01:37:38.794938+0000","last_peered":"2024-09-12T01:37:38.794938+0000","last_clean":"2024-09-12T01:37:38.794938+0000","last_became_active":"2024-09-12T00:25:00.479335+0000","last_became_peered":"2024-09-12T00:25:00.479335+0000","last_unstale":"2024-09-12T01:37:38.794938+0000","last_undegraded":"2024-09-12T01:37:38.794938+0000","last_fullsized":"2024-09-12T01:37:38.794938+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:52.582972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1920160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":7515,"num_write":984,"num_write_kb":32910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534500+0000","last_change":"2024-09-12T00:25:04.485699+0000","last_active":"2024-09-12T01:35:09.534500+0000","last_peered":"2024-09-12T01:35:09.534500+0000","last_clean":"2024-09-12T01:35:09.534500+0000","last_became_active":"2024-09-12T00:25:04.485389+0000","last_became_peered":"2024-09-12T00:25:04.485389+0000","last_unstale":"2024-09-12T01:35:09.534500+0000","last_undegraded":"2024-09-12T01:35:09.534500+0000","last_fullsized":"2024-09-12T01:35:09.534500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:42.240804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'216","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.546231+0000","last_change":"2024-09-12T00:25:06.500211+0000","last_active":"2024-09-12T01:37:19.546231+0000","last_peered":"2024-09-12T01:37:19.546231+0000","last_clean":"2024-09-12T01:37:19.546231+0000","last_became_active":"2024-09-12T00:25:06.499933+0000","last_became_peered":"2024-09-12T00:25:06.499933+0000","last_unstale":"2024-09-12T01:37:19.546231+0000","last_undegraded":"2024-09-12T01:37:19.546231+0000","last_fullsized":"2024-09-12T01:37:19.546231+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:46.967892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13196,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":351,"num_write":172,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.089450+0000","last_change":"2024-09-12T00:25:08.501552+0000","last_active":"2024-09-12T01:35:14.089450+0000","last_peered":"2024-09-12T01:35:14.089450+0000","last_clean":"2024-09-12T01:35:14.089450+0000","last_became_active":"2024-09-12T00:25:08.501137+0000","last_became_peered":"2024-09-12T00:25:08.501137+0000","last_unstale":"2024-09-12T01:35:14.089450+0000","last_undegraded":"2024-09-12T01:35:14.089450+0000","last_fullsized":"2024-09-12T01:35:14.089450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:02.147605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2435","reported_seq":4332,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.040799+0000","last_change":"2024-09-12T00:25:10.526327+0000","last_active":"2024-09-12T01:36:12.040799+0000","last_peered":"2024-09-12T01:36:12.040799+0000","last_clean":"2024-09-12T01:36:12.040799+0000","last_became_active":"2024-09-12T00:25:10.526016+0000","last_became_peered":"2024-09-12T00:25:10.526016+0000","last_unstale":"2024-09-12T01:36:12.040799+0000","last_undegraded":"2024-09-12T01:36:12.040799+0000","last_fullsized":"2024-09-12T01:36:12.040799+0000","mapping_epoch":36,"log_start":"266'2400","ondisk_log_start":"266'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":2400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:25.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6097,"num_read_kb":6097,"num_write":4851,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'891","reported_seq":2330,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428993+0000","last_change":"2024-09-12T00:25:02.477964+0000","last_active":"2024-09-12T01:37:18.428993+0000","last_peered":"2024-09-12T01:37:18.428993+0000","last_clean":"2024-09-12T01:37:18.428993+0000","last_became_active":"2024-09-12T00:25:02.477360+0000","last_became_peered":"2024-09-12T00:25:02.477360+0000","last_unstale":"2024-09-12T01:37:18.428993+0000","last_undegraded":"2024-09-12T01:37:18.428993+0000","last_fullsized":"2024-09-12T01:37:18.428993+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:52.094792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4073,"num_read_kb":3587,"num_write":1238,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'213","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.810139+0000","last_change":"2024-09-12T00:25:00.452665+0000","last_active":"2024-09-12T01:37:38.810139+0000","last_peered":"2024-09-12T01:37:38.810139+0000","last_clean":"2024-09-12T01:37:38.810139+0000","last_became_active":"2024-09-12T00:25:00.452236+0000","last_became_peered":"2024-09-12T00:25:00.452236+0000","last_unstale":"2024-09-12T01:37:38.810139+0000","last_undegraded":"2024-09-12T01:37:38.810139+0000","last_fullsized":"2024-09-12T01:37:38.810139+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:05.744126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084046,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":27979,"num_write":1022,"num_write_kb":43410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.254402+0000","last_change":"2024-09-12T00:25:04.481555+0000","last_active":"2024-09-12T01:35:17.254402+0000","last_peered":"2024-09-12T01:35:17.254402+0000","last_clean":"2024-09-12T01:35:17.254402+0000","last_became_active":"2024-09-12T00:25:04.481218+0000","last_became_peered":"2024-09-12T00:25:04.481218+0000","last_unstale":"2024-09-12T01:35:17.254402+0000","last_undegraded":"2024-09-12T01:35:17.254402+0000","last_fullsized":"2024-09-12T01:35:17.254402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:06.324093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'127","reported_seq":676,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.201882+0000","last_change":"2024-09-12T00:25:06.490765+0000","last_active":"2024-09-12T01:35:55.201882+0000","last_peered":"2024-09-12T01:35:55.201882+0000","last_clean":"2024-09-12T01:35:55.201882+0000","last_became_active":"2024-09-12T00:25:06.490463+0000","last_became_peered":"2024-09-12T00:25:06.490463+0000","last_unstale":"2024-09-12T01:35:55.201882+0000","last_undegraded":"2024-09-12T01:35:55.201882+0000","last_fullsized":"2024-09-12T01:35:55.201882+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:30.310748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":131,"num_write":102,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.089409+0000","last_change":"2024-09-12T00:25:08.505822+0000","last_active":"2024-09-12T01:35:14.089409+0000","last_peered":"2024-09-12T01:35:14.089409+0000","last_clean":"2024-09-12T01:35:14.089409+0000","last_became_active":"2024-09-12T00:25:08.505492+0000","last_became_peered":"2024-09-12T00:25:08.505492+0000","last_unstale":"2024-09-12T01:35:14.089409+0000","last_undegraded":"2024-09-12T01:35:14.089409+0000","last_fullsized":"2024-09-12T01:35:14.089409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:49.241744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'139","reported_seq":659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.247384+0000","last_change":"2024-09-12T00:25:10.523127+0000","last_active":"2024-09-12T01:37:18.247384+0000","last_peered":"2024-09-12T01:37:18.247384+0000","last_clean":"2024-09-12T01:37:18.247384+0000","last_became_active":"2024-09-12T00:25:10.522822+0000","last_became_peered":"2024-09-12T00:25:10.522822+0000","last_unstale":"2024-09-12T01:37:18.247384+0000","last_undegraded":"2024-09-12T01:37:18.247384+0000","last_fullsized":"2024-09-12T01:37:18.247384+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:39.986321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":196,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'482","reported_seq":2022,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.002276+0000","last_change":"2024-09-12T00:25:02.479138+0000","last_active":"2024-09-12T01:35:09.002276+0000","last_peered":"2024-09-12T01:35:09.002276+0000","last_clean":"2024-09-12T01:35:09.002276+0000","last_became_active":"2024-09-12T00:25:02.478850+0000","last_became_peered":"2024-09-12T00:25:02.478850+0000","last_unstale":"2024-09-12T01:35:09.002276+0000","last_undegraded":"2024-09-12T01:35:09.002276+0000","last_fullsized":"2024-09-12T01:35:09.002276+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:31.778936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2311,"num_write":575,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'203","reported_seq":863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.703784+0000","last_change":"2024-09-12T00:25:00.476041+0000","last_active":"2024-09-12T01:37:38.703784+0000","last_peered":"2024-09-12T01:37:38.703784+0000","last_clean":"2024-09-12T01:37:38.703784+0000","last_became_active":"2024-09-12T00:25:00.475628+0000","last_became_peered":"2024-09-12T00:25:00.475628+0000","last_unstale":"2024-09-12T01:37:38.703784+0000","last_undegraded":"2024-09-12T01:37:38.703784+0000","last_fullsized":"2024-09-12T01:37:38.703784+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:14.169208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":1110,"num_write":851,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:12.253498+0000","last_change":"2024-09-12T00:25:04.484287+0000","last_active":"2024-09-12T01:35:12.253498+0000","last_peered":"2024-09-12T01:35:12.253498+0000","last_clean":"2024-09-12T01:35:12.253498+0000","last_became_active":"2024-09-12T00:25:04.483774+0000","last_became_peered":"2024-09-12T00:25:04.483774+0000","last_unstale":"2024-09-12T01:35:12.253498+0000","last_undegraded":"2024-09-12T01:35:12.253498+0000","last_fullsized":"2024-09-12T01:35:12.253498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:26.376424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'143","reported_seq":719,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.415267+0000","last_change":"2024-09-12T00:25:06.501549+0000","last_active":"2024-09-12T01:36:07.415267+0000","last_peered":"2024-09-12T01:36:07.415267+0000","last_clean":"2024-09-12T01:36:07.415267+0000","last_became_active":"2024-09-12T00:25:06.500991+0000","last_became_peered":"2024-09-12T00:25:06.500991+0000","last_unstale":"2024-09-12T01:36:07.415267+0000","last_undegraded":"2024-09-12T01:36:07.415267+0000","last_fullsized":"2024-09-12T01:36:07.415267+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:31.699237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'797","reported_seq":4866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.920566+0000","last_change":"2024-09-12T00:25:08.514676+0000","last_active":"2024-09-12T01:37:38.920566+0000","last_peered":"2024-09-12T01:37:38.920566+0000","last_clean":"2024-09-12T01:37:38.920566+0000","last_became_active":"2024-09-12T00:25:08.514360+0000","last_became_peered":"2024-09-12T00:25:08.514360+0000","last_unstale":"2024-09-12T01:37:38.920566+0000","last_undegraded":"2024-09-12T01:37:38.920566+0000","last_fullsized":"2024-09-12T01:37:38.920566+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:19.747805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'202","reported_seq":1037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.546065+0000","last_change":"2024-09-12T00:25:10.519173+0000","last_active":"2024-09-12T01:36:12.546065+0000","last_peered":"2024-09-12T01:36:12.546065+0000","last_clean":"2024-09-12T01:36:12.546065+0000","last_became_active":"2024-09-12T00:25:10.518861+0000","last_became_peered":"2024-09-12T00:25:10.518861+0000","last_unstale":"2024-09-12T01:36:12.546065+0000","last_undegraded":"2024-09-12T01:36:12.546065+0000","last_fullsized":"2024-09-12T01:36:12.546065+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:28.784023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":600,"num_write":435,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'466","reported_seq":1986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491174+0000","last_change":"2024-09-12T00:25:02.477428+0000","last_active":"2024-09-12T01:35:23.491174+0000","last_peered":"2024-09-12T01:35:23.491174+0000","last_clean":"2024-09-12T01:35:23.491174+0000","last_became_active":"2024-09-12T00:25:02.477052+0000","last_became_peered":"2024-09-12T00:25:02.477052+0000","last_unstale":"2024-09-12T01:35:23.491174+0000","last_undegraded":"2024-09-12T01:35:23.491174+0000","last_fullsized":"2024-09-12T01:35:23.491174+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:47.054845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2388,"num_read_kb":2234,"num_write":549,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'224","reported_seq":869,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.691028+0000","last_change":"2024-09-12T00:25:00.458865+0000","last_active":"2024-09-12T01:37:38.691028+0000","last_peered":"2024-09-12T01:37:38.691028+0000","last_clean":"2024-09-12T01:37:38.691028+0000","last_became_active":"2024-09-12T00:25:00.457828+0000","last_became_peered":"2024-09-12T00:25:00.457828+0000","last_unstale":"2024-09-12T01:37:38.691028+0000","last_undegraded":"2024-09-12T01:37:38.691028+0000","last_fullsized":"2024-09-12T01:37:38.691028+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:20.656353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":9782,"num_write":1039,"num_write_kb":35060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534518+0000","last_change":"2024-09-12T00:25:04.482494+0000","last_active":"2024-09-12T01:35:09.534518+0000","last_peered":"2024-09-12T01:35:09.534518+0000","last_clean":"2024-09-12T01:35:09.534518+0000","last_became_active":"2024-09-12T00:25:04.482173+0000","last_became_peered":"2024-09-12T00:25:04.482173+0000","last_unstale":"2024-09-12T01:35:09.534518+0000","last_undegraded":"2024-09-12T01:35:09.534518+0000","last_fullsized":"2024-09-12T01:35:09.534518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:38.300401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'158","reported_seq":751,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.915794+0000","last_change":"2024-09-12T00:25:06.491652+0000","last_active":"2024-09-12T01:37:38.915794+0000","last_peered":"2024-09-12T01:37:38.915794+0000","last_clean":"2024-09-12T01:37:38.915794+0000","last_became_active":"2024-09-12T00:25:06.491337+0000","last_became_peered":"2024-09-12T00:25:06.491337+0000","last_unstale":"2024-09-12T01:37:38.915794+0000","last_undegraded":"2024-09-12T01:37:38.915794+0000","last_fullsized":"2024-09-12T01:37:38.915794+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:08.948500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5611,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":280,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'801","reported_seq":2767,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.530753+0000","last_change":"2024-09-12T00:25:08.512430+0000","last_active":"2024-09-12T01:37:38.530753+0000","last_peered":"2024-09-12T01:37:38.530753+0000","last_clean":"2024-09-12T01:37:38.530753+0000","last_became_active":"2024-09-12T00:25:08.512125+0000","last_became_peered":"2024-09-12T00:25:08.512125+0000","last_unstale":"2024-09-12T01:37:38.530753+0000","last_undegraded":"2024-09-12T01:37:38.530753+0000","last_fullsized":"2024-09-12T01:37:38.530753+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:52.436088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'2025","reported_seq":3645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338541+0000","last_change":"2024-09-12T00:25:02.465523+0000","last_active":"2024-09-12T01:36:12.338541+0000","last_peered":"2024-09-12T01:36:12.338541+0000","last_clean":"2024-09-12T01:36:12.338541+0000","last_became_active":"2024-09-12T00:25:02.465239+0000","last_became_peered":"2024-09-12T00:25:02.465239+0000","last_unstale":"2024-09-12T01:36:12.338541+0000","last_undegraded":"2024-09-12T01:36:12.338541+0000","last_fullsized":"2024-09-12T01:36:12.338541+0000","mapping_epoch":28,"log_start":"266'2000","ondisk_log_start":"266'2000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:57.527506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8773,"num_read_kb":7539,"num_write":2902,"num_write_kb":1299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'179","reported_seq":791,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.640641+0000","last_change":"2024-09-12T00:25:00.467280+0000","last_active":"2024-09-12T01:37:38.640641+0000","last_peered":"2024-09-12T01:37:38.640641+0000","last_clean":"2024-09-12T01:37:38.640641+0000","last_became_active":"2024-09-12T00:25:00.466899+0000","last_became_peered":"2024-09-12T00:25:00.466899+0000","last_unstale":"2024-09-12T01:37:38.640641+0000","last_undegraded":"2024-09-12T01:37:38.640641+0000","last_fullsized":"2024-09-12T01:37:38.640641+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:56.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":366,"num_read_kb":8806,"num_write":851,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.084136+0000","last_change":"2024-09-12T00:25:04.483191+0000","last_active":"2024-09-12T01:34:24.084136+0000","last_peered":"2024-09-12T01:34:24.084136+0000","last_clean":"2024-09-12T01:34:24.084136+0000","last_became_active":"2024-09-12T00:25:04.482885+0000","last_became_peered":"2024-09-12T00:25:04.482885+0000","last_unstale":"2024-09-12T01:34:24.084136+0000","last_undegraded":"2024-09-12T01:34:24.084136+0000","last_fullsized":"2024-09-12T01:34:24.084136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:29.397137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'264","reported_seq":917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.662698+0000","last_change":"2024-09-12T00:25:06.498236+0000","last_active":"2024-09-12T01:37:38.662698+0000","last_peered":"2024-09-12T01:37:38.662698+0000","last_clean":"2024-09-12T01:37:38.662698+0000","last_became_active":"2024-09-12T00:25:06.497881+0000","last_became_peered":"2024-09-12T00:25:06.497881+0000","last_unstale":"2024-09-12T01:37:38.662698+0000","last_undegraded":"2024-09-12T01:37:38.662698+0000","last_fullsized":"2024-09-12T01:37:38.662698+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:36.459394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20748,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":371,"num_read_kb":470,"num_write":222,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.178342+0000","last_change":"2024-09-12T00:25:08.508274+0000","last_active":"2024-09-12T01:34:54.178342+0000","last_peered":"2024-09-12T01:34:54.178342+0000","last_clean":"2024-09-12T01:34:54.178342+0000","last_became_active":"2024-09-12T00:25:08.507993+0000","last_became_peered":"2024-09-12T00:25:08.507993+0000","last_unstale":"2024-09-12T01:34:54.178342+0000","last_undegraded":"2024-09-12T01:34:54.178342+0000","last_fullsized":"2024-09-12T01:34:54.178342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:26.028970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'572","reported_seq":1417,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.565060+0000","last_change":"2024-09-12T00:25:10.528237+0000","last_active":"2024-09-12T01:37:19.565060+0000","last_peered":"2024-09-12T01:37:19.565060+0000","last_clean":"2024-09-12T01:37:19.565060+0000","last_became_active":"2024-09-12T00:25:10.528021+0000","last_became_peered":"2024-09-12T00:25:10.528021+0000","last_unstale":"2024-09-12T01:37:19.565060+0000","last_undegraded":"2024-09-12T01:37:19.565060+0000","last_fullsized":"2024-09-12T01:37:19.565060+0000","mapping_epoch":36,"log_start":"266'500","ondisk_log_start":"266'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:14.269299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1390,"num_read_kb":1363,"num_write":1223,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'492","reported_seq":2153,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.488491+0000","last_change":"2024-09-12T00:25:02.468103+0000","last_active":"2024-09-12T01:35:19.488491+0000","last_peered":"2024-09-12T01:35:19.488491+0000","last_clean":"2024-09-12T01:35:19.488491+0000","last_became_active":"2024-09-12T00:25:02.467846+0000","last_became_peered":"2024-09-12T00:25:02.467846+0000","last_unstale":"2024-09-12T01:35:19.488491+0000","last_undegraded":"2024-09-12T01:35:19.488491+0000","last_fullsized":"2024-09-12T01:35:19.488491+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:33.654734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2600,"num_read_kb":2447,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'208","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.903489+0000","last_change":"2024-09-12T00:25:00.486904+0000","last_active":"2024-09-12T01:37:38.903489+0000","last_peered":"2024-09-12T01:37:38.903489+0000","last_clean":"2024-09-12T01:37:38.903489+0000","last_became_active":"2024-09-12T00:25:00.486471+0000","last_became_peered":"2024-09-12T00:25:00.486471+0000","last_unstale":"2024-09-12T01:37:38.903489+0000","last_undegraded":"2024-09-12T01:37:38.903489+0000","last_fullsized":"2024-09-12T01:37:38.903489+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:35.328875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706427,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":18784,"num_write":969,"num_write_kb":38470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.174174+0000","last_change":"2024-09-12T00:25:04.480755+0000","last_active":"2024-09-12T01:34:24.174174+0000","last_peered":"2024-09-12T01:34:24.174174+0000","last_clean":"2024-09-12T01:34:24.174174+0000","last_became_active":"2024-09-12T00:25:04.480469+0000","last_became_peered":"2024-09-12T00:25:04.480469+0000","last_unstale":"2024-09-12T01:34:24.174174+0000","last_undegraded":"2024-09-12T01:34:24.174174+0000","last_fullsized":"2024-09-12T01:34:24.174174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:20.229017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'144","reported_seq":740,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:07.269941+0000","last_change":"2024-09-12T00:25:06.500291+0000","last_active":"2024-09-12T01:37:07.269941+0000","last_peered":"2024-09-12T01:37:07.269941+0000","last_clean":"2024-09-12T01:37:07.269941+0000","last_became_active":"2024-09-12T00:25:06.500036+0000","last_became_peered":"2024-09-12T00:25:06.500036+0000","last_unstale":"2024-09-12T01:37:07.269941+0000","last_undegraded":"2024-09-12T01:37:07.269941+0000","last_fullsized":"2024-09-12T01:37:07.269941+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:40.715748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11550,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":233,"num_write":96,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:42.248759+0000","last_change":"2024-09-12T00:25:08.510086+0000","last_active":"2024-09-12T01:34:42.248759+0000","last_peered":"2024-09-12T01:34:42.248759+0000","last_clean":"2024-09-12T01:34:42.248759+0000","last_became_active":"2024-09-12T00:25:08.509780+0000","last_became_peered":"2024-09-12T00:25:08.509780+0000","last_unstale":"2024-09-12T01:34:42.248759+0000","last_undegraded":"2024-09-12T01:34:42.248759+0000","last_fullsized":"2024-09-12T01:34:42.248759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:23.294463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'144","reported_seq":649,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:14.095922+0000","last_change":"2024-09-12T00:25:10.528275+0000","last_active":"2024-09-12T01:36:14.095922+0000","last_peered":"2024-09-12T01:36:14.095922+0000","last_clean":"2024-09-12T01:36:14.095922+0000","last_became_active":"2024-09-12T00:25:10.527984+0000","last_became_peered":"2024-09-12T00:25:10.527984+0000","last_unstale":"2024-09-12T01:36:14.095922+0000","last_undegraded":"2024-09-12T01:36:14.095922+0000","last_fullsized":"2024-09-12T01:36:14.095922+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:42.118932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":124,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'452","reported_seq":2015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801286+0000","last_change":"2024-09-12T00:25:02.469437+0000","last_active":"2024-09-12T01:35:34.801286+0000","last_peered":"2024-09-12T01:35:34.801286+0000","last_clean":"2024-09-12T01:35:34.801286+0000","last_became_active":"2024-09-12T00:25:02.469155+0000","last_became_peered":"2024-09-12T00:25:02.469155+0000","last_unstale":"2024-09-12T01:35:34.801286+0000","last_undegraded":"2024-09-12T01:35:34.801286+0000","last_fullsized":"2024-09-12T01:35:34.801286+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:28.701935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2451,"num_write":541,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'226","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.815420+0000","last_change":"2024-09-12T00:25:32.564364+0000","last_active":"2024-09-12T01:37:38.815420+0000","last_peered":"2024-09-12T01:37:38.815420+0000","last_clean":"2024-09-12T01:37:38.815420+0000","last_became_active":"2024-09-12T00:25:32.563811+0000","last_became_peered":"2024-09-12T00:25:32.563811+0000","last_unstale":"2024-09-12T01:37:38.815420+0000","last_undegraded":"2024-09-12T01:37:38.815420+0000","last_fullsized":"2024-09-12T01:37:38.815420+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:39.825680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442172,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":15150,"num_write":1090,"num_write_kb":21884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:48.998771+0000","last_change":"2024-09-12T00:25:04.484649+0000","last_active":"2024-09-12T01:34:48.998771+0000","last_peered":"2024-09-12T01:34:48.998771+0000","last_clean":"2024-09-12T01:34:48.998771+0000","last_became_active":"2024-09-12T00:25:04.484029+0000","last_became_peered":"2024-09-12T00:25:04.484029+0000","last_unstale":"2024-09-12T01:34:48.998771+0000","last_undegraded":"2024-09-12T01:34:48.998771+0000","last_fullsized":"2024-09-12T01:34:48.998771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:29.267578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'217","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.698221+0000","last_change":"2024-09-12T00:25:06.496644+0000","last_active":"2024-09-12T01:37:38.698221+0000","last_peered":"2024-09-12T01:37:38.698221+0000","last_clean":"2024-09-12T01:37:38.698221+0000","last_became_active":"2024-09-12T00:25:06.496348+0000","last_became_peered":"2024-09-12T00:25:06.496348+0000","last_unstale":"2024-09-12T01:37:38.698221+0000","last_undegraded":"2024-09-12T01:37:38.698221+0000","last_fullsized":"2024-09-12T01:37:38.698221+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:12.917394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22554,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":293,"num_read_kb":420,"num_write":176,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'800","reported_seq":4588,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.531846+0000","last_change":"2024-09-12T00:25:08.512365+0000","last_active":"2024-09-12T01:37:38.531846+0000","last_peered":"2024-09-12T01:37:38.531846+0000","last_clean":"2024-09-12T01:37:38.531846+0000","last_became_active":"2024-09-12T00:25:08.512086+0000","last_became_peered":"2024-09-12T00:25:08.512086+0000","last_unstale":"2024-09-12T01:37:38.531846+0000","last_undegraded":"2024-09-12T01:37:38.531846+0000","last_fullsized":"2024-09-12T01:37:38.531846+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:45.064721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'130","reported_seq":630,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.246800+0000","last_change":"2024-09-12T00:25:10.521608+0000","last_active":"2024-09-12T01:37:18.246800+0000","last_peered":"2024-09-12T01:37:18.246800+0000","last_clean":"2024-09-12T01:37:18.246800+0000","last_became_active":"2024-09-12T00:25:10.521322+0000","last_became_peered":"2024-09-12T00:25:10.521322+0000","last_unstale":"2024-09-12T01:37:18.246800+0000","last_undegraded":"2024-09-12T01:37:18.246800+0000","last_fullsized":"2024-09-12T01:37:18.246800+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.501352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":104,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'389","reported_seq":1833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.490823+0000","last_change":"2024-09-12T00:25:02.468886+0000","last_active":"2024-09-12T01:35:19.490823+0000","last_peered":"2024-09-12T01:35:19.490823+0000","last_clean":"2024-09-12T01:35:19.490823+0000","last_became_active":"2024-09-12T00:25:02.468609+0000","last_became_peered":"2024-09-12T00:25:02.468609+0000","last_unstale":"2024-09-12T01:35:19.490823+0000","last_undegraded":"2024-09-12T01:35:19.490823+0000","last_fullsized":"2024-09-12T01:35:19.490823+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:52.563826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2038,"num_read_kb":1930,"num_write":430,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'219","reported_seq":970,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.756624+0000","last_change":"2024-09-12T00:25:00.473333+0000","last_active":"2024-09-12T01:37:38.756624+0000","last_peered":"2024-09-12T01:37:38.756624+0000","last_clean":"2024-09-12T01:37:38.756624+0000","last_became_active":"2024-09-12T00:25:00.472065+0000","last_became_peered":"2024-09-12T00:25:00.472065+0000","last_unstale":"2024-09-12T01:37:38.756624+0000","last_undegraded":"2024-09-12T01:37:38.756624+0000","last_fullsized":"2024-09-12T01:37:38.756624+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:52.897931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9573531,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1000,"num_read_kb":31471,"num_write":994,"num_write_kb":39869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"38'4","reported_seq":977,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.291052+0000","last_change":"2024-09-12T00:25:04.482765+0000","last_active":"2024-09-12T01:37:38.291052+0000","last_peered":"2024-09-12T01:37:38.291052+0000","last_clean":"2024-09-12T01:37:38.291052+0000","last_became_active":"2024-09-12T00:25:04.482518+0000","last_became_peered":"2024-09-12T00:25:04.482518+0000","last_unstale":"2024-09-12T01:37:38.291052+0000","last_undegraded":"2024-09-12T01:37:38.291052+0000","last_fullsized":"2024-09-12T01:37:38.291052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.317643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'216","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.532689+0000","last_change":"2024-09-12T00:25:06.497612+0000","last_active":"2024-09-12T01:37:19.532689+0000","last_peered":"2024-09-12T01:37:19.532689+0000","last_clean":"2024-09-12T01:37:19.532689+0000","last_became_active":"2024-09-12T00:25:06.497269+0000","last_became_peered":"2024-09-12T00:25:06.497269+0000","last_unstale":"2024-09-12T01:37:19.532689+0000","last_undegraded":"2024-09-12T01:37:19.532689+0000","last_fullsized":"2024-09-12T01:37:19.532689+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:15.450749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19882,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":301,"num_read_kb":401,"num_write":154,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:28.995211+0000","last_change":"2024-09-12T00:25:08.514101+0000","last_active":"2024-09-12T01:34:28.995211+0000","last_peered":"2024-09-12T01:34:28.995211+0000","last_clean":"2024-09-12T01:34:28.995211+0000","last_became_active":"2024-09-12T00:25:08.513758+0000","last_became_peered":"2024-09-12T00:25:08.513758+0000","last_unstale":"2024-09-12T01:34:28.995211+0000","last_undegraded":"2024-09-12T01:34:28.995211+0000","last_fullsized":"2024-09-12T01:34:28.995211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:44.229276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'131","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.673372+0000","last_change":"2024-09-12T00:25:10.525073+0000","last_active":"2024-09-12T01:36:07.673372+0000","last_peered":"2024-09-12T01:36:07.673372+0000","last_clean":"2024-09-12T01:36:07.673372+0000","last_became_active":"2024-09-12T00:25:10.524500+0000","last_became_peered":"2024-09-12T00:25:10.524500+0000","last_unstale":"2024-09-12T01:36:07.673372+0000","last_undegraded":"2024-09-12T01:36:07.673372+0000","last_fullsized":"2024-09-12T01:36:07.673372+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:33.151875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":199,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'393","reported_seq":2026,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.195471+0000","last_change":"2024-09-12T00:25:02.476800+0000","last_active":"2024-09-12T01:36:11.195471+0000","last_peered":"2024-09-12T01:36:11.195471+0000","last_clean":"2024-09-12T01:36:11.195471+0000","last_became_active":"2024-09-12T00:25:02.476549+0000","last_became_peered":"2024-09-12T00:25:02.476549+0000","last_unstale":"2024-09-12T01:36:11.195471+0000","last_undegraded":"2024-09-12T01:36:11.195471+0000","last_fullsized":"2024-09-12T01:36:11.195471+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:16.691928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2368,"num_read_kb":2274,"num_write":449,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'195","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.890983+0000","last_change":"2024-09-12T00:25:00.471698+0000","last_active":"2024-09-12T01:37:38.890983+0000","last_peered":"2024-09-12T01:37:38.890983+0000","last_clean":"2024-09-12T01:37:38.890983+0000","last_became_active":"2024-09-12T00:25:00.471314+0000","last_became_peered":"2024-09-12T00:25:00.471314+0000","last_unstale":"2024-09-12T01:37:38.890983+0000","last_undegraded":"2024-09-12T01:37:38.890983+0000","last_fullsized":"2024-09-12T01:37:38.890983+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:13.302458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190278,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":11373,"num_write":891,"num_write_kb":19982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:50.121029+0000","last_change":"2024-09-12T00:25:04.486405+0000","last_active":"2024-09-12T01:34:50.121029+0000","last_peered":"2024-09-12T01:34:50.121029+0000","last_clean":"2024-09-12T01:34:50.121029+0000","last_became_active":"2024-09-12T00:25:04.486111+0000","last_became_peered":"2024-09-12T00:25:04.486111+0000","last_unstale":"2024-09-12T01:34:50.121029+0000","last_undegraded":"2024-09-12T01:34:50.121029+0000","last_fullsized":"2024-09-12T01:34:50.121029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:49.097494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'202","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.860441+0000","last_change":"2024-09-12T00:25:06.497567+0000","last_active":"2024-09-12T01:37:38.860441+0000","last_peered":"2024-09-12T01:37:38.860441+0000","last_clean":"2024-09-12T01:37:38.860441+0000","last_became_active":"2024-09-12T00:25:06.497247+0000","last_became_peered":"2024-09-12T00:25:06.497247+0000","last_unstale":"2024-09-12T01:37:38.860441+0000","last_undegraded":"2024-09-12T01:37:38.860441+0000","last_fullsized":"2024-09-12T01:37:38.860441+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:35.152802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":347,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123202+0000","last_change":"2024-09-12T00:25:08.517282+0000","last_active":"2024-09-12T01:35:05.123202+0000","last_peered":"2024-09-12T01:35:05.123202+0000","last_clean":"2024-09-12T01:35:05.123202+0000","last_became_active":"2024-09-12T00:25:08.516949+0000","last_became_peered":"2024-09-12T00:25:08.516949+0000","last_unstale":"2024-09-12T01:35:05.123202+0000","last_undegraded":"2024-09-12T01:35:05.123202+0000","last_fullsized":"2024-09-12T01:35:05.123202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:05.996838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'123","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:08.018005+0000","last_change":"2024-09-12T00:25:10.531019+0000","last_active":"2024-09-12T01:37:08.018005+0000","last_peered":"2024-09-12T01:37:08.018005+0000","last_clean":"2024-09-12T01:37:08.018005+0000","last_became_active":"2024-09-12T00:25:10.530731+0000","last_became_peered":"2024-09-12T00:25:10.530731+0000","last_unstale":"2024-09-12T01:37:08.018005+0000","last_undegraded":"2024-09-12T01:37:08.018005+0000","last_fullsized":"2024-09-12T01:37:08.018005+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.713991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":124,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'665","reported_seq":2301,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.803243+0000","last_change":"2024-09-12T00:25:02.474838+0000","last_active":"2024-09-12T01:35:34.803243+0000","last_peered":"2024-09-12T01:35:34.803243+0000","last_clean":"2024-09-12T01:35:34.803243+0000","last_became_active":"2024-09-12T00:25:02.474113+0000","last_became_peered":"2024-09-12T00:25:02.474113+0000","last_unstale":"2024-09-12T01:35:34.803243+0000","last_undegraded":"2024-09-12T01:35:34.803243+0000","last_fullsized":"2024-09-12T01:35:34.803243+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":600,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:02.950937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3250,"num_read_kb":2990,"num_write":879,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'185","reported_seq":897,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.545738+0000","last_change":"2024-09-12T00:25:32.562365+0000","last_active":"2024-09-12T01:36:39.545738+0000","last_peered":"2024-09-12T01:36:39.545738+0000","last_clean":"2024-09-12T01:36:39.545738+0000","last_became_active":"2024-09-12T00:25:32.562005+0000","last_became_peered":"2024-09-12T00:25:32.562005+0000","last_unstale":"2024-09-12T01:36:39.545738+0000","last_undegraded":"2024-09-12T01:36:39.545738+0000","last_fullsized":"2024-09-12T01:36:39.545738+0000","mapping_epoch":39,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:04.047110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568762,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":135425,"num_write":898,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:48.998802+0000","last_change":"2024-09-12T00:25:04.483049+0000","last_active":"2024-09-12T01:34:48.998802+0000","last_peered":"2024-09-12T01:34:48.998802+0000","last_clean":"2024-09-12T01:34:48.998802+0000","last_became_active":"2024-09-12T00:25:04.482744+0000","last_became_peered":"2024-09-12T00:25:04.482744+0000","last_unstale":"2024-09-12T01:34:48.998802+0000","last_undegraded":"2024-09-12T01:34:48.998802+0000","last_fullsized":"2024-09-12T01:34:48.998802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:16.996020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'192","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.788049+0000","last_change":"2024-09-12T00:25:06.497726+0000","last_active":"2024-09-12T01:37:38.788049+0000","last_peered":"2024-09-12T01:37:38.788049+0000","last_clean":"2024-09-12T01:37:38.788049+0000","last_became_active":"2024-09-12T00:25:06.497448+0000","last_became_peered":"2024-09-12T00:25:06.497448+0000","last_unstale":"2024-09-12T01:37:38.788049+0000","last_undegraded":"2024-09-12T01:37:38.788049+0000","last_fullsized":"2024-09-12T01:37:38.788049+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:20.638948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":247,"num_read_kb":253,"num_write":136,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'764","reported_seq":2721,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.526972+0000","last_change":"2024-09-12T00:25:08.510452+0000","last_active":"2024-09-12T01:37:38.526972+0000","last_peered":"2024-09-12T01:37:38.526972+0000","last_clean":"2024-09-12T01:37:38.526972+0000","last_became_active":"2024-09-12T00:25:08.510134+0000","last_became_peered":"2024-09-12T00:25:08.510134+0000","last_unstale":"2024-09-12T01:37:38.526972+0000","last_undegraded":"2024-09-12T01:37:38.526972+0000","last_fullsized":"2024-09-12T01:37:38.526972+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:11.026047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'125","reported_seq":627,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.054270+0000","last_change":"2024-09-12T00:25:10.522261+0000","last_active":"2024-09-12T01:36:09.054270+0000","last_peered":"2024-09-12T01:36:09.054270+0000","last_clean":"2024-09-12T01:36:09.054270+0000","last_became_active":"2024-09-12T00:25:10.521992+0000","last_became_peered":"2024-09-12T00:25:10.521992+0000","last_unstale":"2024-09-12T01:36:09.054270+0000","last_undegraded":"2024-09-12T01:36:09.054270+0000","last_fullsized":"2024-09-12T01:36:09.054270+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:39.515026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":300,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801315+0000","last_change":"2024-09-12T00:25:02.468698+0000","last_active":"2024-09-12T01:35:34.801315+0000","last_peered":"2024-09-12T01:35:34.801315+0000","last_clean":"2024-09-12T01:35:34.801315+0000","last_became_active":"2024-09-12T00:25:02.468401+0000","last_became_peered":"2024-09-12T00:25:02.468401+0000","last_unstale":"2024-09-12T01:35:34.801315+0000","last_undegraded":"2024-09-12T01:35:34.801315+0000","last_fullsized":"2024-09-12T01:35:34.801315+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:25.428427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2162,"num_read_kb":2053,"num_write":481,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'266","reported_seq":936,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.692623+0000","last_change":"2024-09-12T00:25:00.474914+0000","last_active":"2024-09-12T01:37:38.692623+0000","last_peered":"2024-09-12T01:37:38.692623+0000","last_clean":"2024-09-12T01:37:38.692623+0000","last_became_active":"2024-09-12T00:25:00.474471+0000","last_became_peered":"2024-09-12T00:25:00.474471+0000","last_unstale":"2024-09-12T01:37:38.692623+0000","last_undegraded":"2024-09-12T01:37:38.692623+0000","last_fullsized":"2024-09-12T01:37:38.692623+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:32.026867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2612534,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":560,"num_read_kb":17654,"num_write":1154,"num_write_kb":37946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1453,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.303392+0000","last_change":"2024-09-12T00:25:04.483123+0000","last_active":"2024-09-12T01:37:38.303392+0000","last_peered":"2024-09-12T01:37:38.303392+0000","last_clean":"2024-09-12T01:37:38.303392+0000","last_became_active":"2024-09-12T00:25:04.482824+0000","last_became_peered":"2024-09-12T00:25:04.482824+0000","last_unstale":"2024-09-12T01:37:38.303392+0000","last_undegraded":"2024-09-12T01:37:38.303392+0000","last_fullsized":"2024-09-12T01:37:38.303392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:35.937773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":942,"num_read_kb":942,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'103","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.535072+0000","last_change":"2024-09-12T00:25:06.500248+0000","last_active":"2024-09-12T01:35:51.535072+0000","last_peered":"2024-09-12T01:35:51.535072+0000","last_clean":"2024-09-12T01:35:51.535072+0000","last_became_active":"2024-09-12T00:25:06.499937+0000","last_became_peered":"2024-09-12T00:25:06.499937+0000","last_unstale":"2024-09-12T01:35:51.535072+0000","last_undegraded":"2024-09-12T01:35:51.535072+0000","last_fullsized":"2024-09-12T01:35:51.535072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:31.323131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'774","reported_seq":2632,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.527952+0000","last_change":"2024-09-12T00:25:08.502922+0000","last_active":"2024-09-12T01:37:38.527952+0000","last_peered":"2024-09-12T01:37:38.527952+0000","last_clean":"2024-09-12T01:37:38.527952+0000","last_became_active":"2024-09-12T00:25:08.501192+0000","last_became_peered":"2024-09-12T00:25:08.501192+0000","last_unstale":"2024-09-12T01:37:38.527952+0000","last_undegraded":"2024-09-12T01:37:38.527952+0000","last_fullsized":"2024-09-12T01:37:38.527952+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:55.381458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'106","reported_seq":611,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:55.080615+0000","last_change":"2024-09-12T00:25:10.524909+0000","last_active":"2024-09-12T01:33:55.080615+0000","last_peered":"2024-09-12T01:33:55.080615+0000","last_clean":"2024-09-12T01:33:55.080615+0000","last_became_active":"2024-09-12T00:25:10.524610+0000","last_became_peered":"2024-09-12T00:25:10.524610+0000","last_unstale":"2024-09-12T01:33:55.080615+0000","last_undegraded":"2024-09-12T01:33:55.080615+0000","last_fullsized":"2024-09-12T01:33:55.080615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:08.033152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'789","reported_seq":2436,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.408526+0000","last_change":"2024-09-12T00:25:02.479122+0000","last_active":"2024-09-12T01:37:18.408526+0000","last_peered":"2024-09-12T01:37:18.408526+0000","last_clean":"2024-09-12T01:37:18.408526+0000","last_became_active":"2024-09-12T00:25:02.478793+0000","last_became_peered":"2024-09-12T00:25:02.478793+0000","last_unstale":"2024-09-12T01:37:18.408526+0000","last_undegraded":"2024-09-12T01:37:18.408526+0000","last_fullsized":"2024-09-12T01:37:18.408526+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:57.070249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3638,"num_write":1039,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'220","reported_seq":937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.245709+0000","last_change":"2024-09-12T00:25:32.561533+0000","last_active":"2024-09-12T01:34:22.245709+0000","last_peered":"2024-09-12T01:34:22.245709+0000","last_clean":"2024-09-12T01:34:22.245709+0000","last_became_active":"2024-09-12T00:25:32.561102+0000","last_became_peered":"2024-09-12T00:25:32.561102+0000","last_unstale":"2024-09-12T01:34:22.245709+0000","last_undegraded":"2024-09-12T01:34:22.245709+0000","last_fullsized":"2024-09-12T01:34:22.245709+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:17.692906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8796046,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":546,"num_read_kb":71561,"num_write":1039,"num_write_kb":46306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6,0],"acting":[4,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.532031+0000","last_change":"2024-09-12T00:25:04.484834+0000","last_active":"2024-09-12T01:34:49.532031+0000","last_peered":"2024-09-12T01:34:49.532031+0000","last_clean":"2024-09-12T01:34:49.532031+0000","last_became_active":"2024-09-12T00:25:04.484543+0000","last_became_peered":"2024-09-12T00:25:04.484543+0000","last_unstale":"2024-09-12T01:34:49.532031+0000","last_undegraded":"2024-09-12T01:34:49.532031+0000","last_fullsized":"2024-09-12T01:34:49.532031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:42.025957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'305","reported_seq":943,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.642475+0000","last_change":"2024-09-12T00:25:06.497244+0000","last_active":"2024-09-12T01:37:38.642475+0000","last_peered":"2024-09-12T01:37:38.642475+0000","last_clean":"2024-09-12T01:37:38.642475+0000","last_became_active":"2024-09-12T00:25:06.496949+0000","last_became_peered":"2024-09-12T00:25:06.496949+0000","last_unstale":"2024-09-12T01:37:38.642475+0000","last_undegraded":"2024-09-12T01:37:38.642475+0000","last_fullsized":"2024-09-12T01:37:38.642475+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.596588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9140,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1014,"num_read_kb":1082,"num_write":1556,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:55.086981+0000","last_change":"2024-09-12T00:25:08.511378+0000","last_active":"2024-09-12T01:34:55.086981+0000","last_peered":"2024-09-12T01:34:55.086981+0000","last_clean":"2024-09-12T01:34:55.086981+0000","last_became_active":"2024-09-12T00:25:08.511103+0000","last_became_peered":"2024-09-12T00:25:08.511103+0000","last_unstale":"2024-09-12T01:34:55.086981+0000","last_undegraded":"2024-09-12T01:34:55.086981+0000","last_fullsized":"2024-09-12T01:34:55.086981+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:15.770737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'155","reported_seq":659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.023949+0000","last_change":"2024-09-12T00:25:10.524712+0000","last_active":"2024-09-12T01:35:02.023949+0000","last_peered":"2024-09-12T01:35:02.023949+0000","last_clean":"2024-09-12T01:35:02.023949+0000","last_became_active":"2024-09-12T00:25:10.524399+0000","last_became_peered":"2024-09-12T00:25:10.524399+0000","last_unstale":"2024-09-12T01:35:02.023949+0000","last_undegraded":"2024-09-12T01:35:02.023949+0000","last_fullsized":"2024-09-12T01:35:02.023949+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:02.179754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":348,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'525","reported_seq":2110,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.802899+0000","last_change":"2024-09-12T00:25:02.470865+0000","last_active":"2024-09-12T01:35:34.802899+0000","last_peered":"2024-09-12T01:35:34.802899+0000","last_clean":"2024-09-12T01:35:34.802899+0000","last_became_active":"2024-09-12T00:25:02.470508+0000","last_became_peered":"2024-09-12T00:25:02.470508+0000","last_unstale":"2024-09-12T01:35:34.802899+0000","last_undegraded":"2024-09-12T01:35:34.802899+0000","last_fullsized":"2024-09-12T01:35:34.802899+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:21.513113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2852,"num_read_kb":2640,"num_write":653,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":631,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.087190+0000","last_change":"2024-09-12T00:24:40.256272+0000","last_active":"2024-09-12T01:34:54.087190+0000","last_peered":"2024-09-12T01:34:54.087190+0000","last_clean":"2024-09-12T01:34:54.087190+0000","last_became_active":"2024-09-12T00:24:40.255060+0000","last_became_peered":"2024-09-12T00:24:40.255060+0000","last_unstale":"2024-09-12T01:34:54.087190+0000","last_undegraded":"2024-09-12T01:34:54.087190+0000","last_fullsized":"2024-09-12T01:34:54.087190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:39.174906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:39.174906+0000","last_clean_scrub_stamp":"2024-09-12T00:24:39.174906+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:43.340341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.523015+0000","last_change":"2024-09-12T00:24:48.219201+0000","last_active":"2024-09-12T01:33:34.523015+0000","last_peered":"2024-09-12T01:33:34.523015+0000","last_clean":"2024-09-12T01:33:34.523015+0000","last_became_active":"2024-09-12T00:24:46.449286+0000","last_became_peered":"2024-09-12T00:24:46.449286+0000","last_unstale":"2024-09-12T01:33:34.523015+0000","last_undegraded":"2024-09-12T01:33:34.523015+0000","last_fullsized":"2024-09-12T01:33:34.523015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:20.504679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001069263,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'198","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.240940+0000","last_change":"2024-09-12T00:25:00.466263+0000","last_active":"2024-09-12T01:33:47.240940+0000","last_peered":"2024-09-12T01:33:47.240940+0000","last_clean":"2024-09-12T01:33:47.240940+0000","last_became_active":"2024-09-12T00:25:00.465691+0000","last_became_peered":"2024-09-12T00:25:00.465691+0000","last_unstale":"2024-09-12T01:33:47.240940+0000","last_undegraded":"2024-09-12T01:33:47.240940+0000","last_fullsized":"2024-09-12T01:33:47.240940+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:44.824605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588854,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":386,"num_read_kb":3125,"num_write":967,"num_write_kb":16262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.973231+0000","last_change":"2024-09-12T00:25:04.484191+0000","last_active":"2024-09-12T01:33:49.973231+0000","last_peered":"2024-09-12T01:33:49.973231+0000","last_clean":"2024-09-12T01:33:49.973231+0000","last_became_active":"2024-09-12T00:25:04.483893+0000","last_became_peered":"2024-09-12T00:25:04.483893+0000","last_unstale":"2024-09-12T01:33:49.973231+0000","last_undegraded":"2024-09-12T01:33:49.973231+0000","last_fullsized":"2024-09-12T01:33:49.973231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:57.380284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'334","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.767482+0000","last_change":"2024-09-12T00:25:06.497651+0000","last_active":"2024-09-12T01:37:38.767482+0000","last_peered":"2024-09-12T01:37:38.767482+0000","last_clean":"2024-09-12T01:37:38.767482+0000","last_became_active":"2024-09-12T00:25:06.497261+0000","last_became_peered":"2024-09-12T00:25:06.497261+0000","last_unstale":"2024-09-12T01:37:38.767482+0000","last_undegraded":"2024-09-12T01:37:38.767482+0000","last_fullsized":"2024-09-12T01:37:38.767482+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:29.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36159,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":620,"num_read_kb":873,"num_write":540,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:28.995333+0000","last_change":"2024-09-12T00:25:08.509443+0000","last_active":"2024-09-12T01:34:28.995333+0000","last_peered":"2024-09-12T01:34:28.995333+0000","last_clean":"2024-09-12T01:34:28.995333+0000","last_became_active":"2024-09-12T00:25:08.509183+0000","last_became_peered":"2024-09-12T00:25:08.509183+0000","last_unstale":"2024-09-12T01:34:28.995333+0000","last_undegraded":"2024-09-12T01:34:28.995333+0000","last_fullsized":"2024-09-12T01:34:28.995333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:07.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'216","reported_seq":927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.368080+0000","last_change":"2024-09-12T00:25:10.525926+0000","last_active":"2024-09-12T01:36:12.368080+0000","last_peered":"2024-09-12T01:36:12.368080+0000","last_clean":"2024-09-12T01:36:12.368080+0000","last_became_active":"2024-09-12T00:25:10.525441+0000","last_became_peered":"2024-09-12T00:25:10.525441+0000","last_unstale":"2024-09-12T01:36:12.368080+0000","last_undegraded":"2024-09-12T01:36:12.368080+0000","last_fullsized":"2024-09-12T01:36:12.368080+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:21.545364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":453,"num_read_kb":448,"num_write":488,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'808","reported_seq":2391,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.675442+0000","last_change":"2024-09-12T00:25:02.479220+0000","last_active":"2024-09-12T01:35:04.675442+0000","last_peered":"2024-09-12T01:35:04.675442+0000","last_clean":"2024-09-12T01:35:04.675442+0000","last_became_active":"2024-09-12T00:25:02.478919+0000","last_became_peered":"2024-09-12T00:25:02.478919+0000","last_unstale":"2024-09-12T01:35:04.675442+0000","last_undegraded":"2024-09-12T01:35:04.675442+0000","last_fullsized":"2024-09-12T01:35:04.675442+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:03.891856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4003,"num_read_kb":3616,"num_write":1060,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.532517+0000","last_change":"2024-09-12T00:24:48.218739+0000","last_active":"2024-09-12T01:34:54.532517+0000","last_peered":"2024-09-12T01:34:54.532517+0000","last_clean":"2024-09-12T01:34:54.532517+0000","last_became_active":"2024-09-12T00:24:46.216398+0000","last_became_peered":"2024-09-12T00:24:46.216398+0000","last_unstale":"2024-09-12T01:34:54.532517+0000","last_undegraded":"2024-09-12T01:34:54.532517+0000","last_fullsized":"2024-09-12T01:34:54.532517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:54.142561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080348300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'237","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.911839+0000","last_change":"2024-09-12T00:25:00.468216+0000","last_active":"2024-09-12T01:37:38.911839+0000","last_peered":"2024-09-12T01:37:38.911839+0000","last_clean":"2024-09-12T01:37:38.911839+0000","last_became_active":"2024-09-12T00:25:00.467622+0000","last_became_peered":"2024-09-12T00:25:00.467622+0000","last_unstale":"2024-09-12T01:37:38.911839+0000","last_undegraded":"2024-09-12T01:37:38.911839+0000","last_fullsized":"2024-09-12T01:37:38.911839+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:47.186663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":667699,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":22643,"num_write":1048,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.529037+0000","last_change":"2024-09-12T00:25:04.484033+0000","last_active":"2024-09-12T01:34:24.529037+0000","last_peered":"2024-09-12T01:34:24.529037+0000","last_clean":"2024-09-12T01:34:24.529037+0000","last_became_active":"2024-09-12T00:25:04.483752+0000","last_became_peered":"2024-09-12T00:25:04.483752+0000","last_unstale":"2024-09-12T01:34:24.529037+0000","last_undegraded":"2024-09-12T01:34:24.529037+0000","last_fullsized":"2024-09-12T01:34:24.529037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:45.784755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'927","reported_seq":2751,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.831626+0000","last_change":"2024-09-12T00:25:06.492242+0000","last_active":"2024-09-12T01:37:38.831626+0000","last_peered":"2024-09-12T01:37:38.831626+0000","last_clean":"2024-09-12T01:37:38.831626+0000","last_became_active":"2024-09-12T00:25:06.491919+0000","last_became_peered":"2024-09-12T00:25:06.491919+0000","last_unstale":"2024-09-12T01:37:38.831626+0000","last_undegraded":"2024-09-12T01:37:38.831626+0000","last_fullsized":"2024-09-12T01:37:38.831626+0000","mapping_epoch":32,"log_start":"266'900","ondisk_log_start":"266'900","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:27.174380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26860,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1263,"num_read_kb":1464,"num_write":378,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.525990+0000","last_change":"2024-09-12T00:25:08.514605+0000","last_active":"2024-09-12T01:33:59.525990+0000","last_peered":"2024-09-12T01:33:59.525990+0000","last_clean":"2024-09-12T01:33:59.525990+0000","last_became_active":"2024-09-12T00:25:08.514284+0000","last_became_peered":"2024-09-12T00:25:08.514284+0000","last_unstale":"2024-09-12T01:33:59.525990+0000","last_undegraded":"2024-09-12T01:33:59.525990+0000","last_fullsized":"2024-09-12T01:33:59.525990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:57.005332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'199","reported_seq":729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.179557+0000","last_change":"2024-09-12T00:25:10.521984+0000","last_active":"2024-09-12T01:36:11.179557+0000","last_peered":"2024-09-12T01:36:11.179557+0000","last_clean":"2024-09-12T01:36:11.179557+0000","last_became_active":"2024-09-12T00:25:10.521686+0000","last_became_peered":"2024-09-12T00:25:10.521686+0000","last_unstale":"2024-09-12T01:36:11.179557+0000","last_undegraded":"2024-09-12T01:36:11.179557+0000","last_fullsized":"2024-09-12T01:36:11.179557+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:44.218223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":329,"num_write":450,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'457","reported_seq":1918,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338325+0000","last_change":"2024-09-12T00:25:02.472659+0000","last_active":"2024-09-12T01:36:12.338325+0000","last_peered":"2024-09-12T01:36:12.338325+0000","last_clean":"2024-09-12T01:36:12.338325+0000","last_became_active":"2024-09-12T00:25:02.472379+0000","last_became_peered":"2024-09-12T00:25:02.472379+0000","last_unstale":"2024-09-12T01:36:12.338325+0000","last_undegraded":"2024-09-12T01:36:12.338325+0000","last_fullsized":"2024-09-12T01:36:12.338325+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:11.033418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2328,"num_read_kb":2161,"num_write":552,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:35.109804+0000","last_change":"2024-09-12T00:24:48.293366+0000","last_active":"2024-09-12T01:33:35.109804+0000","last_peered":"2024-09-12T01:33:35.109804+0000","last_clean":"2024-09-12T01:33:35.109804+0000","last_became_active":"2024-09-12T00:24:46.219148+0000","last_became_peered":"2024-09-12T00:24:46.219148+0000","last_unstale":"2024-09-12T01:33:35.109804+0000","last_undegraded":"2024-09-12T01:33:35.109804+0000","last_fullsized":"2024-09-12T01:33:35.109804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:43.132714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040735800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'221","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.870176+0000","last_change":"2024-09-12T00:25:00.468826+0000","last_active":"2024-09-12T01:37:38.870176+0000","last_peered":"2024-09-12T01:37:38.870176+0000","last_clean":"2024-09-12T01:37:38.870176+0000","last_became_active":"2024-09-12T00:25:00.468270+0000","last_became_peered":"2024-09-12T00:25:00.468270+0000","last_unstale":"2024-09-12T01:37:38.870176+0000","last_undegraded":"2024-09-12T01:37:38.870176+0000","last_fullsized":"2024-09-12T01:37:38.870176+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.482218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":34464,"num_write":950,"num_write_kb":30398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:25.117408+0000","last_change":"2024-09-12T00:25:04.486850+0000","last_active":"2024-09-12T01:34:25.117408+0000","last_peered":"2024-09-12T01:34:25.117408+0000","last_clean":"2024-09-12T01:34:25.117408+0000","last_became_active":"2024-09-12T00:25:04.486554+0000","last_became_peered":"2024-09-12T00:25:04.486554+0000","last_unstale":"2024-09-12T01:34:25.117408+0000","last_undegraded":"2024-09-12T01:34:25.117408+0000","last_fullsized":"2024-09-12T01:34:25.117408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.290712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'310","reported_seq":1743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:14.925557+0000","last_change":"2024-09-12T00:25:06.495614+0000","last_active":"2024-09-12T01:37:14.925557+0000","last_peered":"2024-09-12T01:37:14.925557+0000","last_clean":"2024-09-12T01:37:14.925557+0000","last_became_active":"2024-09-12T00:25:06.495269+0000","last_became_peered":"2024-09-12T00:25:06.495269+0000","last_unstale":"2024-09-12T01:37:14.925557+0000","last_undegraded":"2024-09-12T01:37:14.925557+0000","last_fullsized":"2024-09-12T01:37:14.925557+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:38.976235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":267,"num_read_kb":257,"num_write":249,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.242368+0000","last_change":"2024-09-12T00:25:08.512053+0000","last_active":"2024-09-12T01:33:57.242368+0000","last_peered":"2024-09-12T01:33:57.242368+0000","last_clean":"2024-09-12T01:33:57.242368+0000","last_became_active":"2024-09-12T00:25:08.511783+0000","last_became_peered":"2024-09-12T00:25:08.511783+0000","last_unstale":"2024-09-12T01:33:57.242368+0000","last_undegraded":"2024-09-12T01:33:57.242368+0000","last_fullsized":"2024-09-12T01:33:57.242368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.395473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'269","reported_seq":883,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:12.270641+0000","last_change":"2024-09-12T00:25:10.525964+0000","last_active":"2024-09-12T01:37:12.270641+0000","last_peered":"2024-09-12T01:37:12.270641+0000","last_clean":"2024-09-12T01:37:12.270641+0000","last_became_active":"2024-09-12T00:25:10.525594+0000","last_became_peered":"2024-09-12T00:25:10.525594+0000","last_unstale":"2024-09-12T01:37:12.270641+0000","last_undegraded":"2024-09-12T01:37:12.270641+0000","last_fullsized":"2024-09-12T01:37:12.270641+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:12.216646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":513,"num_write":584,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'412","reported_seq":1889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.018009+0000","last_change":"2024-09-12T00:25:02.467324+0000","last_active":"2024-09-12T01:35:02.018009+0000","last_peered":"2024-09-12T01:35:02.018009+0000","last_clean":"2024-09-12T01:35:02.018009+0000","last_became_active":"2024-09-12T00:25:02.467022+0000","last_became_peered":"2024-09-12T00:25:02.467022+0000","last_unstale":"2024-09-12T01:35:02.018009+0000","last_undegraded":"2024-09-12T01:35:02.018009+0000","last_fullsized":"2024-09-12T01:35:02.018009+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.341992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2131,"num_read_kb":2016,"num_write":472,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.522983+0000","last_change":"2024-09-12T00:24:48.218472+0000","last_active":"2024-09-12T01:33:34.522983+0000","last_peered":"2024-09-12T01:33:34.522983+0000","last_clean":"2024-09-12T01:33:34.522983+0000","last_became_active":"2024-09-12T00:24:46.296014+0000","last_became_peered":"2024-09-12T00:24:46.296014+0000","last_unstale":"2024-09-12T01:33:34.522983+0000","last_undegraded":"2024-09-12T01:33:34.522983+0000","last_fullsized":"2024-09-12T01:33:34.522983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:16.575080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055221999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'227","reported_seq":859,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.806318+0000","last_change":"2024-09-12T00:25:00.480960+0000","last_active":"2024-09-12T01:37:38.806318+0000","last_peered":"2024-09-12T01:37:38.806318+0000","last_clean":"2024-09-12T01:37:38.806318+0000","last_became_active":"2024-09-12T00:25:00.480242+0000","last_became_peered":"2024-09-12T00:25:00.480242+0000","last_unstale":"2024-09-12T01:37:38.806318+0000","last_undegraded":"2024-09-12T01:37:38.806318+0000","last_fullsized":"2024-09-12T01:37:38.806318+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:45.844641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":8697,"num_write":1016,"num_write_kb":33114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:00.113567+0000","last_change":"2024-09-12T00:25:04.483695+0000","last_active":"2024-09-12T01:34:00.113567+0000","last_peered":"2024-09-12T01:34:00.113567+0000","last_clean":"2024-09-12T01:34:00.113567+0000","last_became_active":"2024-09-12T00:25:04.483224+0000","last_became_peered":"2024-09-12T00:25:04.483224+0000","last_unstale":"2024-09-12T01:34:00.113567+0000","last_undegraded":"2024-09-12T01:34:00.113567+0000","last_fullsized":"2024-09-12T01:34:00.113567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:36.407261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'161","reported_seq":724,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.016537+0000","last_change":"2024-09-12T00:25:06.500894+0000","last_active":"2024-09-12T01:36:39.016537+0000","last_peered":"2024-09-12T01:36:39.016537+0000","last_clean":"2024-09-12T01:36:39.016537+0000","last_became_active":"2024-09-12T00:25:06.500406+0000","last_became_peered":"2024-09-12T00:25:06.500406+0000","last_unstale":"2024-09-12T01:36:39.016537+0000","last_undegraded":"2024-09-12T01:36:39.016537+0000","last_fullsized":"2024-09-12T01:36:39.016537+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:01.547439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":204,"num_read_kb":195,"num_write":150,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529656+0000","last_change":"2024-09-12T00:25:08.510581+0000","last_active":"2024-09-12T01:34:29.529656+0000","last_peered":"2024-09-12T01:34:29.529656+0000","last_clean":"2024-09-12T01:34:29.529656+0000","last_became_active":"2024-09-12T00:25:08.510287+0000","last_became_peered":"2024-09-12T00:25:08.510287+0000","last_unstale":"2024-09-12T01:34:29.529656+0000","last_undegraded":"2024-09-12T01:34:29.529656+0000","last_fullsized":"2024-09-12T01:34:29.529656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:48.633444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'158","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.085171+0000","last_change":"2024-09-12T00:25:10.523899+0000","last_active":"2024-09-12T01:34:34.085171+0000","last_peered":"2024-09-12T01:34:34.085171+0000","last_clean":"2024-09-12T01:34:34.085171+0000","last_became_active":"2024-09-12T00:25:10.523589+0000","last_became_peered":"2024-09-12T00:25:10.523589+0000","last_unstale":"2024-09-12T01:34:34.085171+0000","last_undegraded":"2024-09-12T01:34:34.085171+0000","last_fullsized":"2024-09-12T01:34:34.085171+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:20.406801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":189,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'1613","reported_seq":3209,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.172043+0000","last_change":"2024-09-12T00:25:02.471771+0000","last_active":"2024-09-12T01:36:11.172043+0000","last_peered":"2024-09-12T01:36:11.172043+0000","last_clean":"2024-09-12T01:36:11.172043+0000","last_became_active":"2024-09-12T00:25:02.471491+0000","last_became_peered":"2024-09-12T00:25:02.471491+0000","last_unstale":"2024-09-12T01:36:11.172043+0000","last_undegraded":"2024-09-12T01:36:11.172043+0000","last_fullsized":"2024-09-12T01:36:11.172043+0000","mapping_epoch":28,"log_start":"266'1600","ondisk_log_start":"266'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:00.651310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7163,"num_read_kb":6213,"num_write":2294,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'243","reported_seq":913,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.847696+0000","last_change":"2024-09-12T00:25:00.485158+0000","last_active":"2024-09-12T01:37:38.847696+0000","last_peered":"2024-09-12T01:37:38.847696+0000","last_clean":"2024-09-12T01:37:38.847696+0000","last_became_active":"2024-09-12T00:25:00.484147+0000","last_became_peered":"2024-09-12T00:25:00.484147+0000","last_unstale":"2024-09-12T01:37:38.847696+0000","last_undegraded":"2024-09-12T01:37:38.847696+0000","last_fullsized":"2024-09-12T01:37:38.847696+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:09.449162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":38062,"num_write":1135,"num_write_kb":41091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:33.986492+0000","last_change":"2024-09-12T00:24:48.266785+0000","last_active":"2024-09-12T01:33:33.986492+0000","last_peered":"2024-09-12T01:33:33.986492+0000","last_clean":"2024-09-12T01:33:33.986492+0000","last_became_active":"2024-09-12T00:24:46.295839+0000","last_became_peered":"2024-09-12T00:24:46.295839+0000","last_unstale":"2024-09-12T01:33:33.986492+0000","last_undegraded":"2024-09-12T01:33:33.986492+0000","last_fullsized":"2024-09-12T01:33:33.986492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:07.950890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045367200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.241588+0000","last_change":"2024-09-12T00:25:04.479203+0000","last_active":"2024-09-12T01:33:52.241588+0000","last_peered":"2024-09-12T01:33:52.241588+0000","last_clean":"2024-09-12T01:33:52.241588+0000","last_became_active":"2024-09-12T00:25:04.478947+0000","last_became_peered":"2024-09-12T00:25:04.478947+0000","last_unstale":"2024-09-12T01:33:52.241588+0000","last_undegraded":"2024-09-12T01:33:52.241588+0000","last_fullsized":"2024-09-12T01:33:52.241588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:57.527013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'315","reported_seq":1016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.781701+0000","last_change":"2024-09-12T00:25:06.497179+0000","last_active":"2024-09-12T01:37:38.781701+0000","last_peered":"2024-09-12T01:37:38.781701+0000","last_clean":"2024-09-12T01:37:38.781701+0000","last_became_active":"2024-09-12T00:25:06.496693+0000","last_became_peered":"2024-09-12T00:25:06.496693+0000","last_unstale":"2024-09-12T01:37:38.781701+0000","last_undegraded":"2024-09-12T01:37:38.781701+0000","last_fullsized":"2024-09-12T01:37:38.781701+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:55.147097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":458,"num_read_kb":584,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:55.080589+0000","last_change":"2024-09-12T00:25:08.510222+0000","last_active":"2024-09-12T01:33:55.080589+0000","last_peered":"2024-09-12T01:33:55.080589+0000","last_clean":"2024-09-12T01:33:55.080589+0000","last_became_active":"2024-09-12T00:25:08.509962+0000","last_became_peered":"2024-09-12T00:25:08.509962+0000","last_unstale":"2024-09-12T01:33:55.080589+0000","last_undegraded":"2024-09-12T01:33:55.080589+0000","last_fullsized":"2024-09-12T01:33:55.080589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:01.318302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'143","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.243688+0000","last_change":"2024-09-12T00:25:10.522132+0000","last_active":"2024-09-12T01:36:11.243688+0000","last_peered":"2024-09-12T01:36:11.243688+0000","last_clean":"2024-09-12T01:36:11.243688+0000","last_became_active":"2024-09-12T00:25:10.521670+0000","last_became_peered":"2024-09-12T00:25:10.521670+0000","last_unstale":"2024-09-12T01:36:11.243688+0000","last_undegraded":"2024-09-12T01:36:11.243688+0000","last_fullsized":"2024-09-12T01:36:11.243688+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.340900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":347,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'1208","reported_seq":2855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:02.222588+0000","last_change":"2024-09-12T00:25:02.473486+0000","last_active":"2024-09-12T01:34:02.222588+0000","last_peered":"2024-09-12T01:34:02.222588+0000","last_clean":"2024-09-12T01:34:02.222588+0000","last_became_active":"2024-09-12T00:25:02.473158+0000","last_became_peered":"2024-09-12T00:25:02.473158+0000","last_unstale":"2024-09-12T01:34:02.222588+0000","last_undegraded":"2024-09-12T01:34:02.222588+0000","last_fullsized":"2024-09-12T01:34:02.222588+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:11.141082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5007,"num_write":1669,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'191","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.774056+0000","last_change":"2024-09-12T00:25:00.466317+0000","last_active":"2024-09-12T01:37:38.774056+0000","last_peered":"2024-09-12T01:37:38.774056+0000","last_clean":"2024-09-12T01:37:38.774056+0000","last_became_active":"2024-09-12T00:25:00.465896+0000","last_became_peered":"2024-09-12T00:25:00.465896+0000","last_unstale":"2024-09-12T01:37:38.774056+0000","last_undegraded":"2024-09-12T01:37:38.774056+0000","last_fullsized":"2024-09-12T01:37:38.774056+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:09.955689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702969,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":438,"num_read_kb":13303,"num_write":931,"num_write_kb":18974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523688+0000","last_change":"2024-09-12T00:24:48.218424+0000","last_active":"2024-09-12T01:33:39.523688+0000","last_peered":"2024-09-12T01:33:39.523688+0000","last_clean":"2024-09-12T01:33:39.523688+0000","last_became_active":"2024-09-12T00:24:46.213839+0000","last_became_peered":"2024-09-12T00:24:46.213839+0000","last_unstale":"2024-09-12T01:33:39.523688+0000","last_undegraded":"2024-09-12T01:33:39.523688+0000","last_fullsized":"2024-09-12T01:33:39.523688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.527991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050495300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.973182+0000","last_change":"2024-09-12T00:25:04.481438+0000","last_active":"2024-09-12T01:33:49.973182+0000","last_peered":"2024-09-12T01:33:49.973182+0000","last_clean":"2024-09-12T01:33:49.973182+0000","last_became_active":"2024-09-12T00:25:04.481137+0000","last_became_peered":"2024-09-12T00:25:04.481137+0000","last_unstale":"2024-09-12T01:33:49.973182+0000","last_undegraded":"2024-09-12T01:33:49.973182+0000","last_fullsized":"2024-09-12T01:33:49.973182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:00.812394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'252","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:18.697355+0000","last_change":"2024-09-12T00:25:06.501412+0000","last_active":"2024-09-12T01:36:18.697355+0000","last_peered":"2024-09-12T01:36:18.697355+0000","last_clean":"2024-09-12T01:36:18.697355+0000","last_became_active":"2024-09-12T00:25:06.501118+0000","last_became_peered":"2024-09-12T00:25:06.501118+0000","last_unstale":"2024-09-12T01:36:18.697355+0000","last_undegraded":"2024-09-12T01:36:18.697355+0000","last_fullsized":"2024-09-12T01:36:18.697355+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:25.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":326,"num_read_kb":318,"num_write":296,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'774","reported_seq":2925,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.524835+0000","last_change":"2024-09-12T00:25:08.509879+0000","last_active":"2024-09-12T01:37:38.524835+0000","last_peered":"2024-09-12T01:37:38.524835+0000","last_clean":"2024-09-12T01:37:38.524835+0000","last_became_active":"2024-09-12T00:25:08.509511+0000","last_became_peered":"2024-09-12T00:25:08.509511+0000","last_unstale":"2024-09-12T01:37:38.524835+0000","last_undegraded":"2024-09-12T01:37:38.524835+0000","last_fullsized":"2024-09-12T01:37:38.524835+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:11.392274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'129","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.569096+0000","last_change":"2024-09-12T00:25:10.525336+0000","last_active":"2024-09-12T01:37:19.569096+0000","last_peered":"2024-09-12T01:37:19.569096+0000","last_clean":"2024-09-12T01:37:19.569096+0000","last_became_active":"2024-09-12T00:25:10.524804+0000","last_became_peered":"2024-09-12T00:25:10.524804+0000","last_unstale":"2024-09-12T01:37:19.569096+0000","last_undegraded":"2024-09-12T01:37:19.569096+0000","last_fullsized":"2024-09-12T01:37:19.569096+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:29.933357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'465","reported_seq":2156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801739+0000","last_change":"2024-09-12T00:25:02.463524+0000","last_active":"2024-09-12T01:35:34.801739+0000","last_peered":"2024-09-12T01:35:34.801739+0000","last_clean":"2024-09-12T01:35:34.801739+0000","last_became_active":"2024-09-12T00:25:02.463232+0000","last_became_peered":"2024-09-12T00:25:02.463232+0000","last_unstale":"2024-09-12T01:35:34.801739+0000","last_undegraded":"2024-09-12T01:35:34.801739+0000","last_fullsized":"2024-09-12T01:35:34.801739+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:51.011943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2494,"num_read_kb":2382,"num_write":536,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'237","reported_seq":937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.245831+0000","last_change":"2024-09-12T00:25:00.453017+0000","last_active":"2024-09-12T01:34:22.245831+0000","last_peered":"2024-09-12T01:34:22.245831+0000","last_clean":"2024-09-12T01:34:22.245831+0000","last_became_active":"2024-09-12T00:25:00.452591+0000","last_became_peered":"2024-09-12T00:25:00.452591+0000","last_unstale":"2024-09-12T01:34:22.245831+0000","last_undegraded":"2024-09-12T01:34:22.245831+0000","last_fullsized":"2024-09-12T01:34:22.245831+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:36.167076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8400964,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":773,"num_read_kb":13125,"num_write":980,"num_write_kb":40186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:07.243705+0000","last_change":"2024-09-12T00:24:48.220966+0000","last_active":"2024-09-12T01:34:07.243705+0000","last_peered":"2024-09-12T01:34:07.243705+0000","last_clean":"2024-09-12T01:34:07.243705+0000","last_became_active":"2024-09-12T00:24:46.426160+0000","last_became_peered":"2024-09-12T00:24:46.426160+0000","last_unstale":"2024-09-12T01:34:07.243705+0000","last_undegraded":"2024-09-12T01:34:07.243705+0000","last_fullsized":"2024-09-12T01:34:07.243705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.751628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.524827+0000","last_change":"2024-09-12T00:25:04.483165+0000","last_active":"2024-09-12T01:33:49.524827+0000","last_peered":"2024-09-12T01:33:49.524827+0000","last_clean":"2024-09-12T01:33:49.524827+0000","last_became_active":"2024-09-12T00:25:04.482856+0000","last_became_peered":"2024-09-12T00:25:04.482856+0000","last_unstale":"2024-09-12T01:33:49.524827+0000","last_undegraded":"2024-09-12T01:33:49.524827+0000","last_fullsized":"2024-09-12T01:33:49.524827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:17.015689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'141","reported_seq":706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.422769+0000","last_change":"2024-09-12T00:25:06.498471+0000","last_active":"2024-09-12T01:36:07.422769+0000","last_peered":"2024-09-12T01:36:07.422769+0000","last_clean":"2024-09-12T01:36:07.422769+0000","last_became_active":"2024-09-12T00:25:06.497888+0000","last_became_peered":"2024-09-12T00:25:06.497888+0000","last_unstale":"2024-09-12T01:36:07.422769+0000","last_undegraded":"2024-09-12T01:36:07.422769+0000","last_fullsized":"2024-09-12T01:36:07.422769+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:52.806203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":168,"num_write":116,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'802","reported_seq":2656,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.529336+0000","last_change":"2024-09-12T00:25:08.513106+0000","last_active":"2024-09-12T01:37:38.529336+0000","last_peered":"2024-09-12T01:37:38.529336+0000","last_clean":"2024-09-12T01:37:38.529336+0000","last_became_active":"2024-09-12T00:25:08.512784+0000","last_became_peered":"2024-09-12T00:25:08.512784+0000","last_unstale":"2024-09-12T01:37:38.529336+0000","last_undegraded":"2024-09-12T01:37:38.529336+0000","last_fullsized":"2024-09-12T01:37:38.529336+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:47.339140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'243","reported_seq":771,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:10.294224+0000","last_change":"2024-09-12T00:25:10.523553+0000","last_active":"2024-09-12T01:36:10.294224+0000","last_peered":"2024-09-12T01:36:10.294224+0000","last_clean":"2024-09-12T01:36:10.294224+0000","last_became_active":"2024-09-12T00:25:10.523258+0000","last_became_peered":"2024-09-12T00:25:10.523258+0000","last_unstale":"2024-09-12T01:36:10.294224+0000","last_undegraded":"2024-09-12T01:36:10.294224+0000","last_fullsized":"2024-09-12T01:36:10.294224+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:05.850202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'489","reported_seq":2075,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.600382+0000","last_change":"2024-09-12T00:25:02.468737+0000","last_active":"2024-09-12T01:33:56.600382+0000","last_peered":"2024-09-12T01:33:56.600382+0000","last_clean":"2024-09-12T01:33:56.600382+0000","last_became_active":"2024-09-12T00:25:02.468436+0000","last_became_peered":"2024-09-12T00:25:02.468436+0000","last_unstale":"2024-09-12T01:33:56.600382+0000","last_undegraded":"2024-09-12T01:33:56.600382+0000","last_fullsized":"2024-09-12T01:33:56.600382+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:34.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2713,"num_read_kb":2534,"num_write":588,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'188","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.245804+0000","last_change":"2024-09-12T00:25:00.456455+0000","last_active":"2024-09-12T01:34:22.245804+0000","last_peered":"2024-09-12T01:34:22.245804+0000","last_clean":"2024-09-12T01:34:22.245804+0000","last_became_active":"2024-09-12T00:25:00.456071+0000","last_became_peered":"2024-09-12T00:25:00.456071+0000","last_unstale":"2024-09-12T01:34:22.245804+0000","last_undegraded":"2024-09-12T01:34:22.245804+0000","last_fullsized":"2024-09-12T01:34:22.245804+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:15.020137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6637754,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":419,"num_read_kb":39651,"num_write":889,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.527303+0000","last_change":"2024-09-12T00:24:48.218804+0000","last_active":"2024-09-12T01:34:09.527303+0000","last_peered":"2024-09-12T01:34:09.527303+0000","last_clean":"2024-09-12T01:34:09.527303+0000","last_became_active":"2024-09-12T00:24:46.425908+0000","last_became_peered":"2024-09-12T00:24:46.425908+0000","last_unstale":"2024-09-12T01:34:09.527303+0000","last_undegraded":"2024-09-12T01:34:09.527303+0000","last_fullsized":"2024-09-12T01:34:09.527303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:43.693370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085110299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"38'3","reported_seq":990,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.283815+0000","last_change":"2024-09-12T00:25:04.482182+0000","last_active":"2024-09-12T01:37:19.283815+0000","last_peered":"2024-09-12T01:37:19.283815+0000","last_clean":"2024-09-12T01:37:19.283815+0000","last_became_active":"2024-09-12T00:25:04.481193+0000","last_became_peered":"2024-09-12T00:25:04.481193+0000","last_unstale":"2024-09-12T01:37:19.283815+0000","last_undegraded":"2024-09-12T01:37:19.283815+0000","last_fullsized":"2024-09-12T01:37:19.283815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:59.006487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":711,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'357","reported_seq":1109,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.893836+0000","last_change":"2024-09-12T00:25:06.492488+0000","last_active":"2024-09-12T01:37:38.893836+0000","last_peered":"2024-09-12T01:37:38.893836+0000","last_clean":"2024-09-12T01:37:38.893836+0000","last_became_active":"2024-09-12T00:25:06.492189+0000","last_became_peered":"2024-09-12T00:25:06.492189+0000","last_unstale":"2024-09-12T01:37:38.893836+0000","last_undegraded":"2024-09-12T01:37:38.893836+0000","last_fullsized":"2024-09-12T01:37:38.893836+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:44.290586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35877,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":729,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.242319+0000","last_change":"2024-09-12T00:25:08.510520+0000","last_active":"2024-09-12T01:33:57.242319+0000","last_peered":"2024-09-12T01:33:57.242319+0000","last_clean":"2024-09-12T01:33:57.242319+0000","last_became_active":"2024-09-12T00:25:08.510167+0000","last_became_peered":"2024-09-12T00:25:08.510167+0000","last_unstale":"2024-09-12T01:33:57.242319+0000","last_undegraded":"2024-09-12T01:33:57.242319+0000","last_fullsized":"2024-09-12T01:33:57.242319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:02.351709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'112","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.478978+0000","last_change":"2024-09-12T00:25:10.526124+0000","last_active":"2024-09-12T01:36:12.478978+0000","last_peered":"2024-09-12T01:36:12.478978+0000","last_clean":"2024-09-12T01:36:12.478978+0000","last_became_active":"2024-09-12T00:25:10.525850+0000","last_became_peered":"2024-09-12T00:25:10.525850+0000","last_unstale":"2024-09-12T01:36:12.478978+0000","last_undegraded":"2024-09-12T01:36:12.478978+0000","last_fullsized":"2024-09-12T01:36:12.478978+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:52.252550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'144","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.336165+0000","last_change":"2024-09-12T00:25:10.527379+0000","last_active":"2024-09-12T01:36:11.336165+0000","last_peered":"2024-09-12T01:36:11.336165+0000","last_clean":"2024-09-12T01:36:11.336165+0000","last_became_active":"2024-09-12T00:25:10.526982+0000","last_became_peered":"2024-09-12T00:25:10.526982+0000","last_unstale":"2024-09-12T01:36:11.336165+0000","last_undegraded":"2024-09-12T01:36:11.336165+0000","last_fullsized":"2024-09-12T01:36:11.336165+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:40.227802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":212,"num_write":342,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'493","reported_seq":2074,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.878429+0000","last_change":"2024-09-12T00:25:02.472468+0000","last_active":"2024-09-12T01:35:08.878429+0000","last_peered":"2024-09-12T01:35:08.878429+0000","last_clean":"2024-09-12T01:35:08.878429+0000","last_became_active":"2024-09-12T00:25:02.472013+0000","last_became_peered":"2024-09-12T00:25:02.472013+0000","last_unstale":"2024-09-12T01:35:08.878429+0000","last_undegraded":"2024-09-12T01:35:08.878429+0000","last_fullsized":"2024-09-12T01:35:08.878429+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:27.839901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2517,"num_read_kb":2353,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'215","reported_seq":917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.591988+0000","last_change":"2024-09-12T00:25:00.473993+0000","last_active":"2024-09-12T01:37:38.591988+0000","last_peered":"2024-09-12T01:37:38.591988+0000","last_clean":"2024-09-12T01:37:38.591988+0000","last_became_active":"2024-09-12T00:25:00.473591+0000","last_became_peered":"2024-09-12T00:25:00.473591+0000","last_unstale":"2024-09-12T01:37:38.591988+0000","last_undegraded":"2024-09-12T01:37:38.591988+0000","last_fullsized":"2024-09-12T01:37:38.591988+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:13.812127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308446,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":52508,"num_write":917,"num_write_kb":35191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.179649+0000","last_change":"2024-09-12T00:25:04.480021+0000","last_active":"2024-09-12T01:35:04.179649+0000","last_peered":"2024-09-12T01:35:04.179649+0000","last_clean":"2024-09-12T01:35:04.179649+0000","last_became_active":"2024-09-12T00:25:04.479701+0000","last_became_peered":"2024-09-12T00:25:04.479701+0000","last_unstale":"2024-09-12T01:35:04.179649+0000","last_undegraded":"2024-09-12T01:35:04.179649+0000","last_fullsized":"2024-09-12T01:35:04.179649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:14.742672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'160","reported_seq":756,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.677507+0000","last_change":"2024-09-12T00:25:06.500803+0000","last_active":"2024-09-12T01:37:38.677507+0000","last_peered":"2024-09-12T01:37:38.677507+0000","last_clean":"2024-09-12T01:37:38.677507+0000","last_became_active":"2024-09-12T00:25:06.500315+0000","last_became_peered":"2024-09-12T00:25:06.500315+0000","last_unstale":"2024-09-12T01:37:38.677507+0000","last_undegraded":"2024-09-12T01:37:38.677507+0000","last_fullsized":"2024-09-12T01:37:38.677507+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:36.321812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6391,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":221,"num_read_kb":264,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.123727+0000","last_change":"2024-09-12T00:25:08.517253+0000","last_active":"2024-09-12T01:35:10.123727+0000","last_peered":"2024-09-12T01:35:10.123727+0000","last_clean":"2024-09-12T01:35:10.123727+0000","last_became_active":"2024-09-12T00:25:08.516921+0000","last_became_peered":"2024-09-12T00:25:08.516921+0000","last_unstale":"2024-09-12T01:35:10.123727+0000","last_undegraded":"2024-09-12T01:35:10.123727+0000","last_fullsized":"2024-09-12T01:35:10.123727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:11.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'115","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:25.126051+0000","last_change":"2024-09-12T00:25:10.525063+0000","last_active":"2024-09-12T01:35:25.126051+0000","last_peered":"2024-09-12T01:35:25.126051+0000","last_clean":"2024-09-12T01:35:25.126051+0000","last_became_active":"2024-09-12T00:25:10.524416+0000","last_became_peered":"2024-09-12T00:25:10.524416+0000","last_unstale":"2024-09-12T01:35:25.126051+0000","last_undegraded":"2024-09-12T01:35:25.126051+0000","last_fullsized":"2024-09-12T01:35:25.126051+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:13.897999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":157,"num_read_kb":134,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'449","reported_seq":2012,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.193697+0000","last_change":"2024-09-12T00:25:02.473711+0000","last_active":"2024-09-12T01:36:11.193697+0000","last_peered":"2024-09-12T01:36:11.193697+0000","last_clean":"2024-09-12T01:36:11.193697+0000","last_became_active":"2024-09-12T00:25:02.471242+0000","last_became_peered":"2024-09-12T00:25:02.471242+0000","last_unstale":"2024-09-12T01:36:11.193697+0000","last_undegraded":"2024-09-12T01:36:11.193697+0000","last_fullsized":"2024-09-12T01:36:11.193697+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:25.707605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2437,"num_read_kb":2317,"num_write":523,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'218","reported_seq":878,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.857523+0000","last_change":"2024-09-12T00:25:00.481178+0000","last_active":"2024-09-12T01:37:38.857523+0000","last_peered":"2024-09-12T01:37:38.857523+0000","last_clean":"2024-09-12T01:37:38.857523+0000","last_became_active":"2024-09-12T00:25:00.480801+0000","last_became_peered":"2024-09-12T00:25:00.480801+0000","last_unstale":"2024-09-12T01:37:38.857523+0000","last_undegraded":"2024-09-12T01:37:38.857523+0000","last_fullsized":"2024-09-12T01:37:38.857523+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:23.032999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288330,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":555,"num_read_kb":14522,"num_write":924,"num_write_kb":19421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:07.252680+0000","last_change":"2024-09-12T00:25:04.484027+0000","last_active":"2024-09-12T01:35:07.252680+0000","last_peered":"2024-09-12T01:35:07.252680+0000","last_clean":"2024-09-12T01:35:07.252680+0000","last_became_active":"2024-09-12T00:25:04.482891+0000","last_became_peered":"2024-09-12T00:25:04.482891+0000","last_unstale":"2024-09-12T01:35:07.252680+0000","last_undegraded":"2024-09-12T01:35:07.252680+0000","last_fullsized":"2024-09-12T01:35:07.252680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:48.325429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'68","reported_seq":592,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:43.925146+0000","last_change":"2024-09-12T00:25:06.501436+0000","last_active":"2024-09-12T01:35:43.925146+0000","last_peered":"2024-09-12T01:35:43.925146+0000","last_clean":"2024-09-12T01:35:43.925146+0000","last_became_active":"2024-09-12T00:25:06.501049+0000","last_became_peered":"2024-09-12T00:25:06.501049+0000","last_unstale":"2024-09-12T01:35:43.925146+0000","last_undegraded":"2024-09-12T01:35:43.925146+0000","last_fullsized":"2024-09-12T01:35:43.925146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:39.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":50,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088627+0000","last_change":"2024-09-12T00:25:08.506372+0000","last_active":"2024-09-12T01:35:10.088627+0000","last_peered":"2024-09-12T01:35:10.088627+0000","last_clean":"2024-09-12T01:35:10.088627+0000","last_became_active":"2024-09-12T00:25:08.506052+0000","last_became_peered":"2024-09-12T00:25:08.506052+0000","last_unstale":"2024-09-12T01:35:10.088627+0000","last_undegraded":"2024-09-12T01:35:10.088627+0000","last_fullsized":"2024-09-12T01:35:10.088627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:29.150145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'177","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.160319+0000","last_change":"2024-09-12T00:25:10.525258+0000","last_active":"2024-09-12T01:36:11.160319+0000","last_peered":"2024-09-12T01:36:11.160319+0000","last_clean":"2024-09-12T01:36:11.160319+0000","last_became_active":"2024-09-12T00:25:10.524992+0000","last_became_peered":"2024-09-12T00:25:10.524992+0000","last_unstale":"2024-09-12T01:36:11.160319+0000","last_undegraded":"2024-09-12T01:36:11.160319+0000","last_fullsized":"2024-09-12T01:36:11.160319+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:04.187071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":300,"num_read_kb":289,"num_write":406,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'593","reported_seq":2213,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428085+0000","last_change":"2024-09-12T00:25:02.468999+0000","last_active":"2024-09-12T01:37:18.428085+0000","last_peered":"2024-09-12T01:37:18.428085+0000","last_clean":"2024-09-12T01:37:18.428085+0000","last_became_active":"2024-09-12T00:25:02.468715+0000","last_became_peered":"2024-09-12T00:25:02.468715+0000","last_unstale":"2024-09-12T01:37:18.428085+0000","last_undegraded":"2024-09-12T01:37:18.428085+0000","last_fullsized":"2024-09-12T01:37:18.428085+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:09.616582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2927,"num_read_kb":2680,"num_write":750,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'255","reported_seq":904,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.668798+0000","last_change":"2024-09-12T00:25:00.482223+0000","last_active":"2024-09-12T01:37:38.668798+0000","last_peered":"2024-09-12T01:37:38.668798+0000","last_clean":"2024-09-12T01:37:38.668798+0000","last_became_active":"2024-09-12T00:25:00.481741+0000","last_became_peered":"2024-09-12T00:25:00.481741+0000","last_unstale":"2024-09-12T01:37:38.668798+0000","last_undegraded":"2024-09-12T01:37:38.668798+0000","last_fullsized":"2024-09-12T01:37:38.668798+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:46.144319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":2782,"num_write":1086,"num_write_kb":27824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088007+0000","last_change":"2024-09-12T00:25:04.476625+0000","last_active":"2024-09-12T01:35:05.088007+0000","last_peered":"2024-09-12T01:35:05.088007+0000","last_clean":"2024-09-12T01:35:05.088007+0000","last_became_active":"2024-09-12T00:25:04.476356+0000","last_became_peered":"2024-09-12T00:25:04.476356+0000","last_unstale":"2024-09-12T01:35:05.088007+0000","last_undegraded":"2024-09-12T01:35:05.088007+0000","last_fullsized":"2024-09-12T01:35:05.088007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.898254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'186","reported_seq":793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.905124+0000","last_change":"2024-09-12T00:25:06.496641+0000","last_active":"2024-09-12T01:37:38.905124+0000","last_peered":"2024-09-12T01:37:38.905124+0000","last_clean":"2024-09-12T01:37:38.905124+0000","last_became_active":"2024-09-12T00:25:06.496372+0000","last_became_peered":"2024-09-12T00:25:06.496372+0000","last_unstale":"2024-09-12T01:37:38.905124+0000","last_undegraded":"2024-09-12T01:37:38.905124+0000","last_fullsized":"2024-09-12T01:37:38.905124+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:02.866379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11132,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":274,"num_read_kb":379,"num_write":160,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088829+0000","last_change":"2024-09-12T00:25:08.509562+0000","last_active":"2024-09-12T01:35:09.088829+0000","last_peered":"2024-09-12T01:35:09.088829+0000","last_clean":"2024-09-12T01:35:09.088829+0000","last_became_active":"2024-09-12T00:25:08.508336+0000","last_became_peered":"2024-09-12T00:25:08.508336+0000","last_unstale":"2024-09-12T01:35:09.088829+0000","last_undegraded":"2024-09-12T01:35:09.088829+0000","last_fullsized":"2024-09-12T01:35:09.088829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:42.261339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'122","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:53.484506+0000","last_change":"2024-09-12T00:25:10.524167+0000","last_active":"2024-09-12T01:34:53.484506+0000","last_peered":"2024-09-12T01:34:53.484506+0000","last_clean":"2024-09-12T01:34:53.484506+0000","last_became_active":"2024-09-12T00:25:10.522375+0000","last_became_peered":"2024-09-12T00:25:10.522375+0000","last_unstale":"2024-09-12T01:34:53.484506+0000","last_undegraded":"2024-09-12T01:34:53.484506+0000","last_fullsized":"2024-09-12T01:34:53.484506+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:07.393133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":308,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'819","reported_seq":2384,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.833892+0000","last_change":"2024-09-12T00:25:02.473893+0000","last_active":"2024-09-12T01:35:16.833892+0000","last_peered":"2024-09-12T01:35:16.833892+0000","last_clean":"2024-09-12T01:35:16.833892+0000","last_became_active":"2024-09-12T00:25:02.473631+0000","last_became_peered":"2024-09-12T00:25:02.473631+0000","last_unstale":"2024-09-12T01:35:16.833892+0000","last_undegraded":"2024-09-12T01:35:16.833892+0000","last_fullsized":"2024-09-12T01:35:16.833892+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:23.372646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3838,"num_read_kb":3448,"num_write":1071,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'213","reported_seq":856,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.797969+0000","last_change":"2024-09-12T00:25:00.462263+0000","last_active":"2024-09-12T01:37:38.797969+0000","last_peered":"2024-09-12T01:37:38.797969+0000","last_clean":"2024-09-12T01:37:38.797969+0000","last_became_active":"2024-09-12T00:25:00.461875+0000","last_became_peered":"2024-09-12T00:25:00.461875+0000","last_unstale":"2024-09-12T01:37:38.797969+0000","last_undegraded":"2024-09-12T01:37:38.797969+0000","last_fullsized":"2024-09-12T01:37:38.797969+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:08.987863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288524,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":40693,"num_write":998,"num_write_kb":39273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533703+0000","last_change":"2024-09-12T00:25:04.486530+0000","last_active":"2024-09-12T01:35:04.533703+0000","last_peered":"2024-09-12T01:35:04.533703+0000","last_clean":"2024-09-12T01:35:04.533703+0000","last_became_active":"2024-09-12T00:25:04.486195+0000","last_became_peered":"2024-09-12T00:25:04.486195+0000","last_unstale":"2024-09-12T01:35:04.533703+0000","last_undegraded":"2024-09-12T01:35:04.533703+0000","last_fullsized":"2024-09-12T01:35:04.533703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:28.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'153","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.875995+0000","last_change":"2024-09-12T00:25:06.493690+0000","last_active":"2024-09-12T01:37:38.875995+0000","last_peered":"2024-09-12T01:37:38.875995+0000","last_clean":"2024-09-12T01:37:38.875995+0000","last_became_active":"2024-09-12T00:25:06.493276+0000","last_became_peered":"2024-09-12T00:25:06.493276+0000","last_unstale":"2024-09-12T01:37:38.875995+0000","last_undegraded":"2024-09-12T01:37:38.875995+0000","last_fullsized":"2024-09-12T01:37:38.875995+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:57.912640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":282,"num_write":108,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.123775+0000","last_change":"2024-09-12T00:25:08.513038+0000","last_active":"2024-09-12T01:35:10.123775+0000","last_peered":"2024-09-12T01:35:10.123775+0000","last_clean":"2024-09-12T01:35:10.123775+0000","last_became_active":"2024-09-12T00:25:08.512647+0000","last_became_peered":"2024-09-12T00:25:08.512647+0000","last_unstale":"2024-09-12T01:35:10.123775+0000","last_undegraded":"2024-09-12T01:35:10.123775+0000","last_fullsized":"2024-09-12T01:35:10.123775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:28.714653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'319","reported_seq":1615,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.676199+0000","last_change":"2024-09-12T00:25:02.475789+0000","last_active":"2024-09-12T01:35:04.676199+0000","last_peered":"2024-09-12T01:35:04.676199+0000","last_clean":"2024-09-12T01:35:04.676199+0000","last_became_active":"2024-09-12T00:25:02.475490+0000","last_became_peered":"2024-09-12T00:25:02.475490+0000","last_unstale":"2024-09-12T01:35:04.676199+0000","last_undegraded":"2024-09-12T01:35:04.676199+0000","last_fullsized":"2024-09-12T01:35:04.676199+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:44.106869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1691,"num_read_kb":1609,"num_write":373,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'212","reported_seq":820,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.816248+0000","last_change":"2024-09-12T00:25:00.462380+0000","last_active":"2024-09-12T01:37:38.816248+0000","last_peered":"2024-09-12T01:37:38.816248+0000","last_clean":"2024-09-12T01:37:38.816248+0000","last_became_active":"2024-09-12T00:25:00.462022+0000","last_became_peered":"2024-09-12T00:25:00.462022+0000","last_unstale":"2024-09-12T01:37:38.816248+0000","last_undegraded":"2024-09-12T01:37:38.816248+0000","last_fullsized":"2024-09-12T01:37:38.816248+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:53.418485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":5153,"num_write":1017,"num_write_kb":32149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.182675+0000","last_change":"2024-09-12T00:25:04.487420+0000","last_active":"2024-09-12T01:35:24.182675+0000","last_peered":"2024-09-12T01:35:24.182675+0000","last_clean":"2024-09-12T01:35:24.182675+0000","last_became_active":"2024-09-12T00:25:04.487192+0000","last_became_peered":"2024-09-12T00:25:04.487192+0000","last_unstale":"2024-09-12T01:35:24.182675+0000","last_undegraded":"2024-09-12T01:35:24.182675+0000","last_fullsized":"2024-09-12T01:35:24.182675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:45.179481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'229","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.864437+0000","last_change":"2024-09-12T00:25:06.498928+0000","last_active":"2024-09-12T01:37:38.864437+0000","last_peered":"2024-09-12T01:37:38.864437+0000","last_clean":"2024-09-12T01:37:38.864437+0000","last_became_active":"2024-09-12T00:25:06.498651+0000","last_became_peered":"2024-09-12T00:25:06.498651+0000","last_unstale":"2024-09-12T01:37:38.864437+0000","last_undegraded":"2024-09-12T01:37:38.864437+0000","last_fullsized":"2024-09-12T01:37:38.864437+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:22.315708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9365,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":332,"num_read_kb":425,"num_write":210,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088704+0000","last_change":"2024-09-12T00:25:08.507366+0000","last_active":"2024-09-12T01:35:10.088704+0000","last_peered":"2024-09-12T01:35:10.088704+0000","last_clean":"2024-09-12T01:35:10.088704+0000","last_became_active":"2024-09-12T00:25:08.507090+0000","last_became_peered":"2024-09-12T00:25:08.507090+0000","last_unstale":"2024-09-12T01:35:10.088704+0000","last_undegraded":"2024-09-12T01:35:10.088704+0000","last_fullsized":"2024-09-12T01:35:10.088704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:09.874475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'186","reported_seq":707,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.725493+0000","last_change":"2024-09-12T00:25:10.522192+0000","last_active":"2024-09-12T01:36:09.725493+0000","last_peered":"2024-09-12T01:36:09.725493+0000","last_clean":"2024-09-12T01:36:09.725493+0000","last_became_active":"2024-09-12T00:25:10.521886+0000","last_became_peered":"2024-09-12T00:25:10.521886+0000","last_unstale":"2024-09-12T01:36:09.725493+0000","last_undegraded":"2024-09-12T01:36:09.725493+0000","last_fullsized":"2024-09-12T01:36:09.725493+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.743861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":280,"num_read_kb":274,"num_write":435,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'456","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.411387+0000","last_change":"2024-09-12T00:25:02.463605+0000","last_active":"2024-09-12T01:37:18.411387+0000","last_peered":"2024-09-12T01:37:18.411387+0000","last_clean":"2024-09-12T01:37:18.411387+0000","last_became_active":"2024-09-12T00:25:02.463187+0000","last_became_peered":"2024-09-12T00:25:02.463187+0000","last_unstale":"2024-09-12T01:37:18.411387+0000","last_undegraded":"2024-09-12T01:37:18.411387+0000","last_fullsized":"2024-09-12T01:37:18.411387+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:03.195160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2353,"num_read_kb":2190,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'296","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:52.232470+0000","last_change":"2024-09-12T00:25:00.469310+0000","last_active":"2024-09-12T01:32:52.232470+0000","last_peered":"2024-09-12T01:32:52.232470+0000","last_clean":"2024-09-12T01:32:52.232470+0000","last_became_active":"2024-09-12T00:25:00.467785+0000","last_became_peered":"2024-09-12T00:25:00.467785+0000","last_unstale":"2024-09-12T01:32:52.232470+0000","last_undegraded":"2024-09-12T01:32:52.232470+0000","last_fullsized":"2024-09-12T01:32:52.232470+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:53.465549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65959,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":728,"num_read_kb":946,"num_write":1130,"num_write_kb":20145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:50.080174+0000","last_change":"2024-09-12T00:25:04.484951+0000","last_active":"2024-09-12T01:33:50.080174+0000","last_peered":"2024-09-12T01:33:50.080174+0000","last_clean":"2024-09-12T01:33:50.080174+0000","last_became_active":"2024-09-12T00:25:04.484608+0000","last_became_peered":"2024-09-12T00:25:04.484608+0000","last_unstale":"2024-09-12T01:33:50.080174+0000","last_undegraded":"2024-09-12T01:33:50.080174+0000","last_fullsized":"2024-09-12T01:33:50.080174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:12.048616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'198","reported_seq":805,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.885494+0000","last_change":"2024-09-12T00:25:06.490294+0000","last_active":"2024-09-12T01:37:38.885494+0000","last_peered":"2024-09-12T01:37:38.885494+0000","last_clean":"2024-09-12T01:37:38.885494+0000","last_became_active":"2024-09-12T00:25:06.489578+0000","last_became_peered":"2024-09-12T00:25:06.489578+0000","last_unstale":"2024-09-12T01:37:38.885494+0000","last_undegraded":"2024-09-12T01:37:38.885494+0000","last_fullsized":"2024-09-12T01:37:38.885494+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:10.076563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7791,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":284,"num_read_kb":342,"num_write":192,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.002258+0000","last_change":"2024-09-12T00:25:08.513646+0000","last_active":"2024-09-12T01:35:09.002258+0000","last_peered":"2024-09-12T01:35:09.002258+0000","last_clean":"2024-09-12T01:35:09.002258+0000","last_became_active":"2024-09-12T00:25:08.513330+0000","last_became_peered":"2024-09-12T00:25:08.513330+0000","last_unstale":"2024-09-12T01:35:09.002258+0000","last_undegraded":"2024-09-12T01:35:09.002258+0000","last_fullsized":"2024-09-12T01:35:09.002258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:40.371456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'218","reported_seq":1100,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:08.536614+0000","last_change":"2024-09-12T00:25:10.527941+0000","last_active":"2024-09-12T01:36:08.536614+0000","last_peered":"2024-09-12T01:36:08.536614+0000","last_clean":"2024-09-12T01:36:08.536614+0000","last_became_active":"2024-09-12T00:25:10.527649+0000","last_became_peered":"2024-09-12T00:25:10.527649+0000","last_unstale":"2024-09-12T01:36:08.536614+0000","last_undegraded":"2024-09-12T01:36:08.536614+0000","last_fullsized":"2024-09-12T01:36:08.536614+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:30.223583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":648,"num_write":596,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'365","reported_seq":1815,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.802431+0000","last_change":"2024-09-12T00:25:02.479298+0000","last_active":"2024-09-12T01:35:34.802431+0000","last_peered":"2024-09-12T01:35:34.802431+0000","last_clean":"2024-09-12T01:35:34.802431+0000","last_became_active":"2024-09-12T00:25:02.479051+0000","last_became_peered":"2024-09-12T00:25:02.479051+0000","last_unstale":"2024-09-12T01:35:34.802431+0000","last_undegraded":"2024-09-12T01:35:34.802431+0000","last_fullsized":"2024-09-12T01:35:34.802431+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:59.990966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1824,"num_write":392,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'196","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.732801+0000","last_change":"2024-09-12T00:25:00.455462+0000","last_active":"2024-09-12T01:37:38.732801+0000","last_peered":"2024-09-12T01:37:38.732801+0000","last_clean":"2024-09-12T01:37:38.732801+0000","last_became_active":"2024-09-12T00:25:00.454796+0000","last_became_peered":"2024-09-12T00:25:00.454796+0000","last_unstale":"2024-09-12T01:37:38.732801+0000","last_undegraded":"2024-09-12T01:37:38.732801+0000","last_fullsized":"2024-09-12T01:37:38.732801+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:11.220113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661693,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":2462,"num_write":975,"num_write_kb":27053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088088+0000","last_change":"2024-09-12T00:25:04.475794+0000","last_active":"2024-09-12T01:35:05.088088+0000","last_peered":"2024-09-12T01:35:05.088088+0000","last_clean":"2024-09-12T01:35:05.088088+0000","last_became_active":"2024-09-12T00:25:04.475432+0000","last_became_peered":"2024-09-12T00:25:04.475432+0000","last_unstale":"2024-09-12T01:35:05.088088+0000","last_undegraded":"2024-09-12T01:35:05.088088+0000","last_fullsized":"2024-09-12T01:35:05.088088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:40.125056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'174","reported_seq":773,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.727058+0000","last_change":"2024-09-12T00:25:06.500060+0000","last_active":"2024-09-12T01:37:38.727058+0000","last_peered":"2024-09-12T01:37:38.727058+0000","last_clean":"2024-09-12T01:37:38.727058+0000","last_became_active":"2024-09-12T00:25:06.499452+0000","last_became_peered":"2024-09-12T00:25:06.499452+0000","last_unstale":"2024-09-12T01:37:38.727058+0000","last_undegraded":"2024-09-12T01:37:38.727058+0000","last_fullsized":"2024-09-12T01:37:38.727058+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:39.160375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6920,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":302,"num_write":132,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125335+0000","last_change":"2024-09-12T00:25:08.514860+0000","last_active":"2024-09-12T01:35:20.125335+0000","last_peered":"2024-09-12T01:35:20.125335+0000","last_clean":"2024-09-12T01:35:20.125335+0000","last_became_active":"2024-09-12T00:25:08.514591+0000","last_became_peered":"2024-09-12T00:25:08.514591+0000","last_unstale":"2024-09-12T01:35:20.125335+0000","last_undegraded":"2024-09-12T01:35:20.125335+0000","last_fullsized":"2024-09-12T01:35:20.125335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:20.635770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'120","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.574196+0000","last_change":"2024-09-12T00:25:10.527404+0000","last_active":"2024-09-12T01:37:19.574196+0000","last_peered":"2024-09-12T01:37:19.574196+0000","last_clean":"2024-09-12T01:37:19.574196+0000","last_became_active":"2024-09-12T00:25:10.527125+0000","last_became_peered":"2024-09-12T00:25:10.527125+0000","last_unstale":"2024-09-12T01:37:19.574196+0000","last_undegraded":"2024-09-12T01:37:19.574196+0000","last_fullsized":"2024-09-12T01:37:19.574196+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:04.270864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":179,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'797","reported_seq":2247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.251816+0000","last_change":"2024-09-12T00:25:02.464662+0000","last_active":"2024-09-12T01:35:02.251816+0000","last_peered":"2024-09-12T01:35:02.251816+0000","last_clean":"2024-09-12T01:35:02.251816+0000","last_became_active":"2024-09-12T00:25:02.464409+0000","last_became_peered":"2024-09-12T00:25:02.464409+0000","last_unstale":"2024-09-12T01:35:02.251816+0000","last_undegraded":"2024-09-12T01:35:02.251816+0000","last_fullsized":"2024-09-12T01:35:02.251816+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:53.007518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3724,"num_read_kb":3326,"num_write":1070,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'240","reported_seq":920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.251765+0000","last_change":"2024-09-12T00:25:00.466956+0000","last_active":"2024-09-12T01:35:02.251765+0000","last_peered":"2024-09-12T01:35:02.251765+0000","last_clean":"2024-09-12T01:35:02.251765+0000","last_became_active":"2024-09-12T00:25:00.466015+0000","last_became_peered":"2024-09-12T00:25:00.466015+0000","last_unstale":"2024-09-12T01:35:02.251765+0000","last_undegraded":"2024-09-12T01:35:02.251765+0000","last_fullsized":"2024-09-12T01:35:02.251765+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:26.695504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6701232,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":59877,"num_write":1078,"num_write_kb":30675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:07.252715+0000","last_change":"2024-09-12T00:25:04.482399+0000","last_active":"2024-09-12T01:35:07.252715+0000","last_peered":"2024-09-12T01:35:07.252715+0000","last_clean":"2024-09-12T01:35:07.252715+0000","last_became_active":"2024-09-12T00:25:04.482091+0000","last_became_peered":"2024-09-12T00:25:04.482091+0000","last_unstale":"2024-09-12T01:35:07.252715+0000","last_undegraded":"2024-09-12T01:35:07.252715+0000","last_fullsized":"2024-09-12T01:35:07.252715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.772204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'124","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.560906+0000","last_change":"2024-09-12T00:25:06.492106+0000","last_active":"2024-09-12T01:36:07.560906+0000","last_peered":"2024-09-12T01:36:07.560906+0000","last_clean":"2024-09-12T01:36:07.560906+0000","last_became_active":"2024-09-12T00:25:06.491582+0000","last_became_peered":"2024-09-12T00:25:06.491582+0000","last_unstale":"2024-09-12T01:36:07.560906+0000","last_undegraded":"2024-09-12T01:36:07.560906+0000","last_fullsized":"2024-09-12T01:36:07.560906+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:35.340695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":169,"num_read_kb":163,"num_write":166,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'765","reported_seq":2555,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.523342+0000","last_change":"2024-09-12T00:25:08.507545+0000","last_active":"2024-09-12T01:37:38.523342+0000","last_peered":"2024-09-12T01:37:38.523342+0000","last_clean":"2024-09-12T01:37:38.523342+0000","last_became_active":"2024-09-12T00:25:08.506288+0000","last_became_peered":"2024-09-12T00:25:08.506288+0000","last_unstale":"2024-09-12T01:37:38.523342+0000","last_undegraded":"2024-09-12T01:37:38.523342+0000","last_fullsized":"2024-09-12T01:37:38.523342+0000","mapping_epoch":34,"log_start":"266'701","ondisk_log_start":"266'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:41.048601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'126","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.534992+0000","last_change":"2024-09-12T00:25:10.525346+0000","last_active":"2024-09-12T01:35:14.534992+0000","last_peered":"2024-09-12T01:35:14.534992+0000","last_clean":"2024-09-12T01:35:14.534992+0000","last_became_active":"2024-09-12T00:25:10.525045+0000","last_became_peered":"2024-09-12T00:25:10.525045+0000","last_unstale":"2024-09-12T01:35:14.534992+0000","last_undegraded":"2024-09-12T01:35:14.534992+0000","last_fullsized":"2024-09-12T01:35:14.534992+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:19.669222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'457","reported_seq":2071,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.489386+0000","last_change":"2024-09-12T00:25:02.471992+0000","last_active":"2024-09-12T01:35:19.489386+0000","last_peered":"2024-09-12T01:35:19.489386+0000","last_clean":"2024-09-12T01:35:19.489386+0000","last_became_active":"2024-09-12T00:25:02.471255+0000","last_became_peered":"2024-09-12T00:25:02.471255+0000","last_unstale":"2024-09-12T01:35:19.489386+0000","last_undegraded":"2024-09-12T01:35:19.489386+0000","last_fullsized":"2024-09-12T01:35:19.489386+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:31.823002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2599,"num_read_kb":2460,"num_write":533,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'175","reported_seq":811,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.900378+0000","last_change":"2024-09-12T00:25:00.458803+0000","last_active":"2024-09-12T01:37:38.900378+0000","last_peered":"2024-09-12T01:37:38.900378+0000","last_clean":"2024-09-12T01:37:38.900378+0000","last_became_active":"2024-09-12T00:25:00.456853+0000","last_became_peered":"2024-09-12T00:25:00.456853+0000","last_unstale":"2024-09-12T01:37:38.900378+0000","last_undegraded":"2024-09-12T01:37:38.900378+0000","last_fullsized":"2024-09-12T01:37:38.900378+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:13.587033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1794910,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":16809,"num_write":841,"num_write_kb":28613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.088296+0000","last_change":"2024-09-12T00:25:04.482756+0000","last_active":"2024-09-12T01:35:04.088296+0000","last_peered":"2024-09-12T01:35:04.088296+0000","last_clean":"2024-09-12T01:35:04.088296+0000","last_became_active":"2024-09-12T00:25:04.482441+0000","last_became_peered":"2024-09-12T00:25:04.482441+0000","last_unstale":"2024-09-12T01:35:04.088296+0000","last_undegraded":"2024-09-12T01:35:04.088296+0000","last_fullsized":"2024-09-12T01:35:04.088296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:06.666983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'219","reported_seq":854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.799555+0000","last_change":"2024-09-12T00:25:06.494170+0000","last_active":"2024-09-12T01:37:38.799555+0000","last_peered":"2024-09-12T01:37:38.799555+0000","last_clean":"2024-09-12T01:37:38.799555+0000","last_became_active":"2024-09-12T00:25:06.493625+0000","last_became_peered":"2024-09-12T00:25:06.493625+0000","last_unstale":"2024-09-12T01:37:38.799555+0000","last_undegraded":"2024-09-12T01:37:38.799555+0000","last_fullsized":"2024-09-12T01:37:38.799555+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:01.532658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9308,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":374,"num_write":180,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:52.232442+0000","last_change":"2024-09-12T00:25:08.511276+0000","last_active":"2024-09-12T01:32:52.232442+0000","last_peered":"2024-09-12T01:32:52.232442+0000","last_clean":"2024-09-12T01:32:52.232442+0000","last_became_active":"2024-09-12T00:25:08.511024+0000","last_became_peered":"2024-09-12T00:25:08.511024+0000","last_unstale":"2024-09-12T01:32:52.232442+0000","last_undegraded":"2024-09-12T01:32:52.232442+0000","last_fullsized":"2024-09-12T01:32:52.232442+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:18.243804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'102","reported_seq":610,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.090066+0000","last_change":"2024-09-12T00:25:10.526277+0000","last_active":"2024-09-12T01:35:19.090066+0000","last_peered":"2024-09-12T01:35:19.090066+0000","last_clean":"2024-09-12T01:35:19.090066+0000","last_became_active":"2024-09-12T00:25:10.525981+0000","last_became_peered":"2024-09-12T00:25:10.525981+0000","last_unstale":"2024-09-12T01:35:19.090066+0000","last_undegraded":"2024-09-12T01:35:19.090066+0000","last_fullsized":"2024-09-12T01:35:19.090066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:24.715656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":244,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'801","reported_seq":2397,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.430285+0000","last_change":"2024-09-12T00:25:02.463863+0000","last_active":"2024-09-12T01:37:18.430285+0000","last_peered":"2024-09-12T01:37:18.430285+0000","last_clean":"2024-09-12T01:37:18.430285+0000","last_became_active":"2024-09-12T00:25:02.463545+0000","last_became_peered":"2024-09-12T00:25:02.463545+0000","last_unstale":"2024-09-12T01:37:18.430285+0000","last_undegraded":"2024-09-12T01:37:18.430285+0000","last_fullsized":"2024-09-12T01:37:18.430285+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:38.345347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3630,"num_write":1061,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'201","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.675352+0000","last_change":"2024-09-12T00:25:00.479118+0000","last_active":"2024-09-12T01:37:38.675352+0000","last_peered":"2024-09-12T01:37:38.675352+0000","last_clean":"2024-09-12T01:37:38.675352+0000","last_became_active":"2024-09-12T00:25:00.478561+0000","last_became_peered":"2024-09-12T00:25:00.478561+0000","last_unstale":"2024-09-12T01:37:38.675352+0000","last_undegraded":"2024-09-12T01:37:38.675352+0000","last_fullsized":"2024-09-12T01:37:38.675352+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:02.954102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568262,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":8616,"num_write":923,"num_write_kb":24681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088076+0000","last_change":"2024-09-12T00:25:04.481420+0000","last_active":"2024-09-12T01:35:05.088076+0000","last_peered":"2024-09-12T01:35:05.088076+0000","last_clean":"2024-09-12T01:35:05.088076+0000","last_became_active":"2024-09-12T00:25:04.481146+0000","last_became_peered":"2024-09-12T00:25:04.481146+0000","last_unstale":"2024-09-12T01:35:05.088076+0000","last_undegraded":"2024-09-12T01:35:05.088076+0000","last_fullsized":"2024-09-12T01:35:05.088076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:58.000768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'151","reported_seq":745,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.528032+0000","last_change":"2024-09-12T00:25:06.499351+0000","last_active":"2024-09-12T01:37:19.528032+0000","last_peered":"2024-09-12T01:37:19.528032+0000","last_clean":"2024-09-12T01:37:19.528032+0000","last_became_active":"2024-09-12T00:25:06.499065+0000","last_became_peered":"2024-09-12T00:25:06.499065+0000","last_unstale":"2024-09-12T01:37:19.528032+0000","last_undegraded":"2024-09-12T01:37:19.528032+0000","last_fullsized":"2024-09-12T01:37:19.528032+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:00.555004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25525,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":203,"num_read_kb":299,"num_write":116,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:54.518132+0000","last_change":"2024-09-12T00:25:08.510993+0000","last_active":"2024-09-12T01:32:54.518132+0000","last_peered":"2024-09-12T01:32:54.518132+0000","last_clean":"2024-09-12T01:32:54.518132+0000","last_became_active":"2024-09-12T00:25:08.510416+0000","last_became_peered":"2024-09-12T00:25:08.510416+0000","last_unstale":"2024-09-12T01:32:54.518132+0000","last_undegraded":"2024-09-12T01:32:54.518132+0000","last_fullsized":"2024-09-12T01:32:54.518132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:07.820462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'116","reported_seq":637,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.003868+0000","last_change":"2024-09-12T00:25:10.521269+0000","last_active":"2024-09-12T01:35:19.003868+0000","last_peered":"2024-09-12T01:35:19.003868+0000","last_clean":"2024-09-12T01:35:19.003868+0000","last_became_active":"2024-09-12T00:25:10.520808+0000","last_became_peered":"2024-09-12T00:25:10.520808+0000","last_unstale":"2024-09-12T01:35:19.003868+0000","last_undegraded":"2024-09-12T01:35:19.003868+0000","last_fullsized":"2024-09-12T01:35:19.003868+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:03.946656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1152,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":290,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'797","reported_seq":2307,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.315904+0000","last_change":"2024-09-12T00:25:02.470881+0000","last_active":"2024-09-12T01:36:12.315904+0000","last_peered":"2024-09-12T01:36:12.315904+0000","last_clean":"2024-09-12T01:36:12.315904+0000","last_became_active":"2024-09-12T00:25:02.470607+0000","last_became_peered":"2024-09-12T00:25:02.470607+0000","last_unstale":"2024-09-12T01:36:12.315904+0000","last_undegraded":"2024-09-12T01:36:12.315904+0000","last_fullsized":"2024-09-12T01:36:12.315904+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:49.586235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3788,"num_read_kb":3387,"num_write":1064,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'177","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.873940+0000","last_change":"2024-09-12T00:25:00.465714+0000","last_active":"2024-09-12T01:37:38.873940+0000","last_peered":"2024-09-12T01:37:38.873940+0000","last_clean":"2024-09-12T01:37:38.873940+0000","last_became_active":"2024-09-12T00:25:00.465095+0000","last_became_peered":"2024-09-12T00:25:00.465095+0000","last_unstale":"2024-09-12T01:37:38.873940+0000","last_undegraded":"2024-09-12T01:37:38.873940+0000","last_fullsized":"2024-09-12T01:37:38.873940+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:10.785936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":87968,"num_write":861,"num_write_kb":34661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088796+0000","last_change":"2024-09-12T00:25:04.483527+0000","last_active":"2024-09-12T01:35:09.088796+0000","last_peered":"2024-09-12T01:35:09.088796+0000","last_clean":"2024-09-12T01:35:09.088796+0000","last_became_active":"2024-09-12T00:25:04.483232+0000","last_became_peered":"2024-09-12T00:25:04.483232+0000","last_unstale":"2024-09-12T01:35:09.088796+0000","last_undegraded":"2024-09-12T01:35:09.088796+0000","last_fullsized":"2024-09-12T01:35:09.088796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:29.187018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'120","reported_seq":690,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.707553+0000","last_change":"2024-09-12T00:25:06.500325+0000","last_active":"2024-09-12T01:37:38.707553+0000","last_peered":"2024-09-12T01:37:38.707553+0000","last_clean":"2024-09-12T01:37:38.707553+0000","last_became_active":"2024-09-12T00:25:06.499749+0000","last_became_peered":"2024-09-12T00:25:06.499749+0000","last_unstale":"2024-09-12T01:37:38.707553+0000","last_undegraded":"2024-09-12T01:37:38.707553+0000","last_fullsized":"2024-09-12T01:37:38.707553+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:39.445969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8122,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":217,"num_write":76,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534440+0000","last_change":"2024-09-12T00:25:08.514387+0000","last_active":"2024-09-12T01:35:09.534440+0000","last_peered":"2024-09-12T01:35:09.534440+0000","last_clean":"2024-09-12T01:35:09.534440+0000","last_became_active":"2024-09-12T00:25:08.513977+0000","last_became_peered":"2024-09-12T00:25:08.513977+0000","last_unstale":"2024-09-12T01:35:09.534440+0000","last_undegraded":"2024-09-12T01:35:09.534440+0000","last_fullsized":"2024-09-12T01:35:09.534440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.665951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'144","reported_seq":1247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:10.909919+0000","last_change":"2024-09-12T00:25:10.530536+0000","last_active":"2024-09-12T01:36:10.909919+0000","last_peered":"2024-09-12T01:36:10.909919+0000","last_clean":"2024-09-12T01:36:10.909919+0000","last_became_active":"2024-09-12T00:25:10.530103+0000","last_became_peered":"2024-09-12T00:25:10.530103+0000","last_unstale":"2024-09-12T01:36:10.909919+0000","last_undegraded":"2024-09-12T01:36:10.909919+0000","last_fullsized":"2024-09-12T01:36:10.909919+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.601805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":760,"num_write":344,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'1249","reported_seq":2942,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088591+0000","last_change":"2024-09-12T00:25:02.467411+0000","last_active":"2024-09-12T01:35:10.088591+0000","last_peered":"2024-09-12T01:35:10.088591+0000","last_clean":"2024-09-12T01:35:10.088591+0000","last_became_active":"2024-09-12T00:25:02.467159+0000","last_became_peered":"2024-09-12T00:25:02.467159+0000","last_unstale":"2024-09-12T01:35:10.088591+0000","last_undegraded":"2024-09-12T01:35:10.088591+0000","last_fullsized":"2024-09-12T01:35:10.088591+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:32.592501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5713,"num_read_kb":5033,"num_write":1731,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'181","reported_seq":795,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.640952+0000","last_change":"2024-09-12T00:25:00.458860+0000","last_active":"2024-09-12T01:37:38.640952+0000","last_peered":"2024-09-12T01:37:38.640952+0000","last_clean":"2024-09-12T01:37:38.640952+0000","last_became_active":"2024-09-12T00:25:00.458519+0000","last_became_peered":"2024-09-12T00:25:00.458519+0000","last_unstale":"2024-09-12T01:37:38.640952+0000","last_undegraded":"2024-09-12T01:37:38.640952+0000","last_fullsized":"2024-09-12T01:37:38.640952+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:29.743861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174575,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":854,"num_write":913,"num_write_kb":13833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:57.233292+0000","last_change":"2024-09-12T00:25:04.482146+0000","last_active":"2024-09-12T01:32:57.233292+0000","last_peered":"2024-09-12T01:32:57.233292+0000","last_clean":"2024-09-12T01:32:57.233292+0000","last_became_active":"2024-09-12T00:25:04.481393+0000","last_became_peered":"2024-09-12T00:25:04.481393+0000","last_unstale":"2024-09-12T01:32:57.233292+0000","last_undegraded":"2024-09-12T01:32:57.233292+0000","last_fullsized":"2024-09-12T01:32:57.233292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:22.018902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'193","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.737443+0000","last_change":"2024-09-12T00:25:06.490707+0000","last_active":"2024-09-12T01:37:38.737443+0000","last_peered":"2024-09-12T01:37:38.737443+0000","last_clean":"2024-09-12T01:37:38.737443+0000","last_became_active":"2024-09-12T00:25:06.490384+0000","last_became_peered":"2024-09-12T00:25:06.490384+0000","last_unstale":"2024-09-12T01:37:38.737443+0000","last_undegraded":"2024-09-12T01:37:38.737443+0000","last_fullsized":"2024-09-12T01:37:38.737443+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:11.867492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8836,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:42.230896+0000","last_change":"2024-09-12T00:25:08.508294+0000","last_active":"2024-09-12T01:32:42.230896+0000","last_peered":"2024-09-12T01:32:42.230896+0000","last_clean":"2024-09-12T01:32:42.230896+0000","last_became_active":"2024-09-12T00:25:08.507837+0000","last_became_peered":"2024-09-12T00:25:08.507837+0000","last_unstale":"2024-09-12T01:32:42.230896+0000","last_undegraded":"2024-09-12T01:32:42.230896+0000","last_fullsized":"2024-09-12T01:32:42.230896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:13.827697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'136","reported_seq":682,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.395437+0000","last_change":"2024-09-12T00:25:10.528310+0000","last_active":"2024-09-12T01:37:18.395437+0000","last_peered":"2024-09-12T01:37:18.395437+0000","last_clean":"2024-09-12T01:37:18.395437+0000","last_became_active":"2024-09-12T00:25:10.528040+0000","last_became_peered":"2024-09-12T00:25:10.528040+0000","last_unstale":"2024-09-12T01:37:18.395437+0000","last_undegraded":"2024-09-12T01:37:18.395437+0000","last_fullsized":"2024-09-12T01:37:18.395437+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:22.655533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":238,"num_write":307,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'1096","reported_seq":2607,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.781254+0000","last_change":"2024-09-12T00:25:02.474566+0000","last_active":"2024-09-12T01:34:39.781254+0000","last_peered":"2024-09-12T01:34:39.781254+0000","last_clean":"2024-09-12T01:34:39.781254+0000","last_became_active":"2024-09-12T00:25:02.474282+0000","last_became_peered":"2024-09-12T00:25:02.474282+0000","last_unstale":"2024-09-12T01:34:39.781254+0000","last_undegraded":"2024-09-12T01:34:39.781254+0000","last_fullsized":"2024-09-12T01:34:39.781254+0000","mapping_epoch":28,"log_start":"266'1000","ondisk_log_start":"266'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:37.444902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4398,"num_write":1510,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'185","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.882035+0000","last_change":"2024-09-12T00:25:00.478653+0000","last_active":"2024-09-12T01:37:38.882035+0000","last_peered":"2024-09-12T01:37:38.882035+0000","last_clean":"2024-09-12T01:37:38.882035+0000","last_became_active":"2024-09-12T00:25:00.478259+0000","last_became_peered":"2024-09-12T00:25:00.478259+0000","last_unstale":"2024-09-12T01:37:38.882035+0000","last_undegraded":"2024-09-12T01:37:38.882035+0000","last_fullsized":"2024-09-12T01:37:38.882035+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:16.754223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515600,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":41144,"num_write":873,"num_write_kb":35919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'752","reported_seq":2230,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.789666+0000","last_change":"2024-09-12T00:25:02.479779+0000","last_active":"2024-09-12T01:34:32.789666+0000","last_peered":"2024-09-12T01:34:32.789666+0000","last_clean":"2024-09-12T01:34:32.789666+0000","last_became_active":"2024-09-12T00:25:02.479450+0000","last_became_peered":"2024-09-12T00:25:02.479450+0000","last_unstale":"2024-09-12T01:34:32.789666+0000","last_undegraded":"2024-09-12T01:34:32.789666+0000","last_fullsized":"2024-09-12T01:34:32.789666+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:48.463312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3526,"num_read_kb":3183,"num_write":976,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'207","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.755842+0000","last_change":"2024-09-12T00:25:00.468633+0000","last_active":"2024-09-12T01:37:38.755842+0000","last_peered":"2024-09-12T01:37:38.755842+0000","last_clean":"2024-09-12T01:37:38.755842+0000","last_became_active":"2024-09-12T00:25:00.468280+0000","last_became_peered":"2024-09-12T00:25:00.468280+0000","last_unstale":"2024-09-12T01:37:38.755842+0000","last_undegraded":"2024-09-12T01:37:38.755842+0000","last_fullsized":"2024-09-12T01:37:38.755842+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:45.872366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":421,"num_read_kb":15096,"num_write":1006,"num_write_kb":29184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'365","reported_seq":1884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.192081+0000","last_change":"2024-09-12T00:25:02.477649+0000","last_active":"2024-09-12T01:36:11.192081+0000","last_peered":"2024-09-12T01:36:11.192081+0000","last_clean":"2024-09-12T01:36:11.192081+0000","last_became_active":"2024-09-12T00:25:02.476993+0000","last_became_peered":"2024-09-12T00:25:02.476993+0000","last_unstale":"2024-09-12T01:36:11.192081+0000","last_undegraded":"2024-09-12T01:36:11.192081+0000","last_fullsized":"2024-09-12T01:36:11.192081+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:43.749594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2221,"num_read_kb":2131,"num_write":417,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'201","reported_seq":885,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.794562+0000","last_change":"2024-09-12T00:25:00.478242+0000","last_active":"2024-09-12T01:37:38.794562+0000","last_peered":"2024-09-12T01:37:38.794562+0000","last_clean":"2024-09-12T01:37:38.794562+0000","last_became_active":"2024-09-12T00:25:00.477872+0000","last_became_peered":"2024-09-12T00:25:00.477872+0000","last_unstale":"2024-09-12T01:37:38.794562+0000","last_undegraded":"2024-09-12T01:37:38.794562+0000","last_fullsized":"2024-09-12T01:37:38.794562+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:04.405196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590195,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":9353,"num_write":799,"num_write_kb":34820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'478","reported_seq":1981,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.192692+0000","last_change":"2024-09-12T00:25:02.468462+0000","last_active":"2024-09-12T01:36:11.192692+0000","last_peered":"2024-09-12T01:36:11.192692+0000","last_clean":"2024-09-12T01:36:11.192692+0000","last_became_active":"2024-09-12T00:25:02.468180+0000","last_became_peered":"2024-09-12T00:25:02.468180+0000","last_unstale":"2024-09-12T01:36:11.192692+0000","last_undegraded":"2024-09-12T01:36:11.192692+0000","last_fullsized":"2024-09-12T01:36:11.192692+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:04.921278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2321,"num_read_kb":2166,"num_write":540,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'179","reported_seq":788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.683516+0000","last_change":"2024-09-12T00:25:00.472077+0000","last_active":"2024-09-12T01:37:38.683516+0000","last_peered":"2024-09-12T01:37:38.683516+0000","last_clean":"2024-09-12T01:37:38.683516+0000","last_became_active":"2024-09-12T00:25:00.471412+0000","last_became_peered":"2024-09-12T00:25:00.471412+0000","last_unstale":"2024-09-12T01:37:38.683516+0000","last_undegraded":"2024-09-12T01:37:38.683516+0000","last_fullsized":"2024-09-12T01:37:38.683516+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:10.903274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432317,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":354,"num_read_kb":25493,"num_write":898,"num_write_kb":19511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'498","reported_seq":2184,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.646707+0000","last_change":"2024-09-12T00:25:02.469514+0000","last_active":"2024-09-12T01:35:23.646707+0000","last_peered":"2024-09-12T01:35:23.646707+0000","last_clean":"2024-09-12T01:35:23.646707+0000","last_became_active":"2024-09-12T00:25:02.469251+0000","last_became_peered":"2024-09-12T00:25:02.469251+0000","last_unstale":"2024-09-12T01:35:23.646707+0000","last_undegraded":"2024-09-12T01:35:23.646707+0000","last_fullsized":"2024-09-12T01:35:23.646707+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:47.158487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2750,"num_read_kb":2605,"num_write":624,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'206","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.814127+0000","last_change":"2024-09-12T00:25:00.467331+0000","last_active":"2024-09-12T01:37:38.814127+0000","last_peered":"2024-09-12T01:37:38.814127+0000","last_clean":"2024-09-12T01:37:38.814127+0000","last_became_active":"2024-09-12T00:25:00.466945+0000","last_became_peered":"2024-09-12T00:25:00.466945+0000","last_unstale":"2024-09-12T01:37:38.814127+0000","last_undegraded":"2024-09-12T01:37:38.814127+0000","last_fullsized":"2024-09-12T01:37:38.814127+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:39.900588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":18851,"num_write":965,"num_write_kb":35048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'496","reported_seq":2036,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.880849+0000","last_change":"2024-09-12T00:25:02.475541+0000","last_active":"2024-09-12T01:35:08.880849+0000","last_peered":"2024-09-12T01:35:08.880849+0000","last_clean":"2024-09-12T01:35:08.880849+0000","last_became_active":"2024-09-12T00:25:02.475225+0000","last_became_peered":"2024-09-12T00:25:02.475225+0000","last_unstale":"2024-09-12T01:35:08.880849+0000","last_undegraded":"2024-09-12T01:35:08.880849+0000","last_fullsized":"2024-09-12T01:35:08.880849+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.705825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2326,"num_write":604,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'195","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.848872+0000","last_change":"2024-09-12T00:25:00.468589+0000","last_active":"2024-09-12T01:37:38.848872+0000","last_peered":"2024-09-12T01:37:38.848872+0000","last_clean":"2024-09-12T01:37:38.848872+0000","last_became_active":"2024-09-12T00:25:00.468245+0000","last_became_peered":"2024-09-12T00:25:00.468245+0000","last_unstale":"2024-09-12T01:37:38.848872+0000","last_undegraded":"2024-09-12T01:37:38.848872+0000","last_fullsized":"2024-09-12T01:37:38.848872+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:59.481921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":27275,"num_write":960,"num_write_kb":19137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'527","reported_seq":2284,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:53.479407+0000","last_change":"2024-09-12T00:25:02.469328+0000","last_active":"2024-09-12T01:34:53.479407+0000","last_peered":"2024-09-12T01:34:53.479407+0000","last_clean":"2024-09-12T01:34:53.479407+0000","last_became_active":"2024-09-12T00:25:02.469044+0000","last_became_peered":"2024-09-12T00:25:02.469044+0000","last_unstale":"2024-09-12T01:34:53.479407+0000","last_undegraded":"2024-09-12T01:34:53.479407+0000","last_fullsized":"2024-09-12T01:34:53.479407+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:12.185074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2889,"num_read_kb":2724,"num_write":624,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'185","reported_seq":810,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.811056+0000","last_change":"2024-09-12T00:25:00.487875+0000","last_active":"2024-09-12T01:37:38.811056+0000","last_peered":"2024-09-12T01:37:38.811056+0000","last_clean":"2024-09-12T01:37:38.811056+0000","last_became_active":"2024-09-12T00:25:00.487526+0000","last_became_peered":"2024-09-12T00:25:00.487526+0000","last_unstale":"2024-09-12T01:37:38.811056+0000","last_undegraded":"2024-09-12T01:37:38.811056+0000","last_fullsized":"2024-09-12T01:37:38.811056+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:49.142939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306655,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":3010,"num_write":923,"num_write_kb":19090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1186","reported_seq":2778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.404544+0000","last_change":"2024-09-12T00:25:02.465875+0000","last_active":"2024-09-12T01:37:18.404544+0000","last_peered":"2024-09-12T01:37:18.404544+0000","last_clean":"2024-09-12T01:37:18.404544+0000","last_became_active":"2024-09-12T00:25:02.465257+0000","last_became_peered":"2024-09-12T00:25:02.465257+0000","last_unstale":"2024-09-12T01:37:18.404544+0000","last_undegraded":"2024-09-12T01:37:18.404544+0000","last_fullsized":"2024-09-12T01:37:18.404544+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:04.981975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5507,"num_read_kb":4876,"num_write":1621,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'262","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.593553+0000","last_change":"2024-09-12T00:25:00.469603+0000","last_active":"2024-09-12T01:37:38.593553+0000","last_peered":"2024-09-12T01:37:38.593553+0000","last_clean":"2024-09-12T01:37:38.593553+0000","last_became_active":"2024-09-12T00:25:00.469159+0000","last_became_peered":"2024-09-12T00:25:00.469159+0000","last_unstale":"2024-09-12T01:37:38.593553+0000","last_undegraded":"2024-09-12T01:37:38.593553+0000","last_fullsized":"2024-09-12T01:37:38.593553+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:29.592131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":57821,"num_write":1101,"num_write_kb":41989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'486","reported_seq":1921,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123191+0000","last_change":"2024-09-12T00:25:02.470885+0000","last_active":"2024-09-12T01:35:05.123191+0000","last_peered":"2024-09-12T01:35:05.123191+0000","last_clean":"2024-09-12T01:35:05.123191+0000","last_became_active":"2024-09-12T00:25:02.470623+0000","last_became_peered":"2024-09-12T00:25:02.470623+0000","last_unstale":"2024-09-12T01:35:05.123191+0000","last_undegraded":"2024-09-12T01:35:05.123191+0000","last_fullsized":"2024-09-12T01:35:05.123191+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:25.739488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2404,"num_read_kb":2207,"num_write":594,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'242","reported_seq":907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.778318+0000","last_change":"2024-09-12T00:25:00.470643+0000","last_active":"2024-09-12T01:37:38.778318+0000","last_peered":"2024-09-12T01:37:38.778318+0000","last_clean":"2024-09-12T01:37:38.778318+0000","last_became_active":"2024-09-12T00:25:00.469918+0000","last_became_peered":"2024-09-12T00:25:00.469918+0000","last_unstale":"2024-09-12T01:37:38.778318+0000","last_undegraded":"2024-09-12T01:37:38.778318+0000","last_fullsized":"2024-09-12T01:37:38.778318+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:08.268473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":488,"num_read_kb":51750,"num_write":1103,"num_write_kb":39694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'612","reported_seq":2412,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801716+0000","last_change":"2024-09-12T00:25:02.476152+0000","last_active":"2024-09-12T01:35:34.801716+0000","last_peered":"2024-09-12T01:35:34.801716+0000","last_clean":"2024-09-12T01:35:34.801716+0000","last_became_active":"2024-09-12T00:25:02.475864+0000","last_became_peered":"2024-09-12T00:25:02.475864+0000","last_unstale":"2024-09-12T01:35:34.801716+0000","last_undegraded":"2024-09-12T01:35:34.801716+0000","last_fullsized":"2024-09-12T01:35:34.801716+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:31.109147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3105,"num_read_kb":2885,"num_write":734,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'287","reported_seq":986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.874176+0000","last_change":"2024-09-12T00:25:00.468654+0000","last_active":"2024-09-12T01:37:38.874176+0000","last_peered":"2024-09-12T01:37:38.874176+0000","last_clean":"2024-09-12T01:37:38.874176+0000","last_became_active":"2024-09-12T00:25:00.468228+0000","last_became_peered":"2024-09-12T00:25:00.468228+0000","last_unstale":"2024-09-12T01:37:38.874176+0000","last_undegraded":"2024-09-12T01:37:38.874176+0000","last_fullsized":"2024-09-12T01:37:38.874176+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:04.194595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":681,"num_read_kb":67032,"num_write":1230,"num_write_kb":28377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'949","reported_seq":2514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.490891+0000","last_change":"2024-09-12T00:25:02.476025+0000","last_active":"2024-09-12T01:35:23.490891+0000","last_peered":"2024-09-12T01:35:23.490891+0000","last_clean":"2024-09-12T01:35:23.490891+0000","last_became_active":"2024-09-12T00:25:02.473441+0000","last_became_peered":"2024-09-12T00:25:02.473441+0000","last_unstale":"2024-09-12T01:35:23.490891+0000","last_undegraded":"2024-09-12T01:35:23.490891+0000","last_fullsized":"2024-09-12T01:35:23.490891+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:50.101335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4462,"num_read_kb":3929,"num_write":1316,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'215","reported_seq":868,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.733268+0000","last_change":"2024-09-12T00:25:00.465738+0000","last_active":"2024-09-12T01:37:38.733268+0000","last_peered":"2024-09-12T01:37:38.733268+0000","last_clean":"2024-09-12T01:37:38.733268+0000","last_became_active":"2024-09-12T00:25:00.465127+0000","last_became_peered":"2024-09-12T00:25:00.465127+0000","last_unstale":"2024-09-12T01:37:38.733268+0000","last_undegraded":"2024-09-12T01:37:38.733268+0000","last_fullsized":"2024-09-12T01:37:38.733268+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:37.553300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":16638,"num_write":1049,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'828","reported_seq":2449,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.834057+0000","last_change":"2024-09-12T00:25:02.464676+0000","last_active":"2024-09-12T01:35:16.834057+0000","last_peered":"2024-09-12T01:35:16.834057+0000","last_clean":"2024-09-12T01:35:16.834057+0000","last_became_active":"2024-09-12T00:25:02.464386+0000","last_became_peered":"2024-09-12T00:25:02.464386+0000","last_unstale":"2024-09-12T01:35:16.834057+0000","last_undegraded":"2024-09-12T01:35:16.834057+0000","last_fullsized":"2024-09-12T01:35:16.834057+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:41.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3522,"num_write":1059,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'163","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:47.249575+0000","last_change":"2024-09-12T00:25:00.465954+0000","last_active":"2024-09-12T01:34:47.249575+0000","last_peered":"2024-09-12T01:34:47.249575+0000","last_clean":"2024-09-12T01:34:47.249575+0000","last_became_active":"2024-09-12T00:25:00.465400+0000","last_became_peered":"2024-09-12T00:25:00.465400+0000","last_unstale":"2024-09-12T01:34:47.249575+0000","last_undegraded":"2024-09-12T01:34:47.249575+0000","last_fullsized":"2024-09-12T01:34:47.249575+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:52.577671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079914,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":437,"num_read_kb":4582,"num_write":825,"num_write_kb":26519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'779","reported_seq":2416,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194962+0000","last_change":"2024-09-12T00:25:02.469311+0000","last_active":"2024-09-12T01:36:11.194962+0000","last_peered":"2024-09-12T01:36:11.194962+0000","last_clean":"2024-09-12T01:36:11.194962+0000","last_became_active":"2024-09-12T00:25:02.469046+0000","last_became_peered":"2024-09-12T00:25:02.469046+0000","last_unstale":"2024-09-12T01:36:11.194962+0000","last_undegraded":"2024-09-12T01:36:11.194962+0000","last_fullsized":"2024-09-12T01:36:11.194962+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.426796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3834,"num_read_kb":3478,"num_write":1008,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'208","reported_seq":878,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.757693+0000","last_change":"2024-09-12T00:25:00.469566+0000","last_active":"2024-09-12T01:37:38.757693+0000","last_peered":"2024-09-12T01:37:38.757693+0000","last_clean":"2024-09-12T01:37:38.757693+0000","last_became_active":"2024-09-12T00:25:00.468581+0000","last_became_peered":"2024-09-12T00:25:00.468581+0000","last_unstale":"2024-09-12T01:37:38.757693+0000","last_undegraded":"2024-09-12T01:37:38.757693+0000","last_fullsized":"2024-09-12T01:37:38.757693+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:58.853274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323902,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":48643,"num_write":1011,"num_write_kb":19361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'797","reported_seq":2362,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.397154+0000","last_change":"2024-09-12T00:25:02.477178+0000","last_active":"2024-09-12T01:37:18.397154+0000","last_peered":"2024-09-12T01:37:18.397154+0000","last_clean":"2024-09-12T01:37:18.397154+0000","last_became_active":"2024-09-12T00:25:02.476825+0000","last_became_peered":"2024-09-12T00:25:02.476825+0000","last_unstale":"2024-09-12T01:37:18.397154+0000","last_undegraded":"2024-09-12T01:37:18.397154+0000","last_fullsized":"2024-09-12T01:37:18.397154+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:53.361725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3888,"num_read_kb":3500,"num_write":1075,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'188","reported_seq":864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.754796+0000","last_change":"2024-09-12T00:25:00.480493+0000","last_active":"2024-09-12T01:37:38.754796+0000","last_peered":"2024-09-12T01:37:38.754796+0000","last_clean":"2024-09-12T01:37:38.754796+0000","last_became_active":"2024-09-12T00:25:00.480122+0000","last_became_peered":"2024-09-12T00:25:00.480122+0000","last_unstale":"2024-09-12T01:37:38.754796+0000","last_undegraded":"2024-09-12T01:37:38.754796+0000","last_fullsized":"2024-09-12T01:37:38.754796+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:57.940376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399183,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":553,"num_read_kb":7914,"num_write":895,"num_write_kb":29144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'690","reported_seq":2144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.193773+0000","last_change":"2024-09-12T00:25:02.467034+0000","last_active":"2024-09-12T01:36:11.193773+0000","last_peered":"2024-09-12T01:36:11.193773+0000","last_clean":"2024-09-12T01:36:11.193773+0000","last_became_active":"2024-09-12T00:25:02.465790+0000","last_became_peered":"2024-09-12T00:25:02.465790+0000","last_unstale":"2024-09-12T01:36:11.193773+0000","last_undegraded":"2024-09-12T01:36:11.193773+0000","last_fullsized":"2024-09-12T01:36:11.193773+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:47.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3268,"num_read_kb":2971,"num_write":903,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'258","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.806913+0000","last_change":"2024-09-12T00:25:00.469984+0000","last_active":"2024-09-12T01:37:38.806913+0000","last_peered":"2024-09-12T01:37:38.806913+0000","last_clean":"2024-09-12T01:37:38.806913+0000","last_became_active":"2024-09-12T00:25:00.469634+0000","last_became_peered":"2024-09-12T00:25:00.469634+0000","last_unstale":"2024-09-12T01:37:38.806913+0000","last_undegraded":"2024-09-12T01:37:38.806913+0000","last_fullsized":"2024-09-12T01:37:38.806913+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:05.806256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155756,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1718,"num_write":1162,"num_write_kb":27079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'434","reported_seq":2042,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.340373+0000","last_change":"2024-09-12T00:25:02.465571+0000","last_active":"2024-09-12T01:36:12.340373+0000","last_peered":"2024-09-12T01:36:12.340373+0000","last_clean":"2024-09-12T01:36:12.340373+0000","last_became_active":"2024-09-12T00:25:02.464112+0000","last_became_peered":"2024-09-12T00:25:02.464112+0000","last_unstale":"2024-09-12T01:36:12.340373+0000","last_undegraded":"2024-09-12T01:36:12.340373+0000","last_fullsized":"2024-09-12T01:36:12.340373+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:22.009640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2410,"num_read_kb":2284,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'226","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.812901+0000","last_change":"2024-09-12T00:25:00.469057+0000","last_active":"2024-09-12T01:37:38.812901+0000","last_peered":"2024-09-12T01:37:38.812901+0000","last_clean":"2024-09-12T01:37:38.812901+0000","last_became_active":"2024-09-12T00:25:00.468600+0000","last_became_peered":"2024-09-12T00:25:00.468600+0000","last_unstale":"2024-09-12T01:37:38.812901+0000","last_undegraded":"2024-09-12T01:37:38.812901+0000","last_fullsized":"2024-09-12T01:37:38.812901+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:05.715126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133763,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":7263,"num_write":1147,"num_write_kb":27569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'182","reported_seq":826,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.881632+0000","last_change":"2024-09-12T00:25:00.470300+0000","last_active":"2024-09-12T01:37:38.881632+0000","last_peered":"2024-09-12T01:37:38.881632+0000","last_clean":"2024-09-12T01:37:38.881632+0000","last_became_active":"2024-09-12T00:25:00.469382+0000","last_became_peered":"2024-09-12T00:25:00.469382+0000","last_unstale":"2024-09-12T01:37:38.881632+0000","last_undegraded":"2024-09-12T01:37:38.881632+0000","last_fullsized":"2024-09-12T01:37:38.881632+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:57.619429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":14411,"num_write":860,"num_write_kb":23706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'916","reported_seq":2485,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.307264+0000","last_change":"2024-09-12T00:25:02.475301+0000","last_active":"2024-09-12T01:36:12.307264+0000","last_peered":"2024-09-12T01:36:12.307264+0000","last_clean":"2024-09-12T01:36:12.307264+0000","last_became_active":"2024-09-12T00:25:02.475004+0000","last_became_peered":"2024-09-12T00:25:02.475004+0000","last_unstale":"2024-09-12T01:36:12.307264+0000","last_undegraded":"2024-09-12T01:36:12.307264+0000","last_fullsized":"2024-09-12T01:36:12.307264+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:17.094814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4224,"num_read_kb":3778,"num_write":1247,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'230","reported_seq":955,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.829157+0000","last_change":"2024-09-12T00:25:00.472266+0000","last_active":"2024-09-12T01:37:38.829157+0000","last_peered":"2024-09-12T01:37:38.829157+0000","last_clean":"2024-09-12T01:37:38.829157+0000","last_became_active":"2024-09-12T00:25:00.471411+0000","last_became_peered":"2024-09-12T00:25:00.471411+0000","last_unstale":"2024-09-12T01:37:38.829157+0000","last_undegraded":"2024-09-12T01:37:38.829157+0000","last_fullsized":"2024-09-12T01:37:38.829157+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:34.132087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323861,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":157504,"num_write":954,"num_write_kb":45267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'647","reported_seq":2390,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194867+0000","last_change":"2024-09-12T00:25:02.463284+0000","last_active":"2024-09-12T01:36:11.194867+0000","last_peered":"2024-09-12T01:36:11.194867+0000","last_clean":"2024-09-12T01:36:11.194867+0000","last_became_active":"2024-09-12T00:25:02.462993+0000","last_became_peered":"2024-09-12T00:25:02.462993+0000","last_unstale":"2024-09-12T01:36:11.194867+0000","last_undegraded":"2024-09-12T01:36:11.194867+0000","last_fullsized":"2024-09-12T01:36:11.194867+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":600,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:48.709170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3586,"num_read_kb":3293,"num_write":883,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5955,"num_read_kb":4160,"num_write":1937,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15084,"num_read_kb":14735,"num_write":16735,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1466,"ondisk_log_size":1466,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":676,"ondisk_log_size":676,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":336770,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":10142,"num_read_kb":12264,"num_write":7067,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":348160,"data_stored":35052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1759,"ondisk_log_size":1759,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2370,"num_read_kb":2830,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212728,"num_read_kb":194072,"num_write":55276,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4200,"ondisk_log_size":4200,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":110421795,"num_objects":264,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":33223,"num_read_kb":1810762,"num_write":62781,"num_write_kb":1904228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149446656,"data_stored":149446656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4078,"ondisk_log_size":4078,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":165,"num_read_kb":174385,"num_write":181,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14671872,"data_stored":14671872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":162,"num_read_kb":174274,"num_write":181,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6303744,"data_stored":6302855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477619,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141144,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94230696,"statfs":{"total":96636764160,"available":96492232704,"internally_reserved":0,"allocated":15908864,"data_stored":13922526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477617,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136116,"kb_used_data":24360,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94235724,"statfs":{"total":96636764160,"available":96497381376,"internally_reserved":0,"allocated":24944640,"data_stored":22945833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424510322,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214348,"kb_used_data":16580,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94157492,"statfs":{"total":96636764160,"available":96417271808,"internally_reserved":0,"allocated":16977920,"data_stored":14990871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510320,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":182772,"kb_used_data":93284,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94189068,"statfs":{"total":96636764160,"available":96449605632,"internally_reserved":0,"allocated":95522816,"data_stored":93475520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510321,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343852,"kb_used_data":101660,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94027988,"statfs":{"total":96636764160,"available":96284659712,"internally_reserved":0,"allocated":104099840,"data_stored":102057947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":247986629},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510322,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253136,"kb_used_data":19216,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94118704,"statfs":{"total":96636764160,"available":96377552896,"internally_reserved":0,"allocated":19677184,"data_stored":17673901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510322,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307928,"kb_used_data":33752,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94063912,"statfs":{"total":96636764160,"available":96321445888,"internally_reserved":0,"allocated":34562048,"data_stored":32541409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575733,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242824,"kb_used_data":77048,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94129016,"statfs":{"total":96636764160,"available":96388112384,"internally_reserved":0,"allocated":78897152,"data_stored":76859945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20709376,"data_stored":20709376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12632064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11685888,"data_stored":11685888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15437824,"data_stored":15437824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53620736,"data_stored":53620736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9035776,"data_stored":9035776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13570048,"data_stored":13570048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12754944,"data_stored":12754944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":28638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6303744,"data_stored":6302855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14671872,"data_stored":14671872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:37:41.088 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T01:37:41.088 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:37:41.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T01:37:41.433 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:37:41.455 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:37:41.473 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":2450,"stamp":"2024-09-12T01:37:40.766259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":116612916,"num_objects":753,"num_object_clones":0,"num_object_copies":2034,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":753,"num_whiteouts":0,"num_read":279907,"num_read_kb":2387549,"num_write":144299,"num_write_kb":2165309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13521,"ondisk_log_size":13521,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1822120,"kb_used_data":381436,"kb_used_omap":12,"kb_used_meta":1440307,"kb_avail":753152600,"statfs":{"total":773094113280,"available":771228262400,"internally_reserved":0,"allocated":390590464,"data_stored":374467952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1474874928},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-357960168,"num_objects":-299,"num_object_clones":0,"num_object_copies":-1096,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-299,"num_whiteouts":0,"num_read":574,"num_read_kb":587,"num_write":430,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005485"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.977721+0000","last_change":"2024-09-12T01:02:03.926254+0000","last_active":"2024-09-12T01:34:34.977721+0000","last_peered":"2024-09-12T01:34:34.977721+0000","last_clean":"2024-09-12T01:34:34.977721+0000","last_became_active":"2024-09-12T01:02:03.925687+0000","last_became_peered":"2024-09-12T01:02:03.925687+0000","last_unstale":"2024-09-12T01:34:34.977721+0000","last_undegraded":"2024-09-12T01:34:34.977721+0000","last_fullsized":"2024-09-12T01:34:34.977721+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:25.162167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"266'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:14.095890+0000","last_change":"2024-09-12T00:43:43.813662+0000","last_active":"2024-09-12T01:36:14.095890+0000","last_peered":"2024-09-12T01:36:14.095890+0000","last_clean":"2024-09-12T01:36:14.095890+0000","last_became_active":"2024-09-12T00:43:43.812701+0000","last_became_peered":"2024-09-12T00:43:43.812701+0000","last_unstale":"2024-09-12T01:36:14.095890+0000","last_undegraded":"2024-09-12T01:36:14.095890+0000","last_fullsized":"2024-09-12T01:36:14.095890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:32.083600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.110512+0000","last_change":"2024-09-12T00:43:38.799582+0000","last_active":"2024-09-12T01:33:40.110512+0000","last_peered":"2024-09-12T01:33:40.110512+0000","last_clean":"2024-09-12T01:33:40.110512+0000","last_became_active":"2024-09-12T00:43:38.799322+0000","last_became_peered":"2024-09-12T00:43:38.799322+0000","last_unstale":"2024-09-12T01:33:40.110512+0000","last_undegraded":"2024-09-12T01:33:40.110512+0000","last_fullsized":"2024-09-12T01:33:40.110512+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:52.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.256826+0000","last_change":"2024-09-12T00:39:17.764042+0000","last_active":"2024-09-12T01:35:32.256826+0000","last_peered":"2024-09-12T01:35:32.256826+0000","last_clean":"2024-09-12T01:35:32.256826+0000","last_became_active":"2024-09-12T00:39:17.763761+0000","last_became_peered":"2024-09-12T00:39:17.763761+0000","last_unstale":"2024-09-12T01:35:32.256826+0000","last_undegraded":"2024-09-12T01:35:32.256826+0000","last_fullsized":"2024-09-12T01:35:32.256826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:49.430258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.175890+0000","last_change":"2024-09-12T01:02:03.925619+0000","last_active":"2024-09-12T01:34:34.175890+0000","last_peered":"2024-09-12T01:34:34.175890+0000","last_clean":"2024-09-12T01:34:34.175890+0000","last_became_active":"2024-09-12T01:02:03.925338+0000","last_became_peered":"2024-09-12T01:02:03.925338+0000","last_unstale":"2024-09-12T01:34:34.175890+0000","last_undegraded":"2024-09-12T01:34:34.175890+0000","last_fullsized":"2024-09-12T01:34:34.175890+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:34.463430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"266'5","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:15.095648+0000","last_change":"2024-09-12T00:43:43.822539+0000","last_active":"2024-09-12T01:36:15.095648+0000","last_peered":"2024-09-12T01:36:15.095648+0000","last_clean":"2024-09-12T01:36:15.095648+0000","last_became_active":"2024-09-12T00:43:43.822189+0000","last_became_peered":"2024-09-12T00:43:43.822189+0000","last_unstale":"2024-09-12T01:36:15.095648+0000","last_undegraded":"2024-09-12T01:36:15.095648+0000","last_fullsized":"2024-09-12T01:36:15.095648+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:14.331070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987382+0000","last_change":"2024-09-12T00:43:38.794157+0000","last_active":"2024-09-12T01:33:38.987382+0000","last_peered":"2024-09-12T01:33:38.987382+0000","last_clean":"2024-09-12T01:33:38.987382+0000","last_became_active":"2024-09-12T00:43:38.793866+0000","last_became_peered":"2024-09-12T00:43:38.793866+0000","last_unstale":"2024-09-12T01:33:38.987382+0000","last_undegraded":"2024-09-12T01:33:38.987382+0000","last_fullsized":"2024-09-12T01:33:38.987382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:51.874866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'33","reported_seq":147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256146+0000","last_change":"2024-09-12T00:39:17.769275+0000","last_active":"2024-09-12T01:35:27.256146+0000","last_peered":"2024-09-12T01:35:27.256146+0000","last_clean":"2024-09-12T01:35:27.256146+0000","last_became_active":"2024-09-12T00:39:17.768977+0000","last_became_peered":"2024-09-12T00:39:17.768977+0000","last_unstale":"2024-09-12T01:35:27.256146+0000","last_undegraded":"2024-09-12T01:35:27.256146+0000","last_fullsized":"2024-09-12T01:35:27.256146+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:10.855870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":119,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.078422+0000","last_change":"2024-09-12T01:02:03.922480+0000","last_active":"2024-09-12T01:33:29.078422+0000","last_peered":"2024-09-12T01:33:29.078422+0000","last_clean":"2024-09-12T01:33:29.078422+0000","last_became_active":"2024-09-12T01:02:03.921938+0000","last_became_peered":"2024-09-12T01:02:03.921938+0000","last_unstale":"2024-09-12T01:33:29.078422+0000","last_undegraded":"2024-09-12T01:33:29.078422+0000","last_fullsized":"2024-09-12T01:33:29.078422+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:49.013238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"266'6","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.008891+0000","last_change":"2024-09-12T00:43:43.814192+0000","last_active":"2024-09-12T01:35:49.008891+0000","last_peered":"2024-09-12T01:35:49.008891+0000","last_clean":"2024-09-12T01:35:49.008891+0000","last_became_active":"2024-09-12T00:43:43.813568+0000","last_became_peered":"2024-09-12T00:43:43.813568+0000","last_unstale":"2024-09-12T01:35:49.008891+0000","last_undegraded":"2024-09-12T01:35:49.008891+0000","last_fullsized":"2024-09-12T01:35:49.008891+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:58.958483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7172,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'7","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.129688+0000","last_change":"2024-09-12T00:43:38.797811+0000","last_active":"2024-09-12T01:35:50.129688+0000","last_peered":"2024-09-12T01:35:50.129688+0000","last_clean":"2024-09-12T01:35:50.129688+0000","last_became_active":"2024-09-12T00:43:38.797520+0000","last_became_peered":"2024-09-12T00:43:38.797520+0000","last_unstale":"2024-09-12T01:35:50.129688+0000","last_undegraded":"2024-09-12T01:35:50.129688+0000","last_fullsized":"2024-09-12T01:35:50.129688+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:56.953531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16390,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'41","reported_seq":171,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173586+0000","last_change":"2024-09-12T00:39:17.769080+0000","last_active":"2024-09-12T01:34:19.173586+0000","last_peered":"2024-09-12T01:34:19.173586+0000","last_clean":"2024-09-12T01:34:19.173586+0000","last_became_active":"2024-09-12T00:39:17.768692+0000","last_became_peered":"2024-09-12T00:39:17.768692+0000","last_unstale":"2024-09-12T01:34:19.173586+0000","last_undegraded":"2024-09-12T01:34:19.173586+0000","last_fullsized":"2024-09-12T01:34:19.173586+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:43.550430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":161,"num_write":65,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987313+0000","last_change":"2024-09-12T01:02:03.922647+0000","last_active":"2024-09-12T01:33:38.987313+0000","last_peered":"2024-09-12T01:33:38.987313+0000","last_clean":"2024-09-12T01:33:38.987313+0000","last_became_active":"2024-09-12T01:02:03.922297+0000","last_became_peered":"2024-09-12T01:02:03.922297+0000","last_unstale":"2024-09-12T01:33:38.987313+0000","last_undegraded":"2024-09-12T01:33:38.987313+0000","last_fullsized":"2024-09-12T01:33:38.987313+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:53.989667+0000","last_change":"2024-09-12T00:43:43.819023+0000","last_active":"2024-09-12T01:33:53.989667+0000","last_peered":"2024-09-12T01:33:53.989667+0000","last_clean":"2024-09-12T01:33:53.989667+0000","last_became_active":"2024-09-12T00:43:43.818668+0000","last_became_peered":"2024-09-12T00:43:43.818668+0000","last_unstale":"2024-09-12T01:33:53.989667+0000","last_undegraded":"2024-09-12T01:33:53.989667+0000","last_fullsized":"2024-09-12T01:33:53.989667+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:45.138160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.079562+0000","last_change":"2024-09-12T00:43:38.795677+0000","last_active":"2024-09-12T01:33:39.079562+0000","last_peered":"2024-09-12T01:33:39.079562+0000","last_clean":"2024-09-12T01:33:39.079562+0000","last_became_active":"2024-09-12T00:43:38.794121+0000","last_became_peered":"2024-09-12T00:43:38.794121+0000","last_unstale":"2024-09-12T01:33:39.079562+0000","last_undegraded":"2024-09-12T01:33:39.079562+0000","last_fullsized":"2024-09-12T01:33:39.079562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:33.638934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'16","reported_seq":93,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173559+0000","last_change":"2024-09-12T00:39:17.759626+0000","last_active":"2024-09-12T01:34:19.173559+0000","last_peered":"2024-09-12T01:34:19.173559+0000","last_clean":"2024-09-12T01:34:19.173559+0000","last_became_active":"2024-09-12T00:39:17.759016+0000","last_became_peered":"2024-09-12T00:39:17.759016+0000","last_unstale":"2024-09-12T01:34:19.173559+0000","last_undegraded":"2024-09-12T01:34:19.173559+0000","last_fullsized":"2024-09-12T01:34:19.173559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:25.380216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:15.115873+0000","last_change":"2024-09-12T01:02:03.919665+0000","last_active":"2024-09-12T01:34:15.115873+0000","last_peered":"2024-09-12T01:34:15.115873+0000","last_clean":"2024-09-12T01:34:15.115873+0000","last_became_active":"2024-09-12T01:02:03.919293+0000","last_became_peered":"2024-09-12T01:02:03.919293+0000","last_unstale":"2024-09-12T01:34:15.115873+0000","last_undegraded":"2024-09-12T01:34:15.115873+0000","last_fullsized":"2024-09-12T01:34:15.115873+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:31.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.978417+0000","last_change":"2024-09-12T00:43:43.818041+0000","last_active":"2024-09-12T01:34:39.978417+0000","last_peered":"2024-09-12T01:34:39.978417+0000","last_clean":"2024-09-12T01:34:39.978417+0000","last_became_active":"2024-09-12T00:43:43.817714+0000","last_became_peered":"2024-09-12T00:43:43.817714+0000","last_unstale":"2024-09-12T01:34:39.978417+0000","last_undegraded":"2024-09-12T01:34:39.978417+0000","last_fullsized":"2024-09-12T01:34:39.978417+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:15.291037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'15","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:49.017973+0000","last_change":"2024-09-12T00:43:38.795483+0000","last_active":"2024-09-12T01:36:49.017973+0000","last_peered":"2024-09-12T01:36:49.017973+0000","last_clean":"2024-09-12T01:36:49.017973+0000","last_became_active":"2024-09-12T00:43:38.795206+0000","last_became_peered":"2024-09-12T00:43:38.795206+0000","last_unstale":"2024-09-12T01:36:49.017973+0000","last_undegraded":"2024-09-12T01:36:49.017973+0000","last_fullsized":"2024-09-12T01:36:49.017973+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:51.351578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":29708,"num_write":20,"num_write_kb":14332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'31","reported_seq":144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173515+0000","last_change":"2024-09-12T00:39:17.762663+0000","last_active":"2024-09-12T01:34:19.173515+0000","last_peered":"2024-09-12T01:34:19.173515+0000","last_clean":"2024-09-12T01:34:19.173515+0000","last_became_active":"2024-09-12T00:39:17.762124+0000","last_became_peered":"2024-09-12T00:39:17.762124+0000","last_unstale":"2024-09-12T01:34:19.173515+0000","last_undegraded":"2024-09-12T01:34:19.173515+0000","last_fullsized":"2024-09-12T01:34:19.173515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:55.240200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256179+0000","last_change":"2024-09-12T01:02:03.915670+0000","last_active":"2024-09-12T01:35:27.256179+0000","last_peered":"2024-09-12T01:35:27.256179+0000","last_clean":"2024-09-12T01:35:27.256179+0000","last_became_active":"2024-09-12T01:02:03.915387+0000","last_became_peered":"2024-09-12T01:02:03.915387+0000","last_unstale":"2024-09-12T01:35:27.256179+0000","last_undegraded":"2024-09-12T01:35:27.256179+0000","last_fullsized":"2024-09-12T01:35:27.256179+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:30.278716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529511+0000","last_change":"2024-09-12T00:43:43.825343+0000","last_active":"2024-09-12T01:34:29.529511+0000","last_peered":"2024-09-12T01:34:29.529511+0000","last_clean":"2024-09-12T01:34:29.529511+0000","last_became_active":"2024-09-12T00:43:43.825054+0000","last_became_peered":"2024-09-12T00:43:43.825054+0000","last_unstale":"2024-09-12T01:34:29.529511+0000","last_undegraded":"2024-09-12T01:34:29.529511+0000","last_fullsized":"2024-09-12T01:34:29.529511+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:57.949570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:54.547748+0000","last_change":"2024-09-12T00:43:38.794955+0000","last_active":"2024-09-12T01:36:54.547748+0000","last_peered":"2024-09-12T01:36:54.547748+0000","last_clean":"2024-09-12T01:36:54.547748+0000","last_became_active":"2024-09-12T00:43:38.794612+0000","last_became_peered":"2024-09-12T00:43:38.794612+0000","last_unstale":"2024-09-12T01:36:54.547748+0000","last_undegraded":"2024-09-12T01:36:54.547748+0000","last_fullsized":"2024-09-12T01:36:54.547748+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:55.593800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'16","reported_seq":92,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:20.083241+0000","last_change":"2024-09-12T00:39:17.772179+0000","last_active":"2024-09-12T01:34:20.083241+0000","last_peered":"2024-09-12T01:34:20.083241+0000","last_clean":"2024-09-12T01:34:20.083241+0000","last_became_active":"2024-09-12T00:39:17.771839+0000","last_became_peered":"2024-09-12T00:39:17.771839+0000","last_unstale":"2024-09-12T01:34:20.083241+0000","last_undegraded":"2024-09-12T01:34:20.083241+0000","last_fullsized":"2024-09-12T01:34:20.083241+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:56.418566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":43,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.084810+0000","last_change":"2024-09-12T01:02:03.928338+0000","last_active":"2024-09-12T01:34:35.084810+0000","last_peered":"2024-09-12T01:34:35.084810+0000","last_clean":"2024-09-12T01:34:35.084810+0000","last_became_active":"2024-09-12T01:02:03.928036+0000","last_became_peered":"2024-09-12T01:02:03.928036+0000","last_unstale":"2024-09-12T01:34:35.084810+0000","last_undegraded":"2024-09-12T01:34:35.084810+0000","last_fullsized":"2024-09-12T01:34:35.084810+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:58.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079595+0000","last_change":"2024-09-12T00:43:43.819611+0000","last_active":"2024-09-12T01:33:45.079595+0000","last_peered":"2024-09-12T01:33:45.079595+0000","last_clean":"2024-09-12T01:33:45.079595+0000","last_became_active":"2024-09-12T00:43:43.819239+0000","last_became_peered":"2024-09-12T00:43:43.819239+0000","last_unstale":"2024-09-12T01:33:45.079595+0000","last_undegraded":"2024-09-12T01:33:45.079595+0000","last_fullsized":"2024-09-12T01:33:45.079595+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.073168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8210,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"266'10","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.988208+0000","last_change":"2024-09-12T00:43:38.785050+0000","last_active":"2024-09-12T01:36:09.988208+0000","last_peered":"2024-09-12T01:36:09.988208+0000","last_clean":"2024-09-12T01:36:09.988208+0000","last_became_active":"2024-09-12T00:43:38.784746+0000","last_became_peered":"2024-09-12T00:43:38.784746+0000","last_unstale":"2024-09-12T01:36:09.988208+0000","last_undegraded":"2024-09-12T01:36:09.988208+0000","last_fullsized":"2024-09-12T01:36:09.988208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:12.845708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"257'30","reported_seq":143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123074+0000","last_change":"2024-09-12T00:39:17.764933+0000","last_active":"2024-09-12T01:35:05.123074+0000","last_peered":"2024-09-12T01:35:05.123074+0000","last_clean":"2024-09-12T01:35:05.123074+0000","last_became_active":"2024-09-12T00:39:17.764658+0000","last_became_peered":"2024-09-12T00:39:17.764658+0000","last_unstale":"2024-09-12T01:35:05.123074+0000","last_undegraded":"2024-09-12T01:35:05.123074+0000","last_fullsized":"2024-09-12T01:35:05.123074+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:54.897501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":139,"num_write":41,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.977764+0000","last_change":"2024-09-12T01:02:03.917684+0000","last_active":"2024-09-12T01:34:34.977764+0000","last_peered":"2024-09-12T01:34:34.977764+0000","last_clean":"2024-09-12T01:34:34.977764+0000","last_became_active":"2024-09-12T01:02:03.917362+0000","last_became_peered":"2024-09-12T01:02:03.917362+0000","last_unstale":"2024-09-12T01:34:34.977764+0000","last_undegraded":"2024-09-12T01:34:34.977764+0000","last_fullsized":"2024-09-12T01:34:34.977764+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:13.774129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"266'8","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.668909+0000","last_change":"2024-09-12T00:43:43.822843+0000","last_active":"2024-09-12T01:37:38.668909+0000","last_peered":"2024-09-12T01:37:38.668909+0000","last_clean":"2024-09-12T01:37:38.668909+0000","last_became_active":"2024-09-12T00:43:43.822574+0000","last_became_peered":"2024-09-12T00:43:43.822574+0000","last_unstale":"2024-09-12T01:37:38.668909+0000","last_undegraded":"2024-09-12T01:37:38.668909+0000","last_fullsized":"2024-09-12T01:37:38.668909+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:31.603888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9228,"num_write":8,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.189305+0000","last_change":"2024-09-12T00:43:38.799826+0000","last_active":"2024-09-12T01:36:09.189305+0000","last_peered":"2024-09-12T01:36:09.189305+0000","last_clean":"2024-09-12T01:36:09.189305+0000","last_became_active":"2024-09-12T00:43:38.799567+0000","last_became_peered":"2024-09-12T00:43:38.799567+0000","last_unstale":"2024-09-12T01:36:09.189305+0000","last_undegraded":"2024-09-12T01:36:09.189305+0000","last_fullsized":"2024-09-12T01:36:09.189305+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:50.512707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'52","reported_seq":196,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.178294+0000","last_change":"2024-09-12T00:39:17.761012+0000","last_active":"2024-09-12T01:34:54.178294+0000","last_peered":"2024-09-12T01:34:54.178294+0000","last_clean":"2024-09-12T01:34:54.178294+0000","last_became_active":"2024-09-12T00:39:17.760735+0000","last_became_peered":"2024-09-12T00:39:17.760735+0000","last_unstale":"2024-09-12T01:34:54.178294+0000","last_undegraded":"2024-09-12T01:34:54.178294+0000","last_fullsized":"2024-09-12T01:34:54.178294+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:37.209781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":192,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997802+0000","last_change":"2024-09-12T01:02:03.925249+0000","last_active":"2024-09-12T01:34:43.997802+0000","last_peered":"2024-09-12T01:34:43.997802+0000","last_clean":"2024-09-12T01:34:43.997802+0000","last_became_active":"2024-09-12T01:02:03.924800+0000","last_became_peered":"2024-09-12T01:02:03.924800+0000","last_unstale":"2024-09-12T01:34:43.997802+0000","last_undegraded":"2024-09-12T01:34:43.997802+0000","last_fullsized":"2024-09-12T01:34:43.997802+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:42.824392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:30.118030+0000","last_change":"2024-09-12T00:43:43.822402+0000","last_active":"2024-09-12T01:34:30.118030+0000","last_peered":"2024-09-12T01:34:30.118030+0000","last_clean":"2024-09-12T01:34:30.118030+0000","last_became_active":"2024-09-12T00:43:43.822130+0000","last_became_peered":"2024-09-12T00:43:43.822130+0000","last_unstale":"2024-09-12T01:34:30.118030+0000","last_undegraded":"2024-09-12T01:34:30.118030+0000","last_fullsized":"2024-09-12T01:34:30.118030+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:52.855759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533810+0000","last_change":"2024-09-12T00:43:38.789538+0000","last_active":"2024-09-12T01:35:04.533810+0000","last_peered":"2024-09-12T01:35:04.533810+0000","last_clean":"2024-09-12T01:35:04.533810+0000","last_became_active":"2024-09-12T00:43:38.789198+0000","last_became_peered":"2024-09-12T00:43:38.789198+0000","last_unstale":"2024-09-12T01:35:04.533810+0000","last_undegraded":"2024-09-12T01:35:04.533810+0000","last_fullsized":"2024-09-12T01:35:04.533810+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:11.316230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'15","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250354+0000","last_change":"2024-09-12T00:39:17.767969+0000","last_active":"2024-09-12T01:34:52.250354+0000","last_peered":"2024-09-12T01:34:52.250354+0000","last_clean":"2024-09-12T01:34:52.250354+0000","last_became_active":"2024-09-12T00:39:17.767662+0000","last_became_peered":"2024-09-12T00:39:17.767662+0000","last_unstale":"2024-09-12T01:34:52.250354+0000","last_undegraded":"2024-09-12T01:34:52.250354+0000","last_fullsized":"2024-09-12T01:34:52.250354+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:30.457902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:44.177191+0000","last_change":"2024-09-12T01:02:03.924577+0000","last_active":"2024-09-12T01:34:44.177191+0000","last_peered":"2024-09-12T01:34:44.177191+0000","last_clean":"2024-09-12T01:34:44.177191+0000","last_became_active":"2024-09-12T01:02:03.924303+0000","last_became_peered":"2024-09-12T01:02:03.924303+0000","last_unstale":"2024-09-12T01:34:44.177191+0000","last_undegraded":"2024-09-12T01:34:44.177191+0000","last_fullsized":"2024-09-12T01:34:44.177191+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:24.298478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'9","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.843719+0000","last_change":"2024-09-12T00:43:43.821003+0000","last_active":"2024-09-12T01:37:38.843719+0000","last_peered":"2024-09-12T01:37:38.843719+0000","last_clean":"2024-09-12T01:37:38.843719+0000","last_became_active":"2024-09-12T00:43:43.819058+0000","last_became_peered":"2024-09-12T00:43:43.819058+0000","last_unstale":"2024-09-12T01:37:38.843719+0000","last_undegraded":"2024-09-12T01:37:38.843719+0000","last_fullsized":"2024-09-12T01:37:38.843719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:02.246750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9222,"num_write":14,"num_write_kb":9222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"266'8","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.626218+0000","last_change":"2024-09-12T00:43:38.796717+0000","last_active":"2024-09-12T01:37:38.626218+0000","last_peered":"2024-09-12T01:37:38.626218+0000","last_clean":"2024-09-12T01:37:38.626218+0000","last_became_active":"2024-09-12T00:43:38.796426+0000","last_became_peered":"2024-09-12T00:43:38.796426+0000","last_unstale":"2024-09-12T01:37:38.626218+0000","last_undegraded":"2024-09-12T01:37:38.626218+0000","last_fullsized":"2024-09-12T01:37:38.626218+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:20.544492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9226,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250340+0000","last_change":"2024-09-12T00:39:17.767397+0000","last_active":"2024-09-12T01:34:52.250340+0000","last_peered":"2024-09-12T01:34:52.250340+0000","last_clean":"2024-09-12T01:34:52.250340+0000","last_became_active":"2024-09-12T00:39:17.767088+0000","last_became_peered":"2024-09-12T00:39:17.767088+0000","last_unstale":"2024-09-12T01:34:52.250340+0000","last_undegraded":"2024-09-12T01:34:52.250340+0000","last_fullsized":"2024-09-12T01:34:52.250340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:12.858828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:45.085791+0000","last_change":"2024-09-12T01:02:03.925759+0000","last_active":"2024-09-12T01:34:45.085791+0000","last_peered":"2024-09-12T01:34:45.085791+0000","last_clean":"2024-09-12T01:34:45.085791+0000","last_became_active":"2024-09-12T01:02:03.925482+0000","last_became_peered":"2024-09-12T01:02:03.925482+0000","last_unstale":"2024-09-12T01:34:45.085791+0000","last_undegraded":"2024-09-12T01:34:45.085791+0000","last_fullsized":"2024-09-12T01:34:45.085791+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:13.030524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:55.139373+0000","last_change":"2024-09-12T00:43:43.820868+0000","last_active":"2024-09-12T01:36:55.139373+0000","last_peered":"2024-09-12T01:36:55.139373+0000","last_clean":"2024-09-12T01:36:55.139373+0000","last_became_active":"2024-09-12T00:43:43.820272+0000","last_became_peered":"2024-09-12T00:43:43.820272+0000","last_unstale":"2024-09-12T01:36:55.139373+0000","last_undegraded":"2024-09-12T01:36:55.139373+0000","last_fullsized":"2024-09-12T01:36:55.139373+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:42.963849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'6","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:50.138568+0000","last_change":"2024-09-12T00:43:38.800018+0000","last_active":"2024-09-12T01:36:50.138568+0000","last_peered":"2024-09-12T01:36:50.138568+0000","last_clean":"2024-09-12T01:36:50.138568+0000","last_became_active":"2024-09-12T00:43:38.799719+0000","last_became_peered":"2024-09-12T00:43:38.799719+0000","last_unstale":"2024-09-12T01:36:50.138568+0000","last_undegraded":"2024-09-12T01:36:50.138568+0000","last_fullsized":"2024-09-12T01:36:50.138568+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:07.155485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20462,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'32","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:55.121695+0000","last_change":"2024-09-12T00:39:17.762941+0000","last_active":"2024-09-12T01:34:55.121695+0000","last_peered":"2024-09-12T01:34:55.121695+0000","last_clean":"2024-09-12T01:34:55.121695+0000","last_became_active":"2024-09-12T00:39:17.762639+0000","last_became_peered":"2024-09-12T00:39:17.762639+0000","last_unstale":"2024-09-12T01:34:55.121695+0000","last_undegraded":"2024-09-12T01:34:55.121695+0000","last_fullsized":"2024-09-12T01:34:55.121695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:15.974100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:44.978932+0000","last_change":"2024-09-12T01:02:03.925349+0000","last_active":"2024-09-12T01:34:44.978932+0000","last_peered":"2024-09-12T01:34:44.978932+0000","last_clean":"2024-09-12T01:34:44.978932+0000","last_became_active":"2024-09-12T01:02:03.924892+0000","last_became_peered":"2024-09-12T01:02:03.924892+0000","last_unstale":"2024-09-12T01:34:44.978932+0000","last_undegraded":"2024-09-12T01:34:44.978932+0000","last_fullsized":"2024-09-12T01:34:44.978932+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:07.795848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'4","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:54.994285+0000","last_change":"2024-09-12T00:43:43.819938+0000","last_active":"2024-09-12T01:36:54.994285+0000","last_peered":"2024-09-12T01:36:54.994285+0000","last_clean":"2024-09-12T01:36:54.994285+0000","last_became_active":"2024-09-12T00:43:43.819431+0000","last_became_peered":"2024-09-12T00:43:43.819431+0000","last_unstale":"2024-09-12T01:36:54.994285+0000","last_undegraded":"2024-09-12T01:36:54.994285+0000","last_fullsized":"2024-09-12T01:36:54.994285+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:42.027354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"266'3","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:49.018108+0000","last_change":"2024-09-12T00:43:38.797182+0000","last_active":"2024-09-12T01:36:49.018108+0000","last_peered":"2024-09-12T01:36:49.018108+0000","last_clean":"2024-09-12T01:36:49.018108+0000","last_became_active":"2024-09-12T00:43:38.796894+0000","last_became_peered":"2024-09-12T00:43:38.796894+0000","last_unstale":"2024-09-12T01:36:49.018108+0000","last_undegraded":"2024-09-12T01:36:49.018108+0000","last_fullsized":"2024-09-12T01:36:49.018108+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:57.433793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'47","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:04.519365+0000","last_change":"2024-09-12T00:39:17.762269+0000","last_active":"2024-09-12T01:33:04.519365+0000","last_peered":"2024-09-12T01:33:04.519365+0000","last_clean":"2024-09-12T01:33:04.519365+0000","last_became_active":"2024-09-12T00:39:17.761972+0000","last_became_peered":"2024-09-12T00:39:17.761972+0000","last_unstale":"2024-09-12T01:33:04.519365+0000","last_undegraded":"2024-09-12T01:33:04.519365+0000","last_fullsized":"2024-09-12T01:33:04.519365+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:47.885908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":165,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:28.985653+0000","last_change":"2024-09-12T01:02:03.923742+0000","last_active":"2024-09-12T01:33:28.985653+0000","last_peered":"2024-09-12T01:33:28.985653+0000","last_clean":"2024-09-12T01:33:28.985653+0000","last_became_active":"2024-09-12T01:02:03.923464+0000","last_became_peered":"2024-09-12T01:02:03.923464+0000","last_unstale":"2024-09-12T01:33:28.985653+0000","last_undegraded":"2024-09-12T01:33:28.985653+0000","last_fullsized":"2024-09-12T01:33:28.985653+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:44.541153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'11","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.842146+0000","last_change":"2024-09-12T00:43:43.818258+0000","last_active":"2024-09-12T01:37:38.842146+0000","last_peered":"2024-09-12T01:37:38.842146+0000","last_clean":"2024-09-12T01:37:38.842146+0000","last_became_active":"2024-09-12T00:43:43.817990+0000","last_became_peered":"2024-09-12T00:43:43.817990+0000","last_unstale":"2024-09-12T01:37:38.842146+0000","last_undegraded":"2024-09-12T01:37:38.842146+0000","last_fullsized":"2024-09-12T01:37:38.842146+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:00.011210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14448,"num_write":16,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"266'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.103250+0000","last_change":"2024-09-12T00:43:38.795940+0000","last_active":"2024-09-12T01:37:19.103250+0000","last_peered":"2024-09-12T01:37:19.103250+0000","last_clean":"2024-09-12T01:37:19.103250+0000","last_became_active":"2024-09-12T00:43:38.793825+0000","last_became_peered":"2024-09-12T00:43:38.793825+0000","last_unstale":"2024-09-12T01:37:19.103250+0000","last_undegraded":"2024-09-12T01:37:19.103250+0000","last_fullsized":"2024-09-12T01:37:19.103250+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:24.205683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'20","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.535804+0000","last_change":"2024-09-12T00:39:17.770201+0000","last_active":"2024-09-12T01:35:19.535804+0000","last_peered":"2024-09-12T01:35:19.535804+0000","last_clean":"2024-09-12T01:35:19.535804+0000","last_became_active":"2024-09-12T00:39:17.769263+0000","last_became_peered":"2024-09-12T00:39:17.769263+0000","last_unstale":"2024-09-12T01:35:19.535804+0000","last_undegraded":"2024-09-12T01:35:19.535804+0000","last_fullsized":"2024-09-12T01:35:19.535804+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:15.097860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.165777+0000","last_change":"2024-09-12T01:02:03.924548+0000","last_active":"2024-09-12T01:33:29.165777+0000","last_peered":"2024-09-12T01:33:29.165777+0000","last_clean":"2024-09-12T01:33:29.165777+0000","last_became_active":"2024-09-12T01:02:03.924260+0000","last_became_peered":"2024-09-12T01:02:03.924260+0000","last_unstale":"2024-09-12T01:33:29.165777+0000","last_undegraded":"2024-09-12T01:33:29.165777+0000","last_fullsized":"2024-09-12T01:33:29.165777+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:07.250231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"266'3","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:24.023301+0000","last_change":"2024-09-12T00:43:43.824871+0000","last_active":"2024-09-12T01:37:24.023301+0000","last_peered":"2024-09-12T01:37:24.023301+0000","last_clean":"2024-09-12T01:37:24.023301+0000","last_became_active":"2024-09-12T00:43:43.824567+0000","last_became_peered":"2024-09-12T00:43:43.824567+0000","last_unstale":"2024-09-12T01:37:24.023301+0000","last_undegraded":"2024-09-12T01:37:24.023301+0000","last_fullsized":"2024-09-12T01:37:24.023301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:24.293339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"266'5","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.022626+0000","last_change":"2024-09-12T00:43:38.798453+0000","last_active":"2024-09-12T01:37:19.022626+0000","last_peered":"2024-09-12T01:37:19.022626+0000","last_clean":"2024-09-12T01:37:19.022626+0000","last_became_active":"2024-09-12T00:43:38.798200+0000","last_became_peered":"2024-09-12T00:43:38.798200+0000","last_unstale":"2024-09-12T01:37:19.022626+0000","last_undegraded":"2024-09-12T01:37:19.022626+0000","last_fullsized":"2024-09-12T01:37:19.022626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:27.881376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"266'30","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125273+0000","last_change":"2024-09-12T00:39:17.766861+0000","last_active":"2024-09-12T01:35:20.125273+0000","last_peered":"2024-09-12T01:35:20.125273+0000","last_clean":"2024-09-12T01:35:20.125273+0000","last_became_active":"2024-09-12T00:39:17.766600+0000","last_became_peered":"2024-09-12T00:39:17.766600+0000","last_unstale":"2024-09-12T01:35:20.125273+0000","last_undegraded":"2024-09-12T01:35:20.125273+0000","last_fullsized":"2024-09-12T01:35:20.125273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:07.049466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":112,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250307+0000","last_change":"2024-09-12T01:02:03.919723+0000","last_active":"2024-09-12T01:34:52.250307+0000","last_peered":"2024-09-12T01:34:52.250307+0000","last_clean":"2024-09-12T01:34:52.250307+0000","last_became_active":"2024-09-12T01:02:03.919377+0000","last_became_peered":"2024-09-12T01:02:03.919377+0000","last_unstale":"2024-09-12T01:34:52.250307+0000","last_undegraded":"2024-09-12T01:34:52.250307+0000","last_fullsized":"2024-09-12T01:34:52.250307+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:59.358385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123101+0000","last_change":"2024-09-12T00:43:43.818424+0000","last_active":"2024-09-12T01:35:05.123101+0000","last_peered":"2024-09-12T01:35:05.123101+0000","last_clean":"2024-09-12T01:35:05.123101+0000","last_became_active":"2024-09-12T00:43:43.818153+0000","last_became_peered":"2024-09-12T00:43:43.818153+0000","last_unstale":"2024-09-12T01:35:05.123101+0000","last_undegraded":"2024-09-12T01:35:05.123101+0000","last_fullsized":"2024-09-12T01:35:05.123101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.787318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'6","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.890420+0000","last_change":"2024-09-12T00:43:38.792429+0000","last_active":"2024-09-12T01:37:38.890420+0000","last_peered":"2024-09-12T01:37:38.890420+0000","last_clean":"2024-09-12T01:37:38.890420+0000","last_became_active":"2024-09-12T00:43:38.792135+0000","last_became_peered":"2024-09-12T00:43:38.792135+0000","last_unstale":"2024-09-12T01:37:38.890420+0000","last_undegraded":"2024-09-12T01:37:38.890420+0000","last_fullsized":"2024-09-12T01:37:38.890420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:11.570953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8232,"num_write":6,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"266'12","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.089651+0000","last_change":"2024-09-12T00:39:17.768309+0000","last_active":"2024-09-12T01:35:20.089651+0000","last_peered":"2024-09-12T01:35:20.089651+0000","last_clean":"2024-09-12T01:35:20.089651+0000","last_became_active":"2024-09-12T00:39:17.767599+0000","last_became_peered":"2024-09-12T00:39:17.767599+0000","last_unstale":"2024-09-12T01:35:20.089651+0000","last_undegraded":"2024-09-12T01:35:20.089651+0000","last_fullsized":"2024-09-12T01:35:20.089651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:18.635424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.165738+0000","last_change":"2024-09-12T01:02:03.918519+0000","last_active":"2024-09-12T01:33:29.165738+0000","last_peered":"2024-09-12T01:33:29.165738+0000","last_clean":"2024-09-12T01:33:29.165738+0000","last_became_active":"2024-09-12T01:02:03.918248+0000","last_became_peered":"2024-09-12T01:02:03.918248+0000","last_unstale":"2024-09-12T01:33:29.165738+0000","last_undegraded":"2024-09-12T01:33:29.165738+0000","last_fullsized":"2024-09-12T01:33:29.165738+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:15.650720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533744+0000","last_change":"2024-09-12T00:43:43.825033+0000","last_active":"2024-09-12T01:35:04.533744+0000","last_peered":"2024-09-12T01:35:04.533744+0000","last_clean":"2024-09-12T01:35:04.533744+0000","last_became_active":"2024-09-12T00:43:43.822993+0000","last_became_peered":"2024-09-12T00:43:43.822993+0000","last_unstale":"2024-09-12T01:35:04.533744+0000","last_undegraded":"2024-09-12T01:35:04.533744+0000","last_fullsized":"2024-09-12T01:35:04.533744+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.928486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:59.087781+0000","last_change":"2024-09-12T00:43:38.795993+0000","last_active":"2024-09-12T01:34:59.087781+0000","last_peered":"2024-09-12T01:34:59.087781+0000","last_clean":"2024-09-12T01:34:59.087781+0000","last_became_active":"2024-09-12T00:43:38.795625+0000","last_became_peered":"2024-09-12T00:43:38.795625+0000","last_unstale":"2024-09-12T01:34:59.087781+0000","last_undegraded":"2024-09-12T01:34:59.087781+0000","last_fullsized":"2024-09-12T01:34:59.087781+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:32.904211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'39","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125177+0000","last_change":"2024-09-12T00:39:17.761781+0000","last_active":"2024-09-12T01:35:20.125177+0000","last_peered":"2024-09-12T01:35:20.125177+0000","last_clean":"2024-09-12T01:35:20.125177+0000","last_became_active":"2024-09-12T00:39:17.761517+0000","last_became_peered":"2024-09-12T00:39:17.761517+0000","last_unstale":"2024-09-12T01:35:20.125177+0000","last_undegraded":"2024-09-12T01:35:20.125177+0000","last_fullsized":"2024-09-12T01:35:20.125177+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:36.401035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997821+0000","last_change":"2024-09-12T01:02:03.924588+0000","last_active":"2024-09-12T01:34:43.997821+0000","last_peered":"2024-09-12T01:34:43.997821+0000","last_clean":"2024-09-12T01:34:43.997821+0000","last_became_active":"2024-09-12T01:02:03.923808+0000","last_became_peered":"2024-09-12T01:02:03.923808+0000","last_unstale":"2024-09-12T01:34:43.997821+0000","last_undegraded":"2024-09-12T01:34:43.997821+0000","last_fullsized":"2024-09-12T01:34:43.997821+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:42.299573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'5","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:15.106685+0000","last_change":"2024-09-12T00:43:43.819522+0000","last_active":"2024-09-12T01:33:15.106685+0000","last_peered":"2024-09-12T01:33:15.106685+0000","last_clean":"2024-09-12T01:33:15.106685+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:33:15.106685+0000","last_undegraded":"2024-09-12T01:33:15.106685+0000","last_fullsized":"2024-09-12T01:33:15.106685+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:30.323747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'4","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.786735+0000","last_change":"2024-09-12T00:43:38.795759+0000","last_active":"2024-09-12T01:37:38.786735+0000","last_peered":"2024-09-12T01:37:38.786735+0000","last_clean":"2024-09-12T01:37:38.786735+0000","last_became_active":"2024-09-12T00:43:38.795451+0000","last_became_peered":"2024-09-12T00:43:38.795451+0000","last_unstale":"2024-09-12T01:37:38.786735+0000","last_undegraded":"2024-09-12T01:37:38.786735+0000","last_fullsized":"2024-09-12T01:37:38.786735+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:17.278286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'133","reported_seq":488,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:30.109250+0000","last_change":"2024-09-12T00:39:17.763176+0000","last_active":"2024-09-12T01:33:30.109250+0000","last_peered":"2024-09-12T01:33:30.109250+0000","last_clean":"2024-09-12T01:33:30.109250+0000","last_became_active":"2024-09-12T00:39:17.762649+0000","last_became_peered":"2024-09-12T00:39:17.762649+0000","last_unstale":"2024-09-12T01:33:30.109250+0000","last_undegraded":"2024-09-12T01:33:30.109250+0000","last_fullsized":"2024-09-12T01:33:30.109250+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:52.621341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":844,"num_read_kb":585,"num_write":185,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.078996+0000","last_change":"2024-09-12T01:02:03.925718+0000","last_active":"2024-09-12T01:33:34.078996+0000","last_peered":"2024-09-12T01:33:34.078996+0000","last_clean":"2024-09-12T01:33:34.078996+0000","last_became_active":"2024-09-12T01:02:03.924934+0000","last_became_peered":"2024-09-12T01:02:03.924934+0000","last_unstale":"2024-09-12T01:33:34.078996+0000","last_undegraded":"2024-09-12T01:33:34.078996+0000","last_fullsized":"2024-09-12T01:33:34.078996+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:26.933104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:15.106630+0000","last_change":"2024-09-12T00:43:43.822008+0000","last_active":"2024-09-12T01:33:15.106630+0000","last_peered":"2024-09-12T01:33:15.106630+0000","last_clean":"2024-09-12T01:33:15.106630+0000","last_became_active":"2024-09-12T00:43:43.821288+0000","last_became_peered":"2024-09-12T00:43:43.821288+0000","last_unstale":"2024-09-12T01:33:15.106630+0000","last_undegraded":"2024-09-12T01:33:15.106630+0000","last_fullsized":"2024-09-12T01:33:15.106630+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:12.223424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.182657+0000","last_change":"2024-09-12T00:43:38.798047+0000","last_active":"2024-09-12T01:35:24.182657+0000","last_peered":"2024-09-12T01:35:24.182657+0000","last_clean":"2024-09-12T01:35:24.182657+0000","last_became_active":"2024-09-12T00:43:38.797782+0000","last_became_peered":"2024-09-12T00:43:38.797782+0000","last_unstale":"2024-09-12T01:35:24.182657+0000","last_undegraded":"2024-09-12T01:35:24.182657+0000","last_fullsized":"2024-09-12T01:35:24.182657+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:52.438462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'33","reported_seq":147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.521087+0000","last_change":"2024-09-12T00:39:17.769240+0000","last_active":"2024-09-12T01:33:19.521087+0000","last_peered":"2024-09-12T01:33:19.521087+0000","last_clean":"2024-09-12T01:33:19.521087+0000","last_became_active":"2024-09-12T00:39:17.768151+0000","last_became_peered":"2024-09-12T00:39:17.768151+0000","last_unstale":"2024-09-12T01:33:19.521087+0000","last_undegraded":"2024-09-12T01:33:19.521087+0000","last_fullsized":"2024-09-12T01:33:19.521087+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:44.421190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.530106+0000","last_change":"2024-09-12T01:02:03.922540+0000","last_active":"2024-09-12T01:34:34.530106+0000","last_peered":"2024-09-12T01:34:34.530106+0000","last_clean":"2024-09-12T01:34:34.530106+0000","last_became_active":"2024-09-12T01:02:03.921595+0000","last_became_peered":"2024-09-12T01:02:03.921595+0000","last_unstale":"2024-09-12T01:34:34.530106+0000","last_undegraded":"2024-09-12T01:34:34.530106+0000","last_fullsized":"2024-09-12T01:34:34.530106+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.523672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"266'9","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:40.128350+0000","last_change":"2024-09-12T00:43:43.820529+0000","last_active":"2024-09-12T01:35:40.128350+0000","last_peered":"2024-09-12T01:35:40.128350+0000","last_clean":"2024-09-12T01:35:40.128350+0000","last_became_active":"2024-09-12T00:43:43.819990+0000","last_became_peered":"2024-09-12T00:43:43.819990+0000","last_unstale":"2024-09-12T01:35:40.128350+0000","last_undegraded":"2024-09-12T01:35:40.128350+0000","last_fullsized":"2024-09-12T01:35:40.128350+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:58.280401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8217,"num_write":14,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.750005+0000","last_change":"2024-09-12T00:43:38.798676+0000","last_active":"2024-09-12T01:37:38.750005+0000","last_peered":"2024-09-12T01:37:38.750005+0000","last_clean":"2024-09-12T01:37:38.750005+0000","last_became_active":"2024-09-12T00:43:38.798374+0000","last_became_peered":"2024-09-12T00:43:38.798374+0000","last_unstale":"2024-09-12T01:37:38.750005+0000","last_undegraded":"2024-09-12T01:37:38.750005+0000","last_fullsized":"2024-09-12T01:37:38.750005+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:29.029265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":166,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.077519+0000","last_change":"2024-09-12T00:39:17.758205+0000","last_active":"2024-09-12T01:33:19.077519+0000","last_peered":"2024-09-12T01:33:19.077519+0000","last_clean":"2024-09-12T01:33:19.077519+0000","last_became_active":"2024-09-12T00:39:17.757795+0000","last_became_peered":"2024-09-12T00:39:17.757795+0000","last_unstale":"2024-09-12T01:33:19.077519+0000","last_undegraded":"2024-09-12T01:33:19.077519+0000","last_fullsized":"2024-09-12T01:33:19.077519+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:32.214592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.085182+0000","last_change":"2024-09-12T01:02:03.924136+0000","last_active":"2024-09-12T01:34:34.085182+0000","last_peered":"2024-09-12T01:34:34.085182+0000","last_clean":"2024-09-12T01:34:34.085182+0000","last_became_active":"2024-09-12T01:02:03.923774+0000","last_became_peered":"2024-09-12T01:02:03.923774+0000","last_unstale":"2024-09-12T01:34:34.085182+0000","last_undegraded":"2024-09-12T01:34:34.085182+0000","last_fullsized":"2024-09-12T01:34:34.085182+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:13.881070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.741914+0000","last_change":"2024-09-12T00:43:43.820925+0000","last_active":"2024-09-12T01:37:38.741914+0000","last_peered":"2024-09-12T01:37:38.741914+0000","last_clean":"2024-09-12T01:37:38.741914+0000","last_became_active":"2024-09-12T00:43:43.819044+0000","last_became_peered":"2024-09-12T00:43:43.819044+0000","last_unstale":"2024-09-12T01:37:38.741914+0000","last_undegraded":"2024-09-12T01:37:38.741914+0000","last_fullsized":"2024-09-12T01:37:38.741914+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:51.315359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6160,"num_write":14,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:20.107587+0000","last_change":"2024-09-12T00:43:38.797698+0000","last_active":"2024-09-12T01:33:20.107587+0000","last_peered":"2024-09-12T01:33:20.107587+0000","last_clean":"2024-09-12T01:33:20.107587+0000","last_became_active":"2024-09-12T00:43:38.797343+0000","last_became_peered":"2024-09-12T00:43:38.797343+0000","last_unstale":"2024-09-12T01:33:20.107587+0000","last_undegraded":"2024-09-12T01:33:20.107587+0000","last_fullsized":"2024-09-12T01:33:20.107587+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:07.327017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'33","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.164334+0000","last_change":"2024-09-12T00:39:17.760056+0000","last_active":"2024-09-12T01:33:19.164334+0000","last_peered":"2024-09-12T01:33:19.164334+0000","last_clean":"2024-09-12T01:33:19.164334+0000","last_became_active":"2024-09-12T00:39:17.759701+0000","last_became_peered":"2024-09-12T00:39:17.759701+0000","last_unstale":"2024-09-12T01:33:19.164334+0000","last_undegraded":"2024-09-12T01:33:19.164334+0000","last_fullsized":"2024-09-12T01:33:19.164334+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:36.105302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":64,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:33.986537+0000","last_change":"2024-09-12T01:02:03.923765+0000","last_active":"2024-09-12T01:33:33.986537+0000","last_peered":"2024-09-12T01:33:33.986537+0000","last_clean":"2024-09-12T01:33:33.986537+0000","last_became_active":"2024-09-12T01:02:03.923440+0000","last_became_peered":"2024-09-12T01:02:03.923440+0000","last_unstale":"2024-09-12T01:33:33.986537+0000","last_undegraded":"2024-09-12T01:33:33.986537+0000","last_fullsized":"2024-09-12T01:33:33.986537+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:46.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'5","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.538821+0000","last_change":"2024-09-12T00:43:43.819656+0000","last_active":"2024-09-12T01:35:44.538821+0000","last_peered":"2024-09-12T01:35:44.538821+0000","last_clean":"2024-09-12T01:35:44.538821+0000","last_became_active":"2024-09-12T00:43:43.819247+0000","last_became_peered":"2024-09-12T00:43:43.819247+0000","last_unstale":"2024-09-12T01:35:44.538821+0000","last_undegraded":"2024-09-12T01:35:44.538821+0000","last_fullsized":"2024-09-12T01:35:44.538821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:00.847535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"266'5","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:40.128225+0000","last_change":"2024-09-12T00:43:38.794688+0000","last_active":"2024-09-12T01:35:40.128225+0000","last_peered":"2024-09-12T01:35:40.128225+0000","last_clean":"2024-09-12T01:35:40.128225+0000","last_became_active":"2024-09-12T00:43:38.794286+0000","last_became_peered":"2024-09-12T00:43:38.794286+0000","last_unstale":"2024-09-12T01:35:40.128225+0000","last_undegraded":"2024-09-12T01:35:40.128225+0000","last_fullsized":"2024-09-12T01:35:40.128225+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:52.618143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'28","reported_seq":129,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.164290+0000","last_change":"2024-09-12T00:39:17.762387+0000","last_active":"2024-09-12T01:33:19.164290+0000","last_peered":"2024-09-12T01:33:19.164290+0000","last_clean":"2024-09-12T01:33:19.164290+0000","last_became_active":"2024-09-12T00:39:17.761738+0000","last_became_peered":"2024-09-12T00:39:17.761738+0000","last_unstale":"2024-09-12T01:33:19.164290+0000","last_undegraded":"2024-09-12T01:33:19.164290+0000","last_fullsized":"2024-09-12T01:33:19.164290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:49.875350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":96,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.079050+0000","last_change":"2024-09-12T01:02:03.928768+0000","last_active":"2024-09-12T01:33:40.079050+0000","last_peered":"2024-09-12T01:33:40.079050+0000","last_clean":"2024-09-12T01:33:40.079050+0000","last_became_active":"2024-09-12T01:02:03.928475+0000","last_became_peered":"2024-09-12T01:02:03.928475+0000","last_unstale":"2024-09-12T01:33:40.079050+0000","last_undegraded":"2024-09-12T01:33:40.079050+0000","last_fullsized":"2024-09-12T01:33:40.079050+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:39.969871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'2","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:35.078402+0000","last_change":"2024-09-12T00:43:43.821438+0000","last_active":"2024-09-12T01:33:35.078402+0000","last_peered":"2024-09-12T01:33:35.078402+0000","last_clean":"2024-09-12T01:33:35.078402+0000","last_became_active":"2024-09-12T00:43:43.821149+0000","last_became_peered":"2024-09-12T00:43:43.821149+0000","last_unstale":"2024-09-12T01:33:35.078402+0000","last_undegraded":"2024-09-12T01:33:35.078402+0000","last_fullsized":"2024-09-12T01:33:35.078402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:02.729782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'9","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.627920+0000","last_change":"2024-09-12T00:43:38.799268+0000","last_active":"2024-09-12T01:37:38.627920+0000","last_peered":"2024-09-12T01:37:38.627920+0000","last_clean":"2024-09-12T01:37:38.627920+0000","last_became_active":"2024-09-12T00:43:38.798510+0000","last_became_peered":"2024-09-12T00:43:38.798510+0000","last_unstale":"2024-09-12T01:37:38.627920+0000","last_undegraded":"2024-09-12T01:37:38.627920+0000","last_fullsized":"2024-09-12T01:37:38.627920+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:19.360861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16416,"num_write":14,"num_write_kb":12320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'28","reported_seq":135,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.078974+0000","last_change":"2024-09-12T00:39:17.771090+0000","last_active":"2024-09-12T01:33:40.078974+0000","last_peered":"2024-09-12T01:33:40.078974+0000","last_clean":"2024-09-12T01:33:40.078974+0000","last_became_active":"2024-09-12T00:39:17.770779+0000","last_became_peered":"2024-09-12T00:39:17.770779+0000","last_unstale":"2024-09-12T01:33:40.078974+0000","last_undegraded":"2024-09-12T01:33:40.078974+0000","last_fullsized":"2024-09-12T01:33:40.078974+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:45.806957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.971578+0000","last_change":"2024-09-12T01:02:03.925931+0000","last_active":"2024-09-12T01:33:34.971578+0000","last_peered":"2024-09-12T01:33:34.971578+0000","last_clean":"2024-09-12T01:33:34.971578+0000","last_became_active":"2024-09-12T01:02:03.925618+0000","last_became_peered":"2024-09-12T01:02:03.925618+0000","last_unstale":"2024-09-12T01:33:34.971578+0000","last_undegraded":"2024-09-12T01:33:34.971578+0000","last_fullsized":"2024-09-12T01:33:34.971578+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:46.274807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"266'5","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.652986+0000","last_change":"2024-09-12T00:43:43.825678+0000","last_active":"2024-09-12T01:37:38.652986+0000","last_peered":"2024-09-12T01:37:38.652986+0000","last_clean":"2024-09-12T01:37:38.652986+0000","last_became_active":"2024-09-12T00:43:43.825380+0000","last_became_peered":"2024-09-12T00:43:43.825380+0000","last_unstale":"2024-09-12T01:37:38.652986+0000","last_undegraded":"2024-09-12T01:37:38.652986+0000","last_fullsized":"2024-09-12T01:37:38.652986+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:38.026807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8232,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.110471+0000","last_change":"2024-09-12T00:43:38.791841+0000","last_active":"2024-09-12T01:33:40.110471+0000","last_peered":"2024-09-12T01:33:40.110471+0000","last_clean":"2024-09-12T01:33:40.110471+0000","last_became_active":"2024-09-12T00:43:38.791586+0000","last_became_peered":"2024-09-12T00:43:38.791586+0000","last_unstale":"2024-09-12T01:33:40.110471+0000","last_undegraded":"2024-09-12T01:33:40.110471+0000","last_fullsized":"2024-09-12T01:33:40.110471+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:32.346959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'54","reported_seq":205,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:28.985589+0000","last_change":"2024-09-12T00:39:17.762695+0000","last_active":"2024-09-12T01:33:28.985589+0000","last_peered":"2024-09-12T01:33:28.985589+0000","last_clean":"2024-09-12T01:33:28.985589+0000","last_became_active":"2024-09-12T00:39:17.762435+0000","last_became_peered":"2024-09-12T00:39:17.762435+0000","last_unstale":"2024-09-12T01:33:28.985589+0000","last_undegraded":"2024-09-12T01:33:28.985589+0000","last_fullsized":"2024-09-12T01:33:28.985589+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:26.720224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":202,"num_write":91,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:35.109860+0000","last_change":"2024-09-12T01:02:03.926151+0000","last_active":"2024-09-12T01:33:35.109860+0000","last_peered":"2024-09-12T01:33:35.109860+0000","last_clean":"2024-09-12T01:33:35.109860+0000","last_became_active":"2024-09-12T01:02:03.925866+0000","last_became_peered":"2024-09-12T01:02:03.925866+0000","last_unstale":"2024-09-12T01:33:35.109860+0000","last_undegraded":"2024-09-12T01:33:35.109860+0000","last_fullsized":"2024-09-12T01:33:35.109860+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:41.925257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'3","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:54.986356+0000","last_change":"2024-09-12T00:43:43.820437+0000","last_active":"2024-09-12T01:35:54.986356+0000","last_peered":"2024-09-12T01:35:54.986356+0000","last_clean":"2024-09-12T01:35:54.986356+0000","last_became_active":"2024-09-12T00:43:43.820153+0000","last_became_peered":"2024-09-12T00:43:43.820153+0000","last_unstale":"2024-09-12T01:35:54.986356+0000","last_undegraded":"2024-09-12T01:35:54.986356+0000","last_fullsized":"2024-09-12T01:35:54.986356+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:49.421817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'3","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.628485+0000","last_change":"2024-09-12T00:43:38.790234+0000","last_active":"2024-09-12T01:37:38.628485+0000","last_peered":"2024-09-12T01:37:38.628485+0000","last_clean":"2024-09-12T01:37:38.628485+0000","last_became_active":"2024-09-12T00:43:38.789945+0000","last_became_peered":"2024-09-12T00:43:38.789945+0000","last_unstale":"2024-09-12T01:37:38.628485+0000","last_undegraded":"2024-09-12T01:37:38.628485+0000","last_fullsized":"2024-09-12T01:37:38.628485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.330002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'34","reported_seq":150,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.970915+0000","last_change":"2024-09-12T00:39:17.760033+0000","last_active":"2024-09-12T01:33:29.970915+0000","last_peered":"2024-09-12T01:33:29.970915+0000","last_clean":"2024-09-12T01:33:29.970915+0000","last_became_active":"2024-09-12T00:39:17.759741+0000","last_became_peered":"2024-09-12T00:39:17.759741+0000","last_unstale":"2024-09-12T01:33:29.970915+0000","last_undegraded":"2024-09-12T01:33:29.970915+0000","last_fullsized":"2024-09-12T01:33:29.970915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:16.079518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.983140+0000","last_change":"2024-09-12T01:02:03.919303+0000","last_active":"2024-09-12T01:35:24.983140+0000","last_peered":"2024-09-12T01:35:24.983140+0000","last_clean":"2024-09-12T01:35:24.983140+0000","last_became_active":"2024-09-12T01:02:03.918998+0000","last_became_peered":"2024-09-12T01:02:03.918998+0000","last_unstale":"2024-09-12T01:35:24.983140+0000","last_undegraded":"2024-09-12T01:35:24.983140+0000","last_fullsized":"2024-09-12T01:35:24.983140+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:39.378429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:53.989633+0000","last_change":"2024-09-12T00:43:43.822054+0000","last_active":"2024-09-12T01:33:53.989633+0000","last_peered":"2024-09-12T01:33:53.989633+0000","last_clean":"2024-09-12T01:33:53.989633+0000","last_became_active":"2024-09-12T00:43:43.821691+0000","last_became_peered":"2024-09-12T00:43:43.821691+0000","last_unstale":"2024-09-12T01:33:53.989633+0000","last_undegraded":"2024-09-12T01:33:53.989633+0000","last_fullsized":"2024-09-12T01:33:53.989633+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:18.745231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523665+0000","last_change":"2024-09-12T00:43:38.798045+0000","last_active":"2024-09-12T01:33:39.523665+0000","last_peered":"2024-09-12T01:33:39.523665+0000","last_clean":"2024-09-12T01:33:39.523665+0000","last_became_active":"2024-09-12T00:43:38.797711+0000","last_became_peered":"2024-09-12T00:43:38.797711+0000","last_unstale":"2024-09-12T01:33:39.523665+0000","last_undegraded":"2024-09-12T01:33:39.523665+0000","last_fullsized":"2024-09-12T01:33:39.523665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:56.223002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'32","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:27.237937+0000","last_change":"2024-09-12T00:39:17.761142+0000","last_active":"2024-09-12T01:33:27.237937+0000","last_peered":"2024-09-12T01:33:27.237937+0000","last_clean":"2024-09-12T01:33:27.237937+0000","last_became_active":"2024-09-12T00:39:17.760839+0000","last_became_peered":"2024-09-12T00:39:17.760839+0000","last_unstale":"2024-09-12T01:33:27.237937+0000","last_undegraded":"2024-09-12T01:33:27.237937+0000","last_fullsized":"2024-09-12T01:33:27.237937+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:10.465344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.983164+0000","last_change":"2024-09-12T01:02:03.920002+0000","last_active":"2024-09-12T01:35:24.983164+0000","last_peered":"2024-09-12T01:35:24.983164+0000","last_clean":"2024-09-12T01:35:24.983164+0000","last_became_active":"2024-09-12T01:02:03.919706+0000","last_became_peered":"2024-09-12T01:02:03.919706+0000","last_unstale":"2024-09-12T01:35:24.983164+0000","last_undegraded":"2024-09-12T01:35:24.983164+0000","last_fullsized":"2024-09-12T01:35:24.983164+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:03.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.008824+0000","last_change":"2024-09-12T00:43:43.818598+0000","last_active":"2024-09-12T01:35:49.008824+0000","last_peered":"2024-09-12T01:35:49.008824+0000","last_clean":"2024-09-12T01:35:49.008824+0000","last_became_active":"2024-09-12T00:43:43.818321+0000","last_became_peered":"2024-09-12T00:43:43.818321+0000","last_unstale":"2024-09-12T01:35:49.008824+0000","last_undegraded":"2024-09-12T01:35:49.008824+0000","last_fullsized":"2024-09-12T01:35:49.008824+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:55.640954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":96,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'3","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.241650+0000","last_change":"2024-09-12T00:43:38.792440+0000","last_active":"2024-09-12T01:33:52.241650+0000","last_peered":"2024-09-12T01:33:52.241650+0000","last_clean":"2024-09-12T01:33:52.241650+0000","last_became_active":"2024-09-12T00:43:38.792154+0000","last_became_peered":"2024-09-12T00:43:38.792154+0000","last_unstale":"2024-09-12T01:33:52.241650+0000","last_undegraded":"2024-09-12T01:33:52.241650+0000","last_fullsized":"2024-09-12T01:33:52.241650+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:59.352763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":1034,"num_write":3,"num_write_kb":1034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"266'40","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.522358+0000","last_change":"2024-09-12T00:39:17.770041+0000","last_active":"2024-09-12T01:33:29.522358+0000","last_peered":"2024-09-12T01:33:29.522358+0000","last_clean":"2024-09-12T01:33:29.522358+0000","last_became_active":"2024-09-12T00:39:17.767962+0000","last_became_peered":"2024-09-12T00:39:17.767962+0000","last_unstale":"2024-09-12T01:33:29.522358+0000","last_undegraded":"2024-09-12T01:33:29.522358+0000","last_fullsized":"2024-09-12T01:33:29.522358+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:38.083643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":136,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:13.992744+0000","last_change":"2024-09-12T01:02:03.922136+0000","last_active":"2024-09-12T01:34:13.992744+0000","last_peered":"2024-09-12T01:34:13.992744+0000","last_clean":"2024-09-12T01:34:13.992744+0000","last_became_active":"2024-09-12T01:02:03.918216+0000","last_became_peered":"2024-09-12T01:02:03.918216+0000","last_unstale":"2024-09-12T01:34:13.992744+0000","last_undegraded":"2024-09-12T01:34:13.992744+0000","last_fullsized":"2024-09-12T01:34:13.992744+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:26.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'10","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.985350+0000","last_change":"2024-09-12T00:43:43.820490+0000","last_active":"2024-09-12T01:35:44.985350+0000","last_peered":"2024-09-12T01:35:44.985350+0000","last_clean":"2024-09-12T01:35:44.985350+0000","last_became_active":"2024-09-12T00:43:43.820194+0000","last_became_peered":"2024-09-12T00:43:43.820194+0000","last_unstale":"2024-09-12T01:35:44.985350+0000","last_undegraded":"2024-09-12T01:35:44.985350+0000","last_fullsized":"2024-09-12T01:35:44.985350+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:54.662468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"266'10","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.750798+0000","last_change":"2024-09-12T00:43:38.797923+0000","last_active":"2024-09-12T01:37:38.750798+0000","last_peered":"2024-09-12T01:37:38.750798+0000","last_clean":"2024-09-12T01:37:38.750798+0000","last_became_active":"2024-09-12T00:43:38.797428+0000","last_became_peered":"2024-09-12T00:43:38.797428+0000","last_unstale":"2024-09-12T01:37:38.750798+0000","last_undegraded":"2024-09-12T01:37:38.750798+0000","last_fullsized":"2024-09-12T01:37:38.750798+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:07.995028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12282,"num_write":20,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'85","reported_seq":370,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.079026+0000","last_change":"2024-09-12T00:39:17.767845+0000","last_active":"2024-09-12T01:33:40.079026+0000","last_peered":"2024-09-12T01:33:40.079026+0000","last_clean":"2024-09-12T01:33:40.079026+0000","last_became_active":"2024-09-12T00:39:17.767517+0000","last_became_peered":"2024-09-12T00:39:17.767517+0000","last_unstale":"2024-09-12T01:33:40.079026+0000","last_undegraded":"2024-09-12T01:33:40.079026+0000","last_fullsized":"2024-09-12T01:33:40.079026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:44.733701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":615,"num_read_kb":395,"num_write":114,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536407+0000","last_change":"2024-09-12T01:02:03.922775+0000","last_active":"2024-09-12T01:35:24.536407+0000","last_peered":"2024-09-12T01:35:24.536407+0000","last_clean":"2024-09-12T01:35:24.536407+0000","last_became_active":"2024-09-12T01:02:03.922479+0000","last_became_peered":"2024-09-12T01:02:03.922479+0000","last_unstale":"2024-09-12T01:35:24.536407+0000","last_undegraded":"2024-09-12T01:35:24.536407+0000","last_fullsized":"2024-09-12T01:35:24.536407+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.011531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"263'4","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.523080+0000","last_change":"2024-09-12T00:43:43.821630+0000","last_active":"2024-09-12T01:33:34.523080+0000","last_peered":"2024-09-12T01:33:34.523080+0000","last_clean":"2024-09-12T01:33:34.523080+0000","last_became_active":"2024-09-12T00:43:43.821303+0000","last_became_peered":"2024-09-12T00:43:43.821303+0000","last_unstale":"2024-09-12T01:33:34.523080+0000","last_undegraded":"2024-09-12T01:33:34.523080+0000","last_fullsized":"2024-09-12T01:33:34.523080+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:56.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16370,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.538301+0000","last_change":"2024-09-12T00:43:38.800008+0000","last_active":"2024-09-12T01:35:39.538301+0000","last_peered":"2024-09-12T01:35:39.538301+0000","last_clean":"2024-09-12T01:35:39.538301+0000","last_became_active":"2024-09-12T00:43:38.799623+0000","last_became_peered":"2024-09-12T00:43:38.799623+0000","last_unstale":"2024-09-12T01:35:39.538301+0000","last_undegraded":"2024-09-12T01:35:39.538301+0000","last_fullsized":"2024-09-12T01:35:39.538301+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:26.934976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'30","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:35.127450+0000","last_change":"2024-09-12T00:39:17.768450+0000","last_active":"2024-09-12T01:35:35.127450+0000","last_peered":"2024-09-12T01:35:35.127450+0000","last_clean":"2024-09-12T01:35:35.127450+0000","last_became_active":"2024-09-12T00:39:17.768143+0000","last_became_peered":"2024-09-12T00:39:17.768143+0000","last_unstale":"2024-09-12T01:35:35.127450+0000","last_undegraded":"2024-09-12T01:35:35.127450+0000","last_fullsized":"2024-09-12T01:35:35.127450+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:16.633147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":109,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.118947+0000","last_change":"2024-09-12T01:02:03.927047+0000","last_active":"2024-09-12T01:34:35.118947+0000","last_peered":"2024-09-12T01:34:35.118947+0000","last_clean":"2024-09-12T01:34:35.118947+0000","last_became_active":"2024-09-12T01:02:03.926699+0000","last_became_peered":"2024-09-12T01:02:03.926699+0000","last_unstale":"2024-09-12T01:34:35.118947+0000","last_undegraded":"2024-09-12T01:34:35.118947+0000","last_fullsized":"2024-09-12T01:34:35.118947+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:16.113729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'6","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.240897+0000","last_change":"2024-09-12T00:43:43.819559+0000","last_active":"2024-09-12T01:33:47.240897+0000","last_peered":"2024-09-12T01:33:47.240897+0000","last_clean":"2024-09-12T01:33:47.240897+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:33:47.240897+0000","last_undegraded":"2024-09-12T01:33:47.240897+0000","last_fullsized":"2024-09-12T01:33:47.240897+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:15.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":24570,"num_write":11,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:50.080070+0000","last_change":"2024-09-12T00:43:38.798764+0000","last_active":"2024-09-12T01:33:50.080070+0000","last_peered":"2024-09-12T01:33:50.080070+0000","last_clean":"2024-09-12T01:33:50.080070+0000","last_became_active":"2024-09-12T00:43:38.798431+0000","last_became_peered":"2024-09-12T00:43:38.798431+0000","last_unstale":"2024-09-12T01:33:50.080070+0000","last_undegraded":"2024-09-12T01:33:50.080070+0000","last_fullsized":"2024-09-12T01:33:50.080070+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:19.004021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:35.091204+0000","last_change":"2024-09-12T00:39:17.769932+0000","last_active":"2024-09-12T01:35:35.091204+0000","last_peered":"2024-09-12T01:35:35.091204+0000","last_clean":"2024-09-12T01:35:35.091204+0000","last_became_active":"2024-09-12T00:39:17.768901+0000","last_became_peered":"2024-09-12T00:39:17.768901+0000","last_unstale":"2024-09-12T01:35:35.091204+0000","last_undegraded":"2024-09-12T01:35:35.091204+0000","last_fullsized":"2024-09-12T01:35:35.091204+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:49.443724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.248104+0000","last_change":"2024-09-12T01:02:03.922843+0000","last_active":"2024-09-12T01:34:37.248104+0000","last_peered":"2024-09-12T01:34:37.248104+0000","last_clean":"2024-09-12T01:34:37.248104+0000","last_became_active":"2024-09-12T01:02:03.922500+0000","last_became_peered":"2024-09-12T01:02:03.922500+0000","last_unstale":"2024-09-12T01:34:37.248104+0000","last_undegraded":"2024-09-12T01:34:37.248104+0000","last_fullsized":"2024-09-12T01:34:37.248104+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:26.949487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.524780+0000","last_change":"2024-09-12T00:43:43.824719+0000","last_active":"2024-09-12T01:33:49.524780+0000","last_peered":"2024-09-12T01:33:49.524780+0000","last_clean":"2024-09-12T01:33:49.524780+0000","last_became_active":"2024-09-12T00:43:43.823554+0000","last_became_peered":"2024-09-12T00:43:43.823554+0000","last_unstale":"2024-09-12T01:33:49.524780+0000","last_undegraded":"2024-09-12T01:33:49.524780+0000","last_fullsized":"2024-09-12T01:33:49.524780+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:47.954677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523603+0000","last_change":"2024-09-12T00:43:38.798395+0000","last_active":"2024-09-12T01:33:39.523603+0000","last_peered":"2024-09-12T01:33:39.523603+0000","last_clean":"2024-09-12T01:33:39.523603+0000","last_became_active":"2024-09-12T00:43:38.798117+0000","last_became_peered":"2024-09-12T00:43:38.798117+0000","last_unstale":"2024-09-12T01:33:39.523603+0000","last_undegraded":"2024-09-12T01:33:39.523603+0000","last_fullsized":"2024-09-12T01:33:39.523603+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:43.142516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'16","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537633+0000","last_change":"2024-09-12T00:39:17.768795+0000","last_active":"2024-09-12T01:35:34.537633+0000","last_peered":"2024-09-12T01:35:34.537633+0000","last_clean":"2024-09-12T01:35:34.537633+0000","last_became_active":"2024-09-12T00:39:17.768503+0000","last_became_peered":"2024-09-12T00:39:17.768503+0000","last_unstale":"2024-09-12T01:35:34.537633+0000","last_undegraded":"2024-09-12T01:35:34.537633+0000","last_fullsized":"2024-09-12T01:35:34.537633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:49.617037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.004612+0000","last_change":"2024-09-12T01:02:03.928738+0000","last_active":"2024-09-12T01:35:24.004612+0000","last_peered":"2024-09-12T01:35:24.004612+0000","last_clean":"2024-09-12T01:35:24.004612+0000","last_became_active":"2024-09-12T01:02:03.928430+0000","last_became_peered":"2024-09-12T01:02:03.928430+0000","last_unstale":"2024-09-12T01:35:24.004612+0000","last_undegraded":"2024-09-12T01:35:24.004612+0000","last_fullsized":"2024-09-12T01:35:24.004612+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:55.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079580+0000","last_change":"2024-09-12T00:43:43.823435+0000","last_active":"2024-09-12T01:33:45.079580+0000","last_peered":"2024-09-12T01:33:45.079580+0000","last_clean":"2024-09-12T01:33:45.079580+0000","last_became_active":"2024-09-12T00:43:43.822996+0000","last_became_peered":"2024-09-12T00:43:43.822996+0000","last_unstale":"2024-09-12T01:33:45.079580+0000","last_undegraded":"2024-09-12T01:33:45.079580+0000","last_fullsized":"2024-09-12T01:33:45.079580+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:25.064321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'2","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.167242+0000","last_change":"2024-09-12T00:43:38.797634+0000","last_active":"2024-09-12T01:33:39.167242+0000","last_peered":"2024-09-12T01:33:39.167242+0000","last_clean":"2024-09-12T01:33:39.167242+0000","last_became_active":"2024-09-12T00:43:38.797367+0000","last_became_peered":"2024-09-12T00:43:38.797367+0000","last_unstale":"2024-09-12T01:33:39.167242+0000","last_undegraded":"2024-09-12T01:33:39.167242+0000","last_fullsized":"2024-09-12T01:33:39.167242+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.679006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'9","reported_seq":83,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537587+0000","last_change":"2024-09-12T00:39:17.759644+0000","last_active":"2024-09-12T01:35:34.537587+0000","last_peered":"2024-09-12T01:35:34.537587+0000","last_clean":"2024-09-12T01:35:34.537587+0000","last_became_active":"2024-09-12T00:39:17.759327+0000","last_became_peered":"2024-09-12T00:39:17.759327+0000","last_unstale":"2024-09-12T01:35:34.537587+0000","last_undegraded":"2024-09-12T01:35:34.537587+0000","last_fullsized":"2024-09-12T01:35:34.537587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:23.808909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":31,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536493+0000","last_change":"2024-09-12T01:02:03.925373+0000","last_active":"2024-09-12T01:35:24.536493+0000","last_peered":"2024-09-12T01:35:24.536493+0000","last_clean":"2024-09-12T01:35:24.536493+0000","last_became_active":"2024-09-12T01:02:03.925081+0000","last_became_peered":"2024-09-12T01:02:03.925081+0000","last_unstale":"2024-09-12T01:35:24.536493+0000","last_undegraded":"2024-09-12T01:35:24.536493+0000","last_fullsized":"2024-09-12T01:35:24.536493+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:09.007940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'4","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.092766+0000","last_change":"2024-09-12T00:43:43.822771+0000","last_active":"2024-09-12T01:35:50.092766+0000","last_peered":"2024-09-12T01:35:50.092766+0000","last_clean":"2024-09-12T01:35:50.092766+0000","last_became_active":"2024-09-12T00:43:43.822237+0000","last_became_peered":"2024-09-12T00:43:43.822237+0000","last_unstale":"2024-09-12T01:35:50.092766+0000","last_undegraded":"2024-09-12T01:35:50.092766+0000","last_fullsized":"2024-09-12T01:35:50.092766+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:25.025447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'6","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.749584+0000","last_change":"2024-09-12T00:43:38.794264+0000","last_active":"2024-09-12T01:37:38.749584+0000","last_peered":"2024-09-12T01:37:38.749584+0000","last_clean":"2024-09-12T01:37:38.749584+0000","last_became_active":"2024-09-12T00:43:38.793943+0000","last_became_peered":"2024-09-12T00:43:38.793943+0000","last_unstale":"2024-09-12T01:37:38.749584+0000","last_undegraded":"2024-09-12T01:37:38.749584+0000","last_fullsized":"2024-09-12T01:37:38.749584+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:15.467403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11272,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"266'26","reported_seq":130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:30.090680+0000","last_change":"2024-09-12T00:39:17.770362+0000","last_active":"2024-09-12T01:35:30.090680+0000","last_peered":"2024-09-12T01:35:30.090680+0000","last_clean":"2024-09-12T01:35:30.090680+0000","last_became_active":"2024-09-12T00:39:17.770093+0000","last_became_peered":"2024-09-12T00:39:17.770093+0000","last_unstale":"2024-09-12T01:35:30.090680+0000","last_undegraded":"2024-09-12T01:35:30.090680+0000","last_fullsized":"2024-09-12T01:35:30.090680+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:56.241617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'194","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.691922+0000","last_change":"2024-09-12T00:25:00.480152+0000","last_active":"2024-09-12T01:37:38.691922+0000","last_peered":"2024-09-12T01:37:38.691922+0000","last_clean":"2024-09-12T01:37:38.691922+0000","last_became_active":"2024-09-12T00:25:00.479764+0000","last_became_peered":"2024-09-12T00:25:00.479764+0000","last_unstale":"2024-09-12T01:37:38.691922+0000","last_undegraded":"2024-09-12T01:37:38.691922+0000","last_fullsized":"2024-09-12T01:37:38.691922+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:56.463852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":6490,"num_write":862,"num_write_kb":17717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'383","reported_seq":1929,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194930+0000","last_change":"2024-09-12T00:25:02.474787+0000","last_active":"2024-09-12T01:36:11.194930+0000","last_peered":"2024-09-12T01:36:11.194930+0000","last_clean":"2024-09-12T01:36:11.194930+0000","last_became_active":"2024-09-12T00:25:02.474473+0000","last_became_peered":"2024-09-12T00:25:02.474473+0000","last_unstale":"2024-09-12T01:36:11.194930+0000","last_undegraded":"2024-09-12T01:36:11.194930+0000","last_fullsized":"2024-09-12T01:36:11.194930+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.534016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2167,"num_read_kb":2073,"num_write":418,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'235","reported_seq":975,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.882587+0000","last_change":"2024-09-12T00:25:00.469978+0000","last_active":"2024-09-12T01:37:38.882587+0000","last_peered":"2024-09-12T01:37:38.882587+0000","last_clean":"2024-09-12T01:37:38.882587+0000","last_became_active":"2024-09-12T00:25:00.469588+0000","last_became_peered":"2024-09-12T00:25:00.469588+0000","last_unstale":"2024-09-12T01:37:38.882587+0000","last_undegraded":"2024-09-12T01:37:38.882587+0000","last_fullsized":"2024-09-12T01:37:38.882587+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.105712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038976,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":700,"num_read_kb":64068,"num_write":1104,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'889","reported_seq":2575,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491254+0000","last_change":"2024-09-12T00:25:02.476425+0000","last_active":"2024-09-12T01:35:23.491254+0000","last_peered":"2024-09-12T01:35:23.491254+0000","last_clean":"2024-09-12T01:35:23.491254+0000","last_became_active":"2024-09-12T00:25:02.476131+0000","last_became_peered":"2024-09-12T00:25:02.476131+0000","last_unstale":"2024-09-12T01:35:23.491254+0000","last_undegraded":"2024-09-12T01:35:23.491254+0000","last_fullsized":"2024-09-12T01:35:23.491254+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:34.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4103,"num_read_kb":3695,"num_write":1128,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'210","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.856883+0000","last_change":"2024-09-12T00:25:00.458464+0000","last_active":"2024-09-12T01:37:38.856883+0000","last_peered":"2024-09-12T01:37:38.856883+0000","last_clean":"2024-09-12T01:37:38.856883+0000","last_became_active":"2024-09-12T00:25:00.458072+0000","last_became_peered":"2024-09-12T00:25:00.458072+0000","last_unstale":"2024-09-12T01:37:38.856883+0000","last_undegraded":"2024-09-12T01:37:38.856883+0000","last_fullsized":"2024-09-12T01:37:38.856883+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:23.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":12854,"num_write":984,"num_write_kb":25223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1325","reported_seq":2879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338584+0000","last_change":"2024-09-12T00:25:02.470846+0000","last_active":"2024-09-12T01:36:12.338584+0000","last_peered":"2024-09-12T01:36:12.338584+0000","last_clean":"2024-09-12T01:36:12.338584+0000","last_became_active":"2024-09-12T00:25:02.470249+0000","last_became_peered":"2024-09-12T00:25:02.470249+0000","last_unstale":"2024-09-12T01:36:12.338584+0000","last_undegraded":"2024-09-12T01:36:12.338584+0000","last_fullsized":"2024-09-12T01:36:12.338584+0000","mapping_epoch":28,"log_start":"266'1300","ondisk_log_start":"266'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:00.680374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5936,"num_read_kb":5183,"num_write":1890,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'198","reported_seq":833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.756641+0000","last_change":"2024-09-12T00:25:00.484283+0000","last_active":"2024-09-12T01:37:38.756641+0000","last_peered":"2024-09-12T01:37:38.756641+0000","last_clean":"2024-09-12T01:37:38.756641+0000","last_became_active":"2024-09-12T00:25:00.482357+0000","last_became_peered":"2024-09-12T00:25:00.482357+0000","last_unstale":"2024-09-12T01:37:38.756641+0000","last_undegraded":"2024-09-12T01:37:38.756641+0000","last_fullsized":"2024-09-12T01:37:38.756641+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:35.608009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":30861,"num_write":868,"num_write_kb":33122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'567","reported_seq":2114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.489600+0000","last_change":"2024-09-12T00:25:02.467647+0000","last_active":"2024-09-12T01:35:23.489600+0000","last_peered":"2024-09-12T01:35:23.489600+0000","last_clean":"2024-09-12T01:35:23.489600+0000","last_became_active":"2024-09-12T00:25:02.467378+0000","last_became_peered":"2024-09-12T00:25:02.467378+0000","last_unstale":"2024-09-12T01:35:23.489600+0000","last_undegraded":"2024-09-12T01:35:23.489600+0000","last_fullsized":"2024-09-12T01:35:23.489600+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:08.109241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2918,"num_read_kb":2656,"num_write":743,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'211","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.811655+0000","last_change":"2024-09-12T00:25:00.478922+0000","last_active":"2024-09-12T01:37:38.811655+0000","last_peered":"2024-09-12T01:37:38.811655+0000","last_clean":"2024-09-12T01:37:38.811655+0000","last_became_active":"2024-09-12T00:25:00.475340+0000","last_became_peered":"2024-09-12T00:25:00.475340+0000","last_unstale":"2024-09-12T01:37:38.811655+0000","last_undegraded":"2024-09-12T01:37:38.811655+0000","last_fullsized":"2024-09-12T01:37:38.811655+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:27.145736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":13966,"num_write":1015,"num_write_kb":23620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'571","reported_seq":2274,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428973+0000","last_change":"2024-09-12T00:25:02.474521+0000","last_active":"2024-09-12T01:37:18.428973+0000","last_peered":"2024-09-12T01:37:18.428973+0000","last_clean":"2024-09-12T01:37:18.428973+0000","last_became_active":"2024-09-12T00:25:02.474229+0000","last_became_peered":"2024-09-12T00:25:02.474229+0000","last_unstale":"2024-09-12T01:37:18.428973+0000","last_undegraded":"2024-09-12T01:37:18.428973+0000","last_fullsized":"2024-09-12T01:37:18.428973+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:59.636555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2896,"num_write":736,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'188","reported_seq":931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.689331+0000","last_change":"2024-09-12T00:25:00.488194+0000","last_active":"2024-09-12T01:37:38.689331+0000","last_peered":"2024-09-12T01:37:38.689331+0000","last_clean":"2024-09-12T01:37:38.689331+0000","last_became_active":"2024-09-12T00:25:00.487589+0000","last_became_peered":"2024-09-12T00:25:00.487589+0000","last_unstale":"2024-09-12T01:37:38.689331+0000","last_undegraded":"2024-09-12T01:37:38.689331+0000","last_fullsized":"2024-09-12T01:37:38.689331+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:00.587126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8822595,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":942,"num_read_kb":45033,"num_write":954,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'522","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.489583+0000","last_change":"2024-09-12T00:25:02.477683+0000","last_active":"2024-09-12T01:35:23.489583+0000","last_peered":"2024-09-12T01:35:23.489583+0000","last_clean":"2024-09-12T01:35:23.489583+0000","last_became_active":"2024-09-12T00:25:02.477395+0000","last_became_peered":"2024-09-12T00:25:02.477395+0000","last_unstale":"2024-09-12T01:35:23.489583+0000","last_undegraded":"2024-09-12T01:35:23.489583+0000","last_fullsized":"2024-09-12T01:35:23.489583+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:51.177502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3189,"num_read_kb":3033,"num_write":616,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'234","reported_seq":895,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.765765+0000","last_change":"2024-09-12T00:25:00.478053+0000","last_active":"2024-09-12T01:37:38.765765+0000","last_peered":"2024-09-12T01:37:38.765765+0000","last_clean":"2024-09-12T01:37:38.765765+0000","last_became_active":"2024-09-12T00:25:00.477590+0000","last_became_peered":"2024-09-12T00:25:00.477590+0000","last_unstale":"2024-09-12T01:37:38.765765+0000","last_undegraded":"2024-09-12T01:37:38.765765+0000","last_fullsized":"2024-09-12T01:37:38.765765+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:08.585286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048652,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":24485,"num_write":1039,"num_write_kb":27596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'375","reported_seq":1757,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.789775+0000","last_change":"2024-09-12T00:25:02.466712+0000","last_active":"2024-09-12T01:34:32.789775+0000","last_peered":"2024-09-12T01:34:32.789775+0000","last_clean":"2024-09-12T01:34:32.789775+0000","last_became_active":"2024-09-12T00:25:02.466439+0000","last_became_peered":"2024-09-12T00:25:02.466439+0000","last_unstale":"2024-09-12T01:34:32.789775+0000","last_undegraded":"2024-09-12T01:34:32.789775+0000","last_fullsized":"2024-09-12T01:34:32.789775+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:59.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1739,"num_write":422,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'188","reported_seq":793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:34.025271+0000","last_change":"2024-09-12T00:25:00.472775+0000","last_active":"2024-09-12T01:37:34.025271+0000","last_peered":"2024-09-12T01:37:34.025271+0000","last_clean":"2024-09-12T01:37:34.025271+0000","last_became_active":"2024-09-12T00:25:00.472046+0000","last_became_peered":"2024-09-12T00:25:00.472046+0000","last_unstale":"2024-09-12T01:37:34.025271+0000","last_undegraded":"2024-09-12T01:37:34.025271+0000","last_fullsized":"2024-09-12T01:37:34.025271+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.088983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":23076,"num_write":837,"num_write_kb":28135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'364","reported_seq":1839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428522+0000","last_change":"2024-09-12T00:25:02.475079+0000","last_active":"2024-09-12T01:37:18.428522+0000","last_peered":"2024-09-12T01:37:18.428522+0000","last_clean":"2024-09-12T01:37:18.428522+0000","last_became_active":"2024-09-12T00:25:02.474791+0000","last_became_peered":"2024-09-12T00:25:02.474791+0000","last_unstale":"2024-09-12T01:37:18.428522+0000","last_undegraded":"2024-09-12T01:37:18.428522+0000","last_fullsized":"2024-09-12T01:37:18.428522+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:06.924137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2089,"num_read_kb":2020,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'476","reported_seq":2145,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428799+0000","last_change":"2024-09-12T00:25:02.471996+0000","last_active":"2024-09-12T01:37:18.428799+0000","last_peered":"2024-09-12T01:37:18.428799+0000","last_clean":"2024-09-12T01:37:18.428799+0000","last_became_active":"2024-09-12T00:25:02.471545+0000","last_became_peered":"2024-09-12T00:25:02.471545+0000","last_unstale":"2024-09-12T01:37:18.428799+0000","last_undegraded":"2024-09-12T01:37:18.428799+0000","last_fullsized":"2024-09-12T01:37:18.428799+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:19.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2642,"num_read_kb":2498,"num_write":559,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'202","reported_seq":1061,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.090055+0000","last_change":"2024-09-12T00:25:00.465180+0000","last_active":"2024-09-12T01:35:19.090055+0000","last_peered":"2024-09-12T01:35:19.090055+0000","last_clean":"2024-09-12T01:35:19.090055+0000","last_became_active":"2024-09-12T00:25:00.464783+0000","last_became_peered":"2024-09-12T00:25:00.464783+0000","last_unstale":"2024-09-12T01:35:19.090055+0000","last_undegraded":"2024-09-12T01:35:19.090055+0000","last_fullsized":"2024-09-12T01:35:19.090055+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:29.682704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":967,"num_read_kb":27994,"num_write":1073,"num_write_kb":26373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'501","reported_seq":2068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.981007+0000","last_change":"2024-09-12T00:25:02.475307+0000","last_active":"2024-09-12T01:35:04.981007+0000","last_peered":"2024-09-12T01:35:04.981007+0000","last_clean":"2024-09-12T01:35:04.981007+0000","last_became_active":"2024-09-12T00:25:02.475032+0000","last_became_peered":"2024-09-12T00:25:02.475032+0000","last_unstale":"2024-09-12T01:35:04.981007+0000","last_undegraded":"2024-09-12T01:35:04.981007+0000","last_fullsized":"2024-09-12T01:35:04.981007+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:48.727325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2653,"num_read_kb":2473,"num_write":625,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'211","reported_seq":844,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.847224+0000","last_change":"2024-09-12T00:25:00.480048+0000","last_active":"2024-09-12T01:37:38.847224+0000","last_peered":"2024-09-12T01:37:38.847224+0000","last_clean":"2024-09-12T01:37:38.847224+0000","last_became_active":"2024-09-12T00:25:00.479635+0000","last_became_peered":"2024-09-12T00:25:00.479635+0000","last_unstale":"2024-09-12T01:37:38.847224+0000","last_undegraded":"2024-09-12T01:37:38.847224+0000","last_fullsized":"2024-09-12T01:37:38.847224+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:28.545600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279168,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":30051,"num_write":937,"num_write_kb":51711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'1150","reported_seq":2931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801039+0000","last_change":"2024-09-12T00:25:02.467494+0000","last_active":"2024-09-12T01:35:34.801039+0000","last_peered":"2024-09-12T01:35:34.801039+0000","last_clean":"2024-09-12T01:35:34.801039+0000","last_became_active":"2024-09-12T00:25:02.467224+0000","last_became_peered":"2024-09-12T00:25:02.467224+0000","last_unstale":"2024-09-12T01:35:34.801039+0000","last_undegraded":"2024-09-12T01:35:34.801039+0000","last_fullsized":"2024-09-12T01:35:34.801039+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:38.270517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5645,"num_read_kb":4973,"num_write":1729,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'210","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.858824+0000","last_change":"2024-09-12T00:25:00.477548+0000","last_active":"2024-09-12T01:37:38.858824+0000","last_peered":"2024-09-12T01:37:38.858824+0000","last_clean":"2024-09-12T01:37:38.858824+0000","last_became_active":"2024-09-12T00:25:00.477184+0000","last_became_peered":"2024-09-12T00:25:00.477184+0000","last_unstale":"2024-09-12T01:37:38.858824+0000","last_undegraded":"2024-09-12T01:37:38.858824+0000","last_fullsized":"2024-09-12T01:37:38.858824+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:16.176834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3321654,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":408,"num_read_kb":20227,"num_write":1015,"num_write_kb":31572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'485","reported_seq":2016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.490363+0000","last_change":"2024-09-12T00:25:02.469723+0000","last_active":"2024-09-12T01:35:19.490363+0000","last_peered":"2024-09-12T01:35:19.490363+0000","last_clean":"2024-09-12T01:35:19.490363+0000","last_became_active":"2024-09-12T00:25:02.469463+0000","last_became_peered":"2024-09-12T00:25:02.469463+0000","last_unstale":"2024-09-12T01:35:19.490363+0000","last_undegraded":"2024-09-12T01:35:19.490363+0000","last_fullsized":"2024-09-12T01:35:19.490363+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:41.693227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2387,"num_write":615,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'190","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.733785+0000","last_change":"2024-09-12T00:25:00.483752+0000","last_active":"2024-09-12T01:37:38.733785+0000","last_peered":"2024-09-12T01:37:38.733785+0000","last_clean":"2024-09-12T01:37:38.733785+0000","last_became_active":"2024-09-12T00:25:00.483327+0000","last_became_peered":"2024-09-12T00:25:00.483327+0000","last_unstale":"2024-09-12T01:37:38.733785+0000","last_undegraded":"2024-09-12T01:37:38.733785+0000","last_fullsized":"2024-09-12T01:37:38.733785+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.085933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395812,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":12020,"num_write":922,"num_write_kb":12011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'406","reported_seq":1997,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491334+0000","last_change":"2024-09-12T00:25:02.472828+0000","last_active":"2024-09-12T01:35:23.491334+0000","last_peered":"2024-09-12T01:35:23.491334+0000","last_clean":"2024-09-12T01:35:23.491334+0000","last_became_active":"2024-09-12T00:25:02.471598+0000","last_became_peered":"2024-09-12T00:25:02.471598+0000","last_unstale":"2024-09-12T01:35:23.491334+0000","last_undegraded":"2024-09-12T01:35:23.491334+0000","last_fullsized":"2024-09-12T01:35:23.491334+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:34.396174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2389,"num_read_kb":2272,"num_write":462,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'177","reported_seq":836,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.857878+0000","last_change":"2024-09-12T00:25:00.478611+0000","last_active":"2024-09-12T01:37:38.857878+0000","last_peered":"2024-09-12T01:37:38.857878+0000","last_clean":"2024-09-12T01:37:38.857878+0000","last_became_active":"2024-09-12T00:25:00.478202+0000","last_became_peered":"2024-09-12T00:25:00.478202+0000","last_unstale":"2024-09-12T01:37:38.857878+0000","last_undegraded":"2024-09-12T01:37:38.857878+0000","last_fullsized":"2024-09-12T01:37:38.857878+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:15.648085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":78408,"num_write":837,"num_write_kb":24955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'664","reported_seq":2197,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088854+0000","last_change":"2024-09-12T00:25:02.470543+0000","last_active":"2024-09-12T01:35:09.088854+0000","last_peered":"2024-09-12T01:35:09.088854+0000","last_clean":"2024-09-12T01:35:09.088854+0000","last_became_active":"2024-09-12T00:25:02.470278+0000","last_became_peered":"2024-09-12T00:25:02.470278+0000","last_unstale":"2024-09-12T01:35:09.088854+0000","last_undegraded":"2024-09-12T01:35:09.088854+0000","last_fullsized":"2024-09-12T01:35:09.088854+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:56.843342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3455,"num_read_kb":3151,"num_write":936,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'238","reported_seq":906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.807799+0000","last_change":"2024-09-12T00:25:00.457125+0000","last_active":"2024-09-12T01:37:38.807799+0000","last_peered":"2024-09-12T01:37:38.807799+0000","last_clean":"2024-09-12T01:37:38.807799+0000","last_became_active":"2024-09-12T00:25:00.456765+0000","last_became_peered":"2024-09-12T00:25:00.456765+0000","last_unstale":"2024-09-12T01:37:38.807799+0000","last_undegraded":"2024-09-12T01:37:38.807799+0000","last_fullsized":"2024-09-12T01:37:38.807799+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:03.452813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496550,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":628,"num_read_kb":22861,"num_write":1212,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'129","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.484498+0000","last_change":"2024-09-12T00:25:10.523473+0000","last_active":"2024-09-12T01:36:12.484498+0000","last_peered":"2024-09-12T01:36:12.484498+0000","last_clean":"2024-09-12T01:36:12.484498+0000","last_became_active":"2024-09-12T00:25:10.523187+0000","last_became_peered":"2024-09-12T00:25:10.523187+0000","last_unstale":"2024-09-12T01:36:12.484498+0000","last_undegraded":"2024-09-12T01:36:12.484498+0000","last_fullsized":"2024-09-12T01:36:12.484498+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:03.075928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'447","reported_seq":2133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.833875+0000","last_change":"2024-09-12T00:25:02.464400+0000","last_active":"2024-09-12T01:35:16.833875+0000","last_peered":"2024-09-12T01:35:16.833875+0000","last_clean":"2024-09-12T01:35:16.833875+0000","last_became_active":"2024-09-12T00:25:02.464035+0000","last_became_peered":"2024-09-12T00:25:02.464035+0000","last_unstale":"2024-09-12T01:35:16.833875+0000","last_undegraded":"2024-09-12T01:35:16.833875+0000","last_fullsized":"2024-09-12T01:35:16.833875+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.803044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2614,"num_read_kb":2487,"num_write":526,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'214","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.794938+0000","last_change":"2024-09-12T00:25:00.479724+0000","last_active":"2024-09-12T01:37:38.794938+0000","last_peered":"2024-09-12T01:37:38.794938+0000","last_clean":"2024-09-12T01:37:38.794938+0000","last_became_active":"2024-09-12T00:25:00.479335+0000","last_became_peered":"2024-09-12T00:25:00.479335+0000","last_unstale":"2024-09-12T01:37:38.794938+0000","last_undegraded":"2024-09-12T01:37:38.794938+0000","last_fullsized":"2024-09-12T01:37:38.794938+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:52.582972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1920160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":7515,"num_write":984,"num_write_kb":32910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534500+0000","last_change":"2024-09-12T00:25:04.485699+0000","last_active":"2024-09-12T01:35:09.534500+0000","last_peered":"2024-09-12T01:35:09.534500+0000","last_clean":"2024-09-12T01:35:09.534500+0000","last_became_active":"2024-09-12T00:25:04.485389+0000","last_became_peered":"2024-09-12T00:25:04.485389+0000","last_unstale":"2024-09-12T01:35:09.534500+0000","last_undegraded":"2024-09-12T01:35:09.534500+0000","last_fullsized":"2024-09-12T01:35:09.534500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:42.240804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'216","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.546231+0000","last_change":"2024-09-12T00:25:06.500211+0000","last_active":"2024-09-12T01:37:19.546231+0000","last_peered":"2024-09-12T01:37:19.546231+0000","last_clean":"2024-09-12T01:37:19.546231+0000","last_became_active":"2024-09-12T00:25:06.499933+0000","last_became_peered":"2024-09-12T00:25:06.499933+0000","last_unstale":"2024-09-12T01:37:19.546231+0000","last_undegraded":"2024-09-12T01:37:19.546231+0000","last_fullsized":"2024-09-12T01:37:19.546231+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:46.967892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13196,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":292,"num_read_kb":351,"num_write":172,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.089450+0000","last_change":"2024-09-12T00:25:08.501552+0000","last_active":"2024-09-12T01:35:14.089450+0000","last_peered":"2024-09-12T01:35:14.089450+0000","last_clean":"2024-09-12T01:35:14.089450+0000","last_became_active":"2024-09-12T00:25:08.501137+0000","last_became_peered":"2024-09-12T00:25:08.501137+0000","last_unstale":"2024-09-12T01:35:14.089450+0000","last_undegraded":"2024-09-12T01:35:14.089450+0000","last_fullsized":"2024-09-12T01:35:14.089450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:02.147605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2435","reported_seq":4332,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.040799+0000","last_change":"2024-09-12T00:25:10.526327+0000","last_active":"2024-09-12T01:36:12.040799+0000","last_peered":"2024-09-12T01:36:12.040799+0000","last_clean":"2024-09-12T01:36:12.040799+0000","last_became_active":"2024-09-12T00:25:10.526016+0000","last_became_peered":"2024-09-12T00:25:10.526016+0000","last_unstale":"2024-09-12T01:36:12.040799+0000","last_undegraded":"2024-09-12T01:36:12.040799+0000","last_fullsized":"2024-09-12T01:36:12.040799+0000","mapping_epoch":36,"log_start":"266'2400","ondisk_log_start":"266'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":2400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:25.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6097,"num_read_kb":6097,"num_write":4851,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'891","reported_seq":2330,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428993+0000","last_change":"2024-09-12T00:25:02.477964+0000","last_active":"2024-09-12T01:37:18.428993+0000","last_peered":"2024-09-12T01:37:18.428993+0000","last_clean":"2024-09-12T01:37:18.428993+0000","last_became_active":"2024-09-12T00:25:02.477360+0000","last_became_peered":"2024-09-12T00:25:02.477360+0000","last_unstale":"2024-09-12T01:37:18.428993+0000","last_undegraded":"2024-09-12T01:37:18.428993+0000","last_fullsized":"2024-09-12T01:37:18.428993+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:52.094792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4073,"num_read_kb":3587,"num_write":1238,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'213","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.810139+0000","last_change":"2024-09-12T00:25:00.452665+0000","last_active":"2024-09-12T01:37:38.810139+0000","last_peered":"2024-09-12T01:37:38.810139+0000","last_clean":"2024-09-12T01:37:38.810139+0000","last_became_active":"2024-09-12T00:25:00.452236+0000","last_became_peered":"2024-09-12T00:25:00.452236+0000","last_unstale":"2024-09-12T01:37:38.810139+0000","last_undegraded":"2024-09-12T01:37:38.810139+0000","last_fullsized":"2024-09-12T01:37:38.810139+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:05.744126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084046,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":27979,"num_write":1022,"num_write_kb":43410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.254402+0000","last_change":"2024-09-12T00:25:04.481555+0000","last_active":"2024-09-12T01:35:17.254402+0000","last_peered":"2024-09-12T01:35:17.254402+0000","last_clean":"2024-09-12T01:35:17.254402+0000","last_became_active":"2024-09-12T00:25:04.481218+0000","last_became_peered":"2024-09-12T00:25:04.481218+0000","last_unstale":"2024-09-12T01:35:17.254402+0000","last_undegraded":"2024-09-12T01:35:17.254402+0000","last_fullsized":"2024-09-12T01:35:17.254402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:06.324093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'127","reported_seq":676,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.201882+0000","last_change":"2024-09-12T00:25:06.490765+0000","last_active":"2024-09-12T01:35:55.201882+0000","last_peered":"2024-09-12T01:35:55.201882+0000","last_clean":"2024-09-12T01:35:55.201882+0000","last_became_active":"2024-09-12T00:25:06.490463+0000","last_became_peered":"2024-09-12T00:25:06.490463+0000","last_unstale":"2024-09-12T01:35:55.201882+0000","last_undegraded":"2024-09-12T01:35:55.201882+0000","last_fullsized":"2024-09-12T01:35:55.201882+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:30.310748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":131,"num_write":102,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.089409+0000","last_change":"2024-09-12T00:25:08.505822+0000","last_active":"2024-09-12T01:35:14.089409+0000","last_peered":"2024-09-12T01:35:14.089409+0000","last_clean":"2024-09-12T01:35:14.089409+0000","last_became_active":"2024-09-12T00:25:08.505492+0000","last_became_peered":"2024-09-12T00:25:08.505492+0000","last_unstale":"2024-09-12T01:35:14.089409+0000","last_undegraded":"2024-09-12T01:35:14.089409+0000","last_fullsized":"2024-09-12T01:35:14.089409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:49.241744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'139","reported_seq":659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.247384+0000","last_change":"2024-09-12T00:25:10.523127+0000","last_active":"2024-09-12T01:37:18.247384+0000","last_peered":"2024-09-12T01:37:18.247384+0000","last_clean":"2024-09-12T01:37:18.247384+0000","last_became_active":"2024-09-12T00:25:10.522822+0000","last_became_peered":"2024-09-12T00:25:10.522822+0000","last_unstale":"2024-09-12T01:37:18.247384+0000","last_undegraded":"2024-09-12T01:37:18.247384+0000","last_fullsized":"2024-09-12T01:37:18.247384+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:39.986321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":196,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'482","reported_seq":2022,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.002276+0000","last_change":"2024-09-12T00:25:02.479138+0000","last_active":"2024-09-12T01:35:09.002276+0000","last_peered":"2024-09-12T01:35:09.002276+0000","last_clean":"2024-09-12T01:35:09.002276+0000","last_became_active":"2024-09-12T00:25:02.478850+0000","last_became_peered":"2024-09-12T00:25:02.478850+0000","last_unstale":"2024-09-12T01:35:09.002276+0000","last_undegraded":"2024-09-12T01:35:09.002276+0000","last_fullsized":"2024-09-12T01:35:09.002276+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:31.778936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2311,"num_write":575,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'203","reported_seq":863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.703784+0000","last_change":"2024-09-12T00:25:00.476041+0000","last_active":"2024-09-12T01:37:38.703784+0000","last_peered":"2024-09-12T01:37:38.703784+0000","last_clean":"2024-09-12T01:37:38.703784+0000","last_became_active":"2024-09-12T00:25:00.475628+0000","last_became_peered":"2024-09-12T00:25:00.475628+0000","last_unstale":"2024-09-12T01:37:38.703784+0000","last_undegraded":"2024-09-12T01:37:38.703784+0000","last_fullsized":"2024-09-12T01:37:38.703784+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:14.169208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":1110,"num_write":851,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:12.253498+0000","last_change":"2024-09-12T00:25:04.484287+0000","last_active":"2024-09-12T01:35:12.253498+0000","last_peered":"2024-09-12T01:35:12.253498+0000","last_clean":"2024-09-12T01:35:12.253498+0000","last_became_active":"2024-09-12T00:25:04.483774+0000","last_became_peered":"2024-09-12T00:25:04.483774+0000","last_unstale":"2024-09-12T01:35:12.253498+0000","last_undegraded":"2024-09-12T01:35:12.253498+0000","last_fullsized":"2024-09-12T01:35:12.253498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:26.376424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'143","reported_seq":719,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.415267+0000","last_change":"2024-09-12T00:25:06.501549+0000","last_active":"2024-09-12T01:36:07.415267+0000","last_peered":"2024-09-12T01:36:07.415267+0000","last_clean":"2024-09-12T01:36:07.415267+0000","last_became_active":"2024-09-12T00:25:06.500991+0000","last_became_peered":"2024-09-12T00:25:06.500991+0000","last_unstale":"2024-09-12T01:36:07.415267+0000","last_undegraded":"2024-09-12T01:36:07.415267+0000","last_fullsized":"2024-09-12T01:36:07.415267+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:31.699237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'797","reported_seq":4866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.920566+0000","last_change":"2024-09-12T00:25:08.514676+0000","last_active":"2024-09-12T01:37:38.920566+0000","last_peered":"2024-09-12T01:37:38.920566+0000","last_clean":"2024-09-12T01:37:38.920566+0000","last_became_active":"2024-09-12T00:25:08.514360+0000","last_became_peered":"2024-09-12T00:25:08.514360+0000","last_unstale":"2024-09-12T01:37:38.920566+0000","last_undegraded":"2024-09-12T01:37:38.920566+0000","last_fullsized":"2024-09-12T01:37:38.920566+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:19.747805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'202","reported_seq":1037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.546065+0000","last_change":"2024-09-12T00:25:10.519173+0000","last_active":"2024-09-12T01:36:12.546065+0000","last_peered":"2024-09-12T01:36:12.546065+0000","last_clean":"2024-09-12T01:36:12.546065+0000","last_became_active":"2024-09-12T00:25:10.518861+0000","last_became_peered":"2024-09-12T00:25:10.518861+0000","last_unstale":"2024-09-12T01:36:12.546065+0000","last_undegraded":"2024-09-12T01:36:12.546065+0000","last_fullsized":"2024-09-12T01:36:12.546065+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:28.784023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":600,"num_write":435,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'466","reported_seq":1986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491174+0000","last_change":"2024-09-12T00:25:02.477428+0000","last_active":"2024-09-12T01:35:23.491174+0000","last_peered":"2024-09-12T01:35:23.491174+0000","last_clean":"2024-09-12T01:35:23.491174+0000","last_became_active":"2024-09-12T00:25:02.477052+0000","last_became_peered":"2024-09-12T00:25:02.477052+0000","last_unstale":"2024-09-12T01:35:23.491174+0000","last_undegraded":"2024-09-12T01:35:23.491174+0000","last_fullsized":"2024-09-12T01:35:23.491174+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:47.054845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2388,"num_read_kb":2234,"num_write":549,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'224","reported_seq":869,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.691028+0000","last_change":"2024-09-12T00:25:00.458865+0000","last_active":"2024-09-12T01:37:38.691028+0000","last_peered":"2024-09-12T01:37:38.691028+0000","last_clean":"2024-09-12T01:37:38.691028+0000","last_became_active":"2024-09-12T00:25:00.457828+0000","last_became_peered":"2024-09-12T00:25:00.457828+0000","last_unstale":"2024-09-12T01:37:38.691028+0000","last_undegraded":"2024-09-12T01:37:38.691028+0000","last_fullsized":"2024-09-12T01:37:38.691028+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:20.656353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":9782,"num_write":1039,"num_write_kb":35060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534518+0000","last_change":"2024-09-12T00:25:04.482494+0000","last_active":"2024-09-12T01:35:09.534518+0000","last_peered":"2024-09-12T01:35:09.534518+0000","last_clean":"2024-09-12T01:35:09.534518+0000","last_became_active":"2024-09-12T00:25:04.482173+0000","last_became_peered":"2024-09-12T00:25:04.482173+0000","last_unstale":"2024-09-12T01:35:09.534518+0000","last_undegraded":"2024-09-12T01:35:09.534518+0000","last_fullsized":"2024-09-12T01:35:09.534518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:38.300401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'158","reported_seq":751,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.915794+0000","last_change":"2024-09-12T00:25:06.491652+0000","last_active":"2024-09-12T01:37:38.915794+0000","last_peered":"2024-09-12T01:37:38.915794+0000","last_clean":"2024-09-12T01:37:38.915794+0000","last_became_active":"2024-09-12T00:25:06.491337+0000","last_became_peered":"2024-09-12T00:25:06.491337+0000","last_unstale":"2024-09-12T01:37:38.915794+0000","last_undegraded":"2024-09-12T01:37:38.915794+0000","last_fullsized":"2024-09-12T01:37:38.915794+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:08.948500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5611,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":280,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'801","reported_seq":2767,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.530753+0000","last_change":"2024-09-12T00:25:08.512430+0000","last_active":"2024-09-12T01:37:38.530753+0000","last_peered":"2024-09-12T01:37:38.530753+0000","last_clean":"2024-09-12T01:37:38.530753+0000","last_became_active":"2024-09-12T00:25:08.512125+0000","last_became_peered":"2024-09-12T00:25:08.512125+0000","last_unstale":"2024-09-12T01:37:38.530753+0000","last_undegraded":"2024-09-12T01:37:38.530753+0000","last_fullsized":"2024-09-12T01:37:38.530753+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:52.436088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'2025","reported_seq":3645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338541+0000","last_change":"2024-09-12T00:25:02.465523+0000","last_active":"2024-09-12T01:36:12.338541+0000","last_peered":"2024-09-12T01:36:12.338541+0000","last_clean":"2024-09-12T01:36:12.338541+0000","last_became_active":"2024-09-12T00:25:02.465239+0000","last_became_peered":"2024-09-12T00:25:02.465239+0000","last_unstale":"2024-09-12T01:36:12.338541+0000","last_undegraded":"2024-09-12T01:36:12.338541+0000","last_fullsized":"2024-09-12T01:36:12.338541+0000","mapping_epoch":28,"log_start":"266'2000","ondisk_log_start":"266'2000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:57.527506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8773,"num_read_kb":7539,"num_write":2902,"num_write_kb":1299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'179","reported_seq":791,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.640641+0000","last_change":"2024-09-12T00:25:00.467280+0000","last_active":"2024-09-12T01:37:38.640641+0000","last_peered":"2024-09-12T01:37:38.640641+0000","last_clean":"2024-09-12T01:37:38.640641+0000","last_became_active":"2024-09-12T00:25:00.466899+0000","last_became_peered":"2024-09-12T00:25:00.466899+0000","last_unstale":"2024-09-12T01:37:38.640641+0000","last_undegraded":"2024-09-12T01:37:38.640641+0000","last_fullsized":"2024-09-12T01:37:38.640641+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:56.406557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":366,"num_read_kb":8806,"num_write":851,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.084136+0000","last_change":"2024-09-12T00:25:04.483191+0000","last_active":"2024-09-12T01:34:24.084136+0000","last_peered":"2024-09-12T01:34:24.084136+0000","last_clean":"2024-09-12T01:34:24.084136+0000","last_became_active":"2024-09-12T00:25:04.482885+0000","last_became_peered":"2024-09-12T00:25:04.482885+0000","last_unstale":"2024-09-12T01:34:24.084136+0000","last_undegraded":"2024-09-12T01:34:24.084136+0000","last_fullsized":"2024-09-12T01:34:24.084136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:29.397137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'264","reported_seq":917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.662698+0000","last_change":"2024-09-12T00:25:06.498236+0000","last_active":"2024-09-12T01:37:38.662698+0000","last_peered":"2024-09-12T01:37:38.662698+0000","last_clean":"2024-09-12T01:37:38.662698+0000","last_became_active":"2024-09-12T00:25:06.497881+0000","last_became_peered":"2024-09-12T00:25:06.497881+0000","last_unstale":"2024-09-12T01:37:38.662698+0000","last_undegraded":"2024-09-12T01:37:38.662698+0000","last_fullsized":"2024-09-12T01:37:38.662698+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:36.459394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20748,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":371,"num_read_kb":470,"num_write":222,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.178342+0000","last_change":"2024-09-12T00:25:08.508274+0000","last_active":"2024-09-12T01:34:54.178342+0000","last_peered":"2024-09-12T01:34:54.178342+0000","last_clean":"2024-09-12T01:34:54.178342+0000","last_became_active":"2024-09-12T00:25:08.507993+0000","last_became_peered":"2024-09-12T00:25:08.507993+0000","last_unstale":"2024-09-12T01:34:54.178342+0000","last_undegraded":"2024-09-12T01:34:54.178342+0000","last_fullsized":"2024-09-12T01:34:54.178342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:26.028970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'572","reported_seq":1417,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.565060+0000","last_change":"2024-09-12T00:25:10.528237+0000","last_active":"2024-09-12T01:37:19.565060+0000","last_peered":"2024-09-12T01:37:19.565060+0000","last_clean":"2024-09-12T01:37:19.565060+0000","last_became_active":"2024-09-12T00:25:10.528021+0000","last_became_peered":"2024-09-12T00:25:10.528021+0000","last_unstale":"2024-09-12T01:37:19.565060+0000","last_undegraded":"2024-09-12T01:37:19.565060+0000","last_fullsized":"2024-09-12T01:37:19.565060+0000","mapping_epoch":36,"log_start":"266'500","ondisk_log_start":"266'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:14.269299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1390,"num_read_kb":1363,"num_write":1223,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'492","reported_seq":2153,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.488491+0000","last_change":"2024-09-12T00:25:02.468103+0000","last_active":"2024-09-12T01:35:19.488491+0000","last_peered":"2024-09-12T01:35:19.488491+0000","last_clean":"2024-09-12T01:35:19.488491+0000","last_became_active":"2024-09-12T00:25:02.467846+0000","last_became_peered":"2024-09-12T00:25:02.467846+0000","last_unstale":"2024-09-12T01:35:19.488491+0000","last_undegraded":"2024-09-12T01:35:19.488491+0000","last_fullsized":"2024-09-12T01:35:19.488491+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:33.654734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2600,"num_read_kb":2447,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'208","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.903489+0000","last_change":"2024-09-12T00:25:00.486904+0000","last_active":"2024-09-12T01:37:38.903489+0000","last_peered":"2024-09-12T01:37:38.903489+0000","last_clean":"2024-09-12T01:37:38.903489+0000","last_became_active":"2024-09-12T00:25:00.486471+0000","last_became_peered":"2024-09-12T00:25:00.486471+0000","last_unstale":"2024-09-12T01:37:38.903489+0000","last_undegraded":"2024-09-12T01:37:38.903489+0000","last_fullsized":"2024-09-12T01:37:38.903489+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:35.328875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706427,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":18784,"num_write":969,"num_write_kb":38470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.174174+0000","last_change":"2024-09-12T00:25:04.480755+0000","last_active":"2024-09-12T01:34:24.174174+0000","last_peered":"2024-09-12T01:34:24.174174+0000","last_clean":"2024-09-12T01:34:24.174174+0000","last_became_active":"2024-09-12T00:25:04.480469+0000","last_became_peered":"2024-09-12T00:25:04.480469+0000","last_unstale":"2024-09-12T01:34:24.174174+0000","last_undegraded":"2024-09-12T01:34:24.174174+0000","last_fullsized":"2024-09-12T01:34:24.174174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:20.229017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'144","reported_seq":740,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:07.269941+0000","last_change":"2024-09-12T00:25:06.500291+0000","last_active":"2024-09-12T01:37:07.269941+0000","last_peered":"2024-09-12T01:37:07.269941+0000","last_clean":"2024-09-12T01:37:07.269941+0000","last_became_active":"2024-09-12T00:25:06.500036+0000","last_became_peered":"2024-09-12T00:25:06.500036+0000","last_unstale":"2024-09-12T01:37:07.269941+0000","last_undegraded":"2024-09-12T01:37:07.269941+0000","last_fullsized":"2024-09-12T01:37:07.269941+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:40.715748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11550,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":183,"num_read_kb":233,"num_write":96,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:42.248759+0000","last_change":"2024-09-12T00:25:08.510086+0000","last_active":"2024-09-12T01:34:42.248759+0000","last_peered":"2024-09-12T01:34:42.248759+0000","last_clean":"2024-09-12T01:34:42.248759+0000","last_became_active":"2024-09-12T00:25:08.509780+0000","last_became_peered":"2024-09-12T00:25:08.509780+0000","last_unstale":"2024-09-12T01:34:42.248759+0000","last_undegraded":"2024-09-12T01:34:42.248759+0000","last_fullsized":"2024-09-12T01:34:42.248759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:23.294463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'144","reported_seq":649,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:14.095922+0000","last_change":"2024-09-12T00:25:10.528275+0000","last_active":"2024-09-12T01:36:14.095922+0000","last_peered":"2024-09-12T01:36:14.095922+0000","last_clean":"2024-09-12T01:36:14.095922+0000","last_became_active":"2024-09-12T00:25:10.527984+0000","last_became_peered":"2024-09-12T00:25:10.527984+0000","last_unstale":"2024-09-12T01:36:14.095922+0000","last_undegraded":"2024-09-12T01:36:14.095922+0000","last_fullsized":"2024-09-12T01:36:14.095922+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:42.118932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":124,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'452","reported_seq":2015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801286+0000","last_change":"2024-09-12T00:25:02.469437+0000","last_active":"2024-09-12T01:35:34.801286+0000","last_peered":"2024-09-12T01:35:34.801286+0000","last_clean":"2024-09-12T01:35:34.801286+0000","last_became_active":"2024-09-12T00:25:02.469155+0000","last_became_peered":"2024-09-12T00:25:02.469155+0000","last_unstale":"2024-09-12T01:35:34.801286+0000","last_undegraded":"2024-09-12T01:35:34.801286+0000","last_fullsized":"2024-09-12T01:35:34.801286+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:28.701935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2451,"num_write":541,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'226","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.815420+0000","last_change":"2024-09-12T00:25:32.564364+0000","last_active":"2024-09-12T01:37:38.815420+0000","last_peered":"2024-09-12T01:37:38.815420+0000","last_clean":"2024-09-12T01:37:38.815420+0000","last_became_active":"2024-09-12T00:25:32.563811+0000","last_became_peered":"2024-09-12T00:25:32.563811+0000","last_unstale":"2024-09-12T01:37:38.815420+0000","last_undegraded":"2024-09-12T01:37:38.815420+0000","last_fullsized":"2024-09-12T01:37:38.815420+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:39.825680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442172,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":15150,"num_write":1090,"num_write_kb":21884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:48.998771+0000","last_change":"2024-09-12T00:25:04.484649+0000","last_active":"2024-09-12T01:34:48.998771+0000","last_peered":"2024-09-12T01:34:48.998771+0000","last_clean":"2024-09-12T01:34:48.998771+0000","last_became_active":"2024-09-12T00:25:04.484029+0000","last_became_peered":"2024-09-12T00:25:04.484029+0000","last_unstale":"2024-09-12T01:34:48.998771+0000","last_undegraded":"2024-09-12T01:34:48.998771+0000","last_fullsized":"2024-09-12T01:34:48.998771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:29.267578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'217","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.698221+0000","last_change":"2024-09-12T00:25:06.496644+0000","last_active":"2024-09-12T01:37:38.698221+0000","last_peered":"2024-09-12T01:37:38.698221+0000","last_clean":"2024-09-12T01:37:38.698221+0000","last_became_active":"2024-09-12T00:25:06.496348+0000","last_became_peered":"2024-09-12T00:25:06.496348+0000","last_unstale":"2024-09-12T01:37:38.698221+0000","last_undegraded":"2024-09-12T01:37:38.698221+0000","last_fullsized":"2024-09-12T01:37:38.698221+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:12.917394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22554,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":293,"num_read_kb":420,"num_write":176,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'800","reported_seq":4588,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.531846+0000","last_change":"2024-09-12T00:25:08.512365+0000","last_active":"2024-09-12T01:37:38.531846+0000","last_peered":"2024-09-12T01:37:38.531846+0000","last_clean":"2024-09-12T01:37:38.531846+0000","last_became_active":"2024-09-12T00:25:08.512086+0000","last_became_peered":"2024-09-12T00:25:08.512086+0000","last_unstale":"2024-09-12T01:37:38.531846+0000","last_undegraded":"2024-09-12T01:37:38.531846+0000","last_fullsized":"2024-09-12T01:37:38.531846+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:45.064721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'130","reported_seq":630,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.246800+0000","last_change":"2024-09-12T00:25:10.521608+0000","last_active":"2024-09-12T01:37:18.246800+0000","last_peered":"2024-09-12T01:37:18.246800+0000","last_clean":"2024-09-12T01:37:18.246800+0000","last_became_active":"2024-09-12T00:25:10.521322+0000","last_became_peered":"2024-09-12T00:25:10.521322+0000","last_unstale":"2024-09-12T01:37:18.246800+0000","last_undegraded":"2024-09-12T01:37:18.246800+0000","last_fullsized":"2024-09-12T01:37:18.246800+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.501352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":104,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'389","reported_seq":1833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.490823+0000","last_change":"2024-09-12T00:25:02.468886+0000","last_active":"2024-09-12T01:35:19.490823+0000","last_peered":"2024-09-12T01:35:19.490823+0000","last_clean":"2024-09-12T01:35:19.490823+0000","last_became_active":"2024-09-12T00:25:02.468609+0000","last_became_peered":"2024-09-12T00:25:02.468609+0000","last_unstale":"2024-09-12T01:35:19.490823+0000","last_undegraded":"2024-09-12T01:35:19.490823+0000","last_fullsized":"2024-09-12T01:35:19.490823+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:52.563826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2038,"num_read_kb":1930,"num_write":430,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'219","reported_seq":970,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.756624+0000","last_change":"2024-09-12T00:25:00.473333+0000","last_active":"2024-09-12T01:37:38.756624+0000","last_peered":"2024-09-12T01:37:38.756624+0000","last_clean":"2024-09-12T01:37:38.756624+0000","last_became_active":"2024-09-12T00:25:00.472065+0000","last_became_peered":"2024-09-12T00:25:00.472065+0000","last_unstale":"2024-09-12T01:37:38.756624+0000","last_undegraded":"2024-09-12T01:37:38.756624+0000","last_fullsized":"2024-09-12T01:37:38.756624+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:52.897931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9573531,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1000,"num_read_kb":31471,"num_write":994,"num_write_kb":39869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"38'4","reported_seq":977,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.291052+0000","last_change":"2024-09-12T00:25:04.482765+0000","last_active":"2024-09-12T01:37:38.291052+0000","last_peered":"2024-09-12T01:37:38.291052+0000","last_clean":"2024-09-12T01:37:38.291052+0000","last_became_active":"2024-09-12T00:25:04.482518+0000","last_became_peered":"2024-09-12T00:25:04.482518+0000","last_unstale":"2024-09-12T01:37:38.291052+0000","last_undegraded":"2024-09-12T01:37:38.291052+0000","last_fullsized":"2024-09-12T01:37:38.291052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.317643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'216","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.532689+0000","last_change":"2024-09-12T00:25:06.497612+0000","last_active":"2024-09-12T01:37:19.532689+0000","last_peered":"2024-09-12T01:37:19.532689+0000","last_clean":"2024-09-12T01:37:19.532689+0000","last_became_active":"2024-09-12T00:25:06.497269+0000","last_became_peered":"2024-09-12T00:25:06.497269+0000","last_unstale":"2024-09-12T01:37:19.532689+0000","last_undegraded":"2024-09-12T01:37:19.532689+0000","last_fullsized":"2024-09-12T01:37:19.532689+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:15.450749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19882,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":301,"num_read_kb":401,"num_write":154,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:28.995211+0000","last_change":"2024-09-12T00:25:08.514101+0000","last_active":"2024-09-12T01:34:28.995211+0000","last_peered":"2024-09-12T01:34:28.995211+0000","last_clean":"2024-09-12T01:34:28.995211+0000","last_became_active":"2024-09-12T00:25:08.513758+0000","last_became_peered":"2024-09-12T00:25:08.513758+0000","last_unstale":"2024-09-12T01:34:28.995211+0000","last_undegraded":"2024-09-12T01:34:28.995211+0000","last_fullsized":"2024-09-12T01:34:28.995211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:44.229276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'131","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.673372+0000","last_change":"2024-09-12T00:25:10.525073+0000","last_active":"2024-09-12T01:36:07.673372+0000","last_peered":"2024-09-12T01:36:07.673372+0000","last_clean":"2024-09-12T01:36:07.673372+0000","last_became_active":"2024-09-12T00:25:10.524500+0000","last_became_peered":"2024-09-12T00:25:10.524500+0000","last_unstale":"2024-09-12T01:36:07.673372+0000","last_undegraded":"2024-09-12T01:36:07.673372+0000","last_fullsized":"2024-09-12T01:36:07.673372+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:33.151875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":199,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'393","reported_seq":2026,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.195471+0000","last_change":"2024-09-12T00:25:02.476800+0000","last_active":"2024-09-12T01:36:11.195471+0000","last_peered":"2024-09-12T01:36:11.195471+0000","last_clean":"2024-09-12T01:36:11.195471+0000","last_became_active":"2024-09-12T00:25:02.476549+0000","last_became_peered":"2024-09-12T00:25:02.476549+0000","last_unstale":"2024-09-12T01:36:11.195471+0000","last_undegraded":"2024-09-12T01:36:11.195471+0000","last_fullsized":"2024-09-12T01:36:11.195471+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:16.691928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2368,"num_read_kb":2274,"num_write":449,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'195","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.890983+0000","last_change":"2024-09-12T00:25:00.471698+0000","last_active":"2024-09-12T01:37:38.890983+0000","last_peered":"2024-09-12T01:37:38.890983+0000","last_clean":"2024-09-12T01:37:38.890983+0000","last_became_active":"2024-09-12T00:25:00.471314+0000","last_became_peered":"2024-09-12T00:25:00.471314+0000","last_unstale":"2024-09-12T01:37:38.890983+0000","last_undegraded":"2024-09-12T01:37:38.890983+0000","last_fullsized":"2024-09-12T01:37:38.890983+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:13.302458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190278,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":11373,"num_write":891,"num_write_kb":19982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:50.121029+0000","last_change":"2024-09-12T00:25:04.486405+0000","last_active":"2024-09-12T01:34:50.121029+0000","last_peered":"2024-09-12T01:34:50.121029+0000","last_clean":"2024-09-12T01:34:50.121029+0000","last_became_active":"2024-09-12T00:25:04.486111+0000","last_became_peered":"2024-09-12T00:25:04.486111+0000","last_unstale":"2024-09-12T01:34:50.121029+0000","last_undegraded":"2024-09-12T01:34:50.121029+0000","last_fullsized":"2024-09-12T01:34:50.121029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:49.097494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'202","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.860441+0000","last_change":"2024-09-12T00:25:06.497567+0000","last_active":"2024-09-12T01:37:38.860441+0000","last_peered":"2024-09-12T01:37:38.860441+0000","last_clean":"2024-09-12T01:37:38.860441+0000","last_became_active":"2024-09-12T00:25:06.497247+0000","last_became_peered":"2024-09-12T00:25:06.497247+0000","last_unstale":"2024-09-12T01:37:38.860441+0000","last_undegraded":"2024-09-12T01:37:38.860441+0000","last_fullsized":"2024-09-12T01:37:38.860441+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:35.152802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":347,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123202+0000","last_change":"2024-09-12T00:25:08.517282+0000","last_active":"2024-09-12T01:35:05.123202+0000","last_peered":"2024-09-12T01:35:05.123202+0000","last_clean":"2024-09-12T01:35:05.123202+0000","last_became_active":"2024-09-12T00:25:08.516949+0000","last_became_peered":"2024-09-12T00:25:08.516949+0000","last_unstale":"2024-09-12T01:35:05.123202+0000","last_undegraded":"2024-09-12T01:35:05.123202+0000","last_fullsized":"2024-09-12T01:35:05.123202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:05.996838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'123","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:08.018005+0000","last_change":"2024-09-12T00:25:10.531019+0000","last_active":"2024-09-12T01:37:08.018005+0000","last_peered":"2024-09-12T01:37:08.018005+0000","last_clean":"2024-09-12T01:37:08.018005+0000","last_became_active":"2024-09-12T00:25:10.530731+0000","last_became_peered":"2024-09-12T00:25:10.530731+0000","last_unstale":"2024-09-12T01:37:08.018005+0000","last_undegraded":"2024-09-12T01:37:08.018005+0000","last_fullsized":"2024-09-12T01:37:08.018005+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.713991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":124,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'665","reported_seq":2301,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.803243+0000","last_change":"2024-09-12T00:25:02.474838+0000","last_active":"2024-09-12T01:35:34.803243+0000","last_peered":"2024-09-12T01:35:34.803243+0000","last_clean":"2024-09-12T01:35:34.803243+0000","last_became_active":"2024-09-12T00:25:02.474113+0000","last_became_peered":"2024-09-12T00:25:02.474113+0000","last_unstale":"2024-09-12T01:35:34.803243+0000","last_undegraded":"2024-09-12T01:35:34.803243+0000","last_fullsized":"2024-09-12T01:35:34.803243+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":600,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:02.950937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3250,"num_read_kb":2990,"num_write":879,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'185","reported_seq":897,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.545738+0000","last_change":"2024-09-12T00:25:32.562365+0000","last_active":"2024-09-12T01:36:39.545738+0000","last_peered":"2024-09-12T01:36:39.545738+0000","last_clean":"2024-09-12T01:36:39.545738+0000","last_became_active":"2024-09-12T00:25:32.562005+0000","last_became_peered":"2024-09-12T00:25:32.562005+0000","last_unstale":"2024-09-12T01:36:39.545738+0000","last_undegraded":"2024-09-12T01:36:39.545738+0000","last_fullsized":"2024-09-12T01:36:39.545738+0000","mapping_epoch":39,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:04.047110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568762,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":135425,"num_write":898,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:48.998802+0000","last_change":"2024-09-12T00:25:04.483049+0000","last_active":"2024-09-12T01:34:48.998802+0000","last_peered":"2024-09-12T01:34:48.998802+0000","last_clean":"2024-09-12T01:34:48.998802+0000","last_became_active":"2024-09-12T00:25:04.482744+0000","last_became_peered":"2024-09-12T00:25:04.482744+0000","last_unstale":"2024-09-12T01:34:48.998802+0000","last_undegraded":"2024-09-12T01:34:48.998802+0000","last_fullsized":"2024-09-12T01:34:48.998802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:16.996020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'192","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.788049+0000","last_change":"2024-09-12T00:25:06.497726+0000","last_active":"2024-09-12T01:37:38.788049+0000","last_peered":"2024-09-12T01:37:38.788049+0000","last_clean":"2024-09-12T01:37:38.788049+0000","last_became_active":"2024-09-12T00:25:06.497448+0000","last_became_peered":"2024-09-12T00:25:06.497448+0000","last_unstale":"2024-09-12T01:37:38.788049+0000","last_undegraded":"2024-09-12T01:37:38.788049+0000","last_fullsized":"2024-09-12T01:37:38.788049+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:20.638948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":247,"num_read_kb":253,"num_write":136,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'764","reported_seq":2721,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.526972+0000","last_change":"2024-09-12T00:25:08.510452+0000","last_active":"2024-09-12T01:37:38.526972+0000","last_peered":"2024-09-12T01:37:38.526972+0000","last_clean":"2024-09-12T01:37:38.526972+0000","last_became_active":"2024-09-12T00:25:08.510134+0000","last_became_peered":"2024-09-12T00:25:08.510134+0000","last_unstale":"2024-09-12T01:37:38.526972+0000","last_undegraded":"2024-09-12T01:37:38.526972+0000","last_fullsized":"2024-09-12T01:37:38.526972+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:11.026047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'125","reported_seq":627,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.054270+0000","last_change":"2024-09-12T00:25:10.522261+0000","last_active":"2024-09-12T01:36:09.054270+0000","last_peered":"2024-09-12T01:36:09.054270+0000","last_clean":"2024-09-12T01:36:09.054270+0000","last_became_active":"2024-09-12T00:25:10.521992+0000","last_became_peered":"2024-09-12T00:25:10.521992+0000","last_unstale":"2024-09-12T01:36:09.054270+0000","last_undegraded":"2024-09-12T01:36:09.054270+0000","last_fullsized":"2024-09-12T01:36:09.054270+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:39.515026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":300,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801315+0000","last_change":"2024-09-12T00:25:02.468698+0000","last_active":"2024-09-12T01:35:34.801315+0000","last_peered":"2024-09-12T01:35:34.801315+0000","last_clean":"2024-09-12T01:35:34.801315+0000","last_became_active":"2024-09-12T00:25:02.468401+0000","last_became_peered":"2024-09-12T00:25:02.468401+0000","last_unstale":"2024-09-12T01:35:34.801315+0000","last_undegraded":"2024-09-12T01:35:34.801315+0000","last_fullsized":"2024-09-12T01:35:34.801315+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:25.428427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2162,"num_read_kb":2053,"num_write":481,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'266","reported_seq":936,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.692623+0000","last_change":"2024-09-12T00:25:00.474914+0000","last_active":"2024-09-12T01:37:38.692623+0000","last_peered":"2024-09-12T01:37:38.692623+0000","last_clean":"2024-09-12T01:37:38.692623+0000","last_became_active":"2024-09-12T00:25:00.474471+0000","last_became_peered":"2024-09-12T00:25:00.474471+0000","last_unstale":"2024-09-12T01:37:38.692623+0000","last_undegraded":"2024-09-12T01:37:38.692623+0000","last_fullsized":"2024-09-12T01:37:38.692623+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:32.026867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2612534,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":560,"num_read_kb":17654,"num_write":1154,"num_write_kb":37946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1453,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.303392+0000","last_change":"2024-09-12T00:25:04.483123+0000","last_active":"2024-09-12T01:37:38.303392+0000","last_peered":"2024-09-12T01:37:38.303392+0000","last_clean":"2024-09-12T01:37:38.303392+0000","last_became_active":"2024-09-12T00:25:04.482824+0000","last_became_peered":"2024-09-12T00:25:04.482824+0000","last_unstale":"2024-09-12T01:37:38.303392+0000","last_undegraded":"2024-09-12T01:37:38.303392+0000","last_fullsized":"2024-09-12T01:37:38.303392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:35.937773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":942,"num_read_kb":942,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'103","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.535072+0000","last_change":"2024-09-12T00:25:06.500248+0000","last_active":"2024-09-12T01:35:51.535072+0000","last_peered":"2024-09-12T01:35:51.535072+0000","last_clean":"2024-09-12T01:35:51.535072+0000","last_became_active":"2024-09-12T00:25:06.499937+0000","last_became_peered":"2024-09-12T00:25:06.499937+0000","last_unstale":"2024-09-12T01:35:51.535072+0000","last_undegraded":"2024-09-12T01:35:51.535072+0000","last_fullsized":"2024-09-12T01:35:51.535072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:31.323131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'774","reported_seq":2632,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.527952+0000","last_change":"2024-09-12T00:25:08.502922+0000","last_active":"2024-09-12T01:37:38.527952+0000","last_peered":"2024-09-12T01:37:38.527952+0000","last_clean":"2024-09-12T01:37:38.527952+0000","last_became_active":"2024-09-12T00:25:08.501192+0000","last_became_peered":"2024-09-12T00:25:08.501192+0000","last_unstale":"2024-09-12T01:37:38.527952+0000","last_undegraded":"2024-09-12T01:37:38.527952+0000","last_fullsized":"2024-09-12T01:37:38.527952+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:55.381458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'106","reported_seq":611,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:55.080615+0000","last_change":"2024-09-12T00:25:10.524909+0000","last_active":"2024-09-12T01:33:55.080615+0000","last_peered":"2024-09-12T01:33:55.080615+0000","last_clean":"2024-09-12T01:33:55.080615+0000","last_became_active":"2024-09-12T00:25:10.524610+0000","last_became_peered":"2024-09-12T00:25:10.524610+0000","last_unstale":"2024-09-12T01:33:55.080615+0000","last_undegraded":"2024-09-12T01:33:55.080615+0000","last_fullsized":"2024-09-12T01:33:55.080615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:08.033152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'789","reported_seq":2436,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.408526+0000","last_change":"2024-09-12T00:25:02.479122+0000","last_active":"2024-09-12T01:37:18.408526+0000","last_peered":"2024-09-12T01:37:18.408526+0000","last_clean":"2024-09-12T01:37:18.408526+0000","last_became_active":"2024-09-12T00:25:02.478793+0000","last_became_peered":"2024-09-12T00:25:02.478793+0000","last_unstale":"2024-09-12T01:37:18.408526+0000","last_undegraded":"2024-09-12T01:37:18.408526+0000","last_fullsized":"2024-09-12T01:37:18.408526+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:57.070249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3638,"num_write":1039,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'220","reported_seq":937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.245709+0000","last_change":"2024-09-12T00:25:32.561533+0000","last_active":"2024-09-12T01:34:22.245709+0000","last_peered":"2024-09-12T01:34:22.245709+0000","last_clean":"2024-09-12T01:34:22.245709+0000","last_became_active":"2024-09-12T00:25:32.561102+0000","last_became_peered":"2024-09-12T00:25:32.561102+0000","last_unstale":"2024-09-12T01:34:22.245709+0000","last_undegraded":"2024-09-12T01:34:22.245709+0000","last_fullsized":"2024-09-12T01:34:22.245709+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:17.692906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8796046,"num_objects":12,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":546,"num_read_kb":71561,"num_write":1039,"num_write_kb":46306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6,0],"acting":[4,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.532031+0000","last_change":"2024-09-12T00:25:04.484834+0000","last_active":"2024-09-12T01:34:49.532031+0000","last_peered":"2024-09-12T01:34:49.532031+0000","last_clean":"2024-09-12T01:34:49.532031+0000","last_became_active":"2024-09-12T00:25:04.484543+0000","last_became_peered":"2024-09-12T00:25:04.484543+0000","last_unstale":"2024-09-12T01:34:49.532031+0000","last_undegraded":"2024-09-12T01:34:49.532031+0000","last_fullsized":"2024-09-12T01:34:49.532031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:42.025957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'305","reported_seq":943,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.642475+0000","last_change":"2024-09-12T00:25:06.497244+0000","last_active":"2024-09-12T01:37:38.642475+0000","last_peered":"2024-09-12T01:37:38.642475+0000","last_clean":"2024-09-12T01:37:38.642475+0000","last_became_active":"2024-09-12T00:25:06.496949+0000","last_became_peered":"2024-09-12T00:25:06.496949+0000","last_unstale":"2024-09-12T01:37:38.642475+0000","last_undegraded":"2024-09-12T01:37:38.642475+0000","last_fullsized":"2024-09-12T01:37:38.642475+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.596588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9140,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1014,"num_read_kb":1082,"num_write":1556,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:55.086981+0000","last_change":"2024-09-12T00:25:08.511378+0000","last_active":"2024-09-12T01:34:55.086981+0000","last_peered":"2024-09-12T01:34:55.086981+0000","last_clean":"2024-09-12T01:34:55.086981+0000","last_became_active":"2024-09-12T00:25:08.511103+0000","last_became_peered":"2024-09-12T00:25:08.511103+0000","last_unstale":"2024-09-12T01:34:55.086981+0000","last_undegraded":"2024-09-12T01:34:55.086981+0000","last_fullsized":"2024-09-12T01:34:55.086981+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:15.770737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'155","reported_seq":659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.023949+0000","last_change":"2024-09-12T00:25:10.524712+0000","last_active":"2024-09-12T01:35:02.023949+0000","last_peered":"2024-09-12T01:35:02.023949+0000","last_clean":"2024-09-12T01:35:02.023949+0000","last_became_active":"2024-09-12T00:25:10.524399+0000","last_became_peered":"2024-09-12T00:25:10.524399+0000","last_unstale":"2024-09-12T01:35:02.023949+0000","last_undegraded":"2024-09-12T01:35:02.023949+0000","last_fullsized":"2024-09-12T01:35:02.023949+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:02.179754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":348,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'525","reported_seq":2110,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.802899+0000","last_change":"2024-09-12T00:25:02.470865+0000","last_active":"2024-09-12T01:35:34.802899+0000","last_peered":"2024-09-12T01:35:34.802899+0000","last_clean":"2024-09-12T01:35:34.802899+0000","last_became_active":"2024-09-12T00:25:02.470508+0000","last_became_peered":"2024-09-12T00:25:02.470508+0000","last_unstale":"2024-09-12T01:35:34.802899+0000","last_undegraded":"2024-09-12T01:35:34.802899+0000","last_fullsized":"2024-09-12T01:35:34.802899+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:21.513113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2852,"num_read_kb":2640,"num_write":653,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"18'72","reported_seq":631,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.087190+0000","last_change":"2024-09-12T00:24:40.256272+0000","last_active":"2024-09-12T01:34:54.087190+0000","last_peered":"2024-09-12T01:34:54.087190+0000","last_clean":"2024-09-12T01:34:54.087190+0000","last_became_active":"2024-09-12T00:24:40.255060+0000","last_became_peered":"2024-09-12T00:24:40.255060+0000","last_unstale":"2024-09-12T01:34:54.087190+0000","last_undegraded":"2024-09-12T01:34:54.087190+0000","last_fullsized":"2024-09-12T01:34:54.087190+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:39.174906+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:39.174906+0000","last_clean_scrub_stamp":"2024-09-12T00:24:39.174906+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:43.340341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.523015+0000","last_change":"2024-09-12T00:24:48.219201+0000","last_active":"2024-09-12T01:33:34.523015+0000","last_peered":"2024-09-12T01:33:34.523015+0000","last_clean":"2024-09-12T01:33:34.523015+0000","last_became_active":"2024-09-12T00:24:46.449286+0000","last_became_peered":"2024-09-12T00:24:46.449286+0000","last_unstale":"2024-09-12T01:33:34.523015+0000","last_undegraded":"2024-09-12T01:33:34.523015+0000","last_fullsized":"2024-09-12T01:33:34.523015+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:20.504679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001069263,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'198","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:47.240940+0000","last_change":"2024-09-12T00:25:00.466263+0000","last_active":"2024-09-12T01:33:47.240940+0000","last_peered":"2024-09-12T01:33:47.240940+0000","last_clean":"2024-09-12T01:33:47.240940+0000","last_became_active":"2024-09-12T00:25:00.465691+0000","last_became_peered":"2024-09-12T00:25:00.465691+0000","last_unstale":"2024-09-12T01:33:47.240940+0000","last_undegraded":"2024-09-12T01:33:47.240940+0000","last_fullsized":"2024-09-12T01:33:47.240940+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:44.824605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588854,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":386,"num_read_kb":3125,"num_write":967,"num_write_kb":16262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.973231+0000","last_change":"2024-09-12T00:25:04.484191+0000","last_active":"2024-09-12T01:33:49.973231+0000","last_peered":"2024-09-12T01:33:49.973231+0000","last_clean":"2024-09-12T01:33:49.973231+0000","last_became_active":"2024-09-12T00:25:04.483893+0000","last_became_peered":"2024-09-12T00:25:04.483893+0000","last_unstale":"2024-09-12T01:33:49.973231+0000","last_undegraded":"2024-09-12T01:33:49.973231+0000","last_fullsized":"2024-09-12T01:33:49.973231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:57.380284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'334","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.767482+0000","last_change":"2024-09-12T00:25:06.497651+0000","last_active":"2024-09-12T01:37:38.767482+0000","last_peered":"2024-09-12T01:37:38.767482+0000","last_clean":"2024-09-12T01:37:38.767482+0000","last_became_active":"2024-09-12T00:25:06.497261+0000","last_became_peered":"2024-09-12T00:25:06.497261+0000","last_unstale":"2024-09-12T01:37:38.767482+0000","last_undegraded":"2024-09-12T01:37:38.767482+0000","last_fullsized":"2024-09-12T01:37:38.767482+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:29.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36159,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":620,"num_read_kb":873,"num_write":540,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:28.995333+0000","last_change":"2024-09-12T00:25:08.509443+0000","last_active":"2024-09-12T01:34:28.995333+0000","last_peered":"2024-09-12T01:34:28.995333+0000","last_clean":"2024-09-12T01:34:28.995333+0000","last_became_active":"2024-09-12T00:25:08.509183+0000","last_became_peered":"2024-09-12T00:25:08.509183+0000","last_unstale":"2024-09-12T01:34:28.995333+0000","last_undegraded":"2024-09-12T01:34:28.995333+0000","last_fullsized":"2024-09-12T01:34:28.995333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:07.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'216","reported_seq":927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.368080+0000","last_change":"2024-09-12T00:25:10.525926+0000","last_active":"2024-09-12T01:36:12.368080+0000","last_peered":"2024-09-12T01:36:12.368080+0000","last_clean":"2024-09-12T01:36:12.368080+0000","last_became_active":"2024-09-12T00:25:10.525441+0000","last_became_peered":"2024-09-12T00:25:10.525441+0000","last_unstale":"2024-09-12T01:36:12.368080+0000","last_undegraded":"2024-09-12T01:36:12.368080+0000","last_fullsized":"2024-09-12T01:36:12.368080+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:21.545364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":453,"num_read_kb":448,"num_write":488,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'808","reported_seq":2391,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.675442+0000","last_change":"2024-09-12T00:25:02.479220+0000","last_active":"2024-09-12T01:35:04.675442+0000","last_peered":"2024-09-12T01:35:04.675442+0000","last_clean":"2024-09-12T01:35:04.675442+0000","last_became_active":"2024-09-12T00:25:02.478919+0000","last_became_peered":"2024-09-12T00:25:02.478919+0000","last_unstale":"2024-09-12T01:35:04.675442+0000","last_undegraded":"2024-09-12T01:35:04.675442+0000","last_fullsized":"2024-09-12T01:35:04.675442+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:03.891856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4003,"num_read_kb":3616,"num_write":1060,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.532517+0000","last_change":"2024-09-12T00:24:48.218739+0000","last_active":"2024-09-12T01:34:54.532517+0000","last_peered":"2024-09-12T01:34:54.532517+0000","last_clean":"2024-09-12T01:34:54.532517+0000","last_became_active":"2024-09-12T00:24:46.216398+0000","last_became_peered":"2024-09-12T00:24:46.216398+0000","last_unstale":"2024-09-12T01:34:54.532517+0000","last_undegraded":"2024-09-12T01:34:54.532517+0000","last_fullsized":"2024-09-12T01:34:54.532517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:54.142561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080348300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'237","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.911839+0000","last_change":"2024-09-12T00:25:00.468216+0000","last_active":"2024-09-12T01:37:38.911839+0000","last_peered":"2024-09-12T01:37:38.911839+0000","last_clean":"2024-09-12T01:37:38.911839+0000","last_became_active":"2024-09-12T00:25:00.467622+0000","last_became_peered":"2024-09-12T00:25:00.467622+0000","last_unstale":"2024-09-12T01:37:38.911839+0000","last_undegraded":"2024-09-12T01:37:38.911839+0000","last_fullsized":"2024-09-12T01:37:38.911839+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:47.186663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":667699,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":22643,"num_write":1048,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.529037+0000","last_change":"2024-09-12T00:25:04.484033+0000","last_active":"2024-09-12T01:34:24.529037+0000","last_peered":"2024-09-12T01:34:24.529037+0000","last_clean":"2024-09-12T01:34:24.529037+0000","last_became_active":"2024-09-12T00:25:04.483752+0000","last_became_peered":"2024-09-12T00:25:04.483752+0000","last_unstale":"2024-09-12T01:34:24.529037+0000","last_undegraded":"2024-09-12T01:34:24.529037+0000","last_fullsized":"2024-09-12T01:34:24.529037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:45.784755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'927","reported_seq":2751,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.831626+0000","last_change":"2024-09-12T00:25:06.492242+0000","last_active":"2024-09-12T01:37:38.831626+0000","last_peered":"2024-09-12T01:37:38.831626+0000","last_clean":"2024-09-12T01:37:38.831626+0000","last_became_active":"2024-09-12T00:25:06.491919+0000","last_became_peered":"2024-09-12T00:25:06.491919+0000","last_unstale":"2024-09-12T01:37:38.831626+0000","last_undegraded":"2024-09-12T01:37:38.831626+0000","last_fullsized":"2024-09-12T01:37:38.831626+0000","mapping_epoch":32,"log_start":"266'900","ondisk_log_start":"266'900","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:27.174380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26860,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1263,"num_read_kb":1464,"num_write":378,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.525990+0000","last_change":"2024-09-12T00:25:08.514605+0000","last_active":"2024-09-12T01:33:59.525990+0000","last_peered":"2024-09-12T01:33:59.525990+0000","last_clean":"2024-09-12T01:33:59.525990+0000","last_became_active":"2024-09-12T00:25:08.514284+0000","last_became_peered":"2024-09-12T00:25:08.514284+0000","last_unstale":"2024-09-12T01:33:59.525990+0000","last_undegraded":"2024-09-12T01:33:59.525990+0000","last_fullsized":"2024-09-12T01:33:59.525990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:57.005332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'199","reported_seq":729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.179557+0000","last_change":"2024-09-12T00:25:10.521984+0000","last_active":"2024-09-12T01:36:11.179557+0000","last_peered":"2024-09-12T01:36:11.179557+0000","last_clean":"2024-09-12T01:36:11.179557+0000","last_became_active":"2024-09-12T00:25:10.521686+0000","last_became_peered":"2024-09-12T00:25:10.521686+0000","last_unstale":"2024-09-12T01:36:11.179557+0000","last_undegraded":"2024-09-12T01:36:11.179557+0000","last_fullsized":"2024-09-12T01:36:11.179557+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:44.218223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":329,"num_write":450,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'457","reported_seq":1918,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338325+0000","last_change":"2024-09-12T00:25:02.472659+0000","last_active":"2024-09-12T01:36:12.338325+0000","last_peered":"2024-09-12T01:36:12.338325+0000","last_clean":"2024-09-12T01:36:12.338325+0000","last_became_active":"2024-09-12T00:25:02.472379+0000","last_became_peered":"2024-09-12T00:25:02.472379+0000","last_unstale":"2024-09-12T01:36:12.338325+0000","last_undegraded":"2024-09-12T01:36:12.338325+0000","last_fullsized":"2024-09-12T01:36:12.338325+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:11.033418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2328,"num_read_kb":2161,"num_write":552,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:35.109804+0000","last_change":"2024-09-12T00:24:48.293366+0000","last_active":"2024-09-12T01:33:35.109804+0000","last_peered":"2024-09-12T01:33:35.109804+0000","last_clean":"2024-09-12T01:33:35.109804+0000","last_became_active":"2024-09-12T00:24:46.219148+0000","last_became_peered":"2024-09-12T00:24:46.219148+0000","last_unstale":"2024-09-12T01:33:35.109804+0000","last_undegraded":"2024-09-12T01:33:35.109804+0000","last_fullsized":"2024-09-12T01:33:35.109804+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:43.132714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040735800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'221","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.870176+0000","last_change":"2024-09-12T00:25:00.468826+0000","last_active":"2024-09-12T01:37:38.870176+0000","last_peered":"2024-09-12T01:37:38.870176+0000","last_clean":"2024-09-12T01:37:38.870176+0000","last_became_active":"2024-09-12T00:25:00.468270+0000","last_became_peered":"2024-09-12T00:25:00.468270+0000","last_unstale":"2024-09-12T01:37:38.870176+0000","last_undegraded":"2024-09-12T01:37:38.870176+0000","last_fullsized":"2024-09-12T01:37:38.870176+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.482218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":34464,"num_write":950,"num_write_kb":30398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:25.117408+0000","last_change":"2024-09-12T00:25:04.486850+0000","last_active":"2024-09-12T01:34:25.117408+0000","last_peered":"2024-09-12T01:34:25.117408+0000","last_clean":"2024-09-12T01:34:25.117408+0000","last_became_active":"2024-09-12T00:25:04.486554+0000","last_became_peered":"2024-09-12T00:25:04.486554+0000","last_unstale":"2024-09-12T01:34:25.117408+0000","last_undegraded":"2024-09-12T01:34:25.117408+0000","last_fullsized":"2024-09-12T01:34:25.117408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.290712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'310","reported_seq":1743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:14.925557+0000","last_change":"2024-09-12T00:25:06.495614+0000","last_active":"2024-09-12T01:37:14.925557+0000","last_peered":"2024-09-12T01:37:14.925557+0000","last_clean":"2024-09-12T01:37:14.925557+0000","last_became_active":"2024-09-12T00:25:06.495269+0000","last_became_peered":"2024-09-12T00:25:06.495269+0000","last_unstale":"2024-09-12T01:37:14.925557+0000","last_undegraded":"2024-09-12T01:37:14.925557+0000","last_fullsized":"2024-09-12T01:37:14.925557+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:38.976235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":267,"num_read_kb":257,"num_write":249,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.242368+0000","last_change":"2024-09-12T00:25:08.512053+0000","last_active":"2024-09-12T01:33:57.242368+0000","last_peered":"2024-09-12T01:33:57.242368+0000","last_clean":"2024-09-12T01:33:57.242368+0000","last_became_active":"2024-09-12T00:25:08.511783+0000","last_became_peered":"2024-09-12T00:25:08.511783+0000","last_unstale":"2024-09-12T01:33:57.242368+0000","last_undegraded":"2024-09-12T01:33:57.242368+0000","last_fullsized":"2024-09-12T01:33:57.242368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.395473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'269","reported_seq":883,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:12.270641+0000","last_change":"2024-09-12T00:25:10.525964+0000","last_active":"2024-09-12T01:37:12.270641+0000","last_peered":"2024-09-12T01:37:12.270641+0000","last_clean":"2024-09-12T01:37:12.270641+0000","last_became_active":"2024-09-12T00:25:10.525594+0000","last_became_peered":"2024-09-12T00:25:10.525594+0000","last_unstale":"2024-09-12T01:37:12.270641+0000","last_undegraded":"2024-09-12T01:37:12.270641+0000","last_fullsized":"2024-09-12T01:37:12.270641+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:12.216646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":513,"num_write":584,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'412","reported_seq":1889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.018009+0000","last_change":"2024-09-12T00:25:02.467324+0000","last_active":"2024-09-12T01:35:02.018009+0000","last_peered":"2024-09-12T01:35:02.018009+0000","last_clean":"2024-09-12T01:35:02.018009+0000","last_became_active":"2024-09-12T00:25:02.467022+0000","last_became_peered":"2024-09-12T00:25:02.467022+0000","last_unstale":"2024-09-12T01:35:02.018009+0000","last_undegraded":"2024-09-12T01:35:02.018009+0000","last_fullsized":"2024-09-12T01:35:02.018009+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.341992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2131,"num_read_kb":2016,"num_write":472,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.522983+0000","last_change":"2024-09-12T00:24:48.218472+0000","last_active":"2024-09-12T01:33:34.522983+0000","last_peered":"2024-09-12T01:33:34.522983+0000","last_clean":"2024-09-12T01:33:34.522983+0000","last_became_active":"2024-09-12T00:24:46.296014+0000","last_became_peered":"2024-09-12T00:24:46.296014+0000","last_unstale":"2024-09-12T01:33:34.522983+0000","last_undegraded":"2024-09-12T01:33:34.522983+0000","last_fullsized":"2024-09-12T01:33:34.522983+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:16.575080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055221999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'227","reported_seq":859,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.806318+0000","last_change":"2024-09-12T00:25:00.480960+0000","last_active":"2024-09-12T01:37:38.806318+0000","last_peered":"2024-09-12T01:37:38.806318+0000","last_clean":"2024-09-12T01:37:38.806318+0000","last_became_active":"2024-09-12T00:25:00.480242+0000","last_became_peered":"2024-09-12T00:25:00.480242+0000","last_unstale":"2024-09-12T01:37:38.806318+0000","last_undegraded":"2024-09-12T01:37:38.806318+0000","last_fullsized":"2024-09-12T01:37:38.806318+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:45.844641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":8697,"num_write":1016,"num_write_kb":33114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:00.113567+0000","last_change":"2024-09-12T00:25:04.483695+0000","last_active":"2024-09-12T01:34:00.113567+0000","last_peered":"2024-09-12T01:34:00.113567+0000","last_clean":"2024-09-12T01:34:00.113567+0000","last_became_active":"2024-09-12T00:25:04.483224+0000","last_became_peered":"2024-09-12T00:25:04.483224+0000","last_unstale":"2024-09-12T01:34:00.113567+0000","last_undegraded":"2024-09-12T01:34:00.113567+0000","last_fullsized":"2024-09-12T01:34:00.113567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:36.407261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'161","reported_seq":724,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.016537+0000","last_change":"2024-09-12T00:25:06.500894+0000","last_active":"2024-09-12T01:36:39.016537+0000","last_peered":"2024-09-12T01:36:39.016537+0000","last_clean":"2024-09-12T01:36:39.016537+0000","last_became_active":"2024-09-12T00:25:06.500406+0000","last_became_peered":"2024-09-12T00:25:06.500406+0000","last_unstale":"2024-09-12T01:36:39.016537+0000","last_undegraded":"2024-09-12T01:36:39.016537+0000","last_fullsized":"2024-09-12T01:36:39.016537+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:01.547439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":204,"num_read_kb":195,"num_write":150,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529656+0000","last_change":"2024-09-12T00:25:08.510581+0000","last_active":"2024-09-12T01:34:29.529656+0000","last_peered":"2024-09-12T01:34:29.529656+0000","last_clean":"2024-09-12T01:34:29.529656+0000","last_became_active":"2024-09-12T00:25:08.510287+0000","last_became_peered":"2024-09-12T00:25:08.510287+0000","last_unstale":"2024-09-12T01:34:29.529656+0000","last_undegraded":"2024-09-12T01:34:29.529656+0000","last_fullsized":"2024-09-12T01:34:29.529656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:48.633444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'158","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.085171+0000","last_change":"2024-09-12T00:25:10.523899+0000","last_active":"2024-09-12T01:34:34.085171+0000","last_peered":"2024-09-12T01:34:34.085171+0000","last_clean":"2024-09-12T01:34:34.085171+0000","last_became_active":"2024-09-12T00:25:10.523589+0000","last_became_peered":"2024-09-12T00:25:10.523589+0000","last_unstale":"2024-09-12T01:34:34.085171+0000","last_undegraded":"2024-09-12T01:34:34.085171+0000","last_fullsized":"2024-09-12T01:34:34.085171+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:20.406801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":189,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'1613","reported_seq":3209,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.172043+0000","last_change":"2024-09-12T00:25:02.471771+0000","last_active":"2024-09-12T01:36:11.172043+0000","last_peered":"2024-09-12T01:36:11.172043+0000","last_clean":"2024-09-12T01:36:11.172043+0000","last_became_active":"2024-09-12T00:25:02.471491+0000","last_became_peered":"2024-09-12T00:25:02.471491+0000","last_unstale":"2024-09-12T01:36:11.172043+0000","last_undegraded":"2024-09-12T01:36:11.172043+0000","last_fullsized":"2024-09-12T01:36:11.172043+0000","mapping_epoch":28,"log_start":"266'1600","ondisk_log_start":"266'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:00.651310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7163,"num_read_kb":6213,"num_write":2294,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'243","reported_seq":913,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.847696+0000","last_change":"2024-09-12T00:25:00.485158+0000","last_active":"2024-09-12T01:37:38.847696+0000","last_peered":"2024-09-12T01:37:38.847696+0000","last_clean":"2024-09-12T01:37:38.847696+0000","last_became_active":"2024-09-12T00:25:00.484147+0000","last_became_peered":"2024-09-12T00:25:00.484147+0000","last_unstale":"2024-09-12T01:37:38.847696+0000","last_undegraded":"2024-09-12T01:37:38.847696+0000","last_fullsized":"2024-09-12T01:37:38.847696+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:09.449162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":38062,"num_write":1135,"num_write_kb":41091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:33.986492+0000","last_change":"2024-09-12T00:24:48.266785+0000","last_active":"2024-09-12T01:33:33.986492+0000","last_peered":"2024-09-12T01:33:33.986492+0000","last_clean":"2024-09-12T01:33:33.986492+0000","last_became_active":"2024-09-12T00:24:46.295839+0000","last_became_peered":"2024-09-12T00:24:46.295839+0000","last_unstale":"2024-09-12T01:33:33.986492+0000","last_undegraded":"2024-09-12T01:33:33.986492+0000","last_fullsized":"2024-09-12T01:33:33.986492+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:07.950890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045367200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.241588+0000","last_change":"2024-09-12T00:25:04.479203+0000","last_active":"2024-09-12T01:33:52.241588+0000","last_peered":"2024-09-12T01:33:52.241588+0000","last_clean":"2024-09-12T01:33:52.241588+0000","last_became_active":"2024-09-12T00:25:04.478947+0000","last_became_peered":"2024-09-12T00:25:04.478947+0000","last_unstale":"2024-09-12T01:33:52.241588+0000","last_undegraded":"2024-09-12T01:33:52.241588+0000","last_fullsized":"2024-09-12T01:33:52.241588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:57.527013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'315","reported_seq":1016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.781701+0000","last_change":"2024-09-12T00:25:06.497179+0000","last_active":"2024-09-12T01:37:38.781701+0000","last_peered":"2024-09-12T01:37:38.781701+0000","last_clean":"2024-09-12T01:37:38.781701+0000","last_became_active":"2024-09-12T00:25:06.496693+0000","last_became_peered":"2024-09-12T00:25:06.496693+0000","last_unstale":"2024-09-12T01:37:38.781701+0000","last_undegraded":"2024-09-12T01:37:38.781701+0000","last_fullsized":"2024-09-12T01:37:38.781701+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:55.147097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":458,"num_read_kb":584,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:55.080589+0000","last_change":"2024-09-12T00:25:08.510222+0000","last_active":"2024-09-12T01:33:55.080589+0000","last_peered":"2024-09-12T01:33:55.080589+0000","last_clean":"2024-09-12T01:33:55.080589+0000","last_became_active":"2024-09-12T00:25:08.509962+0000","last_became_peered":"2024-09-12T00:25:08.509962+0000","last_unstale":"2024-09-12T01:33:55.080589+0000","last_undegraded":"2024-09-12T01:33:55.080589+0000","last_fullsized":"2024-09-12T01:33:55.080589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:01.318302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'143","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.243688+0000","last_change":"2024-09-12T00:25:10.522132+0000","last_active":"2024-09-12T01:36:11.243688+0000","last_peered":"2024-09-12T01:36:11.243688+0000","last_clean":"2024-09-12T01:36:11.243688+0000","last_became_active":"2024-09-12T00:25:10.521670+0000","last_became_peered":"2024-09-12T00:25:10.521670+0000","last_unstale":"2024-09-12T01:36:11.243688+0000","last_undegraded":"2024-09-12T01:36:11.243688+0000","last_fullsized":"2024-09-12T01:36:11.243688+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.340900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":347,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'1208","reported_seq":2855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:02.222588+0000","last_change":"2024-09-12T00:25:02.473486+0000","last_active":"2024-09-12T01:34:02.222588+0000","last_peered":"2024-09-12T01:34:02.222588+0000","last_clean":"2024-09-12T01:34:02.222588+0000","last_became_active":"2024-09-12T00:25:02.473158+0000","last_became_peered":"2024-09-12T00:25:02.473158+0000","last_unstale":"2024-09-12T01:34:02.222588+0000","last_undegraded":"2024-09-12T01:34:02.222588+0000","last_fullsized":"2024-09-12T01:34:02.222588+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:11.141082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5007,"num_write":1669,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'191","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.774056+0000","last_change":"2024-09-12T00:25:00.466317+0000","last_active":"2024-09-12T01:37:38.774056+0000","last_peered":"2024-09-12T01:37:38.774056+0000","last_clean":"2024-09-12T01:37:38.774056+0000","last_became_active":"2024-09-12T00:25:00.465896+0000","last_became_peered":"2024-09-12T00:25:00.465896+0000","last_unstale":"2024-09-12T01:37:38.774056+0000","last_undegraded":"2024-09-12T01:37:38.774056+0000","last_fullsized":"2024-09-12T01:37:38.774056+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:09.955689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702969,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":438,"num_read_kb":13303,"num_write":931,"num_write_kb":18974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523688+0000","last_change":"2024-09-12T00:24:48.218424+0000","last_active":"2024-09-12T01:33:39.523688+0000","last_peered":"2024-09-12T01:33:39.523688+0000","last_clean":"2024-09-12T01:33:39.523688+0000","last_became_active":"2024-09-12T00:24:46.213839+0000","last_became_peered":"2024-09-12T00:24:46.213839+0000","last_unstale":"2024-09-12T01:33:39.523688+0000","last_undegraded":"2024-09-12T01:33:39.523688+0000","last_fullsized":"2024-09-12T01:33:39.523688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.527991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050495300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.973182+0000","last_change":"2024-09-12T00:25:04.481438+0000","last_active":"2024-09-12T01:33:49.973182+0000","last_peered":"2024-09-12T01:33:49.973182+0000","last_clean":"2024-09-12T01:33:49.973182+0000","last_became_active":"2024-09-12T00:25:04.481137+0000","last_became_peered":"2024-09-12T00:25:04.481137+0000","last_unstale":"2024-09-12T01:33:49.973182+0000","last_undegraded":"2024-09-12T01:33:49.973182+0000","last_fullsized":"2024-09-12T01:33:49.973182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:00.812394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'252","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:18.697355+0000","last_change":"2024-09-12T00:25:06.501412+0000","last_active":"2024-09-12T01:36:18.697355+0000","last_peered":"2024-09-12T01:36:18.697355+0000","last_clean":"2024-09-12T01:36:18.697355+0000","last_became_active":"2024-09-12T00:25:06.501118+0000","last_became_peered":"2024-09-12T00:25:06.501118+0000","last_unstale":"2024-09-12T01:36:18.697355+0000","last_undegraded":"2024-09-12T01:36:18.697355+0000","last_fullsized":"2024-09-12T01:36:18.697355+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:25.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":326,"num_read_kb":318,"num_write":296,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'774","reported_seq":2925,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.524835+0000","last_change":"2024-09-12T00:25:08.509879+0000","last_active":"2024-09-12T01:37:38.524835+0000","last_peered":"2024-09-12T01:37:38.524835+0000","last_clean":"2024-09-12T01:37:38.524835+0000","last_became_active":"2024-09-12T00:25:08.509511+0000","last_became_peered":"2024-09-12T00:25:08.509511+0000","last_unstale":"2024-09-12T01:37:38.524835+0000","last_undegraded":"2024-09-12T01:37:38.524835+0000","last_fullsized":"2024-09-12T01:37:38.524835+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:11.392274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'129","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.569096+0000","last_change":"2024-09-12T00:25:10.525336+0000","last_active":"2024-09-12T01:37:19.569096+0000","last_peered":"2024-09-12T01:37:19.569096+0000","last_clean":"2024-09-12T01:37:19.569096+0000","last_became_active":"2024-09-12T00:25:10.524804+0000","last_became_peered":"2024-09-12T00:25:10.524804+0000","last_unstale":"2024-09-12T01:37:19.569096+0000","last_undegraded":"2024-09-12T01:37:19.569096+0000","last_fullsized":"2024-09-12T01:37:19.569096+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:29.933357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'465","reported_seq":2156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801739+0000","last_change":"2024-09-12T00:25:02.463524+0000","last_active":"2024-09-12T01:35:34.801739+0000","last_peered":"2024-09-12T01:35:34.801739+0000","last_clean":"2024-09-12T01:35:34.801739+0000","last_became_active":"2024-09-12T00:25:02.463232+0000","last_became_peered":"2024-09-12T00:25:02.463232+0000","last_unstale":"2024-09-12T01:35:34.801739+0000","last_undegraded":"2024-09-12T01:35:34.801739+0000","last_fullsized":"2024-09-12T01:35:34.801739+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:51.011943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2494,"num_read_kb":2382,"num_write":536,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'237","reported_seq":937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.245831+0000","last_change":"2024-09-12T00:25:00.453017+0000","last_active":"2024-09-12T01:34:22.245831+0000","last_peered":"2024-09-12T01:34:22.245831+0000","last_clean":"2024-09-12T01:34:22.245831+0000","last_became_active":"2024-09-12T00:25:00.452591+0000","last_became_peered":"2024-09-12T00:25:00.452591+0000","last_unstale":"2024-09-12T01:34:22.245831+0000","last_undegraded":"2024-09-12T01:34:22.245831+0000","last_fullsized":"2024-09-12T01:34:22.245831+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:36.167076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8400964,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":773,"num_read_kb":13125,"num_write":980,"num_write_kb":40186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:07.243705+0000","last_change":"2024-09-12T00:24:48.220966+0000","last_active":"2024-09-12T01:34:07.243705+0000","last_peered":"2024-09-12T01:34:07.243705+0000","last_clean":"2024-09-12T01:34:07.243705+0000","last_became_active":"2024-09-12T00:24:46.426160+0000","last_became_peered":"2024-09-12T00:24:46.426160+0000","last_unstale":"2024-09-12T01:34:07.243705+0000","last_undegraded":"2024-09-12T01:34:07.243705+0000","last_fullsized":"2024-09-12T01:34:07.243705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.751628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.524827+0000","last_change":"2024-09-12T00:25:04.483165+0000","last_active":"2024-09-12T01:33:49.524827+0000","last_peered":"2024-09-12T01:33:49.524827+0000","last_clean":"2024-09-12T01:33:49.524827+0000","last_became_active":"2024-09-12T00:25:04.482856+0000","last_became_peered":"2024-09-12T00:25:04.482856+0000","last_unstale":"2024-09-12T01:33:49.524827+0000","last_undegraded":"2024-09-12T01:33:49.524827+0000","last_fullsized":"2024-09-12T01:33:49.524827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:17.015689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'141","reported_seq":706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.422769+0000","last_change":"2024-09-12T00:25:06.498471+0000","last_active":"2024-09-12T01:36:07.422769+0000","last_peered":"2024-09-12T01:36:07.422769+0000","last_clean":"2024-09-12T01:36:07.422769+0000","last_became_active":"2024-09-12T00:25:06.497888+0000","last_became_peered":"2024-09-12T00:25:06.497888+0000","last_unstale":"2024-09-12T01:36:07.422769+0000","last_undegraded":"2024-09-12T01:36:07.422769+0000","last_fullsized":"2024-09-12T01:36:07.422769+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:52.806203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":168,"num_write":116,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'802","reported_seq":2656,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.529336+0000","last_change":"2024-09-12T00:25:08.513106+0000","last_active":"2024-09-12T01:37:38.529336+0000","last_peered":"2024-09-12T01:37:38.529336+0000","last_clean":"2024-09-12T01:37:38.529336+0000","last_became_active":"2024-09-12T00:25:08.512784+0000","last_became_peered":"2024-09-12T00:25:08.512784+0000","last_unstale":"2024-09-12T01:37:38.529336+0000","last_undegraded":"2024-09-12T01:37:38.529336+0000","last_fullsized":"2024-09-12T01:37:38.529336+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:47.339140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'243","reported_seq":771,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:10.294224+0000","last_change":"2024-09-12T00:25:10.523553+0000","last_active":"2024-09-12T01:36:10.294224+0000","last_peered":"2024-09-12T01:36:10.294224+0000","last_clean":"2024-09-12T01:36:10.294224+0000","last_became_active":"2024-09-12T00:25:10.523258+0000","last_became_peered":"2024-09-12T00:25:10.523258+0000","last_unstale":"2024-09-12T01:36:10.294224+0000","last_undegraded":"2024-09-12T01:36:10.294224+0000","last_fullsized":"2024-09-12T01:36:10.294224+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:05.850202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'489","reported_seq":2075,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.600382+0000","last_change":"2024-09-12T00:25:02.468737+0000","last_active":"2024-09-12T01:33:56.600382+0000","last_peered":"2024-09-12T01:33:56.600382+0000","last_clean":"2024-09-12T01:33:56.600382+0000","last_became_active":"2024-09-12T00:25:02.468436+0000","last_became_peered":"2024-09-12T00:25:02.468436+0000","last_unstale":"2024-09-12T01:33:56.600382+0000","last_undegraded":"2024-09-12T01:33:56.600382+0000","last_fullsized":"2024-09-12T01:33:56.600382+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:34.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2713,"num_read_kb":2534,"num_write":588,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'188","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:22.245804+0000","last_change":"2024-09-12T00:25:00.456455+0000","last_active":"2024-09-12T01:34:22.245804+0000","last_peered":"2024-09-12T01:34:22.245804+0000","last_clean":"2024-09-12T01:34:22.245804+0000","last_became_active":"2024-09-12T00:25:00.456071+0000","last_became_peered":"2024-09-12T00:25:00.456071+0000","last_unstale":"2024-09-12T01:34:22.245804+0000","last_undegraded":"2024-09-12T01:34:22.245804+0000","last_fullsized":"2024-09-12T01:34:22.245804+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:15.020137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6637754,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":419,"num_read_kb":39651,"num_write":889,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.527303+0000","last_change":"2024-09-12T00:24:48.218804+0000","last_active":"2024-09-12T01:34:09.527303+0000","last_peered":"2024-09-12T01:34:09.527303+0000","last_clean":"2024-09-12T01:34:09.527303+0000","last_became_active":"2024-09-12T00:24:46.425908+0000","last_became_peered":"2024-09-12T00:24:46.425908+0000","last_unstale":"2024-09-12T01:34:09.527303+0000","last_undegraded":"2024-09-12T01:34:09.527303+0000","last_fullsized":"2024-09-12T01:34:09.527303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:43.693370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085110299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"38'3","reported_seq":990,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.283815+0000","last_change":"2024-09-12T00:25:04.482182+0000","last_active":"2024-09-12T01:37:19.283815+0000","last_peered":"2024-09-12T01:37:19.283815+0000","last_clean":"2024-09-12T01:37:19.283815+0000","last_became_active":"2024-09-12T00:25:04.481193+0000","last_became_peered":"2024-09-12T00:25:04.481193+0000","last_unstale":"2024-09-12T01:37:19.283815+0000","last_undegraded":"2024-09-12T01:37:19.283815+0000","last_fullsized":"2024-09-12T01:37:19.283815+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:59.006487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":713,"num_read_kb":711,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'357","reported_seq":1109,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.893836+0000","last_change":"2024-09-12T00:25:06.492488+0000","last_active":"2024-09-12T01:37:38.893836+0000","last_peered":"2024-09-12T01:37:38.893836+0000","last_clean":"2024-09-12T01:37:38.893836+0000","last_became_active":"2024-09-12T00:25:06.492189+0000","last_became_peered":"2024-09-12T00:25:06.492189+0000","last_unstale":"2024-09-12T01:37:38.893836+0000","last_undegraded":"2024-09-12T01:37:38.893836+0000","last_fullsized":"2024-09-12T01:37:38.893836+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:44.290586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35877,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":729,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.242319+0000","last_change":"2024-09-12T00:25:08.510520+0000","last_active":"2024-09-12T01:33:57.242319+0000","last_peered":"2024-09-12T01:33:57.242319+0000","last_clean":"2024-09-12T01:33:57.242319+0000","last_became_active":"2024-09-12T00:25:08.510167+0000","last_became_peered":"2024-09-12T00:25:08.510167+0000","last_unstale":"2024-09-12T01:33:57.242319+0000","last_undegraded":"2024-09-12T01:33:57.242319+0000","last_fullsized":"2024-09-12T01:33:57.242319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:02.351709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'112","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.478978+0000","last_change":"2024-09-12T00:25:10.526124+0000","last_active":"2024-09-12T01:36:12.478978+0000","last_peered":"2024-09-12T01:36:12.478978+0000","last_clean":"2024-09-12T01:36:12.478978+0000","last_became_active":"2024-09-12T00:25:10.525850+0000","last_became_peered":"2024-09-12T00:25:10.525850+0000","last_unstale":"2024-09-12T01:36:12.478978+0000","last_undegraded":"2024-09-12T01:36:12.478978+0000","last_fullsized":"2024-09-12T01:36:12.478978+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:52.252550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'144","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.336165+0000","last_change":"2024-09-12T00:25:10.527379+0000","last_active":"2024-09-12T01:36:11.336165+0000","last_peered":"2024-09-12T01:36:11.336165+0000","last_clean":"2024-09-12T01:36:11.336165+0000","last_became_active":"2024-09-12T00:25:10.526982+0000","last_became_peered":"2024-09-12T00:25:10.526982+0000","last_unstale":"2024-09-12T01:36:11.336165+0000","last_undegraded":"2024-09-12T01:36:11.336165+0000","last_fullsized":"2024-09-12T01:36:11.336165+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:40.227802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":212,"num_write":342,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'493","reported_seq":2074,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.878429+0000","last_change":"2024-09-12T00:25:02.472468+0000","last_active":"2024-09-12T01:35:08.878429+0000","last_peered":"2024-09-12T01:35:08.878429+0000","last_clean":"2024-09-12T01:35:08.878429+0000","last_became_active":"2024-09-12T00:25:02.472013+0000","last_became_peered":"2024-09-12T00:25:02.472013+0000","last_unstale":"2024-09-12T01:35:08.878429+0000","last_undegraded":"2024-09-12T01:35:08.878429+0000","last_fullsized":"2024-09-12T01:35:08.878429+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:27.839901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2517,"num_read_kb":2353,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'215","reported_seq":917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.591988+0000","last_change":"2024-09-12T00:25:00.473993+0000","last_active":"2024-09-12T01:37:38.591988+0000","last_peered":"2024-09-12T01:37:38.591988+0000","last_clean":"2024-09-12T01:37:38.591988+0000","last_became_active":"2024-09-12T00:25:00.473591+0000","last_became_peered":"2024-09-12T00:25:00.473591+0000","last_unstale":"2024-09-12T01:37:38.591988+0000","last_undegraded":"2024-09-12T01:37:38.591988+0000","last_fullsized":"2024-09-12T01:37:38.591988+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:13.812127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308446,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":52508,"num_write":917,"num_write_kb":35191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.179649+0000","last_change":"2024-09-12T00:25:04.480021+0000","last_active":"2024-09-12T01:35:04.179649+0000","last_peered":"2024-09-12T01:35:04.179649+0000","last_clean":"2024-09-12T01:35:04.179649+0000","last_became_active":"2024-09-12T00:25:04.479701+0000","last_became_peered":"2024-09-12T00:25:04.479701+0000","last_unstale":"2024-09-12T01:35:04.179649+0000","last_undegraded":"2024-09-12T01:35:04.179649+0000","last_fullsized":"2024-09-12T01:35:04.179649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:14.742672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'160","reported_seq":756,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.677507+0000","last_change":"2024-09-12T00:25:06.500803+0000","last_active":"2024-09-12T01:37:38.677507+0000","last_peered":"2024-09-12T01:37:38.677507+0000","last_clean":"2024-09-12T01:37:38.677507+0000","last_became_active":"2024-09-12T00:25:06.500315+0000","last_became_peered":"2024-09-12T00:25:06.500315+0000","last_unstale":"2024-09-12T01:37:38.677507+0000","last_undegraded":"2024-09-12T01:37:38.677507+0000","last_fullsized":"2024-09-12T01:37:38.677507+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:36.321812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6391,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":221,"num_read_kb":264,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.123727+0000","last_change":"2024-09-12T00:25:08.517253+0000","last_active":"2024-09-12T01:35:10.123727+0000","last_peered":"2024-09-12T01:35:10.123727+0000","last_clean":"2024-09-12T01:35:10.123727+0000","last_became_active":"2024-09-12T00:25:08.516921+0000","last_became_peered":"2024-09-12T00:25:08.516921+0000","last_unstale":"2024-09-12T01:35:10.123727+0000","last_undegraded":"2024-09-12T01:35:10.123727+0000","last_fullsized":"2024-09-12T01:35:10.123727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:11.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'115","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:25.126051+0000","last_change":"2024-09-12T00:25:10.525063+0000","last_active":"2024-09-12T01:35:25.126051+0000","last_peered":"2024-09-12T01:35:25.126051+0000","last_clean":"2024-09-12T01:35:25.126051+0000","last_became_active":"2024-09-12T00:25:10.524416+0000","last_became_peered":"2024-09-12T00:25:10.524416+0000","last_unstale":"2024-09-12T01:35:25.126051+0000","last_undegraded":"2024-09-12T01:35:25.126051+0000","last_fullsized":"2024-09-12T01:35:25.126051+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:13.897999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":157,"num_read_kb":134,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'449","reported_seq":2012,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.193697+0000","last_change":"2024-09-12T00:25:02.473711+0000","last_active":"2024-09-12T01:36:11.193697+0000","last_peered":"2024-09-12T01:36:11.193697+0000","last_clean":"2024-09-12T01:36:11.193697+0000","last_became_active":"2024-09-12T00:25:02.471242+0000","last_became_peered":"2024-09-12T00:25:02.471242+0000","last_unstale":"2024-09-12T01:36:11.193697+0000","last_undegraded":"2024-09-12T01:36:11.193697+0000","last_fullsized":"2024-09-12T01:36:11.193697+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:25.707605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2437,"num_read_kb":2317,"num_write":523,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'218","reported_seq":878,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.857523+0000","last_change":"2024-09-12T00:25:00.481178+0000","last_active":"2024-09-12T01:37:38.857523+0000","last_peered":"2024-09-12T01:37:38.857523+0000","last_clean":"2024-09-12T01:37:38.857523+0000","last_became_active":"2024-09-12T00:25:00.480801+0000","last_became_peered":"2024-09-12T00:25:00.480801+0000","last_unstale":"2024-09-12T01:37:38.857523+0000","last_undegraded":"2024-09-12T01:37:38.857523+0000","last_fullsized":"2024-09-12T01:37:38.857523+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:23.032999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288330,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":555,"num_read_kb":14522,"num_write":924,"num_write_kb":19421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:07.252680+0000","last_change":"2024-09-12T00:25:04.484027+0000","last_active":"2024-09-12T01:35:07.252680+0000","last_peered":"2024-09-12T01:35:07.252680+0000","last_clean":"2024-09-12T01:35:07.252680+0000","last_became_active":"2024-09-12T00:25:04.482891+0000","last_became_peered":"2024-09-12T00:25:04.482891+0000","last_unstale":"2024-09-12T01:35:07.252680+0000","last_undegraded":"2024-09-12T01:35:07.252680+0000","last_fullsized":"2024-09-12T01:35:07.252680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:48.325429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'68","reported_seq":592,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:43.925146+0000","last_change":"2024-09-12T00:25:06.501436+0000","last_active":"2024-09-12T01:35:43.925146+0000","last_peered":"2024-09-12T01:35:43.925146+0000","last_clean":"2024-09-12T01:35:43.925146+0000","last_became_active":"2024-09-12T00:25:06.501049+0000","last_became_peered":"2024-09-12T00:25:06.501049+0000","last_unstale":"2024-09-12T01:35:43.925146+0000","last_undegraded":"2024-09-12T01:35:43.925146+0000","last_fullsized":"2024-09-12T01:35:43.925146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:39.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":50,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088627+0000","last_change":"2024-09-12T00:25:08.506372+0000","last_active":"2024-09-12T01:35:10.088627+0000","last_peered":"2024-09-12T01:35:10.088627+0000","last_clean":"2024-09-12T01:35:10.088627+0000","last_became_active":"2024-09-12T00:25:08.506052+0000","last_became_peered":"2024-09-12T00:25:08.506052+0000","last_unstale":"2024-09-12T01:35:10.088627+0000","last_undegraded":"2024-09-12T01:35:10.088627+0000","last_fullsized":"2024-09-12T01:35:10.088627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:29.150145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'177","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.160319+0000","last_change":"2024-09-12T00:25:10.525258+0000","last_active":"2024-09-12T01:36:11.160319+0000","last_peered":"2024-09-12T01:36:11.160319+0000","last_clean":"2024-09-12T01:36:11.160319+0000","last_became_active":"2024-09-12T00:25:10.524992+0000","last_became_peered":"2024-09-12T00:25:10.524992+0000","last_unstale":"2024-09-12T01:36:11.160319+0000","last_undegraded":"2024-09-12T01:36:11.160319+0000","last_fullsized":"2024-09-12T01:36:11.160319+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:04.187071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":300,"num_read_kb":289,"num_write":406,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'593","reported_seq":2213,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428085+0000","last_change":"2024-09-12T00:25:02.468999+0000","last_active":"2024-09-12T01:37:18.428085+0000","last_peered":"2024-09-12T01:37:18.428085+0000","last_clean":"2024-09-12T01:37:18.428085+0000","last_became_active":"2024-09-12T00:25:02.468715+0000","last_became_peered":"2024-09-12T00:25:02.468715+0000","last_unstale":"2024-09-12T01:37:18.428085+0000","last_undegraded":"2024-09-12T01:37:18.428085+0000","last_fullsized":"2024-09-12T01:37:18.428085+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:09.616582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2927,"num_read_kb":2680,"num_write":750,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'255","reported_seq":904,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.668798+0000","last_change":"2024-09-12T00:25:00.482223+0000","last_active":"2024-09-12T01:37:38.668798+0000","last_peered":"2024-09-12T01:37:38.668798+0000","last_clean":"2024-09-12T01:37:38.668798+0000","last_became_active":"2024-09-12T00:25:00.481741+0000","last_became_peered":"2024-09-12T00:25:00.481741+0000","last_unstale":"2024-09-12T01:37:38.668798+0000","last_undegraded":"2024-09-12T01:37:38.668798+0000","last_fullsized":"2024-09-12T01:37:38.668798+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:46.144319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":2782,"num_write":1086,"num_write_kb":27824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088007+0000","last_change":"2024-09-12T00:25:04.476625+0000","last_active":"2024-09-12T01:35:05.088007+0000","last_peered":"2024-09-12T01:35:05.088007+0000","last_clean":"2024-09-12T01:35:05.088007+0000","last_became_active":"2024-09-12T00:25:04.476356+0000","last_became_peered":"2024-09-12T00:25:04.476356+0000","last_unstale":"2024-09-12T01:35:05.088007+0000","last_undegraded":"2024-09-12T01:35:05.088007+0000","last_fullsized":"2024-09-12T01:35:05.088007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.898254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'186","reported_seq":793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.905124+0000","last_change":"2024-09-12T00:25:06.496641+0000","last_active":"2024-09-12T01:37:38.905124+0000","last_peered":"2024-09-12T01:37:38.905124+0000","last_clean":"2024-09-12T01:37:38.905124+0000","last_became_active":"2024-09-12T00:25:06.496372+0000","last_became_peered":"2024-09-12T00:25:06.496372+0000","last_unstale":"2024-09-12T01:37:38.905124+0000","last_undegraded":"2024-09-12T01:37:38.905124+0000","last_fullsized":"2024-09-12T01:37:38.905124+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:02.866379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11132,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":274,"num_read_kb":379,"num_write":160,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088829+0000","last_change":"2024-09-12T00:25:08.509562+0000","last_active":"2024-09-12T01:35:09.088829+0000","last_peered":"2024-09-12T01:35:09.088829+0000","last_clean":"2024-09-12T01:35:09.088829+0000","last_became_active":"2024-09-12T00:25:08.508336+0000","last_became_peered":"2024-09-12T00:25:08.508336+0000","last_unstale":"2024-09-12T01:35:09.088829+0000","last_undegraded":"2024-09-12T01:35:09.088829+0000","last_fullsized":"2024-09-12T01:35:09.088829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:42.261339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'122","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:53.484506+0000","last_change":"2024-09-12T00:25:10.524167+0000","last_active":"2024-09-12T01:34:53.484506+0000","last_peered":"2024-09-12T01:34:53.484506+0000","last_clean":"2024-09-12T01:34:53.484506+0000","last_became_active":"2024-09-12T00:25:10.522375+0000","last_became_peered":"2024-09-12T00:25:10.522375+0000","last_unstale":"2024-09-12T01:34:53.484506+0000","last_undegraded":"2024-09-12T01:34:53.484506+0000","last_fullsized":"2024-09-12T01:34:53.484506+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:07.393133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":308,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'819","reported_seq":2384,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.833892+0000","last_change":"2024-09-12T00:25:02.473893+0000","last_active":"2024-09-12T01:35:16.833892+0000","last_peered":"2024-09-12T01:35:16.833892+0000","last_clean":"2024-09-12T01:35:16.833892+0000","last_became_active":"2024-09-12T00:25:02.473631+0000","last_became_peered":"2024-09-12T00:25:02.473631+0000","last_unstale":"2024-09-12T01:35:16.833892+0000","last_undegraded":"2024-09-12T01:35:16.833892+0000","last_fullsized":"2024-09-12T01:35:16.833892+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:23.372646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3838,"num_read_kb":3448,"num_write":1071,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'213","reported_seq":856,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.797969+0000","last_change":"2024-09-12T00:25:00.462263+0000","last_active":"2024-09-12T01:37:38.797969+0000","last_peered":"2024-09-12T01:37:38.797969+0000","last_clean":"2024-09-12T01:37:38.797969+0000","last_became_active":"2024-09-12T00:25:00.461875+0000","last_became_peered":"2024-09-12T00:25:00.461875+0000","last_unstale":"2024-09-12T01:37:38.797969+0000","last_undegraded":"2024-09-12T01:37:38.797969+0000","last_fullsized":"2024-09-12T01:37:38.797969+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:08.987863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288524,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":40693,"num_write":998,"num_write_kb":39273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533703+0000","last_change":"2024-09-12T00:25:04.486530+0000","last_active":"2024-09-12T01:35:04.533703+0000","last_peered":"2024-09-12T01:35:04.533703+0000","last_clean":"2024-09-12T01:35:04.533703+0000","last_became_active":"2024-09-12T00:25:04.486195+0000","last_became_peered":"2024-09-12T00:25:04.486195+0000","last_unstale":"2024-09-12T01:35:04.533703+0000","last_undegraded":"2024-09-12T01:35:04.533703+0000","last_fullsized":"2024-09-12T01:35:04.533703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:28.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'153","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.875995+0000","last_change":"2024-09-12T00:25:06.493690+0000","last_active":"2024-09-12T01:37:38.875995+0000","last_peered":"2024-09-12T01:37:38.875995+0000","last_clean":"2024-09-12T01:37:38.875995+0000","last_became_active":"2024-09-12T00:25:06.493276+0000","last_became_peered":"2024-09-12T00:25:06.493276+0000","last_unstale":"2024-09-12T01:37:38.875995+0000","last_undegraded":"2024-09-12T01:37:38.875995+0000","last_fullsized":"2024-09-12T01:37:38.875995+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:57.912640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":282,"num_write":108,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.123775+0000","last_change":"2024-09-12T00:25:08.513038+0000","last_active":"2024-09-12T01:35:10.123775+0000","last_peered":"2024-09-12T01:35:10.123775+0000","last_clean":"2024-09-12T01:35:10.123775+0000","last_became_active":"2024-09-12T00:25:08.512647+0000","last_became_peered":"2024-09-12T00:25:08.512647+0000","last_unstale":"2024-09-12T01:35:10.123775+0000","last_undegraded":"2024-09-12T01:35:10.123775+0000","last_fullsized":"2024-09-12T01:35:10.123775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:28.714653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'319","reported_seq":1615,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.676199+0000","last_change":"2024-09-12T00:25:02.475789+0000","last_active":"2024-09-12T01:35:04.676199+0000","last_peered":"2024-09-12T01:35:04.676199+0000","last_clean":"2024-09-12T01:35:04.676199+0000","last_became_active":"2024-09-12T00:25:02.475490+0000","last_became_peered":"2024-09-12T00:25:02.475490+0000","last_unstale":"2024-09-12T01:35:04.676199+0000","last_undegraded":"2024-09-12T01:35:04.676199+0000","last_fullsized":"2024-09-12T01:35:04.676199+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:44.106869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1691,"num_read_kb":1609,"num_write":373,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'212","reported_seq":820,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.816248+0000","last_change":"2024-09-12T00:25:00.462380+0000","last_active":"2024-09-12T01:37:38.816248+0000","last_peered":"2024-09-12T01:37:38.816248+0000","last_clean":"2024-09-12T01:37:38.816248+0000","last_became_active":"2024-09-12T00:25:00.462022+0000","last_became_peered":"2024-09-12T00:25:00.462022+0000","last_unstale":"2024-09-12T01:37:38.816248+0000","last_undegraded":"2024-09-12T01:37:38.816248+0000","last_fullsized":"2024-09-12T01:37:38.816248+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:53.418485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":5153,"num_write":1017,"num_write_kb":32149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.182675+0000","last_change":"2024-09-12T00:25:04.487420+0000","last_active":"2024-09-12T01:35:24.182675+0000","last_peered":"2024-09-12T01:35:24.182675+0000","last_clean":"2024-09-12T01:35:24.182675+0000","last_became_active":"2024-09-12T00:25:04.487192+0000","last_became_peered":"2024-09-12T00:25:04.487192+0000","last_unstale":"2024-09-12T01:35:24.182675+0000","last_undegraded":"2024-09-12T01:35:24.182675+0000","last_fullsized":"2024-09-12T01:35:24.182675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:45.179481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'229","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.864437+0000","last_change":"2024-09-12T00:25:06.498928+0000","last_active":"2024-09-12T01:37:38.864437+0000","last_peered":"2024-09-12T01:37:38.864437+0000","last_clean":"2024-09-12T01:37:38.864437+0000","last_became_active":"2024-09-12T00:25:06.498651+0000","last_became_peered":"2024-09-12T00:25:06.498651+0000","last_unstale":"2024-09-12T01:37:38.864437+0000","last_undegraded":"2024-09-12T01:37:38.864437+0000","last_fullsized":"2024-09-12T01:37:38.864437+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:22.315708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9365,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":332,"num_read_kb":425,"num_write":210,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088704+0000","last_change":"2024-09-12T00:25:08.507366+0000","last_active":"2024-09-12T01:35:10.088704+0000","last_peered":"2024-09-12T01:35:10.088704+0000","last_clean":"2024-09-12T01:35:10.088704+0000","last_became_active":"2024-09-12T00:25:08.507090+0000","last_became_peered":"2024-09-12T00:25:08.507090+0000","last_unstale":"2024-09-12T01:35:10.088704+0000","last_undegraded":"2024-09-12T01:35:10.088704+0000","last_fullsized":"2024-09-12T01:35:10.088704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:09.874475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'186","reported_seq":707,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.725493+0000","last_change":"2024-09-12T00:25:10.522192+0000","last_active":"2024-09-12T01:36:09.725493+0000","last_peered":"2024-09-12T01:36:09.725493+0000","last_clean":"2024-09-12T01:36:09.725493+0000","last_became_active":"2024-09-12T00:25:10.521886+0000","last_became_peered":"2024-09-12T00:25:10.521886+0000","last_unstale":"2024-09-12T01:36:09.725493+0000","last_undegraded":"2024-09-12T01:36:09.725493+0000","last_fullsized":"2024-09-12T01:36:09.725493+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.743861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":280,"num_read_kb":274,"num_write":435,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'456","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.411387+0000","last_change":"2024-09-12T00:25:02.463605+0000","last_active":"2024-09-12T01:37:18.411387+0000","last_peered":"2024-09-12T01:37:18.411387+0000","last_clean":"2024-09-12T01:37:18.411387+0000","last_became_active":"2024-09-12T00:25:02.463187+0000","last_became_peered":"2024-09-12T00:25:02.463187+0000","last_unstale":"2024-09-12T01:37:18.411387+0000","last_undegraded":"2024-09-12T01:37:18.411387+0000","last_fullsized":"2024-09-12T01:37:18.411387+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:03.195160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2353,"num_read_kb":2190,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'296","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:52.232470+0000","last_change":"2024-09-12T00:25:00.469310+0000","last_active":"2024-09-12T01:32:52.232470+0000","last_peered":"2024-09-12T01:32:52.232470+0000","last_clean":"2024-09-12T01:32:52.232470+0000","last_became_active":"2024-09-12T00:25:00.467785+0000","last_became_peered":"2024-09-12T00:25:00.467785+0000","last_unstale":"2024-09-12T01:32:52.232470+0000","last_undegraded":"2024-09-12T01:32:52.232470+0000","last_fullsized":"2024-09-12T01:32:52.232470+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":200,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:53.465549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65959,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":728,"num_read_kb":946,"num_write":1130,"num_write_kb":20145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:50.080174+0000","last_change":"2024-09-12T00:25:04.484951+0000","last_active":"2024-09-12T01:33:50.080174+0000","last_peered":"2024-09-12T01:33:50.080174+0000","last_clean":"2024-09-12T01:33:50.080174+0000","last_became_active":"2024-09-12T00:25:04.484608+0000","last_became_peered":"2024-09-12T00:25:04.484608+0000","last_unstale":"2024-09-12T01:33:50.080174+0000","last_undegraded":"2024-09-12T01:33:50.080174+0000","last_fullsized":"2024-09-12T01:33:50.080174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:12.048616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'198","reported_seq":805,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.885494+0000","last_change":"2024-09-12T00:25:06.490294+0000","last_active":"2024-09-12T01:37:38.885494+0000","last_peered":"2024-09-12T01:37:38.885494+0000","last_clean":"2024-09-12T01:37:38.885494+0000","last_became_active":"2024-09-12T00:25:06.489578+0000","last_became_peered":"2024-09-12T00:25:06.489578+0000","last_unstale":"2024-09-12T01:37:38.885494+0000","last_undegraded":"2024-09-12T01:37:38.885494+0000","last_fullsized":"2024-09-12T01:37:38.885494+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:10.076563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7791,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":284,"num_read_kb":342,"num_write":192,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.002258+0000","last_change":"2024-09-12T00:25:08.513646+0000","last_active":"2024-09-12T01:35:09.002258+0000","last_peered":"2024-09-12T01:35:09.002258+0000","last_clean":"2024-09-12T01:35:09.002258+0000","last_became_active":"2024-09-12T00:25:08.513330+0000","last_became_peered":"2024-09-12T00:25:08.513330+0000","last_unstale":"2024-09-12T01:35:09.002258+0000","last_undegraded":"2024-09-12T01:35:09.002258+0000","last_fullsized":"2024-09-12T01:35:09.002258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:40.371456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'218","reported_seq":1100,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:08.536614+0000","last_change":"2024-09-12T00:25:10.527941+0000","last_active":"2024-09-12T01:36:08.536614+0000","last_peered":"2024-09-12T01:36:08.536614+0000","last_clean":"2024-09-12T01:36:08.536614+0000","last_became_active":"2024-09-12T00:25:10.527649+0000","last_became_peered":"2024-09-12T00:25:10.527649+0000","last_unstale":"2024-09-12T01:36:08.536614+0000","last_undegraded":"2024-09-12T01:36:08.536614+0000","last_fullsized":"2024-09-12T01:36:08.536614+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:30.223583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":648,"num_write":596,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'365","reported_seq":1815,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.802431+0000","last_change":"2024-09-12T00:25:02.479298+0000","last_active":"2024-09-12T01:35:34.802431+0000","last_peered":"2024-09-12T01:35:34.802431+0000","last_clean":"2024-09-12T01:35:34.802431+0000","last_became_active":"2024-09-12T00:25:02.479051+0000","last_became_peered":"2024-09-12T00:25:02.479051+0000","last_unstale":"2024-09-12T01:35:34.802431+0000","last_undegraded":"2024-09-12T01:35:34.802431+0000","last_fullsized":"2024-09-12T01:35:34.802431+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:59.990966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1824,"num_write":392,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'196","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.732801+0000","last_change":"2024-09-12T00:25:00.455462+0000","last_active":"2024-09-12T01:37:38.732801+0000","last_peered":"2024-09-12T01:37:38.732801+0000","last_clean":"2024-09-12T01:37:38.732801+0000","last_became_active":"2024-09-12T00:25:00.454796+0000","last_became_peered":"2024-09-12T00:25:00.454796+0000","last_unstale":"2024-09-12T01:37:38.732801+0000","last_undegraded":"2024-09-12T01:37:38.732801+0000","last_fullsized":"2024-09-12T01:37:38.732801+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:11.220113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661693,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":2462,"num_write":975,"num_write_kb":27053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088088+0000","last_change":"2024-09-12T00:25:04.475794+0000","last_active":"2024-09-12T01:35:05.088088+0000","last_peered":"2024-09-12T01:35:05.088088+0000","last_clean":"2024-09-12T01:35:05.088088+0000","last_became_active":"2024-09-12T00:25:04.475432+0000","last_became_peered":"2024-09-12T00:25:04.475432+0000","last_unstale":"2024-09-12T01:35:05.088088+0000","last_undegraded":"2024-09-12T01:35:05.088088+0000","last_fullsized":"2024-09-12T01:35:05.088088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:40.125056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'174","reported_seq":773,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.727058+0000","last_change":"2024-09-12T00:25:06.500060+0000","last_active":"2024-09-12T01:37:38.727058+0000","last_peered":"2024-09-12T01:37:38.727058+0000","last_clean":"2024-09-12T01:37:38.727058+0000","last_became_active":"2024-09-12T00:25:06.499452+0000","last_became_peered":"2024-09-12T00:25:06.499452+0000","last_unstale":"2024-09-12T01:37:38.727058+0000","last_undegraded":"2024-09-12T01:37:38.727058+0000","last_fullsized":"2024-09-12T01:37:38.727058+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:39.160375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6920,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":302,"num_write":132,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125335+0000","last_change":"2024-09-12T00:25:08.514860+0000","last_active":"2024-09-12T01:35:20.125335+0000","last_peered":"2024-09-12T01:35:20.125335+0000","last_clean":"2024-09-12T01:35:20.125335+0000","last_became_active":"2024-09-12T00:25:08.514591+0000","last_became_peered":"2024-09-12T00:25:08.514591+0000","last_unstale":"2024-09-12T01:35:20.125335+0000","last_undegraded":"2024-09-12T01:35:20.125335+0000","last_fullsized":"2024-09-12T01:35:20.125335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:20.635770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'120","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.574196+0000","last_change":"2024-09-12T00:25:10.527404+0000","last_active":"2024-09-12T01:37:19.574196+0000","last_peered":"2024-09-12T01:37:19.574196+0000","last_clean":"2024-09-12T01:37:19.574196+0000","last_became_active":"2024-09-12T00:25:10.527125+0000","last_became_peered":"2024-09-12T00:25:10.527125+0000","last_unstale":"2024-09-12T01:37:19.574196+0000","last_undegraded":"2024-09-12T01:37:19.574196+0000","last_fullsized":"2024-09-12T01:37:19.574196+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:04.270864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":179,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'797","reported_seq":2247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.251816+0000","last_change":"2024-09-12T00:25:02.464662+0000","last_active":"2024-09-12T01:35:02.251816+0000","last_peered":"2024-09-12T01:35:02.251816+0000","last_clean":"2024-09-12T01:35:02.251816+0000","last_became_active":"2024-09-12T00:25:02.464409+0000","last_became_peered":"2024-09-12T00:25:02.464409+0000","last_unstale":"2024-09-12T01:35:02.251816+0000","last_undegraded":"2024-09-12T01:35:02.251816+0000","last_fullsized":"2024-09-12T01:35:02.251816+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:53.007518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3724,"num_read_kb":3326,"num_write":1070,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'240","reported_seq":920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.251765+0000","last_change":"2024-09-12T00:25:00.466956+0000","last_active":"2024-09-12T01:35:02.251765+0000","last_peered":"2024-09-12T01:35:02.251765+0000","last_clean":"2024-09-12T01:35:02.251765+0000","last_became_active":"2024-09-12T00:25:00.466015+0000","last_became_peered":"2024-09-12T00:25:00.466015+0000","last_unstale":"2024-09-12T01:35:02.251765+0000","last_undegraded":"2024-09-12T01:35:02.251765+0000","last_fullsized":"2024-09-12T01:35:02.251765+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:26.695504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6701232,"num_objects":8,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":545,"num_read_kb":59877,"num_write":1078,"num_write_kb":30675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:07.252715+0000","last_change":"2024-09-12T00:25:04.482399+0000","last_active":"2024-09-12T01:35:07.252715+0000","last_peered":"2024-09-12T01:35:07.252715+0000","last_clean":"2024-09-12T01:35:07.252715+0000","last_became_active":"2024-09-12T00:25:04.482091+0000","last_became_peered":"2024-09-12T00:25:04.482091+0000","last_unstale":"2024-09-12T01:35:07.252715+0000","last_undegraded":"2024-09-12T01:35:07.252715+0000","last_fullsized":"2024-09-12T01:35:07.252715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.772204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'124","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.560906+0000","last_change":"2024-09-12T00:25:06.492106+0000","last_active":"2024-09-12T01:36:07.560906+0000","last_peered":"2024-09-12T01:36:07.560906+0000","last_clean":"2024-09-12T01:36:07.560906+0000","last_became_active":"2024-09-12T00:25:06.491582+0000","last_became_peered":"2024-09-12T00:25:06.491582+0000","last_unstale":"2024-09-12T01:36:07.560906+0000","last_undegraded":"2024-09-12T01:36:07.560906+0000","last_fullsized":"2024-09-12T01:36:07.560906+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:35.340695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":169,"num_read_kb":163,"num_write":166,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'765","reported_seq":2555,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.523342+0000","last_change":"2024-09-12T00:25:08.507545+0000","last_active":"2024-09-12T01:37:38.523342+0000","last_peered":"2024-09-12T01:37:38.523342+0000","last_clean":"2024-09-12T01:37:38.523342+0000","last_became_active":"2024-09-12T00:25:08.506288+0000","last_became_peered":"2024-09-12T00:25:08.506288+0000","last_unstale":"2024-09-12T01:37:38.523342+0000","last_undegraded":"2024-09-12T01:37:38.523342+0000","last_fullsized":"2024-09-12T01:37:38.523342+0000","mapping_epoch":34,"log_start":"266'701","ondisk_log_start":"266'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:41.048601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'126","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.534992+0000","last_change":"2024-09-12T00:25:10.525346+0000","last_active":"2024-09-12T01:35:14.534992+0000","last_peered":"2024-09-12T01:35:14.534992+0000","last_clean":"2024-09-12T01:35:14.534992+0000","last_became_active":"2024-09-12T00:25:10.525045+0000","last_became_peered":"2024-09-12T00:25:10.525045+0000","last_unstale":"2024-09-12T01:35:14.534992+0000","last_undegraded":"2024-09-12T01:35:14.534992+0000","last_fullsized":"2024-09-12T01:35:14.534992+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:19.669222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'457","reported_seq":2071,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.489386+0000","last_change":"2024-09-12T00:25:02.471992+0000","last_active":"2024-09-12T01:35:19.489386+0000","last_peered":"2024-09-12T01:35:19.489386+0000","last_clean":"2024-09-12T01:35:19.489386+0000","last_became_active":"2024-09-12T00:25:02.471255+0000","last_became_peered":"2024-09-12T00:25:02.471255+0000","last_unstale":"2024-09-12T01:35:19.489386+0000","last_undegraded":"2024-09-12T01:35:19.489386+0000","last_fullsized":"2024-09-12T01:35:19.489386+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:31.823002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2599,"num_read_kb":2460,"num_write":533,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'175","reported_seq":811,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.900378+0000","last_change":"2024-09-12T00:25:00.458803+0000","last_active":"2024-09-12T01:37:38.900378+0000","last_peered":"2024-09-12T01:37:38.900378+0000","last_clean":"2024-09-12T01:37:38.900378+0000","last_became_active":"2024-09-12T00:25:00.456853+0000","last_became_peered":"2024-09-12T00:25:00.456853+0000","last_unstale":"2024-09-12T01:37:38.900378+0000","last_undegraded":"2024-09-12T01:37:38.900378+0000","last_fullsized":"2024-09-12T01:37:38.900378+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:13.587033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1794910,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":16809,"num_write":841,"num_write_kb":28613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.088296+0000","last_change":"2024-09-12T00:25:04.482756+0000","last_active":"2024-09-12T01:35:04.088296+0000","last_peered":"2024-09-12T01:35:04.088296+0000","last_clean":"2024-09-12T01:35:04.088296+0000","last_became_active":"2024-09-12T00:25:04.482441+0000","last_became_peered":"2024-09-12T00:25:04.482441+0000","last_unstale":"2024-09-12T01:35:04.088296+0000","last_undegraded":"2024-09-12T01:35:04.088296+0000","last_fullsized":"2024-09-12T01:35:04.088296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:06.666983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'219","reported_seq":854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.799555+0000","last_change":"2024-09-12T00:25:06.494170+0000","last_active":"2024-09-12T01:37:38.799555+0000","last_peered":"2024-09-12T01:37:38.799555+0000","last_clean":"2024-09-12T01:37:38.799555+0000","last_became_active":"2024-09-12T00:25:06.493625+0000","last_became_peered":"2024-09-12T00:25:06.493625+0000","last_unstale":"2024-09-12T01:37:38.799555+0000","last_undegraded":"2024-09-12T01:37:38.799555+0000","last_fullsized":"2024-09-12T01:37:38.799555+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:01.532658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9308,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":374,"num_write":180,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:52.232442+0000","last_change":"2024-09-12T00:25:08.511276+0000","last_active":"2024-09-12T01:32:52.232442+0000","last_peered":"2024-09-12T01:32:52.232442+0000","last_clean":"2024-09-12T01:32:52.232442+0000","last_became_active":"2024-09-12T00:25:08.511024+0000","last_became_peered":"2024-09-12T00:25:08.511024+0000","last_unstale":"2024-09-12T01:32:52.232442+0000","last_undegraded":"2024-09-12T01:32:52.232442+0000","last_fullsized":"2024-09-12T01:32:52.232442+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:18.243804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'102","reported_seq":610,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.090066+0000","last_change":"2024-09-12T00:25:10.526277+0000","last_active":"2024-09-12T01:35:19.090066+0000","last_peered":"2024-09-12T01:35:19.090066+0000","last_clean":"2024-09-12T01:35:19.090066+0000","last_became_active":"2024-09-12T00:25:10.525981+0000","last_became_peered":"2024-09-12T00:25:10.525981+0000","last_unstale":"2024-09-12T01:35:19.090066+0000","last_undegraded":"2024-09-12T01:35:19.090066+0000","last_fullsized":"2024-09-12T01:35:19.090066+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:24.715656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":244,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'801","reported_seq":2397,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.430285+0000","last_change":"2024-09-12T00:25:02.463863+0000","last_active":"2024-09-12T01:37:18.430285+0000","last_peered":"2024-09-12T01:37:18.430285+0000","last_clean":"2024-09-12T01:37:18.430285+0000","last_became_active":"2024-09-12T00:25:02.463545+0000","last_became_peered":"2024-09-12T00:25:02.463545+0000","last_unstale":"2024-09-12T01:37:18.430285+0000","last_undegraded":"2024-09-12T01:37:18.430285+0000","last_fullsized":"2024-09-12T01:37:18.430285+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:38.345347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3630,"num_write":1061,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'201","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.675352+0000","last_change":"2024-09-12T00:25:00.479118+0000","last_active":"2024-09-12T01:37:38.675352+0000","last_peered":"2024-09-12T01:37:38.675352+0000","last_clean":"2024-09-12T01:37:38.675352+0000","last_became_active":"2024-09-12T00:25:00.478561+0000","last_became_peered":"2024-09-12T00:25:00.478561+0000","last_unstale":"2024-09-12T01:37:38.675352+0000","last_undegraded":"2024-09-12T01:37:38.675352+0000","last_fullsized":"2024-09-12T01:37:38.675352+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:02.954102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568262,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":8616,"num_write":923,"num_write_kb":24681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088076+0000","last_change":"2024-09-12T00:25:04.481420+0000","last_active":"2024-09-12T01:35:05.088076+0000","last_peered":"2024-09-12T01:35:05.088076+0000","last_clean":"2024-09-12T01:35:05.088076+0000","last_became_active":"2024-09-12T00:25:04.481146+0000","last_became_peered":"2024-09-12T00:25:04.481146+0000","last_unstale":"2024-09-12T01:35:05.088076+0000","last_undegraded":"2024-09-12T01:35:05.088076+0000","last_fullsized":"2024-09-12T01:35:05.088076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:58.000768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'151","reported_seq":745,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.528032+0000","last_change":"2024-09-12T00:25:06.499351+0000","last_active":"2024-09-12T01:37:19.528032+0000","last_peered":"2024-09-12T01:37:19.528032+0000","last_clean":"2024-09-12T01:37:19.528032+0000","last_became_active":"2024-09-12T00:25:06.499065+0000","last_became_peered":"2024-09-12T00:25:06.499065+0000","last_unstale":"2024-09-12T01:37:19.528032+0000","last_undegraded":"2024-09-12T01:37:19.528032+0000","last_fullsized":"2024-09-12T01:37:19.528032+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:00.555004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25525,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":203,"num_read_kb":299,"num_write":116,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:54.518132+0000","last_change":"2024-09-12T00:25:08.510993+0000","last_active":"2024-09-12T01:32:54.518132+0000","last_peered":"2024-09-12T01:32:54.518132+0000","last_clean":"2024-09-12T01:32:54.518132+0000","last_became_active":"2024-09-12T00:25:08.510416+0000","last_became_peered":"2024-09-12T00:25:08.510416+0000","last_unstale":"2024-09-12T01:32:54.518132+0000","last_undegraded":"2024-09-12T01:32:54.518132+0000","last_fullsized":"2024-09-12T01:32:54.518132+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:07.820462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'116","reported_seq":637,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.003868+0000","last_change":"2024-09-12T00:25:10.521269+0000","last_active":"2024-09-12T01:35:19.003868+0000","last_peered":"2024-09-12T01:35:19.003868+0000","last_clean":"2024-09-12T01:35:19.003868+0000","last_became_active":"2024-09-12T00:25:10.520808+0000","last_became_peered":"2024-09-12T00:25:10.520808+0000","last_unstale":"2024-09-12T01:35:19.003868+0000","last_undegraded":"2024-09-12T01:35:19.003868+0000","last_fullsized":"2024-09-12T01:35:19.003868+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:03.946656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1152,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":290,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'797","reported_seq":2307,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.315904+0000","last_change":"2024-09-12T00:25:02.470881+0000","last_active":"2024-09-12T01:36:12.315904+0000","last_peered":"2024-09-12T01:36:12.315904+0000","last_clean":"2024-09-12T01:36:12.315904+0000","last_became_active":"2024-09-12T00:25:02.470607+0000","last_became_peered":"2024-09-12T00:25:02.470607+0000","last_unstale":"2024-09-12T01:36:12.315904+0000","last_undegraded":"2024-09-12T01:36:12.315904+0000","last_fullsized":"2024-09-12T01:36:12.315904+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:49.586235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3788,"num_read_kb":3387,"num_write":1064,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'177","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.873940+0000","last_change":"2024-09-12T00:25:00.465714+0000","last_active":"2024-09-12T01:37:38.873940+0000","last_peered":"2024-09-12T01:37:38.873940+0000","last_clean":"2024-09-12T01:37:38.873940+0000","last_became_active":"2024-09-12T00:25:00.465095+0000","last_became_peered":"2024-09-12T00:25:00.465095+0000","last_unstale":"2024-09-12T01:37:38.873940+0000","last_undegraded":"2024-09-12T01:37:38.873940+0000","last_fullsized":"2024-09-12T01:37:38.873940+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:10.785936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":87968,"num_write":861,"num_write_kb":34661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088796+0000","last_change":"2024-09-12T00:25:04.483527+0000","last_active":"2024-09-12T01:35:09.088796+0000","last_peered":"2024-09-12T01:35:09.088796+0000","last_clean":"2024-09-12T01:35:09.088796+0000","last_became_active":"2024-09-12T00:25:04.483232+0000","last_became_peered":"2024-09-12T00:25:04.483232+0000","last_unstale":"2024-09-12T01:35:09.088796+0000","last_undegraded":"2024-09-12T01:35:09.088796+0000","last_fullsized":"2024-09-12T01:35:09.088796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:29.187018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'120","reported_seq":690,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.707553+0000","last_change":"2024-09-12T00:25:06.500325+0000","last_active":"2024-09-12T01:37:38.707553+0000","last_peered":"2024-09-12T01:37:38.707553+0000","last_clean":"2024-09-12T01:37:38.707553+0000","last_became_active":"2024-09-12T00:25:06.499749+0000","last_became_peered":"2024-09-12T00:25:06.499749+0000","last_unstale":"2024-09-12T01:37:38.707553+0000","last_undegraded":"2024-09-12T01:37:38.707553+0000","last_fullsized":"2024-09-12T01:37:38.707553+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:39.445969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8122,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":217,"num_write":76,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534440+0000","last_change":"2024-09-12T00:25:08.514387+0000","last_active":"2024-09-12T01:35:09.534440+0000","last_peered":"2024-09-12T01:35:09.534440+0000","last_clean":"2024-09-12T01:35:09.534440+0000","last_became_active":"2024-09-12T00:25:08.513977+0000","last_became_peered":"2024-09-12T00:25:08.513977+0000","last_unstale":"2024-09-12T01:35:09.534440+0000","last_undegraded":"2024-09-12T01:35:09.534440+0000","last_fullsized":"2024-09-12T01:35:09.534440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.665951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'144","reported_seq":1247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:10.909919+0000","last_change":"2024-09-12T00:25:10.530536+0000","last_active":"2024-09-12T01:36:10.909919+0000","last_peered":"2024-09-12T01:36:10.909919+0000","last_clean":"2024-09-12T01:36:10.909919+0000","last_became_active":"2024-09-12T00:25:10.530103+0000","last_became_peered":"2024-09-12T00:25:10.530103+0000","last_unstale":"2024-09-12T01:36:10.909919+0000","last_undegraded":"2024-09-12T01:36:10.909919+0000","last_fullsized":"2024-09-12T01:36:10.909919+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.601805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":760,"num_write":344,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'1249","reported_seq":2942,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088591+0000","last_change":"2024-09-12T00:25:02.467411+0000","last_active":"2024-09-12T01:35:10.088591+0000","last_peered":"2024-09-12T01:35:10.088591+0000","last_clean":"2024-09-12T01:35:10.088591+0000","last_became_active":"2024-09-12T00:25:02.467159+0000","last_became_peered":"2024-09-12T00:25:02.467159+0000","last_unstale":"2024-09-12T01:35:10.088591+0000","last_undegraded":"2024-09-12T01:35:10.088591+0000","last_fullsized":"2024-09-12T01:35:10.088591+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:32.592501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5713,"num_read_kb":5033,"num_write":1731,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'181","reported_seq":795,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.640952+0000","last_change":"2024-09-12T00:25:00.458860+0000","last_active":"2024-09-12T01:37:38.640952+0000","last_peered":"2024-09-12T01:37:38.640952+0000","last_clean":"2024-09-12T01:37:38.640952+0000","last_became_active":"2024-09-12T00:25:00.458519+0000","last_became_peered":"2024-09-12T00:25:00.458519+0000","last_unstale":"2024-09-12T01:37:38.640952+0000","last_undegraded":"2024-09-12T01:37:38.640952+0000","last_fullsized":"2024-09-12T01:37:38.640952+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:29.743861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174575,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":854,"num_write":913,"num_write_kb":13833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:57.233292+0000","last_change":"2024-09-12T00:25:04.482146+0000","last_active":"2024-09-12T01:32:57.233292+0000","last_peered":"2024-09-12T01:32:57.233292+0000","last_clean":"2024-09-12T01:32:57.233292+0000","last_became_active":"2024-09-12T00:25:04.481393+0000","last_became_peered":"2024-09-12T00:25:04.481393+0000","last_unstale":"2024-09-12T01:32:57.233292+0000","last_undegraded":"2024-09-12T01:32:57.233292+0000","last_fullsized":"2024-09-12T01:32:57.233292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:22.018902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'193","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.737443+0000","last_change":"2024-09-12T00:25:06.490707+0000","last_active":"2024-09-12T01:37:38.737443+0000","last_peered":"2024-09-12T01:37:38.737443+0000","last_clean":"2024-09-12T01:37:38.737443+0000","last_became_active":"2024-09-12T00:25:06.490384+0000","last_became_peered":"2024-09-12T00:25:06.490384+0000","last_unstale":"2024-09-12T01:37:38.737443+0000","last_undegraded":"2024-09-12T01:37:38.737443+0000","last_fullsized":"2024-09-12T01:37:38.737443+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:11.867492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8836,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:42.230896+0000","last_change":"2024-09-12T00:25:08.508294+0000","last_active":"2024-09-12T01:32:42.230896+0000","last_peered":"2024-09-12T01:32:42.230896+0000","last_clean":"2024-09-12T01:32:42.230896+0000","last_became_active":"2024-09-12T00:25:08.507837+0000","last_became_peered":"2024-09-12T00:25:08.507837+0000","last_unstale":"2024-09-12T01:32:42.230896+0000","last_undegraded":"2024-09-12T01:32:42.230896+0000","last_fullsized":"2024-09-12T01:32:42.230896+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:13.827697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'136","reported_seq":682,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.395437+0000","last_change":"2024-09-12T00:25:10.528310+0000","last_active":"2024-09-12T01:37:18.395437+0000","last_peered":"2024-09-12T01:37:18.395437+0000","last_clean":"2024-09-12T01:37:18.395437+0000","last_became_active":"2024-09-12T00:25:10.528040+0000","last_became_peered":"2024-09-12T00:25:10.528040+0000","last_unstale":"2024-09-12T01:37:18.395437+0000","last_undegraded":"2024-09-12T01:37:18.395437+0000","last_fullsized":"2024-09-12T01:37:18.395437+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:22.655533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":238,"num_write":307,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'1096","reported_seq":2607,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.781254+0000","last_change":"2024-09-12T00:25:02.474566+0000","last_active":"2024-09-12T01:34:39.781254+0000","last_peered":"2024-09-12T01:34:39.781254+0000","last_clean":"2024-09-12T01:34:39.781254+0000","last_became_active":"2024-09-12T00:25:02.474282+0000","last_became_peered":"2024-09-12T00:25:02.474282+0000","last_unstale":"2024-09-12T01:34:39.781254+0000","last_undegraded":"2024-09-12T01:34:39.781254+0000","last_fullsized":"2024-09-12T01:34:39.781254+0000","mapping_epoch":28,"log_start":"266'1000","ondisk_log_start":"266'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:37.444902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4398,"num_write":1510,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'185","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.882035+0000","last_change":"2024-09-12T00:25:00.478653+0000","last_active":"2024-09-12T01:37:38.882035+0000","last_peered":"2024-09-12T01:37:38.882035+0000","last_clean":"2024-09-12T01:37:38.882035+0000","last_became_active":"2024-09-12T00:25:00.478259+0000","last_became_peered":"2024-09-12T00:25:00.478259+0000","last_unstale":"2024-09-12T01:37:38.882035+0000","last_undegraded":"2024-09-12T01:37:38.882035+0000","last_fullsized":"2024-09-12T01:37:38.882035+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:16.754223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515600,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":41144,"num_write":873,"num_write_kb":35919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'752","reported_seq":2230,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.789666+0000","last_change":"2024-09-12T00:25:02.479779+0000","last_active":"2024-09-12T01:34:32.789666+0000","last_peered":"2024-09-12T01:34:32.789666+0000","last_clean":"2024-09-12T01:34:32.789666+0000","last_became_active":"2024-09-12T00:25:02.479450+0000","last_became_peered":"2024-09-12T00:25:02.479450+0000","last_unstale":"2024-09-12T01:34:32.789666+0000","last_undegraded":"2024-09-12T01:34:32.789666+0000","last_fullsized":"2024-09-12T01:34:32.789666+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:48.463312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3526,"num_read_kb":3183,"num_write":976,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'207","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.755842+0000","last_change":"2024-09-12T00:25:00.468633+0000","last_active":"2024-09-12T01:37:38.755842+0000","last_peered":"2024-09-12T01:37:38.755842+0000","last_clean":"2024-09-12T01:37:38.755842+0000","last_became_active":"2024-09-12T00:25:00.468280+0000","last_became_peered":"2024-09-12T00:25:00.468280+0000","last_unstale":"2024-09-12T01:37:38.755842+0000","last_undegraded":"2024-09-12T01:37:38.755842+0000","last_fullsized":"2024-09-12T01:37:38.755842+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:45.872366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":421,"num_read_kb":15096,"num_write":1006,"num_write_kb":29184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'365","reported_seq":1884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.192081+0000","last_change":"2024-09-12T00:25:02.477649+0000","last_active":"2024-09-12T01:36:11.192081+0000","last_peered":"2024-09-12T01:36:11.192081+0000","last_clean":"2024-09-12T01:36:11.192081+0000","last_became_active":"2024-09-12T00:25:02.476993+0000","last_became_peered":"2024-09-12T00:25:02.476993+0000","last_unstale":"2024-09-12T01:36:11.192081+0000","last_undegraded":"2024-09-12T01:36:11.192081+0000","last_fullsized":"2024-09-12T01:36:11.192081+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:43.749594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2221,"num_read_kb":2131,"num_write":417,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'201","reported_seq":885,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.794562+0000","last_change":"2024-09-12T00:25:00.478242+0000","last_active":"2024-09-12T01:37:38.794562+0000","last_peered":"2024-09-12T01:37:38.794562+0000","last_clean":"2024-09-12T01:37:38.794562+0000","last_became_active":"2024-09-12T00:25:00.477872+0000","last_became_peered":"2024-09-12T00:25:00.477872+0000","last_unstale":"2024-09-12T01:37:38.794562+0000","last_undegraded":"2024-09-12T01:37:38.794562+0000","last_fullsized":"2024-09-12T01:37:38.794562+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:04.405196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590195,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":9353,"num_write":799,"num_write_kb":34820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'478","reported_seq":1981,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.192692+0000","last_change":"2024-09-12T00:25:02.468462+0000","last_active":"2024-09-12T01:36:11.192692+0000","last_peered":"2024-09-12T01:36:11.192692+0000","last_clean":"2024-09-12T01:36:11.192692+0000","last_became_active":"2024-09-12T00:25:02.468180+0000","last_became_peered":"2024-09-12T00:25:02.468180+0000","last_unstale":"2024-09-12T01:36:11.192692+0000","last_undegraded":"2024-09-12T01:36:11.192692+0000","last_fullsized":"2024-09-12T01:36:11.192692+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:04.921278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2321,"num_read_kb":2166,"num_write":540,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'179","reported_seq":788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.683516+0000","last_change":"2024-09-12T00:25:00.472077+0000","last_active":"2024-09-12T01:37:38.683516+0000","last_peered":"2024-09-12T01:37:38.683516+0000","last_clean":"2024-09-12T01:37:38.683516+0000","last_became_active":"2024-09-12T00:25:00.471412+0000","last_became_peered":"2024-09-12T00:25:00.471412+0000","last_unstale":"2024-09-12T01:37:38.683516+0000","last_undegraded":"2024-09-12T01:37:38.683516+0000","last_fullsized":"2024-09-12T01:37:38.683516+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:10.903274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432317,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":354,"num_read_kb":25493,"num_write":898,"num_write_kb":19511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'498","reported_seq":2184,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.646707+0000","last_change":"2024-09-12T00:25:02.469514+0000","last_active":"2024-09-12T01:35:23.646707+0000","last_peered":"2024-09-12T01:35:23.646707+0000","last_clean":"2024-09-12T01:35:23.646707+0000","last_became_active":"2024-09-12T00:25:02.469251+0000","last_became_peered":"2024-09-12T00:25:02.469251+0000","last_unstale":"2024-09-12T01:35:23.646707+0000","last_undegraded":"2024-09-12T01:35:23.646707+0000","last_fullsized":"2024-09-12T01:35:23.646707+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:47.158487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2750,"num_read_kb":2605,"num_write":624,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'206","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.814127+0000","last_change":"2024-09-12T00:25:00.467331+0000","last_active":"2024-09-12T01:37:38.814127+0000","last_peered":"2024-09-12T01:37:38.814127+0000","last_clean":"2024-09-12T01:37:38.814127+0000","last_became_active":"2024-09-12T00:25:00.466945+0000","last_became_peered":"2024-09-12T00:25:00.466945+0000","last_unstale":"2024-09-12T01:37:38.814127+0000","last_undegraded":"2024-09-12T01:37:38.814127+0000","last_fullsized":"2024-09-12T01:37:38.814127+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:39.900588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":18851,"num_write":965,"num_write_kb":35048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'496","reported_seq":2036,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.880849+0000","last_change":"2024-09-12T00:25:02.475541+0000","last_active":"2024-09-12T01:35:08.880849+0000","last_peered":"2024-09-12T01:35:08.880849+0000","last_clean":"2024-09-12T01:35:08.880849+0000","last_became_active":"2024-09-12T00:25:02.475225+0000","last_became_peered":"2024-09-12T00:25:02.475225+0000","last_unstale":"2024-09-12T01:35:08.880849+0000","last_undegraded":"2024-09-12T01:35:08.880849+0000","last_fullsized":"2024-09-12T01:35:08.880849+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.705825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2326,"num_write":604,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'195","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.848872+0000","last_change":"2024-09-12T00:25:00.468589+0000","last_active":"2024-09-12T01:37:38.848872+0000","last_peered":"2024-09-12T01:37:38.848872+0000","last_clean":"2024-09-12T01:37:38.848872+0000","last_became_active":"2024-09-12T00:25:00.468245+0000","last_became_peered":"2024-09-12T00:25:00.468245+0000","last_unstale":"2024-09-12T01:37:38.848872+0000","last_undegraded":"2024-09-12T01:37:38.848872+0000","last_fullsized":"2024-09-12T01:37:38.848872+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:59.481921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":27275,"num_write":960,"num_write_kb":19137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'527","reported_seq":2284,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:53.479407+0000","last_change":"2024-09-12T00:25:02.469328+0000","last_active":"2024-09-12T01:34:53.479407+0000","last_peered":"2024-09-12T01:34:53.479407+0000","last_clean":"2024-09-12T01:34:53.479407+0000","last_became_active":"2024-09-12T00:25:02.469044+0000","last_became_peered":"2024-09-12T00:25:02.469044+0000","last_unstale":"2024-09-12T01:34:53.479407+0000","last_undegraded":"2024-09-12T01:34:53.479407+0000","last_fullsized":"2024-09-12T01:34:53.479407+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:12.185074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2889,"num_read_kb":2724,"num_write":624,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'185","reported_seq":810,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.811056+0000","last_change":"2024-09-12T00:25:00.487875+0000","last_active":"2024-09-12T01:37:38.811056+0000","last_peered":"2024-09-12T01:37:38.811056+0000","last_clean":"2024-09-12T01:37:38.811056+0000","last_became_active":"2024-09-12T00:25:00.487526+0000","last_became_peered":"2024-09-12T00:25:00.487526+0000","last_unstale":"2024-09-12T01:37:38.811056+0000","last_undegraded":"2024-09-12T01:37:38.811056+0000","last_fullsized":"2024-09-12T01:37:38.811056+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:49.142939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306655,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":3010,"num_write":923,"num_write_kb":19090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1186","reported_seq":2778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.404544+0000","last_change":"2024-09-12T00:25:02.465875+0000","last_active":"2024-09-12T01:37:18.404544+0000","last_peered":"2024-09-12T01:37:18.404544+0000","last_clean":"2024-09-12T01:37:18.404544+0000","last_became_active":"2024-09-12T00:25:02.465257+0000","last_became_peered":"2024-09-12T00:25:02.465257+0000","last_unstale":"2024-09-12T01:37:18.404544+0000","last_undegraded":"2024-09-12T01:37:18.404544+0000","last_fullsized":"2024-09-12T01:37:18.404544+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:04.981975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5507,"num_read_kb":4876,"num_write":1621,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'262","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.593553+0000","last_change":"2024-09-12T00:25:00.469603+0000","last_active":"2024-09-12T01:37:38.593553+0000","last_peered":"2024-09-12T01:37:38.593553+0000","last_clean":"2024-09-12T01:37:38.593553+0000","last_became_active":"2024-09-12T00:25:00.469159+0000","last_became_peered":"2024-09-12T00:25:00.469159+0000","last_unstale":"2024-09-12T01:37:38.593553+0000","last_undegraded":"2024-09-12T01:37:38.593553+0000","last_fullsized":"2024-09-12T01:37:38.593553+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:29.592131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":57821,"num_write":1101,"num_write_kb":41989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'486","reported_seq":1921,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123191+0000","last_change":"2024-09-12T00:25:02.470885+0000","last_active":"2024-09-12T01:35:05.123191+0000","last_peered":"2024-09-12T01:35:05.123191+0000","last_clean":"2024-09-12T01:35:05.123191+0000","last_became_active":"2024-09-12T00:25:02.470623+0000","last_became_peered":"2024-09-12T00:25:02.470623+0000","last_unstale":"2024-09-12T01:35:05.123191+0000","last_undegraded":"2024-09-12T01:35:05.123191+0000","last_fullsized":"2024-09-12T01:35:05.123191+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:25.739488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2404,"num_read_kb":2207,"num_write":594,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'242","reported_seq":907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.778318+0000","last_change":"2024-09-12T00:25:00.470643+0000","last_active":"2024-09-12T01:37:38.778318+0000","last_peered":"2024-09-12T01:37:38.778318+0000","last_clean":"2024-09-12T01:37:38.778318+0000","last_became_active":"2024-09-12T00:25:00.469918+0000","last_became_peered":"2024-09-12T00:25:00.469918+0000","last_unstale":"2024-09-12T01:37:38.778318+0000","last_undegraded":"2024-09-12T01:37:38.778318+0000","last_fullsized":"2024-09-12T01:37:38.778318+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:08.268473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":488,"num_read_kb":51750,"num_write":1103,"num_write_kb":39694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'612","reported_seq":2412,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801716+0000","last_change":"2024-09-12T00:25:02.476152+0000","last_active":"2024-09-12T01:35:34.801716+0000","last_peered":"2024-09-12T01:35:34.801716+0000","last_clean":"2024-09-12T01:35:34.801716+0000","last_became_active":"2024-09-12T00:25:02.475864+0000","last_became_peered":"2024-09-12T00:25:02.475864+0000","last_unstale":"2024-09-12T01:35:34.801716+0000","last_undegraded":"2024-09-12T01:35:34.801716+0000","last_fullsized":"2024-09-12T01:35:34.801716+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:31.109147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3105,"num_read_kb":2885,"num_write":734,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'287","reported_seq":986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.874176+0000","last_change":"2024-09-12T00:25:00.468654+0000","last_active":"2024-09-12T01:37:38.874176+0000","last_peered":"2024-09-12T01:37:38.874176+0000","last_clean":"2024-09-12T01:37:38.874176+0000","last_became_active":"2024-09-12T00:25:00.468228+0000","last_became_peered":"2024-09-12T00:25:00.468228+0000","last_unstale":"2024-09-12T01:37:38.874176+0000","last_undegraded":"2024-09-12T01:37:38.874176+0000","last_fullsized":"2024-09-12T01:37:38.874176+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:04.194595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":681,"num_read_kb":67032,"num_write":1230,"num_write_kb":28377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'949","reported_seq":2514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.490891+0000","last_change":"2024-09-12T00:25:02.476025+0000","last_active":"2024-09-12T01:35:23.490891+0000","last_peered":"2024-09-12T01:35:23.490891+0000","last_clean":"2024-09-12T01:35:23.490891+0000","last_became_active":"2024-09-12T00:25:02.473441+0000","last_became_peered":"2024-09-12T00:25:02.473441+0000","last_unstale":"2024-09-12T01:35:23.490891+0000","last_undegraded":"2024-09-12T01:35:23.490891+0000","last_fullsized":"2024-09-12T01:35:23.490891+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:50.101335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4462,"num_read_kb":3929,"num_write":1316,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'215","reported_seq":868,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.733268+0000","last_change":"2024-09-12T00:25:00.465738+0000","last_active":"2024-09-12T01:37:38.733268+0000","last_peered":"2024-09-12T01:37:38.733268+0000","last_clean":"2024-09-12T01:37:38.733268+0000","last_became_active":"2024-09-12T00:25:00.465127+0000","last_became_peered":"2024-09-12T00:25:00.465127+0000","last_unstale":"2024-09-12T01:37:38.733268+0000","last_undegraded":"2024-09-12T01:37:38.733268+0000","last_fullsized":"2024-09-12T01:37:38.733268+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:37.553300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":16638,"num_write":1049,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'828","reported_seq":2449,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.834057+0000","last_change":"2024-09-12T00:25:02.464676+0000","last_active":"2024-09-12T01:35:16.834057+0000","last_peered":"2024-09-12T01:35:16.834057+0000","last_clean":"2024-09-12T01:35:16.834057+0000","last_became_active":"2024-09-12T00:25:02.464386+0000","last_became_peered":"2024-09-12T00:25:02.464386+0000","last_unstale":"2024-09-12T01:35:16.834057+0000","last_undegraded":"2024-09-12T01:35:16.834057+0000","last_fullsized":"2024-09-12T01:35:16.834057+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:41.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3522,"num_write":1059,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'163","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:47.249575+0000","last_change":"2024-09-12T00:25:00.465954+0000","last_active":"2024-09-12T01:34:47.249575+0000","last_peered":"2024-09-12T01:34:47.249575+0000","last_clean":"2024-09-12T01:34:47.249575+0000","last_became_active":"2024-09-12T00:25:00.465400+0000","last_became_peered":"2024-09-12T00:25:00.465400+0000","last_unstale":"2024-09-12T01:34:47.249575+0000","last_undegraded":"2024-09-12T01:34:47.249575+0000","last_fullsized":"2024-09-12T01:34:47.249575+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":100,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:52.577671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1079914,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":437,"num_read_kb":4582,"num_write":825,"num_write_kb":26519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'779","reported_seq":2416,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194962+0000","last_change":"2024-09-12T00:25:02.469311+0000","last_active":"2024-09-12T01:36:11.194962+0000","last_peered":"2024-09-12T01:36:11.194962+0000","last_clean":"2024-09-12T01:36:11.194962+0000","last_became_active":"2024-09-12T00:25:02.469046+0000","last_became_peered":"2024-09-12T00:25:02.469046+0000","last_unstale":"2024-09-12T01:36:11.194962+0000","last_undegraded":"2024-09-12T01:36:11.194962+0000","last_fullsized":"2024-09-12T01:36:11.194962+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.426796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3834,"num_read_kb":3478,"num_write":1008,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'208","reported_seq":878,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.757693+0000","last_change":"2024-09-12T00:25:00.469566+0000","last_active":"2024-09-12T01:37:38.757693+0000","last_peered":"2024-09-12T01:37:38.757693+0000","last_clean":"2024-09-12T01:37:38.757693+0000","last_became_active":"2024-09-12T00:25:00.468581+0000","last_became_peered":"2024-09-12T00:25:00.468581+0000","last_unstale":"2024-09-12T01:37:38.757693+0000","last_undegraded":"2024-09-12T01:37:38.757693+0000","last_fullsized":"2024-09-12T01:37:38.757693+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:58.853274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323902,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":48643,"num_write":1011,"num_write_kb":19361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'797","reported_seq":2362,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.397154+0000","last_change":"2024-09-12T00:25:02.477178+0000","last_active":"2024-09-12T01:37:18.397154+0000","last_peered":"2024-09-12T01:37:18.397154+0000","last_clean":"2024-09-12T01:37:18.397154+0000","last_became_active":"2024-09-12T00:25:02.476825+0000","last_became_peered":"2024-09-12T00:25:02.476825+0000","last_unstale":"2024-09-12T01:37:18.397154+0000","last_undegraded":"2024-09-12T01:37:18.397154+0000","last_fullsized":"2024-09-12T01:37:18.397154+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:53.361725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3888,"num_read_kb":3500,"num_write":1075,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'188","reported_seq":864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.754796+0000","last_change":"2024-09-12T00:25:00.480493+0000","last_active":"2024-09-12T01:37:38.754796+0000","last_peered":"2024-09-12T01:37:38.754796+0000","last_clean":"2024-09-12T01:37:38.754796+0000","last_became_active":"2024-09-12T00:25:00.480122+0000","last_became_peered":"2024-09-12T00:25:00.480122+0000","last_unstale":"2024-09-12T01:37:38.754796+0000","last_undegraded":"2024-09-12T01:37:38.754796+0000","last_fullsized":"2024-09-12T01:37:38.754796+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:57.940376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399183,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":553,"num_read_kb":7914,"num_write":895,"num_write_kb":29144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'690","reported_seq":2144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.193773+0000","last_change":"2024-09-12T00:25:02.467034+0000","last_active":"2024-09-12T01:36:11.193773+0000","last_peered":"2024-09-12T01:36:11.193773+0000","last_clean":"2024-09-12T01:36:11.193773+0000","last_became_active":"2024-09-12T00:25:02.465790+0000","last_became_peered":"2024-09-12T00:25:02.465790+0000","last_unstale":"2024-09-12T01:36:11.193773+0000","last_undegraded":"2024-09-12T01:36:11.193773+0000","last_fullsized":"2024-09-12T01:36:11.193773+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:47.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3268,"num_read_kb":2971,"num_write":903,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'258","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.806913+0000","last_change":"2024-09-12T00:25:00.469984+0000","last_active":"2024-09-12T01:37:38.806913+0000","last_peered":"2024-09-12T01:37:38.806913+0000","last_clean":"2024-09-12T01:37:38.806913+0000","last_became_active":"2024-09-12T00:25:00.469634+0000","last_became_peered":"2024-09-12T00:25:00.469634+0000","last_unstale":"2024-09-12T01:37:38.806913+0000","last_undegraded":"2024-09-12T01:37:38.806913+0000","last_fullsized":"2024-09-12T01:37:38.806913+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:05.806256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155756,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1718,"num_write":1162,"num_write_kb":27079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'434","reported_seq":2042,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.340373+0000","last_change":"2024-09-12T00:25:02.465571+0000","last_active":"2024-09-12T01:36:12.340373+0000","last_peered":"2024-09-12T01:36:12.340373+0000","last_clean":"2024-09-12T01:36:12.340373+0000","last_became_active":"2024-09-12T00:25:02.464112+0000","last_became_peered":"2024-09-12T00:25:02.464112+0000","last_unstale":"2024-09-12T01:36:12.340373+0000","last_undegraded":"2024-09-12T01:36:12.340373+0000","last_fullsized":"2024-09-12T01:36:12.340373+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:22.009640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2410,"num_read_kb":2284,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'226","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.812901+0000","last_change":"2024-09-12T00:25:00.469057+0000","last_active":"2024-09-12T01:37:38.812901+0000","last_peered":"2024-09-12T01:37:38.812901+0000","last_clean":"2024-09-12T01:37:38.812901+0000","last_became_active":"2024-09-12T00:25:00.468600+0000","last_became_peered":"2024-09-12T00:25:00.468600+0000","last_unstale":"2024-09-12T01:37:38.812901+0000","last_undegraded":"2024-09-12T01:37:38.812901+0000","last_fullsized":"2024-09-12T01:37:38.812901+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:05.715126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133763,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":7263,"num_write":1147,"num_write_kb":27569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'182","reported_seq":826,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.881632+0000","last_change":"2024-09-12T00:25:00.470300+0000","last_active":"2024-09-12T01:37:38.881632+0000","last_peered":"2024-09-12T01:37:38.881632+0000","last_clean":"2024-09-12T01:37:38.881632+0000","last_became_active":"2024-09-12T00:25:00.469382+0000","last_became_peered":"2024-09-12T00:25:00.469382+0000","last_unstale":"2024-09-12T01:37:38.881632+0000","last_undegraded":"2024-09-12T01:37:38.881632+0000","last_fullsized":"2024-09-12T01:37:38.881632+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:57.619429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":14411,"num_write":860,"num_write_kb":23706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'916","reported_seq":2485,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.307264+0000","last_change":"2024-09-12T00:25:02.475301+0000","last_active":"2024-09-12T01:36:12.307264+0000","last_peered":"2024-09-12T01:36:12.307264+0000","last_clean":"2024-09-12T01:36:12.307264+0000","last_became_active":"2024-09-12T00:25:02.475004+0000","last_became_peered":"2024-09-12T00:25:02.475004+0000","last_unstale":"2024-09-12T01:36:12.307264+0000","last_undegraded":"2024-09-12T01:36:12.307264+0000","last_fullsized":"2024-09-12T01:36:12.307264+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:17.094814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4224,"num_read_kb":3778,"num_write":1247,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'230","reported_seq":955,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.829157+0000","last_change":"2024-09-12T00:25:00.472266+0000","last_active":"2024-09-12T01:37:38.829157+0000","last_peered":"2024-09-12T01:37:38.829157+0000","last_clean":"2024-09-12T01:37:38.829157+0000","last_became_active":"2024-09-12T00:25:00.471411+0000","last_became_peered":"2024-09-12T00:25:00.471411+0000","last_unstale":"2024-09-12T01:37:38.829157+0000","last_undegraded":"2024-09-12T01:37:38.829157+0000","last_fullsized":"2024-09-12T01:37:38.829157+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:34.132087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323861,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":157504,"num_write":954,"num_write_kb":45267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'647","reported_seq":2390,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194867+0000","last_change":"2024-09-12T00:25:02.463284+0000","last_active":"2024-09-12T01:36:11.194867+0000","last_peered":"2024-09-12T01:36:11.194867+0000","last_clean":"2024-09-12T01:36:11.194867+0000","last_became_active":"2024-09-12T00:25:02.462993+0000","last_became_peered":"2024-09-12T00:25:02.462993+0000","last_unstale":"2024-09-12T01:36:11.194867+0000","last_undegraded":"2024-09-12T01:36:11.194867+0000","last_fullsized":"2024-09-12T01:36:11.194867+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":600,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:48.709170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3586,"num_read_kb":3293,"num_write":883,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5955,"num_read_kb":4160,"num_write":1937,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15084,"num_read_kb":14735,"num_write":16735,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1466,"ondisk_log_size":1466,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":676,"ondisk_log_size":676,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":336770,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":10142,"num_read_kb":12264,"num_write":7067,"num_write_kb":3077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":348160,"data_stored":35052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1759,"ondisk_log_size":1759,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2370,"num_read_kb":2830,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212728,"num_read_kb":194072,"num_write":55276,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4200,"ondisk_log_size":4200,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":110421795,"num_objects":264,"num_object_clones":0,"num_object_copies":1056,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":264,"num_whiteouts":0,"num_read":33223,"num_read_kb":1810762,"num_write":62781,"num_write_kb":1904228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":149446656,"data_stored":149446656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4078,"ondisk_log_size":4078,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":165,"num_read_kb":174385,"num_write":181,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":14671872,"data_stored":14671872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":1056768,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":162,"num_read_kb":174274,"num_write":181,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":6303744,"data_stored":6302855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":121,"ondisk_log_size":121,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477619,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141144,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94230696,"statfs":{"total":96636764160,"available":96492232704,"internally_reserved":0,"allocated":15908864,"data_stored":13922526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477617,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136116,"kb_used_data":24360,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94235724,"statfs":{"total":96636764160,"available":96497381376,"internally_reserved":0,"allocated":24944640,"data_stored":22945833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424510322,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214348,"kb_used_data":16580,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94157492,"statfs":{"total":96636764160,"available":96417271808,"internally_reserved":0,"allocated":16977920,"data_stored":14990871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510320,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":182772,"kb_used_data":93284,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94189068,"statfs":{"total":96636764160,"available":96449605632,"internally_reserved":0,"allocated":95522816,"data_stored":93475520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510321,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":343852,"kb_used_data":101660,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94027988,"statfs":{"total":96636764160,"available":96284659712,"internally_reserved":0,"allocated":104099840,"data_stored":102057947,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":247986629},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510322,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253136,"kb_used_data":19216,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94118704,"statfs":{"total":96636764160,"available":96377552896,"internally_reserved":0,"allocated":19677184,"data_stored":17673901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510322,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":307928,"kb_used_data":33752,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94063912,"statfs":{"total":96636764160,"available":96321445888,"internally_reserved":0,"allocated":34562048,"data_stored":32541409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575733,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":242824,"kb_used_data":77048,"kb_used_omap":1,"kb_used_meta":165758,"kb_avail":94129016,"statfs":{"total":96636764160,"available":96388112384,"internally_reserved":0,"allocated":78897152,"data_stored":76859945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":169736645},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20709376,"data_stored":20709376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12632064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11685888,"data_stored":11685888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15437824,"data_stored":15437824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":53620736,"data_stored":53620736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9035776,"data_stored":9035776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13570048,"data_stored":13570048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12754944,"data_stored":12754944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":28638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":6303744,"data_stored":6302855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":14671872,"data_stored":14671872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:37:41.489 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T01:37:41.832 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:37:41.832 INFO:teuthology.orchestra.run.smithi019.stdout:{"epoch":266,"fsid":"aacb94df-c940-42c4-9df9-171d09a84719","created":"2024-09-12T00:24:26.611771+0000","modified":"2024-09-12T01:02:04.902487+0000","last_up_change":"2024-09-12T00:24:39.174906+0000","last_in_change":"2024-09-12T00:24:28.999488+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":17,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:24:38.895187+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:24:45.050522+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:24:58.426682+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:25:00.799043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:25:02.632852+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:25:04.542741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:25:06.501825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"36","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:25:08.576284+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:39:16.149952+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:43:37.533937+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:43:41.806756+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T01:02:02.359424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"266","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"77c13442-d11f-4e3f-868c-505b5cf8df46","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6816","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6817","nonce":1125148903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6818","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6819","nonce":1125148903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6822","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6823","nonce":1125148903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6820","nonce":1125148903},{"type":"v1","addr":"172.21.15.19:6821","nonce":1125148903}]},"public_addr":"172.21.15.19:6817/1125148903","cluster_addr":"172.21.15.19:6819/1125148903","heartbeat_back_addr":"172.21.15.19:6823/1125148903","heartbeat_front_addr":"172.21.15.19:6821/1125148903","state":["exists","up"]},{"osd":1,"uuid":"ca603641-3174-4ed3-b0fd-d44e57874366","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6805","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6807","nonce":977330370}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6810","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6811","nonce":977330370}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6814","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6815","nonce":977330370}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6812","nonce":977330370},{"type":"v1","addr":"172.21.15.19:6813","nonce":977330370}]},"public_addr":"172.21.15.19:6807/977330370","cluster_addr":"172.21.15.19:6811/977330370","heartbeat_back_addr":"172.21.15.19:6815/977330370","heartbeat_front_addr":"172.21.15.19:6813/977330370","state":["exists","up"]},{"osd":2,"uuid":"8e067835-c65a-4149-926f-e1eb237e089a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6800","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6801","nonce":3407245840}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6802","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6803","nonce":3407245840}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6808","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6809","nonce":3407245840}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6804","nonce":3407245840},{"type":"v1","addr":"172.21.15.19:6806","nonce":3407245840}]},"public_addr":"172.21.15.19:6801/3407245840","cluster_addr":"172.21.15.19:6803/3407245840","heartbeat_back_addr":"172.21.15.19:6809/3407245840","heartbeat_front_addr":"172.21.15.19:6806/3407245840","state":["exists","up"]},{"osd":3,"uuid":"1f0803eb-011d-4af9-867b-dd6dddd1b729","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6824","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6825","nonce":737061592}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6826","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6827","nonce":737061592}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6830","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6831","nonce":737061592}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.19:6828","nonce":737061592},{"type":"v1","addr":"172.21.15.19:6829","nonce":737061592}]},"public_addr":"172.21.15.19:6825/737061592","cluster_addr":"172.21.15.19:6827/737061592","heartbeat_back_addr":"172.21.15.19:6831/737061592","heartbeat_front_addr":"172.21.15.19:6829/737061592","state":["exists","up"]},{"osd":4,"uuid":"144aeca4-2bde-407e-8074-3175188171fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6800","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6801","nonce":2991448734}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6802","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6803","nonce":2991448734}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6806","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6807","nonce":2991448734}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6804","nonce":2991448734},{"type":"v1","addr":"172.21.15.135:6805","nonce":2991448734}]},"public_addr":"172.21.15.135:6801/2991448734","cluster_addr":"172.21.15.135:6803/2991448734","heartbeat_back_addr":"172.21.15.135:6807/2991448734","heartbeat_front_addr":"172.21.15.135:6805/2991448734","state":["exists","up"]},{"osd":5,"uuid":"8fece5b1-bbfa-4083-9c22-d379c92bf125","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6808","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6809","nonce":43193093}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6810","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6811","nonce":43193093}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6814","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6815","nonce":43193093}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6812","nonce":43193093},{"type":"v1","addr":"172.21.15.135:6813","nonce":43193093}]},"public_addr":"172.21.15.135:6809/43193093","cluster_addr":"172.21.15.135:6811/43193093","heartbeat_back_addr":"172.21.15.135:6815/43193093","heartbeat_front_addr":"172.21.15.135:6813/43193093","state":["exists","up"]},{"osd":6,"uuid":"d15eb2dc-5b0f-4f9b-9d99-947ffb65caf3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6824","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6825","nonce":1074135986}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6826","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6827","nonce":1074135986}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6830","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6831","nonce":1074135986}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6828","nonce":1074135986},{"type":"v1","addr":"172.21.15.135:6829","nonce":1074135986}]},"public_addr":"172.21.15.135:6825/1074135986","cluster_addr":"172.21.15.135:6827/1074135986","heartbeat_back_addr":"172.21.15.135:6831/1074135986","heartbeat_front_addr":"172.21.15.135:6829/1074135986","state":["exists","up"]},{"osd":7,"uuid":"4c832964-8b83-46ac-9c23-fc3888c2fdab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6816","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6817","nonce":3292274812}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6818","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6819","nonce":3292274812}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6822","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6823","nonce":3292274812}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.135:6820","nonce":3292274812},{"type":"v1","addr":"172.21.15.135:6821","nonce":3292274812}]},"public_addr":"172.21.15.135:6817/3292274812","cluster_addr":"172.21.15.135:6819/3292274812","heartbeat_back_addr":"172.21.15.135:6823/3292274812","heartbeat_front_addr":"172.21.15.135:6821/3292274812","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.418615+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.146762+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.091427+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.366242+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:34.849335+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.259320+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:36.356984+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:24:35.864014+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.8","mappings":[{"from":2,"to":6}]},{"pgid":"3.a","mappings":[{"from":2,"to":5}]},{"pgid":"3.d","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T01:37:42.846 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T01:37:42.846 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:37:43.004 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:37:43.004 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:37:43.004 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:37:43.015 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T01:37:43.328 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T01:37:43.341 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T01:37:43.342 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:37:43.484 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:37:43.484 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:37:43.484 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:37:43.495 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T01:37:43.808 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T01:37:43.823 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T01:37:43.823 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:37:43.967 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:37:43.967 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:37:43.967 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:37:43.978 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T01:37:44.300 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T01:37:44.314 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T01:37:44.314 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:37:44.456 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:37:44.457 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:37:44.467 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T01:37:44.782 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T01:37:44.796 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T01:37:44.796 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:37:44.940 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:37:44.941 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:37:44.941 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:37:44.951 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T01:37:45.266 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T01:37:45.279 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T01:37:45.279 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:37:45.422 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:37:45.423 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:37:45.423 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:37:45.433 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T01:37:45.749 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T01:37:45.762 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T01:37:45.763 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:37:45.905 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:37:45.905 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:37:45.905 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:37:45.916 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T01:37:46.231 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T01:37:46.244 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T01:37:46.245 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T01:37:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:{ 2024-09-12T01:37:46.388 INFO:teuthology.orchestra.run.smithi019.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T01:37:46.388 INFO:teuthology.orchestra.run.smithi019.stdout:} 2024-09-12T01:37:46.399 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T01:37:46.716 INFO:teuthology.orchestra.run.smithi019.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T01:37:46.731 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:37:47.072 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:37:47.084 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:37:47.086 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":2453,"stamp":"2024-09-12T01:37:46.769502+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80473315,"num_objects":722,"num_object_clones":0,"num_object_copies":1914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":279991,"num_read_kb":2387663,"num_write":144355,"num_write_kb":2165314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13579,"ondisk_log_size":13579,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1586796,"kb_used_data":140392,"kb_used_omap":12,"kb_used_meta":1445875,"kb_avail":753387924,"statfs":{"total":773094113280,"available":771469234176,"internally_reserved":0,"allocated":143761408,"data_stored":127764298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1480576560},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-394099769,"num_objects":-330,"num_object_clones":0,"num_object_copies":-1216,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-330,"num_whiteouts":0,"num_read":658,"num_read_kb":701,"num_write":486,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005915"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.977721+0000","last_change":"2024-09-12T01:02:03.926254+0000","last_active":"2024-09-12T01:34:34.977721+0000","last_peered":"2024-09-12T01:34:34.977721+0000","last_clean":"2024-09-12T01:34:34.977721+0000","last_became_active":"2024-09-12T01:02:03.925687+0000","last_became_peered":"2024-09-12T01:02:03.925687+0000","last_unstale":"2024-09-12T01:34:34.977721+0000","last_undegraded":"2024-09-12T01:34:34.977721+0000","last_fullsized":"2024-09-12T01:34:34.977721+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:25.162167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"266'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:14.095890+0000","last_change":"2024-09-12T00:43:43.813662+0000","last_active":"2024-09-12T01:36:14.095890+0000","last_peered":"2024-09-12T01:36:14.095890+0000","last_clean":"2024-09-12T01:36:14.095890+0000","last_became_active":"2024-09-12T00:43:43.812701+0000","last_became_peered":"2024-09-12T00:43:43.812701+0000","last_unstale":"2024-09-12T01:36:14.095890+0000","last_undegraded":"2024-09-12T01:36:14.095890+0000","last_fullsized":"2024-09-12T01:36:14.095890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:32.083600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.110512+0000","last_change":"2024-09-12T00:43:38.799582+0000","last_active":"2024-09-12T01:33:40.110512+0000","last_peered":"2024-09-12T01:33:40.110512+0000","last_clean":"2024-09-12T01:33:40.110512+0000","last_became_active":"2024-09-12T00:43:38.799322+0000","last_became_peered":"2024-09-12T00:43:38.799322+0000","last_unstale":"2024-09-12T01:33:40.110512+0000","last_undegraded":"2024-09-12T01:33:40.110512+0000","last_fullsized":"2024-09-12T01:33:40.110512+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:52.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.256826+0000","last_change":"2024-09-12T00:39:17.764042+0000","last_active":"2024-09-12T01:35:32.256826+0000","last_peered":"2024-09-12T01:35:32.256826+0000","last_clean":"2024-09-12T01:35:32.256826+0000","last_became_active":"2024-09-12T00:39:17.763761+0000","last_became_peered":"2024-09-12T00:39:17.763761+0000","last_unstale":"2024-09-12T01:35:32.256826+0000","last_undegraded":"2024-09-12T01:35:32.256826+0000","last_fullsized":"2024-09-12T01:35:32.256826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:49.430258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.175890+0000","last_change":"2024-09-12T01:02:03.925619+0000","last_active":"2024-09-12T01:34:34.175890+0000","last_peered":"2024-09-12T01:34:34.175890+0000","last_clean":"2024-09-12T01:34:34.175890+0000","last_became_active":"2024-09-12T01:02:03.925338+0000","last_became_peered":"2024-09-12T01:02:03.925338+0000","last_unstale":"2024-09-12T01:34:34.175890+0000","last_undegraded":"2024-09-12T01:34:34.175890+0000","last_fullsized":"2024-09-12T01:34:34.175890+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:34.463430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"266'5","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:15.095648+0000","last_change":"2024-09-12T00:43:43.822539+0000","last_active":"2024-09-12T01:36:15.095648+0000","last_peered":"2024-09-12T01:36:15.095648+0000","last_clean":"2024-09-12T01:36:15.095648+0000","last_became_active":"2024-09-12T00:43:43.822189+0000","last_became_peered":"2024-09-12T00:43:43.822189+0000","last_unstale":"2024-09-12T01:36:15.095648+0000","last_undegraded":"2024-09-12T01:36:15.095648+0000","last_fullsized":"2024-09-12T01:36:15.095648+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:14.331070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987382+0000","last_change":"2024-09-12T00:43:38.794157+0000","last_active":"2024-09-12T01:33:38.987382+0000","last_peered":"2024-09-12T01:33:38.987382+0000","last_clean":"2024-09-12T01:33:38.987382+0000","last_became_active":"2024-09-12T00:43:38.793866+0000","last_became_peered":"2024-09-12T00:43:38.793866+0000","last_unstale":"2024-09-12T01:33:38.987382+0000","last_undegraded":"2024-09-12T01:33:38.987382+0000","last_fullsized":"2024-09-12T01:33:38.987382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:51.874866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'33","reported_seq":147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256146+0000","last_change":"2024-09-12T00:39:17.769275+0000","last_active":"2024-09-12T01:35:27.256146+0000","last_peered":"2024-09-12T01:35:27.256146+0000","last_clean":"2024-09-12T01:35:27.256146+0000","last_became_active":"2024-09-12T00:39:17.768977+0000","last_became_peered":"2024-09-12T00:39:17.768977+0000","last_unstale":"2024-09-12T01:35:27.256146+0000","last_undegraded":"2024-09-12T01:35:27.256146+0000","last_fullsized":"2024-09-12T01:35:27.256146+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:10.855870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":119,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.078422+0000","last_change":"2024-09-12T01:02:03.922480+0000","last_active":"2024-09-12T01:33:29.078422+0000","last_peered":"2024-09-12T01:33:29.078422+0000","last_clean":"2024-09-12T01:33:29.078422+0000","last_became_active":"2024-09-12T01:02:03.921938+0000","last_became_peered":"2024-09-12T01:02:03.921938+0000","last_unstale":"2024-09-12T01:33:29.078422+0000","last_undegraded":"2024-09-12T01:33:29.078422+0000","last_fullsized":"2024-09-12T01:33:29.078422+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:49.013238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"266'6","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.008891+0000","last_change":"2024-09-12T00:43:43.814192+0000","last_active":"2024-09-12T01:35:49.008891+0000","last_peered":"2024-09-12T01:35:49.008891+0000","last_clean":"2024-09-12T01:35:49.008891+0000","last_became_active":"2024-09-12T00:43:43.813568+0000","last_became_peered":"2024-09-12T00:43:43.813568+0000","last_unstale":"2024-09-12T01:35:49.008891+0000","last_undegraded":"2024-09-12T01:35:49.008891+0000","last_fullsized":"2024-09-12T01:35:49.008891+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:58.958483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7172,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'7","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.129688+0000","last_change":"2024-09-12T00:43:38.797811+0000","last_active":"2024-09-12T01:35:50.129688+0000","last_peered":"2024-09-12T01:35:50.129688+0000","last_clean":"2024-09-12T01:35:50.129688+0000","last_became_active":"2024-09-12T00:43:38.797520+0000","last_became_peered":"2024-09-12T00:43:38.797520+0000","last_unstale":"2024-09-12T01:35:50.129688+0000","last_undegraded":"2024-09-12T01:35:50.129688+0000","last_fullsized":"2024-09-12T01:35:50.129688+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:56.953531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16390,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'41","reported_seq":171,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173586+0000","last_change":"2024-09-12T00:39:17.769080+0000","last_active":"2024-09-12T01:34:19.173586+0000","last_peered":"2024-09-12T01:34:19.173586+0000","last_clean":"2024-09-12T01:34:19.173586+0000","last_became_active":"2024-09-12T00:39:17.768692+0000","last_became_peered":"2024-09-12T00:39:17.768692+0000","last_unstale":"2024-09-12T01:34:19.173586+0000","last_undegraded":"2024-09-12T01:34:19.173586+0000","last_fullsized":"2024-09-12T01:34:19.173586+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:43.550430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":161,"num_write":65,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987313+0000","last_change":"2024-09-12T01:02:03.922647+0000","last_active":"2024-09-12T01:33:38.987313+0000","last_peered":"2024-09-12T01:33:38.987313+0000","last_clean":"2024-09-12T01:33:38.987313+0000","last_became_active":"2024-09-12T01:02:03.922297+0000","last_became_peered":"2024-09-12T01:02:03.922297+0000","last_unstale":"2024-09-12T01:33:38.987313+0000","last_undegraded":"2024-09-12T01:33:38.987313+0000","last_fullsized":"2024-09-12T01:33:38.987313+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:53.989667+0000","last_change":"2024-09-12T00:43:43.819023+0000","last_active":"2024-09-12T01:33:53.989667+0000","last_peered":"2024-09-12T01:33:53.989667+0000","last_clean":"2024-09-12T01:33:53.989667+0000","last_became_active":"2024-09-12T00:43:43.818668+0000","last_became_peered":"2024-09-12T00:43:43.818668+0000","last_unstale":"2024-09-12T01:33:53.989667+0000","last_undegraded":"2024-09-12T01:33:53.989667+0000","last_fullsized":"2024-09-12T01:33:53.989667+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:45.138160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.079562+0000","last_change":"2024-09-12T00:43:38.795677+0000","last_active":"2024-09-12T01:33:39.079562+0000","last_peered":"2024-09-12T01:33:39.079562+0000","last_clean":"2024-09-12T01:33:39.079562+0000","last_became_active":"2024-09-12T00:43:38.794121+0000","last_became_peered":"2024-09-12T00:43:38.794121+0000","last_unstale":"2024-09-12T01:33:39.079562+0000","last_undegraded":"2024-09-12T01:33:39.079562+0000","last_fullsized":"2024-09-12T01:33:39.079562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:33.638934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'16","reported_seq":93,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173559+0000","last_change":"2024-09-12T00:39:17.759626+0000","last_active":"2024-09-12T01:34:19.173559+0000","last_peered":"2024-09-12T01:34:19.173559+0000","last_clean":"2024-09-12T01:34:19.173559+0000","last_became_active":"2024-09-12T00:39:17.759016+0000","last_became_peered":"2024-09-12T00:39:17.759016+0000","last_unstale":"2024-09-12T01:34:19.173559+0000","last_undegraded":"2024-09-12T01:34:19.173559+0000","last_fullsized":"2024-09-12T01:34:19.173559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:25.380216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:15.115873+0000","last_change":"2024-09-12T01:02:03.919665+0000","last_active":"2024-09-12T01:34:15.115873+0000","last_peered":"2024-09-12T01:34:15.115873+0000","last_clean":"2024-09-12T01:34:15.115873+0000","last_became_active":"2024-09-12T01:02:03.919293+0000","last_became_peered":"2024-09-12T01:02:03.919293+0000","last_unstale":"2024-09-12T01:34:15.115873+0000","last_undegraded":"2024-09-12T01:34:15.115873+0000","last_fullsized":"2024-09-12T01:34:15.115873+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:31.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.978417+0000","last_change":"2024-09-12T00:43:43.818041+0000","last_active":"2024-09-12T01:34:39.978417+0000","last_peered":"2024-09-12T01:34:39.978417+0000","last_clean":"2024-09-12T01:34:39.978417+0000","last_became_active":"2024-09-12T00:43:43.817714+0000","last_became_peered":"2024-09-12T00:43:43.817714+0000","last_unstale":"2024-09-12T01:34:39.978417+0000","last_undegraded":"2024-09-12T01:34:39.978417+0000","last_fullsized":"2024-09-12T01:34:39.978417+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:15.291037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'15","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:49.017973+0000","last_change":"2024-09-12T00:43:38.795483+0000","last_active":"2024-09-12T01:36:49.017973+0000","last_peered":"2024-09-12T01:36:49.017973+0000","last_clean":"2024-09-12T01:36:49.017973+0000","last_became_active":"2024-09-12T00:43:38.795206+0000","last_became_peered":"2024-09-12T00:43:38.795206+0000","last_unstale":"2024-09-12T01:36:49.017973+0000","last_undegraded":"2024-09-12T01:36:49.017973+0000","last_fullsized":"2024-09-12T01:36:49.017973+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:51.351578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":29708,"num_write":20,"num_write_kb":14332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'31","reported_seq":144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173515+0000","last_change":"2024-09-12T00:39:17.762663+0000","last_active":"2024-09-12T01:34:19.173515+0000","last_peered":"2024-09-12T01:34:19.173515+0000","last_clean":"2024-09-12T01:34:19.173515+0000","last_became_active":"2024-09-12T00:39:17.762124+0000","last_became_peered":"2024-09-12T00:39:17.762124+0000","last_unstale":"2024-09-12T01:34:19.173515+0000","last_undegraded":"2024-09-12T01:34:19.173515+0000","last_fullsized":"2024-09-12T01:34:19.173515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:55.240200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256179+0000","last_change":"2024-09-12T01:02:03.915670+0000","last_active":"2024-09-12T01:35:27.256179+0000","last_peered":"2024-09-12T01:35:27.256179+0000","last_clean":"2024-09-12T01:35:27.256179+0000","last_became_active":"2024-09-12T01:02:03.915387+0000","last_became_peered":"2024-09-12T01:02:03.915387+0000","last_unstale":"2024-09-12T01:35:27.256179+0000","last_undegraded":"2024-09-12T01:35:27.256179+0000","last_fullsized":"2024-09-12T01:35:27.256179+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:30.278716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529511+0000","last_change":"2024-09-12T00:43:43.825343+0000","last_active":"2024-09-12T01:34:29.529511+0000","last_peered":"2024-09-12T01:34:29.529511+0000","last_clean":"2024-09-12T01:34:29.529511+0000","last_became_active":"2024-09-12T00:43:43.825054+0000","last_became_peered":"2024-09-12T00:43:43.825054+0000","last_unstale":"2024-09-12T01:34:29.529511+0000","last_undegraded":"2024-09-12T01:34:29.529511+0000","last_fullsized":"2024-09-12T01:34:29.529511+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:57.949570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:54.547748+0000","last_change":"2024-09-12T00:43:38.794955+0000","last_active":"2024-09-12T01:36:54.547748+0000","last_peered":"2024-09-12T01:36:54.547748+0000","last_clean":"2024-09-12T01:36:54.547748+0000","last_became_active":"2024-09-12T00:43:38.794612+0000","last_became_peered":"2024-09-12T00:43:38.794612+0000","last_unstale":"2024-09-12T01:36:54.547748+0000","last_undegraded":"2024-09-12T01:36:54.547748+0000","last_fullsized":"2024-09-12T01:36:54.547748+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:55.593800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'16","reported_seq":92,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:20.083241+0000","last_change":"2024-09-12T00:39:17.772179+0000","last_active":"2024-09-12T01:34:20.083241+0000","last_peered":"2024-09-12T01:34:20.083241+0000","last_clean":"2024-09-12T01:34:20.083241+0000","last_became_active":"2024-09-12T00:39:17.771839+0000","last_became_peered":"2024-09-12T00:39:17.771839+0000","last_unstale":"2024-09-12T01:34:20.083241+0000","last_undegraded":"2024-09-12T01:34:20.083241+0000","last_fullsized":"2024-09-12T01:34:20.083241+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:56.418566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":43,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.084810+0000","last_change":"2024-09-12T01:02:03.928338+0000","last_active":"2024-09-12T01:34:35.084810+0000","last_peered":"2024-09-12T01:34:35.084810+0000","last_clean":"2024-09-12T01:34:35.084810+0000","last_became_active":"2024-09-12T01:02:03.928036+0000","last_became_peered":"2024-09-12T01:02:03.928036+0000","last_unstale":"2024-09-12T01:34:35.084810+0000","last_undegraded":"2024-09-12T01:34:35.084810+0000","last_fullsized":"2024-09-12T01:34:35.084810+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:58.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079595+0000","last_change":"2024-09-12T00:43:43.819611+0000","last_active":"2024-09-12T01:33:45.079595+0000","last_peered":"2024-09-12T01:33:45.079595+0000","last_clean":"2024-09-12T01:33:45.079595+0000","last_became_active":"2024-09-12T00:43:43.819239+0000","last_became_peered":"2024-09-12T00:43:43.819239+0000","last_unstale":"2024-09-12T01:33:45.079595+0000","last_undegraded":"2024-09-12T01:33:45.079595+0000","last_fullsized":"2024-09-12T01:33:45.079595+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.073168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8210,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"266'10","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.988208+0000","last_change":"2024-09-12T00:43:38.785050+0000","last_active":"2024-09-12T01:36:09.988208+0000","last_peered":"2024-09-12T01:36:09.988208+0000","last_clean":"2024-09-12T01:36:09.988208+0000","last_became_active":"2024-09-12T00:43:38.784746+0000","last_became_peered":"2024-09-12T00:43:38.784746+0000","last_unstale":"2024-09-12T01:36:09.988208+0000","last_undegraded":"2024-09-12T01:36:09.988208+0000","last_fullsized":"2024-09-12T01:36:09.988208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:12.845708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"257'30","reported_seq":143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123074+0000","last_change":"2024-09-12T00:39:17.764933+0000","last_active":"2024-09-12T01:35:05.123074+0000","last_peered":"2024-09-12T01:35:05.123074+0000","last_clean":"2024-09-12T01:35:05.123074+0000","last_became_active":"2024-09-12T00:39:17.764658+0000","last_became_peered":"2024-09-12T00:39:17.764658+0000","last_unstale":"2024-09-12T01:35:05.123074+0000","last_undegraded":"2024-09-12T01:35:05.123074+0000","last_fullsized":"2024-09-12T01:35:05.123074+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:54.897501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":139,"num_write":41,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.977764+0000","last_change":"2024-09-12T01:02:03.917684+0000","last_active":"2024-09-12T01:34:34.977764+0000","last_peered":"2024-09-12T01:34:34.977764+0000","last_clean":"2024-09-12T01:34:34.977764+0000","last_became_active":"2024-09-12T01:02:03.917362+0000","last_became_peered":"2024-09-12T01:02:03.917362+0000","last_unstale":"2024-09-12T01:34:34.977764+0000","last_undegraded":"2024-09-12T01:34:34.977764+0000","last_fullsized":"2024-09-12T01:34:34.977764+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:13.774129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"266'8","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.668909+0000","last_change":"2024-09-12T00:43:43.822843+0000","last_active":"2024-09-12T01:37:38.668909+0000","last_peered":"2024-09-12T01:37:38.668909+0000","last_clean":"2024-09-12T01:37:38.668909+0000","last_became_active":"2024-09-12T00:43:43.822574+0000","last_became_peered":"2024-09-12T00:43:43.822574+0000","last_unstale":"2024-09-12T01:37:38.668909+0000","last_undegraded":"2024-09-12T01:37:38.668909+0000","last_fullsized":"2024-09-12T01:37:38.668909+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:31.603888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9228,"num_write":8,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.189305+0000","last_change":"2024-09-12T00:43:38.799826+0000","last_active":"2024-09-12T01:36:09.189305+0000","last_peered":"2024-09-12T01:36:09.189305+0000","last_clean":"2024-09-12T01:36:09.189305+0000","last_became_active":"2024-09-12T00:43:38.799567+0000","last_became_peered":"2024-09-12T00:43:38.799567+0000","last_unstale":"2024-09-12T01:36:09.189305+0000","last_undegraded":"2024-09-12T01:36:09.189305+0000","last_fullsized":"2024-09-12T01:36:09.189305+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:50.512707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'52","reported_seq":196,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.178294+0000","last_change":"2024-09-12T00:39:17.761012+0000","last_active":"2024-09-12T01:34:54.178294+0000","last_peered":"2024-09-12T01:34:54.178294+0000","last_clean":"2024-09-12T01:34:54.178294+0000","last_became_active":"2024-09-12T00:39:17.760735+0000","last_became_peered":"2024-09-12T00:39:17.760735+0000","last_unstale":"2024-09-12T01:34:54.178294+0000","last_undegraded":"2024-09-12T01:34:54.178294+0000","last_fullsized":"2024-09-12T01:34:54.178294+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:37.209781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":192,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997802+0000","last_change":"2024-09-12T01:02:03.925249+0000","last_active":"2024-09-12T01:34:43.997802+0000","last_peered":"2024-09-12T01:34:43.997802+0000","last_clean":"2024-09-12T01:34:43.997802+0000","last_became_active":"2024-09-12T01:02:03.924800+0000","last_became_peered":"2024-09-12T01:02:03.924800+0000","last_unstale":"2024-09-12T01:34:43.997802+0000","last_undegraded":"2024-09-12T01:34:43.997802+0000","last_fullsized":"2024-09-12T01:34:43.997802+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:42.824392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:30.118030+0000","last_change":"2024-09-12T00:43:43.822402+0000","last_active":"2024-09-12T01:34:30.118030+0000","last_peered":"2024-09-12T01:34:30.118030+0000","last_clean":"2024-09-12T01:34:30.118030+0000","last_became_active":"2024-09-12T00:43:43.822130+0000","last_became_peered":"2024-09-12T00:43:43.822130+0000","last_unstale":"2024-09-12T01:34:30.118030+0000","last_undegraded":"2024-09-12T01:34:30.118030+0000","last_fullsized":"2024-09-12T01:34:30.118030+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:52.855759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533810+0000","last_change":"2024-09-12T00:43:38.789538+0000","last_active":"2024-09-12T01:35:04.533810+0000","last_peered":"2024-09-12T01:35:04.533810+0000","last_clean":"2024-09-12T01:35:04.533810+0000","last_became_active":"2024-09-12T00:43:38.789198+0000","last_became_peered":"2024-09-12T00:43:38.789198+0000","last_unstale":"2024-09-12T01:35:04.533810+0000","last_undegraded":"2024-09-12T01:35:04.533810+0000","last_fullsized":"2024-09-12T01:35:04.533810+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:11.316230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'15","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250354+0000","last_change":"2024-09-12T00:39:17.767969+0000","last_active":"2024-09-12T01:34:52.250354+0000","last_peered":"2024-09-12T01:34:52.250354+0000","last_clean":"2024-09-12T01:34:52.250354+0000","last_became_active":"2024-09-12T00:39:17.767662+0000","last_became_peered":"2024-09-12T00:39:17.767662+0000","last_unstale":"2024-09-12T01:34:52.250354+0000","last_undegraded":"2024-09-12T01:34:52.250354+0000","last_fullsized":"2024-09-12T01:34:52.250354+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:30.457902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:44.177191+0000","last_change":"2024-09-12T01:02:03.924577+0000","last_active":"2024-09-12T01:34:44.177191+0000","last_peered":"2024-09-12T01:34:44.177191+0000","last_clean":"2024-09-12T01:34:44.177191+0000","last_became_active":"2024-09-12T01:02:03.924303+0000","last_became_peered":"2024-09-12T01:02:03.924303+0000","last_unstale":"2024-09-12T01:34:44.177191+0000","last_undegraded":"2024-09-12T01:34:44.177191+0000","last_fullsized":"2024-09-12T01:34:44.177191+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:24.298478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'9","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.843719+0000","last_change":"2024-09-12T00:43:43.821003+0000","last_active":"2024-09-12T01:37:38.843719+0000","last_peered":"2024-09-12T01:37:38.843719+0000","last_clean":"2024-09-12T01:37:38.843719+0000","last_became_active":"2024-09-12T00:43:43.819058+0000","last_became_peered":"2024-09-12T00:43:43.819058+0000","last_unstale":"2024-09-12T01:37:38.843719+0000","last_undegraded":"2024-09-12T01:37:38.843719+0000","last_fullsized":"2024-09-12T01:37:38.843719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:02.246750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9222,"num_write":14,"num_write_kb":9222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"266'8","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.626218+0000","last_change":"2024-09-12T00:43:38.796717+0000","last_active":"2024-09-12T01:37:38.626218+0000","last_peered":"2024-09-12T01:37:38.626218+0000","last_clean":"2024-09-12T01:37:38.626218+0000","last_became_active":"2024-09-12T00:43:38.796426+0000","last_became_peered":"2024-09-12T00:43:38.796426+0000","last_unstale":"2024-09-12T01:37:38.626218+0000","last_undegraded":"2024-09-12T01:37:38.626218+0000","last_fullsized":"2024-09-12T01:37:38.626218+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:20.544492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9226,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250340+0000","last_change":"2024-09-12T00:39:17.767397+0000","last_active":"2024-09-12T01:34:52.250340+0000","last_peered":"2024-09-12T01:34:52.250340+0000","last_clean":"2024-09-12T01:34:52.250340+0000","last_became_active":"2024-09-12T00:39:17.767088+0000","last_became_peered":"2024-09-12T00:39:17.767088+0000","last_unstale":"2024-09-12T01:34:52.250340+0000","last_undegraded":"2024-09-12T01:34:52.250340+0000","last_fullsized":"2024-09-12T01:34:52.250340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:12.858828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:45.085791+0000","last_change":"2024-09-12T01:02:03.925759+0000","last_active":"2024-09-12T01:34:45.085791+0000","last_peered":"2024-09-12T01:34:45.085791+0000","last_clean":"2024-09-12T01:34:45.085791+0000","last_became_active":"2024-09-12T01:02:03.925482+0000","last_became_peered":"2024-09-12T01:02:03.925482+0000","last_unstale":"2024-09-12T01:34:45.085791+0000","last_undegraded":"2024-09-12T01:34:45.085791+0000","last_fullsized":"2024-09-12T01:34:45.085791+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:13.030524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:55.139373+0000","last_change":"2024-09-12T00:43:43.820868+0000","last_active":"2024-09-12T01:36:55.139373+0000","last_peered":"2024-09-12T01:36:55.139373+0000","last_clean":"2024-09-12T01:36:55.139373+0000","last_became_active":"2024-09-12T00:43:43.820272+0000","last_became_peered":"2024-09-12T00:43:43.820272+0000","last_unstale":"2024-09-12T01:36:55.139373+0000","last_undegraded":"2024-09-12T01:36:55.139373+0000","last_fullsized":"2024-09-12T01:36:55.139373+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:42.963849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'6","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:50.138568+0000","last_change":"2024-09-12T00:43:38.800018+0000","last_active":"2024-09-12T01:36:50.138568+0000","last_peered":"2024-09-12T01:36:50.138568+0000","last_clean":"2024-09-12T01:36:50.138568+0000","last_became_active":"2024-09-12T00:43:38.799719+0000","last_became_peered":"2024-09-12T00:43:38.799719+0000","last_unstale":"2024-09-12T01:36:50.138568+0000","last_undegraded":"2024-09-12T01:36:50.138568+0000","last_fullsized":"2024-09-12T01:36:50.138568+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:07.155485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20462,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'32","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:55.121695+0000","last_change":"2024-09-12T00:39:17.762941+0000","last_active":"2024-09-12T01:34:55.121695+0000","last_peered":"2024-09-12T01:34:55.121695+0000","last_clean":"2024-09-12T01:34:55.121695+0000","last_became_active":"2024-09-12T00:39:17.762639+0000","last_became_peered":"2024-09-12T00:39:17.762639+0000","last_unstale":"2024-09-12T01:34:55.121695+0000","last_undegraded":"2024-09-12T01:34:55.121695+0000","last_fullsized":"2024-09-12T01:34:55.121695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:15.974100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:44.978932+0000","last_change":"2024-09-12T01:02:03.925349+0000","last_active":"2024-09-12T01:34:44.978932+0000","last_peered":"2024-09-12T01:34:44.978932+0000","last_clean":"2024-09-12T01:34:44.978932+0000","last_became_active":"2024-09-12T01:02:03.924892+0000","last_became_peered":"2024-09-12T01:02:03.924892+0000","last_unstale":"2024-09-12T01:34:44.978932+0000","last_undegraded":"2024-09-12T01:34:44.978932+0000","last_fullsized":"2024-09-12T01:34:44.978932+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:07.795848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'4","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:54.994285+0000","last_change":"2024-09-12T00:43:43.819938+0000","last_active":"2024-09-12T01:36:54.994285+0000","last_peered":"2024-09-12T01:36:54.994285+0000","last_clean":"2024-09-12T01:36:54.994285+0000","last_became_active":"2024-09-12T00:43:43.819431+0000","last_became_peered":"2024-09-12T00:43:43.819431+0000","last_unstale":"2024-09-12T01:36:54.994285+0000","last_undegraded":"2024-09-12T01:36:54.994285+0000","last_fullsized":"2024-09-12T01:36:54.994285+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:42.027354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"266'3","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:49.018108+0000","last_change":"2024-09-12T00:43:38.797182+0000","last_active":"2024-09-12T01:36:49.018108+0000","last_peered":"2024-09-12T01:36:49.018108+0000","last_clean":"2024-09-12T01:36:49.018108+0000","last_became_active":"2024-09-12T00:43:38.796894+0000","last_became_peered":"2024-09-12T00:43:38.796894+0000","last_unstale":"2024-09-12T01:36:49.018108+0000","last_undegraded":"2024-09-12T01:36:49.018108+0000","last_fullsized":"2024-09-12T01:36:49.018108+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:57.433793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'47","reported_seq":182,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536474+0000","last_change":"2024-09-12T00:39:17.762269+0000","last_active":"2024-09-12T01:35:24.536474+0000","last_peered":"2024-09-12T01:35:24.536474+0000","last_clean":"2024-09-12T01:35:24.536474+0000","last_became_active":"2024-09-12T00:39:17.761972+0000","last_became_peered":"2024-09-12T00:39:17.761972+0000","last_unstale":"2024-09-12T01:35:24.536474+0000","last_undegraded":"2024-09-12T01:35:24.536474+0000","last_fullsized":"2024-09-12T01:35:24.536474+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:47.885908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":165,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:28.985653+0000","last_change":"2024-09-12T01:02:03.923742+0000","last_active":"2024-09-12T01:33:28.985653+0000","last_peered":"2024-09-12T01:33:28.985653+0000","last_clean":"2024-09-12T01:33:28.985653+0000","last_became_active":"2024-09-12T01:02:03.923464+0000","last_became_peered":"2024-09-12T01:02:03.923464+0000","last_unstale":"2024-09-12T01:33:28.985653+0000","last_undegraded":"2024-09-12T01:33:28.985653+0000","last_fullsized":"2024-09-12T01:33:28.985653+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:44.541153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'11","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.842146+0000","last_change":"2024-09-12T00:43:43.818258+0000","last_active":"2024-09-12T01:37:38.842146+0000","last_peered":"2024-09-12T01:37:38.842146+0000","last_clean":"2024-09-12T01:37:38.842146+0000","last_became_active":"2024-09-12T00:43:43.817990+0000","last_became_peered":"2024-09-12T00:43:43.817990+0000","last_unstale":"2024-09-12T01:37:38.842146+0000","last_undegraded":"2024-09-12T01:37:38.842146+0000","last_fullsized":"2024-09-12T01:37:38.842146+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:00.011210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14448,"num_write":16,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"266'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.103250+0000","last_change":"2024-09-12T00:43:38.795940+0000","last_active":"2024-09-12T01:37:19.103250+0000","last_peered":"2024-09-12T01:37:19.103250+0000","last_clean":"2024-09-12T01:37:19.103250+0000","last_became_active":"2024-09-12T00:43:38.793825+0000","last_became_peered":"2024-09-12T00:43:38.793825+0000","last_unstale":"2024-09-12T01:37:19.103250+0000","last_undegraded":"2024-09-12T01:37:19.103250+0000","last_fullsized":"2024-09-12T01:37:19.103250+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:24.205683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'20","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.535804+0000","last_change":"2024-09-12T00:39:17.770201+0000","last_active":"2024-09-12T01:35:19.535804+0000","last_peered":"2024-09-12T01:35:19.535804+0000","last_clean":"2024-09-12T01:35:19.535804+0000","last_became_active":"2024-09-12T00:39:17.769263+0000","last_became_peered":"2024-09-12T00:39:17.769263+0000","last_unstale":"2024-09-12T01:35:19.535804+0000","last_undegraded":"2024-09-12T01:35:19.535804+0000","last_fullsized":"2024-09-12T01:35:19.535804+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:15.097860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.165777+0000","last_change":"2024-09-12T01:02:03.924548+0000","last_active":"2024-09-12T01:33:29.165777+0000","last_peered":"2024-09-12T01:33:29.165777+0000","last_clean":"2024-09-12T01:33:29.165777+0000","last_became_active":"2024-09-12T01:02:03.924260+0000","last_became_peered":"2024-09-12T01:02:03.924260+0000","last_unstale":"2024-09-12T01:33:29.165777+0000","last_undegraded":"2024-09-12T01:33:29.165777+0000","last_fullsized":"2024-09-12T01:33:29.165777+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:07.250231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"266'3","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:24.023301+0000","last_change":"2024-09-12T00:43:43.824871+0000","last_active":"2024-09-12T01:37:24.023301+0000","last_peered":"2024-09-12T01:37:24.023301+0000","last_clean":"2024-09-12T01:37:24.023301+0000","last_became_active":"2024-09-12T00:43:43.824567+0000","last_became_peered":"2024-09-12T00:43:43.824567+0000","last_unstale":"2024-09-12T01:37:24.023301+0000","last_undegraded":"2024-09-12T01:37:24.023301+0000","last_fullsized":"2024-09-12T01:37:24.023301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:24.293339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"266'5","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.022626+0000","last_change":"2024-09-12T00:43:38.798453+0000","last_active":"2024-09-12T01:37:19.022626+0000","last_peered":"2024-09-12T01:37:19.022626+0000","last_clean":"2024-09-12T01:37:19.022626+0000","last_became_active":"2024-09-12T00:43:38.798200+0000","last_became_peered":"2024-09-12T00:43:38.798200+0000","last_unstale":"2024-09-12T01:37:19.022626+0000","last_undegraded":"2024-09-12T01:37:19.022626+0000","last_fullsized":"2024-09-12T01:37:19.022626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:27.881376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"266'30","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125273+0000","last_change":"2024-09-12T00:39:17.766861+0000","last_active":"2024-09-12T01:35:20.125273+0000","last_peered":"2024-09-12T01:35:20.125273+0000","last_clean":"2024-09-12T01:35:20.125273+0000","last_became_active":"2024-09-12T00:39:17.766600+0000","last_became_peered":"2024-09-12T00:39:17.766600+0000","last_unstale":"2024-09-12T01:35:20.125273+0000","last_undegraded":"2024-09-12T01:35:20.125273+0000","last_fullsized":"2024-09-12T01:35:20.125273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:07.049466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":112,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250307+0000","last_change":"2024-09-12T01:02:03.919723+0000","last_active":"2024-09-12T01:34:52.250307+0000","last_peered":"2024-09-12T01:34:52.250307+0000","last_clean":"2024-09-12T01:34:52.250307+0000","last_became_active":"2024-09-12T01:02:03.919377+0000","last_became_peered":"2024-09-12T01:02:03.919377+0000","last_unstale":"2024-09-12T01:34:52.250307+0000","last_undegraded":"2024-09-12T01:34:52.250307+0000","last_fullsized":"2024-09-12T01:34:52.250307+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:59.358385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123101+0000","last_change":"2024-09-12T00:43:43.818424+0000","last_active":"2024-09-12T01:35:05.123101+0000","last_peered":"2024-09-12T01:35:05.123101+0000","last_clean":"2024-09-12T01:35:05.123101+0000","last_became_active":"2024-09-12T00:43:43.818153+0000","last_became_peered":"2024-09-12T00:43:43.818153+0000","last_unstale":"2024-09-12T01:35:05.123101+0000","last_undegraded":"2024-09-12T01:35:05.123101+0000","last_fullsized":"2024-09-12T01:35:05.123101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.787318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'6","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.890420+0000","last_change":"2024-09-12T00:43:38.792429+0000","last_active":"2024-09-12T01:37:38.890420+0000","last_peered":"2024-09-12T01:37:38.890420+0000","last_clean":"2024-09-12T01:37:38.890420+0000","last_became_active":"2024-09-12T00:43:38.792135+0000","last_became_peered":"2024-09-12T00:43:38.792135+0000","last_unstale":"2024-09-12T01:37:38.890420+0000","last_undegraded":"2024-09-12T01:37:38.890420+0000","last_fullsized":"2024-09-12T01:37:38.890420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:11.570953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8232,"num_write":6,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"266'12","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.089651+0000","last_change":"2024-09-12T00:39:17.768309+0000","last_active":"2024-09-12T01:35:20.089651+0000","last_peered":"2024-09-12T01:35:20.089651+0000","last_clean":"2024-09-12T01:35:20.089651+0000","last_became_active":"2024-09-12T00:39:17.767599+0000","last_became_peered":"2024-09-12T00:39:17.767599+0000","last_unstale":"2024-09-12T01:35:20.089651+0000","last_undegraded":"2024-09-12T01:35:20.089651+0000","last_fullsized":"2024-09-12T01:35:20.089651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:18.635424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.165738+0000","last_change":"2024-09-12T01:02:03.918519+0000","last_active":"2024-09-12T01:33:29.165738+0000","last_peered":"2024-09-12T01:33:29.165738+0000","last_clean":"2024-09-12T01:33:29.165738+0000","last_became_active":"2024-09-12T01:02:03.918248+0000","last_became_peered":"2024-09-12T01:02:03.918248+0000","last_unstale":"2024-09-12T01:33:29.165738+0000","last_undegraded":"2024-09-12T01:33:29.165738+0000","last_fullsized":"2024-09-12T01:33:29.165738+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:15.650720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533744+0000","last_change":"2024-09-12T00:43:43.825033+0000","last_active":"2024-09-12T01:35:04.533744+0000","last_peered":"2024-09-12T01:35:04.533744+0000","last_clean":"2024-09-12T01:35:04.533744+0000","last_became_active":"2024-09-12T00:43:43.822993+0000","last_became_peered":"2024-09-12T00:43:43.822993+0000","last_unstale":"2024-09-12T01:35:04.533744+0000","last_undegraded":"2024-09-12T01:35:04.533744+0000","last_fullsized":"2024-09-12T01:35:04.533744+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.928486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:59.087781+0000","last_change":"2024-09-12T00:43:38.795993+0000","last_active":"2024-09-12T01:34:59.087781+0000","last_peered":"2024-09-12T01:34:59.087781+0000","last_clean":"2024-09-12T01:34:59.087781+0000","last_became_active":"2024-09-12T00:43:38.795625+0000","last_became_peered":"2024-09-12T00:43:38.795625+0000","last_unstale":"2024-09-12T01:34:59.087781+0000","last_undegraded":"2024-09-12T01:34:59.087781+0000","last_fullsized":"2024-09-12T01:34:59.087781+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:32.904211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'39","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125177+0000","last_change":"2024-09-12T00:39:17.761781+0000","last_active":"2024-09-12T01:35:20.125177+0000","last_peered":"2024-09-12T01:35:20.125177+0000","last_clean":"2024-09-12T01:35:20.125177+0000","last_became_active":"2024-09-12T00:39:17.761517+0000","last_became_peered":"2024-09-12T00:39:17.761517+0000","last_unstale":"2024-09-12T01:35:20.125177+0000","last_undegraded":"2024-09-12T01:35:20.125177+0000","last_fullsized":"2024-09-12T01:35:20.125177+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:36.401035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997821+0000","last_change":"2024-09-12T01:02:03.924588+0000","last_active":"2024-09-12T01:34:43.997821+0000","last_peered":"2024-09-12T01:34:43.997821+0000","last_clean":"2024-09-12T01:34:43.997821+0000","last_became_active":"2024-09-12T01:02:03.923808+0000","last_became_peered":"2024-09-12T01:02:03.923808+0000","last_unstale":"2024-09-12T01:34:43.997821+0000","last_undegraded":"2024-09-12T01:34:43.997821+0000","last_fullsized":"2024-09-12T01:34:43.997821+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:42.299573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'5","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:30.126665+0000","last_change":"2024-09-12T00:43:43.819522+0000","last_active":"2024-09-12T01:35:30.126665+0000","last_peered":"2024-09-12T01:35:30.126665+0000","last_clean":"2024-09-12T01:35:30.126665+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:35:30.126665+0000","last_undegraded":"2024-09-12T01:35:30.126665+0000","last_fullsized":"2024-09-12T01:35:30.126665+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:30.323747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'4","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.786735+0000","last_change":"2024-09-12T00:43:38.795759+0000","last_active":"2024-09-12T01:37:38.786735+0000","last_peered":"2024-09-12T01:37:38.786735+0000","last_clean":"2024-09-12T01:37:38.786735+0000","last_became_active":"2024-09-12T00:43:38.795451+0000","last_became_peered":"2024-09-12T00:43:38.795451+0000","last_unstale":"2024-09-12T01:37:38.786735+0000","last_undegraded":"2024-09-12T01:37:38.786735+0000","last_fullsized":"2024-09-12T01:37:38.786735+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:17.278286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'133","reported_seq":488,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:30.109250+0000","last_change":"2024-09-12T00:39:17.763176+0000","last_active":"2024-09-12T01:33:30.109250+0000","last_peered":"2024-09-12T01:33:30.109250+0000","last_clean":"2024-09-12T01:33:30.109250+0000","last_became_active":"2024-09-12T00:39:17.762649+0000","last_became_peered":"2024-09-12T00:39:17.762649+0000","last_unstale":"2024-09-12T01:33:30.109250+0000","last_undegraded":"2024-09-12T01:33:30.109250+0000","last_fullsized":"2024-09-12T01:33:30.109250+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:52.621341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":844,"num_read_kb":585,"num_write":185,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.078996+0000","last_change":"2024-09-12T01:02:03.925718+0000","last_active":"2024-09-12T01:33:34.078996+0000","last_peered":"2024-09-12T01:33:34.078996+0000","last_clean":"2024-09-12T01:33:34.078996+0000","last_became_active":"2024-09-12T01:02:03.924934+0000","last_became_peered":"2024-09-12T01:02:03.924934+0000","last_unstale":"2024-09-12T01:33:34.078996+0000","last_undegraded":"2024-09-12T01:33:34.078996+0000","last_fullsized":"2024-09-12T01:33:34.078996+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:47:26.933104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:30.126629+0000","last_change":"2024-09-12T00:43:43.822008+0000","last_active":"2024-09-12T01:35:30.126629+0000","last_peered":"2024-09-12T01:35:30.126629+0000","last_clean":"2024-09-12T01:35:30.126629+0000","last_became_active":"2024-09-12T00:43:43.821288+0000","last_became_peered":"2024-09-12T00:43:43.821288+0000","last_unstale":"2024-09-12T01:35:30.126629+0000","last_undegraded":"2024-09-12T01:35:30.126629+0000","last_fullsized":"2024-09-12T01:35:30.126629+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:12.223424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.182657+0000","last_change":"2024-09-12T00:43:38.798047+0000","last_active":"2024-09-12T01:35:24.182657+0000","last_peered":"2024-09-12T01:35:24.182657+0000","last_clean":"2024-09-12T01:35:24.182657+0000","last_became_active":"2024-09-12T00:43:38.797782+0000","last_became_peered":"2024-09-12T00:43:38.797782+0000","last_unstale":"2024-09-12T01:35:24.182657+0000","last_undegraded":"2024-09-12T01:35:24.182657+0000","last_fullsized":"2024-09-12T01:35:24.182657+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:52.438462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'33","reported_seq":147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.521087+0000","last_change":"2024-09-12T00:39:17.769240+0000","last_active":"2024-09-12T01:33:19.521087+0000","last_peered":"2024-09-12T01:33:19.521087+0000","last_clean":"2024-09-12T01:33:19.521087+0000","last_became_active":"2024-09-12T00:39:17.768151+0000","last_became_peered":"2024-09-12T00:39:17.768151+0000","last_unstale":"2024-09-12T01:33:19.521087+0000","last_undegraded":"2024-09-12T01:33:19.521087+0000","last_fullsized":"2024-09-12T01:33:19.521087+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:44.421190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.530106+0000","last_change":"2024-09-12T01:02:03.922540+0000","last_active":"2024-09-12T01:34:34.530106+0000","last_peered":"2024-09-12T01:34:34.530106+0000","last_clean":"2024-09-12T01:34:34.530106+0000","last_became_active":"2024-09-12T01:02:03.921595+0000","last_became_peered":"2024-09-12T01:02:03.921595+0000","last_unstale":"2024-09-12T01:34:34.530106+0000","last_undegraded":"2024-09-12T01:34:34.530106+0000","last_fullsized":"2024-09-12T01:34:34.530106+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.523672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"266'9","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:40.128350+0000","last_change":"2024-09-12T00:43:43.820529+0000","last_active":"2024-09-12T01:35:40.128350+0000","last_peered":"2024-09-12T01:35:40.128350+0000","last_clean":"2024-09-12T01:35:40.128350+0000","last_became_active":"2024-09-12T00:43:43.819990+0000","last_became_peered":"2024-09-12T00:43:43.819990+0000","last_unstale":"2024-09-12T01:35:40.128350+0000","last_undegraded":"2024-09-12T01:35:40.128350+0000","last_fullsized":"2024-09-12T01:35:40.128350+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:58.280401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8217,"num_write":14,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.750005+0000","last_change":"2024-09-12T00:43:38.798676+0000","last_active":"2024-09-12T01:37:38.750005+0000","last_peered":"2024-09-12T01:37:38.750005+0000","last_clean":"2024-09-12T01:37:38.750005+0000","last_became_active":"2024-09-12T00:43:38.798374+0000","last_became_peered":"2024-09-12T00:43:38.798374+0000","last_unstale":"2024-09-12T01:37:38.750005+0000","last_undegraded":"2024-09-12T01:37:38.750005+0000","last_fullsized":"2024-09-12T01:37:38.750005+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:29.029265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":166,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.077519+0000","last_change":"2024-09-12T00:39:17.758205+0000","last_active":"2024-09-12T01:33:19.077519+0000","last_peered":"2024-09-12T01:33:19.077519+0000","last_clean":"2024-09-12T01:33:19.077519+0000","last_became_active":"2024-09-12T00:39:17.757795+0000","last_became_peered":"2024-09-12T00:39:17.757795+0000","last_unstale":"2024-09-12T01:33:19.077519+0000","last_undegraded":"2024-09-12T01:33:19.077519+0000","last_fullsized":"2024-09-12T01:33:19.077519+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:01:32.214592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.085182+0000","last_change":"2024-09-12T01:02:03.924136+0000","last_active":"2024-09-12T01:34:34.085182+0000","last_peered":"2024-09-12T01:34:34.085182+0000","last_clean":"2024-09-12T01:34:34.085182+0000","last_became_active":"2024-09-12T01:02:03.923774+0000","last_became_peered":"2024-09-12T01:02:03.923774+0000","last_unstale":"2024-09-12T01:34:34.085182+0000","last_undegraded":"2024-09-12T01:34:34.085182+0000","last_fullsized":"2024-09-12T01:34:34.085182+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:13.881070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.869482+0000","last_change":"2024-09-12T00:43:43.820925+0000","last_active":"2024-09-12T01:37:38.869482+0000","last_peered":"2024-09-12T01:37:38.869482+0000","last_clean":"2024-09-12T01:37:38.869482+0000","last_became_active":"2024-09-12T00:43:43.819044+0000","last_became_peered":"2024-09-12T00:43:43.819044+0000","last_unstale":"2024-09-12T01:37:38.869482+0000","last_undegraded":"2024-09-12T01:37:38.869482+0000","last_fullsized":"2024-09-12T01:37:38.869482+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:51.315359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6160,"num_write":14,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:20.107587+0000","last_change":"2024-09-12T00:43:38.797698+0000","last_active":"2024-09-12T01:33:20.107587+0000","last_peered":"2024-09-12T01:33:20.107587+0000","last_clean":"2024-09-12T01:33:20.107587+0000","last_became_active":"2024-09-12T00:43:38.797343+0000","last_became_peered":"2024-09-12T00:43:38.797343+0000","last_unstale":"2024-09-12T01:33:20.107587+0000","last_undegraded":"2024-09-12T01:33:20.107587+0000","last_fullsized":"2024-09-12T01:33:20.107587+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:07.327017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'33","reported_seq":137,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.164334+0000","last_change":"2024-09-12T00:39:17.760056+0000","last_active":"2024-09-12T01:33:19.164334+0000","last_peered":"2024-09-12T01:33:19.164334+0000","last_clean":"2024-09-12T01:33:19.164334+0000","last_became_active":"2024-09-12T00:39:17.759701+0000","last_became_peered":"2024-09-12T00:39:17.759701+0000","last_unstale":"2024-09-12T01:33:19.164334+0000","last_undegraded":"2024-09-12T01:33:19.164334+0000","last_fullsized":"2024-09-12T01:33:19.164334+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:36.105302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":64,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:33.986537+0000","last_change":"2024-09-12T01:02:03.923765+0000","last_active":"2024-09-12T01:33:33.986537+0000","last_peered":"2024-09-12T01:33:33.986537+0000","last_clean":"2024-09-12T01:33:33.986537+0000","last_became_active":"2024-09-12T01:02:03.923440+0000","last_became_peered":"2024-09-12T01:02:03.923440+0000","last_unstale":"2024-09-12T01:33:33.986537+0000","last_undegraded":"2024-09-12T01:33:33.986537+0000","last_fullsized":"2024-09-12T01:33:33.986537+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:46.874305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'5","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.538821+0000","last_change":"2024-09-12T00:43:43.819656+0000","last_active":"2024-09-12T01:35:44.538821+0000","last_peered":"2024-09-12T01:35:44.538821+0000","last_clean":"2024-09-12T01:35:44.538821+0000","last_became_active":"2024-09-12T00:43:43.819247+0000","last_became_peered":"2024-09-12T00:43:43.819247+0000","last_unstale":"2024-09-12T01:35:44.538821+0000","last_undegraded":"2024-09-12T01:35:44.538821+0000","last_fullsized":"2024-09-12T01:35:44.538821+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:00.847535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"266'5","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:40.128225+0000","last_change":"2024-09-12T00:43:38.794688+0000","last_active":"2024-09-12T01:35:40.128225+0000","last_peered":"2024-09-12T01:35:40.128225+0000","last_clean":"2024-09-12T01:35:40.128225+0000","last_became_active":"2024-09-12T00:43:38.794286+0000","last_became_peered":"2024-09-12T00:43:38.794286+0000","last_unstale":"2024-09-12T01:35:40.128225+0000","last_undegraded":"2024-09-12T01:35:40.128225+0000","last_fullsized":"2024-09-12T01:35:40.128225+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:52.618143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'28","reported_seq":129,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:19.164290+0000","last_change":"2024-09-12T00:39:17.762387+0000","last_active":"2024-09-12T01:33:19.164290+0000","last_peered":"2024-09-12T01:33:19.164290+0000","last_clean":"2024-09-12T01:33:19.164290+0000","last_became_active":"2024-09-12T00:39:17.761738+0000","last_became_peered":"2024-09-12T00:39:17.761738+0000","last_unstale":"2024-09-12T01:33:19.164290+0000","last_undegraded":"2024-09-12T01:33:19.164290+0000","last_fullsized":"2024-09-12T01:33:19.164290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:49.875350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":96,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.079050+0000","last_change":"2024-09-12T01:02:03.928768+0000","last_active":"2024-09-12T01:33:40.079050+0000","last_peered":"2024-09-12T01:33:40.079050+0000","last_clean":"2024-09-12T01:33:40.079050+0000","last_became_active":"2024-09-12T01:02:03.928475+0000","last_became_peered":"2024-09-12T01:02:03.928475+0000","last_unstale":"2024-09-12T01:33:40.079050+0000","last_undegraded":"2024-09-12T01:33:40.079050+0000","last_fullsized":"2024-09-12T01:33:40.079050+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:39.969871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'2","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:35.078402+0000","last_change":"2024-09-12T00:43:43.821438+0000","last_active":"2024-09-12T01:33:35.078402+0000","last_peered":"2024-09-12T01:33:35.078402+0000","last_clean":"2024-09-12T01:33:35.078402+0000","last_became_active":"2024-09-12T00:43:43.821149+0000","last_became_peered":"2024-09-12T00:43:43.821149+0000","last_unstale":"2024-09-12T01:33:35.078402+0000","last_undegraded":"2024-09-12T01:33:35.078402+0000","last_fullsized":"2024-09-12T01:33:35.078402+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:02.729782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'9","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.627920+0000","last_change":"2024-09-12T00:43:38.799268+0000","last_active":"2024-09-12T01:37:38.627920+0000","last_peered":"2024-09-12T01:37:38.627920+0000","last_clean":"2024-09-12T01:37:38.627920+0000","last_became_active":"2024-09-12T00:43:38.798510+0000","last_became_peered":"2024-09-12T00:43:38.798510+0000","last_unstale":"2024-09-12T01:37:38.627920+0000","last_undegraded":"2024-09-12T01:37:38.627920+0000","last_fullsized":"2024-09-12T01:37:38.627920+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:19.360861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16416,"num_write":14,"num_write_kb":12320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'28","reported_seq":135,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.078974+0000","last_change":"2024-09-12T00:39:17.771090+0000","last_active":"2024-09-12T01:33:40.078974+0000","last_peered":"2024-09-12T01:33:40.078974+0000","last_clean":"2024-09-12T01:33:40.078974+0000","last_became_active":"2024-09-12T00:39:17.770779+0000","last_became_peered":"2024-09-12T00:39:17.770779+0000","last_unstale":"2024-09-12T01:33:40.078974+0000","last_undegraded":"2024-09-12T01:33:40.078974+0000","last_fullsized":"2024-09-12T01:33:40.078974+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:31:45.806957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.971578+0000","last_change":"2024-09-12T01:02:03.925931+0000","last_active":"2024-09-12T01:33:34.971578+0000","last_peered":"2024-09-12T01:33:34.971578+0000","last_clean":"2024-09-12T01:33:34.971578+0000","last_became_active":"2024-09-12T01:02:03.925618+0000","last_became_peered":"2024-09-12T01:02:03.925618+0000","last_unstale":"2024-09-12T01:33:34.971578+0000","last_undegraded":"2024-09-12T01:33:34.971578+0000","last_fullsized":"2024-09-12T01:33:34.971578+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:46.274807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"266'5","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.870471+0000","last_change":"2024-09-12T00:43:43.825678+0000","last_active":"2024-09-12T01:37:38.870471+0000","last_peered":"2024-09-12T01:37:38.870471+0000","last_clean":"2024-09-12T01:37:38.870471+0000","last_became_active":"2024-09-12T00:43:43.825380+0000","last_became_peered":"2024-09-12T00:43:43.825380+0000","last_unstale":"2024-09-12T01:37:38.870471+0000","last_undegraded":"2024-09-12T01:37:38.870471+0000","last_fullsized":"2024-09-12T01:37:38.870471+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:38.026807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8232,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.110471+0000","last_change":"2024-09-12T00:43:38.791841+0000","last_active":"2024-09-12T01:33:40.110471+0000","last_peered":"2024-09-12T01:33:40.110471+0000","last_clean":"2024-09-12T01:33:40.110471+0000","last_became_active":"2024-09-12T00:43:38.791586+0000","last_became_peered":"2024-09-12T00:43:38.791586+0000","last_unstale":"2024-09-12T01:33:40.110471+0000","last_undegraded":"2024-09-12T01:33:40.110471+0000","last_fullsized":"2024-09-12T01:33:40.110471+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:32.346959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'54","reported_seq":205,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:28.985589+0000","last_change":"2024-09-12T00:39:17.762695+0000","last_active":"2024-09-12T01:33:28.985589+0000","last_peered":"2024-09-12T01:33:28.985589+0000","last_clean":"2024-09-12T01:33:28.985589+0000","last_became_active":"2024-09-12T00:39:17.762435+0000","last_became_peered":"2024-09-12T00:39:17.762435+0000","last_unstale":"2024-09-12T01:33:28.985589+0000","last_undegraded":"2024-09-12T01:33:28.985589+0000","last_fullsized":"2024-09-12T01:33:28.985589+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:26.720224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":202,"num_write":91,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:35.109860+0000","last_change":"2024-09-12T01:02:03.926151+0000","last_active":"2024-09-12T01:33:35.109860+0000","last_peered":"2024-09-12T01:33:35.109860+0000","last_clean":"2024-09-12T01:33:35.109860+0000","last_became_active":"2024-09-12T01:02:03.925866+0000","last_became_peered":"2024-09-12T01:02:03.925866+0000","last_unstale":"2024-09-12T01:33:35.109860+0000","last_undegraded":"2024-09-12T01:33:35.109860+0000","last_fullsized":"2024-09-12T01:33:35.109860+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:41.925257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'3","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:54.986356+0000","last_change":"2024-09-12T00:43:43.820437+0000","last_active":"2024-09-12T01:35:54.986356+0000","last_peered":"2024-09-12T01:35:54.986356+0000","last_clean":"2024-09-12T01:35:54.986356+0000","last_became_active":"2024-09-12T00:43:43.820153+0000","last_became_peered":"2024-09-12T00:43:43.820153+0000","last_unstale":"2024-09-12T01:35:54.986356+0000","last_undegraded":"2024-09-12T01:35:54.986356+0000","last_fullsized":"2024-09-12T01:35:54.986356+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:49.421817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'3","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.628485+0000","last_change":"2024-09-12T00:43:38.790234+0000","last_active":"2024-09-12T01:37:38.628485+0000","last_peered":"2024-09-12T01:37:38.628485+0000","last_clean":"2024-09-12T01:37:38.628485+0000","last_became_active":"2024-09-12T00:43:38.789945+0000","last_became_peered":"2024-09-12T00:43:38.789945+0000","last_unstale":"2024-09-12T01:37:38.628485+0000","last_undegraded":"2024-09-12T01:37:38.628485+0000","last_fullsized":"2024-09-12T01:37:38.628485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.330002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'34","reported_seq":150,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.970915+0000","last_change":"2024-09-12T00:39:17.760033+0000","last_active":"2024-09-12T01:33:29.970915+0000","last_peered":"2024-09-12T01:33:29.970915+0000","last_clean":"2024-09-12T01:33:29.970915+0000","last_became_active":"2024-09-12T00:39:17.759741+0000","last_became_peered":"2024-09-12T00:39:17.759741+0000","last_unstale":"2024-09-12T01:33:29.970915+0000","last_undegraded":"2024-09-12T01:33:29.970915+0000","last_fullsized":"2024-09-12T01:33:29.970915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:16.079518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.983140+0000","last_change":"2024-09-12T01:02:03.919303+0000","last_active":"2024-09-12T01:35:24.983140+0000","last_peered":"2024-09-12T01:35:24.983140+0000","last_clean":"2024-09-12T01:35:24.983140+0000","last_became_active":"2024-09-12T01:02:03.918998+0000","last_became_peered":"2024-09-12T01:02:03.918998+0000","last_unstale":"2024-09-12T01:35:24.983140+0000","last_undegraded":"2024-09-12T01:35:24.983140+0000","last_fullsized":"2024-09-12T01:35:24.983140+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:39.378429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:53.989633+0000","last_change":"2024-09-12T00:43:43.822054+0000","last_active":"2024-09-12T01:33:53.989633+0000","last_peered":"2024-09-12T01:33:53.989633+0000","last_clean":"2024-09-12T01:33:53.989633+0000","last_became_active":"2024-09-12T00:43:43.821691+0000","last_became_peered":"2024-09-12T00:43:43.821691+0000","last_unstale":"2024-09-12T01:33:53.989633+0000","last_undegraded":"2024-09-12T01:33:53.989633+0000","last_fullsized":"2024-09-12T01:33:53.989633+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:18.745231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523665+0000","last_change":"2024-09-12T00:43:38.798045+0000","last_active":"2024-09-12T01:33:39.523665+0000","last_peered":"2024-09-12T01:33:39.523665+0000","last_clean":"2024-09-12T01:33:39.523665+0000","last_became_active":"2024-09-12T00:43:38.797711+0000","last_became_peered":"2024-09-12T00:43:38.797711+0000","last_unstale":"2024-09-12T01:33:39.523665+0000","last_undegraded":"2024-09-12T01:33:39.523665+0000","last_fullsized":"2024-09-12T01:33:39.523665+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:56.223002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'32","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:27.237937+0000","last_change":"2024-09-12T00:39:17.761142+0000","last_active":"2024-09-12T01:33:27.237937+0000","last_peered":"2024-09-12T01:33:27.237937+0000","last_clean":"2024-09-12T01:33:27.237937+0000","last_became_active":"2024-09-12T00:39:17.760839+0000","last_became_peered":"2024-09-12T00:39:17.760839+0000","last_unstale":"2024-09-12T01:33:27.237937+0000","last_undegraded":"2024-09-12T01:33:27.237937+0000","last_fullsized":"2024-09-12T01:33:27.237937+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:10.465344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.983164+0000","last_change":"2024-09-12T01:02:03.920002+0000","last_active":"2024-09-12T01:35:24.983164+0000","last_peered":"2024-09-12T01:35:24.983164+0000","last_clean":"2024-09-12T01:35:24.983164+0000","last_became_active":"2024-09-12T01:02:03.919706+0000","last_became_peered":"2024-09-12T01:02:03.919706+0000","last_unstale":"2024-09-12T01:35:24.983164+0000","last_undegraded":"2024-09-12T01:35:24.983164+0000","last_fullsized":"2024-09-12T01:35:24.983164+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:03.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.008824+0000","last_change":"2024-09-12T00:43:43.818598+0000","last_active":"2024-09-12T01:35:49.008824+0000","last_peered":"2024-09-12T01:35:49.008824+0000","last_clean":"2024-09-12T01:35:49.008824+0000","last_became_active":"2024-09-12T00:43:43.818321+0000","last_became_peered":"2024-09-12T00:43:43.818321+0000","last_unstale":"2024-09-12T01:35:49.008824+0000","last_undegraded":"2024-09-12T01:35:49.008824+0000","last_fullsized":"2024-09-12T01:35:49.008824+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:45:55.640954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":96,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.260217+0000","last_change":"2024-09-12T00:43:38.792440+0000","last_active":"2024-09-12T01:35:57.260217+0000","last_peered":"2024-09-12T01:35:57.260217+0000","last_clean":"2024-09-12T01:35:57.260217+0000","last_became_active":"2024-09-12T00:43:38.792154+0000","last_became_peered":"2024-09-12T00:43:38.792154+0000","last_unstale":"2024-09-12T01:35:57.260217+0000","last_undegraded":"2024-09-12T01:35:57.260217+0000","last_fullsized":"2024-09-12T01:35:57.260217+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:59.352763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1034,"num_write":4,"num_write_kb":1034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"266'40","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.522358+0000","last_change":"2024-09-12T00:39:17.770041+0000","last_active":"2024-09-12T01:33:29.522358+0000","last_peered":"2024-09-12T01:33:29.522358+0000","last_clean":"2024-09-12T01:33:29.522358+0000","last_became_active":"2024-09-12T00:39:17.767962+0000","last_became_peered":"2024-09-12T00:39:17.767962+0000","last_unstale":"2024-09-12T01:33:29.522358+0000","last_undegraded":"2024-09-12T01:33:29.522358+0000","last_fullsized":"2024-09-12T01:33:29.522358+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:38.083643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":136,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:13.992744+0000","last_change":"2024-09-12T01:02:03.922136+0000","last_active":"2024-09-12T01:34:13.992744+0000","last_peered":"2024-09-12T01:34:13.992744+0000","last_clean":"2024-09-12T01:34:13.992744+0000","last_became_active":"2024-09-12T01:02:03.918216+0000","last_became_peered":"2024-09-12T01:02:03.918216+0000","last_unstale":"2024-09-12T01:34:13.992744+0000","last_undegraded":"2024-09-12T01:34:13.992744+0000","last_fullsized":"2024-09-12T01:34:13.992744+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:26.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'10","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.985350+0000","last_change":"2024-09-12T00:43:43.820490+0000","last_active":"2024-09-12T01:35:44.985350+0000","last_peered":"2024-09-12T01:35:44.985350+0000","last_clean":"2024-09-12T01:35:44.985350+0000","last_became_active":"2024-09-12T00:43:43.820194+0000","last_became_peered":"2024-09-12T00:43:43.820194+0000","last_unstale":"2024-09-12T01:35:44.985350+0000","last_undegraded":"2024-09-12T01:35:44.985350+0000","last_fullsized":"2024-09-12T01:35:44.985350+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:54.662468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"266'10","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.750798+0000","last_change":"2024-09-12T00:43:38.797923+0000","last_active":"2024-09-12T01:37:38.750798+0000","last_peered":"2024-09-12T01:37:38.750798+0000","last_clean":"2024-09-12T01:37:38.750798+0000","last_became_active":"2024-09-12T00:43:38.797428+0000","last_became_peered":"2024-09-12T00:43:38.797428+0000","last_unstale":"2024-09-12T01:37:38.750798+0000","last_undegraded":"2024-09-12T01:37:38.750798+0000","last_fullsized":"2024-09-12T01:37:38.750798+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:07.995028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12282,"num_write":20,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'85","reported_seq":370,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.079026+0000","last_change":"2024-09-12T00:39:17.767845+0000","last_active":"2024-09-12T01:33:40.079026+0000","last_peered":"2024-09-12T01:33:40.079026+0000","last_clean":"2024-09-12T01:33:40.079026+0000","last_became_active":"2024-09-12T00:39:17.767517+0000","last_became_peered":"2024-09-12T00:39:17.767517+0000","last_unstale":"2024-09-12T01:33:40.079026+0000","last_undegraded":"2024-09-12T01:33:40.079026+0000","last_fullsized":"2024-09-12T01:33:40.079026+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:44.733701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":615,"num_read_kb":395,"num_write":114,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536407+0000","last_change":"2024-09-12T01:02:03.922775+0000","last_active":"2024-09-12T01:35:24.536407+0000","last_peered":"2024-09-12T01:35:24.536407+0000","last_clean":"2024-09-12T01:35:24.536407+0000","last_became_active":"2024-09-12T01:02:03.922479+0000","last_became_peered":"2024-09-12T01:02:03.922479+0000","last_unstale":"2024-09-12T01:35:24.536407+0000","last_undegraded":"2024-09-12T01:35:24.536407+0000","last_fullsized":"2024-09-12T01:35:24.536407+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.011531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"263'4","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:34.523080+0000","last_change":"2024-09-12T00:43:43.821630+0000","last_active":"2024-09-12T01:33:34.523080+0000","last_peered":"2024-09-12T01:33:34.523080+0000","last_clean":"2024-09-12T01:33:34.523080+0000","last_became_active":"2024-09-12T00:43:43.821303+0000","last_became_peered":"2024-09-12T00:43:43.821303+0000","last_unstale":"2024-09-12T01:33:34.523080+0000","last_undegraded":"2024-09-12T01:33:34.523080+0000","last_fullsized":"2024-09-12T01:33:34.523080+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:56.126247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16370,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.538301+0000","last_change":"2024-09-12T00:43:38.800008+0000","last_active":"2024-09-12T01:35:39.538301+0000","last_peered":"2024-09-12T01:35:39.538301+0000","last_clean":"2024-09-12T01:35:39.538301+0000","last_became_active":"2024-09-12T00:43:38.799623+0000","last_became_peered":"2024-09-12T00:43:38.799623+0000","last_unstale":"2024-09-12T01:35:39.538301+0000","last_undegraded":"2024-09-12T01:35:39.538301+0000","last_fullsized":"2024-09-12T01:35:39.538301+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:26.934976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'30","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:35.127450+0000","last_change":"2024-09-12T00:39:17.768450+0000","last_active":"2024-09-12T01:35:35.127450+0000","last_peered":"2024-09-12T01:35:35.127450+0000","last_clean":"2024-09-12T01:35:35.127450+0000","last_became_active":"2024-09-12T00:39:17.768143+0000","last_became_peered":"2024-09-12T00:39:17.768143+0000","last_unstale":"2024-09-12T01:35:35.127450+0000","last_undegraded":"2024-09-12T01:35:35.127450+0000","last_fullsized":"2024-09-12T01:35:35.127450+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:16.633147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":109,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.118947+0000","last_change":"2024-09-12T01:02:03.927047+0000","last_active":"2024-09-12T01:34:35.118947+0000","last_peered":"2024-09-12T01:34:35.118947+0000","last_clean":"2024-09-12T01:34:35.118947+0000","last_became_active":"2024-09-12T01:02:03.926699+0000","last_became_peered":"2024-09-12T01:02:03.926699+0000","last_unstale":"2024-09-12T01:34:35.118947+0000","last_undegraded":"2024-09-12T01:34:35.118947+0000","last_fullsized":"2024-09-12T01:34:35.118947+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:16.113729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'7","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:52.259445+0000","last_change":"2024-09-12T00:43:43.819559+0000","last_active":"2024-09-12T01:35:52.259445+0000","last_peered":"2024-09-12T01:35:52.259445+0000","last_clean":"2024-09-12T01:35:52.259445+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:35:52.259445+0000","last_undegraded":"2024-09-12T01:35:52.259445+0000","last_fullsized":"2024-09-12T01:35:52.259445+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:15.150415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24570,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:50.080070+0000","last_change":"2024-09-12T00:43:38.798764+0000","last_active":"2024-09-12T01:33:50.080070+0000","last_peered":"2024-09-12T01:33:50.080070+0000","last_clean":"2024-09-12T01:33:50.080070+0000","last_became_active":"2024-09-12T00:43:38.798431+0000","last_became_peered":"2024-09-12T00:43:38.798431+0000","last_unstale":"2024-09-12T01:33:50.080070+0000","last_undegraded":"2024-09-12T01:33:50.080070+0000","last_fullsized":"2024-09-12T01:33:50.080070+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:19.004021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:35.091204+0000","last_change":"2024-09-12T00:39:17.769932+0000","last_active":"2024-09-12T01:35:35.091204+0000","last_peered":"2024-09-12T01:35:35.091204+0000","last_clean":"2024-09-12T01:35:35.091204+0000","last_became_active":"2024-09-12T00:39:17.768901+0000","last_became_peered":"2024-09-12T00:39:17.768901+0000","last_unstale":"2024-09-12T01:35:35.091204+0000","last_undegraded":"2024-09-12T01:35:35.091204+0000","last_fullsized":"2024-09-12T01:35:35.091204+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:49.443724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.248104+0000","last_change":"2024-09-12T01:02:03.922843+0000","last_active":"2024-09-12T01:34:37.248104+0000","last_peered":"2024-09-12T01:34:37.248104+0000","last_clean":"2024-09-12T01:34:37.248104+0000","last_became_active":"2024-09-12T01:02:03.922500+0000","last_became_peered":"2024-09-12T01:02:03.922500+0000","last_unstale":"2024-09-12T01:34:37.248104+0000","last_undegraded":"2024-09-12T01:34:37.248104+0000","last_fullsized":"2024-09-12T01:34:37.248104+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:26.949487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.524780+0000","last_change":"2024-09-12T00:43:43.824719+0000","last_active":"2024-09-12T01:33:49.524780+0000","last_peered":"2024-09-12T01:33:49.524780+0000","last_clean":"2024-09-12T01:33:49.524780+0000","last_became_active":"2024-09-12T00:43:43.823554+0000","last_became_peered":"2024-09-12T00:43:43.823554+0000","last_unstale":"2024-09-12T01:33:49.524780+0000","last_undegraded":"2024-09-12T01:33:49.524780+0000","last_fullsized":"2024-09-12T01:33:49.524780+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:47.954677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523603+0000","last_change":"2024-09-12T00:43:38.798395+0000","last_active":"2024-09-12T01:33:39.523603+0000","last_peered":"2024-09-12T01:33:39.523603+0000","last_clean":"2024-09-12T01:33:39.523603+0000","last_became_active":"2024-09-12T00:43:38.798117+0000","last_became_peered":"2024-09-12T00:43:38.798117+0000","last_unstale":"2024-09-12T01:33:39.523603+0000","last_undegraded":"2024-09-12T01:33:39.523603+0000","last_fullsized":"2024-09-12T01:33:39.523603+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:43.142516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'16","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537633+0000","last_change":"2024-09-12T00:39:17.768795+0000","last_active":"2024-09-12T01:35:34.537633+0000","last_peered":"2024-09-12T01:35:34.537633+0000","last_clean":"2024-09-12T01:35:34.537633+0000","last_became_active":"2024-09-12T00:39:17.768503+0000","last_became_peered":"2024-09-12T00:39:17.768503+0000","last_unstale":"2024-09-12T01:35:34.537633+0000","last_undegraded":"2024-09-12T01:35:34.537633+0000","last_fullsized":"2024-09-12T01:35:34.537633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:49.617037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.004612+0000","last_change":"2024-09-12T01:02:03.928738+0000","last_active":"2024-09-12T01:35:24.004612+0000","last_peered":"2024-09-12T01:35:24.004612+0000","last_clean":"2024-09-12T01:35:24.004612+0000","last_became_active":"2024-09-12T01:02:03.928430+0000","last_became_peered":"2024-09-12T01:02:03.928430+0000","last_unstale":"2024-09-12T01:35:24.004612+0000","last_undegraded":"2024-09-12T01:35:24.004612+0000","last_fullsized":"2024-09-12T01:35:24.004612+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:55.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079580+0000","last_change":"2024-09-12T00:43:43.823435+0000","last_active":"2024-09-12T01:33:45.079580+0000","last_peered":"2024-09-12T01:33:45.079580+0000","last_clean":"2024-09-12T01:33:45.079580+0000","last_became_active":"2024-09-12T00:43:43.822996+0000","last_became_peered":"2024-09-12T00:43:43.822996+0000","last_unstale":"2024-09-12T01:33:45.079580+0000","last_undegraded":"2024-09-12T01:33:45.079580+0000","last_fullsized":"2024-09-12T01:33:45.079580+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:25.064321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'2","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.167242+0000","last_change":"2024-09-12T00:43:38.797634+0000","last_active":"2024-09-12T01:33:39.167242+0000","last_peered":"2024-09-12T01:33:39.167242+0000","last_clean":"2024-09-12T01:33:39.167242+0000","last_became_active":"2024-09-12T00:43:38.797367+0000","last_became_peered":"2024-09-12T00:43:38.797367+0000","last_unstale":"2024-09-12T01:33:39.167242+0000","last_undegraded":"2024-09-12T01:33:39.167242+0000","last_fullsized":"2024-09-12T01:33:39.167242+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:24.679006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'9","reported_seq":83,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537587+0000","last_change":"2024-09-12T00:39:17.759644+0000","last_active":"2024-09-12T01:35:34.537587+0000","last_peered":"2024-09-12T01:35:34.537587+0000","last_clean":"2024-09-12T01:35:34.537587+0000","last_became_active":"2024-09-12T00:39:17.759327+0000","last_became_peered":"2024-09-12T00:39:17.759327+0000","last_unstale":"2024-09-12T01:35:34.537587+0000","last_undegraded":"2024-09-12T01:35:34.537587+0000","last_fullsized":"2024-09-12T01:35:34.537587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:23.808909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":31,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536493+0000","last_change":"2024-09-12T01:02:03.925373+0000","last_active":"2024-09-12T01:35:24.536493+0000","last_peered":"2024-09-12T01:35:24.536493+0000","last_clean":"2024-09-12T01:35:24.536493+0000","last_became_active":"2024-09-12T01:02:03.925081+0000","last_became_peered":"2024-09-12T01:02:03.925081+0000","last_unstale":"2024-09-12T01:35:24.536493+0000","last_undegraded":"2024-09-12T01:35:24.536493+0000","last_fullsized":"2024-09-12T01:35:24.536493+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:09.007940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'4","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.092766+0000","last_change":"2024-09-12T00:43:43.822771+0000","last_active":"2024-09-12T01:35:50.092766+0000","last_peered":"2024-09-12T01:35:50.092766+0000","last_clean":"2024-09-12T01:35:50.092766+0000","last_became_active":"2024-09-12T00:43:43.822237+0000","last_became_peered":"2024-09-12T00:43:43.822237+0000","last_unstale":"2024-09-12T01:35:50.092766+0000","last_undegraded":"2024-09-12T01:35:50.092766+0000","last_fullsized":"2024-09-12T01:35:50.092766+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:25.025447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'6","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.749584+0000","last_change":"2024-09-12T00:43:38.794264+0000","last_active":"2024-09-12T01:37:38.749584+0000","last_peered":"2024-09-12T01:37:38.749584+0000","last_clean":"2024-09-12T01:37:38.749584+0000","last_became_active":"2024-09-12T00:43:38.793943+0000","last_became_peered":"2024-09-12T00:43:38.793943+0000","last_unstale":"2024-09-12T01:37:38.749584+0000","last_undegraded":"2024-09-12T01:37:38.749584+0000","last_fullsized":"2024-09-12T01:37:38.749584+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:15.467403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11272,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"266'26","reported_seq":130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:30.090680+0000","last_change":"2024-09-12T00:39:17.770362+0000","last_active":"2024-09-12T01:35:30.090680+0000","last_peered":"2024-09-12T01:35:30.090680+0000","last_clean":"2024-09-12T01:35:30.090680+0000","last_became_active":"2024-09-12T00:39:17.770093+0000","last_became_peered":"2024-09-12T00:39:17.770093+0000","last_unstale":"2024-09-12T01:35:30.090680+0000","last_undegraded":"2024-09-12T01:35:30.090680+0000","last_fullsized":"2024-09-12T01:35:30.090680+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:56.241617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'194","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.691922+0000","last_change":"2024-09-12T00:25:00.480152+0000","last_active":"2024-09-12T01:37:38.691922+0000","last_peered":"2024-09-12T01:37:38.691922+0000","last_clean":"2024-09-12T01:37:38.691922+0000","last_became_active":"2024-09-12T00:25:00.479764+0000","last_became_peered":"2024-09-12T00:25:00.479764+0000","last_unstale":"2024-09-12T01:37:38.691922+0000","last_undegraded":"2024-09-12T01:37:38.691922+0000","last_fullsized":"2024-09-12T01:37:38.691922+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:56.463852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":6490,"num_write":862,"num_write_kb":17717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'383","reported_seq":1929,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194930+0000","last_change":"2024-09-12T00:25:02.474787+0000","last_active":"2024-09-12T01:36:11.194930+0000","last_peered":"2024-09-12T01:36:11.194930+0000","last_clean":"2024-09-12T01:36:11.194930+0000","last_became_active":"2024-09-12T00:25:02.474473+0000","last_became_peered":"2024-09-12T00:25:02.474473+0000","last_unstale":"2024-09-12T01:36:11.194930+0000","last_undegraded":"2024-09-12T01:36:11.194930+0000","last_fullsized":"2024-09-12T01:36:11.194930+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":300,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:43.534016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2167,"num_read_kb":2073,"num_write":418,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'235","reported_seq":975,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.882587+0000","last_change":"2024-09-12T00:25:00.469978+0000","last_active":"2024-09-12T01:37:38.882587+0000","last_peered":"2024-09-12T01:37:38.882587+0000","last_clean":"2024-09-12T01:37:38.882587+0000","last_became_active":"2024-09-12T00:25:00.469588+0000","last_became_peered":"2024-09-12T00:25:00.469588+0000","last_unstale":"2024-09-12T01:37:38.882587+0000","last_undegraded":"2024-09-12T01:37:38.882587+0000","last_fullsized":"2024-09-12T01:37:38.882587+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:49.105712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038976,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":700,"num_read_kb":64068,"num_write":1104,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'889","reported_seq":2575,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491254+0000","last_change":"2024-09-12T00:25:02.476425+0000","last_active":"2024-09-12T01:35:23.491254+0000","last_peered":"2024-09-12T01:35:23.491254+0000","last_clean":"2024-09-12T01:35:23.491254+0000","last_became_active":"2024-09-12T00:25:02.476131+0000","last_became_peered":"2024-09-12T00:25:02.476131+0000","last_unstale":"2024-09-12T01:35:23.491254+0000","last_undegraded":"2024-09-12T01:35:23.491254+0000","last_fullsized":"2024-09-12T01:35:23.491254+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:34.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4103,"num_read_kb":3695,"num_write":1128,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'210","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.856883+0000","last_change":"2024-09-12T00:25:00.458464+0000","last_active":"2024-09-12T01:37:38.856883+0000","last_peered":"2024-09-12T01:37:38.856883+0000","last_clean":"2024-09-12T01:37:38.856883+0000","last_became_active":"2024-09-12T00:25:00.458072+0000","last_became_peered":"2024-09-12T00:25:00.458072+0000","last_unstale":"2024-09-12T01:37:38.856883+0000","last_undegraded":"2024-09-12T01:37:38.856883+0000","last_fullsized":"2024-09-12T01:37:38.856883+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:23.740269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":12854,"num_write":984,"num_write_kb":25223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1325","reported_seq":2879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338584+0000","last_change":"2024-09-12T00:25:02.470846+0000","last_active":"2024-09-12T01:36:12.338584+0000","last_peered":"2024-09-12T01:36:12.338584+0000","last_clean":"2024-09-12T01:36:12.338584+0000","last_became_active":"2024-09-12T00:25:02.470249+0000","last_became_peered":"2024-09-12T00:25:02.470249+0000","last_unstale":"2024-09-12T01:36:12.338584+0000","last_undegraded":"2024-09-12T01:36:12.338584+0000","last_fullsized":"2024-09-12T01:36:12.338584+0000","mapping_epoch":28,"log_start":"266'1300","ondisk_log_start":"266'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:00.680374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5936,"num_read_kb":5183,"num_write":1890,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'198","reported_seq":833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.756641+0000","last_change":"2024-09-12T00:25:00.484283+0000","last_active":"2024-09-12T01:37:38.756641+0000","last_peered":"2024-09-12T01:37:38.756641+0000","last_clean":"2024-09-12T01:37:38.756641+0000","last_became_active":"2024-09-12T00:25:00.482357+0000","last_became_peered":"2024-09-12T00:25:00.482357+0000","last_unstale":"2024-09-12T01:37:38.756641+0000","last_undegraded":"2024-09-12T01:37:38.756641+0000","last_fullsized":"2024-09-12T01:37:38.756641+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:35.608009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":30861,"num_write":868,"num_write_kb":33122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'567","reported_seq":2114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.489600+0000","last_change":"2024-09-12T00:25:02.467647+0000","last_active":"2024-09-12T01:35:23.489600+0000","last_peered":"2024-09-12T01:35:23.489600+0000","last_clean":"2024-09-12T01:35:23.489600+0000","last_became_active":"2024-09-12T00:25:02.467378+0000","last_became_peered":"2024-09-12T00:25:02.467378+0000","last_unstale":"2024-09-12T01:35:23.489600+0000","last_undegraded":"2024-09-12T01:35:23.489600+0000","last_fullsized":"2024-09-12T01:35:23.489600+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":500,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:08.109241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2918,"num_read_kb":2656,"num_write":743,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'211","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.811655+0000","last_change":"2024-09-12T00:25:00.478922+0000","last_active":"2024-09-12T01:37:38.811655+0000","last_peered":"2024-09-12T01:37:38.811655+0000","last_clean":"2024-09-12T01:37:38.811655+0000","last_became_active":"2024-09-12T00:25:00.475340+0000","last_became_peered":"2024-09-12T00:25:00.475340+0000","last_unstale":"2024-09-12T01:37:38.811655+0000","last_undegraded":"2024-09-12T01:37:38.811655+0000","last_fullsized":"2024-09-12T01:37:38.811655+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:27.145736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":13966,"num_write":1015,"num_write_kb":23620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'571","reported_seq":2274,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428973+0000","last_change":"2024-09-12T00:25:02.474521+0000","last_active":"2024-09-12T01:37:18.428973+0000","last_peered":"2024-09-12T01:37:18.428973+0000","last_clean":"2024-09-12T01:37:18.428973+0000","last_became_active":"2024-09-12T00:25:02.474229+0000","last_became_peered":"2024-09-12T00:25:02.474229+0000","last_unstale":"2024-09-12T01:37:18.428973+0000","last_undegraded":"2024-09-12T01:37:18.428973+0000","last_fullsized":"2024-09-12T01:37:18.428973+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":500,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:59.636555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2896,"num_write":736,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'188","reported_seq":931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.689331+0000","last_change":"2024-09-12T00:25:00.488194+0000","last_active":"2024-09-12T01:37:38.689331+0000","last_peered":"2024-09-12T01:37:38.689331+0000","last_clean":"2024-09-12T01:37:38.689331+0000","last_became_active":"2024-09-12T00:25:00.487589+0000","last_became_peered":"2024-09-12T00:25:00.487589+0000","last_unstale":"2024-09-12T01:37:38.689331+0000","last_undegraded":"2024-09-12T01:37:38.689331+0000","last_fullsized":"2024-09-12T01:37:38.689331+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:00.587126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8822595,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":942,"num_read_kb":45033,"num_write":954,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'522","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.489583+0000","last_change":"2024-09-12T00:25:02.477683+0000","last_active":"2024-09-12T01:35:23.489583+0000","last_peered":"2024-09-12T01:35:23.489583+0000","last_clean":"2024-09-12T01:35:23.489583+0000","last_became_active":"2024-09-12T00:25:02.477395+0000","last_became_peered":"2024-09-12T00:25:02.477395+0000","last_unstale":"2024-09-12T01:35:23.489583+0000","last_undegraded":"2024-09-12T01:35:23.489583+0000","last_fullsized":"2024-09-12T01:35:23.489583+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":500,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:51.177502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3189,"num_read_kb":3033,"num_write":616,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'234","reported_seq":895,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.765765+0000","last_change":"2024-09-12T00:25:00.478053+0000","last_active":"2024-09-12T01:37:38.765765+0000","last_peered":"2024-09-12T01:37:38.765765+0000","last_clean":"2024-09-12T01:37:38.765765+0000","last_became_active":"2024-09-12T00:25:00.477590+0000","last_became_peered":"2024-09-12T00:25:00.477590+0000","last_unstale":"2024-09-12T01:37:38.765765+0000","last_undegraded":"2024-09-12T01:37:38.765765+0000","last_fullsized":"2024-09-12T01:37:38.765765+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:54:08.585286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048652,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":24485,"num_write":1039,"num_write_kb":27596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'375","reported_seq":1757,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.789775+0000","last_change":"2024-09-12T00:25:02.466712+0000","last_active":"2024-09-12T01:34:32.789775+0000","last_peered":"2024-09-12T01:34:32.789775+0000","last_clean":"2024-09-12T01:34:32.789775+0000","last_became_active":"2024-09-12T00:25:02.466439+0000","last_became_peered":"2024-09-12T00:25:02.466439+0000","last_unstale":"2024-09-12T01:34:32.789775+0000","last_undegraded":"2024-09-12T01:34:32.789775+0000","last_fullsized":"2024-09-12T01:34:32.789775+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:59.619974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1739,"num_write":422,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'188","reported_seq":793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:34.025271+0000","last_change":"2024-09-12T00:25:00.472775+0000","last_active":"2024-09-12T01:37:34.025271+0000","last_peered":"2024-09-12T01:37:34.025271+0000","last_clean":"2024-09-12T01:37:34.025271+0000","last_became_active":"2024-09-12T00:25:00.472046+0000","last_became_peered":"2024-09-12T00:25:00.472046+0000","last_unstale":"2024-09-12T01:37:34.025271+0000","last_undegraded":"2024-09-12T01:37:34.025271+0000","last_fullsized":"2024-09-12T01:37:34.025271+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:47.088983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":23076,"num_write":837,"num_write_kb":28135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'364","reported_seq":1839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428522+0000","last_change":"2024-09-12T00:25:02.475079+0000","last_active":"2024-09-12T01:37:18.428522+0000","last_peered":"2024-09-12T01:37:18.428522+0000","last_clean":"2024-09-12T01:37:18.428522+0000","last_became_active":"2024-09-12T00:25:02.474791+0000","last_became_peered":"2024-09-12T00:25:02.474791+0000","last_unstale":"2024-09-12T01:37:18.428522+0000","last_undegraded":"2024-09-12T01:37:18.428522+0000","last_fullsized":"2024-09-12T01:37:18.428522+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:06.924137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2089,"num_read_kb":2020,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'476","reported_seq":2145,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428799+0000","last_change":"2024-09-12T00:25:02.471996+0000","last_active":"2024-09-12T01:37:18.428799+0000","last_peered":"2024-09-12T01:37:18.428799+0000","last_clean":"2024-09-12T01:37:18.428799+0000","last_became_active":"2024-09-12T00:25:02.471545+0000","last_became_peered":"2024-09-12T00:25:02.471545+0000","last_unstale":"2024-09-12T01:37:18.428799+0000","last_undegraded":"2024-09-12T01:37:18.428799+0000","last_fullsized":"2024-09-12T01:37:18.428799+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:19.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2642,"num_read_kb":2498,"num_write":559,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'202","reported_seq":1062,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.795716+0000","last_change":"2024-09-12T00:25:00.465180+0000","last_active":"2024-09-12T01:37:38.795716+0000","last_peered":"2024-09-12T01:37:38.795716+0000","last_clean":"2024-09-12T01:37:38.795716+0000","last_became_active":"2024-09-12T00:25:00.464783+0000","last_became_peered":"2024-09-12T00:25:00.464783+0000","last_unstale":"2024-09-12T01:37:38.795716+0000","last_undegraded":"2024-09-12T01:37:38.795716+0000","last_fullsized":"2024-09-12T01:37:38.795716+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":967,"num_read_kb":27994,"num_write":1073,"num_write_kb":26373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'501","reported_seq":2068,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.981007+0000","last_change":"2024-09-12T00:25:02.475307+0000","last_active":"2024-09-12T01:35:04.981007+0000","last_peered":"2024-09-12T01:35:04.981007+0000","last_clean":"2024-09-12T01:35:04.981007+0000","last_became_active":"2024-09-12T00:25:02.475032+0000","last_became_peered":"2024-09-12T00:25:02.475032+0000","last_unstale":"2024-09-12T01:35:04.981007+0000","last_undegraded":"2024-09-12T01:35:04.981007+0000","last_fullsized":"2024-09-12T01:35:04.981007+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":400,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:48.727325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2653,"num_read_kb":2473,"num_write":625,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'211","reported_seq":844,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.847224+0000","last_change":"2024-09-12T00:25:00.480048+0000","last_active":"2024-09-12T01:37:38.847224+0000","last_peered":"2024-09-12T01:37:38.847224+0000","last_clean":"2024-09-12T01:37:38.847224+0000","last_became_active":"2024-09-12T00:25:00.479635+0000","last_became_peered":"2024-09-12T00:25:00.479635+0000","last_unstale":"2024-09-12T01:37:38.847224+0000","last_undegraded":"2024-09-12T01:37:38.847224+0000","last_fullsized":"2024-09-12T01:37:38.847224+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:28.545600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279168,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":30051,"num_write":937,"num_write_kb":51711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'1150","reported_seq":2931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801039+0000","last_change":"2024-09-12T00:25:02.467494+0000","last_active":"2024-09-12T01:35:34.801039+0000","last_peered":"2024-09-12T01:35:34.801039+0000","last_clean":"2024-09-12T01:35:34.801039+0000","last_became_active":"2024-09-12T00:25:02.467224+0000","last_became_peered":"2024-09-12T00:25:02.467224+0000","last_unstale":"2024-09-12T01:35:34.801039+0000","last_undegraded":"2024-09-12T01:35:34.801039+0000","last_fullsized":"2024-09-12T01:35:34.801039+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":1100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:38.270517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5645,"num_read_kb":4973,"num_write":1729,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'210","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.858824+0000","last_change":"2024-09-12T00:25:00.477548+0000","last_active":"2024-09-12T01:37:38.858824+0000","last_peered":"2024-09-12T01:37:38.858824+0000","last_clean":"2024-09-12T01:37:38.858824+0000","last_became_active":"2024-09-12T00:25:00.477184+0000","last_became_peered":"2024-09-12T00:25:00.477184+0000","last_unstale":"2024-09-12T01:37:38.858824+0000","last_undegraded":"2024-09-12T01:37:38.858824+0000","last_fullsized":"2024-09-12T01:37:38.858824+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:29:16.176834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3321654,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":408,"num_read_kb":20227,"num_write":1015,"num_write_kb":31572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'485","reported_seq":2016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.490363+0000","last_change":"2024-09-12T00:25:02.469723+0000","last_active":"2024-09-12T01:35:19.490363+0000","last_peered":"2024-09-12T01:35:19.490363+0000","last_clean":"2024-09-12T01:35:19.490363+0000","last_became_active":"2024-09-12T00:25:02.469463+0000","last_became_peered":"2024-09-12T00:25:02.469463+0000","last_unstale":"2024-09-12T01:35:19.490363+0000","last_undegraded":"2024-09-12T01:35:19.490363+0000","last_fullsized":"2024-09-12T01:35:19.490363+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":400,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:41.693227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2387,"num_write":615,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'190","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.733785+0000","last_change":"2024-09-12T00:25:00.483752+0000","last_active":"2024-09-12T01:37:38.733785+0000","last_peered":"2024-09-12T01:37:38.733785+0000","last_clean":"2024-09-12T01:37:38.733785+0000","last_became_active":"2024-09-12T00:25:00.483327+0000","last_became_peered":"2024-09-12T00:25:00.483327+0000","last_unstale":"2024-09-12T01:37:38.733785+0000","last_undegraded":"2024-09-12T01:37:38.733785+0000","last_fullsized":"2024-09-12T01:37:38.733785+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.085933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395812,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":12020,"num_write":922,"num_write_kb":12011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'406","reported_seq":1997,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491334+0000","last_change":"2024-09-12T00:25:02.472828+0000","last_active":"2024-09-12T01:35:23.491334+0000","last_peered":"2024-09-12T01:35:23.491334+0000","last_clean":"2024-09-12T01:35:23.491334+0000","last_became_active":"2024-09-12T00:25:02.471598+0000","last_became_peered":"2024-09-12T00:25:02.471598+0000","last_unstale":"2024-09-12T01:35:23.491334+0000","last_undegraded":"2024-09-12T01:35:23.491334+0000","last_fullsized":"2024-09-12T01:35:23.491334+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:34.396174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2389,"num_read_kb":2272,"num_write":462,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'177","reported_seq":836,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.857878+0000","last_change":"2024-09-12T00:25:00.478611+0000","last_active":"2024-09-12T01:37:38.857878+0000","last_peered":"2024-09-12T01:37:38.857878+0000","last_clean":"2024-09-12T01:37:38.857878+0000","last_became_active":"2024-09-12T00:25:00.478202+0000","last_became_peered":"2024-09-12T00:25:00.478202+0000","last_unstale":"2024-09-12T01:37:38.857878+0000","last_undegraded":"2024-09-12T01:37:38.857878+0000","last_fullsized":"2024-09-12T01:37:38.857878+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:15.648085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":78408,"num_write":837,"num_write_kb":24955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'664","reported_seq":2197,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088854+0000","last_change":"2024-09-12T00:25:02.470543+0000","last_active":"2024-09-12T01:35:09.088854+0000","last_peered":"2024-09-12T01:35:09.088854+0000","last_clean":"2024-09-12T01:35:09.088854+0000","last_became_active":"2024-09-12T00:25:02.470278+0000","last_became_peered":"2024-09-12T00:25:02.470278+0000","last_unstale":"2024-09-12T01:35:09.088854+0000","last_undegraded":"2024-09-12T01:35:09.088854+0000","last_fullsized":"2024-09-12T01:35:09.088854+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":600,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:56.843342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3455,"num_read_kb":3151,"num_write":936,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'238","reported_seq":907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.900002+0000","last_change":"2024-09-12T00:25:00.457125+0000","last_active":"2024-09-12T01:37:38.900002+0000","last_peered":"2024-09-12T01:37:38.900002+0000","last_clean":"2024-09-12T01:37:38.900002+0000","last_became_active":"2024-09-12T00:25:00.456765+0000","last_became_peered":"2024-09-12T00:25:00.456765+0000","last_unstale":"2024-09-12T01:37:38.900002+0000","last_undegraded":"2024-09-12T01:37:38.900002+0000","last_fullsized":"2024-09-12T01:37:38.900002+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:03.452813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496550,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":628,"num_read_kb":22861,"num_write":1212,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'129","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.484498+0000","last_change":"2024-09-12T00:25:10.523473+0000","last_active":"2024-09-12T01:36:12.484498+0000","last_peered":"2024-09-12T01:36:12.484498+0000","last_clean":"2024-09-12T01:36:12.484498+0000","last_became_active":"2024-09-12T00:25:10.523187+0000","last_became_peered":"2024-09-12T00:25:10.523187+0000","last_unstale":"2024-09-12T01:36:12.484498+0000","last_undegraded":"2024-09-12T01:36:12.484498+0000","last_fullsized":"2024-09-12T01:36:12.484498+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:03.075928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'447","reported_seq":2134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.182637+0000","last_change":"2024-09-12T00:25:02.464400+0000","last_active":"2024-09-12T01:35:24.182637+0000","last_peered":"2024-09-12T01:35:24.182637+0000","last_clean":"2024-09-12T01:35:24.182637+0000","last_became_active":"2024-09-12T00:25:02.464035+0000","last_became_peered":"2024-09-12T00:25:02.464035+0000","last_unstale":"2024-09-12T01:35:24.182637+0000","last_undegraded":"2024-09-12T01:35:24.182637+0000","last_fullsized":"2024-09-12T01:35:24.182637+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:21.803044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2614,"num_read_kb":2487,"num_write":526,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'214","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.794938+0000","last_change":"2024-09-12T00:25:00.479724+0000","last_active":"2024-09-12T01:37:38.794938+0000","last_peered":"2024-09-12T01:37:38.794938+0000","last_clean":"2024-09-12T01:37:38.794938+0000","last_became_active":"2024-09-12T00:25:00.479335+0000","last_became_peered":"2024-09-12T00:25:00.479335+0000","last_unstale":"2024-09-12T01:37:38.794938+0000","last_undegraded":"2024-09-12T01:37:38.794938+0000","last_fullsized":"2024-09-12T01:37:38.794938+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:52.582972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1920160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":7515,"num_write":984,"num_write_kb":32910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534500+0000","last_change":"2024-09-12T00:25:04.485699+0000","last_active":"2024-09-12T01:35:09.534500+0000","last_peered":"2024-09-12T01:35:09.534500+0000","last_clean":"2024-09-12T01:35:09.534500+0000","last_became_active":"2024-09-12T00:25:04.485389+0000","last_became_peered":"2024-09-12T00:25:04.485389+0000","last_unstale":"2024-09-12T01:35:09.534500+0000","last_undegraded":"2024-09-12T01:35:09.534500+0000","last_fullsized":"2024-09-12T01:35:09.534500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:42.240804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'220","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.635957+0000","last_change":"2024-09-12T00:25:06.500211+0000","last_active":"2024-09-12T01:37:38.635957+0000","last_peered":"2024-09-12T01:37:38.635957+0000","last_clean":"2024-09-12T01:37:38.635957+0000","last_became_active":"2024-09-12T00:25:06.499933+0000","last_became_peered":"2024-09-12T00:25:06.499933+0000","last_unstale":"2024-09-12T01:37:38.635957+0000","last_undegraded":"2024-09-12T01:37:38.635957+0000","last_fullsized":"2024-09-12T01:37:38.635957+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:46.967892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7477,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":376,"num_write":176,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.089450+0000","last_change":"2024-09-12T00:25:08.501552+0000","last_active":"2024-09-12T01:35:14.089450+0000","last_peered":"2024-09-12T01:35:14.089450+0000","last_clean":"2024-09-12T01:35:14.089450+0000","last_became_active":"2024-09-12T00:25:08.501137+0000","last_became_peered":"2024-09-12T00:25:08.501137+0000","last_unstale":"2024-09-12T01:35:14.089450+0000","last_undegraded":"2024-09-12T01:35:14.089450+0000","last_fullsized":"2024-09-12T01:35:14.089450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:02.147605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2435","reported_seq":4332,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.040799+0000","last_change":"2024-09-12T00:25:10.526327+0000","last_active":"2024-09-12T01:36:12.040799+0000","last_peered":"2024-09-12T01:36:12.040799+0000","last_clean":"2024-09-12T01:36:12.040799+0000","last_became_active":"2024-09-12T00:25:10.526016+0000","last_became_peered":"2024-09-12T00:25:10.526016+0000","last_unstale":"2024-09-12T01:36:12.040799+0000","last_undegraded":"2024-09-12T01:36:12.040799+0000","last_fullsized":"2024-09-12T01:36:12.040799+0000","mapping_epoch":36,"log_start":"266'2400","ondisk_log_start":"266'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":2400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:25.344444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6097,"num_read_kb":6097,"num_write":4851,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'891","reported_seq":2330,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428993+0000","last_change":"2024-09-12T00:25:02.477964+0000","last_active":"2024-09-12T01:37:18.428993+0000","last_peered":"2024-09-12T01:37:18.428993+0000","last_clean":"2024-09-12T01:37:18.428993+0000","last_became_active":"2024-09-12T00:25:02.477360+0000","last_became_peered":"2024-09-12T00:25:02.477360+0000","last_unstale":"2024-09-12T01:37:18.428993+0000","last_undegraded":"2024-09-12T01:37:18.428993+0000","last_fullsized":"2024-09-12T01:37:18.428993+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:52.094792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4073,"num_read_kb":3587,"num_write":1238,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'213","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.810139+0000","last_change":"2024-09-12T00:25:00.452665+0000","last_active":"2024-09-12T01:37:38.810139+0000","last_peered":"2024-09-12T01:37:38.810139+0000","last_clean":"2024-09-12T01:37:38.810139+0000","last_became_active":"2024-09-12T00:25:00.452236+0000","last_became_peered":"2024-09-12T00:25:00.452236+0000","last_unstale":"2024-09-12T01:37:38.810139+0000","last_undegraded":"2024-09-12T01:37:38.810139+0000","last_fullsized":"2024-09-12T01:37:38.810139+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:05.744126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084046,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":27979,"num_write":1022,"num_write_kb":43410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.254402+0000","last_change":"2024-09-12T00:25:04.481555+0000","last_active":"2024-09-12T01:35:17.254402+0000","last_peered":"2024-09-12T01:35:17.254402+0000","last_clean":"2024-09-12T01:35:17.254402+0000","last_became_active":"2024-09-12T00:25:04.481218+0000","last_became_peered":"2024-09-12T00:25:04.481218+0000","last_unstale":"2024-09-12T01:35:17.254402+0000","last_undegraded":"2024-09-12T01:35:17.254402+0000","last_fullsized":"2024-09-12T01:35:17.254402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:06.324093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'127","reported_seq":676,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.201882+0000","last_change":"2024-09-12T00:25:06.490765+0000","last_active":"2024-09-12T01:35:55.201882+0000","last_peered":"2024-09-12T01:35:55.201882+0000","last_clean":"2024-09-12T01:35:55.201882+0000","last_became_active":"2024-09-12T00:25:06.490463+0000","last_became_peered":"2024-09-12T00:25:06.490463+0000","last_unstale":"2024-09-12T01:35:55.201882+0000","last_undegraded":"2024-09-12T01:35:55.201882+0000","last_fullsized":"2024-09-12T01:35:55.201882+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:30.310748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":131,"num_write":102,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.089409+0000","last_change":"2024-09-12T00:25:08.505822+0000","last_active":"2024-09-12T01:35:14.089409+0000","last_peered":"2024-09-12T01:35:14.089409+0000","last_clean":"2024-09-12T01:35:14.089409+0000","last_became_active":"2024-09-12T00:25:08.505492+0000","last_became_peered":"2024-09-12T00:25:08.505492+0000","last_unstale":"2024-09-12T01:35:14.089409+0000","last_undegraded":"2024-09-12T01:35:14.089409+0000","last_fullsized":"2024-09-12T01:35:14.089409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:49.241744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'139","reported_seq":660,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.420519+0000","last_change":"2024-09-12T00:25:10.523127+0000","last_active":"2024-09-12T01:37:18.420519+0000","last_peered":"2024-09-12T01:37:18.420519+0000","last_clean":"2024-09-12T01:37:18.420519+0000","last_became_active":"2024-09-12T00:25:10.522822+0000","last_became_peered":"2024-09-12T00:25:10.522822+0000","last_unstale":"2024-09-12T01:37:18.420519+0000","last_undegraded":"2024-09-12T01:37:18.420519+0000","last_fullsized":"2024-09-12T01:37:18.420519+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:39.986321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":196,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'482","reported_seq":2022,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.002276+0000","last_change":"2024-09-12T00:25:02.479138+0000","last_active":"2024-09-12T01:35:09.002276+0000","last_peered":"2024-09-12T01:35:09.002276+0000","last_clean":"2024-09-12T01:35:09.002276+0000","last_became_active":"2024-09-12T00:25:02.478850+0000","last_became_peered":"2024-09-12T00:25:02.478850+0000","last_unstale":"2024-09-12T01:35:09.002276+0000","last_undegraded":"2024-09-12T01:35:09.002276+0000","last_fullsized":"2024-09-12T01:35:09.002276+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:31.778936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2311,"num_write":575,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'203","reported_seq":863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.703784+0000","last_change":"2024-09-12T00:25:00.476041+0000","last_active":"2024-09-12T01:37:38.703784+0000","last_peered":"2024-09-12T01:37:38.703784+0000","last_clean":"2024-09-12T01:37:38.703784+0000","last_became_active":"2024-09-12T00:25:00.475628+0000","last_became_peered":"2024-09-12T00:25:00.475628+0000","last_unstale":"2024-09-12T01:37:38.703784+0000","last_undegraded":"2024-09-12T01:37:38.703784+0000","last_fullsized":"2024-09-12T01:37:38.703784+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:14.169208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":1110,"num_write":851,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:12.253498+0000","last_change":"2024-09-12T00:25:04.484287+0000","last_active":"2024-09-12T01:35:12.253498+0000","last_peered":"2024-09-12T01:35:12.253498+0000","last_clean":"2024-09-12T01:35:12.253498+0000","last_became_active":"2024-09-12T00:25:04.483774+0000","last_became_peered":"2024-09-12T00:25:04.483774+0000","last_unstale":"2024-09-12T01:35:12.253498+0000","last_undegraded":"2024-09-12T01:35:12.253498+0000","last_fullsized":"2024-09-12T01:35:12.253498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:26.376424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'143","reported_seq":719,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.415267+0000","last_change":"2024-09-12T00:25:06.501549+0000","last_active":"2024-09-12T01:36:07.415267+0000","last_peered":"2024-09-12T01:36:07.415267+0000","last_clean":"2024-09-12T01:36:07.415267+0000","last_became_active":"2024-09-12T00:25:06.500991+0000","last_became_peered":"2024-09-12T00:25:06.500991+0000","last_unstale":"2024-09-12T01:36:07.415267+0000","last_undegraded":"2024-09-12T01:36:07.415267+0000","last_fullsized":"2024-09-12T01:36:07.415267+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:31.699237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'797","reported_seq":4866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.920566+0000","last_change":"2024-09-12T00:25:08.514676+0000","last_active":"2024-09-12T01:37:38.920566+0000","last_peered":"2024-09-12T01:37:38.920566+0000","last_clean":"2024-09-12T01:37:38.920566+0000","last_became_active":"2024-09-12T00:25:08.514360+0000","last_became_peered":"2024-09-12T00:25:08.514360+0000","last_unstale":"2024-09-12T01:37:38.920566+0000","last_undegraded":"2024-09-12T01:37:38.920566+0000","last_fullsized":"2024-09-12T01:37:38.920566+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:19.747805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'202","reported_seq":1037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.546065+0000","last_change":"2024-09-12T00:25:10.519173+0000","last_active":"2024-09-12T01:36:12.546065+0000","last_peered":"2024-09-12T01:36:12.546065+0000","last_clean":"2024-09-12T01:36:12.546065+0000","last_became_active":"2024-09-12T00:25:10.518861+0000","last_became_peered":"2024-09-12T00:25:10.518861+0000","last_unstale":"2024-09-12T01:36:12.546065+0000","last_undegraded":"2024-09-12T01:36:12.546065+0000","last_fullsized":"2024-09-12T01:36:12.546065+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:28.784023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":600,"num_write":435,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'466","reported_seq":1986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491174+0000","last_change":"2024-09-12T00:25:02.477428+0000","last_active":"2024-09-12T01:35:23.491174+0000","last_peered":"2024-09-12T01:35:23.491174+0000","last_clean":"2024-09-12T01:35:23.491174+0000","last_became_active":"2024-09-12T00:25:02.477052+0000","last_became_peered":"2024-09-12T00:25:02.477052+0000","last_unstale":"2024-09-12T01:35:23.491174+0000","last_undegraded":"2024-09-12T01:35:23.491174+0000","last_fullsized":"2024-09-12T01:35:23.491174+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:47.054845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2388,"num_read_kb":2234,"num_write":549,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'224","reported_seq":869,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.691028+0000","last_change":"2024-09-12T00:25:00.458865+0000","last_active":"2024-09-12T01:37:38.691028+0000","last_peered":"2024-09-12T01:37:38.691028+0000","last_clean":"2024-09-12T01:37:38.691028+0000","last_became_active":"2024-09-12T00:25:00.457828+0000","last_became_peered":"2024-09-12T00:25:00.457828+0000","last_unstale":"2024-09-12T01:37:38.691028+0000","last_undegraded":"2024-09-12T01:37:38.691028+0000","last_fullsized":"2024-09-12T01:37:38.691028+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:20.656353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":9782,"num_write":1039,"num_write_kb":35060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534518+0000","last_change":"2024-09-12T00:25:04.482494+0000","last_active":"2024-09-12T01:35:09.534518+0000","last_peered":"2024-09-12T01:35:09.534518+0000","last_clean":"2024-09-12T01:35:09.534518+0000","last_became_active":"2024-09-12T00:25:04.482173+0000","last_became_peered":"2024-09-12T00:25:04.482173+0000","last_unstale":"2024-09-12T01:35:09.534518+0000","last_undegraded":"2024-09-12T01:35:09.534518+0000","last_fullsized":"2024-09-12T01:35:09.534518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:38.300401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'158","reported_seq":751,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.915794+0000","last_change":"2024-09-12T00:25:06.491652+0000","last_active":"2024-09-12T01:37:38.915794+0000","last_peered":"2024-09-12T01:37:38.915794+0000","last_clean":"2024-09-12T01:37:38.915794+0000","last_became_active":"2024-09-12T00:25:06.491337+0000","last_became_peered":"2024-09-12T00:25:06.491337+0000","last_unstale":"2024-09-12T01:37:38.915794+0000","last_undegraded":"2024-09-12T01:37:38.915794+0000","last_fullsized":"2024-09-12T01:37:38.915794+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:08.948500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5611,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":280,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'801","reported_seq":2768,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.924992+0000","last_change":"2024-09-12T00:25:08.512430+0000","last_active":"2024-09-12T01:37:38.924992+0000","last_peered":"2024-09-12T01:37:38.924992+0000","last_clean":"2024-09-12T01:37:38.924992+0000","last_became_active":"2024-09-12T00:25:08.512125+0000","last_became_peered":"2024-09-12T00:25:08.512125+0000","last_unstale":"2024-09-12T01:37:38.924992+0000","last_undegraded":"2024-09-12T01:37:38.924992+0000","last_fullsized":"2024-09-12T01:37:38.924992+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:52.436088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'2025","reported_seq":3645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338541+0000","last_change":"2024-09-12T00:25:02.465523+0000","last_active":"2024-09-12T01:36:12.338541+0000","last_peered":"2024-09-12T01:36:12.338541+0000","last_clean":"2024-09-12T01:36:12.338541+0000","last_became_active":"2024-09-12T00:25:02.465239+0000","last_became_peered":"2024-09-12T00:25:02.465239+0000","last_unstale":"2024-09-12T01:36:12.338541+0000","last_undegraded":"2024-09-12T01:36:12.338541+0000","last_fullsized":"2024-09-12T01:36:12.338541+0000","mapping_epoch":28,"log_start":"266'2000","ondisk_log_start":"266'2000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":2000,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:57.527506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8773,"num_read_kb":7539,"num_write":2902,"num_write_kb":1299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'179","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.933037+0000","last_change":"2024-09-12T01:37:44.933037+0000","last_active":"2024-09-12T01:37:44.933037+0000","last_peered":"2024-09-12T01:37:44.933037+0000","last_clean":"2024-09-12T01:37:44.933037+0000","last_became_active":"2024-09-12T00:25:00.466899+0000","last_became_peered":"2024-09-12T00:25:00.466899+0000","last_unstale":"2024-09-12T01:37:44.933037+0000","last_undegraded":"2024-09-12T01:37:44.933037+0000","last_fullsized":"2024-09-12T01:37:44.933037+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'179","last_scrub_stamp":"2024-09-12T01:37:44.932938+0000","last_deep_scrub":"266'179","last_deep_scrub_stamp":"2024-09-12T01:37:44.932938+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.932938+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:07.942233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":366,"num_read_kb":8806,"num_write":851,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.084136+0000","last_change":"2024-09-12T00:25:04.483191+0000","last_active":"2024-09-12T01:34:24.084136+0000","last_peered":"2024-09-12T01:34:24.084136+0000","last_clean":"2024-09-12T01:34:24.084136+0000","last_became_active":"2024-09-12T00:25:04.482885+0000","last_became_peered":"2024-09-12T00:25:04.482885+0000","last_unstale":"2024-09-12T01:34:24.084136+0000","last_undegraded":"2024-09-12T01:34:24.084136+0000","last_fullsized":"2024-09-12T01:34:24.084136+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:29.397137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'264","reported_seq":917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.662698+0000","last_change":"2024-09-12T00:25:06.498236+0000","last_active":"2024-09-12T01:37:38.662698+0000","last_peered":"2024-09-12T01:37:38.662698+0000","last_clean":"2024-09-12T01:37:38.662698+0000","last_became_active":"2024-09-12T00:25:06.497881+0000","last_became_peered":"2024-09-12T00:25:06.497881+0000","last_unstale":"2024-09-12T01:37:38.662698+0000","last_undegraded":"2024-09-12T01:37:38.662698+0000","last_fullsized":"2024-09-12T01:37:38.662698+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":200,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:36.459394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20748,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":371,"num_read_kb":470,"num_write":222,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.178342+0000","last_change":"2024-09-12T00:25:08.508274+0000","last_active":"2024-09-12T01:34:54.178342+0000","last_peered":"2024-09-12T01:34:54.178342+0000","last_clean":"2024-09-12T01:34:54.178342+0000","last_became_active":"2024-09-12T00:25:08.507993+0000","last_became_peered":"2024-09-12T00:25:08.507993+0000","last_unstale":"2024-09-12T01:34:54.178342+0000","last_undegraded":"2024-09-12T01:34:54.178342+0000","last_fullsized":"2024-09-12T01:34:54.178342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:26.028970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'572","reported_seq":1417,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.565060+0000","last_change":"2024-09-12T00:25:10.528237+0000","last_active":"2024-09-12T01:37:19.565060+0000","last_peered":"2024-09-12T01:37:19.565060+0000","last_clean":"2024-09-12T01:37:19.565060+0000","last_became_active":"2024-09-12T00:25:10.528021+0000","last_became_peered":"2024-09-12T00:25:10.528021+0000","last_unstale":"2024-09-12T01:37:19.565060+0000","last_undegraded":"2024-09-12T01:37:19.565060+0000","last_fullsized":"2024-09-12T01:37:19.565060+0000","mapping_epoch":36,"log_start":"266'500","ondisk_log_start":"266'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:14.269299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1390,"num_read_kb":1363,"num_write":1223,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'492","reported_seq":2153,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.488491+0000","last_change":"2024-09-12T00:25:02.468103+0000","last_active":"2024-09-12T01:35:19.488491+0000","last_peered":"2024-09-12T01:35:19.488491+0000","last_clean":"2024-09-12T01:35:19.488491+0000","last_became_active":"2024-09-12T00:25:02.467846+0000","last_became_peered":"2024-09-12T00:25:02.467846+0000","last_unstale":"2024-09-12T01:35:19.488491+0000","last_undegraded":"2024-09-12T01:35:19.488491+0000","last_fullsized":"2024-09-12T01:35:19.488491+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":400,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:33.654734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2600,"num_read_kb":2447,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'208","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.530686+0000","last_change":"2024-09-12T01:37:44.530686+0000","last_active":"2024-09-12T01:37:44.530686+0000","last_peered":"2024-09-12T01:37:44.530686+0000","last_clean":"2024-09-12T01:37:44.530686+0000","last_became_active":"2024-09-12T00:25:00.486471+0000","last_became_peered":"2024-09-12T00:25:00.486471+0000","last_unstale":"2024-09-12T01:37:44.530686+0000","last_undegraded":"2024-09-12T01:37:44.530686+0000","last_fullsized":"2024-09-12T01:37:44.530686+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:37:44.530555+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:37:44.530555+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.530555+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.391104+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706427,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":18784,"num_write":969,"num_write_kb":38470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.174174+0000","last_change":"2024-09-12T00:25:04.480755+0000","last_active":"2024-09-12T01:34:24.174174+0000","last_peered":"2024-09-12T01:34:24.174174+0000","last_clean":"2024-09-12T01:34:24.174174+0000","last_became_active":"2024-09-12T00:25:04.480469+0000","last_became_peered":"2024-09-12T00:25:04.480469+0000","last_unstale":"2024-09-12T01:34:24.174174+0000","last_undegraded":"2024-09-12T01:34:24.174174+0000","last_fullsized":"2024-09-12T01:34:24.174174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:20.229017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'148","reported_seq":748,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.823722+0000","last_change":"2024-09-12T00:25:06.500291+0000","last_active":"2024-09-12T01:37:38.823722+0000","last_peered":"2024-09-12T01:37:38.823722+0000","last_clean":"2024-09-12T01:37:38.823722+0000","last_became_active":"2024-09-12T00:25:06.500036+0000","last_became_peered":"2024-09-12T00:25:06.500036+0000","last_unstale":"2024-09-12T01:37:38.823722+0000","last_undegraded":"2024-09-12T01:37:38.823722+0000","last_fullsized":"2024-09-12T01:37:38.823722+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:40.715748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11217,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":248,"num_write":100,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:42.248759+0000","last_change":"2024-09-12T00:25:08.510086+0000","last_active":"2024-09-12T01:34:42.248759+0000","last_peered":"2024-09-12T01:34:42.248759+0000","last_clean":"2024-09-12T01:34:42.248759+0000","last_became_active":"2024-09-12T00:25:08.509780+0000","last_became_peered":"2024-09-12T00:25:08.509780+0000","last_unstale":"2024-09-12T01:34:42.248759+0000","last_undegraded":"2024-09-12T01:34:42.248759+0000","last_fullsized":"2024-09-12T01:34:42.248759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:23.294463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'144","reported_seq":649,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:14.095922+0000","last_change":"2024-09-12T00:25:10.528275+0000","last_active":"2024-09-12T01:36:14.095922+0000","last_peered":"2024-09-12T01:36:14.095922+0000","last_clean":"2024-09-12T01:36:14.095922+0000","last_became_active":"2024-09-12T00:25:10.527984+0000","last_became_peered":"2024-09-12T00:25:10.527984+0000","last_unstale":"2024-09-12T01:36:14.095922+0000","last_undegraded":"2024-09-12T01:36:14.095922+0000","last_fullsized":"2024-09-12T01:36:14.095922+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:42.118932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":124,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'452","reported_seq":2015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801286+0000","last_change":"2024-09-12T00:25:02.469437+0000","last_active":"2024-09-12T01:35:34.801286+0000","last_peered":"2024-09-12T01:35:34.801286+0000","last_clean":"2024-09-12T01:35:34.801286+0000","last_became_active":"2024-09-12T00:25:02.469155+0000","last_became_peered":"2024-09-12T00:25:02.469155+0000","last_unstale":"2024-09-12T01:35:34.801286+0000","last_undegraded":"2024-09-12T01:35:34.801286+0000","last_fullsized":"2024-09-12T01:35:34.801286+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:28.701935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2451,"num_write":541,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'226","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.815420+0000","last_change":"2024-09-12T00:25:32.564364+0000","last_active":"2024-09-12T01:37:38.815420+0000","last_peered":"2024-09-12T01:37:38.815420+0000","last_clean":"2024-09-12T01:37:38.815420+0000","last_became_active":"2024-09-12T00:25:32.563811+0000","last_became_peered":"2024-09-12T00:25:32.563811+0000","last_unstale":"2024-09-12T01:37:38.815420+0000","last_undegraded":"2024-09-12T01:37:38.815420+0000","last_fullsized":"2024-09-12T01:37:38.815420+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:39.825680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442172,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":15150,"num_write":1090,"num_write_kb":21884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:48.998771+0000","last_change":"2024-09-12T00:25:04.484649+0000","last_active":"2024-09-12T01:34:48.998771+0000","last_peered":"2024-09-12T01:34:48.998771+0000","last_clean":"2024-09-12T01:34:48.998771+0000","last_became_active":"2024-09-12T00:25:04.484029+0000","last_became_peered":"2024-09-12T00:25:04.484029+0000","last_unstale":"2024-09-12T01:34:48.998771+0000","last_undegraded":"2024-09-12T01:34:48.998771+0000","last_fullsized":"2024-09-12T01:34:48.998771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:29.267578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'217","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.698221+0000","last_change":"2024-09-12T00:25:06.496644+0000","last_active":"2024-09-12T01:37:38.698221+0000","last_peered":"2024-09-12T01:37:38.698221+0000","last_clean":"2024-09-12T01:37:38.698221+0000","last_became_active":"2024-09-12T00:25:06.496348+0000","last_became_peered":"2024-09-12T00:25:06.496348+0000","last_unstale":"2024-09-12T01:37:38.698221+0000","last_undegraded":"2024-09-12T01:37:38.698221+0000","last_fullsized":"2024-09-12T01:37:38.698221+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:12.917394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22554,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":293,"num_read_kb":420,"num_write":176,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'800","reported_seq":4588,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.531846+0000","last_change":"2024-09-12T00:25:08.512365+0000","last_active":"2024-09-12T01:37:38.531846+0000","last_peered":"2024-09-12T01:37:38.531846+0000","last_clean":"2024-09-12T01:37:38.531846+0000","last_became_active":"2024-09-12T00:25:08.512086+0000","last_became_peered":"2024-09-12T00:25:08.512086+0000","last_unstale":"2024-09-12T01:37:38.531846+0000","last_undegraded":"2024-09-12T01:37:38.531846+0000","last_fullsized":"2024-09-12T01:37:38.531846+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:45.064721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'130","reported_seq":630,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.246800+0000","last_change":"2024-09-12T00:25:10.521608+0000","last_active":"2024-09-12T01:37:18.246800+0000","last_peered":"2024-09-12T01:37:18.246800+0000","last_clean":"2024-09-12T01:37:18.246800+0000","last_became_active":"2024-09-12T00:25:10.521322+0000","last_became_peered":"2024-09-12T00:25:10.521322+0000","last_unstale":"2024-09-12T01:37:18.246800+0000","last_undegraded":"2024-09-12T01:37:18.246800+0000","last_fullsized":"2024-09-12T01:37:18.246800+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.501352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":104,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'389","reported_seq":1833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.490823+0000","last_change":"2024-09-12T00:25:02.468886+0000","last_active":"2024-09-12T01:35:19.490823+0000","last_peered":"2024-09-12T01:35:19.490823+0000","last_clean":"2024-09-12T01:35:19.490823+0000","last_became_active":"2024-09-12T00:25:02.468609+0000","last_became_peered":"2024-09-12T00:25:02.468609+0000","last_unstale":"2024-09-12T01:35:19.490823+0000","last_undegraded":"2024-09-12T01:35:19.490823+0000","last_fullsized":"2024-09-12T01:35:19.490823+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:09:52.563826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2038,"num_read_kb":1930,"num_write":430,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'219","reported_seq":978,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.965862+0000","last_change":"2024-09-12T01:37:43.965862+0000","last_active":"2024-09-12T01:37:43.965862+0000","last_peered":"2024-09-12T01:37:43.965862+0000","last_clean":"2024-09-12T01:37:43.965862+0000","last_became_active":"2024-09-12T00:25:00.472065+0000","last_became_peered":"2024-09-12T00:25:00.472065+0000","last_unstale":"2024-09-12T01:37:43.965862+0000","last_undegraded":"2024-09-12T01:37:43.965862+0000","last_fullsized":"2024-09-12T01:37:43.965862+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'219","last_scrub_stamp":"2024-09-12T01:37:43.965697+0000","last_deep_scrub":"266'219","last_deep_scrub_stamp":"2024-09-12T01:37:43.965697+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.965697+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:29.632688+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9573531,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1000,"num_read_kb":31471,"num_write":994,"num_write_kb":39869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"38'4","reported_seq":977,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.291052+0000","last_change":"2024-09-12T00:25:04.482765+0000","last_active":"2024-09-12T01:37:38.291052+0000","last_peered":"2024-09-12T01:37:38.291052+0000","last_clean":"2024-09-12T01:37:38.291052+0000","last_became_active":"2024-09-12T00:25:04.482518+0000","last_became_peered":"2024-09-12T00:25:04.482518+0000","last_unstale":"2024-09-12T01:37:38.291052+0000","last_undegraded":"2024-09-12T01:37:38.291052+0000","last_fullsized":"2024-09-12T01:37:38.291052+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:09.317643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'224","reported_seq":892,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.850805+0000","last_change":"2024-09-12T00:25:06.497612+0000","last_active":"2024-09-12T01:37:38.850805+0000","last_peered":"2024-09-12T01:37:38.850805+0000","last_clean":"2024-09-12T01:37:38.850805+0000","last_became_active":"2024-09-12T00:25:06.497269+0000","last_became_peered":"2024-09-12T00:25:06.497269+0000","last_unstale":"2024-09-12T01:37:38.850805+0000","last_undegraded":"2024-09-12T01:37:38.850805+0000","last_fullsized":"2024-09-12T01:37:38.850805+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:15.450749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14775,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":319,"num_read_kb":439,"num_write":162,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:28.995211+0000","last_change":"2024-09-12T00:25:08.514101+0000","last_active":"2024-09-12T01:34:28.995211+0000","last_peered":"2024-09-12T01:34:28.995211+0000","last_clean":"2024-09-12T01:34:28.995211+0000","last_became_active":"2024-09-12T00:25:08.513758+0000","last_became_peered":"2024-09-12T00:25:08.513758+0000","last_unstale":"2024-09-12T01:34:28.995211+0000","last_undegraded":"2024-09-12T01:34:28.995211+0000","last_fullsized":"2024-09-12T01:34:28.995211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:44.229276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'131","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.673372+0000","last_change":"2024-09-12T00:25:10.525073+0000","last_active":"2024-09-12T01:36:07.673372+0000","last_peered":"2024-09-12T01:36:07.673372+0000","last_clean":"2024-09-12T01:36:07.673372+0000","last_became_active":"2024-09-12T00:25:10.524500+0000","last_became_peered":"2024-09-12T00:25:10.524500+0000","last_unstale":"2024-09-12T01:36:07.673372+0000","last_undegraded":"2024-09-12T01:36:07.673372+0000","last_fullsized":"2024-09-12T01:36:07.673372+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:33.151875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":199,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'393","reported_seq":2026,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.195471+0000","last_change":"2024-09-12T00:25:02.476800+0000","last_active":"2024-09-12T01:36:11.195471+0000","last_peered":"2024-09-12T01:36:11.195471+0000","last_clean":"2024-09-12T01:36:11.195471+0000","last_became_active":"2024-09-12T00:25:02.476549+0000","last_became_peered":"2024-09-12T00:25:02.476549+0000","last_unstale":"2024-09-12T01:36:11.195471+0000","last_undegraded":"2024-09-12T01:36:11.195471+0000","last_fullsized":"2024-09-12T01:36:11.195471+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:39:16.691928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2368,"num_read_kb":2274,"num_write":449,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'195","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.890983+0000","last_change":"2024-09-12T00:25:00.471698+0000","last_active":"2024-09-12T01:37:38.890983+0000","last_peered":"2024-09-12T01:37:38.890983+0000","last_clean":"2024-09-12T01:37:38.890983+0000","last_became_active":"2024-09-12T00:25:00.471314+0000","last_became_peered":"2024-09-12T00:25:00.471314+0000","last_unstale":"2024-09-12T01:37:38.890983+0000","last_undegraded":"2024-09-12T01:37:38.890983+0000","last_fullsized":"2024-09-12T01:37:38.890983+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:13.302458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190278,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":11373,"num_write":891,"num_write_kb":19982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:50.121029+0000","last_change":"2024-09-12T00:25:04.486405+0000","last_active":"2024-09-12T01:34:50.121029+0000","last_peered":"2024-09-12T01:34:50.121029+0000","last_clean":"2024-09-12T01:34:50.121029+0000","last_became_active":"2024-09-12T00:25:04.486111+0000","last_became_peered":"2024-09-12T00:25:04.486111+0000","last_unstale":"2024-09-12T01:34:50.121029+0000","last_undegraded":"2024-09-12T01:34:50.121029+0000","last_fullsized":"2024-09-12T01:34:50.121029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:49.097494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'202","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.860441+0000","last_change":"2024-09-12T00:25:06.497567+0000","last_active":"2024-09-12T01:37:38.860441+0000","last_peered":"2024-09-12T01:37:38.860441+0000","last_clean":"2024-09-12T01:37:38.860441+0000","last_became_active":"2024-09-12T00:25:06.497247+0000","last_became_peered":"2024-09-12T00:25:06.497247+0000","last_unstale":"2024-09-12T01:37:38.860441+0000","last_undegraded":"2024-09-12T01:37:38.860441+0000","last_fullsized":"2024-09-12T01:37:38.860441+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:35.152802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":347,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123202+0000","last_change":"2024-09-12T00:25:08.517282+0000","last_active":"2024-09-12T01:35:05.123202+0000","last_peered":"2024-09-12T01:35:05.123202+0000","last_clean":"2024-09-12T01:35:05.123202+0000","last_became_active":"2024-09-12T00:25:08.516949+0000","last_became_peered":"2024-09-12T00:25:08.516949+0000","last_unstale":"2024-09-12T01:35:05.123202+0000","last_undegraded":"2024-09-12T01:35:05.123202+0000","last_fullsized":"2024-09-12T01:35:05.123202+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:05.996838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'123","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:08.018005+0000","last_change":"2024-09-12T00:25:10.531019+0000","last_active":"2024-09-12T01:37:08.018005+0000","last_peered":"2024-09-12T01:37:08.018005+0000","last_clean":"2024-09-12T01:37:08.018005+0000","last_became_active":"2024-09-12T00:25:10.530731+0000","last_became_peered":"2024-09-12T00:25:10.530731+0000","last_unstale":"2024-09-12T01:37:08.018005+0000","last_undegraded":"2024-09-12T01:37:08.018005+0000","last_fullsized":"2024-09-12T01:37:08.018005+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.713991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":124,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'665","reported_seq":2301,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.803243+0000","last_change":"2024-09-12T00:25:02.474838+0000","last_active":"2024-09-12T01:35:34.803243+0000","last_peered":"2024-09-12T01:35:34.803243+0000","last_clean":"2024-09-12T01:35:34.803243+0000","last_became_active":"2024-09-12T00:25:02.474113+0000","last_became_peered":"2024-09-12T00:25:02.474113+0000","last_unstale":"2024-09-12T01:35:34.803243+0000","last_undegraded":"2024-09-12T01:35:34.803243+0000","last_fullsized":"2024-09-12T01:35:34.803243+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":600,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:02.950937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3250,"num_read_kb":2990,"num_write":879,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'185","reported_seq":897,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.545738+0000","last_change":"2024-09-12T00:25:32.562365+0000","last_active":"2024-09-12T01:36:39.545738+0000","last_peered":"2024-09-12T01:36:39.545738+0000","last_clean":"2024-09-12T01:36:39.545738+0000","last_became_active":"2024-09-12T00:25:32.562005+0000","last_became_peered":"2024-09-12T00:25:32.562005+0000","last_unstale":"2024-09-12T01:36:39.545738+0000","last_undegraded":"2024-09-12T01:36:39.545738+0000","last_fullsized":"2024-09-12T01:36:39.545738+0000","mapping_epoch":39,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:08:04.047110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568762,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":135425,"num_write":898,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:48.998802+0000","last_change":"2024-09-12T00:25:04.483049+0000","last_active":"2024-09-12T01:34:48.998802+0000","last_peered":"2024-09-12T01:34:48.998802+0000","last_clean":"2024-09-12T01:34:48.998802+0000","last_became_active":"2024-09-12T00:25:04.482744+0000","last_became_peered":"2024-09-12T00:25:04.482744+0000","last_unstale":"2024-09-12T01:34:48.998802+0000","last_undegraded":"2024-09-12T01:34:48.998802+0000","last_fullsized":"2024-09-12T01:34:48.998802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:16.996020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'192","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.788049+0000","last_change":"2024-09-12T00:25:06.497726+0000","last_active":"2024-09-12T01:37:38.788049+0000","last_peered":"2024-09-12T01:37:38.788049+0000","last_clean":"2024-09-12T01:37:38.788049+0000","last_became_active":"2024-09-12T00:25:06.497448+0000","last_became_peered":"2024-09-12T00:25:06.497448+0000","last_unstale":"2024-09-12T01:37:38.788049+0000","last_undegraded":"2024-09-12T01:37:38.788049+0000","last_fullsized":"2024-09-12T01:37:38.788049+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:20.638948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":247,"num_read_kb":253,"num_write":136,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'764","reported_seq":2721,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.526972+0000","last_change":"2024-09-12T00:25:08.510452+0000","last_active":"2024-09-12T01:37:38.526972+0000","last_peered":"2024-09-12T01:37:38.526972+0000","last_clean":"2024-09-12T01:37:38.526972+0000","last_became_active":"2024-09-12T00:25:08.510134+0000","last_became_peered":"2024-09-12T00:25:08.510134+0000","last_unstale":"2024-09-12T01:37:38.526972+0000","last_undegraded":"2024-09-12T01:37:38.526972+0000","last_fullsized":"2024-09-12T01:37:38.526972+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:11.026047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'125","reported_seq":627,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.054270+0000","last_change":"2024-09-12T00:25:10.522261+0000","last_active":"2024-09-12T01:36:09.054270+0000","last_peered":"2024-09-12T01:36:09.054270+0000","last_clean":"2024-09-12T01:36:09.054270+0000","last_became_active":"2024-09-12T00:25:10.521992+0000","last_became_peered":"2024-09-12T00:25:10.521992+0000","last_unstale":"2024-09-12T01:36:09.054270+0000","last_undegraded":"2024-09-12T01:36:09.054270+0000","last_fullsized":"2024-09-12T01:36:09.054270+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:39.515026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":300,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801315+0000","last_change":"2024-09-12T00:25:02.468698+0000","last_active":"2024-09-12T01:35:34.801315+0000","last_peered":"2024-09-12T01:35:34.801315+0000","last_clean":"2024-09-12T01:35:34.801315+0000","last_became_active":"2024-09-12T00:25:02.468401+0000","last_became_peered":"2024-09-12T00:25:02.468401+0000","last_unstale":"2024-09-12T01:35:34.801315+0000","last_undegraded":"2024-09-12T01:35:34.801315+0000","last_fullsized":"2024-09-12T01:35:34.801315+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:25.428427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2162,"num_read_kb":2053,"num_write":481,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'266","reported_seq":936,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.692623+0000","last_change":"2024-09-12T00:25:00.474914+0000","last_active":"2024-09-12T01:37:38.692623+0000","last_peered":"2024-09-12T01:37:38.692623+0000","last_clean":"2024-09-12T01:37:38.692623+0000","last_became_active":"2024-09-12T00:25:00.474471+0000","last_became_peered":"2024-09-12T00:25:00.474471+0000","last_unstale":"2024-09-12T01:37:38.692623+0000","last_undegraded":"2024-09-12T01:37:38.692623+0000","last_fullsized":"2024-09-12T01:37:38.692623+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:32.026867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2612534,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":560,"num_read_kb":17654,"num_write":1154,"num_write_kb":37946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"31'2","reported_seq":1453,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.303392+0000","last_change":"2024-09-12T00:25:04.483123+0000","last_active":"2024-09-12T01:37:38.303392+0000","last_peered":"2024-09-12T01:37:38.303392+0000","last_clean":"2024-09-12T01:37:38.303392+0000","last_became_active":"2024-09-12T00:25:04.482824+0000","last_became_peered":"2024-09-12T00:25:04.482824+0000","last_unstale":"2024-09-12T01:37:38.303392+0000","last_undegraded":"2024-09-12T01:37:38.303392+0000","last_fullsized":"2024-09-12T01:37:38.303392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:35.937773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":942,"num_read_kb":942,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'103","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.535072+0000","last_change":"2024-09-12T00:25:06.500248+0000","last_active":"2024-09-12T01:35:51.535072+0000","last_peered":"2024-09-12T01:35:51.535072+0000","last_clean":"2024-09-12T01:35:51.535072+0000","last_became_active":"2024-09-12T00:25:06.499937+0000","last_became_peered":"2024-09-12T00:25:06.499937+0000","last_unstale":"2024-09-12T01:35:51.535072+0000","last_undegraded":"2024-09-12T01:35:51.535072+0000","last_fullsized":"2024-09-12T01:35:51.535072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:31.323131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'774","reported_seq":2632,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.527952+0000","last_change":"2024-09-12T00:25:08.502922+0000","last_active":"2024-09-12T01:37:38.527952+0000","last_peered":"2024-09-12T01:37:38.527952+0000","last_clean":"2024-09-12T01:37:38.527952+0000","last_became_active":"2024-09-12T00:25:08.501192+0000","last_became_peered":"2024-09-12T00:25:08.501192+0000","last_unstale":"2024-09-12T01:37:38.527952+0000","last_undegraded":"2024-09-12T01:37:38.527952+0000","last_fullsized":"2024-09-12T01:37:38.527952+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:55.381458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'106","reported_seq":611,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:55.080615+0000","last_change":"2024-09-12T00:25:10.524909+0000","last_active":"2024-09-12T01:33:55.080615+0000","last_peered":"2024-09-12T01:33:55.080615+0000","last_clean":"2024-09-12T01:33:55.080615+0000","last_became_active":"2024-09-12T00:25:10.524610+0000","last_became_peered":"2024-09-12T00:25:10.524610+0000","last_unstale":"2024-09-12T01:33:55.080615+0000","last_undegraded":"2024-09-12T01:33:55.080615+0000","last_fullsized":"2024-09-12T01:33:55.080615+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:08.033152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'789","reported_seq":2436,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.408526+0000","last_change":"2024-09-12T00:25:02.479122+0000","last_active":"2024-09-12T01:37:18.408526+0000","last_peered":"2024-09-12T01:37:18.408526+0000","last_clean":"2024-09-12T01:37:18.408526+0000","last_became_active":"2024-09-12T00:25:02.478793+0000","last_became_peered":"2024-09-12T00:25:02.478793+0000","last_unstale":"2024-09-12T01:37:18.408526+0000","last_undegraded":"2024-09-12T01:37:18.408526+0000","last_fullsized":"2024-09-12T01:37:18.408526+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:57.070249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3638,"num_write":1039,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'228","reported_seq":945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.902022+0000","last_change":"2024-09-12T00:25:32.561533+0000","last_active":"2024-09-12T01:37:38.902022+0000","last_peered":"2024-09-12T01:37:38.902022+0000","last_clean":"2024-09-12T01:37:38.902022+0000","last_became_active":"2024-09-12T00:25:32.561102+0000","last_became_peered":"2024-09-12T00:25:32.561102+0000","last_unstale":"2024-09-12T01:37:38.902022+0000","last_undegraded":"2024-09-12T01:37:38.902022+0000","last_fullsized":"2024-09-12T01:37:38.902022+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:17.692906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":554,"num_read_kb":71561,"num_write":1047,"num_write_kb":46306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6,0],"acting":[4,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.532031+0000","last_change":"2024-09-12T00:25:04.484834+0000","last_active":"2024-09-12T01:34:49.532031+0000","last_peered":"2024-09-12T01:34:49.532031+0000","last_clean":"2024-09-12T01:34:49.532031+0000","last_became_active":"2024-09-12T00:25:04.484543+0000","last_became_peered":"2024-09-12T00:25:04.484543+0000","last_unstale":"2024-09-12T01:34:49.532031+0000","last_undegraded":"2024-09-12T01:34:49.532031+0000","last_fullsized":"2024-09-12T01:34:49.532031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:42.025957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'305","reported_seq":943,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.642475+0000","last_change":"2024-09-12T00:25:06.497244+0000","last_active":"2024-09-12T01:37:38.642475+0000","last_peered":"2024-09-12T01:37:38.642475+0000","last_clean":"2024-09-12T01:37:38.642475+0000","last_became_active":"2024-09-12T00:25:06.496949+0000","last_became_peered":"2024-09-12T00:25:06.496949+0000","last_unstale":"2024-09-12T01:37:38.642475+0000","last_undegraded":"2024-09-12T01:37:38.642475+0000","last_fullsized":"2024-09-12T01:37:38.642475+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":200,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:45.596588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9140,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1014,"num_read_kb":1082,"num_write":1556,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:55.086981+0000","last_change":"2024-09-12T00:25:08.511378+0000","last_active":"2024-09-12T01:34:55.086981+0000","last_peered":"2024-09-12T01:34:55.086981+0000","last_clean":"2024-09-12T01:34:55.086981+0000","last_became_active":"2024-09-12T00:25:08.511103+0000","last_became_peered":"2024-09-12T00:25:08.511103+0000","last_unstale":"2024-09-12T01:34:55.086981+0000","last_undegraded":"2024-09-12T01:34:55.086981+0000","last_fullsized":"2024-09-12T01:34:55.086981+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:15.770737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'155","reported_seq":659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.023949+0000","last_change":"2024-09-12T00:25:10.524712+0000","last_active":"2024-09-12T01:35:02.023949+0000","last_peered":"2024-09-12T01:35:02.023949+0000","last_clean":"2024-09-12T01:35:02.023949+0000","last_became_active":"2024-09-12T00:25:10.524399+0000","last_became_peered":"2024-09-12T00:25:10.524399+0000","last_unstale":"2024-09-12T01:35:02.023949+0000","last_undegraded":"2024-09-12T01:35:02.023949+0000","last_fullsized":"2024-09-12T01:35:02.023949+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:02.179754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":348,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'525","reported_seq":2110,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.802899+0000","last_change":"2024-09-12T00:25:02.470865+0000","last_active":"2024-09-12T01:35:34.802899+0000","last_peered":"2024-09-12T01:35:34.802899+0000","last_clean":"2024-09-12T01:35:34.802899+0000","last_became_active":"2024-09-12T00:25:02.470508+0000","last_became_peered":"2024-09-12T00:25:02.470508+0000","last_unstale":"2024-09-12T01:35:34.802899+0000","last_undegraded":"2024-09-12T01:35:34.802899+0000","last_fullsized":"2024-09-12T01:35:34.802899+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":500,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:21.513113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2852,"num_read_kb":2640,"num_write":653,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.840458+0000","last_change":"2024-09-12T01:37:43.840458+0000","last_active":"2024-09-12T01:37:43.840458+0000","last_peered":"2024-09-12T01:37:43.840458+0000","last_clean":"2024-09-12T01:37:43.840458+0000","last_became_active":"2024-09-12T00:24:40.255060+0000","last_became_peered":"2024-09-12T00:24:40.255060+0000","last_unstale":"2024-09-12T01:37:43.840458+0000","last_undegraded":"2024-09-12T01:37:43.840458+0000","last_fullsized":"2024-09-12T01:37:43.840458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T01:37:43.840360+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T01:37:43.840360+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.840360+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:24.816378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.538244+0000","last_change":"2024-09-12T00:24:48.219201+0000","last_active":"2024-09-12T01:35:39.538244+0000","last_peered":"2024-09-12T01:35:39.538244+0000","last_clean":"2024-09-12T01:35:39.538244+0000","last_became_active":"2024-09-12T00:24:46.449286+0000","last_became_peered":"2024-09-12T00:24:46.449286+0000","last_unstale":"2024-09-12T01:35:39.538244+0000","last_undegraded":"2024-09-12T01:35:39.538244+0000","last_fullsized":"2024-09-12T01:35:39.538244+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:20.504679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001069263,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'200","reported_seq":826,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.798155+0000","last_change":"2024-09-12T00:25:00.466263+0000","last_active":"2024-09-12T01:37:38.798155+0000","last_peered":"2024-09-12T01:37:38.798155+0000","last_clean":"2024-09-12T01:37:38.798155+0000","last_became_active":"2024-09-12T00:25:00.465691+0000","last_became_peered":"2024-09-12T00:25:00.465691+0000","last_unstale":"2024-09-12T01:37:38.798155+0000","last_undegraded":"2024-09-12T01:37:38.798155+0000","last_fullsized":"2024-09-12T01:37:38.798155+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:44.824605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262165,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":3125,"num_write":969,"num_write_kb":16262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.973231+0000","last_change":"2024-09-12T00:25:04.484191+0000","last_active":"2024-09-12T01:33:49.973231+0000","last_peered":"2024-09-12T01:33:49.973231+0000","last_clean":"2024-09-12T01:33:49.973231+0000","last_became_active":"2024-09-12T00:25:04.483893+0000","last_became_peered":"2024-09-12T00:25:04.483893+0000","last_unstale":"2024-09-12T01:33:49.973231+0000","last_undegraded":"2024-09-12T01:33:49.973231+0000","last_fullsized":"2024-09-12T01:33:49.973231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:57.380284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'334","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.767482+0000","last_change":"2024-09-12T00:25:06.497651+0000","last_active":"2024-09-12T01:37:38.767482+0000","last_peered":"2024-09-12T01:37:38.767482+0000","last_clean":"2024-09-12T01:37:38.767482+0000","last_became_active":"2024-09-12T00:25:06.497261+0000","last_became_peered":"2024-09-12T00:25:06.497261+0000","last_unstale":"2024-09-12T01:37:38.767482+0000","last_undegraded":"2024-09-12T01:37:38.767482+0000","last_fullsized":"2024-09-12T01:37:38.767482+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:29.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36159,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":620,"num_read_kb":873,"num_write":540,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:28.995333+0000","last_change":"2024-09-12T00:25:08.509443+0000","last_active":"2024-09-12T01:34:28.995333+0000","last_peered":"2024-09-12T01:34:28.995333+0000","last_clean":"2024-09-12T01:34:28.995333+0000","last_became_active":"2024-09-12T00:25:08.509183+0000","last_became_peered":"2024-09-12T00:25:08.509183+0000","last_unstale":"2024-09-12T01:34:28.995333+0000","last_undegraded":"2024-09-12T01:34:28.995333+0000","last_fullsized":"2024-09-12T01:34:28.995333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:07.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'216","reported_seq":927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.368080+0000","last_change":"2024-09-12T00:25:10.525926+0000","last_active":"2024-09-12T01:36:12.368080+0000","last_peered":"2024-09-12T01:36:12.368080+0000","last_clean":"2024-09-12T01:36:12.368080+0000","last_became_active":"2024-09-12T00:25:10.525441+0000","last_became_peered":"2024-09-12T00:25:10.525441+0000","last_unstale":"2024-09-12T01:36:12.368080+0000","last_undegraded":"2024-09-12T01:36:12.368080+0000","last_fullsized":"2024-09-12T01:36:12.368080+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:21.545364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":453,"num_read_kb":448,"num_write":488,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'808","reported_seq":2391,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.675442+0000","last_change":"2024-09-12T00:25:02.479220+0000","last_active":"2024-09-12T01:35:04.675442+0000","last_peered":"2024-09-12T01:35:04.675442+0000","last_clean":"2024-09-12T01:35:04.675442+0000","last_became_active":"2024-09-12T00:25:02.478919+0000","last_became_peered":"2024-09-12T00:25:02.478919+0000","last_unstale":"2024-09-12T01:35:04.675442+0000","last_undegraded":"2024-09-12T01:35:04.675442+0000","last_fullsized":"2024-09-12T01:35:04.675442+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:03.891856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4003,"num_read_kb":3616,"num_write":1060,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":536,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.532517+0000","last_change":"2024-09-12T00:24:48.218739+0000","last_active":"2024-09-12T01:34:54.532517+0000","last_peered":"2024-09-12T01:34:54.532517+0000","last_clean":"2024-09-12T01:34:54.532517+0000","last_became_active":"2024-09-12T00:24:46.216398+0000","last_became_peered":"2024-09-12T00:24:46.216398+0000","last_unstale":"2024-09-12T01:34:54.532517+0000","last_undegraded":"2024-09-12T01:34:54.532517+0000","last_fullsized":"2024-09-12T01:34:54.532517+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:54.142561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00080348300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'237","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.911839+0000","last_change":"2024-09-12T00:25:00.468216+0000","last_active":"2024-09-12T01:37:38.911839+0000","last_peered":"2024-09-12T01:37:38.911839+0000","last_clean":"2024-09-12T01:37:38.911839+0000","last_became_active":"2024-09-12T00:25:00.467622+0000","last_became_peered":"2024-09-12T00:25:00.467622+0000","last_unstale":"2024-09-12T01:37:38.911839+0000","last_undegraded":"2024-09-12T01:37:38.911839+0000","last_fullsized":"2024-09-12T01:37:38.911839+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:47.186663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":667699,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":22643,"num_write":1048,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.529037+0000","last_change":"2024-09-12T00:25:04.484033+0000","last_active":"2024-09-12T01:34:24.529037+0000","last_peered":"2024-09-12T01:34:24.529037+0000","last_clean":"2024-09-12T01:34:24.529037+0000","last_became_active":"2024-09-12T00:25:04.483752+0000","last_became_peered":"2024-09-12T00:25:04.483752+0000","last_unstale":"2024-09-12T01:34:24.529037+0000","last_undegraded":"2024-09-12T01:34:24.529037+0000","last_fullsized":"2024-09-12T01:34:24.529037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:45.784755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'927","reported_seq":2751,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.831626+0000","last_change":"2024-09-12T00:25:06.492242+0000","last_active":"2024-09-12T01:37:38.831626+0000","last_peered":"2024-09-12T01:37:38.831626+0000","last_clean":"2024-09-12T01:37:38.831626+0000","last_became_active":"2024-09-12T00:25:06.491919+0000","last_became_peered":"2024-09-12T00:25:06.491919+0000","last_unstale":"2024-09-12T01:37:38.831626+0000","last_undegraded":"2024-09-12T01:37:38.831626+0000","last_fullsized":"2024-09-12T01:37:38.831626+0000","mapping_epoch":32,"log_start":"266'900","ondisk_log_start":"266'900","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":900,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:27.174380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26860,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1263,"num_read_kb":1464,"num_write":378,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.525990+0000","last_change":"2024-09-12T00:25:08.514605+0000","last_active":"2024-09-12T01:33:59.525990+0000","last_peered":"2024-09-12T01:33:59.525990+0000","last_clean":"2024-09-12T01:33:59.525990+0000","last_became_active":"2024-09-12T00:25:08.514284+0000","last_became_peered":"2024-09-12T00:25:08.514284+0000","last_unstale":"2024-09-12T01:33:59.525990+0000","last_undegraded":"2024-09-12T01:33:59.525990+0000","last_fullsized":"2024-09-12T01:33:59.525990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:57.005332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'199","reported_seq":729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.179557+0000","last_change":"2024-09-12T00:25:10.521984+0000","last_active":"2024-09-12T01:36:11.179557+0000","last_peered":"2024-09-12T01:36:11.179557+0000","last_clean":"2024-09-12T01:36:11.179557+0000","last_became_active":"2024-09-12T00:25:10.521686+0000","last_became_peered":"2024-09-12T00:25:10.521686+0000","last_unstale":"2024-09-12T01:36:11.179557+0000","last_undegraded":"2024-09-12T01:36:11.179557+0000","last_fullsized":"2024-09-12T01:36:11.179557+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:44.218223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":329,"num_write":450,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'457","reported_seq":1918,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338325+0000","last_change":"2024-09-12T00:25:02.472659+0000","last_active":"2024-09-12T01:36:12.338325+0000","last_peered":"2024-09-12T01:36:12.338325+0000","last_clean":"2024-09-12T01:36:12.338325+0000","last_became_active":"2024-09-12T00:25:02.472379+0000","last_became_peered":"2024-09-12T00:25:02.472379+0000","last_unstale":"2024-09-12T01:36:12.338325+0000","last_undegraded":"2024-09-12T01:36:12.338325+0000","last_fullsized":"2024-09-12T01:36:12.338325+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:11.033418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2328,"num_read_kb":2161,"num_write":552,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:40.128259+0000","last_change":"2024-09-12T00:24:48.293366+0000","last_active":"2024-09-12T01:35:40.128259+0000","last_peered":"2024-09-12T01:35:40.128259+0000","last_clean":"2024-09-12T01:35:40.128259+0000","last_became_active":"2024-09-12T00:24:46.219148+0000","last_became_peered":"2024-09-12T00:24:46.219148+0000","last_unstale":"2024-09-12T01:35:40.128259+0000","last_undegraded":"2024-09-12T01:35:40.128259+0000","last_fullsized":"2024-09-12T01:35:40.128259+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:43.132714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040735800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'221","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.870176+0000","last_change":"2024-09-12T00:25:00.468826+0000","last_active":"2024-09-12T01:37:38.870176+0000","last_peered":"2024-09-12T01:37:38.870176+0000","last_clean":"2024-09-12T01:37:38.870176+0000","last_became_active":"2024-09-12T00:25:00.468270+0000","last_became_peered":"2024-09-12T00:25:00.468270+0000","last_unstale":"2024-09-12T01:37:38.870176+0000","last_undegraded":"2024-09-12T01:37:38.870176+0000","last_fullsized":"2024-09-12T01:37:38.870176+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:56.482218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":34464,"num_write":950,"num_write_kb":30398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"31'1","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:25.117408+0000","last_change":"2024-09-12T00:25:04.486850+0000","last_active":"2024-09-12T01:34:25.117408+0000","last_peered":"2024-09-12T01:34:25.117408+0000","last_clean":"2024-09-12T01:34:25.117408+0000","last_became_active":"2024-09-12T00:25:04.486554+0000","last_became_peered":"2024-09-12T00:25:04.486554+0000","last_unstale":"2024-09-12T01:34:25.117408+0000","last_undegraded":"2024-09-12T01:34:25.117408+0000","last_fullsized":"2024-09-12T01:34:25.117408+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:05.290712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'310","reported_seq":1743,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:14.925557+0000","last_change":"2024-09-12T00:25:06.495614+0000","last_active":"2024-09-12T01:37:14.925557+0000","last_peered":"2024-09-12T01:37:14.925557+0000","last_clean":"2024-09-12T01:37:14.925557+0000","last_became_active":"2024-09-12T00:25:06.495269+0000","last_became_peered":"2024-09-12T00:25:06.495269+0000","last_unstale":"2024-09-12T01:37:14.925557+0000","last_undegraded":"2024-09-12T01:37:14.925557+0000","last_fullsized":"2024-09-12T01:37:14.925557+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:38.976235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":267,"num_read_kb":257,"num_write":249,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.242368+0000","last_change":"2024-09-12T00:25:08.512053+0000","last_active":"2024-09-12T01:33:57.242368+0000","last_peered":"2024-09-12T01:33:57.242368+0000","last_clean":"2024-09-12T01:33:57.242368+0000","last_became_active":"2024-09-12T00:25:08.511783+0000","last_became_peered":"2024-09-12T00:25:08.511783+0000","last_unstale":"2024-09-12T01:33:57.242368+0000","last_undegraded":"2024-09-12T01:33:57.242368+0000","last_fullsized":"2024-09-12T01:33:57.242368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.395473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'269","reported_seq":883,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:12.270641+0000","last_change":"2024-09-12T00:25:10.525964+0000","last_active":"2024-09-12T01:37:12.270641+0000","last_peered":"2024-09-12T01:37:12.270641+0000","last_clean":"2024-09-12T01:37:12.270641+0000","last_became_active":"2024-09-12T00:25:10.525594+0000","last_became_peered":"2024-09-12T00:25:10.525594+0000","last_unstale":"2024-09-12T01:37:12.270641+0000","last_undegraded":"2024-09-12T01:37:12.270641+0000","last_fullsized":"2024-09-12T01:37:12.270641+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:12.216646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":513,"num_write":584,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'412","reported_seq":1889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.018009+0000","last_change":"2024-09-12T00:25:02.467324+0000","last_active":"2024-09-12T01:35:02.018009+0000","last_peered":"2024-09-12T01:35:02.018009+0000","last_clean":"2024-09-12T01:35:02.018009+0000","last_became_active":"2024-09-12T00:25:02.467022+0000","last_became_peered":"2024-09-12T00:25:02.467022+0000","last_unstale":"2024-09-12T01:35:02.018009+0000","last_undegraded":"2024-09-12T01:35:02.018009+0000","last_fullsized":"2024-09-12T01:35:02.018009+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":400,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:42.341992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2131,"num_read_kb":2016,"num_write":472,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":537,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.538221+0000","last_change":"2024-09-12T00:24:48.218472+0000","last_active":"2024-09-12T01:35:39.538221+0000","last_peered":"2024-09-12T01:35:39.538221+0000","last_clean":"2024-09-12T01:35:39.538221+0000","last_became_active":"2024-09-12T00:24:46.296014+0000","last_became_peered":"2024-09-12T00:24:46.296014+0000","last_unstale":"2024-09-12T01:35:39.538221+0000","last_undegraded":"2024-09-12T01:35:39.538221+0000","last_fullsized":"2024-09-12T01:35:39.538221+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:16.575080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00055221999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'227","reported_seq":859,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.806318+0000","last_change":"2024-09-12T00:25:00.480960+0000","last_active":"2024-09-12T01:37:38.806318+0000","last_peered":"2024-09-12T01:37:38.806318+0000","last_clean":"2024-09-12T01:37:38.806318+0000","last_became_active":"2024-09-12T00:25:00.480242+0000","last_became_peered":"2024-09-12T00:25:00.480242+0000","last_unstale":"2024-09-12T01:37:38.806318+0000","last_undegraded":"2024-09-12T01:37:38.806318+0000","last_fullsized":"2024-09-12T01:37:38.806318+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:45.844641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":8697,"num_write":1016,"num_write_kb":33114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:00.113567+0000","last_change":"2024-09-12T00:25:04.483695+0000","last_active":"2024-09-12T01:34:00.113567+0000","last_peered":"2024-09-12T01:34:00.113567+0000","last_clean":"2024-09-12T01:34:00.113567+0000","last_became_active":"2024-09-12T00:25:04.483224+0000","last_became_peered":"2024-09-12T00:25:04.483224+0000","last_unstale":"2024-09-12T01:34:00.113567+0000","last_undegraded":"2024-09-12T01:34:00.113567+0000","last_fullsized":"2024-09-12T01:34:00.113567+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:36.407261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'161","reported_seq":724,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.016537+0000","last_change":"2024-09-12T00:25:06.500894+0000","last_active":"2024-09-12T01:36:39.016537+0000","last_peered":"2024-09-12T01:36:39.016537+0000","last_clean":"2024-09-12T01:36:39.016537+0000","last_became_active":"2024-09-12T00:25:06.500406+0000","last_became_peered":"2024-09-12T00:25:06.500406+0000","last_unstale":"2024-09-12T01:36:39.016537+0000","last_undegraded":"2024-09-12T01:36:39.016537+0000","last_fullsized":"2024-09-12T01:36:39.016537+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:01.547439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":204,"num_read_kb":195,"num_write":150,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529656+0000","last_change":"2024-09-12T00:25:08.510581+0000","last_active":"2024-09-12T01:34:29.529656+0000","last_peered":"2024-09-12T01:34:29.529656+0000","last_clean":"2024-09-12T01:34:29.529656+0000","last_became_active":"2024-09-12T00:25:08.510287+0000","last_became_peered":"2024-09-12T00:25:08.510287+0000","last_unstale":"2024-09-12T01:34:29.529656+0000","last_undegraded":"2024-09-12T01:34:29.529656+0000","last_fullsized":"2024-09-12T01:34:29.529656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:48.633444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'158","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.085171+0000","last_change":"2024-09-12T00:25:10.523899+0000","last_active":"2024-09-12T01:34:34.085171+0000","last_peered":"2024-09-12T01:34:34.085171+0000","last_clean":"2024-09-12T01:34:34.085171+0000","last_became_active":"2024-09-12T00:25:10.523589+0000","last_became_peered":"2024-09-12T00:25:10.523589+0000","last_unstale":"2024-09-12T01:34:34.085171+0000","last_undegraded":"2024-09-12T01:34:34.085171+0000","last_fullsized":"2024-09-12T01:34:34.085171+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:20.406801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":189,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'1613","reported_seq":3209,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.172043+0000","last_change":"2024-09-12T00:25:02.471771+0000","last_active":"2024-09-12T01:36:11.172043+0000","last_peered":"2024-09-12T01:36:11.172043+0000","last_clean":"2024-09-12T01:36:11.172043+0000","last_became_active":"2024-09-12T00:25:02.471491+0000","last_became_peered":"2024-09-12T00:25:02.471491+0000","last_unstale":"2024-09-12T01:36:11.172043+0000","last_undegraded":"2024-09-12T01:36:11.172043+0000","last_fullsized":"2024-09-12T01:36:11.172043+0000","mapping_epoch":28,"log_start":"266'1600","ondisk_log_start":"266'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":1600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:00.651310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7163,"num_read_kb":6213,"num_write":2294,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'243","reported_seq":913,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.847696+0000","last_change":"2024-09-12T00:25:00.485158+0000","last_active":"2024-09-12T01:37:38.847696+0000","last_peered":"2024-09-12T01:37:38.847696+0000","last_clean":"2024-09-12T01:37:38.847696+0000","last_became_active":"2024-09-12T00:25:00.484147+0000","last_became_peered":"2024-09-12T00:25:00.484147+0000","last_unstale":"2024-09-12T01:37:38.847696+0000","last_undegraded":"2024-09-12T01:37:38.847696+0000","last_fullsized":"2024-09-12T01:37:38.847696+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:09.449162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":38062,"num_write":1135,"num_write_kb":41091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.007278+0000","last_change":"2024-09-12T00:24:48.266785+0000","last_active":"2024-09-12T01:35:39.007278+0000","last_peered":"2024-09-12T01:35:39.007278+0000","last_clean":"2024-09-12T01:35:39.007278+0000","last_became_active":"2024-09-12T00:24:46.295839+0000","last_became_peered":"2024-09-12T00:24:46.295839+0000","last_unstale":"2024-09-12T01:35:39.007278+0000","last_undegraded":"2024-09-12T01:35:39.007278+0000","last_fullsized":"2024-09-12T01:35:39.007278+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:09:07.950890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045367200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:52.241588+0000","last_change":"2024-09-12T00:25:04.479203+0000","last_active":"2024-09-12T01:33:52.241588+0000","last_peered":"2024-09-12T01:33:52.241588+0000","last_clean":"2024-09-12T01:33:52.241588+0000","last_became_active":"2024-09-12T00:25:04.478947+0000","last_became_peered":"2024-09-12T00:25:04.478947+0000","last_unstale":"2024-09-12T01:33:52.241588+0000","last_undegraded":"2024-09-12T01:33:52.241588+0000","last_fullsized":"2024-09-12T01:33:52.241588+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:05:57.527013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'315","reported_seq":1016,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.781701+0000","last_change":"2024-09-12T00:25:06.497179+0000","last_active":"2024-09-12T01:37:38.781701+0000","last_peered":"2024-09-12T01:37:38.781701+0000","last_clean":"2024-09-12T01:37:38.781701+0000","last_became_active":"2024-09-12T00:25:06.496693+0000","last_became_peered":"2024-09-12T00:25:06.496693+0000","last_unstale":"2024-09-12T01:37:38.781701+0000","last_undegraded":"2024-09-12T01:37:38.781701+0000","last_fullsized":"2024-09-12T01:37:38.781701+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:55.147097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":458,"num_read_kb":584,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:55.080589+0000","last_change":"2024-09-12T00:25:08.510222+0000","last_active":"2024-09-12T01:33:55.080589+0000","last_peered":"2024-09-12T01:33:55.080589+0000","last_clean":"2024-09-12T01:33:55.080589+0000","last_became_active":"2024-09-12T00:25:08.509962+0000","last_became_peered":"2024-09-12T00:25:08.509962+0000","last_unstale":"2024-09-12T01:33:55.080589+0000","last_undegraded":"2024-09-12T01:33:55.080589+0000","last_fullsized":"2024-09-12T01:33:55.080589+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:47:01.318302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'143","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.243688+0000","last_change":"2024-09-12T00:25:10.522132+0000","last_active":"2024-09-12T01:36:11.243688+0000","last_peered":"2024-09-12T01:36:11.243688+0000","last_clean":"2024-09-12T01:36:11.243688+0000","last_became_active":"2024-09-12T00:25:10.521670+0000","last_became_peered":"2024-09-12T00:25:10.521670+0000","last_unstale":"2024-09-12T01:36:11.243688+0000","last_undegraded":"2024-09-12T01:36:11.243688+0000","last_fullsized":"2024-09-12T01:36:11.243688+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.340900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":347,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'1208","reported_seq":2855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:02.222588+0000","last_change":"2024-09-12T00:25:02.473486+0000","last_active":"2024-09-12T01:34:02.222588+0000","last_peered":"2024-09-12T01:34:02.222588+0000","last_clean":"2024-09-12T01:34:02.222588+0000","last_became_active":"2024-09-12T00:25:02.473158+0000","last_became_peered":"2024-09-12T00:25:02.473158+0000","last_unstale":"2024-09-12T01:34:02.222588+0000","last_undegraded":"2024-09-12T01:34:02.222588+0000","last_fullsized":"2024-09-12T01:34:02.222588+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:11.141082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5007,"num_write":1669,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'191","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.774056+0000","last_change":"2024-09-12T00:25:00.466317+0000","last_active":"2024-09-12T01:37:38.774056+0000","last_peered":"2024-09-12T01:37:38.774056+0000","last_clean":"2024-09-12T01:37:38.774056+0000","last_became_active":"2024-09-12T00:25:00.465896+0000","last_became_peered":"2024-09-12T00:25:00.465896+0000","last_unstale":"2024-09-12T01:37:38.774056+0000","last_undegraded":"2024-09-12T01:37:38.774056+0000","last_fullsized":"2024-09-12T01:37:38.774056+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:09.955689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702969,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":438,"num_read_kb":13303,"num_write":931,"num_write_kb":18974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:39.523688+0000","last_change":"2024-09-12T00:24:48.218424+0000","last_active":"2024-09-12T01:33:39.523688+0000","last_peered":"2024-09-12T01:33:39.523688+0000","last_clean":"2024-09-12T01:33:39.523688+0000","last_became_active":"2024-09-12T00:24:46.213839+0000","last_became_peered":"2024-09-12T00:24:46.213839+0000","last_unstale":"2024-09-12T01:33:39.523688+0000","last_undegraded":"2024-09-12T01:33:39.523688+0000","last_fullsized":"2024-09-12T01:33:39.523688+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:29.527991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00050495300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.973182+0000","last_change":"2024-09-12T00:25:04.481438+0000","last_active":"2024-09-12T01:33:49.973182+0000","last_peered":"2024-09-12T01:33:49.973182+0000","last_clean":"2024-09-12T01:33:49.973182+0000","last_became_active":"2024-09-12T00:25:04.481137+0000","last_became_peered":"2024-09-12T00:25:04.481137+0000","last_unstale":"2024-09-12T01:33:49.973182+0000","last_undegraded":"2024-09-12T01:33:49.973182+0000","last_fullsized":"2024-09-12T01:33:49.973182+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:13:00.812394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'252","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:18.697355+0000","last_change":"2024-09-12T00:25:06.501412+0000","last_active":"2024-09-12T01:36:18.697355+0000","last_peered":"2024-09-12T01:36:18.697355+0000","last_clean":"2024-09-12T01:36:18.697355+0000","last_became_active":"2024-09-12T00:25:06.501118+0000","last_became_peered":"2024-09-12T00:25:06.501118+0000","last_unstale":"2024-09-12T01:36:18.697355+0000","last_undegraded":"2024-09-12T01:36:18.697355+0000","last_fullsized":"2024-09-12T01:36:18.697355+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:25.781723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":326,"num_read_kb":318,"num_write":296,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'774","reported_seq":2925,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.524835+0000","last_change":"2024-09-12T00:25:08.509879+0000","last_active":"2024-09-12T01:37:38.524835+0000","last_peered":"2024-09-12T01:37:38.524835+0000","last_clean":"2024-09-12T01:37:38.524835+0000","last_became_active":"2024-09-12T00:25:08.509511+0000","last_became_peered":"2024-09-12T00:25:08.509511+0000","last_unstale":"2024-09-12T01:37:38.524835+0000","last_undegraded":"2024-09-12T01:37:38.524835+0000","last_fullsized":"2024-09-12T01:37:38.524835+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:11.392274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'129","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.569096+0000","last_change":"2024-09-12T00:25:10.525336+0000","last_active":"2024-09-12T01:37:19.569096+0000","last_peered":"2024-09-12T01:37:19.569096+0000","last_clean":"2024-09-12T01:37:19.569096+0000","last_became_active":"2024-09-12T00:25:10.524804+0000","last_became_peered":"2024-09-12T00:25:10.524804+0000","last_unstale":"2024-09-12T01:37:19.569096+0000","last_undegraded":"2024-09-12T01:37:19.569096+0000","last_fullsized":"2024-09-12T01:37:19.569096+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:29.933357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'465","reported_seq":2156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801739+0000","last_change":"2024-09-12T00:25:02.463524+0000","last_active":"2024-09-12T01:35:34.801739+0000","last_peered":"2024-09-12T01:35:34.801739+0000","last_clean":"2024-09-12T01:35:34.801739+0000","last_became_active":"2024-09-12T00:25:02.463232+0000","last_became_peered":"2024-09-12T00:25:02.463232+0000","last_unstale":"2024-09-12T01:35:34.801739+0000","last_undegraded":"2024-09-12T01:35:34.801739+0000","last_fullsized":"2024-09-12T01:35:34.801739+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:51.011943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2494,"num_read_kb":2382,"num_write":536,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'241","reported_seq":941,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.755079+0000","last_change":"2024-09-12T00:25:00.453017+0000","last_active":"2024-09-12T01:37:38.755079+0000","last_peered":"2024-09-12T01:37:38.755079+0000","last_clean":"2024-09-12T01:37:38.755079+0000","last_became_active":"2024-09-12T00:25:00.452591+0000","last_became_peered":"2024-09-12T00:25:00.452591+0000","last_unstale":"2024-09-12T01:37:38.755079+0000","last_undegraded":"2024-09-12T01:37:38.755079+0000","last_fullsized":"2024-09-12T01:37:38.755079+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:36.167076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":777,"num_read_kb":13125,"num_write":984,"num_write_kb":40186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":541,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:07.243705+0000","last_change":"2024-09-12T00:24:48.220966+0000","last_active":"2024-09-12T01:34:07.243705+0000","last_peered":"2024-09-12T01:34:07.243705+0000","last_clean":"2024-09-12T01:34:07.243705+0000","last_became_active":"2024-09-12T00:24:46.426160+0000","last_became_peered":"2024-09-12T00:24:46.426160+0000","last_unstale":"2024-09-12T01:34:07.243705+0000","last_undegraded":"2024-09-12T01:34:07.243705+0000","last_fullsized":"2024-09-12T01:34:07.243705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:07.751628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:49.524827+0000","last_change":"2024-09-12T00:25:04.483165+0000","last_active":"2024-09-12T01:33:49.524827+0000","last_peered":"2024-09-12T01:33:49.524827+0000","last_clean":"2024-09-12T01:33:49.524827+0000","last_became_active":"2024-09-12T00:25:04.482856+0000","last_became_peered":"2024-09-12T00:25:04.482856+0000","last_unstale":"2024-09-12T01:33:49.524827+0000","last_undegraded":"2024-09-12T01:33:49.524827+0000","last_fullsized":"2024-09-12T01:33:49.524827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:17.015689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'141","reported_seq":706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.422769+0000","last_change":"2024-09-12T00:25:06.498471+0000","last_active":"2024-09-12T01:36:07.422769+0000","last_peered":"2024-09-12T01:36:07.422769+0000","last_clean":"2024-09-12T01:36:07.422769+0000","last_became_active":"2024-09-12T00:25:06.497888+0000","last_became_peered":"2024-09-12T00:25:06.497888+0000","last_unstale":"2024-09-12T01:36:07.422769+0000","last_undegraded":"2024-09-12T01:36:07.422769+0000","last_fullsized":"2024-09-12T01:36:07.422769+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:19:52.806203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":168,"num_write":116,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'802","reported_seq":2656,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.529336+0000","last_change":"2024-09-12T00:25:08.513106+0000","last_active":"2024-09-12T01:37:38.529336+0000","last_peered":"2024-09-12T01:37:38.529336+0000","last_clean":"2024-09-12T01:37:38.529336+0000","last_became_active":"2024-09-12T00:25:08.512784+0000","last_became_peered":"2024-09-12T00:25:08.512784+0000","last_unstale":"2024-09-12T01:37:38.529336+0000","last_undegraded":"2024-09-12T01:37:38.529336+0000","last_fullsized":"2024-09-12T01:37:38.529336+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:47.339140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'243","reported_seq":771,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:10.294224+0000","last_change":"2024-09-12T00:25:10.523553+0000","last_active":"2024-09-12T01:36:10.294224+0000","last_peered":"2024-09-12T01:36:10.294224+0000","last_clean":"2024-09-12T01:36:10.294224+0000","last_became_active":"2024-09-12T00:25:10.523258+0000","last_became_peered":"2024-09-12T00:25:10.523258+0000","last_unstale":"2024-09-12T01:36:10.294224+0000","last_undegraded":"2024-09-12T01:36:10.294224+0000","last_fullsized":"2024-09-12T01:36:10.294224+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:05.850202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'489","reported_seq":2075,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:56.600382+0000","last_change":"2024-09-12T00:25:02.468737+0000","last_active":"2024-09-12T01:33:56.600382+0000","last_peered":"2024-09-12T01:33:56.600382+0000","last_clean":"2024-09-12T01:33:56.600382+0000","last_became_active":"2024-09-12T00:25:02.468436+0000","last_became_peered":"2024-09-12T00:25:02.468436+0000","last_unstale":"2024-09-12T01:33:56.600382+0000","last_undegraded":"2024-09-12T01:33:56.600382+0000","last_fullsized":"2024-09-12T01:33:56.600382+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:34.093331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2713,"num_read_kb":2534,"num_write":588,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'194","reported_seq":844,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.762162+0000","last_change":"2024-09-12T00:25:00.456455+0000","last_active":"2024-09-12T01:37:38.762162+0000","last_peered":"2024-09-12T01:37:38.762162+0000","last_clean":"2024-09-12T01:37:38.762162+0000","last_became_active":"2024-09-12T00:25:00.456071+0000","last_became_peered":"2024-09-12T00:25:00.456071+0000","last_unstale":"2024-09-12T01:37:38.762162+0000","last_undegraded":"2024-09-12T01:37:38.762162+0000","last_fullsized":"2024-09-12T01:37:38.762162+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:15.020137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":39651,"num_write":895,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:09.527303+0000","last_change":"2024-09-12T00:24:48.218804+0000","last_active":"2024-09-12T01:34:09.527303+0000","last_peered":"2024-09-12T01:34:09.527303+0000","last_clean":"2024-09-12T01:34:09.527303+0000","last_became_active":"2024-09-12T00:24:46.425908+0000","last_became_peered":"2024-09-12T00:24:46.425908+0000","last_unstale":"2024-09-12T01:34:09.527303+0000","last_undegraded":"2024-09-12T01:34:09.527303+0000","last_fullsized":"2024-09-12T01:34:09.527303+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:45.196467+0000","last_clean_scrub_stamp":"2024-09-12T00:24:45.196467+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:43.693370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085110299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"38'3","reported_seq":992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.292360+0000","last_change":"2024-09-12T00:25:04.482182+0000","last_active":"2024-09-12T01:37:38.292360+0000","last_peered":"2024-09-12T01:37:38.292360+0000","last_clean":"2024-09-12T01:37:38.292360+0000","last_became_active":"2024-09-12T00:25:04.481193+0000","last_became_peered":"2024-09-12T00:25:04.481193+0000","last_unstale":"2024-09-12T01:37:38.292360+0000","last_undegraded":"2024-09-12T01:37:38.292360+0000","last_fullsized":"2024-09-12T01:37:38.292360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:59.006487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'357","reported_seq":1109,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.893836+0000","last_change":"2024-09-12T00:25:06.492488+0000","last_active":"2024-09-12T01:37:38.893836+0000","last_peered":"2024-09-12T01:37:38.893836+0000","last_clean":"2024-09-12T01:37:38.893836+0000","last_became_active":"2024-09-12T00:25:06.492189+0000","last_became_peered":"2024-09-12T00:25:06.492189+0000","last_unstale":"2024-09-12T01:37:38.893836+0000","last_undegraded":"2024-09-12T01:37:38.893836+0000","last_fullsized":"2024-09-12T01:37:38.893836+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:44.290586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35877,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":729,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.242319+0000","last_change":"2024-09-12T00:25:08.510520+0000","last_active":"2024-09-12T01:33:57.242319+0000","last_peered":"2024-09-12T01:33:57.242319+0000","last_clean":"2024-09-12T01:33:57.242319+0000","last_became_active":"2024-09-12T00:25:08.510167+0000","last_became_peered":"2024-09-12T00:25:08.510167+0000","last_unstale":"2024-09-12T01:33:57.242319+0000","last_undegraded":"2024-09-12T01:33:57.242319+0000","last_fullsized":"2024-09-12T01:33:57.242319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:02.351709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'112","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.478978+0000","last_change":"2024-09-12T00:25:10.526124+0000","last_active":"2024-09-12T01:36:12.478978+0000","last_peered":"2024-09-12T01:36:12.478978+0000","last_clean":"2024-09-12T01:36:12.478978+0000","last_became_active":"2024-09-12T00:25:10.525850+0000","last_became_peered":"2024-09-12T00:25:10.525850+0000","last_unstale":"2024-09-12T01:36:12.478978+0000","last_undegraded":"2024-09-12T01:36:12.478978+0000","last_fullsized":"2024-09-12T01:36:12.478978+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:52.252550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'144","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.336165+0000","last_change":"2024-09-12T00:25:10.527379+0000","last_active":"2024-09-12T01:36:11.336165+0000","last_peered":"2024-09-12T01:36:11.336165+0000","last_clean":"2024-09-12T01:36:11.336165+0000","last_became_active":"2024-09-12T00:25:10.526982+0000","last_became_peered":"2024-09-12T00:25:10.526982+0000","last_unstale":"2024-09-12T01:36:11.336165+0000","last_undegraded":"2024-09-12T01:36:11.336165+0000","last_fullsized":"2024-09-12T01:36:11.336165+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:40.227802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":212,"num_write":342,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'493","reported_seq":2074,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.878429+0000","last_change":"2024-09-12T00:25:02.472468+0000","last_active":"2024-09-12T01:35:08.878429+0000","last_peered":"2024-09-12T01:35:08.878429+0000","last_clean":"2024-09-12T01:35:08.878429+0000","last_became_active":"2024-09-12T00:25:02.472013+0000","last_became_peered":"2024-09-12T00:25:02.472013+0000","last_unstale":"2024-09-12T01:35:08.878429+0000","last_undegraded":"2024-09-12T01:35:08.878429+0000","last_fullsized":"2024-09-12T01:35:08.878429+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":400,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:24:27.839901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2517,"num_read_kb":2353,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'215","reported_seq":917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.591988+0000","last_change":"2024-09-12T00:25:00.473993+0000","last_active":"2024-09-12T01:37:38.591988+0000","last_peered":"2024-09-12T01:37:38.591988+0000","last_clean":"2024-09-12T01:37:38.591988+0000","last_became_active":"2024-09-12T00:25:00.473591+0000","last_became_peered":"2024-09-12T00:25:00.473591+0000","last_unstale":"2024-09-12T01:37:38.591988+0000","last_undegraded":"2024-09-12T01:37:38.591988+0000","last_fullsized":"2024-09-12T01:37:38.591988+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:13.812127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308446,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":52508,"num_write":917,"num_write_kb":35191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.179649+0000","last_change":"2024-09-12T00:25:04.480021+0000","last_active":"2024-09-12T01:35:04.179649+0000","last_peered":"2024-09-12T01:35:04.179649+0000","last_clean":"2024-09-12T01:35:04.179649+0000","last_became_active":"2024-09-12T00:25:04.479701+0000","last_became_peered":"2024-09-12T00:25:04.479701+0000","last_unstale":"2024-09-12T01:35:04.179649+0000","last_undegraded":"2024-09-12T01:35:04.179649+0000","last_fullsized":"2024-09-12T01:35:04.179649+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:14.742672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'160","reported_seq":756,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.677507+0000","last_change":"2024-09-12T00:25:06.500803+0000","last_active":"2024-09-12T01:37:38.677507+0000","last_peered":"2024-09-12T01:37:38.677507+0000","last_clean":"2024-09-12T01:37:38.677507+0000","last_became_active":"2024-09-12T00:25:06.500315+0000","last_became_peered":"2024-09-12T00:25:06.500315+0000","last_unstale":"2024-09-12T01:37:38.677507+0000","last_undegraded":"2024-09-12T01:37:38.677507+0000","last_fullsized":"2024-09-12T01:37:38.677507+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:36.321812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6391,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":221,"num_read_kb":264,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.123727+0000","last_change":"2024-09-12T00:25:08.517253+0000","last_active":"2024-09-12T01:35:10.123727+0000","last_peered":"2024-09-12T01:35:10.123727+0000","last_clean":"2024-09-12T01:35:10.123727+0000","last_became_active":"2024-09-12T00:25:08.516921+0000","last_became_peered":"2024-09-12T00:25:08.516921+0000","last_unstale":"2024-09-12T01:35:10.123727+0000","last_undegraded":"2024-09-12T01:35:10.123727+0000","last_fullsized":"2024-09-12T01:35:10.123727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:11.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'115","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:25.126051+0000","last_change":"2024-09-12T00:25:10.525063+0000","last_active":"2024-09-12T01:35:25.126051+0000","last_peered":"2024-09-12T01:35:25.126051+0000","last_clean":"2024-09-12T01:35:25.126051+0000","last_became_active":"2024-09-12T00:25:10.524416+0000","last_became_peered":"2024-09-12T00:25:10.524416+0000","last_unstale":"2024-09-12T01:35:25.126051+0000","last_undegraded":"2024-09-12T01:35:25.126051+0000","last_fullsized":"2024-09-12T01:35:25.126051+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:13.897999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":157,"num_read_kb":134,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'449","reported_seq":2012,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.193697+0000","last_change":"2024-09-12T00:25:02.473711+0000","last_active":"2024-09-12T01:36:11.193697+0000","last_peered":"2024-09-12T01:36:11.193697+0000","last_clean":"2024-09-12T01:36:11.193697+0000","last_became_active":"2024-09-12T00:25:02.471242+0000","last_became_peered":"2024-09-12T00:25:02.471242+0000","last_unstale":"2024-09-12T01:36:11.193697+0000","last_undegraded":"2024-09-12T01:36:11.193697+0000","last_fullsized":"2024-09-12T01:36:11.193697+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:25.707605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2437,"num_read_kb":2317,"num_write":523,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'218","reported_seq":878,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.857523+0000","last_change":"2024-09-12T00:25:00.481178+0000","last_active":"2024-09-12T01:37:38.857523+0000","last_peered":"2024-09-12T01:37:38.857523+0000","last_clean":"2024-09-12T01:37:38.857523+0000","last_became_active":"2024-09-12T00:25:00.480801+0000","last_became_peered":"2024-09-12T00:25:00.480801+0000","last_unstale":"2024-09-12T01:37:38.857523+0000","last_undegraded":"2024-09-12T01:37:38.857523+0000","last_fullsized":"2024-09-12T01:37:38.857523+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:23.032999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288330,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":555,"num_read_kb":14522,"num_write":924,"num_write_kb":19421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:07.252680+0000","last_change":"2024-09-12T00:25:04.484027+0000","last_active":"2024-09-12T01:35:07.252680+0000","last_peered":"2024-09-12T01:35:07.252680+0000","last_clean":"2024-09-12T01:35:07.252680+0000","last_became_active":"2024-09-12T00:25:04.482891+0000","last_became_peered":"2024-09-12T00:25:04.482891+0000","last_unstale":"2024-09-12T01:35:07.252680+0000","last_undegraded":"2024-09-12T01:35:07.252680+0000","last_fullsized":"2024-09-12T01:35:07.252680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:48.325429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'68","reported_seq":592,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:43.925146+0000","last_change":"2024-09-12T00:25:06.501436+0000","last_active":"2024-09-12T01:35:43.925146+0000","last_peered":"2024-09-12T01:35:43.925146+0000","last_clean":"2024-09-12T01:35:43.925146+0000","last_became_active":"2024-09-12T00:25:06.501049+0000","last_became_peered":"2024-09-12T00:25:06.501049+0000","last_unstale":"2024-09-12T01:35:43.925146+0000","last_undegraded":"2024-09-12T01:35:43.925146+0000","last_fullsized":"2024-09-12T01:35:43.925146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:39.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":50,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088627+0000","last_change":"2024-09-12T00:25:08.506372+0000","last_active":"2024-09-12T01:35:10.088627+0000","last_peered":"2024-09-12T01:35:10.088627+0000","last_clean":"2024-09-12T01:35:10.088627+0000","last_became_active":"2024-09-12T00:25:08.506052+0000","last_became_peered":"2024-09-12T00:25:08.506052+0000","last_unstale":"2024-09-12T01:35:10.088627+0000","last_undegraded":"2024-09-12T01:35:10.088627+0000","last_fullsized":"2024-09-12T01:35:10.088627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:29.150145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'177","reported_seq":704,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.203143+0000","last_change":"2024-09-12T00:25:10.525258+0000","last_active":"2024-09-12T01:36:11.203143+0000","last_peered":"2024-09-12T01:36:11.203143+0000","last_clean":"2024-09-12T01:36:11.203143+0000","last_became_active":"2024-09-12T00:25:10.524992+0000","last_became_peered":"2024-09-12T00:25:10.524992+0000","last_unstale":"2024-09-12T01:36:11.203143+0000","last_undegraded":"2024-09-12T01:36:11.203143+0000","last_fullsized":"2024-09-12T01:36:11.203143+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:04.187071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":300,"num_read_kb":289,"num_write":406,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'593","reported_seq":2213,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428085+0000","last_change":"2024-09-12T00:25:02.468999+0000","last_active":"2024-09-12T01:37:18.428085+0000","last_peered":"2024-09-12T01:37:18.428085+0000","last_clean":"2024-09-12T01:37:18.428085+0000","last_became_active":"2024-09-12T00:25:02.468715+0000","last_became_peered":"2024-09-12T00:25:02.468715+0000","last_unstale":"2024-09-12T01:37:18.428085+0000","last_undegraded":"2024-09-12T01:37:18.428085+0000","last_fullsized":"2024-09-12T01:37:18.428085+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":500,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:09.616582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2927,"num_read_kb":2680,"num_write":750,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'255","reported_seq":904,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.668798+0000","last_change":"2024-09-12T00:25:00.482223+0000","last_active":"2024-09-12T01:37:38.668798+0000","last_peered":"2024-09-12T01:37:38.668798+0000","last_clean":"2024-09-12T01:37:38.668798+0000","last_became_active":"2024-09-12T00:25:00.481741+0000","last_became_peered":"2024-09-12T00:25:00.481741+0000","last_unstale":"2024-09-12T01:37:38.668798+0000","last_undegraded":"2024-09-12T01:37:38.668798+0000","last_fullsized":"2024-09-12T01:37:38.668798+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:46.144319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":2782,"num_write":1086,"num_write_kb":27824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088007+0000","last_change":"2024-09-12T00:25:04.476625+0000","last_active":"2024-09-12T01:35:05.088007+0000","last_peered":"2024-09-12T01:35:05.088007+0000","last_clean":"2024-09-12T01:35:05.088007+0000","last_became_active":"2024-09-12T00:25:04.476356+0000","last_became_peered":"2024-09-12T00:25:04.476356+0000","last_unstale":"2024-09-12T01:35:05.088007+0000","last_undegraded":"2024-09-12T01:35:05.088007+0000","last_fullsized":"2024-09-12T01:35:05.088007+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:49:48.898254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'186","reported_seq":793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.905124+0000","last_change":"2024-09-12T00:25:06.496641+0000","last_active":"2024-09-12T01:37:38.905124+0000","last_peered":"2024-09-12T01:37:38.905124+0000","last_clean":"2024-09-12T01:37:38.905124+0000","last_became_active":"2024-09-12T00:25:06.496372+0000","last_became_peered":"2024-09-12T00:25:06.496372+0000","last_unstale":"2024-09-12T01:37:38.905124+0000","last_undegraded":"2024-09-12T01:37:38.905124+0000","last_fullsized":"2024-09-12T01:37:38.905124+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:02.866379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11132,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":274,"num_read_kb":379,"num_write":160,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088829+0000","last_change":"2024-09-12T00:25:08.509562+0000","last_active":"2024-09-12T01:35:09.088829+0000","last_peered":"2024-09-12T01:35:09.088829+0000","last_clean":"2024-09-12T01:35:09.088829+0000","last_became_active":"2024-09-12T00:25:08.508336+0000","last_became_peered":"2024-09-12T00:25:08.508336+0000","last_unstale":"2024-09-12T01:35:09.088829+0000","last_undegraded":"2024-09-12T01:35:09.088829+0000","last_fullsized":"2024-09-12T01:35:09.088829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:42.261339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'122","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.535080+0000","last_change":"2024-09-12T00:25:10.524167+0000","last_active":"2024-09-12T01:35:14.535080+0000","last_peered":"2024-09-12T01:35:14.535080+0000","last_clean":"2024-09-12T01:35:14.535080+0000","last_became_active":"2024-09-12T00:25:10.522375+0000","last_became_peered":"2024-09-12T00:25:10.522375+0000","last_unstale":"2024-09-12T01:35:14.535080+0000","last_undegraded":"2024-09-12T01:35:14.535080+0000","last_fullsized":"2024-09-12T01:35:14.535080+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:07.393133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":308,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'819","reported_seq":2384,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.833892+0000","last_change":"2024-09-12T00:25:02.473893+0000","last_active":"2024-09-12T01:35:16.833892+0000","last_peered":"2024-09-12T01:35:16.833892+0000","last_clean":"2024-09-12T01:35:16.833892+0000","last_became_active":"2024-09-12T00:25:02.473631+0000","last_became_peered":"2024-09-12T00:25:02.473631+0000","last_unstale":"2024-09-12T01:35:16.833892+0000","last_undegraded":"2024-09-12T01:35:16.833892+0000","last_fullsized":"2024-09-12T01:35:16.833892+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:23.372646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3838,"num_read_kb":3448,"num_write":1071,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'213","reported_seq":856,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.797969+0000","last_change":"2024-09-12T00:25:00.462263+0000","last_active":"2024-09-12T01:37:38.797969+0000","last_peered":"2024-09-12T01:37:38.797969+0000","last_clean":"2024-09-12T01:37:38.797969+0000","last_became_active":"2024-09-12T00:25:00.461875+0000","last_became_peered":"2024-09-12T00:25:00.461875+0000","last_unstale":"2024-09-12T01:37:38.797969+0000","last_undegraded":"2024-09-12T01:37:38.797969+0000","last_fullsized":"2024-09-12T01:37:38.797969+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:08.987863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288524,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":40693,"num_write":998,"num_write_kb":39273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533703+0000","last_change":"2024-09-12T00:25:04.486530+0000","last_active":"2024-09-12T01:35:04.533703+0000","last_peered":"2024-09-12T01:35:04.533703+0000","last_clean":"2024-09-12T01:35:04.533703+0000","last_became_active":"2024-09-12T00:25:04.486195+0000","last_became_peered":"2024-09-12T00:25:04.486195+0000","last_unstale":"2024-09-12T01:35:04.533703+0000","last_undegraded":"2024-09-12T01:35:04.533703+0000","last_fullsized":"2024-09-12T01:35:04.533703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:28.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'153","reported_seq":742,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.875995+0000","last_change":"2024-09-12T00:25:06.493690+0000","last_active":"2024-09-12T01:37:38.875995+0000","last_peered":"2024-09-12T01:37:38.875995+0000","last_clean":"2024-09-12T01:37:38.875995+0000","last_became_active":"2024-09-12T00:25:06.493276+0000","last_became_peered":"2024-09-12T00:25:06.493276+0000","last_unstale":"2024-09-12T01:37:38.875995+0000","last_undegraded":"2024-09-12T01:37:38.875995+0000","last_fullsized":"2024-09-12T01:37:38.875995+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:57.912640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":282,"num_write":108,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.123775+0000","last_change":"2024-09-12T00:25:08.513038+0000","last_active":"2024-09-12T01:35:10.123775+0000","last_peered":"2024-09-12T01:35:10.123775+0000","last_clean":"2024-09-12T01:35:10.123775+0000","last_became_active":"2024-09-12T00:25:08.512647+0000","last_became_peered":"2024-09-12T00:25:08.512647+0000","last_unstale":"2024-09-12T01:35:10.123775+0000","last_undegraded":"2024-09-12T01:35:10.123775+0000","last_fullsized":"2024-09-12T01:35:10.123775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:28.714653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'319","reported_seq":1615,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.676199+0000","last_change":"2024-09-12T00:25:02.475789+0000","last_active":"2024-09-12T01:35:04.676199+0000","last_peered":"2024-09-12T01:35:04.676199+0000","last_clean":"2024-09-12T01:35:04.676199+0000","last_became_active":"2024-09-12T00:25:02.475490+0000","last_became_peered":"2024-09-12T00:25:02.475490+0000","last_unstale":"2024-09-12T01:35:04.676199+0000","last_undegraded":"2024-09-12T01:35:04.676199+0000","last_fullsized":"2024-09-12T01:35:04.676199+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:44.106869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1691,"num_read_kb":1609,"num_write":373,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'212","reported_seq":820,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.816248+0000","last_change":"2024-09-12T00:25:00.462380+0000","last_active":"2024-09-12T01:37:38.816248+0000","last_peered":"2024-09-12T01:37:38.816248+0000","last_clean":"2024-09-12T01:37:38.816248+0000","last_became_active":"2024-09-12T00:25:00.462022+0000","last_became_peered":"2024-09-12T00:25:00.462022+0000","last_unstale":"2024-09-12T01:37:38.816248+0000","last_undegraded":"2024-09-12T01:37:38.816248+0000","last_fullsized":"2024-09-12T01:37:38.816248+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:53.418485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":5153,"num_write":1017,"num_write_kb":32149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.182675+0000","last_change":"2024-09-12T00:25:04.487420+0000","last_active":"2024-09-12T01:35:24.182675+0000","last_peered":"2024-09-12T01:35:24.182675+0000","last_clean":"2024-09-12T01:35:24.182675+0000","last_became_active":"2024-09-12T00:25:04.487192+0000","last_became_peered":"2024-09-12T00:25:04.487192+0000","last_unstale":"2024-09-12T01:35:24.182675+0000","last_undegraded":"2024-09-12T01:35:24.182675+0000","last_fullsized":"2024-09-12T01:35:24.182675+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:45.179481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'229","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.864437+0000","last_change":"2024-09-12T00:25:06.498928+0000","last_active":"2024-09-12T01:37:38.864437+0000","last_peered":"2024-09-12T01:37:38.864437+0000","last_clean":"2024-09-12T01:37:38.864437+0000","last_became_active":"2024-09-12T00:25:06.498651+0000","last_became_peered":"2024-09-12T00:25:06.498651+0000","last_unstale":"2024-09-12T01:37:38.864437+0000","last_undegraded":"2024-09-12T01:37:38.864437+0000","last_fullsized":"2024-09-12T01:37:38.864437+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:22.315708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9365,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":332,"num_read_kb":425,"num_write":210,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088704+0000","last_change":"2024-09-12T00:25:08.507366+0000","last_active":"2024-09-12T01:35:10.088704+0000","last_peered":"2024-09-12T01:35:10.088704+0000","last_clean":"2024-09-12T01:35:10.088704+0000","last_became_active":"2024-09-12T00:25:08.507090+0000","last_became_peered":"2024-09-12T00:25:08.507090+0000","last_unstale":"2024-09-12T01:35:10.088704+0000","last_undegraded":"2024-09-12T01:35:10.088704+0000","last_fullsized":"2024-09-12T01:35:10.088704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:09.874475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'186","reported_seq":707,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.725493+0000","last_change":"2024-09-12T00:25:10.522192+0000","last_active":"2024-09-12T01:36:09.725493+0000","last_peered":"2024-09-12T01:36:09.725493+0000","last_clean":"2024-09-12T01:36:09.725493+0000","last_became_active":"2024-09-12T00:25:10.521886+0000","last_became_peered":"2024-09-12T00:25:10.521886+0000","last_unstale":"2024-09-12T01:36:09.725493+0000","last_undegraded":"2024-09-12T01:36:09.725493+0000","last_fullsized":"2024-09-12T01:36:09.725493+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.743861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":280,"num_read_kb":274,"num_write":435,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'456","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.411387+0000","last_change":"2024-09-12T00:25:02.463605+0000","last_active":"2024-09-12T01:37:18.411387+0000","last_peered":"2024-09-12T01:37:18.411387+0000","last_clean":"2024-09-12T01:37:18.411387+0000","last_became_active":"2024-09-12T00:25:02.463187+0000","last_became_peered":"2024-09-12T00:25:02.463187+0000","last_unstale":"2024-09-12T01:37:18.411387+0000","last_undegraded":"2024-09-12T01:37:18.411387+0000","last_fullsized":"2024-09-12T01:37:18.411387+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:03.195160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2353,"num_read_kb":2190,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'299","reported_seq":988,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.872422+0000","last_change":"2024-09-12T00:25:00.469310+0000","last_active":"2024-09-12T01:37:38.872422+0000","last_peered":"2024-09-12T01:37:38.872422+0000","last_clean":"2024-09-12T01:37:38.872422+0000","last_became_active":"2024-09-12T00:25:00.467785+0000","last_became_peered":"2024-09-12T00:25:00.467785+0000","last_unstale":"2024-09-12T01:37:38.872422+0000","last_undegraded":"2024-09-12T01:37:38.872422+0000","last_fullsized":"2024-09-12T01:37:38.872422+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:53.465549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":731,"num_read_kb":946,"num_write":1133,"num_write_kb":20145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:50.080174+0000","last_change":"2024-09-12T00:25:04.484951+0000","last_active":"2024-09-12T01:33:50.080174+0000","last_peered":"2024-09-12T01:33:50.080174+0000","last_clean":"2024-09-12T01:33:50.080174+0000","last_became_active":"2024-09-12T00:25:04.484608+0000","last_became_peered":"2024-09-12T00:25:04.484608+0000","last_unstale":"2024-09-12T01:33:50.080174+0000","last_undegraded":"2024-09-12T01:33:50.080174+0000","last_fullsized":"2024-09-12T01:33:50.080174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:12.048616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'198","reported_seq":805,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.885494+0000","last_change":"2024-09-12T00:25:06.490294+0000","last_active":"2024-09-12T01:37:38.885494+0000","last_peered":"2024-09-12T01:37:38.885494+0000","last_clean":"2024-09-12T01:37:38.885494+0000","last_became_active":"2024-09-12T00:25:06.489578+0000","last_became_peered":"2024-09-12T00:25:06.489578+0000","last_unstale":"2024-09-12T01:37:38.885494+0000","last_undegraded":"2024-09-12T01:37:38.885494+0000","last_fullsized":"2024-09-12T01:37:38.885494+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:10.076563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7791,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":284,"num_read_kb":342,"num_write":192,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.002258+0000","last_change":"2024-09-12T00:25:08.513646+0000","last_active":"2024-09-12T01:35:09.002258+0000","last_peered":"2024-09-12T01:35:09.002258+0000","last_clean":"2024-09-12T01:35:09.002258+0000","last_became_active":"2024-09-12T00:25:08.513330+0000","last_became_peered":"2024-09-12T00:25:08.513330+0000","last_unstale":"2024-09-12T01:35:09.002258+0000","last_undegraded":"2024-09-12T01:35:09.002258+0000","last_fullsized":"2024-09-12T01:35:09.002258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:40.371456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'218","reported_seq":1100,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:08.536614+0000","last_change":"2024-09-12T00:25:10.527941+0000","last_active":"2024-09-12T01:36:08.536614+0000","last_peered":"2024-09-12T01:36:08.536614+0000","last_clean":"2024-09-12T01:36:08.536614+0000","last_became_active":"2024-09-12T00:25:10.527649+0000","last_became_peered":"2024-09-12T00:25:10.527649+0000","last_unstale":"2024-09-12T01:36:08.536614+0000","last_undegraded":"2024-09-12T01:36:08.536614+0000","last_fullsized":"2024-09-12T01:36:08.536614+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:30.223583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":648,"num_write":596,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'365","reported_seq":1815,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.802431+0000","last_change":"2024-09-12T00:25:02.479298+0000","last_active":"2024-09-12T01:35:34.802431+0000","last_peered":"2024-09-12T01:35:34.802431+0000","last_clean":"2024-09-12T01:35:34.802431+0000","last_became_active":"2024-09-12T00:25:02.479051+0000","last_became_peered":"2024-09-12T00:25:02.479051+0000","last_unstale":"2024-09-12T01:35:34.802431+0000","last_undegraded":"2024-09-12T01:35:34.802431+0000","last_fullsized":"2024-09-12T01:35:34.802431+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:59.990966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1824,"num_write":392,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'196","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.732801+0000","last_change":"2024-09-12T00:25:00.455462+0000","last_active":"2024-09-12T01:37:38.732801+0000","last_peered":"2024-09-12T01:37:38.732801+0000","last_clean":"2024-09-12T01:37:38.732801+0000","last_became_active":"2024-09-12T00:25:00.454796+0000","last_became_peered":"2024-09-12T00:25:00.454796+0000","last_unstale":"2024-09-12T01:37:38.732801+0000","last_undegraded":"2024-09-12T01:37:38.732801+0000","last_fullsized":"2024-09-12T01:37:38.732801+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:31:11.220113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661693,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":2462,"num_write":975,"num_write_kb":27053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088088+0000","last_change":"2024-09-12T00:25:04.475794+0000","last_active":"2024-09-12T01:35:05.088088+0000","last_peered":"2024-09-12T01:35:05.088088+0000","last_clean":"2024-09-12T01:35:05.088088+0000","last_became_active":"2024-09-12T00:25:04.475432+0000","last_became_peered":"2024-09-12T00:25:04.475432+0000","last_unstale":"2024-09-12T01:35:05.088088+0000","last_undegraded":"2024-09-12T01:35:05.088088+0000","last_fullsized":"2024-09-12T01:35:05.088088+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:40.125056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'174","reported_seq":773,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.727058+0000","last_change":"2024-09-12T00:25:06.500060+0000","last_active":"2024-09-12T01:37:38.727058+0000","last_peered":"2024-09-12T01:37:38.727058+0000","last_clean":"2024-09-12T01:37:38.727058+0000","last_became_active":"2024-09-12T00:25:06.499452+0000","last_became_peered":"2024-09-12T00:25:06.499452+0000","last_unstale":"2024-09-12T01:37:38.727058+0000","last_undegraded":"2024-09-12T01:37:38.727058+0000","last_fullsized":"2024-09-12T01:37:38.727058+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:26:39.160375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6920,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":302,"num_write":132,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125335+0000","last_change":"2024-09-12T00:25:08.514860+0000","last_active":"2024-09-12T01:35:20.125335+0000","last_peered":"2024-09-12T01:35:20.125335+0000","last_clean":"2024-09-12T01:35:20.125335+0000","last_became_active":"2024-09-12T00:25:08.514591+0000","last_became_peered":"2024-09-12T00:25:08.514591+0000","last_unstale":"2024-09-12T01:35:20.125335+0000","last_undegraded":"2024-09-12T01:35:20.125335+0000","last_fullsized":"2024-09-12T01:35:20.125335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:20.635770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'120","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.574196+0000","last_change":"2024-09-12T00:25:10.527404+0000","last_active":"2024-09-12T01:37:19.574196+0000","last_peered":"2024-09-12T01:37:19.574196+0000","last_clean":"2024-09-12T01:37:19.574196+0000","last_became_active":"2024-09-12T00:25:10.527125+0000","last_became_peered":"2024-09-12T00:25:10.527125+0000","last_unstale":"2024-09-12T01:37:19.574196+0000","last_undegraded":"2024-09-12T01:37:19.574196+0000","last_fullsized":"2024-09-12T01:37:19.574196+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:04.270864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":179,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'797","reported_seq":2247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.251816+0000","last_change":"2024-09-12T00:25:02.464662+0000","last_active":"2024-09-12T01:35:02.251816+0000","last_peered":"2024-09-12T01:35:02.251816+0000","last_clean":"2024-09-12T01:35:02.251816+0000","last_became_active":"2024-09-12T00:25:02.464409+0000","last_became_peered":"2024-09-12T00:25:02.464409+0000","last_unstale":"2024-09-12T01:35:02.251816+0000","last_undegraded":"2024-09-12T01:35:02.251816+0000","last_fullsized":"2024-09-12T01:35:02.251816+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:53.007518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3724,"num_read_kb":3326,"num_write":1070,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'248","reported_seq":928,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.777644+0000","last_change":"2024-09-12T00:25:00.466956+0000","last_active":"2024-09-12T01:37:38.777644+0000","last_peered":"2024-09-12T01:37:38.777644+0000","last_clean":"2024-09-12T01:37:38.777644+0000","last_became_active":"2024-09-12T00:25:00.466015+0000","last_became_peered":"2024-09-12T00:25:00.466015+0000","last_unstale":"2024-09-12T01:37:38.777644+0000","last_undegraded":"2024-09-12T01:37:38.777644+0000","last_fullsized":"2024-09-12T01:37:38.777644+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:26.695504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":59883,"num_write":1086,"num_write_kb":30675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:07.252715+0000","last_change":"2024-09-12T00:25:04.482399+0000","last_active":"2024-09-12T01:35:07.252715+0000","last_peered":"2024-09-12T01:35:07.252715+0000","last_clean":"2024-09-12T01:35:07.252715+0000","last_became_active":"2024-09-12T00:25:04.482091+0000","last_became_peered":"2024-09-12T00:25:04.482091+0000","last_unstale":"2024-09-12T01:35:07.252715+0000","last_undegraded":"2024-09-12T01:35:07.252715+0000","last_fullsized":"2024-09-12T01:35:07.252715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.772204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'124","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.560906+0000","last_change":"2024-09-12T00:25:06.492106+0000","last_active":"2024-09-12T01:36:07.560906+0000","last_peered":"2024-09-12T01:36:07.560906+0000","last_clean":"2024-09-12T01:36:07.560906+0000","last_became_active":"2024-09-12T00:25:06.491582+0000","last_became_peered":"2024-09-12T00:25:06.491582+0000","last_unstale":"2024-09-12T01:36:07.560906+0000","last_undegraded":"2024-09-12T01:36:07.560906+0000","last_fullsized":"2024-09-12T01:36:07.560906+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:35.340695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":169,"num_read_kb":163,"num_write":166,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'765","reported_seq":2555,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.523342+0000","last_change":"2024-09-12T00:25:08.507545+0000","last_active":"2024-09-12T01:37:38.523342+0000","last_peered":"2024-09-12T01:37:38.523342+0000","last_clean":"2024-09-12T01:37:38.523342+0000","last_became_active":"2024-09-12T00:25:08.506288+0000","last_became_peered":"2024-09-12T00:25:08.506288+0000","last_unstale":"2024-09-12T01:37:38.523342+0000","last_undegraded":"2024-09-12T01:37:38.523342+0000","last_fullsized":"2024-09-12T01:37:38.523342+0000","mapping_epoch":34,"log_start":"266'701","ondisk_log_start":"266'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:47:41.048601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'126","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.534992+0000","last_change":"2024-09-12T00:25:10.525346+0000","last_active":"2024-09-12T01:35:14.534992+0000","last_peered":"2024-09-12T01:35:14.534992+0000","last_clean":"2024-09-12T01:35:14.534992+0000","last_became_active":"2024-09-12T00:25:10.525045+0000","last_became_peered":"2024-09-12T00:25:10.525045+0000","last_unstale":"2024-09-12T01:35:14.534992+0000","last_undegraded":"2024-09-12T01:35:14.534992+0000","last_fullsized":"2024-09-12T01:35:14.534992+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:19.669222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'457","reported_seq":2071,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.489386+0000","last_change":"2024-09-12T00:25:02.471992+0000","last_active":"2024-09-12T01:35:19.489386+0000","last_peered":"2024-09-12T01:35:19.489386+0000","last_clean":"2024-09-12T01:35:19.489386+0000","last_became_active":"2024-09-12T00:25:02.471255+0000","last_became_peered":"2024-09-12T00:25:02.471255+0000","last_unstale":"2024-09-12T01:35:19.489386+0000","last_undegraded":"2024-09-12T01:35:19.489386+0000","last_fullsized":"2024-09-12T01:35:19.489386+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:31.823002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2599,"num_read_kb":2460,"num_write":533,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'175","reported_seq":811,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.900378+0000","last_change":"2024-09-12T00:25:00.458803+0000","last_active":"2024-09-12T01:37:38.900378+0000","last_peered":"2024-09-12T01:37:38.900378+0000","last_clean":"2024-09-12T01:37:38.900378+0000","last_became_active":"2024-09-12T00:25:00.456853+0000","last_became_peered":"2024-09-12T00:25:00.456853+0000","last_unstale":"2024-09-12T01:37:38.900378+0000","last_undegraded":"2024-09-12T01:37:38.900378+0000","last_fullsized":"2024-09-12T01:37:38.900378+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:13.587033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1794910,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":16809,"num_write":841,"num_write_kb":28613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.088296+0000","last_change":"2024-09-12T00:25:04.482756+0000","last_active":"2024-09-12T01:35:04.088296+0000","last_peered":"2024-09-12T01:35:04.088296+0000","last_clean":"2024-09-12T01:35:04.088296+0000","last_became_active":"2024-09-12T00:25:04.482441+0000","last_became_peered":"2024-09-12T00:25:04.482441+0000","last_unstale":"2024-09-12T01:35:04.088296+0000","last_undegraded":"2024-09-12T01:35:04.088296+0000","last_fullsized":"2024-09-12T01:35:04.088296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:06.666983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'219","reported_seq":854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.799555+0000","last_change":"2024-09-12T00:25:06.494170+0000","last_active":"2024-09-12T01:37:38.799555+0000","last_peered":"2024-09-12T01:37:38.799555+0000","last_clean":"2024-09-12T01:37:38.799555+0000","last_became_active":"2024-09-12T00:25:06.493625+0000","last_became_peered":"2024-09-12T00:25:06.493625+0000","last_unstale":"2024-09-12T01:37:38.799555+0000","last_undegraded":"2024-09-12T01:37:38.799555+0000","last_fullsized":"2024-09-12T01:37:38.799555+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:01.532658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9308,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":374,"num_write":180,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.254339+0000","last_change":"2024-09-12T00:25:08.511276+0000","last_active":"2024-09-12T01:35:17.254339+0000","last_peered":"2024-09-12T01:35:17.254339+0000","last_clean":"2024-09-12T01:35:17.254339+0000","last_became_active":"2024-09-12T00:25:08.511024+0000","last_became_peered":"2024-09-12T00:25:08.511024+0000","last_unstale":"2024-09-12T01:35:17.254339+0000","last_undegraded":"2024-09-12T01:35:17.254339+0000","last_fullsized":"2024-09-12T01:35:17.254339+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:18.243804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'102","reported_seq":611,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:08.631109+0000","last_change":"2024-09-12T00:25:10.526277+0000","last_active":"2024-09-12T01:36:08.631109+0000","last_peered":"2024-09-12T01:36:08.631109+0000","last_clean":"2024-09-12T01:36:08.631109+0000","last_became_active":"2024-09-12T00:25:10.525981+0000","last_became_peered":"2024-09-12T00:25:10.525981+0000","last_unstale":"2024-09-12T01:36:08.631109+0000","last_undegraded":"2024-09-12T01:36:08.631109+0000","last_fullsized":"2024-09-12T01:36:08.631109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":244,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'801","reported_seq":2397,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.430285+0000","last_change":"2024-09-12T00:25:02.463863+0000","last_active":"2024-09-12T01:37:18.430285+0000","last_peered":"2024-09-12T01:37:18.430285+0000","last_clean":"2024-09-12T01:37:18.430285+0000","last_became_active":"2024-09-12T00:25:02.463545+0000","last_became_peered":"2024-09-12T00:25:02.463545+0000","last_unstale":"2024-09-12T01:37:18.430285+0000","last_undegraded":"2024-09-12T01:37:18.430285+0000","last_fullsized":"2024-09-12T01:37:18.430285+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:38.345347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3630,"num_write":1061,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'201","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.675352+0000","last_change":"2024-09-12T00:25:00.479118+0000","last_active":"2024-09-12T01:37:38.675352+0000","last_peered":"2024-09-12T01:37:38.675352+0000","last_clean":"2024-09-12T01:37:38.675352+0000","last_became_active":"2024-09-12T00:25:00.478561+0000","last_became_peered":"2024-09-12T00:25:00.478561+0000","last_unstale":"2024-09-12T01:37:38.675352+0000","last_undegraded":"2024-09-12T01:37:38.675352+0000","last_fullsized":"2024-09-12T01:37:38.675352+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:02.954102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568262,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":8616,"num_write":923,"num_write_kb":24681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.088076+0000","last_change":"2024-09-12T00:25:04.481420+0000","last_active":"2024-09-12T01:35:05.088076+0000","last_peered":"2024-09-12T01:35:05.088076+0000","last_clean":"2024-09-12T01:35:05.088076+0000","last_became_active":"2024-09-12T00:25:04.481146+0000","last_became_peered":"2024-09-12T00:25:04.481146+0000","last_unstale":"2024-09-12T01:35:05.088076+0000","last_undegraded":"2024-09-12T01:35:05.088076+0000","last_fullsized":"2024-09-12T01:35:05.088076+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:58.000768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'155","reported_seq":753,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.817743+0000","last_change":"2024-09-12T00:25:06.499351+0000","last_active":"2024-09-12T01:37:38.817743+0000","last_peered":"2024-09-12T01:37:38.817743+0000","last_clean":"2024-09-12T01:37:38.817743+0000","last_became_active":"2024-09-12T00:25:06.499065+0000","last_became_peered":"2024-09-12T00:25:06.499065+0000","last_unstale":"2024-09-12T01:37:38.817743+0000","last_undegraded":"2024-09-12T01:37:38.817743+0000","last_fullsized":"2024-09-12T01:37:38.817743+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:00.555004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":326,"num_write":120,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.535752+0000","last_change":"2024-09-12T00:25:08.510993+0000","last_active":"2024-09-12T01:35:19.535752+0000","last_peered":"2024-09-12T01:35:19.535752+0000","last_clean":"2024-09-12T01:35:19.535752+0000","last_became_active":"2024-09-12T00:25:08.510416+0000","last_became_peered":"2024-09-12T00:25:08.510416+0000","last_unstale":"2024-09-12T01:35:19.535752+0000","last_undegraded":"2024-09-12T01:35:19.535752+0000","last_fullsized":"2024-09-12T01:35:19.535752+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:07.820462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'116","reported_seq":638,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.676200+0000","last_change":"2024-09-12T00:25:10.521269+0000","last_active":"2024-09-12T01:36:07.676200+0000","last_peered":"2024-09-12T01:36:07.676200+0000","last_clean":"2024-09-12T01:36:07.676200+0000","last_became_active":"2024-09-12T00:25:10.520808+0000","last_became_peered":"2024-09-12T00:25:10.520808+0000","last_unstale":"2024-09-12T01:36:07.676200+0000","last_undegraded":"2024-09-12T01:36:07.676200+0000","last_fullsized":"2024-09-12T01:36:07.676200+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:03.946656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1152,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":290,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'797","reported_seq":2308,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.340715+0000","last_change":"2024-09-12T00:25:02.470881+0000","last_active":"2024-09-12T01:36:12.340715+0000","last_peered":"2024-09-12T01:36:12.340715+0000","last_clean":"2024-09-12T01:36:12.340715+0000","last_became_active":"2024-09-12T00:25:02.470607+0000","last_became_peered":"2024-09-12T00:25:02.470607+0000","last_unstale":"2024-09-12T01:36:12.340715+0000","last_undegraded":"2024-09-12T01:36:12.340715+0000","last_fullsized":"2024-09-12T01:36:12.340715+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:49.586235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3788,"num_read_kb":3387,"num_write":1064,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'177","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.873940+0000","last_change":"2024-09-12T00:25:00.465714+0000","last_active":"2024-09-12T01:37:38.873940+0000","last_peered":"2024-09-12T01:37:38.873940+0000","last_clean":"2024-09-12T01:37:38.873940+0000","last_became_active":"2024-09-12T00:25:00.465095+0000","last_became_peered":"2024-09-12T00:25:00.465095+0000","last_unstale":"2024-09-12T01:37:38.873940+0000","last_undegraded":"2024-09-12T01:37:38.873940+0000","last_fullsized":"2024-09-12T01:37:38.873940+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:48:10.785936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":87968,"num_write":861,"num_write_kb":34661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088796+0000","last_change":"2024-09-12T00:25:04.483527+0000","last_active":"2024-09-12T01:35:09.088796+0000","last_peered":"2024-09-12T01:35:09.088796+0000","last_clean":"2024-09-12T01:35:09.088796+0000","last_became_active":"2024-09-12T00:25:04.483232+0000","last_became_peered":"2024-09-12T00:25:04.483232+0000","last_unstale":"2024-09-12T01:35:09.088796+0000","last_undegraded":"2024-09-12T01:35:09.088796+0000","last_fullsized":"2024-09-12T01:35:09.088796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:29.187018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'120","reported_seq":690,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.707553+0000","last_change":"2024-09-12T00:25:06.500325+0000","last_active":"2024-09-12T01:37:38.707553+0000","last_peered":"2024-09-12T01:37:38.707553+0000","last_clean":"2024-09-12T01:37:38.707553+0000","last_became_active":"2024-09-12T00:25:06.499749+0000","last_became_peered":"2024-09-12T00:25:06.499749+0000","last_unstale":"2024-09-12T01:37:38.707553+0000","last_undegraded":"2024-09-12T01:37:38.707553+0000","last_fullsized":"2024-09-12T01:37:38.707553+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:39.445969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8122,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":217,"num_write":76,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534440+0000","last_change":"2024-09-12T00:25:08.514387+0000","last_active":"2024-09-12T01:35:09.534440+0000","last_peered":"2024-09-12T01:35:09.534440+0000","last_clean":"2024-09-12T01:35:09.534440+0000","last_became_active":"2024-09-12T00:25:08.513977+0000","last_became_peered":"2024-09-12T00:25:08.513977+0000","last_unstale":"2024-09-12T01:35:09.534440+0000","last_undegraded":"2024-09-12T01:35:09.534440+0000","last_fullsized":"2024-09-12T01:35:09.534440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.665951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'144","reported_seq":1248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.185545+0000","last_change":"2024-09-12T00:25:10.530536+0000","last_active":"2024-09-12T01:36:11.185545+0000","last_peered":"2024-09-12T01:36:11.185545+0000","last_clean":"2024-09-12T01:36:11.185545+0000","last_became_active":"2024-09-12T00:25:10.530103+0000","last_became_peered":"2024-09-12T00:25:10.530103+0000","last_unstale":"2024-09-12T01:36:11.185545+0000","last_undegraded":"2024-09-12T01:36:11.185545+0000","last_fullsized":"2024-09-12T01:36:11.185545+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.601805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":760,"num_write":344,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'1249","reported_seq":2942,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088591+0000","last_change":"2024-09-12T00:25:02.467411+0000","last_active":"2024-09-12T01:35:10.088591+0000","last_peered":"2024-09-12T01:35:10.088591+0000","last_clean":"2024-09-12T01:35:10.088591+0000","last_became_active":"2024-09-12T00:25:02.467159+0000","last_became_peered":"2024-09-12T00:25:02.467159+0000","last_unstale":"2024-09-12T01:35:10.088591+0000","last_undegraded":"2024-09-12T01:35:10.088591+0000","last_fullsized":"2024-09-12T01:35:10.088591+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":1200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:21:32.592501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5713,"num_read_kb":5033,"num_write":1731,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'181","reported_seq":795,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.640952+0000","last_change":"2024-09-12T00:25:00.458860+0000","last_active":"2024-09-12T01:37:38.640952+0000","last_peered":"2024-09-12T01:37:38.640952+0000","last_clean":"2024-09-12T01:37:38.640952+0000","last_became_active":"2024-09-12T00:25:00.458519+0000","last_became_peered":"2024-09-12T00:25:00.458519+0000","last_unstale":"2024-09-12T01:37:38.640952+0000","last_undegraded":"2024-09-12T01:37:38.640952+0000","last_fullsized":"2024-09-12T01:37:38.640952+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:29.743861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174575,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":854,"num_write":913,"num_write_kb":13833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:32:57.233292+0000","last_change":"2024-09-12T00:25:04.482146+0000","last_active":"2024-09-12T01:32:57.233292+0000","last_peered":"2024-09-12T01:32:57.233292+0000","last_clean":"2024-09-12T01:32:57.233292+0000","last_became_active":"2024-09-12T00:25:04.481393+0000","last_became_peered":"2024-09-12T00:25:04.481393+0000","last_unstale":"2024-09-12T01:32:57.233292+0000","last_undegraded":"2024-09-12T01:32:57.233292+0000","last_fullsized":"2024-09-12T01:32:57.233292+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:22.018902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'193","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.737443+0000","last_change":"2024-09-12T00:25:06.490707+0000","last_active":"2024-09-12T01:37:38.737443+0000","last_peered":"2024-09-12T01:37:38.737443+0000","last_clean":"2024-09-12T01:37:38.737443+0000","last_became_active":"2024-09-12T00:25:06.490384+0000","last_became_peered":"2024-09-12T00:25:06.490384+0000","last_unstale":"2024-09-12T01:37:38.737443+0000","last_undegraded":"2024-09-12T01:37:38.737443+0000","last_fullsized":"2024-09-12T01:37:38.737443+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:11.867492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8836,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:12.253423+0000","last_change":"2024-09-12T00:25:08.508294+0000","last_active":"2024-09-12T01:35:12.253423+0000","last_peered":"2024-09-12T01:35:12.253423+0000","last_clean":"2024-09-12T01:35:12.253423+0000","last_became_active":"2024-09-12T00:25:08.507837+0000","last_became_peered":"2024-09-12T00:25:08.507837+0000","last_unstale":"2024-09-12T01:35:12.253423+0000","last_undegraded":"2024-09-12T01:35:12.253423+0000","last_fullsized":"2024-09-12T01:35:12.253423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:13.827697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'136","reported_seq":683,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.438271+0000","last_change":"2024-09-12T00:25:10.528310+0000","last_active":"2024-09-12T01:37:18.438271+0000","last_peered":"2024-09-12T01:37:18.438271+0000","last_clean":"2024-09-12T01:37:18.438271+0000","last_became_active":"2024-09-12T00:25:10.528040+0000","last_became_peered":"2024-09-12T00:25:10.528040+0000","last_unstale":"2024-09-12T01:37:18.438271+0000","last_undegraded":"2024-09-12T01:37:18.438271+0000","last_fullsized":"2024-09-12T01:37:18.438271+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":238,"num_write":307,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'1096","reported_seq":2607,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.781254+0000","last_change":"2024-09-12T00:25:02.474566+0000","last_active":"2024-09-12T01:34:39.781254+0000","last_peered":"2024-09-12T01:34:39.781254+0000","last_clean":"2024-09-12T01:34:39.781254+0000","last_became_active":"2024-09-12T00:25:02.474282+0000","last_became_peered":"2024-09-12T00:25:02.474282+0000","last_unstale":"2024-09-12T01:34:39.781254+0000","last_undegraded":"2024-09-12T01:34:39.781254+0000","last_fullsized":"2024-09-12T01:34:39.781254+0000","mapping_epoch":28,"log_start":"266'1000","ondisk_log_start":"266'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:35:37.444902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4398,"num_write":1510,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'185","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.882035+0000","last_change":"2024-09-12T00:25:00.478653+0000","last_active":"2024-09-12T01:37:38.882035+0000","last_peered":"2024-09-12T01:37:38.882035+0000","last_clean":"2024-09-12T01:37:38.882035+0000","last_became_active":"2024-09-12T00:25:00.478259+0000","last_became_peered":"2024-09-12T00:25:00.478259+0000","last_unstale":"2024-09-12T01:37:38.882035+0000","last_undegraded":"2024-09-12T01:37:38.882035+0000","last_fullsized":"2024-09-12T01:37:38.882035+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:16.754223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515600,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":41144,"num_write":873,"num_write_kb":35919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'752","reported_seq":2230,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:32.789666+0000","last_change":"2024-09-12T00:25:02.479779+0000","last_active":"2024-09-12T01:34:32.789666+0000","last_peered":"2024-09-12T01:34:32.789666+0000","last_clean":"2024-09-12T01:34:32.789666+0000","last_became_active":"2024-09-12T00:25:02.479450+0000","last_became_peered":"2024-09-12T00:25:02.479450+0000","last_unstale":"2024-09-12T01:34:32.789666+0000","last_undegraded":"2024-09-12T01:34:32.789666+0000","last_fullsized":"2024-09-12T01:34:32.789666+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:48.463312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3526,"num_read_kb":3183,"num_write":976,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'207","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.755842+0000","last_change":"2024-09-12T00:25:00.468633+0000","last_active":"2024-09-12T01:37:38.755842+0000","last_peered":"2024-09-12T01:37:38.755842+0000","last_clean":"2024-09-12T01:37:38.755842+0000","last_became_active":"2024-09-12T00:25:00.468280+0000","last_became_peered":"2024-09-12T00:25:00.468280+0000","last_unstale":"2024-09-12T01:37:38.755842+0000","last_undegraded":"2024-09-12T01:37:38.755842+0000","last_fullsized":"2024-09-12T01:37:38.755842+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:45.872366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":421,"num_read_kb":15096,"num_write":1006,"num_write_kb":29184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'365","reported_seq":1884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.192081+0000","last_change":"2024-09-12T00:25:02.477649+0000","last_active":"2024-09-12T01:36:11.192081+0000","last_peered":"2024-09-12T01:36:11.192081+0000","last_clean":"2024-09-12T01:36:11.192081+0000","last_became_active":"2024-09-12T00:25:02.476993+0000","last_became_peered":"2024-09-12T00:25:02.476993+0000","last_unstale":"2024-09-12T01:36:11.192081+0000","last_undegraded":"2024-09-12T01:36:11.192081+0000","last_fullsized":"2024-09-12T01:36:11.192081+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:43.749594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2221,"num_read_kb":2131,"num_write":417,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'201","reported_seq":885,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.794562+0000","last_change":"2024-09-12T00:25:00.478242+0000","last_active":"2024-09-12T01:37:38.794562+0000","last_peered":"2024-09-12T01:37:38.794562+0000","last_clean":"2024-09-12T01:37:38.794562+0000","last_became_active":"2024-09-12T00:25:00.477872+0000","last_became_peered":"2024-09-12T00:25:00.477872+0000","last_unstale":"2024-09-12T01:37:38.794562+0000","last_undegraded":"2024-09-12T01:37:38.794562+0000","last_fullsized":"2024-09-12T01:37:38.794562+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:04.405196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590195,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":9353,"num_write":799,"num_write_kb":34820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'478","reported_seq":1981,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.192692+0000","last_change":"2024-09-12T00:25:02.468462+0000","last_active":"2024-09-12T01:36:11.192692+0000","last_peered":"2024-09-12T01:36:11.192692+0000","last_clean":"2024-09-12T01:36:11.192692+0000","last_became_active":"2024-09-12T00:25:02.468180+0000","last_became_peered":"2024-09-12T00:25:02.468180+0000","last_unstale":"2024-09-12T01:36:11.192692+0000","last_undegraded":"2024-09-12T01:36:11.192692+0000","last_fullsized":"2024-09-12T01:36:11.192692+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:04.921278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2321,"num_read_kb":2166,"num_write":540,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'179","reported_seq":788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.683516+0000","last_change":"2024-09-12T00:25:00.472077+0000","last_active":"2024-09-12T01:37:38.683516+0000","last_peered":"2024-09-12T01:37:38.683516+0000","last_clean":"2024-09-12T01:37:38.683516+0000","last_became_active":"2024-09-12T00:25:00.471412+0000","last_became_peered":"2024-09-12T00:25:00.471412+0000","last_unstale":"2024-09-12T01:37:38.683516+0000","last_undegraded":"2024-09-12T01:37:38.683516+0000","last_fullsized":"2024-09-12T01:37:38.683516+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:10.903274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432317,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":354,"num_read_kb":25493,"num_write":898,"num_write_kb":19511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'498","reported_seq":2184,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.646707+0000","last_change":"2024-09-12T00:25:02.469514+0000","last_active":"2024-09-12T01:35:23.646707+0000","last_peered":"2024-09-12T01:35:23.646707+0000","last_clean":"2024-09-12T01:35:23.646707+0000","last_became_active":"2024-09-12T00:25:02.469251+0000","last_became_peered":"2024-09-12T00:25:02.469251+0000","last_unstale":"2024-09-12T01:35:23.646707+0000","last_undegraded":"2024-09-12T01:35:23.646707+0000","last_fullsized":"2024-09-12T01:35:23.646707+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:47.158487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2750,"num_read_kb":2605,"num_write":624,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'206","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.814127+0000","last_change":"2024-09-12T00:25:00.467331+0000","last_active":"2024-09-12T01:37:38.814127+0000","last_peered":"2024-09-12T01:37:38.814127+0000","last_clean":"2024-09-12T01:37:38.814127+0000","last_became_active":"2024-09-12T00:25:00.466945+0000","last_became_peered":"2024-09-12T00:25:00.466945+0000","last_unstale":"2024-09-12T01:37:38.814127+0000","last_undegraded":"2024-09-12T01:37:38.814127+0000","last_fullsized":"2024-09-12T01:37:38.814127+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:39.900588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":18851,"num_write":965,"num_write_kb":35048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'496","reported_seq":2036,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:08.880849+0000","last_change":"2024-09-12T00:25:02.475541+0000","last_active":"2024-09-12T01:35:08.880849+0000","last_peered":"2024-09-12T01:35:08.880849+0000","last_clean":"2024-09-12T01:35:08.880849+0000","last_became_active":"2024-09-12T00:25:02.475225+0000","last_became_peered":"2024-09-12T00:25:02.475225+0000","last_unstale":"2024-09-12T01:35:08.880849+0000","last_undegraded":"2024-09-12T01:35:08.880849+0000","last_fullsized":"2024-09-12T01:35:08.880849+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:53.705825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2326,"num_write":604,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'195","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.848872+0000","last_change":"2024-09-12T00:25:00.468589+0000","last_active":"2024-09-12T01:37:38.848872+0000","last_peered":"2024-09-12T01:37:38.848872+0000","last_clean":"2024-09-12T01:37:38.848872+0000","last_became_active":"2024-09-12T00:25:00.468245+0000","last_became_peered":"2024-09-12T00:25:00.468245+0000","last_unstale":"2024-09-12T01:37:38.848872+0000","last_undegraded":"2024-09-12T01:37:38.848872+0000","last_fullsized":"2024-09-12T01:37:38.848872+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:59.481921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":27275,"num_write":960,"num_write_kb":19137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'527","reported_seq":2284,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:53.479407+0000","last_change":"2024-09-12T00:25:02.469328+0000","last_active":"2024-09-12T01:34:53.479407+0000","last_peered":"2024-09-12T01:34:53.479407+0000","last_clean":"2024-09-12T01:34:53.479407+0000","last_became_active":"2024-09-12T00:25:02.469044+0000","last_became_peered":"2024-09-12T00:25:02.469044+0000","last_unstale":"2024-09-12T01:34:53.479407+0000","last_undegraded":"2024-09-12T01:34:53.479407+0000","last_fullsized":"2024-09-12T01:34:53.479407+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":500,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:22:12.185074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2889,"num_read_kb":2724,"num_write":624,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'185","reported_seq":810,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.811056+0000","last_change":"2024-09-12T00:25:00.487875+0000","last_active":"2024-09-12T01:37:38.811056+0000","last_peered":"2024-09-12T01:37:38.811056+0000","last_clean":"2024-09-12T01:37:38.811056+0000","last_became_active":"2024-09-12T00:25:00.487526+0000","last_became_peered":"2024-09-12T00:25:00.487526+0000","last_unstale":"2024-09-12T01:37:38.811056+0000","last_undegraded":"2024-09-12T01:37:38.811056+0000","last_fullsized":"2024-09-12T01:37:38.811056+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:49.142939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306655,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":3010,"num_write":923,"num_write_kb":19090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1186","reported_seq":2778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.404544+0000","last_change":"2024-09-12T00:25:02.465875+0000","last_active":"2024-09-12T01:37:18.404544+0000","last_peered":"2024-09-12T01:37:18.404544+0000","last_clean":"2024-09-12T01:37:18.404544+0000","last_became_active":"2024-09-12T00:25:02.465257+0000","last_became_peered":"2024-09-12T00:25:02.465257+0000","last_unstale":"2024-09-12T01:37:18.404544+0000","last_undegraded":"2024-09-12T01:37:18.404544+0000","last_fullsized":"2024-09-12T01:37:18.404544+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:04.981975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5507,"num_read_kb":4876,"num_write":1621,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'262","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.593553+0000","last_change":"2024-09-12T00:25:00.469603+0000","last_active":"2024-09-12T01:37:38.593553+0000","last_peered":"2024-09-12T01:37:38.593553+0000","last_clean":"2024-09-12T01:37:38.593553+0000","last_became_active":"2024-09-12T00:25:00.469159+0000","last_became_peered":"2024-09-12T00:25:00.469159+0000","last_unstale":"2024-09-12T01:37:38.593553+0000","last_undegraded":"2024-09-12T01:37:38.593553+0000","last_fullsized":"2024-09-12T01:37:38.593553+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:29.592131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":57821,"num_write":1101,"num_write_kb":41989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'486","reported_seq":1921,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123191+0000","last_change":"2024-09-12T00:25:02.470885+0000","last_active":"2024-09-12T01:35:05.123191+0000","last_peered":"2024-09-12T01:35:05.123191+0000","last_clean":"2024-09-12T01:35:05.123191+0000","last_became_active":"2024-09-12T00:25:02.470623+0000","last_became_peered":"2024-09-12T00:25:02.470623+0000","last_unstale":"2024-09-12T01:35:05.123191+0000","last_undegraded":"2024-09-12T01:35:05.123191+0000","last_fullsized":"2024-09-12T01:35:05.123191+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":400,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:25.739488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2404,"num_read_kb":2207,"num_write":594,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'242","reported_seq":907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.778318+0000","last_change":"2024-09-12T00:25:00.470643+0000","last_active":"2024-09-12T01:37:38.778318+0000","last_peered":"2024-09-12T01:37:38.778318+0000","last_clean":"2024-09-12T01:37:38.778318+0000","last_became_active":"2024-09-12T00:25:00.469918+0000","last_became_peered":"2024-09-12T00:25:00.469918+0000","last_unstale":"2024-09-12T01:37:38.778318+0000","last_undegraded":"2024-09-12T01:37:38.778318+0000","last_fullsized":"2024-09-12T01:37:38.778318+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:08.268473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":488,"num_read_kb":51750,"num_write":1103,"num_write_kb":39694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'612","reported_seq":2412,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.801716+0000","last_change":"2024-09-12T00:25:02.476152+0000","last_active":"2024-09-12T01:35:34.801716+0000","last_peered":"2024-09-12T01:35:34.801716+0000","last_clean":"2024-09-12T01:35:34.801716+0000","last_became_active":"2024-09-12T00:25:02.475864+0000","last_became_peered":"2024-09-12T00:25:02.475864+0000","last_unstale":"2024-09-12T01:35:34.801716+0000","last_undegraded":"2024-09-12T01:35:34.801716+0000","last_fullsized":"2024-09-12T01:35:34.801716+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":600,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:31.109147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3105,"num_read_kb":2885,"num_write":734,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'287","reported_seq":986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.874176+0000","last_change":"2024-09-12T00:25:00.468654+0000","last_active":"2024-09-12T01:37:38.874176+0000","last_peered":"2024-09-12T01:37:38.874176+0000","last_clean":"2024-09-12T01:37:38.874176+0000","last_became_active":"2024-09-12T00:25:00.468228+0000","last_became_peered":"2024-09-12T00:25:00.468228+0000","last_unstale":"2024-09-12T01:37:38.874176+0000","last_undegraded":"2024-09-12T01:37:38.874176+0000","last_fullsized":"2024-09-12T01:37:38.874176+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:04.194595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":681,"num_read_kb":67032,"num_write":1230,"num_write_kb":28377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'949","reported_seq":2514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.490891+0000","last_change":"2024-09-12T00:25:02.476025+0000","last_active":"2024-09-12T01:35:23.490891+0000","last_peered":"2024-09-12T01:35:23.490891+0000","last_clean":"2024-09-12T01:35:23.490891+0000","last_became_active":"2024-09-12T00:25:02.473441+0000","last_became_peered":"2024-09-12T00:25:02.473441+0000","last_unstale":"2024-09-12T01:35:23.490891+0000","last_undegraded":"2024-09-12T01:35:23.490891+0000","last_fullsized":"2024-09-12T01:35:23.490891+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:50.101335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4462,"num_read_kb":3929,"num_write":1316,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'215","reported_seq":868,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.733268+0000","last_change":"2024-09-12T00:25:00.465738+0000","last_active":"2024-09-12T01:37:38.733268+0000","last_peered":"2024-09-12T01:37:38.733268+0000","last_clean":"2024-09-12T01:37:38.733268+0000","last_became_active":"2024-09-12T00:25:00.465127+0000","last_became_peered":"2024-09-12T00:25:00.465127+0000","last_unstale":"2024-09-12T01:37:38.733268+0000","last_undegraded":"2024-09-12T01:37:38.733268+0000","last_fullsized":"2024-09-12T01:37:38.733268+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:37.553300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":16638,"num_write":1049,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'828","reported_seq":2449,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:16.834057+0000","last_change":"2024-09-12T00:25:02.464676+0000","last_active":"2024-09-12T01:35:16.834057+0000","last_peered":"2024-09-12T01:35:16.834057+0000","last_clean":"2024-09-12T01:35:16.834057+0000","last_became_active":"2024-09-12T00:25:02.464386+0000","last_became_peered":"2024-09-12T00:25:02.464386+0000","last_unstale":"2024-09-12T01:35:16.834057+0000","last_undegraded":"2024-09-12T01:35:16.834057+0000","last_fullsized":"2024-09-12T01:35:16.834057+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":800,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:41.649172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3522,"num_write":1059,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'166","reported_seq":826,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.673196+0000","last_change":"2024-09-12T00:25:00.465954+0000","last_active":"2024-09-12T01:37:38.673196+0000","last_peered":"2024-09-12T01:37:38.673196+0000","last_clean":"2024-09-12T01:37:38.673196+0000","last_became_active":"2024-09-12T00:25:00.465400+0000","last_became_peered":"2024-09-12T00:25:00.465400+0000","last_unstale":"2024-09-12T01:37:38.673196+0000","last_undegraded":"2024-09-12T01:37:38.673196+0000","last_fullsized":"2024-09-12T01:37:38.673196+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:52.577671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":4582,"num_write":828,"num_write_kb":26519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'779","reported_seq":2416,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194962+0000","last_change":"2024-09-12T00:25:02.469311+0000","last_active":"2024-09-12T01:36:11.194962+0000","last_peered":"2024-09-12T01:36:11.194962+0000","last_clean":"2024-09-12T01:36:11.194962+0000","last_became_active":"2024-09-12T00:25:02.469046+0000","last_became_peered":"2024-09-12T00:25:02.469046+0000","last_unstale":"2024-09-12T01:36:11.194962+0000","last_undegraded":"2024-09-12T01:36:11.194962+0000","last_fullsized":"2024-09-12T01:36:11.194962+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:19.426796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3834,"num_read_kb":3478,"num_write":1008,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'208","reported_seq":878,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.757693+0000","last_change":"2024-09-12T00:25:00.469566+0000","last_active":"2024-09-12T01:37:38.757693+0000","last_peered":"2024-09-12T01:37:38.757693+0000","last_clean":"2024-09-12T01:37:38.757693+0000","last_became_active":"2024-09-12T00:25:00.468581+0000","last_became_peered":"2024-09-12T00:25:00.468581+0000","last_unstale":"2024-09-12T01:37:38.757693+0000","last_undegraded":"2024-09-12T01:37:38.757693+0000","last_fullsized":"2024-09-12T01:37:38.757693+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:58.853274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323902,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":48643,"num_write":1011,"num_write_kb":19361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'797","reported_seq":2362,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.397154+0000","last_change":"2024-09-12T00:25:02.477178+0000","last_active":"2024-09-12T01:37:18.397154+0000","last_peered":"2024-09-12T01:37:18.397154+0000","last_clean":"2024-09-12T01:37:18.397154+0000","last_became_active":"2024-09-12T00:25:02.476825+0000","last_became_peered":"2024-09-12T00:25:02.476825+0000","last_unstale":"2024-09-12T01:37:18.397154+0000","last_undegraded":"2024-09-12T01:37:18.397154+0000","last_fullsized":"2024-09-12T01:37:18.397154+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:53.361725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3888,"num_read_kb":3500,"num_write":1075,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'188","reported_seq":864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.754796+0000","last_change":"2024-09-12T00:25:00.480493+0000","last_active":"2024-09-12T01:37:38.754796+0000","last_peered":"2024-09-12T01:37:38.754796+0000","last_clean":"2024-09-12T01:37:38.754796+0000","last_became_active":"2024-09-12T00:25:00.480122+0000","last_became_peered":"2024-09-12T00:25:00.480122+0000","last_unstale":"2024-09-12T01:37:38.754796+0000","last_undegraded":"2024-09-12T01:37:38.754796+0000","last_fullsized":"2024-09-12T01:37:38.754796+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:57.940376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399183,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":553,"num_read_kb":7914,"num_write":895,"num_write_kb":29144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'690","reported_seq":2144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.193773+0000","last_change":"2024-09-12T00:25:02.467034+0000","last_active":"2024-09-12T01:36:11.193773+0000","last_peered":"2024-09-12T01:36:11.193773+0000","last_clean":"2024-09-12T01:36:11.193773+0000","last_became_active":"2024-09-12T00:25:02.465790+0000","last_became_peered":"2024-09-12T00:25:02.465790+0000","last_unstale":"2024-09-12T01:36:11.193773+0000","last_undegraded":"2024-09-12T01:36:11.193773+0000","last_fullsized":"2024-09-12T01:36:11.193773+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":600,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:47.967138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3268,"num_read_kb":2971,"num_write":903,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'258","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.806913+0000","last_change":"2024-09-12T00:25:00.469984+0000","last_active":"2024-09-12T01:37:38.806913+0000","last_peered":"2024-09-12T01:37:38.806913+0000","last_clean":"2024-09-12T01:37:38.806913+0000","last_became_active":"2024-09-12T00:25:00.469634+0000","last_became_peered":"2024-09-12T00:25:00.469634+0000","last_unstale":"2024-09-12T01:37:38.806913+0000","last_undegraded":"2024-09-12T01:37:38.806913+0000","last_fullsized":"2024-09-12T01:37:38.806913+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:05.806256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155756,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1718,"num_write":1162,"num_write_kb":27079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'434","reported_seq":2042,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.340373+0000","last_change":"2024-09-12T00:25:02.465571+0000","last_active":"2024-09-12T01:36:12.340373+0000","last_peered":"2024-09-12T01:36:12.340373+0000","last_clean":"2024-09-12T01:36:12.340373+0000","last_became_active":"2024-09-12T00:25:02.464112+0000","last_became_peered":"2024-09-12T00:25:02.464112+0000","last_unstale":"2024-09-12T01:36:12.340373+0000","last_undegraded":"2024-09-12T01:36:12.340373+0000","last_fullsized":"2024-09-12T01:36:12.340373+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":400,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:22.009640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2410,"num_read_kb":2284,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'226","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.812901+0000","last_change":"2024-09-12T00:25:00.469057+0000","last_active":"2024-09-12T01:37:38.812901+0000","last_peered":"2024-09-12T01:37:38.812901+0000","last_clean":"2024-09-12T01:37:38.812901+0000","last_became_active":"2024-09-12T00:25:00.468600+0000","last_became_peered":"2024-09-12T00:25:00.468600+0000","last_unstale":"2024-09-12T01:37:38.812901+0000","last_undegraded":"2024-09-12T01:37:38.812901+0000","last_fullsized":"2024-09-12T01:37:38.812901+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:05.715126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133763,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":7263,"num_write":1147,"num_write_kb":27569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'182","reported_seq":826,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.881632+0000","last_change":"2024-09-12T00:25:00.470300+0000","last_active":"2024-09-12T01:37:38.881632+0000","last_peered":"2024-09-12T01:37:38.881632+0000","last_clean":"2024-09-12T01:37:38.881632+0000","last_became_active":"2024-09-12T00:25:00.469382+0000","last_became_peered":"2024-09-12T00:25:00.469382+0000","last_unstale":"2024-09-12T01:37:38.881632+0000","last_undegraded":"2024-09-12T01:37:38.881632+0000","last_fullsized":"2024-09-12T01:37:38.881632+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:57.619429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":14411,"num_write":860,"num_write_kb":23706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'916","reported_seq":2486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338888+0000","last_change":"2024-09-12T00:25:02.475301+0000","last_active":"2024-09-12T01:36:12.338888+0000","last_peered":"2024-09-12T01:36:12.338888+0000","last_clean":"2024-09-12T01:36:12.338888+0000","last_became_active":"2024-09-12T00:25:02.475004+0000","last_became_peered":"2024-09-12T00:25:02.475004+0000","last_unstale":"2024-09-12T01:36:12.338888+0000","last_undegraded":"2024-09-12T01:36:12.338888+0000","last_fullsized":"2024-09-12T01:36:12.338888+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":900,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:15:17.094814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4224,"num_read_kb":3778,"num_write":1247,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'230","reported_seq":955,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.829157+0000","last_change":"2024-09-12T00:25:00.472266+0000","last_active":"2024-09-12T01:37:38.829157+0000","last_peered":"2024-09-12T01:37:38.829157+0000","last_clean":"2024-09-12T01:37:38.829157+0000","last_became_active":"2024-09-12T00:25:00.471411+0000","last_became_peered":"2024-09-12T00:25:00.471411+0000","last_unstale":"2024-09-12T01:37:38.829157+0000","last_undegraded":"2024-09-12T01:37:38.829157+0000","last_fullsized":"2024-09-12T01:37:38.829157+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:24:59.424556+0000","last_clean_scrub_stamp":"2024-09-12T00:24:59.424556+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:34.132087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323861,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":157504,"num_write":954,"num_write_kb":45267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'647","reported_seq":2390,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.194867+0000","last_change":"2024-09-12T00:25:02.463284+0000","last_active":"2024-09-12T01:36:11.194867+0000","last_peered":"2024-09-12T01:36:11.194867+0000","last_clean":"2024-09-12T01:36:11.194867+0000","last_became_active":"2024-09-12T00:25:02.462993+0000","last_became_peered":"2024-09-12T00:25:02.462993+0000","last_unstale":"2024-09-12T01:36:11.194867+0000","last_undegraded":"2024-09-12T01:36:11.194867+0000","last_fullsized":"2024-09-12T01:36:11.194867+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":600,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:48.709170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3586,"num_read_kb":3293,"num_write":883,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5955,"num_read_kb":4160,"num_write":1937,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15084,"num_read_kb":14735,"num_write":16735,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1466,"ondisk_log_size":1466,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":676,"ondisk_log_size":676,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":318753,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":10187,"num_read_kb":12369,"num_write":7087,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1779,"ondisk_log_size":1779,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2373,"num_read_kb":2833,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212728,"num_read_kb":194072,"num_write":55276,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4200,"ondisk_log_size":4200,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":79547187,"num_objects":235,"num_object_clones":0,"num_object_copies":940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":235,"num_whiteouts":0,"num_read":33257,"num_read_kb":1810768,"num_write":62815,"num_write_kb":1904228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108691456,"data_stored":108691456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4112,"ondisk_log_size":4112,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":174385,"num_write":182,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":174274,"num_write":182,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477620,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141144,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94230696,"statfs":{"total":96636764160,"available":96492232704,"internally_reserved":0,"allocated":15908864,"data_stored":13922526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477618,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136056,"kb_used_data":24360,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94235784,"statfs":{"total":96636764160,"available":96497442816,"internally_reserved":0,"allocated":24944640,"data_stored":22945833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424510323,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214348,"kb_used_data":16580,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94157492,"statfs":{"total":96636764160,"available":96417271808,"internally_reserved":0,"allocated":16977920,"data_stored":14990871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510321,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106952,"kb_used_data":17408,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94264888,"statfs":{"total":96636764160,"available":96527245312,"internally_reserved":0,"allocated":17825792,"data_stored":15808424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510322,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239160,"kb_used_data":13548,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94132680,"statfs":{"total":96636764160,"available":96391864320,"internally_reserved":0,"allocated":13873152,"data_stored":11862637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510323,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253136,"kb_used_data":19216,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94118704,"statfs":{"total":96636764160,"available":96377552896,"internally_reserved":0,"allocated":19677184,"data_stored":17673901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510323,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291252,"kb_used_data":17048,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94080588,"statfs":{"total":96636764160,"available":96338522112,"internally_reserved":0,"allocated":17457152,"data_stored":15457736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575734,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":204748,"kb_used_data":16696,"kb_used_omap":1,"kb_used_meta":187966,"kb_avail":94167092,"statfs":{"total":96636764160,"available":96427102208,"internally_reserved":0,"allocated":17096704,"data_stored":15102370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":192477637},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20709376,"data_stored":20709376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12632064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11685888,"data_stored":11685888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15437824,"data_stored":15437824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12865536,"data_stored":12865536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9035776,"data_stored":9035776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13570048,"data_stored":13570048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12754944,"data_stored":12754944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:37:47.106 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.106 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.106 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.106 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.107 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.107 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.107 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.107 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.107 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.108 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.108 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.108 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.108 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.108 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.108 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.108 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.108 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.108 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.109 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.109 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.109 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.109 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.109 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.109 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.109 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.109 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.109 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.110 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.110 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.110 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.110 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.110 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.110 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.110 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.110 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.110 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.110 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.111 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.111 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.111 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.111 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.111 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.111 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.111 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.111 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.111 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.112 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.112 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.112 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.112 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.112 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.112 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.112 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.112 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.112 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.113 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.113 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.113 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.113 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.113 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.113 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.113 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.113 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.113 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.113 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.114 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.114 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.114 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.114 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.114 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.114 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.114 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.114 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.114 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.115 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.115 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.115 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.115 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.115 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.115 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.115 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.115 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.115 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.116 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.116 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.116 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.116 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.116 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.116 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.116 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.116 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.116 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.117 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.117 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.117 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.117 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.117 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.117 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.117 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.117 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.117 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.117 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.118 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.118 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.118 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.118 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.118 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.118 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.118 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.118 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.119 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.119 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.119 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.119 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.119 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.119 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.119 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.119 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.120 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.120 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.120 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.120 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.120 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.120 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.120 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.120 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.120 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.121 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.121 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.121 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.121 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.121 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.121 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.121 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.121 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.122 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.122 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.122 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.122 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.122 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.122 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.122 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.122 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.122 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.123 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.123 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.123 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.123 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.123 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.123 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.123 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.123 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.124 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.124 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.124 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.124 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.124 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.124 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.124 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.124 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.125 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.125 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.125 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.125 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.125 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.125 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.125 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.125 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.125 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.126 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.126 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.126 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.126 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.126 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.126 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.126 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.126 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.126 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.127 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.127 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.127 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.127 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.127 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.127 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.127 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.127 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.127 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.128 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.128 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.128 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.128 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.128 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.128 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.128 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.128 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.128 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.129 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.129 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.129 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.129 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.129 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.129 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.129 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.129 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.129 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.130 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.130 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.130 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.130 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.130 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.130 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.130 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.130 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.130 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.131 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.131 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.131 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.131 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.131 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.131 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.131 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.131 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.131 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.132 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.132 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.132 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.132 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:24:45.196467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.132 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.132 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.132 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.132 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.132 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.133 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.133 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:24:45.196467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.133 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.133 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.133 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.133 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.133 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.133 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.133 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:24:45.196467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.134 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.134 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.134 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.134 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.134 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.134 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.134 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:24:45.196467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.134 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.134 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.135 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.135 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.135 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.135 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.135 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.135 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:24:45.196467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.135 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.135 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.135 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.135 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.136 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.136 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.136 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:24:45.196467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.136 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.136 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.136 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.136 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.136 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.136 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.137 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:24:45.196467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.137 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.137 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.137 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.137 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.137 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.137 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.137 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:24:45.196467+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=45, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.138 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.138 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.138 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.138 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.138 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.138 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.138 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.138 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.138 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.138 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.139 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.139 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.139 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.139 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.139 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.139 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.139 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.139 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.139 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.140 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.140 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.140 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.140 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.140 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.140 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.140 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.140 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.140 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.141 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.141 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.141 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.141 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.141 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.141 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.141 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.141 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.141 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.142 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.142 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.142 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.142 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.142 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.143 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.143 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.143 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.143 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.143 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.143 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.143 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.143 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.144 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.144 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.144 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.144 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.144 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.144 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.144 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.144 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.144 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.144 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.145 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.145 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.145 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.145 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.145 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.145 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.145 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.145 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.145 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.146 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.146 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.146 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.146 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.146 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.146 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.146 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.146 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.146 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.146 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.147 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.147 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.147 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.147 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.147 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.147 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.147 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.147 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.147 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.148 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.148 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.148 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.148 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.148 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.148 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.148 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.148 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.149 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.149 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.149 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.149 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.149 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.149 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.149 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.149 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.150 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.150 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.150 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.150 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.150 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.150 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.150 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:24:59.424556+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=24, tm_sec=59, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.150 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:37:47.150 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:38:07.152 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:07.510 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:38:07.521 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:38:07.524 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":2463,"stamp":"2024-09-12T01:38:06.778950+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80473315,"num_objects":722,"num_object_clones":0,"num_object_copies":1914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":279991,"num_read_kb":2387663,"num_write":144355,"num_write_kb":2165314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":555572,"num_omap_keys":1347,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13479,"ondisk_log_size":13479,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1569768,"kb_used_data":140392,"kb_used_omap":12,"kb_used_meta":1429235,"kb_avail":753404952,"statfs":{"total":773094113280,"available":771486670848,"internally_reserved":0,"allocated":143761408,"data_stored":127764298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1463537200},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":551820,"num_omap_keys":1331,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005755"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.977721+0000","last_change":"2024-09-12T01:02:03.926254+0000","last_active":"2024-09-12T01:34:34.977721+0000","last_peered":"2024-09-12T01:34:34.977721+0000","last_clean":"2024-09-12T01:34:34.977721+0000","last_became_active":"2024-09-12T01:02:03.925687+0000","last_became_peered":"2024-09-12T01:02:03.925687+0000","last_unstale":"2024-09-12T01:34:34.977721+0000","last_undegraded":"2024-09-12T01:34:34.977721+0000","last_fullsized":"2024-09-12T01:34:34.977721+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:25.162167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"266'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:14.095890+0000","last_change":"2024-09-12T00:43:43.813662+0000","last_active":"2024-09-12T01:36:14.095890+0000","last_peered":"2024-09-12T01:36:14.095890+0000","last_clean":"2024-09-12T01:36:14.095890+0000","last_became_active":"2024-09-12T00:43:43.812701+0000","last_became_peered":"2024-09-12T00:43:43.812701+0000","last_unstale":"2024-09-12T01:36:14.095890+0000","last_undegraded":"2024-09-12T01:36:14.095890+0000","last_fullsized":"2024-09-12T01:36:14.095890+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:32.083600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.110512+0000","last_change":"2024-09-12T00:43:38.799582+0000","last_active":"2024-09-12T01:33:40.110512+0000","last_peered":"2024-09-12T01:33:40.110512+0000","last_clean":"2024-09-12T01:33:40.110512+0000","last_became_active":"2024-09-12T00:43:38.799322+0000","last_became_peered":"2024-09-12T00:43:38.799322+0000","last_unstale":"2024-09-12T01:33:40.110512+0000","last_undegraded":"2024-09-12T01:33:40.110512+0000","last_fullsized":"2024-09-12T01:33:40.110512+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:52.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.256826+0000","last_change":"2024-09-12T00:39:17.764042+0000","last_active":"2024-09-12T01:35:32.256826+0000","last_peered":"2024-09-12T01:35:32.256826+0000","last_clean":"2024-09-12T01:35:32.256826+0000","last_became_active":"2024-09-12T00:39:17.763761+0000","last_became_peered":"2024-09-12T00:39:17.763761+0000","last_unstale":"2024-09-12T01:35:32.256826+0000","last_undegraded":"2024-09-12T01:35:32.256826+0000","last_fullsized":"2024-09-12T01:35:32.256826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:49.430258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.175890+0000","last_change":"2024-09-12T01:02:03.925619+0000","last_active":"2024-09-12T01:34:34.175890+0000","last_peered":"2024-09-12T01:34:34.175890+0000","last_clean":"2024-09-12T01:34:34.175890+0000","last_became_active":"2024-09-12T01:02:03.925338+0000","last_became_peered":"2024-09-12T01:02:03.925338+0000","last_unstale":"2024-09-12T01:34:34.175890+0000","last_undegraded":"2024-09-12T01:34:34.175890+0000","last_fullsized":"2024-09-12T01:34:34.175890+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:34.463430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"266'5","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:15.095648+0000","last_change":"2024-09-12T00:43:43.822539+0000","last_active":"2024-09-12T01:36:15.095648+0000","last_peered":"2024-09-12T01:36:15.095648+0000","last_clean":"2024-09-12T01:36:15.095648+0000","last_became_active":"2024-09-12T00:43:43.822189+0000","last_became_peered":"2024-09-12T00:43:43.822189+0000","last_unstale":"2024-09-12T01:36:15.095648+0000","last_undegraded":"2024-09-12T01:36:15.095648+0000","last_fullsized":"2024-09-12T01:36:15.095648+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:14.331070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987382+0000","last_change":"2024-09-12T00:43:38.794157+0000","last_active":"2024-09-12T01:33:38.987382+0000","last_peered":"2024-09-12T01:33:38.987382+0000","last_clean":"2024-09-12T01:33:38.987382+0000","last_became_active":"2024-09-12T00:43:38.793866+0000","last_became_peered":"2024-09-12T00:43:38.793866+0000","last_unstale":"2024-09-12T01:33:38.987382+0000","last_undegraded":"2024-09-12T01:33:38.987382+0000","last_fullsized":"2024-09-12T01:33:38.987382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:51.874866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'33","reported_seq":147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256146+0000","last_change":"2024-09-12T00:39:17.769275+0000","last_active":"2024-09-12T01:35:27.256146+0000","last_peered":"2024-09-12T01:35:27.256146+0000","last_clean":"2024-09-12T01:35:27.256146+0000","last_became_active":"2024-09-12T00:39:17.768977+0000","last_became_peered":"2024-09-12T00:39:17.768977+0000","last_unstale":"2024-09-12T01:35:27.256146+0000","last_undegraded":"2024-09-12T01:35:27.256146+0000","last_fullsized":"2024-09-12T01:35:27.256146+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:10.855870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":119,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.078422+0000","last_change":"2024-09-12T01:02:03.922480+0000","last_active":"2024-09-12T01:33:29.078422+0000","last_peered":"2024-09-12T01:33:29.078422+0000","last_clean":"2024-09-12T01:33:29.078422+0000","last_became_active":"2024-09-12T01:02:03.921938+0000","last_became_peered":"2024-09-12T01:02:03.921938+0000","last_unstale":"2024-09-12T01:33:29.078422+0000","last_undegraded":"2024-09-12T01:33:29.078422+0000","last_fullsized":"2024-09-12T01:33:29.078422+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:49.013238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"266'6","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.576973+0000","last_change":"2024-09-12T00:43:43.814192+0000","last_active":"2024-09-12T01:37:38.576973+0000","last_peered":"2024-09-12T01:37:38.576973+0000","last_clean":"2024-09-12T01:37:38.576973+0000","last_became_active":"2024-09-12T00:43:43.813568+0000","last_became_peered":"2024-09-12T00:43:43.813568+0000","last_unstale":"2024-09-12T01:37:38.576973+0000","last_undegraded":"2024-09-12T01:37:38.576973+0000","last_fullsized":"2024-09-12T01:37:38.576973+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7172,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'7","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.640374+0000","last_change":"2024-09-12T00:43:38.797811+0000","last_active":"2024-09-12T01:37:38.640374+0000","last_peered":"2024-09-12T01:37:38.640374+0000","last_clean":"2024-09-12T01:37:38.640374+0000","last_became_active":"2024-09-12T00:43:38.797520+0000","last_became_peered":"2024-09-12T00:43:38.797520+0000","last_unstale":"2024-09-12T01:37:38.640374+0000","last_undegraded":"2024-09-12T01:37:38.640374+0000","last_fullsized":"2024-09-12T01:37:38.640374+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16390,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'41","reported_seq":171,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173586+0000","last_change":"2024-09-12T00:39:17.769080+0000","last_active":"2024-09-12T01:34:19.173586+0000","last_peered":"2024-09-12T01:34:19.173586+0000","last_clean":"2024-09-12T01:34:19.173586+0000","last_became_active":"2024-09-12T00:39:17.768692+0000","last_became_peered":"2024-09-12T00:39:17.768692+0000","last_unstale":"2024-09-12T01:34:19.173586+0000","last_undegraded":"2024-09-12T01:34:19.173586+0000","last_fullsized":"2024-09-12T01:34:19.173586+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:43.550430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":161,"num_write":65,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987313+0000","last_change":"2024-09-12T01:02:03.922647+0000","last_active":"2024-09-12T01:33:38.987313+0000","last_peered":"2024-09-12T01:33:38.987313+0000","last_clean":"2024-09-12T01:33:38.987313+0000","last_became_active":"2024-09-12T01:02:03.922297+0000","last_became_peered":"2024-09-12T01:02:03.922297+0000","last_unstale":"2024-09-12T01:33:38.987313+0000","last_undegraded":"2024-09-12T01:33:38.987313+0000","last_fullsized":"2024-09-12T01:33:38.987313+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:54.009642+0000","last_change":"2024-09-12T00:43:43.819023+0000","last_active":"2024-09-12T01:35:54.009642+0000","last_peered":"2024-09-12T01:35:54.009642+0000","last_clean":"2024-09-12T01:35:54.009642+0000","last_became_active":"2024-09-12T00:43:43.818668+0000","last_became_peered":"2024-09-12T00:43:43.818668+0000","last_unstale":"2024-09-12T01:35:54.009642+0000","last_undegraded":"2024-09-12T01:35:54.009642+0000","last_fullsized":"2024-09-12T01:35:54.009642+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.092565+0000","last_change":"2024-09-12T00:43:38.795677+0000","last_active":"2024-09-12T01:35:44.092565+0000","last_peered":"2024-09-12T01:35:44.092565+0000","last_clean":"2024-09-12T01:35:44.092565+0000","last_became_active":"2024-09-12T00:43:38.794121+0000","last_became_peered":"2024-09-12T00:43:38.794121+0000","last_unstale":"2024-09-12T01:35:44.092565+0000","last_undegraded":"2024-09-12T01:35:44.092565+0000","last_fullsized":"2024-09-12T01:35:44.092565+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'16","reported_seq":93,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173559+0000","last_change":"2024-09-12T00:39:17.759626+0000","last_active":"2024-09-12T01:34:19.173559+0000","last_peered":"2024-09-12T01:34:19.173559+0000","last_clean":"2024-09-12T01:34:19.173559+0000","last_became_active":"2024-09-12T00:39:17.759016+0000","last_became_peered":"2024-09-12T00:39:17.759016+0000","last_unstale":"2024-09-12T01:34:19.173559+0000","last_undegraded":"2024-09-12T01:34:19.173559+0000","last_fullsized":"2024-09-12T01:34:19.173559+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:25.380216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:15.115873+0000","last_change":"2024-09-12T01:02:03.919665+0000","last_active":"2024-09-12T01:34:15.115873+0000","last_peered":"2024-09-12T01:34:15.115873+0000","last_clean":"2024-09-12T01:34:15.115873+0000","last_became_active":"2024-09-12T01:02:03.919293+0000","last_became_peered":"2024-09-12T01:02:03.919293+0000","last_unstale":"2024-09-12T01:34:15.115873+0000","last_undegraded":"2024-09-12T01:34:15.115873+0000","last_fullsized":"2024-09-12T01:34:15.115873+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:31.969228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:39.978417+0000","last_change":"2024-09-12T00:43:43.818041+0000","last_active":"2024-09-12T01:34:39.978417+0000","last_peered":"2024-09-12T01:34:39.978417+0000","last_clean":"2024-09-12T01:34:39.978417+0000","last_became_active":"2024-09-12T00:43:43.817714+0000","last_became_peered":"2024-09-12T00:43:43.817714+0000","last_unstale":"2024-09-12T01:34:39.978417+0000","last_undegraded":"2024-09-12T01:34:39.978417+0000","last_fullsized":"2024-09-12T01:34:39.978417+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:15.291037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'15","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:49.017973+0000","last_change":"2024-09-12T00:43:38.795483+0000","last_active":"2024-09-12T01:36:49.017973+0000","last_peered":"2024-09-12T01:36:49.017973+0000","last_clean":"2024-09-12T01:36:49.017973+0000","last_became_active":"2024-09-12T00:43:38.795206+0000","last_became_peered":"2024-09-12T00:43:38.795206+0000","last_unstale":"2024-09-12T01:36:49.017973+0000","last_undegraded":"2024-09-12T01:36:49.017973+0000","last_fullsized":"2024-09-12T01:36:49.017973+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:51.351578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":29708,"num_write":20,"num_write_kb":14332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'31","reported_seq":144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:19.173515+0000","last_change":"2024-09-12T00:39:17.762663+0000","last_active":"2024-09-12T01:34:19.173515+0000","last_peered":"2024-09-12T01:34:19.173515+0000","last_clean":"2024-09-12T01:34:19.173515+0000","last_became_active":"2024-09-12T00:39:17.762124+0000","last_became_peered":"2024-09-12T00:39:17.762124+0000","last_unstale":"2024-09-12T01:34:19.173515+0000","last_undegraded":"2024-09-12T01:34:19.173515+0000","last_fullsized":"2024-09-12T01:34:19.173515+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:55.240200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256179+0000","last_change":"2024-09-12T01:02:03.915670+0000","last_active":"2024-09-12T01:35:27.256179+0000","last_peered":"2024-09-12T01:35:27.256179+0000","last_clean":"2024-09-12T01:35:27.256179+0000","last_became_active":"2024-09-12T01:02:03.915387+0000","last_became_peered":"2024-09-12T01:02:03.915387+0000","last_unstale":"2024-09-12T01:35:27.256179+0000","last_undegraded":"2024-09-12T01:35:27.256179+0000","last_fullsized":"2024-09-12T01:35:27.256179+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:30.278716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529511+0000","last_change":"2024-09-12T00:43:43.825343+0000","last_active":"2024-09-12T01:34:29.529511+0000","last_peered":"2024-09-12T01:34:29.529511+0000","last_clean":"2024-09-12T01:34:29.529511+0000","last_became_active":"2024-09-12T00:43:43.825054+0000","last_became_peered":"2024-09-12T00:43:43.825054+0000","last_unstale":"2024-09-12T01:34:29.529511+0000","last_undegraded":"2024-09-12T01:34:29.529511+0000","last_fullsized":"2024-09-12T01:34:29.529511+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:57.949570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:54.547748+0000","last_change":"2024-09-12T00:43:38.794955+0000","last_active":"2024-09-12T01:36:54.547748+0000","last_peered":"2024-09-12T01:36:54.547748+0000","last_clean":"2024-09-12T01:36:54.547748+0000","last_became_active":"2024-09-12T00:43:38.794612+0000","last_became_peered":"2024-09-12T00:43:38.794612+0000","last_unstale":"2024-09-12T01:36:54.547748+0000","last_undegraded":"2024-09-12T01:36:54.547748+0000","last_fullsized":"2024-09-12T01:36:54.547748+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:55.593800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'16","reported_seq":92,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:20.083241+0000","last_change":"2024-09-12T00:39:17.772179+0000","last_active":"2024-09-12T01:34:20.083241+0000","last_peered":"2024-09-12T01:34:20.083241+0000","last_clean":"2024-09-12T01:34:20.083241+0000","last_became_active":"2024-09-12T00:39:17.771839+0000","last_became_peered":"2024-09-12T00:39:17.771839+0000","last_unstale":"2024-09-12T01:34:20.083241+0000","last_undegraded":"2024-09-12T01:34:20.083241+0000","last_fullsized":"2024-09-12T01:34:20.083241+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:56.418566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":43,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.084810+0000","last_change":"2024-09-12T01:02:03.928338+0000","last_active":"2024-09-12T01:34:35.084810+0000","last_peered":"2024-09-12T01:34:35.084810+0000","last_clean":"2024-09-12T01:34:35.084810+0000","last_became_active":"2024-09-12T01:02:03.928036+0000","last_became_peered":"2024-09-12T01:02:03.928036+0000","last_unstale":"2024-09-12T01:34:35.084810+0000","last_undegraded":"2024-09-12T01:34:35.084810+0000","last_fullsized":"2024-09-12T01:34:35.084810+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:58.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:45.079595+0000","last_change":"2024-09-12T00:43:43.819611+0000","last_active":"2024-09-12T01:33:45.079595+0000","last_peered":"2024-09-12T01:33:45.079595+0000","last_clean":"2024-09-12T01:33:45.079595+0000","last_became_active":"2024-09-12T00:43:43.819239+0000","last_became_peered":"2024-09-12T00:43:43.819239+0000","last_unstale":"2024-09-12T01:33:45.079595+0000","last_undegraded":"2024-09-12T01:33:45.079595+0000","last_fullsized":"2024-09-12T01:33:45.079595+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.073168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8210,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"266'10","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.988208+0000","last_change":"2024-09-12T00:43:38.785050+0000","last_active":"2024-09-12T01:36:09.988208+0000","last_peered":"2024-09-12T01:36:09.988208+0000","last_clean":"2024-09-12T01:36:09.988208+0000","last_became_active":"2024-09-12T00:43:38.784746+0000","last_became_peered":"2024-09-12T00:43:38.784746+0000","last_unstale":"2024-09-12T01:36:09.988208+0000","last_undegraded":"2024-09-12T01:36:09.988208+0000","last_fullsized":"2024-09-12T01:36:09.988208+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:12.845708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"257'30","reported_seq":143,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123074+0000","last_change":"2024-09-12T00:39:17.764933+0000","last_active":"2024-09-12T01:35:05.123074+0000","last_peered":"2024-09-12T01:35:05.123074+0000","last_clean":"2024-09-12T01:35:05.123074+0000","last_became_active":"2024-09-12T00:39:17.764658+0000","last_became_peered":"2024-09-12T00:39:17.764658+0000","last_unstale":"2024-09-12T01:35:05.123074+0000","last_undegraded":"2024-09-12T01:35:05.123074+0000","last_fullsized":"2024-09-12T01:35:05.123074+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:54.897501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":139,"num_write":41,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.977764+0000","last_change":"2024-09-12T01:02:03.917684+0000","last_active":"2024-09-12T01:34:34.977764+0000","last_peered":"2024-09-12T01:34:34.977764+0000","last_clean":"2024-09-12T01:34:34.977764+0000","last_became_active":"2024-09-12T01:02:03.917362+0000","last_became_peered":"2024-09-12T01:02:03.917362+0000","last_unstale":"2024-09-12T01:34:34.977764+0000","last_undegraded":"2024-09-12T01:34:34.977764+0000","last_fullsized":"2024-09-12T01:34:34.977764+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:14:13.774129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"266'8","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.668909+0000","last_change":"2024-09-12T00:43:43.822843+0000","last_active":"2024-09-12T01:37:38.668909+0000","last_peered":"2024-09-12T01:37:38.668909+0000","last_clean":"2024-09-12T01:37:38.668909+0000","last_became_active":"2024-09-12T00:43:43.822574+0000","last_became_peered":"2024-09-12T00:43:43.822574+0000","last_unstale":"2024-09-12T01:37:38.668909+0000","last_undegraded":"2024-09-12T01:37:38.668909+0000","last_fullsized":"2024-09-12T01:37:38.668909+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:31.603888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9228,"num_write":8,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.189305+0000","last_change":"2024-09-12T00:43:38.799826+0000","last_active":"2024-09-12T01:36:09.189305+0000","last_peered":"2024-09-12T01:36:09.189305+0000","last_clean":"2024-09-12T01:36:09.189305+0000","last_became_active":"2024-09-12T00:43:38.799567+0000","last_became_peered":"2024-09-12T00:43:38.799567+0000","last_unstale":"2024-09-12T01:36:09.189305+0000","last_undegraded":"2024-09-12T01:36:09.189305+0000","last_fullsized":"2024-09-12T01:36:09.189305+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:50.512707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'52","reported_seq":196,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.178294+0000","last_change":"2024-09-12T00:39:17.761012+0000","last_active":"2024-09-12T01:34:54.178294+0000","last_peered":"2024-09-12T01:34:54.178294+0000","last_clean":"2024-09-12T01:34:54.178294+0000","last_became_active":"2024-09-12T00:39:17.760735+0000","last_became_peered":"2024-09-12T00:39:17.760735+0000","last_unstale":"2024-09-12T01:34:54.178294+0000","last_undegraded":"2024-09-12T01:34:54.178294+0000","last_fullsized":"2024-09-12T01:34:54.178294+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:37.209781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":192,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997802+0000","last_change":"2024-09-12T01:02:03.925249+0000","last_active":"2024-09-12T01:34:43.997802+0000","last_peered":"2024-09-12T01:34:43.997802+0000","last_clean":"2024-09-12T01:34:43.997802+0000","last_became_active":"2024-09-12T01:02:03.924800+0000","last_became_peered":"2024-09-12T01:02:03.924800+0000","last_unstale":"2024-09-12T01:34:43.997802+0000","last_undegraded":"2024-09-12T01:34:43.997802+0000","last_fullsized":"2024-09-12T01:34:43.997802+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:42.824392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:30.118030+0000","last_change":"2024-09-12T00:43:43.822402+0000","last_active":"2024-09-12T01:34:30.118030+0000","last_peered":"2024-09-12T01:34:30.118030+0000","last_clean":"2024-09-12T01:34:30.118030+0000","last_became_active":"2024-09-12T00:43:43.822130+0000","last_became_peered":"2024-09-12T00:43:43.822130+0000","last_unstale":"2024-09-12T01:34:30.118030+0000","last_undegraded":"2024-09-12T01:34:30.118030+0000","last_fullsized":"2024-09-12T01:34:30.118030+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:52.855759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533810+0000","last_change":"2024-09-12T00:43:38.789538+0000","last_active":"2024-09-12T01:35:04.533810+0000","last_peered":"2024-09-12T01:35:04.533810+0000","last_clean":"2024-09-12T01:35:04.533810+0000","last_became_active":"2024-09-12T00:43:38.789198+0000","last_became_peered":"2024-09-12T00:43:38.789198+0000","last_unstale":"2024-09-12T01:35:04.533810+0000","last_undegraded":"2024-09-12T01:35:04.533810+0000","last_fullsized":"2024-09-12T01:35:04.533810+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:11.316230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'15","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250354+0000","last_change":"2024-09-12T00:39:17.767969+0000","last_active":"2024-09-12T01:34:52.250354+0000","last_peered":"2024-09-12T01:34:52.250354+0000","last_clean":"2024-09-12T01:34:52.250354+0000","last_became_active":"2024-09-12T00:39:17.767662+0000","last_became_peered":"2024-09-12T00:39:17.767662+0000","last_unstale":"2024-09-12T01:34:52.250354+0000","last_undegraded":"2024-09-12T01:34:52.250354+0000","last_fullsized":"2024-09-12T01:34:52.250354+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:30.457902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:44.177191+0000","last_change":"2024-09-12T01:02:03.924577+0000","last_active":"2024-09-12T01:34:44.177191+0000","last_peered":"2024-09-12T01:34:44.177191+0000","last_clean":"2024-09-12T01:34:44.177191+0000","last_became_active":"2024-09-12T01:02:03.924303+0000","last_became_peered":"2024-09-12T01:02:03.924303+0000","last_unstale":"2024-09-12T01:34:44.177191+0000","last_undegraded":"2024-09-12T01:34:44.177191+0000","last_fullsized":"2024-09-12T01:34:44.177191+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:24.298478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'9","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.843719+0000","last_change":"2024-09-12T00:43:43.821003+0000","last_active":"2024-09-12T01:37:38.843719+0000","last_peered":"2024-09-12T01:37:38.843719+0000","last_clean":"2024-09-12T01:37:38.843719+0000","last_became_active":"2024-09-12T00:43:43.819058+0000","last_became_peered":"2024-09-12T00:43:43.819058+0000","last_unstale":"2024-09-12T01:37:38.843719+0000","last_undegraded":"2024-09-12T01:37:38.843719+0000","last_fullsized":"2024-09-12T01:37:38.843719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:02.246750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9222,"num_write":14,"num_write_kb":9222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"266'8","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.626218+0000","last_change":"2024-09-12T00:43:38.796717+0000","last_active":"2024-09-12T01:37:38.626218+0000","last_peered":"2024-09-12T01:37:38.626218+0000","last_clean":"2024-09-12T01:37:38.626218+0000","last_became_active":"2024-09-12T00:43:38.796426+0000","last_became_peered":"2024-09-12T00:43:38.796426+0000","last_unstale":"2024-09-12T01:37:38.626218+0000","last_undegraded":"2024-09-12T01:37:38.626218+0000","last_fullsized":"2024-09-12T01:37:38.626218+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:20.544492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9226,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250340+0000","last_change":"2024-09-12T00:39:17.767397+0000","last_active":"2024-09-12T01:34:52.250340+0000","last_peered":"2024-09-12T01:34:52.250340+0000","last_clean":"2024-09-12T01:34:52.250340+0000","last_became_active":"2024-09-12T00:39:17.767088+0000","last_became_peered":"2024-09-12T00:39:17.767088+0000","last_unstale":"2024-09-12T01:34:52.250340+0000","last_undegraded":"2024-09-12T01:34:52.250340+0000","last_fullsized":"2024-09-12T01:34:52.250340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:12.858828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:45.085791+0000","last_change":"2024-09-12T01:02:03.925759+0000","last_active":"2024-09-12T01:34:45.085791+0000","last_peered":"2024-09-12T01:34:45.085791+0000","last_clean":"2024-09-12T01:34:45.085791+0000","last_became_active":"2024-09-12T01:02:03.925482+0000","last_became_peered":"2024-09-12T01:02:03.925482+0000","last_unstale":"2024-09-12T01:34:45.085791+0000","last_undegraded":"2024-09-12T01:34:45.085791+0000","last_fullsized":"2024-09-12T01:34:45.085791+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:13.030524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:55.139373+0000","last_change":"2024-09-12T00:43:43.820868+0000","last_active":"2024-09-12T01:36:55.139373+0000","last_peered":"2024-09-12T01:36:55.139373+0000","last_clean":"2024-09-12T01:36:55.139373+0000","last_became_active":"2024-09-12T00:43:43.820272+0000","last_became_peered":"2024-09-12T00:43:43.820272+0000","last_unstale":"2024-09-12T01:36:55.139373+0000","last_undegraded":"2024-09-12T01:36:55.139373+0000","last_fullsized":"2024-09-12T01:36:55.139373+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:42.963849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'6","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:50.138568+0000","last_change":"2024-09-12T00:43:38.800018+0000","last_active":"2024-09-12T01:36:50.138568+0000","last_peered":"2024-09-12T01:36:50.138568+0000","last_clean":"2024-09-12T01:36:50.138568+0000","last_became_active":"2024-09-12T00:43:38.799719+0000","last_became_peered":"2024-09-12T00:43:38.799719+0000","last_unstale":"2024-09-12T01:36:50.138568+0000","last_undegraded":"2024-09-12T01:36:50.138568+0000","last_fullsized":"2024-09-12T01:36:50.138568+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:07.155485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20462,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'32","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:55.121695+0000","last_change":"2024-09-12T00:39:17.762941+0000","last_active":"2024-09-12T01:34:55.121695+0000","last_peered":"2024-09-12T01:34:55.121695+0000","last_clean":"2024-09-12T01:34:55.121695+0000","last_became_active":"2024-09-12T00:39:17.762639+0000","last_became_peered":"2024-09-12T00:39:17.762639+0000","last_unstale":"2024-09-12T01:34:55.121695+0000","last_undegraded":"2024-09-12T01:34:55.121695+0000","last_fullsized":"2024-09-12T01:34:55.121695+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:15.974100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:44.978932+0000","last_change":"2024-09-12T01:02:03.925349+0000","last_active":"2024-09-12T01:34:44.978932+0000","last_peered":"2024-09-12T01:34:44.978932+0000","last_clean":"2024-09-12T01:34:44.978932+0000","last_became_active":"2024-09-12T01:02:03.924892+0000","last_became_peered":"2024-09-12T01:02:03.924892+0000","last_unstale":"2024-09-12T01:34:44.978932+0000","last_undegraded":"2024-09-12T01:34:44.978932+0000","last_fullsized":"2024-09-12T01:34:44.978932+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:25:07.795848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'4","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:54.994285+0000","last_change":"2024-09-12T00:43:43.819938+0000","last_active":"2024-09-12T01:36:54.994285+0000","last_peered":"2024-09-12T01:36:54.994285+0000","last_clean":"2024-09-12T01:36:54.994285+0000","last_became_active":"2024-09-12T00:43:43.819431+0000","last_became_peered":"2024-09-12T00:43:43.819431+0000","last_unstale":"2024-09-12T01:36:54.994285+0000","last_undegraded":"2024-09-12T01:36:54.994285+0000","last_fullsized":"2024-09-12T01:36:54.994285+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:42.027354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"266'3","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:49.018108+0000","last_change":"2024-09-12T00:43:38.797182+0000","last_active":"2024-09-12T01:36:49.018108+0000","last_peered":"2024-09-12T01:36:49.018108+0000","last_clean":"2024-09-12T01:36:49.018108+0000","last_became_active":"2024-09-12T00:43:38.796894+0000","last_became_peered":"2024-09-12T00:43:38.796894+0000","last_unstale":"2024-09-12T01:36:49.018108+0000","last_undegraded":"2024-09-12T01:36:49.018108+0000","last_fullsized":"2024-09-12T01:36:49.018108+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:57.433793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'47","reported_seq":182,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536474+0000","last_change":"2024-09-12T00:39:17.762269+0000","last_active":"2024-09-12T01:35:24.536474+0000","last_peered":"2024-09-12T01:35:24.536474+0000","last_clean":"2024-09-12T01:35:24.536474+0000","last_became_active":"2024-09-12T00:39:17.761972+0000","last_became_peered":"2024-09-12T00:39:17.761972+0000","last_unstale":"2024-09-12T01:35:24.536474+0000","last_undegraded":"2024-09-12T01:35:24.536474+0000","last_fullsized":"2024-09-12T01:35:24.536474+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:47.885908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":165,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:28.985653+0000","last_change":"2024-09-12T01:02:03.923742+0000","last_active":"2024-09-12T01:33:28.985653+0000","last_peered":"2024-09-12T01:33:28.985653+0000","last_clean":"2024-09-12T01:33:28.985653+0000","last_became_active":"2024-09-12T01:02:03.923464+0000","last_became_peered":"2024-09-12T01:02:03.923464+0000","last_unstale":"2024-09-12T01:33:28.985653+0000","last_undegraded":"2024-09-12T01:33:28.985653+0000","last_fullsized":"2024-09-12T01:33:28.985653+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:27:44.541153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'11","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.842146+0000","last_change":"2024-09-12T00:43:43.818258+0000","last_active":"2024-09-12T01:37:38.842146+0000","last_peered":"2024-09-12T01:37:38.842146+0000","last_clean":"2024-09-12T01:37:38.842146+0000","last_became_active":"2024-09-12T00:43:43.817990+0000","last_became_peered":"2024-09-12T00:43:43.817990+0000","last_unstale":"2024-09-12T01:37:38.842146+0000","last_undegraded":"2024-09-12T01:37:38.842146+0000","last_fullsized":"2024-09-12T01:37:38.842146+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:00.011210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14448,"num_write":16,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"266'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.103250+0000","last_change":"2024-09-12T00:43:38.795940+0000","last_active":"2024-09-12T01:37:19.103250+0000","last_peered":"2024-09-12T01:37:19.103250+0000","last_clean":"2024-09-12T01:37:19.103250+0000","last_became_active":"2024-09-12T00:43:38.793825+0000","last_became_peered":"2024-09-12T00:43:38.793825+0000","last_unstale":"2024-09-12T01:37:19.103250+0000","last_undegraded":"2024-09-12T01:37:19.103250+0000","last_fullsized":"2024-09-12T01:37:19.103250+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:24.205683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'20","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.535804+0000","last_change":"2024-09-12T00:39:17.770201+0000","last_active":"2024-09-12T01:35:19.535804+0000","last_peered":"2024-09-12T01:35:19.535804+0000","last_clean":"2024-09-12T01:35:19.535804+0000","last_became_active":"2024-09-12T00:39:17.769263+0000","last_became_peered":"2024-09-12T00:39:17.769263+0000","last_unstale":"2024-09-12T01:35:19.535804+0000","last_undegraded":"2024-09-12T01:35:19.535804+0000","last_fullsized":"2024-09-12T01:35:19.535804+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:15.097860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.165777+0000","last_change":"2024-09-12T01:02:03.924548+0000","last_active":"2024-09-12T01:33:29.165777+0000","last_peered":"2024-09-12T01:33:29.165777+0000","last_clean":"2024-09-12T01:33:29.165777+0000","last_became_active":"2024-09-12T01:02:03.924260+0000","last_became_peered":"2024-09-12T01:02:03.924260+0000","last_unstale":"2024-09-12T01:33:29.165777+0000","last_undegraded":"2024-09-12T01:33:29.165777+0000","last_fullsized":"2024-09-12T01:33:29.165777+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:07.250231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"266'3","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:24.023301+0000","last_change":"2024-09-12T00:43:43.824871+0000","last_active":"2024-09-12T01:37:24.023301+0000","last_peered":"2024-09-12T01:37:24.023301+0000","last_clean":"2024-09-12T01:37:24.023301+0000","last_became_active":"2024-09-12T00:43:43.824567+0000","last_became_peered":"2024-09-12T00:43:43.824567+0000","last_unstale":"2024-09-12T01:37:24.023301+0000","last_undegraded":"2024-09-12T01:37:24.023301+0000","last_fullsized":"2024-09-12T01:37:24.023301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:24.293339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"266'5","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.022626+0000","last_change":"2024-09-12T00:43:38.798453+0000","last_active":"2024-09-12T01:37:19.022626+0000","last_peered":"2024-09-12T01:37:19.022626+0000","last_clean":"2024-09-12T01:37:19.022626+0000","last_became_active":"2024-09-12T00:43:38.798200+0000","last_became_peered":"2024-09-12T00:43:38.798200+0000","last_unstale":"2024-09-12T01:37:19.022626+0000","last_undegraded":"2024-09-12T01:37:19.022626+0000","last_fullsized":"2024-09-12T01:37:19.022626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:27.881376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"266'30","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125273+0000","last_change":"2024-09-12T00:39:17.766861+0000","last_active":"2024-09-12T01:35:20.125273+0000","last_peered":"2024-09-12T01:35:20.125273+0000","last_clean":"2024-09-12T01:35:20.125273+0000","last_became_active":"2024-09-12T00:39:17.766600+0000","last_became_peered":"2024-09-12T00:39:17.766600+0000","last_unstale":"2024-09-12T01:35:20.125273+0000","last_undegraded":"2024-09-12T01:35:20.125273+0000","last_fullsized":"2024-09-12T01:35:20.125273+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:07.049466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":112,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250307+0000","last_change":"2024-09-12T01:02:03.919723+0000","last_active":"2024-09-12T01:34:52.250307+0000","last_peered":"2024-09-12T01:34:52.250307+0000","last_clean":"2024-09-12T01:34:52.250307+0000","last_became_active":"2024-09-12T01:02:03.919377+0000","last_became_peered":"2024-09-12T01:02:03.919377+0000","last_unstale":"2024-09-12T01:34:52.250307+0000","last_undegraded":"2024-09-12T01:34:52.250307+0000","last_fullsized":"2024-09-12T01:34:52.250307+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:59.358385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123101+0000","last_change":"2024-09-12T00:43:43.818424+0000","last_active":"2024-09-12T01:35:05.123101+0000","last_peered":"2024-09-12T01:35:05.123101+0000","last_clean":"2024-09-12T01:35:05.123101+0000","last_became_active":"2024-09-12T00:43:43.818153+0000","last_became_peered":"2024-09-12T00:43:43.818153+0000","last_unstale":"2024-09-12T01:35:05.123101+0000","last_undegraded":"2024-09-12T01:35:05.123101+0000","last_fullsized":"2024-09-12T01:35:05.123101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.787318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'6","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.890420+0000","last_change":"2024-09-12T00:43:38.792429+0000","last_active":"2024-09-12T01:37:38.890420+0000","last_peered":"2024-09-12T01:37:38.890420+0000","last_clean":"2024-09-12T01:37:38.890420+0000","last_became_active":"2024-09-12T00:43:38.792135+0000","last_became_peered":"2024-09-12T00:43:38.792135+0000","last_unstale":"2024-09-12T01:37:38.890420+0000","last_undegraded":"2024-09-12T01:37:38.890420+0000","last_fullsized":"2024-09-12T01:37:38.890420+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:55:11.570953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8232,"num_write":6,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"266'12","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.089651+0000","last_change":"2024-09-12T00:39:17.768309+0000","last_active":"2024-09-12T01:35:20.089651+0000","last_peered":"2024-09-12T01:35:20.089651+0000","last_clean":"2024-09-12T01:35:20.089651+0000","last_became_active":"2024-09-12T00:39:17.767599+0000","last_became_peered":"2024-09-12T00:39:17.767599+0000","last_unstale":"2024-09-12T01:35:20.089651+0000","last_undegraded":"2024-09-12T01:35:20.089651+0000","last_fullsized":"2024-09-12T01:35:20.089651+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:18.635424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:29.165738+0000","last_change":"2024-09-12T01:02:03.918519+0000","last_active":"2024-09-12T01:33:29.165738+0000","last_peered":"2024-09-12T01:33:29.165738+0000","last_clean":"2024-09-12T01:33:29.165738+0000","last_became_active":"2024-09-12T01:02:03.918248+0000","last_became_peered":"2024-09-12T01:02:03.918248+0000","last_unstale":"2024-09-12T01:33:29.165738+0000","last_undegraded":"2024-09-12T01:33:29.165738+0000","last_fullsized":"2024-09-12T01:33:29.165738+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:11:15.650720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533744+0000","last_change":"2024-09-12T00:43:43.825033+0000","last_active":"2024-09-12T01:35:04.533744+0000","last_peered":"2024-09-12T01:35:04.533744+0000","last_clean":"2024-09-12T01:35:04.533744+0000","last_became_active":"2024-09-12T00:43:43.822993+0000","last_became_peered":"2024-09-12T00:43:43.822993+0000","last_unstale":"2024-09-12T01:35:04.533744+0000","last_undegraded":"2024-09-12T01:35:04.533744+0000","last_fullsized":"2024-09-12T01:35:04.533744+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.928486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:59.087781+0000","last_change":"2024-09-12T00:43:38.795993+0000","last_active":"2024-09-12T01:34:59.087781+0000","last_peered":"2024-09-12T01:34:59.087781+0000","last_clean":"2024-09-12T01:34:59.087781+0000","last_became_active":"2024-09-12T00:43:38.795625+0000","last_became_peered":"2024-09-12T00:43:38.795625+0000","last_unstale":"2024-09-12T01:34:59.087781+0000","last_undegraded":"2024-09-12T01:34:59.087781+0000","last_fullsized":"2024-09-12T01:34:59.087781+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:32.904211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'39","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125177+0000","last_change":"2024-09-12T00:39:17.761781+0000","last_active":"2024-09-12T01:35:20.125177+0000","last_peered":"2024-09-12T01:35:20.125177+0000","last_clean":"2024-09-12T01:35:20.125177+0000","last_became_active":"2024-09-12T00:39:17.761517+0000","last_became_peered":"2024-09-12T00:39:17.761517+0000","last_unstale":"2024-09-12T01:35:20.125177+0000","last_undegraded":"2024-09-12T01:35:20.125177+0000","last_fullsized":"2024-09-12T01:35:20.125177+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:36.401035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997821+0000","last_change":"2024-09-12T01:02:03.924588+0000","last_active":"2024-09-12T01:34:43.997821+0000","last_peered":"2024-09-12T01:34:43.997821+0000","last_clean":"2024-09-12T01:34:43.997821+0000","last_became_active":"2024-09-12T01:02:03.923808+0000","last_became_peered":"2024-09-12T01:02:03.923808+0000","last_unstale":"2024-09-12T01:34:43.997821+0000","last_undegraded":"2024-09-12T01:34:43.997821+0000","last_fullsized":"2024-09-12T01:34:43.997821+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:42.299573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'5","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:30.126665+0000","last_change":"2024-09-12T00:43:43.819522+0000","last_active":"2024-09-12T01:35:30.126665+0000","last_peered":"2024-09-12T01:35:30.126665+0000","last_clean":"2024-09-12T01:35:30.126665+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:35:30.126665+0000","last_undegraded":"2024-09-12T01:35:30.126665+0000","last_fullsized":"2024-09-12T01:35:30.126665+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:30.323747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'4","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.786735+0000","last_change":"2024-09-12T00:43:38.795759+0000","last_active":"2024-09-12T01:37:38.786735+0000","last_peered":"2024-09-12T01:37:38.786735+0000","last_clean":"2024-09-12T01:37:38.786735+0000","last_became_active":"2024-09-12T00:43:38.795451+0000","last_became_peered":"2024-09-12T00:43:38.795451+0000","last_unstale":"2024-09-12T01:37:38.786735+0000","last_undegraded":"2024-09-12T01:37:38.786735+0000","last_fullsized":"2024-09-12T01:37:38.786735+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:14:17.278286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'133","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:45.128969+0000","last_change":"2024-09-12T00:39:17.763176+0000","last_active":"2024-09-12T01:35:45.128969+0000","last_peered":"2024-09-12T01:35:45.128969+0000","last_clean":"2024-09-12T01:35:45.128969+0000","last_became_active":"2024-09-12T00:39:17.762649+0000","last_became_peered":"2024-09-12T00:39:17.762649+0000","last_unstale":"2024-09-12T01:35:45.128969+0000","last_undegraded":"2024-09-12T01:35:45.128969+0000","last_fullsized":"2024-09-12T01:35:45.128969+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":844,"num_read_kb":585,"num_write":185,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.093063+0000","last_change":"2024-09-12T01:02:03.925718+0000","last_active":"2024-09-12T01:35:49.093063+0000","last_peered":"2024-09-12T01:35:49.093063+0000","last_clean":"2024-09-12T01:35:49.093063+0000","last_became_active":"2024-09-12T01:02:03.924934+0000","last_became_peered":"2024-09-12T01:02:03.924934+0000","last_unstale":"2024-09-12T01:35:49.093063+0000","last_undegraded":"2024-09-12T01:35:49.093063+0000","last_fullsized":"2024-09-12T01:35:49.093063+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:30.126629+0000","last_change":"2024-09-12T00:43:43.822008+0000","last_active":"2024-09-12T01:35:30.126629+0000","last_peered":"2024-09-12T01:35:30.126629+0000","last_clean":"2024-09-12T01:35:30.126629+0000","last_became_active":"2024-09-12T00:43:43.821288+0000","last_became_peered":"2024-09-12T00:43:43.821288+0000","last_unstale":"2024-09-12T01:35:30.126629+0000","last_undegraded":"2024-09-12T01:35:30.126629+0000","last_fullsized":"2024-09-12T01:35:30.126629+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:12.223424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.182657+0000","last_change":"2024-09-12T00:43:38.798047+0000","last_active":"2024-09-12T01:35:24.182657+0000","last_peered":"2024-09-12T01:35:24.182657+0000","last_clean":"2024-09-12T01:35:24.182657+0000","last_became_active":"2024-09-12T00:43:38.797782+0000","last_became_peered":"2024-09-12T00:43:38.797782+0000","last_unstale":"2024-09-12T01:35:24.182657+0000","last_undegraded":"2024-09-12T01:35:24.182657+0000","last_fullsized":"2024-09-12T01:35:24.182657+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:52.438462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'33","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537703+0000","last_change":"2024-09-12T00:39:17.769240+0000","last_active":"2024-09-12T01:35:34.537703+0000","last_peered":"2024-09-12T01:35:34.537703+0000","last_clean":"2024-09-12T01:35:34.537703+0000","last_became_active":"2024-09-12T00:39:17.768151+0000","last_became_peered":"2024-09-12T00:39:17.768151+0000","last_unstale":"2024-09-12T01:35:34.537703+0000","last_undegraded":"2024-09-12T01:35:34.537703+0000","last_fullsized":"2024-09-12T01:35:34.537703+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.530106+0000","last_change":"2024-09-12T01:02:03.922540+0000","last_active":"2024-09-12T01:34:34.530106+0000","last_peered":"2024-09-12T01:34:34.530106+0000","last_clean":"2024-09-12T01:34:34.530106+0000","last_became_active":"2024-09-12T01:02:03.921595+0000","last_became_peered":"2024-09-12T01:02:03.921595+0000","last_unstale":"2024-09-12T01:34:34.530106+0000","last_undegraded":"2024-09-12T01:34:34.530106+0000","last_fullsized":"2024-09-12T01:34:34.530106+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.523672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"266'9","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.742220+0000","last_change":"2024-09-12T00:43:43.820529+0000","last_active":"2024-09-12T01:37:38.742220+0000","last_peered":"2024-09-12T01:37:38.742220+0000","last_clean":"2024-09-12T01:37:38.742220+0000","last_became_active":"2024-09-12T00:43:43.819990+0000","last_became_peered":"2024-09-12T00:43:43.819990+0000","last_unstale":"2024-09-12T01:37:38.742220+0000","last_undegraded":"2024-09-12T01:37:38.742220+0000","last_fullsized":"2024-09-12T01:37:38.742220+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8217,"num_write":14,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.750005+0000","last_change":"2024-09-12T00:43:38.798676+0000","last_active":"2024-09-12T01:37:38.750005+0000","last_peered":"2024-09-12T01:37:38.750005+0000","last_clean":"2024-09-12T01:37:38.750005+0000","last_became_active":"2024-09-12T00:43:38.798374+0000","last_became_peered":"2024-09-12T00:43:38.798374+0000","last_unstale":"2024-09-12T01:37:38.750005+0000","last_undegraded":"2024-09-12T01:37:38.750005+0000","last_fullsized":"2024-09-12T01:37:38.750005+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:29.029265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.091539+0000","last_change":"2024-09-12T00:39:17.758205+0000","last_active":"2024-09-12T01:35:34.091539+0000","last_peered":"2024-09-12T01:35:34.091539+0000","last_clean":"2024-09-12T01:35:34.091539+0000","last_became_active":"2024-09-12T00:39:17.757795+0000","last_became_peered":"2024-09-12T00:39:17.757795+0000","last_unstale":"2024-09-12T01:35:34.091539+0000","last_undegraded":"2024-09-12T01:35:34.091539+0000","last_fullsized":"2024-09-12T01:35:34.091539+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.085182+0000","last_change":"2024-09-12T01:02:03.924136+0000","last_active":"2024-09-12T01:34:34.085182+0000","last_peered":"2024-09-12T01:34:34.085182+0000","last_clean":"2024-09-12T01:34:34.085182+0000","last_became_active":"2024-09-12T01:02:03.923774+0000","last_became_peered":"2024-09-12T01:02:03.923774+0000","last_unstale":"2024-09-12T01:34:34.085182+0000","last_undegraded":"2024-09-12T01:34:34.085182+0000","last_fullsized":"2024-09-12T01:34:34.085182+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:48:13.881070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.869482+0000","last_change":"2024-09-12T00:43:43.820925+0000","last_active":"2024-09-12T01:37:38.869482+0000","last_peered":"2024-09-12T01:37:38.869482+0000","last_clean":"2024-09-12T01:37:38.869482+0000","last_became_active":"2024-09-12T00:43:43.819044+0000","last_became_peered":"2024-09-12T00:43:43.819044+0000","last_unstale":"2024-09-12T01:37:38.869482+0000","last_undegraded":"2024-09-12T01:37:38.869482+0000","last_fullsized":"2024-09-12T01:37:38.869482+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:51.315359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6160,"num_write":14,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:35.127509+0000","last_change":"2024-09-12T00:43:38.797698+0000","last_active":"2024-09-12T01:35:35.127509+0000","last_peered":"2024-09-12T01:35:35.127509+0000","last_clean":"2024-09-12T01:35:35.127509+0000","last_became_active":"2024-09-12T00:43:38.797343+0000","last_became_peered":"2024-09-12T00:43:38.797343+0000","last_unstale":"2024-09-12T01:35:35.127509+0000","last_undegraded":"2024-09-12T01:35:35.127509+0000","last_fullsized":"2024-09-12T01:35:35.127509+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'33","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.183957+0000","last_change":"2024-09-12T00:39:17.760056+0000","last_active":"2024-09-12T01:35:34.183957+0000","last_peered":"2024-09-12T01:35:34.183957+0000","last_clean":"2024-09-12T01:35:34.183957+0000","last_became_active":"2024-09-12T00:39:17.759701+0000","last_became_peered":"2024-09-12T00:39:17.759701+0000","last_unstale":"2024-09-12T01:35:34.183957+0000","last_undegraded":"2024-09-12T01:35:34.183957+0000","last_fullsized":"2024-09-12T01:35:34.183957+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":64,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.008862+0000","last_change":"2024-09-12T01:02:03.923765+0000","last_active":"2024-09-12T01:35:49.008862+0000","last_peered":"2024-09-12T01:35:49.008862+0000","last_clean":"2024-09-12T01:35:49.008862+0000","last_became_active":"2024-09-12T01:02:03.923440+0000","last_became_peered":"2024-09-12T01:02:03.923440+0000","last_unstale":"2024-09-12T01:35:49.008862+0000","last_undegraded":"2024-09-12T01:35:49.008862+0000","last_fullsized":"2024-09-12T01:35:49.008862+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'5","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.805088+0000","last_change":"2024-09-12T00:43:43.819656+0000","last_active":"2024-09-12T01:37:38.805088+0000","last_peered":"2024-09-12T01:37:38.805088+0000","last_clean":"2024-09-12T01:37:38.805088+0000","last_became_active":"2024-09-12T00:43:43.819247+0000","last_became_peered":"2024-09-12T00:43:43.819247+0000","last_unstale":"2024-09-12T01:37:38.805088+0000","last_undegraded":"2024-09-12T01:37:38.805088+0000","last_fullsized":"2024-09-12T01:37:38.805088+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"266'5","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.749492+0000","last_change":"2024-09-12T00:43:38.794688+0000","last_active":"2024-09-12T01:37:38.749492+0000","last_peered":"2024-09-12T01:37:38.749492+0000","last_clean":"2024-09-12T01:37:38.749492+0000","last_became_active":"2024-09-12T00:43:38.794286+0000","last_became_peered":"2024-09-12T00:43:38.794286+0000","last_unstale":"2024-09-12T01:37:38.749492+0000","last_undegraded":"2024-09-12T01:37:38.749492+0000","last_fullsized":"2024-09-12T01:37:38.749492+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'28","reported_seq":130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.183888+0000","last_change":"2024-09-12T00:39:17.762387+0000","last_active":"2024-09-12T01:35:34.183888+0000","last_peered":"2024-09-12T01:35:34.183888+0000","last_clean":"2024-09-12T01:35:34.183888+0000","last_became_active":"2024-09-12T00:39:17.761738+0000","last_became_peered":"2024-09-12T00:39:17.761738+0000","last_unstale":"2024-09-12T01:35:34.183888+0000","last_undegraded":"2024-09-12T01:35:34.183888+0000","last_fullsized":"2024-09-12T01:35:34.183888+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":96,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.079050+0000","last_change":"2024-09-12T01:02:03.928768+0000","last_active":"2024-09-12T01:33:40.079050+0000","last_peered":"2024-09-12T01:33:40.079050+0000","last_clean":"2024-09-12T01:33:40.079050+0000","last_became_active":"2024-09-12T01:02:03.928475+0000","last_became_peered":"2024-09-12T01:02:03.928475+0000","last_unstale":"2024-09-12T01:33:40.079050+0000","last_undegraded":"2024-09-12T01:33:40.079050+0000","last_fullsized":"2024-09-12T01:33:40.079050+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:14:39.969871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:45.092221+0000","last_change":"2024-09-12T00:43:43.821438+0000","last_active":"2024-09-12T01:35:45.092221+0000","last_peered":"2024-09-12T01:35:45.092221+0000","last_clean":"2024-09-12T01:35:45.092221+0000","last_became_active":"2024-09-12T00:43:43.821149+0000","last_became_peered":"2024-09-12T00:43:43.821149+0000","last_unstale":"2024-09-12T01:35:45.092221+0000","last_undegraded":"2024-09-12T01:35:45.092221+0000","last_fullsized":"2024-09-12T01:35:45.092221+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'9","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.723658+0000","last_change":"2024-09-12T00:43:38.799268+0000","last_active":"2024-09-12T01:37:38.723658+0000","last_peered":"2024-09-12T01:37:38.723658+0000","last_clean":"2024-09-12T01:37:38.723658+0000","last_became_active":"2024-09-12T00:43:38.798510+0000","last_became_peered":"2024-09-12T00:43:38.798510+0000","last_unstale":"2024-09-12T01:37:38.723658+0000","last_undegraded":"2024-09-12T01:37:38.723658+0000","last_fullsized":"2024-09-12T01:37:38.723658+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16416,"num_write":14,"num_write_kb":12320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'28","reported_seq":136,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.092775+0000","last_change":"2024-09-12T00:39:17.771090+0000","last_active":"2024-09-12T01:35:50.092775+0000","last_peered":"2024-09-12T01:35:50.092775+0000","last_clean":"2024-09-12T01:35:50.092775+0000","last_became_active":"2024-09-12T00:39:17.770779+0000","last_became_peered":"2024-09-12T00:39:17.770779+0000","last_unstale":"2024-09-12T01:35:50.092775+0000","last_undegraded":"2024-09-12T01:35:50.092775+0000","last_fullsized":"2024-09-12T01:35:50.092775+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.985841+0000","last_change":"2024-09-12T01:02:03.925931+0000","last_active":"2024-09-12T01:35:49.985841+0000","last_peered":"2024-09-12T01:35:49.985841+0000","last_clean":"2024-09-12T01:35:49.985841+0000","last_became_active":"2024-09-12T01:02:03.925618+0000","last_became_peered":"2024-09-12T01:02:03.925618+0000","last_unstale":"2024-09-12T01:35:49.985841+0000","last_undegraded":"2024-09-12T01:35:49.985841+0000","last_fullsized":"2024-09-12T01:35:49.985841+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"266'5","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.870471+0000","last_change":"2024-09-12T00:43:43.825678+0000","last_active":"2024-09-12T01:37:38.870471+0000","last_peered":"2024-09-12T01:37:38.870471+0000","last_clean":"2024-09-12T01:37:38.870471+0000","last_became_active":"2024-09-12T00:43:43.825380+0000","last_became_peered":"2024-09-12T00:43:43.825380+0000","last_unstale":"2024-09-12T01:37:38.870471+0000","last_undegraded":"2024-09-12T01:37:38.870471+0000","last_fullsized":"2024-09-12T01:37:38.870471+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:38.026807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8232,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.129616+0000","last_change":"2024-09-12T00:43:38.791841+0000","last_active":"2024-09-12T01:35:50.129616+0000","last_peered":"2024-09-12T01:35:50.129616+0000","last_clean":"2024-09-12T01:35:50.129616+0000","last_became_active":"2024-09-12T00:43:38.791586+0000","last_became_peered":"2024-09-12T00:43:38.791586+0000","last_unstale":"2024-09-12T01:35:50.129616+0000","last_undegraded":"2024-09-12T01:35:50.129616+0000","last_fullsized":"2024-09-12T01:35:50.129616+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'54","reported_seq":206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.007244+0000","last_change":"2024-09-12T00:39:17.762695+0000","last_active":"2024-09-12T01:35:39.007244+0000","last_peered":"2024-09-12T01:35:39.007244+0000","last_clean":"2024-09-12T01:35:39.007244+0000","last_became_active":"2024-09-12T00:39:17.762435+0000","last_became_peered":"2024-09-12T00:39:17.762435+0000","last_unstale":"2024-09-12T01:35:39.007244+0000","last_undegraded":"2024-09-12T01:35:39.007244+0000","last_fullsized":"2024-09-12T01:35:39.007244+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":202,"num_write":91,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.129663+0000","last_change":"2024-09-12T01:02:03.926151+0000","last_active":"2024-09-12T01:35:50.129663+0000","last_peered":"2024-09-12T01:35:50.129663+0000","last_clean":"2024-09-12T01:35:50.129663+0000","last_became_active":"2024-09-12T01:02:03.925866+0000","last_became_peered":"2024-09-12T01:02:03.925866+0000","last_unstale":"2024-09-12T01:35:50.129663+0000","last_undegraded":"2024-09-12T01:35:50.129663+0000","last_fullsized":"2024-09-12T01:35:50.129663+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'3","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.576982+0000","last_change":"2024-09-12T00:43:43.820437+0000","last_active":"2024-09-12T01:37:38.576982+0000","last_peered":"2024-09-12T01:37:38.576982+0000","last_clean":"2024-09-12T01:37:38.576982+0000","last_became_active":"2024-09-12T00:43:43.820153+0000","last_became_peered":"2024-09-12T00:43:43.820153+0000","last_unstale":"2024-09-12T01:37:38.576982+0000","last_undegraded":"2024-09-12T01:37:38.576982+0000","last_fullsized":"2024-09-12T01:37:38.576982+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'3","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.628485+0000","last_change":"2024-09-12T00:43:38.790234+0000","last_active":"2024-09-12T01:37:38.628485+0000","last_peered":"2024-09-12T01:37:38.628485+0000","last_clean":"2024-09-12T01:37:38.628485+0000","last_became_active":"2024-09-12T00:43:38.789945+0000","last_became_peered":"2024-09-12T00:43:38.789945+0000","last_unstale":"2024-09-12T01:37:38.628485+0000","last_undegraded":"2024-09-12T01:37:38.628485+0000","last_fullsized":"2024-09-12T01:37:38.628485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.330002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'34","reported_seq":151,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.984745+0000","last_change":"2024-09-12T00:39:17.760033+0000","last_active":"2024-09-12T01:35:39.984745+0000","last_peered":"2024-09-12T01:35:39.984745+0000","last_clean":"2024-09-12T01:35:39.984745+0000","last_became_active":"2024-09-12T00:39:17.759741+0000","last_became_peered":"2024-09-12T00:39:17.759741+0000","last_unstale":"2024-09-12T01:35:39.984745+0000","last_undegraded":"2024-09-12T01:35:39.984745+0000","last_fullsized":"2024-09-12T01:35:39.984745+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.983140+0000","last_change":"2024-09-12T01:02:03.919303+0000","last_active":"2024-09-12T01:35:24.983140+0000","last_peered":"2024-09-12T01:35:24.983140+0000","last_clean":"2024-09-12T01:35:24.983140+0000","last_became_active":"2024-09-12T01:02:03.918998+0000","last_became_peered":"2024-09-12T01:02:03.918998+0000","last_unstale":"2024-09-12T01:35:24.983140+0000","last_undegraded":"2024-09-12T01:35:24.983140+0000","last_fullsized":"2024-09-12T01:35:24.983140+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:39.378429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:59.010566+0000","last_change":"2024-09-12T00:43:43.822054+0000","last_active":"2024-09-12T01:35:59.010566+0000","last_peered":"2024-09-12T01:35:59.010566+0000","last_clean":"2024-09-12T01:35:59.010566+0000","last_became_active":"2024-09-12T00:43:43.821691+0000","last_became_peered":"2024-09-12T00:43:43.821691+0000","last_unstale":"2024-09-12T01:35:59.010566+0000","last_undegraded":"2024-09-12T01:35:59.010566+0000","last_fullsized":"2024-09-12T01:35:59.010566+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.538879+0000","last_change":"2024-09-12T00:43:38.798045+0000","last_active":"2024-09-12T01:35:44.538879+0000","last_peered":"2024-09-12T01:35:44.538879+0000","last_clean":"2024-09-12T01:35:44.538879+0000","last_became_active":"2024-09-12T00:43:38.797711+0000","last_became_peered":"2024-09-12T00:43:38.797711+0000","last_unstale":"2024-09-12T01:35:44.538879+0000","last_undegraded":"2024-09-12T01:35:44.538879+0000","last_fullsized":"2024-09-12T01:35:44.538879+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'32","reported_seq":141,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:37.257485+0000","last_change":"2024-09-12T00:39:17.761142+0000","last_active":"2024-09-12T01:35:37.257485+0000","last_peered":"2024-09-12T01:35:37.257485+0000","last_clean":"2024-09-12T01:35:37.257485+0000","last_became_active":"2024-09-12T00:39:17.760839+0000","last_became_peered":"2024-09-12T00:39:17.760839+0000","last_unstale":"2024-09-12T01:35:37.257485+0000","last_undegraded":"2024-09-12T01:35:37.257485+0000","last_fullsized":"2024-09-12T01:35:37.257485+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.983164+0000","last_change":"2024-09-12T01:02:03.920002+0000","last_active":"2024-09-12T01:35:24.983164+0000","last_peered":"2024-09-12T01:35:24.983164+0000","last_clean":"2024-09-12T01:35:24.983164+0000","last_became_active":"2024-09-12T01:02:03.919706+0000","last_became_peered":"2024-09-12T01:02:03.919706+0000","last_unstale":"2024-09-12T01:35:24.983164+0000","last_undegraded":"2024-09-12T01:35:24.983164+0000","last_fullsized":"2024-09-12T01:35:24.983164+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:03.131753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"266'2","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.660530+0000","last_change":"2024-09-12T00:43:43.818598+0000","last_active":"2024-09-12T01:37:38.660530+0000","last_peered":"2024-09-12T01:37:38.660530+0000","last_clean":"2024-09-12T01:37:38.660530+0000","last_became_active":"2024-09-12T00:43:43.818321+0000","last_became_peered":"2024-09-12T00:43:43.818321+0000","last_unstale":"2024-09-12T01:37:38.660530+0000","last_undegraded":"2024-09-12T01:37:38.660530+0000","last_fullsized":"2024-09-12T01:37:38.660530+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":96,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.749730+0000","last_change":"2024-09-12T00:43:38.792440+0000","last_active":"2024-09-12T01:37:38.749730+0000","last_peered":"2024-09-12T01:37:38.749730+0000","last_clean":"2024-09-12T01:37:38.749730+0000","last_became_active":"2024-09-12T00:43:38.792154+0000","last_became_peered":"2024-09-12T00:43:38.792154+0000","last_unstale":"2024-09-12T01:37:38.749730+0000","last_undegraded":"2024-09-12T01:37:38.749730+0000","last_fullsized":"2024-09-12T01:37:38.749730+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1034,"num_write":4,"num_write_kb":1034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"266'40","reported_seq":164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.538288+0000","last_change":"2024-09-12T00:39:17.770041+0000","last_active":"2024-09-12T01:35:39.538288+0000","last_peered":"2024-09-12T01:35:39.538288+0000","last_clean":"2024-09-12T01:35:39.538288+0000","last_became_active":"2024-09-12T00:39:17.767962+0000","last_became_peered":"2024-09-12T00:39:17.767962+0000","last_unstale":"2024-09-12T01:35:39.538288+0000","last_undegraded":"2024-09-12T01:35:39.538288+0000","last_fullsized":"2024-09-12T01:35:39.538288+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":136,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:13.992744+0000","last_change":"2024-09-12T01:02:03.922136+0000","last_active":"2024-09-12T01:34:13.992744+0000","last_peered":"2024-09-12T01:34:13.992744+0000","last_clean":"2024-09-12T01:34:13.992744+0000","last_became_active":"2024-09-12T01:02:03.918216+0000","last_became_peered":"2024-09-12T01:02:03.918216+0000","last_unstale":"2024-09-12T01:34:13.992744+0000","last_undegraded":"2024-09-12T01:34:13.992744+0000","last_fullsized":"2024-09-12T01:34:13.992744+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:58:26.445766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'10","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.602441+0000","last_change":"2024-09-12T00:43:43.820490+0000","last_active":"2024-09-12T01:37:38.602441+0000","last_peered":"2024-09-12T01:37:38.602441+0000","last_clean":"2024-09-12T01:37:38.602441+0000","last_became_active":"2024-09-12T00:43:43.820194+0000","last_became_peered":"2024-09-12T00:43:43.820194+0000","last_unstale":"2024-09-12T01:37:38.602441+0000","last_undegraded":"2024-09-12T01:37:38.602441+0000","last_fullsized":"2024-09-12T01:37:38.602441+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"266'10","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.750965+0000","last_change":"2024-09-12T00:43:38.797923+0000","last_active":"2024-09-12T01:37:38.750965+0000","last_peered":"2024-09-12T01:37:38.750965+0000","last_clean":"2024-09-12T01:37:38.750965+0000","last_became_active":"2024-09-12T00:43:38.797428+0000","last_became_peered":"2024-09-12T00:43:38.797428+0000","last_unstale":"2024-09-12T01:37:38.750965+0000","last_undegraded":"2024-09-12T01:37:38.750965+0000","last_fullsized":"2024-09-12T01:37:38.750965+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12282,"num_write":20,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'85","reported_seq":371,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:45.092290+0000","last_change":"2024-09-12T00:39:17.767845+0000","last_active":"2024-09-12T01:35:45.092290+0000","last_peered":"2024-09-12T01:35:45.092290+0000","last_clean":"2024-09-12T01:35:45.092290+0000","last_became_active":"2024-09-12T00:39:17.767517+0000","last_became_peered":"2024-09-12T00:39:17.767517+0000","last_unstale":"2024-09-12T01:35:45.092290+0000","last_undegraded":"2024-09-12T01:35:45.092290+0000","last_fullsized":"2024-09-12T01:35:45.092290+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":615,"num_read_kb":395,"num_write":114,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536407+0000","last_change":"2024-09-12T01:02:03.922775+0000","last_active":"2024-09-12T01:35:24.536407+0000","last_peered":"2024-09-12T01:35:24.536407+0000","last_clean":"2024-09-12T01:35:24.536407+0000","last_became_active":"2024-09-12T01:02:03.922479+0000","last_became_peered":"2024-09-12T01:02:03.922479+0000","last_unstale":"2024-09-12T01:35:24.536407+0000","last_undegraded":"2024-09-12T01:35:24.536407+0000","last_fullsized":"2024-09-12T01:35:24.536407+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.011531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"263'4","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.538933+0000","last_change":"2024-09-12T00:43:43.821630+0000","last_active":"2024-09-12T01:35:44.538933+0000","last_peered":"2024-09-12T01:35:44.538933+0000","last_clean":"2024-09-12T01:35:44.538933+0000","last_became_active":"2024-09-12T00:43:43.821303+0000","last_became_peered":"2024-09-12T00:43:43.821303+0000","last_unstale":"2024-09-12T01:35:44.538933+0000","last_undegraded":"2024-09-12T01:35:44.538933+0000","last_fullsized":"2024-09-12T01:35:44.538933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16370,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'2","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.586590+0000","last_change":"2024-09-12T00:43:38.800008+0000","last_active":"2024-09-12T01:37:38.586590+0000","last_peered":"2024-09-12T01:37:38.586590+0000","last_clean":"2024-09-12T01:37:38.586590+0000","last_became_active":"2024-09-12T00:43:38.799623+0000","last_became_peered":"2024-09-12T00:43:38.799623+0000","last_unstale":"2024-09-12T01:37:38.586590+0000","last_undegraded":"2024-09-12T01:37:38.586590+0000","last_fullsized":"2024-09-12T01:37:38.586590+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'30","reported_seq":140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:35.127450+0000","last_change":"2024-09-12T00:39:17.768450+0000","last_active":"2024-09-12T01:35:35.127450+0000","last_peered":"2024-09-12T01:35:35.127450+0000","last_clean":"2024-09-12T01:35:35.127450+0000","last_became_active":"2024-09-12T00:39:17.768143+0000","last_became_peered":"2024-09-12T00:39:17.768143+0000","last_unstale":"2024-09-12T01:35:35.127450+0000","last_undegraded":"2024-09-12T01:35:35.127450+0000","last_fullsized":"2024-09-12T01:35:35.127450+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:16.633147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":109,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.118947+0000","last_change":"2024-09-12T01:02:03.927047+0000","last_active":"2024-09-12T01:34:35.118947+0000","last_peered":"2024-09-12T01:34:35.118947+0000","last_clean":"2024-09-12T01:34:35.118947+0000","last_became_active":"2024-09-12T01:02:03.926699+0000","last_became_peered":"2024-09-12T01:02:03.926699+0000","last_unstale":"2024-09-12T01:34:35.118947+0000","last_undegraded":"2024-09-12T01:34:35.118947+0000","last_fullsized":"2024-09-12T01:34:35.118947+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:16.113729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'7","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.669277+0000","last_change":"2024-09-12T00:43:43.819559+0000","last_active":"2024-09-12T01:37:38.669277+0000","last_peered":"2024-09-12T01:37:38.669277+0000","last_clean":"2024-09-12T01:37:38.669277+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:37:38.669277+0000","last_undegraded":"2024-09-12T01:37:38.669277+0000","last_fullsized":"2024-09-12T01:37:38.669277+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24570,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.092725+0000","last_change":"2024-09-12T00:43:38.798764+0000","last_active":"2024-09-12T01:35:50.092725+0000","last_peered":"2024-09-12T01:35:50.092725+0000","last_clean":"2024-09-12T01:35:50.092725+0000","last_became_active":"2024-09-12T00:43:38.798431+0000","last_became_peered":"2024-09-12T00:43:38.798431+0000","last_unstale":"2024-09-12T01:35:50.092725+0000","last_undegraded":"2024-09-12T01:35:50.092725+0000","last_fullsized":"2024-09-12T01:35:50.092725+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:35.091204+0000","last_change":"2024-09-12T00:39:17.769932+0000","last_active":"2024-09-12T01:35:35.091204+0000","last_peered":"2024-09-12T01:35:35.091204+0000","last_clean":"2024-09-12T01:35:35.091204+0000","last_became_active":"2024-09-12T00:39:17.768901+0000","last_became_peered":"2024-09-12T00:39:17.768901+0000","last_unstale":"2024-09-12T01:35:35.091204+0000","last_undegraded":"2024-09-12T01:35:35.091204+0000","last_fullsized":"2024-09-12T01:35:35.091204+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:31:49.443724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.248104+0000","last_change":"2024-09-12T01:02:03.922843+0000","last_active":"2024-09-12T01:34:37.248104+0000","last_peered":"2024-09-12T01:34:37.248104+0000","last_clean":"2024-09-12T01:34:37.248104+0000","last_became_active":"2024-09-12T01:02:03.922500+0000","last_became_peered":"2024-09-12T01:02:03.922500+0000","last_unstale":"2024-09-12T01:34:37.248104+0000","last_undegraded":"2024-09-12T01:34:37.248104+0000","last_fullsized":"2024-09-12T01:34:37.248104+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:26.949487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.539497+0000","last_change":"2024-09-12T00:43:43.824719+0000","last_active":"2024-09-12T01:35:49.539497+0000","last_peered":"2024-09-12T01:35:49.539497+0000","last_clean":"2024-09-12T01:35:49.539497+0000","last_became_active":"2024-09-12T00:43:43.823554+0000","last_became_peered":"2024-09-12T00:43:43.823554+0000","last_unstale":"2024-09-12T01:35:49.539497+0000","last_undegraded":"2024-09-12T01:35:49.539497+0000","last_fullsized":"2024-09-12T01:35:49.539497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.538793+0000","last_change":"2024-09-12T00:43:38.798395+0000","last_active":"2024-09-12T01:35:44.538793+0000","last_peered":"2024-09-12T01:35:44.538793+0000","last_clean":"2024-09-12T01:35:44.538793+0000","last_became_active":"2024-09-12T00:43:38.798117+0000","last_became_peered":"2024-09-12T00:43:38.798117+0000","last_unstale":"2024-09-12T01:35:44.538793+0000","last_undegraded":"2024-09-12T01:35:44.538793+0000","last_fullsized":"2024-09-12T01:35:44.538793+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'16","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537633+0000","last_change":"2024-09-12T00:39:17.768795+0000","last_active":"2024-09-12T01:35:34.537633+0000","last_peered":"2024-09-12T01:35:34.537633+0000","last_clean":"2024-09-12T01:35:34.537633+0000","last_became_active":"2024-09-12T00:39:17.768503+0000","last_became_peered":"2024-09-12T00:39:17.768503+0000","last_unstale":"2024-09-12T01:35:34.537633+0000","last_undegraded":"2024-09-12T01:35:34.537633+0000","last_fullsized":"2024-09-12T01:35:34.537633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:49.617037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.004612+0000","last_change":"2024-09-12T01:02:03.928738+0000","last_active":"2024-09-12T01:35:24.004612+0000","last_peered":"2024-09-12T01:35:24.004612+0000","last_clean":"2024-09-12T01:35:24.004612+0000","last_became_active":"2024-09-12T01:02:03.928430+0000","last_became_peered":"2024-09-12T01:02:03.928430+0000","last_unstale":"2024-09-12T01:35:24.004612+0000","last_undegraded":"2024-09-12T01:35:24.004612+0000","last_fullsized":"2024-09-12T01:35:24.004612+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:55.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.092791+0000","last_change":"2024-09-12T00:43:43.823435+0000","last_active":"2024-09-12T01:35:50.092791+0000","last_peered":"2024-09-12T01:35:50.092791+0000","last_clean":"2024-09-12T01:35:50.092791+0000","last_became_active":"2024-09-12T00:43:43.822996+0000","last_became_peered":"2024-09-12T00:43:43.822996+0000","last_unstale":"2024-09-12T01:35:50.092791+0000","last_undegraded":"2024-09-12T01:35:50.092791+0000","last_fullsized":"2024-09-12T01:35:50.092791+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'2","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.185327+0000","last_change":"2024-09-12T00:43:38.797634+0000","last_active":"2024-09-12T01:35:44.185327+0000","last_peered":"2024-09-12T01:35:44.185327+0000","last_clean":"2024-09-12T01:35:44.185327+0000","last_became_active":"2024-09-12T00:43:38.797367+0000","last_became_peered":"2024-09-12T00:43:38.797367+0000","last_unstale":"2024-09-12T01:35:44.185327+0000","last_undegraded":"2024-09-12T01:35:44.185327+0000","last_fullsized":"2024-09-12T01:35:44.185327+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'9","reported_seq":83,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537587+0000","last_change":"2024-09-12T00:39:17.759644+0000","last_active":"2024-09-12T01:35:34.537587+0000","last_peered":"2024-09-12T01:35:34.537587+0000","last_clean":"2024-09-12T01:35:34.537587+0000","last_became_active":"2024-09-12T00:39:17.759327+0000","last_became_peered":"2024-09-12T00:39:17.759327+0000","last_unstale":"2024-09-12T01:35:34.537587+0000","last_undegraded":"2024-09-12T01:35:34.537587+0000","last_fullsized":"2024-09-12T01:35:34.537587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:23.808909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":31,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536493+0000","last_change":"2024-09-12T01:02:03.925373+0000","last_active":"2024-09-12T01:35:24.536493+0000","last_peered":"2024-09-12T01:35:24.536493+0000","last_clean":"2024-09-12T01:35:24.536493+0000","last_became_active":"2024-09-12T01:02:03.925081+0000","last_became_peered":"2024-09-12T01:02:03.925081+0000","last_unstale":"2024-09-12T01:35:24.536493+0000","last_undegraded":"2024-09-12T01:35:24.536493+0000","last_fullsized":"2024-09-12T01:35:24.536493+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:09.007940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'4","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.742130+0000","last_change":"2024-09-12T00:43:43.822771+0000","last_active":"2024-09-12T01:37:38.742130+0000","last_peered":"2024-09-12T01:37:38.742130+0000","last_clean":"2024-09-12T01:37:38.742130+0000","last_became_active":"2024-09-12T00:43:43.822237+0000","last_became_peered":"2024-09-12T00:43:43.822237+0000","last_unstale":"2024-09-12T01:37:38.742130+0000","last_undegraded":"2024-09-12T01:37:38.742130+0000","last_fullsized":"2024-09-12T01:37:38.742130+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'6","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.912065+0000","last_change":"2024-09-12T00:43:38.794264+0000","last_active":"2024-09-12T01:37:38.912065+0000","last_peered":"2024-09-12T01:37:38.912065+0000","last_clean":"2024-09-12T01:37:38.912065+0000","last_became_active":"2024-09-12T00:43:38.793943+0000","last_became_peered":"2024-09-12T00:43:38.793943+0000","last_unstale":"2024-09-12T01:37:38.912065+0000","last_undegraded":"2024-09-12T01:37:38.912065+0000","last_fullsized":"2024-09-12T01:37:38.912065+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11272,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"266'26","reported_seq":130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:30.090680+0000","last_change":"2024-09-12T00:39:17.770362+0000","last_active":"2024-09-12T01:35:30.090680+0000","last_peered":"2024-09-12T01:35:30.090680+0000","last_clean":"2024-09-12T01:35:30.090680+0000","last_became_active":"2024-09-12T00:39:17.770093+0000","last_became_peered":"2024-09-12T00:39:17.770093+0000","last_unstale":"2024-09-12T01:35:30.090680+0000","last_undegraded":"2024-09-12T01:35:30.090680+0000","last_fullsized":"2024-09-12T01:35:30.090680+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:24:56.241617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'194","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.782554+0000","last_change":"2024-09-12T01:37:51.782461+0000","last_active":"2024-09-12T01:37:51.782554+0000","last_peered":"2024-09-12T01:37:51.782554+0000","last_clean":"2024-09-12T01:37:51.782554+0000","last_became_active":"2024-09-12T00:25:00.479764+0000","last_became_peered":"2024-09-12T00:25:00.479764+0000","last_unstale":"2024-09-12T01:37:51.782554+0000","last_undegraded":"2024-09-12T01:37:51.782554+0000","last_fullsized":"2024-09-12T01:37:51.782554+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T01:37:51.782310+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T01:37:51.782310+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.782310+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:39.097138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":6490,"num_write":862,"num_write_kb":17717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'386","reported_seq":1940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.837693+0000","last_change":"2024-09-12T01:37:59.837693+0000","last_active":"2024-09-12T01:37:59.837693+0000","last_peered":"2024-09-12T01:37:59.837693+0000","last_clean":"2024-09-12T01:37:59.837693+0000","last_became_active":"2024-09-12T00:25:02.474473+0000","last_became_peered":"2024-09-12T00:25:02.474473+0000","last_unstale":"2024-09-12T01:37:59.837693+0000","last_undegraded":"2024-09-12T01:37:59.837693+0000","last_fullsized":"2024-09-12T01:37:59.837693+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'386","last_scrub_stamp":"2024-09-12T01:37:59.837583+0000","last_deep_scrub":"266'386","last_deep_scrub_stamp":"2024-09-12T01:37:59.837583+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.837583+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:41.730695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2167,"num_read_kb":2073,"num_write":418,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'235","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.616677+0000","last_change":"2024-09-12T01:37:57.616619+0000","last_active":"2024-09-12T01:37:57.616677+0000","last_peered":"2024-09-12T01:37:57.616677+0000","last_clean":"2024-09-12T01:37:57.616677+0000","last_became_active":"2024-09-12T00:25:00.469588+0000","last_became_peered":"2024-09-12T00:25:00.469588+0000","last_unstale":"2024-09-12T01:37:57.616677+0000","last_undegraded":"2024-09-12T01:37:57.616677+0000","last_fullsized":"2024-09-12T01:37:57.616677+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'235","last_scrub_stamp":"2024-09-12T01:37:57.616503+0000","last_deep_scrub":"266'235","last_deep_scrub_stamp":"2024-09-12T01:37:57.616503+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.616503+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:16.143384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038976,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":700,"num_read_kb":64068,"num_write":1104,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'889","reported_seq":2575,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491254+0000","last_change":"2024-09-12T00:25:02.476425+0000","last_active":"2024-09-12T01:35:23.491254+0000","last_peered":"2024-09-12T01:35:23.491254+0000","last_clean":"2024-09-12T01:35:23.491254+0000","last_became_active":"2024-09-12T00:25:02.476131+0000","last_became_peered":"2024-09-12T00:25:02.476131+0000","last_unstale":"2024-09-12T01:35:23.491254+0000","last_undegraded":"2024-09-12T01:35:23.491254+0000","last_fullsized":"2024-09-12T01:35:23.491254+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":800,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:34.276119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4103,"num_read_kb":3695,"num_write":1128,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'210","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.565091+0000","last_change":"2024-09-12T01:37:58.565004+0000","last_active":"2024-09-12T01:37:58.565091+0000","last_peered":"2024-09-12T01:37:58.565091+0000","last_clean":"2024-09-12T01:37:58.565091+0000","last_became_active":"2024-09-12T00:25:00.458072+0000","last_became_peered":"2024-09-12T00:25:00.458072+0000","last_unstale":"2024-09-12T01:37:58.565091+0000","last_undegraded":"2024-09-12T01:37:58.565091+0000","last_fullsized":"2024-09-12T01:37:58.565091+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T01:37:58.564864+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T01:37:58.564864+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.564864+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:34.721743+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":12854,"num_write":984,"num_write_kb":25223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1325","reported_seq":2879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.338584+0000","last_change":"2024-09-12T00:25:02.470846+0000","last_active":"2024-09-12T01:36:12.338584+0000","last_peered":"2024-09-12T01:36:12.338584+0000","last_clean":"2024-09-12T01:36:12.338584+0000","last_became_active":"2024-09-12T00:25:02.470249+0000","last_became_peered":"2024-09-12T00:25:02.470249+0000","last_unstale":"2024-09-12T01:36:12.338584+0000","last_undegraded":"2024-09-12T01:36:12.338584+0000","last_fullsized":"2024-09-12T01:36:12.338584+0000","mapping_epoch":28,"log_start":"266'1300","ondisk_log_start":"266'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":1300,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:00.680374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5936,"num_read_kb":5183,"num_write":1890,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'198","reported_seq":841,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.701005+0000","last_change":"2024-09-12T01:37:49.701005+0000","last_active":"2024-09-12T01:37:49.701005+0000","last_peered":"2024-09-12T01:37:49.701005+0000","last_clean":"2024-09-12T01:37:49.701005+0000","last_became_active":"2024-09-12T00:25:00.482357+0000","last_became_peered":"2024-09-12T00:25:00.482357+0000","last_unstale":"2024-09-12T01:37:49.701005+0000","last_undegraded":"2024-09-12T01:37:49.701005+0000","last_fullsized":"2024-09-12T01:37:49.701005+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'198","last_scrub_stamp":"2024-09-12T01:37:49.700861+0000","last_deep_scrub":"266'198","last_deep_scrub_stamp":"2024-09-12T01:37:49.700861+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.700861+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:41.600504+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":30861,"num_write":868,"num_write_kb":33122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'568","reported_seq":2123,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.305956+0000","last_change":"2024-09-12T01:38:01.305956+0000","last_active":"2024-09-12T01:38:01.305956+0000","last_peered":"2024-09-12T01:38:01.305956+0000","last_clean":"2024-09-12T01:38:01.305956+0000","last_became_active":"2024-09-12T00:25:02.467378+0000","last_became_peered":"2024-09-12T00:25:02.467378+0000","last_unstale":"2024-09-12T01:38:01.305956+0000","last_undegraded":"2024-09-12T01:38:01.305956+0000","last_fullsized":"2024-09-12T01:38:01.305956+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'568","last_scrub_stamp":"2024-09-12T01:38:01.305854+0000","last_deep_scrub":"266'568","last_deep_scrub_stamp":"2024-09-12T01:38:01.305854+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.305854+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:08.402665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2918,"num_read_kb":2656,"num_write":743,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'211","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.817464+0000","last_change":"2024-09-12T01:37:50.817464+0000","last_active":"2024-09-12T01:37:50.817464+0000","last_peered":"2024-09-12T01:37:50.817464+0000","last_clean":"2024-09-12T01:37:50.817464+0000","last_became_active":"2024-09-12T00:25:00.475340+0000","last_became_peered":"2024-09-12T00:25:00.475340+0000","last_unstale":"2024-09-12T01:37:50.817464+0000","last_undegraded":"2024-09-12T01:37:50.817464+0000","last_fullsized":"2024-09-12T01:37:50.817464+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T01:37:50.817350+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T01:37:50.817350+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.817350+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:44.835143+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":13966,"num_write":1015,"num_write_kb":23620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'576","reported_seq":2287,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.816314+0000","last_change":"2024-09-12T01:37:58.816314+0000","last_active":"2024-09-12T01:37:58.816314+0000","last_peered":"2024-09-12T01:37:58.816314+0000","last_clean":"2024-09-12T01:37:58.816314+0000","last_became_active":"2024-09-12T00:25:02.474229+0000","last_became_peered":"2024-09-12T00:25:02.474229+0000","last_unstale":"2024-09-12T01:37:58.816314+0000","last_undegraded":"2024-09-12T01:37:58.816314+0000","last_fullsized":"2024-09-12T01:37:58.816314+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'576","last_scrub_stamp":"2024-09-12T01:37:58.816221+0000","last_deep_scrub":"266'576","last_deep_scrub_stamp":"2024-09-12T01:37:58.816221+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.816221+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:01.221779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2896,"num_write":736,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1072,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'188","reported_seq":939,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.754127+0000","last_change":"2024-09-12T01:37:50.754127+0000","last_active":"2024-09-12T01:37:50.754127+0000","last_peered":"2024-09-12T01:37:50.754127+0000","last_clean":"2024-09-12T01:37:50.754127+0000","last_became_active":"2024-09-12T00:25:00.487589+0000","last_became_peered":"2024-09-12T00:25:00.487589+0000","last_unstale":"2024-09-12T01:37:50.754127+0000","last_undegraded":"2024-09-12T01:37:50.754127+0000","last_fullsized":"2024-09-12T01:37:50.754127+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:50.754013+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:50.754013+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.754013+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:08.640403+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8822595,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":942,"num_read_kb":45033,"num_write":954,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'529","reported_seq":2429,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.856271+0000","last_change":"2024-09-12T01:37:59.856187+0000","last_active":"2024-09-12T01:37:59.856271+0000","last_peered":"2024-09-12T01:37:59.856271+0000","last_clean":"2024-09-12T01:37:59.856271+0000","last_became_active":"2024-09-12T00:25:02.477395+0000","last_became_peered":"2024-09-12T00:25:02.477395+0000","last_unstale":"2024-09-12T01:37:59.856271+0000","last_undegraded":"2024-09-12T01:37:59.856271+0000","last_fullsized":"2024-09-12T01:37:59.856271+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'529","last_scrub_stamp":"2024-09-12T01:37:59.856094+0000","last_deep_scrub":"266'529","last_deep_scrub_stamp":"2024-09-12T01:37:59.856094+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.856094+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:03.807614+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3189,"num_read_kb":3033,"num_write":616,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2555,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'234","reported_seq":903,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.867960+0000","last_change":"2024-09-12T01:37:49.867960+0000","last_active":"2024-09-12T01:37:49.867960+0000","last_peered":"2024-09-12T01:37:49.867960+0000","last_clean":"2024-09-12T01:37:49.867960+0000","last_became_active":"2024-09-12T00:25:00.477590+0000","last_became_peered":"2024-09-12T00:25:00.477590+0000","last_unstale":"2024-09-12T01:37:49.867960+0000","last_undegraded":"2024-09-12T01:37:49.867960+0000","last_fullsized":"2024-09-12T01:37:49.867960+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'234","last_scrub_stamp":"2024-09-12T01:37:49.867814+0000","last_deep_scrub":"266'234","last_deep_scrub_stamp":"2024-09-12T01:37:49.867814+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.867814+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:35.864908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048652,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":24485,"num_write":1039,"num_write_kb":27596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'375","reported_seq":1766,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.698712+0000","last_change":"2024-09-12T01:37:55.698644+0000","last_active":"2024-09-12T01:37:55.698712+0000","last_peered":"2024-09-12T01:37:55.698712+0000","last_clean":"2024-09-12T01:37:55.698712+0000","last_became_active":"2024-09-12T00:25:02.466439+0000","last_became_peered":"2024-09-12T00:25:02.466439+0000","last_unstale":"2024-09-12T01:37:55.698712+0000","last_undegraded":"2024-09-12T01:37:55.698712+0000","last_fullsized":"2024-09-12T01:37:55.698712+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'375","last_scrub_stamp":"2024-09-12T01:37:55.698565+0000","last_deep_scrub":"266'375","last_deep_scrub_stamp":"2024-09-12T01:37:55.698565+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.698565+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:29.902650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1739,"num_write":422,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'188","reported_seq":801,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.564948+0000","last_change":"2024-09-12T01:37:56.564948+0000","last_active":"2024-09-12T01:37:56.564948+0000","last_peered":"2024-09-12T01:37:56.564948+0000","last_clean":"2024-09-12T01:37:56.564948+0000","last_became_active":"2024-09-12T00:25:00.472046+0000","last_became_peered":"2024-09-12T00:25:00.472046+0000","last_unstale":"2024-09-12T01:37:56.564948+0000","last_undegraded":"2024-09-12T01:37:56.564948+0000","last_fullsized":"2024-09-12T01:37:56.564948+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:56.564688+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:56.564688+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.564688+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:04.119213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":23076,"num_write":837,"num_write_kb":28135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'364","reported_seq":1840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428693+0000","last_change":"2024-09-12T00:25:02.475079+0000","last_active":"2024-09-12T01:37:18.428693+0000","last_peered":"2024-09-12T01:37:18.428693+0000","last_clean":"2024-09-12T01:37:18.428693+0000","last_became_active":"2024-09-12T00:25:02.474791+0000","last_became_peered":"2024-09-12T00:25:02.474791+0000","last_unstale":"2024-09-12T01:37:18.428693+0000","last_undegraded":"2024-09-12T01:37:18.428693+0000","last_fullsized":"2024-09-12T01:37:18.428693+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2089,"num_read_kb":2020,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'476","reported_seq":2145,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428799+0000","last_change":"2024-09-12T00:25:02.471996+0000","last_active":"2024-09-12T01:37:18.428799+0000","last_peered":"2024-09-12T01:37:18.428799+0000","last_clean":"2024-09-12T01:37:18.428799+0000","last_became_active":"2024-09-12T00:25:02.471545+0000","last_became_peered":"2024-09-12T00:25:02.471545+0000","last_unstale":"2024-09-12T01:37:18.428799+0000","last_undegraded":"2024-09-12T01:37:18.428799+0000","last_fullsized":"2024-09-12T01:37:18.428799+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:19.567590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2642,"num_read_kb":2498,"num_write":559,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'202","reported_seq":1070,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.902175+0000","last_change":"2024-09-12T01:37:48.902175+0000","last_active":"2024-09-12T01:37:48.902175+0000","last_peered":"2024-09-12T01:37:48.902175+0000","last_clean":"2024-09-12T01:37:48.902175+0000","last_became_active":"2024-09-12T00:25:00.464783+0000","last_became_peered":"2024-09-12T00:25:00.464783+0000","last_unstale":"2024-09-12T01:37:48.902175+0000","last_undegraded":"2024-09-12T01:37:48.902175+0000","last_fullsized":"2024-09-12T01:37:48.902175+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'202","last_scrub_stamp":"2024-09-12T01:37:48.902072+0000","last_deep_scrub":"266'202","last_deep_scrub_stamp":"2024-09-12T01:37:48.902072+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.902072+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.439697+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":967,"num_read_kb":27994,"num_write":1073,"num_write_kb":26373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'504","reported_seq":2079,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.764743+0000","last_change":"2024-09-12T01:37:54.764743+0000","last_active":"2024-09-12T01:37:54.764743+0000","last_peered":"2024-09-12T01:37:54.764743+0000","last_clean":"2024-09-12T01:37:54.764743+0000","last_became_active":"2024-09-12T00:25:02.475032+0000","last_became_peered":"2024-09-12T00:25:02.475032+0000","last_unstale":"2024-09-12T01:37:54.764743+0000","last_undegraded":"2024-09-12T01:37:54.764743+0000","last_fullsized":"2024-09-12T01:37:54.764743+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'504","last_scrub_stamp":"2024-09-12T01:37:54.764639+0000","last_deep_scrub":"266'504","last_deep_scrub_stamp":"2024-09-12T01:37:54.764639+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.764639+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:07.905496+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2653,"num_read_kb":2473,"num_write":625,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'211","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.771568+0000","last_change":"2024-09-12T01:37:52.771568+0000","last_active":"2024-09-12T01:37:52.771568+0000","last_peered":"2024-09-12T01:37:52.771568+0000","last_clean":"2024-09-12T01:37:52.771568+0000","last_became_active":"2024-09-12T00:25:00.479635+0000","last_became_peered":"2024-09-12T00:25:00.479635+0000","last_unstale":"2024-09-12T01:37:52.771568+0000","last_undegraded":"2024-09-12T01:37:52.771568+0000","last_fullsized":"2024-09-12T01:37:52.771568+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T01:37:52.771466+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T01:37:52.771466+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.771466+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:45.884259+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279168,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":30051,"num_write":937,"num_write_kb":51711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'1151","reported_seq":2940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.880921+0000","last_change":"2024-09-12T01:37:54.880921+0000","last_active":"2024-09-12T01:37:54.880921+0000","last_peered":"2024-09-12T01:37:54.880921+0000","last_clean":"2024-09-12T01:37:54.880921+0000","last_became_active":"2024-09-12T00:25:02.467224+0000","last_became_peered":"2024-09-12T00:25:02.467224+0000","last_unstale":"2024-09-12T01:37:54.880921+0000","last_undegraded":"2024-09-12T01:37:54.880921+0000","last_fullsized":"2024-09-12T01:37:54.880921+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1151","last_scrub_stamp":"2024-09-12T01:37:54.880810+0000","last_deep_scrub":"266'1151","last_deep_scrub_stamp":"2024-09-12T01:37:54.880810+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.880810+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":1100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.639713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5645,"num_read_kb":4973,"num_write":1729,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'210","reported_seq":855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.874315+0000","last_change":"2024-09-12T01:37:48.874315+0000","last_active":"2024-09-12T01:37:48.874315+0000","last_peered":"2024-09-12T01:37:48.874315+0000","last_clean":"2024-09-12T01:37:48.874315+0000","last_became_active":"2024-09-12T00:25:00.477184+0000","last_became_peered":"2024-09-12T00:25:00.477184+0000","last_unstale":"2024-09-12T01:37:48.874315+0000","last_undegraded":"2024-09-12T01:37:48.874315+0000","last_fullsized":"2024-09-12T01:37:48.874315+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T01:37:48.874041+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T01:37:48.874041+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.874041+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:11.950680+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3321654,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":408,"num_read_kb":20227,"num_write":1015,"num_write_kb":31572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'487","reported_seq":2026,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.351017+0000","last_change":"2024-09-12T01:37:59.351017+0000","last_active":"2024-09-12T01:37:59.351017+0000","last_peered":"2024-09-12T01:37:59.351017+0000","last_clean":"2024-09-12T01:37:59.351017+0000","last_became_active":"2024-09-12T00:25:02.469463+0000","last_became_peered":"2024-09-12T00:25:02.469463+0000","last_unstale":"2024-09-12T01:37:59.351017+0000","last_undegraded":"2024-09-12T01:37:59.351017+0000","last_fullsized":"2024-09-12T01:37:59.351017+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'487","last_scrub_stamp":"2024-09-12T01:37:59.350932+0000","last_deep_scrub":"266'487","last_deep_scrub_stamp":"2024-09-12T01:37:59.350932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.350932+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:05.093460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2387,"num_write":615,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'190","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.874423+0000","last_change":"2024-09-12T01:37:47.874423+0000","last_active":"2024-09-12T01:37:47.874423+0000","last_peered":"2024-09-12T01:37:47.874423+0000","last_clean":"2024-09-12T01:37:47.874423+0000","last_became_active":"2024-09-12T00:25:00.483327+0000","last_became_peered":"2024-09-12T00:25:00.483327+0000","last_unstale":"2024-09-12T01:37:47.874423+0000","last_undegraded":"2024-09-12T01:37:47.874423+0000","last_fullsized":"2024-09-12T01:37:47.874423+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T01:37:47.874305+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T01:37:47.874305+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.874305+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:25.303987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395812,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":12020,"num_write":922,"num_write_kb":12011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'406","reported_seq":1997,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491334+0000","last_change":"2024-09-12T00:25:02.472828+0000","last_active":"2024-09-12T01:35:23.491334+0000","last_peered":"2024-09-12T01:35:23.491334+0000","last_clean":"2024-09-12T01:35:23.491334+0000","last_became_active":"2024-09-12T00:25:02.471598+0000","last_became_peered":"2024-09-12T00:25:02.471598+0000","last_unstale":"2024-09-12T01:35:23.491334+0000","last_undegraded":"2024-09-12T01:35:23.491334+0000","last_fullsized":"2024-09-12T01:35:23.491334+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:34.396174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2389,"num_read_kb":2272,"num_write":462,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'177","reported_seq":844,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.284808+0000","last_change":"2024-09-12T01:37:52.284808+0000","last_active":"2024-09-12T01:37:52.284808+0000","last_peered":"2024-09-12T01:37:52.284808+0000","last_clean":"2024-09-12T01:37:52.284808+0000","last_became_active":"2024-09-12T00:25:00.478202+0000","last_became_peered":"2024-09-12T00:25:00.478202+0000","last_unstale":"2024-09-12T01:37:52.284808+0000","last_undegraded":"2024-09-12T01:37:52.284808+0000","last_fullsized":"2024-09-12T01:37:52.284808+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T01:37:52.284701+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T01:37:52.284701+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.284701+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:47.992887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":78408,"num_write":837,"num_write_kb":24955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'665","reported_seq":2206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.925694+0000","last_change":"2024-09-12T01:37:55.925694+0000","last_active":"2024-09-12T01:37:55.925694+0000","last_peered":"2024-09-12T01:37:55.925694+0000","last_clean":"2024-09-12T01:37:55.925694+0000","last_became_active":"2024-09-12T00:25:02.470278+0000","last_became_peered":"2024-09-12T00:25:02.470278+0000","last_unstale":"2024-09-12T01:37:55.925694+0000","last_undegraded":"2024-09-12T01:37:55.925694+0000","last_fullsized":"2024-09-12T01:37:55.925694+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'665","last_scrub_stamp":"2024-09-12T01:37:55.925590+0000","last_deep_scrub":"266'665","last_deep_scrub_stamp":"2024-09-12T01:37:55.925590+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.925590+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":600,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:59.829971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3455,"num_read_kb":3151,"num_write":936,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'238","reported_seq":915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.212407+0000","last_change":"2024-09-12T01:37:50.212407+0000","last_active":"2024-09-12T01:37:50.212407+0000","last_peered":"2024-09-12T01:37:50.212407+0000","last_clean":"2024-09-12T01:37:50.212407+0000","last_became_active":"2024-09-12T00:25:00.456765+0000","last_became_peered":"2024-09-12T00:25:00.456765+0000","last_unstale":"2024-09-12T01:37:50.212407+0000","last_undegraded":"2024-09-12T01:37:50.212407+0000","last_fullsized":"2024-09-12T01:37:50.212407+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'238","last_scrub_stamp":"2024-09-12T01:37:50.212298+0000","last_deep_scrub":"266'238","last_deep_scrub_stamp":"2024-09-12T01:37:50.212298+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.212298+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:59.941924+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496550,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":628,"num_read_kb":22861,"num_write":1212,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'129","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.484498+0000","last_change":"2024-09-12T00:25:10.523473+0000","last_active":"2024-09-12T01:36:12.484498+0000","last_peered":"2024-09-12T01:36:12.484498+0000","last_clean":"2024-09-12T01:36:12.484498+0000","last_became_active":"2024-09-12T00:25:10.523187+0000","last_became_peered":"2024-09-12T00:25:10.523187+0000","last_unstale":"2024-09-12T01:36:12.484498+0000","last_undegraded":"2024-09-12T01:36:12.484498+0000","last_fullsized":"2024-09-12T01:36:12.484498+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:09:03.075928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'452","reported_seq":2147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.335059+0000","last_change":"2024-09-12T01:37:57.335059+0000","last_active":"2024-09-12T01:37:57.335059+0000","last_peered":"2024-09-12T01:37:57.335059+0000","last_clean":"2024-09-12T01:37:57.335059+0000","last_became_active":"2024-09-12T00:25:02.464035+0000","last_became_peered":"2024-09-12T00:25:02.464035+0000","last_unstale":"2024-09-12T01:37:57.335059+0000","last_undegraded":"2024-09-12T01:37:57.335059+0000","last_fullsized":"2024-09-12T01:37:57.335059+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'452","last_scrub_stamp":"2024-09-12T01:37:57.334965+0000","last_deep_scrub":"266'452","last_deep_scrub_stamp":"2024-09-12T01:37:57.334965+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.334965+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.139483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2614,"num_read_kb":2487,"num_write":526,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'214","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.033783+0000","last_change":"2024-09-12T01:37:51.033783+0000","last_active":"2024-09-12T01:37:51.033783+0000","last_peered":"2024-09-12T01:37:51.033783+0000","last_clean":"2024-09-12T01:37:51.033783+0000","last_became_active":"2024-09-12T00:25:00.479335+0000","last_became_peered":"2024-09-12T00:25:00.479335+0000","last_unstale":"2024-09-12T01:37:51.033783+0000","last_undegraded":"2024-09-12T01:37:51.033783+0000","last_fullsized":"2024-09-12T01:37:51.033783+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'214","last_scrub_stamp":"2024-09-12T01:37:51.033591+0000","last_deep_scrub":"266'214","last_deep_scrub_stamp":"2024-09-12T01:37:51.033591+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.033591+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:30.332562+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1920160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":7515,"num_write":984,"num_write_kb":32910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534500+0000","last_change":"2024-09-12T00:25:04.485699+0000","last_active":"2024-09-12T01:35:09.534500+0000","last_peered":"2024-09-12T01:35:09.534500+0000","last_clean":"2024-09-12T01:35:09.534500+0000","last_became_active":"2024-09-12T00:25:04.485389+0000","last_became_peered":"2024-09-12T00:25:04.485389+0000","last_unstale":"2024-09-12T01:35:09.534500+0000","last_undegraded":"2024-09-12T01:35:09.534500+0000","last_fullsized":"2024-09-12T01:35:09.534500+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:42.240804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'220","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.635957+0000","last_change":"2024-09-12T00:25:06.500211+0000","last_active":"2024-09-12T01:37:38.635957+0000","last_peered":"2024-09-12T01:37:38.635957+0000","last_clean":"2024-09-12T01:37:38.635957+0000","last_became_active":"2024-09-12T00:25:06.499933+0000","last_became_peered":"2024-09-12T00:25:06.499933+0000","last_unstale":"2024-09-12T01:37:38.635957+0000","last_undegraded":"2024-09-12T01:37:38.635957+0000","last_fullsized":"2024-09-12T01:37:38.635957+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:46.967892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7477,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":376,"num_write":176,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.089450+0000","last_change":"2024-09-12T00:25:08.501552+0000","last_active":"2024-09-12T01:35:14.089450+0000","last_peered":"2024-09-12T01:35:14.089450+0000","last_clean":"2024-09-12T01:35:14.089450+0000","last_became_active":"2024-09-12T00:25:08.501137+0000","last_became_peered":"2024-09-12T00:25:08.501137+0000","last_unstale":"2024-09-12T01:35:14.089450+0000","last_undegraded":"2024-09-12T01:35:14.089450+0000","last_fullsized":"2024-09-12T01:35:14.089450+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:02.147605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2435","reported_seq":4333,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.472078+0000","last_change":"2024-09-12T00:25:10.526327+0000","last_active":"2024-09-12T01:36:12.472078+0000","last_peered":"2024-09-12T01:36:12.472078+0000","last_clean":"2024-09-12T01:36:12.472078+0000","last_became_active":"2024-09-12T00:25:10.526016+0000","last_became_peered":"2024-09-12T00:25:10.526016+0000","last_unstale":"2024-09-12T01:36:12.472078+0000","last_undegraded":"2024-09-12T01:36:12.472078+0000","last_fullsized":"2024-09-12T01:36:12.472078+0000","mapping_epoch":36,"log_start":"266'2400","ondisk_log_start":"266'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":2400,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6097,"num_read_kb":6097,"num_write":4851,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'891","reported_seq":2330,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.428993+0000","last_change":"2024-09-12T00:25:02.477964+0000","last_active":"2024-09-12T01:37:18.428993+0000","last_peered":"2024-09-12T01:37:18.428993+0000","last_clean":"2024-09-12T01:37:18.428993+0000","last_became_active":"2024-09-12T00:25:02.477360+0000","last_became_peered":"2024-09-12T00:25:02.477360+0000","last_unstale":"2024-09-12T01:37:18.428993+0000","last_undegraded":"2024-09-12T01:37:18.428993+0000","last_fullsized":"2024-09-12T01:37:18.428993+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":800,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:52.094792+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4073,"num_read_kb":3587,"num_write":1238,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'213","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.310189+0000","last_change":"2024-09-12T01:37:47.310189+0000","last_active":"2024-09-12T01:37:47.310189+0000","last_peered":"2024-09-12T01:37:47.310189+0000","last_clean":"2024-09-12T01:37:47.310189+0000","last_became_active":"2024-09-12T00:25:00.452236+0000","last_became_peered":"2024-09-12T00:25:00.452236+0000","last_unstale":"2024-09-12T01:37:47.310189+0000","last_undegraded":"2024-09-12T01:37:47.310189+0000","last_fullsized":"2024-09-12T01:37:47.310189+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T01:37:47.310082+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T01:37:47.310082+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.310082+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:32.824803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084046,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":27979,"num_write":1022,"num_write_kb":43410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.254402+0000","last_change":"2024-09-12T00:25:04.481555+0000","last_active":"2024-09-12T01:35:17.254402+0000","last_peered":"2024-09-12T01:35:17.254402+0000","last_clean":"2024-09-12T01:35:17.254402+0000","last_became_active":"2024-09-12T00:25:04.481218+0000","last_became_peered":"2024-09-12T00:25:04.481218+0000","last_unstale":"2024-09-12T01:35:17.254402+0000","last_undegraded":"2024-09-12T01:35:17.254402+0000","last_fullsized":"2024-09-12T01:35:17.254402+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:06.324093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'131","reported_seq":688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.820345+0000","last_change":"2024-09-12T01:38:03.820345+0000","last_active":"2024-09-12T01:38:03.820345+0000","last_peered":"2024-09-12T01:38:03.820345+0000","last_clean":"2024-09-12T01:38:03.820345+0000","last_became_active":"2024-09-12T00:25:06.490463+0000","last_became_peered":"2024-09-12T00:25:06.490463+0000","last_unstale":"2024-09-12T01:38:03.820345+0000","last_undegraded":"2024-09-12T01:38:03.820345+0000","last_fullsized":"2024-09-12T01:38:03.820345+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'131","last_scrub_stamp":"2024-09-12T01:38:03.820249+0000","last_deep_scrub":"266'131","last_deep_scrub_stamp":"2024-09-12T01:38:03.820249+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.820249+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:39.548081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":131,"num_write":102,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.089409+0000","last_change":"2024-09-12T00:25:08.505822+0000","last_active":"2024-09-12T01:35:14.089409+0000","last_peered":"2024-09-12T01:35:14.089409+0000","last_clean":"2024-09-12T01:35:14.089409+0000","last_became_active":"2024-09-12T00:25:08.505492+0000","last_became_peered":"2024-09-12T00:25:08.505492+0000","last_unstale":"2024-09-12T01:35:14.089409+0000","last_undegraded":"2024-09-12T01:35:14.089409+0000","last_fullsized":"2024-09-12T01:35:14.089409+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:49.241744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'139","reported_seq":660,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.420519+0000","last_change":"2024-09-12T00:25:10.523127+0000","last_active":"2024-09-12T01:37:18.420519+0000","last_peered":"2024-09-12T01:37:18.420519+0000","last_clean":"2024-09-12T01:37:18.420519+0000","last_became_active":"2024-09-12T00:25:10.522822+0000","last_became_peered":"2024-09-12T00:25:10.522822+0000","last_unstale":"2024-09-12T01:37:18.420519+0000","last_undegraded":"2024-09-12T01:37:18.420519+0000","last_fullsized":"2024-09-12T01:37:18.420519+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:39.986321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":196,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'484","reported_seq":2032,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.634426+0000","last_change":"2024-09-12T01:38:03.634426+0000","last_active":"2024-09-12T01:38:03.634426+0000","last_peered":"2024-09-12T01:38:03.634426+0000","last_clean":"2024-09-12T01:38:03.634426+0000","last_became_active":"2024-09-12T00:25:02.478850+0000","last_became_peered":"2024-09-12T00:25:02.478850+0000","last_unstale":"2024-09-12T01:38:03.634426+0000","last_undegraded":"2024-09-12T01:38:03.634426+0000","last_fullsized":"2024-09-12T01:38:03.634426+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'484","last_scrub_stamp":"2024-09-12T01:38:03.634343+0000","last_deep_scrub":"266'484","last_deep_scrub_stamp":"2024-09-12T01:38:03.634343+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.634343+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:40.357076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2311,"num_write":575,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'203","reported_seq":871,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.039288+0000","last_change":"2024-09-12T01:37:59.039288+0000","last_active":"2024-09-12T01:37:59.039288+0000","last_peered":"2024-09-12T01:37:59.039288+0000","last_clean":"2024-09-12T01:37:59.039288+0000","last_became_active":"2024-09-12T00:25:00.475628+0000","last_became_peered":"2024-09-12T00:25:00.475628+0000","last_unstale":"2024-09-12T01:37:59.039288+0000","last_undegraded":"2024-09-12T01:37:59.039288+0000","last_fullsized":"2024-09-12T01:37:59.039288+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'203","last_scrub_stamp":"2024-09-12T01:37:59.039165+0000","last_deep_scrub":"266'203","last_deep_scrub_stamp":"2024-09-12T01:37:59.039165+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.039165+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:59.337559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":1110,"num_write":851,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:12.253498+0000","last_change":"2024-09-12T00:25:04.484287+0000","last_active":"2024-09-12T01:35:12.253498+0000","last_peered":"2024-09-12T01:35:12.253498+0000","last_clean":"2024-09-12T01:35:12.253498+0000","last_became_active":"2024-09-12T00:25:04.483774+0000","last_became_peered":"2024-09-12T00:25:04.483774+0000","last_unstale":"2024-09-12T01:35:12.253498+0000","last_undegraded":"2024-09-12T01:35:12.253498+0000","last_fullsized":"2024-09-12T01:35:12.253498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:54:26.376424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'143","reported_seq":719,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.415267+0000","last_change":"2024-09-12T00:25:06.501549+0000","last_active":"2024-09-12T01:36:07.415267+0000","last_peered":"2024-09-12T01:36:07.415267+0000","last_clean":"2024-09-12T01:36:07.415267+0000","last_became_active":"2024-09-12T00:25:06.500991+0000","last_became_peered":"2024-09-12T00:25:06.500991+0000","last_unstale":"2024-09-12T01:36:07.415267+0000","last_undegraded":"2024-09-12T01:36:07.415267+0000","last_fullsized":"2024-09-12T01:36:07.415267+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:31.699237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'797","reported_seq":4866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.920566+0000","last_change":"2024-09-12T00:25:08.514676+0000","last_active":"2024-09-12T01:37:38.920566+0000","last_peered":"2024-09-12T01:37:38.920566+0000","last_clean":"2024-09-12T01:37:38.920566+0000","last_became_active":"2024-09-12T00:25:08.514360+0000","last_became_peered":"2024-09-12T00:25:08.514360+0000","last_unstale":"2024-09-12T01:37:38.920566+0000","last_undegraded":"2024-09-12T01:37:38.920566+0000","last_fullsized":"2024-09-12T01:37:38.920566+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":700,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:23:19.747805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'202","reported_seq":1037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.546065+0000","last_change":"2024-09-12T00:25:10.519173+0000","last_active":"2024-09-12T01:36:12.546065+0000","last_peered":"2024-09-12T01:36:12.546065+0000","last_clean":"2024-09-12T01:36:12.546065+0000","last_became_active":"2024-09-12T00:25:10.518861+0000","last_became_peered":"2024-09-12T00:25:10.518861+0000","last_unstale":"2024-09-12T01:36:12.546065+0000","last_undegraded":"2024-09-12T01:36:12.546065+0000","last_fullsized":"2024-09-12T01:36:12.546065+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:28.784023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":600,"num_write":435,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'466","reported_seq":1986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.491174+0000","last_change":"2024-09-12T00:25:02.477428+0000","last_active":"2024-09-12T01:35:23.491174+0000","last_peered":"2024-09-12T01:35:23.491174+0000","last_clean":"2024-09-12T01:35:23.491174+0000","last_became_active":"2024-09-12T00:25:02.477052+0000","last_became_peered":"2024-09-12T00:25:02.477052+0000","last_unstale":"2024-09-12T01:35:23.491174+0000","last_undegraded":"2024-09-12T01:35:23.491174+0000","last_fullsized":"2024-09-12T01:35:23.491174+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:47.054845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2388,"num_read_kb":2234,"num_write":549,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'224","reported_seq":877,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.855846+0000","last_change":"2024-09-12T01:37:47.855846+0000","last_active":"2024-09-12T01:37:47.855846+0000","last_peered":"2024-09-12T01:37:47.855846+0000","last_clean":"2024-09-12T01:37:47.855846+0000","last_became_active":"2024-09-12T00:25:00.457828+0000","last_became_peered":"2024-09-12T00:25:00.457828+0000","last_unstale":"2024-09-12T01:37:47.855846+0000","last_undegraded":"2024-09-12T01:37:47.855846+0000","last_fullsized":"2024-09-12T01:37:47.855846+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'224","last_scrub_stamp":"2024-09-12T01:37:47.855735+0000","last_deep_scrub":"266'224","last_deep_scrub_stamp":"2024-09-12T01:37:47.855735+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.855735+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:52.029177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":9782,"num_write":1039,"num_write_kb":35060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534518+0000","last_change":"2024-09-12T00:25:04.482494+0000","last_active":"2024-09-12T01:35:09.534518+0000","last_peered":"2024-09-12T01:35:09.534518+0000","last_clean":"2024-09-12T01:35:09.534518+0000","last_became_active":"2024-09-12T00:25:04.482173+0000","last_became_peered":"2024-09-12T00:25:04.482173+0000","last_unstale":"2024-09-12T01:35:09.534518+0000","last_undegraded":"2024-09-12T01:35:09.534518+0000","last_fullsized":"2024-09-12T01:35:09.534518+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:38.300401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'162","reported_seq":763,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.723613+0000","last_change":"2024-09-12T01:38:03.723613+0000","last_active":"2024-09-12T01:38:03.723613+0000","last_peered":"2024-09-12T01:38:03.723613+0000","last_clean":"2024-09-12T01:38:03.723613+0000","last_became_active":"2024-09-12T00:25:06.491337+0000","last_became_peered":"2024-09-12T00:25:06.491337+0000","last_unstale":"2024-09-12T01:38:03.723613+0000","last_undegraded":"2024-09-12T01:38:03.723613+0000","last_fullsized":"2024-09-12T01:38:03.723613+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'162","last_scrub_stamp":"2024-09-12T01:38:03.723515+0000","last_deep_scrub":"266'162","last_deep_scrub_stamp":"2024-09-12T01:38:03.723515+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.723515+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:22.002913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5611,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":280,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'801","reported_seq":2768,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.924992+0000","last_change":"2024-09-12T00:25:08.512430+0000","last_active":"2024-09-12T01:37:38.924992+0000","last_peered":"2024-09-12T01:37:38.924992+0000","last_clean":"2024-09-12T01:37:38.924992+0000","last_became_active":"2024-09-12T00:25:08.512125+0000","last_became_peered":"2024-09-12T00:25:08.512125+0000","last_unstale":"2024-09-12T01:37:38.924992+0000","last_undegraded":"2024-09-12T01:37:38.924992+0000","last_fullsized":"2024-09-12T01:37:38.924992+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:52.436088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'2026","reported_seq":3654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.975474+0000","last_change":"2024-09-12T01:38:02.975474+0000","last_active":"2024-09-12T01:38:02.975474+0000","last_peered":"2024-09-12T01:38:02.975474+0000","last_clean":"2024-09-12T01:38:02.975474+0000","last_became_active":"2024-09-12T00:25:02.465239+0000","last_became_peered":"2024-09-12T00:25:02.465239+0000","last_unstale":"2024-09-12T01:38:02.975474+0000","last_undegraded":"2024-09-12T01:38:02.975474+0000","last_fullsized":"2024-09-12T01:38:02.975474+0000","mapping_epoch":28,"log_start":"266'2000","ondisk_log_start":"266'2000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2026","last_scrub_stamp":"2024-09-12T01:38:02.975389+0000","last_deep_scrub":"266'2026","last_deep_scrub_stamp":"2024-09-12T01:38:02.975389+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.975389+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":2000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:35.114687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8773,"num_read_kb":7539,"num_write":2902,"num_write_kb":1299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":707,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'179","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.933037+0000","last_change":"2024-09-12T01:37:44.933037+0000","last_active":"2024-09-12T01:37:44.933037+0000","last_peered":"2024-09-12T01:37:44.933037+0000","last_clean":"2024-09-12T01:37:44.933037+0000","last_became_active":"2024-09-12T00:25:00.466899+0000","last_became_peered":"2024-09-12T00:25:00.466899+0000","last_unstale":"2024-09-12T01:37:44.933037+0000","last_undegraded":"2024-09-12T01:37:44.933037+0000","last_fullsized":"2024-09-12T01:37:44.933037+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'179","last_scrub_stamp":"2024-09-12T01:37:44.932938+0000","last_deep_scrub":"266'179","last_deep_scrub_stamp":"2024-09-12T01:37:44.932938+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.932938+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:07.942233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":366,"num_read_kb":8806,"num_write":851,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.916231+0000","last_change":"2024-09-12T01:37:57.916231+0000","last_active":"2024-09-12T01:37:57.916231+0000","last_peered":"2024-09-12T01:37:57.916231+0000","last_clean":"2024-09-12T01:37:57.916231+0000","last_became_active":"2024-09-12T00:25:04.482885+0000","last_became_peered":"2024-09-12T00:25:04.482885+0000","last_unstale":"2024-09-12T01:37:57.916231+0000","last_undegraded":"2024-09-12T01:37:57.916231+0000","last_fullsized":"2024-09-12T01:37:57.916231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:57.916140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:57.916140+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.916140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:21.912079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'273","reported_seq":934,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.883497+0000","last_change":"2024-09-12T01:38:03.883497+0000","last_active":"2024-09-12T01:38:03.883497+0000","last_peered":"2024-09-12T01:38:03.883497+0000","last_clean":"2024-09-12T01:38:03.883497+0000","last_became_active":"2024-09-12T00:25:06.497881+0000","last_became_peered":"2024-09-12T00:25:06.497881+0000","last_unstale":"2024-09-12T01:38:03.883497+0000","last_undegraded":"2024-09-12T01:38:03.883497+0000","last_fullsized":"2024-09-12T01:38:03.883497+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'273","last_scrub_stamp":"2024-09-12T01:38:03.883401+0000","last_deep_scrub":"266'273","last_deep_scrub_stamp":"2024-09-12T01:38:03.883401+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.883401+0000","objects_scrubbed":10,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:36.967915+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20748,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":371,"num_read_kb":470,"num_write":222,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:54.178342+0000","last_change":"2024-09-12T00:25:08.508274+0000","last_active":"2024-09-12T01:34:54.178342+0000","last_peered":"2024-09-12T01:34:54.178342+0000","last_clean":"2024-09-12T01:34:54.178342+0000","last_became_active":"2024-09-12T00:25:08.507993+0000","last_became_peered":"2024-09-12T00:25:08.507993+0000","last_unstale":"2024-09-12T01:34:54.178342+0000","last_undegraded":"2024-09-12T01:34:54.178342+0000","last_fullsized":"2024-09-12T01:34:54.178342+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:26.028970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'572","reported_seq":1418,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.571643+0000","last_change":"2024-09-12T00:25:10.528237+0000","last_active":"2024-09-12T01:37:19.571643+0000","last_peered":"2024-09-12T01:37:19.571643+0000","last_clean":"2024-09-12T01:37:19.571643+0000","last_became_active":"2024-09-12T00:25:10.528021+0000","last_became_peered":"2024-09-12T00:25:10.528021+0000","last_unstale":"2024-09-12T01:37:19.571643+0000","last_undegraded":"2024-09-12T01:37:19.571643+0000","last_fullsized":"2024-09-12T01:37:19.571643+0000","mapping_epoch":36,"log_start":"266'500","ondisk_log_start":"266'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":500,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1390,"num_read_kb":1363,"num_write":1223,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'495","reported_seq":2164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.900930+0000","last_change":"2024-09-12T01:37:49.900930+0000","last_active":"2024-09-12T01:37:49.900930+0000","last_peered":"2024-09-12T01:37:49.900930+0000","last_clean":"2024-09-12T01:37:49.900930+0000","last_became_active":"2024-09-12T00:25:02.467846+0000","last_became_peered":"2024-09-12T00:25:02.467846+0000","last_unstale":"2024-09-12T01:37:49.900930+0000","last_undegraded":"2024-09-12T01:37:49.900930+0000","last_fullsized":"2024-09-12T01:37:49.900930+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'495","last_scrub_stamp":"2024-09-12T01:37:49.900834+0000","last_deep_scrub":"266'495","last_deep_scrub_stamp":"2024-09-12T01:37:49.900834+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.900834+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.878364+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2600,"num_read_kb":2447,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'208","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.530686+0000","last_change":"2024-09-12T01:37:44.530686+0000","last_active":"2024-09-12T01:37:44.530686+0000","last_peered":"2024-09-12T01:37:44.530686+0000","last_clean":"2024-09-12T01:37:44.530686+0000","last_became_active":"2024-09-12T00:25:00.486471+0000","last_became_peered":"2024-09-12T00:25:00.486471+0000","last_unstale":"2024-09-12T01:37:44.530686+0000","last_undegraded":"2024-09-12T01:37:44.530686+0000","last_fullsized":"2024-09-12T01:37:44.530686+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:37:44.530555+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:37:44.530555+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.530555+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.391104+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706427,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":18784,"num_write":969,"num_write_kb":38470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.372242+0000","last_change":"2024-09-12T01:38:00.372242+0000","last_active":"2024-09-12T01:38:00.372242+0000","last_peered":"2024-09-12T01:38:00.372242+0000","last_clean":"2024-09-12T01:38:00.372242+0000","last_became_active":"2024-09-12T00:25:04.480469+0000","last_became_peered":"2024-09-12T00:25:04.480469+0000","last_unstale":"2024-09-12T01:38:00.372242+0000","last_undegraded":"2024-09-12T01:38:00.372242+0000","last_fullsized":"2024-09-12T01:38:00.372242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.372086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.372086+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.372086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:46.172826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'148","reported_seq":748,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.823722+0000","last_change":"2024-09-12T00:25:06.500291+0000","last_active":"2024-09-12T01:37:38.823722+0000","last_peered":"2024-09-12T01:37:38.823722+0000","last_clean":"2024-09-12T01:37:38.823722+0000","last_became_active":"2024-09-12T00:25:06.500036+0000","last_became_peered":"2024-09-12T00:25:06.500036+0000","last_unstale":"2024-09-12T01:37:38.823722+0000","last_undegraded":"2024-09-12T01:37:38.823722+0000","last_fullsized":"2024-09-12T01:37:38.823722+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:40.715748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11217,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":248,"num_write":100,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:42.248759+0000","last_change":"2024-09-12T00:25:08.510086+0000","last_active":"2024-09-12T01:34:42.248759+0000","last_peered":"2024-09-12T01:34:42.248759+0000","last_clean":"2024-09-12T01:34:42.248759+0000","last_became_active":"2024-09-12T00:25:08.509780+0000","last_became_peered":"2024-09-12T00:25:08.509780+0000","last_unstale":"2024-09-12T01:34:42.248759+0000","last_undegraded":"2024-09-12T01:34:42.248759+0000","last_fullsized":"2024-09-12T01:34:42.248759+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:23.294463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'144","reported_seq":649,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:14.095922+0000","last_change":"2024-09-12T00:25:10.528275+0000","last_active":"2024-09-12T01:36:14.095922+0000","last_peered":"2024-09-12T01:36:14.095922+0000","last_clean":"2024-09-12T01:36:14.095922+0000","last_became_active":"2024-09-12T00:25:10.527984+0000","last_became_peered":"2024-09-12T00:25:10.527984+0000","last_unstale":"2024-09-12T01:36:14.095922+0000","last_undegraded":"2024-09-12T01:36:14.095922+0000","last_fullsized":"2024-09-12T01:36:14.095922+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:34:42.118932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":124,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'456","reported_seq":2027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.745822+0000","last_change":"2024-09-12T01:37:53.745822+0000","last_active":"2024-09-12T01:37:53.745822+0000","last_peered":"2024-09-12T01:37:53.745822+0000","last_clean":"2024-09-12T01:37:53.745822+0000","last_became_active":"2024-09-12T00:25:02.469155+0000","last_became_peered":"2024-09-12T00:25:02.469155+0000","last_unstale":"2024-09-12T01:37:53.745822+0000","last_undegraded":"2024-09-12T01:37:53.745822+0000","last_fullsized":"2024-09-12T01:37:53.745822+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T01:37:53.745726+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T01:37:53.745726+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.745726+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:07.128486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2451,"num_write":541,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2546,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'226","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.078785+0000","last_change":"2024-09-12T01:37:52.078785+0000","last_active":"2024-09-12T01:37:52.078785+0000","last_peered":"2024-09-12T01:37:52.078785+0000","last_clean":"2024-09-12T01:37:52.078785+0000","last_became_active":"2024-09-12T00:25:32.563811+0000","last_became_peered":"2024-09-12T00:25:32.563811+0000","last_unstale":"2024-09-12T01:37:52.078785+0000","last_undegraded":"2024-09-12T01:37:52.078785+0000","last_fullsized":"2024-09-12T01:37:52.078785+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:37:52.078628+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:37:52.078628+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.078628+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:10.725907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442172,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":15150,"num_write":1090,"num_write_kb":21884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:48.998771+0000","last_change":"2024-09-12T00:25:04.484649+0000","last_active":"2024-09-12T01:34:48.998771+0000","last_peered":"2024-09-12T01:34:48.998771+0000","last_clean":"2024-09-12T01:34:48.998771+0000","last_became_active":"2024-09-12T00:25:04.484029+0000","last_became_peered":"2024-09-12T00:25:04.484029+0000","last_unstale":"2024-09-12T01:34:48.998771+0000","last_undegraded":"2024-09-12T01:34:48.998771+0000","last_fullsized":"2024-09-12T01:34:48.998771+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:58:29.267578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'217","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.698221+0000","last_change":"2024-09-12T00:25:06.496644+0000","last_active":"2024-09-12T01:37:38.698221+0000","last_peered":"2024-09-12T01:37:38.698221+0000","last_clean":"2024-09-12T01:37:38.698221+0000","last_became_active":"2024-09-12T00:25:06.496348+0000","last_became_peered":"2024-09-12T00:25:06.496348+0000","last_unstale":"2024-09-12T01:37:38.698221+0000","last_undegraded":"2024-09-12T01:37:38.698221+0000","last_fullsized":"2024-09-12T01:37:38.698221+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":200,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:12.917394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22554,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":293,"num_read_kb":420,"num_write":176,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'800","reported_seq":4588,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.531846+0000","last_change":"2024-09-12T00:25:08.512365+0000","last_active":"2024-09-12T01:37:38.531846+0000","last_peered":"2024-09-12T01:37:38.531846+0000","last_clean":"2024-09-12T01:37:38.531846+0000","last_became_active":"2024-09-12T00:25:08.512086+0000","last_became_peered":"2024-09-12T00:25:08.512086+0000","last_unstale":"2024-09-12T01:37:38.531846+0000","last_undegraded":"2024-09-12T01:37:38.531846+0000","last_fullsized":"2024-09-12T01:37:38.531846+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":700,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:45.064721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'130","reported_seq":630,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.246800+0000","last_change":"2024-09-12T00:25:10.521608+0000","last_active":"2024-09-12T01:37:18.246800+0000","last_peered":"2024-09-12T01:37:18.246800+0000","last_clean":"2024-09-12T01:37:18.246800+0000","last_became_active":"2024-09-12T00:25:10.521322+0000","last_became_peered":"2024-09-12T00:25:10.521322+0000","last_unstale":"2024-09-12T01:37:18.246800+0000","last_undegraded":"2024-09-12T01:37:18.246800+0000","last_fullsized":"2024-09-12T01:37:18.246800+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:02.501352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":104,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'397","reported_seq":1849,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.583073+0000","last_change":"2024-09-12T01:38:00.583073+0000","last_active":"2024-09-12T01:38:00.583073+0000","last_peered":"2024-09-12T01:38:00.583073+0000","last_clean":"2024-09-12T01:38:00.583073+0000","last_became_active":"2024-09-12T00:25:02.468609+0000","last_became_peered":"2024-09-12T00:25:02.468609+0000","last_unstale":"2024-09-12T01:38:00.583073+0000","last_undegraded":"2024-09-12T01:38:00.583073+0000","last_fullsized":"2024-09-12T01:38:00.583073+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'397","last_scrub_stamp":"2024-09-12T01:38:00.582971+0000","last_deep_scrub":"266'397","last_deep_scrub_stamp":"2024-09-12T01:38:00.582971+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.582971+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:02.412743+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2038,"num_read_kb":1930,"num_write":430,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'219","reported_seq":978,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.965862+0000","last_change":"2024-09-12T01:37:43.965862+0000","last_active":"2024-09-12T01:37:43.965862+0000","last_peered":"2024-09-12T01:37:43.965862+0000","last_clean":"2024-09-12T01:37:43.965862+0000","last_became_active":"2024-09-12T00:25:00.472065+0000","last_became_peered":"2024-09-12T00:25:00.472065+0000","last_unstale":"2024-09-12T01:37:43.965862+0000","last_undegraded":"2024-09-12T01:37:43.965862+0000","last_fullsized":"2024-09-12T01:37:43.965862+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'219","last_scrub_stamp":"2024-09-12T01:37:43.965697+0000","last_deep_scrub":"266'219","last_deep_scrub_stamp":"2024-09-12T01:37:43.965697+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.965697+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:29.632688+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9573531,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1000,"num_read_kb":31471,"num_write":994,"num_write_kb":39869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"266'5","reported_seq":986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.364416+0000","last_change":"2024-09-12T01:38:01.364416+0000","last_active":"2024-09-12T01:38:01.364416+0000","last_peered":"2024-09-12T01:38:01.364416+0000","last_clean":"2024-09-12T01:38:01.364416+0000","last_became_active":"2024-09-12T00:25:04.482518+0000","last_became_peered":"2024-09-12T00:25:04.482518+0000","last_unstale":"2024-09-12T01:38:01.364416+0000","last_undegraded":"2024-09-12T01:38:01.364416+0000","last_fullsized":"2024-09-12T01:38:01.364416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:01.364313+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:01.364313+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.364313+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.761280+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'224","reported_seq":892,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.850805+0000","last_change":"2024-09-12T00:25:06.497612+0000","last_active":"2024-09-12T01:37:38.850805+0000","last_peered":"2024-09-12T01:37:38.850805+0000","last_clean":"2024-09-12T01:37:38.850805+0000","last_became_active":"2024-09-12T00:25:06.497269+0000","last_became_peered":"2024-09-12T00:25:06.497269+0000","last_unstale":"2024-09-12T01:37:38.850805+0000","last_undegraded":"2024-09-12T01:37:38.850805+0000","last_fullsized":"2024-09-12T01:37:38.850805+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:15.450749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14775,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":319,"num_read_kb":439,"num_write":162,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:28.995211+0000","last_change":"2024-09-12T00:25:08.514101+0000","last_active":"2024-09-12T01:34:28.995211+0000","last_peered":"2024-09-12T01:34:28.995211+0000","last_clean":"2024-09-12T01:34:28.995211+0000","last_became_active":"2024-09-12T00:25:08.513758+0000","last_became_peered":"2024-09-12T00:25:08.513758+0000","last_unstale":"2024-09-12T01:34:28.995211+0000","last_undegraded":"2024-09-12T01:34:28.995211+0000","last_fullsized":"2024-09-12T01:34:28.995211+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:44.229276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'131","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.673372+0000","last_change":"2024-09-12T00:25:10.525073+0000","last_active":"2024-09-12T01:36:07.673372+0000","last_peered":"2024-09-12T01:36:07.673372+0000","last_clean":"2024-09-12T01:36:07.673372+0000","last_became_active":"2024-09-12T00:25:10.524500+0000","last_became_peered":"2024-09-12T00:25:10.524500+0000","last_unstale":"2024-09-12T01:36:07.673372+0000","last_undegraded":"2024-09-12T01:36:07.673372+0000","last_fullsized":"2024-09-12T01:36:07.673372+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:33.151875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":199,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'395","reported_seq":2036,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.771482+0000","last_change":"2024-09-12T01:37:57.771482+0000","last_active":"2024-09-12T01:37:57.771482+0000","last_peered":"2024-09-12T01:37:57.771482+0000","last_clean":"2024-09-12T01:37:57.771482+0000","last_became_active":"2024-09-12T00:25:02.476549+0000","last_became_peered":"2024-09-12T00:25:02.476549+0000","last_unstale":"2024-09-12T01:37:57.771482+0000","last_undegraded":"2024-09-12T01:37:57.771482+0000","last_fullsized":"2024-09-12T01:37:57.771482+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'395","last_scrub_stamp":"2024-09-12T01:37:57.771387+0000","last_deep_scrub":"266'395","last_deep_scrub_stamp":"2024-09-12T01:37:57.771387+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.771387+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:48.184452+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2368,"num_read_kb":2274,"num_write":449,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2987,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'195","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.440332+0000","last_change":"2024-09-12T01:37:48.440332+0000","last_active":"2024-09-12T01:37:48.440332+0000","last_peered":"2024-09-12T01:37:48.440332+0000","last_clean":"2024-09-12T01:37:48.440332+0000","last_became_active":"2024-09-12T00:25:00.471314+0000","last_became_peered":"2024-09-12T00:25:00.471314+0000","last_unstale":"2024-09-12T01:37:48.440332+0000","last_undegraded":"2024-09-12T01:37:48.440332+0000","last_fullsized":"2024-09-12T01:37:48.440332+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'195","last_scrub_stamp":"2024-09-12T01:37:48.440227+0000","last_deep_scrub":"266'195","last_deep_scrub_stamp":"2024-09-12T01:37:48.440227+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.440227+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:08.826724+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190278,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":11373,"num_write":891,"num_write_kb":19982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.455784+0000","last_change":"2024-09-12T01:37:59.455784+0000","last_active":"2024-09-12T01:37:59.455784+0000","last_peered":"2024-09-12T01:37:59.455784+0000","last_clean":"2024-09-12T01:37:59.455784+0000","last_became_active":"2024-09-12T00:25:04.486111+0000","last_became_peered":"2024-09-12T00:25:04.486111+0000","last_unstale":"2024-09-12T01:37:59.455784+0000","last_undegraded":"2024-09-12T01:37:59.455784+0000","last_fullsized":"2024-09-12T01:37:59.455784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:59.455680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:59.455680+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.455680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:07.373369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'208","reported_seq":820,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.785612+0000","last_change":"2024-09-12T01:38:02.785612+0000","last_active":"2024-09-12T01:38:02.785612+0000","last_peered":"2024-09-12T01:38:02.785612+0000","last_clean":"2024-09-12T01:38:02.785612+0000","last_became_active":"2024-09-12T00:25:06.497247+0000","last_became_peered":"2024-09-12T00:25:06.497247+0000","last_unstale":"2024-09-12T01:38:02.785612+0000","last_undegraded":"2024-09-12T01:38:02.785612+0000","last_fullsized":"2024-09-12T01:38:02.785612+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:38:02.785506+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:38:02.785506+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.785506+0000","objects_scrubbed":7,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:48.928001+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":347,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.405837+0000","last_change":"2024-09-12T01:38:04.405837+0000","last_active":"2024-09-12T01:38:04.405837+0000","last_peered":"2024-09-12T01:38:04.405837+0000","last_clean":"2024-09-12T01:38:04.405837+0000","last_became_active":"2024-09-12T00:25:08.516949+0000","last_became_peered":"2024-09-12T00:25:08.516949+0000","last_unstale":"2024-09-12T01:38:04.405837+0000","last_undegraded":"2024-09-12T01:38:04.405837+0000","last_fullsized":"2024-09-12T01:38:04.405837+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:04.405722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:04.405722+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.405722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'123","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:08.018005+0000","last_change":"2024-09-12T00:25:10.531019+0000","last_active":"2024-09-12T01:37:08.018005+0000","last_peered":"2024-09-12T01:37:08.018005+0000","last_clean":"2024-09-12T01:37:08.018005+0000","last_became_active":"2024-09-12T00:25:10.530731+0000","last_became_peered":"2024-09-12T00:25:10.530731+0000","last_unstale":"2024-09-12T01:37:08.018005+0000","last_undegraded":"2024-09-12T01:37:08.018005+0000","last_fullsized":"2024-09-12T01:37:08.018005+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:52.713991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":124,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'668","reported_seq":2312,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.971255+0000","last_change":"2024-09-12T01:38:03.971255+0000","last_active":"2024-09-12T01:38:03.971255+0000","last_peered":"2024-09-12T01:38:03.971255+0000","last_clean":"2024-09-12T01:38:03.971255+0000","last_became_active":"2024-09-12T00:25:02.474113+0000","last_became_peered":"2024-09-12T00:25:02.474113+0000","last_unstale":"2024-09-12T01:38:03.971255+0000","last_undegraded":"2024-09-12T01:38:03.971255+0000","last_fullsized":"2024-09-12T01:38:03.971255+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'668","last_scrub_stamp":"2024-09-12T01:38:03.971165+0000","last_deep_scrub":"266'668","last_deep_scrub_stamp":"2024-09-12T01:38:03.971165+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.971165+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:26.531769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3250,"num_read_kb":2990,"num_write":879,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'185","reported_seq":905,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.071985+0000","last_change":"2024-09-12T01:37:50.071985+0000","last_active":"2024-09-12T01:37:50.071985+0000","last_peered":"2024-09-12T01:37:50.071985+0000","last_clean":"2024-09-12T01:37:50.071985+0000","last_became_active":"2024-09-12T00:25:32.562005+0000","last_became_peered":"2024-09-12T00:25:32.562005+0000","last_unstale":"2024-09-12T01:37:50.071985+0000","last_undegraded":"2024-09-12T01:37:50.071985+0000","last_fullsized":"2024-09-12T01:37:50.071985+0000","mapping_epoch":39,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:50.071880+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:50.071880+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.071880+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:27.878944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568762,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":135425,"num_write":898,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:48.998802+0000","last_change":"2024-09-12T00:25:04.483049+0000","last_active":"2024-09-12T01:34:48.998802+0000","last_peered":"2024-09-12T01:34:48.998802+0000","last_clean":"2024-09-12T01:34:48.998802+0000","last_became_active":"2024-09-12T00:25:04.482744+0000","last_became_peered":"2024-09-12T00:25:04.482744+0000","last_unstale":"2024-09-12T01:34:48.998802+0000","last_undegraded":"2024-09-12T01:34:48.998802+0000","last_fullsized":"2024-09-12T01:34:48.998802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:16.996020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'192","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.788049+0000","last_change":"2024-09-12T00:25:06.497726+0000","last_active":"2024-09-12T01:37:38.788049+0000","last_peered":"2024-09-12T01:37:38.788049+0000","last_clean":"2024-09-12T01:37:38.788049+0000","last_became_active":"2024-09-12T00:25:06.497448+0000","last_became_peered":"2024-09-12T00:25:06.497448+0000","last_unstale":"2024-09-12T01:37:38.788049+0000","last_undegraded":"2024-09-12T01:37:38.788049+0000","last_fullsized":"2024-09-12T01:37:38.788049+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:20.638948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":247,"num_read_kb":253,"num_write":136,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'764","reported_seq":2721,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.526972+0000","last_change":"2024-09-12T00:25:08.510452+0000","last_active":"2024-09-12T01:37:38.526972+0000","last_peered":"2024-09-12T01:37:38.526972+0000","last_clean":"2024-09-12T01:37:38.526972+0000","last_became_active":"2024-09-12T00:25:08.510134+0000","last_became_peered":"2024-09-12T00:25:08.510134+0000","last_unstale":"2024-09-12T01:37:38.526972+0000","last_undegraded":"2024-09-12T01:37:38.526972+0000","last_fullsized":"2024-09-12T01:37:38.526972+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:11.026047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'125","reported_seq":627,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.054270+0000","last_change":"2024-09-12T00:25:10.522261+0000","last_active":"2024-09-12T01:36:09.054270+0000","last_peered":"2024-09-12T01:36:09.054270+0000","last_clean":"2024-09-12T01:36:09.054270+0000","last_became_active":"2024-09-12T00:25:10.521992+0000","last_became_peered":"2024-09-12T00:25:10.521992+0000","last_unstale":"2024-09-12T01:36:09.054270+0000","last_undegraded":"2024-09-12T01:36:09.054270+0000","last_fullsized":"2024-09-12T01:36:09.054270+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:39.515026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":300,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1939,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.708159+0000","last_change":"2024-09-12T01:37:52.708159+0000","last_active":"2024-09-12T01:37:52.708159+0000","last_peered":"2024-09-12T01:37:52.708159+0000","last_clean":"2024-09-12T01:37:52.708159+0000","last_became_active":"2024-09-12T00:25:02.468401+0000","last_became_peered":"2024-09-12T00:25:02.468401+0000","last_unstale":"2024-09-12T01:37:52.708159+0000","last_undegraded":"2024-09-12T01:37:52.708159+0000","last_fullsized":"2024-09-12T01:37:52.708159+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T01:37:52.708072+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T01:37:52.708072+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.708072+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.220170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2162,"num_read_kb":2053,"num_write":481,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'266","reported_seq":944,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.032506+0000","last_change":"2024-09-12T01:37:57.032506+0000","last_active":"2024-09-12T01:37:57.032506+0000","last_peered":"2024-09-12T01:37:57.032506+0000","last_clean":"2024-09-12T01:37:57.032506+0000","last_became_active":"2024-09-12T00:25:00.474471+0000","last_became_peered":"2024-09-12T00:25:00.474471+0000","last_unstale":"2024-09-12T01:37:57.032506+0000","last_undegraded":"2024-09-12T01:37:57.032506+0000","last_fullsized":"2024-09-12T01:37:57.032506+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'266","last_scrub_stamp":"2024-09-12T01:37:57.032348+0000","last_deep_scrub":"266'266","last_deep_scrub_stamp":"2024-09-12T01:37:57.032348+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.032348+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:38.613541+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2612534,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":560,"num_read_kb":17654,"num_write":1154,"num_write_kb":37946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"266'4","reported_seq":1463,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.871477+0000","last_change":"2024-09-12T01:37:58.871477+0000","last_active":"2024-09-12T01:37:58.871477+0000","last_peered":"2024-09-12T01:37:58.871477+0000","last_clean":"2024-09-12T01:37:58.871477+0000","last_became_active":"2024-09-12T00:25:04.482824+0000","last_became_peered":"2024-09-12T00:25:04.482824+0000","last_unstale":"2024-09-12T01:37:58.871477+0000","last_undegraded":"2024-09-12T01:37:58.871477+0000","last_fullsized":"2024-09-12T01:37:58.871477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:37:58.871389+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:37:58.871389+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.871389+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:22.816712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":942,"num_read_kb":942,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'103","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:51.535072+0000","last_change":"2024-09-12T00:25:06.500248+0000","last_active":"2024-09-12T01:35:51.535072+0000","last_peered":"2024-09-12T01:35:51.535072+0000","last_clean":"2024-09-12T01:35:51.535072+0000","last_became_active":"2024-09-12T00:25:06.499937+0000","last_became_peered":"2024-09-12T00:25:06.499937+0000","last_unstale":"2024-09-12T01:35:51.535072+0000","last_undegraded":"2024-09-12T01:35:51.535072+0000","last_fullsized":"2024-09-12T01:35:51.535072+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:31.323131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'774","reported_seq":2632,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.527952+0000","last_change":"2024-09-12T00:25:08.502922+0000","last_active":"2024-09-12T01:37:38.527952+0000","last_peered":"2024-09-12T01:37:38.527952+0000","last_clean":"2024-09-12T01:37:38.527952+0000","last_became_active":"2024-09-12T00:25:08.501192+0000","last_became_peered":"2024-09-12T00:25:08.501192+0000","last_unstale":"2024-09-12T01:37:38.527952+0000","last_undegraded":"2024-09-12T01:37:38.527952+0000","last_fullsized":"2024-09-12T01:37:38.527952+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:55.381458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'106","reported_seq":612,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:00.093860+0000","last_change":"2024-09-12T00:25:10.524909+0000","last_active":"2024-09-12T01:36:00.093860+0000","last_peered":"2024-09-12T01:36:00.093860+0000","last_clean":"2024-09-12T01:36:00.093860+0000","last_became_active":"2024-09-12T00:25:10.524610+0000","last_became_peered":"2024-09-12T00:25:10.524610+0000","last_unstale":"2024-09-12T01:36:00.093860+0000","last_undegraded":"2024-09-12T01:36:00.093860+0000","last_fullsized":"2024-09-12T01:36:00.093860+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'791","reported_seq":2446,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.447463+0000","last_change":"2024-09-12T01:37:50.447463+0000","last_active":"2024-09-12T01:37:50.447463+0000","last_peered":"2024-09-12T01:37:50.447463+0000","last_clean":"2024-09-12T01:37:50.447463+0000","last_became_active":"2024-09-12T00:25:02.478793+0000","last_became_peered":"2024-09-12T00:25:02.478793+0000","last_unstale":"2024-09-12T01:37:50.447463+0000","last_undegraded":"2024-09-12T01:37:50.447463+0000","last_fullsized":"2024-09-12T01:37:50.447463+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'791","last_scrub_stamp":"2024-09-12T01:37:50.447358+0000","last_deep_scrub":"266'791","last_deep_scrub_stamp":"2024-09-12T01:37:50.447358+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.447358+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:46.059048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3638,"num_write":1039,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'228","reported_seq":953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.371550+0000","last_change":"2024-09-12T01:37:49.371550+0000","last_active":"2024-09-12T01:37:49.371550+0000","last_peered":"2024-09-12T01:37:49.371550+0000","last_clean":"2024-09-12T01:37:49.371550+0000","last_became_active":"2024-09-12T00:25:32.561102+0000","last_became_peered":"2024-09-12T00:25:32.561102+0000","last_unstale":"2024-09-12T01:37:49.371550+0000","last_undegraded":"2024-09-12T01:37:49.371550+0000","last_fullsized":"2024-09-12T01:37:49.371550+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'228","last_scrub_stamp":"2024-09-12T01:37:49.371405+0000","last_deep_scrub":"266'228","last_deep_scrub_stamp":"2024-09-12T01:37:49.371405+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.371405+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:27.224790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":554,"num_read_kb":71561,"num_write":1047,"num_write_kb":46306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6,0],"acting":[4,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:49.532031+0000","last_change":"2024-09-12T00:25:04.484834+0000","last_active":"2024-09-12T01:34:49.532031+0000","last_peered":"2024-09-12T01:34:49.532031+0000","last_clean":"2024-09-12T01:34:49.532031+0000","last_became_active":"2024-09-12T00:25:04.484543+0000","last_became_peered":"2024-09-12T00:25:04.484543+0000","last_unstale":"2024-09-12T01:34:49.532031+0000","last_undegraded":"2024-09-12T01:34:49.532031+0000","last_fullsized":"2024-09-12T01:34:49.532031+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:42.025957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'313","reported_seq":959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.822832+0000","last_change":"2024-09-12T01:38:01.822832+0000","last_active":"2024-09-12T01:38:01.822832+0000","last_peered":"2024-09-12T01:38:01.822832+0000","last_clean":"2024-09-12T01:38:01.822832+0000","last_became_active":"2024-09-12T00:25:06.496949+0000","last_became_peered":"2024-09-12T00:25:06.496949+0000","last_unstale":"2024-09-12T01:38:01.822832+0000","last_undegraded":"2024-09-12T01:38:01.822832+0000","last_fullsized":"2024-09-12T01:38:01.822832+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'313","last_scrub_stamp":"2024-09-12T01:38:01.822725+0000","last_deep_scrub":"266'313","last_deep_scrub_stamp":"2024-09-12T01:38:01.822725+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.822725+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:53.190581+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9140,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1014,"num_read_kb":1082,"num_write":1556,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487892,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:55.086981+0000","last_change":"2024-09-12T00:25:08.511378+0000","last_active":"2024-09-12T01:34:55.086981+0000","last_peered":"2024-09-12T01:34:55.086981+0000","last_clean":"2024-09-12T01:34:55.086981+0000","last_became_active":"2024-09-12T00:25:08.511103+0000","last_became_peered":"2024-09-12T00:25:08.511103+0000","last_unstale":"2024-09-12T01:34:55.086981+0000","last_undegraded":"2024-09-12T01:34:55.086981+0000","last_fullsized":"2024-09-12T01:34:55.086981+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:15.770737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'155","reported_seq":659,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:02.023949+0000","last_change":"2024-09-12T00:25:10.524712+0000","last_active":"2024-09-12T01:35:02.023949+0000","last_peered":"2024-09-12T01:35:02.023949+0000","last_clean":"2024-09-12T01:35:02.023949+0000","last_became_active":"2024-09-12T00:25:10.524399+0000","last_became_peered":"2024-09-12T00:25:10.524399+0000","last_unstale":"2024-09-12T01:35:02.023949+0000","last_undegraded":"2024-09-12T01:35:02.023949+0000","last_fullsized":"2024-09-12T01:35:02.023949+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:02.179754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":348,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'526","reported_seq":2120,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.008055+0000","last_change":"2024-09-12T01:38:02.007992+0000","last_active":"2024-09-12T01:38:02.008055+0000","last_peered":"2024-09-12T01:38:02.008055+0000","last_clean":"2024-09-12T01:38:02.008055+0000","last_became_active":"2024-09-12T00:25:02.470508+0000","last_became_peered":"2024-09-12T00:25:02.470508+0000","last_unstale":"2024-09-12T01:38:02.008055+0000","last_undegraded":"2024-09-12T01:38:02.008055+0000","last_fullsized":"2024-09-12T01:38:02.008055+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'526","last_scrub_stamp":"2024-09-12T01:38:02.007907+0000","last_deep_scrub":"266'526","last_deep_scrub_stamp":"2024-09-12T01:38:02.007907+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.007907+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:07.439245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2852,"num_read_kb":2640,"num_write":653,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.840458+0000","last_change":"2024-09-12T01:37:43.840458+0000","last_active":"2024-09-12T01:37:43.840458+0000","last_peered":"2024-09-12T01:37:43.840458+0000","last_clean":"2024-09-12T01:37:43.840458+0000","last_became_active":"2024-09-12T00:24:40.255060+0000","last_became_peered":"2024-09-12T00:24:40.255060+0000","last_unstale":"2024-09-12T01:37:43.840458+0000","last_undegraded":"2024-09-12T01:37:43.840458+0000","last_fullsized":"2024-09-12T01:37:43.840458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T01:37:43.840360+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T01:37:43.840360+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.840360+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:24.816378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":545,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.023075+0000","last_change":"2024-09-12T01:37:47.023075+0000","last_active":"2024-09-12T01:37:47.023075+0000","last_peered":"2024-09-12T01:37:47.023075+0000","last_clean":"2024-09-12T01:37:47.023075+0000","last_became_active":"2024-09-12T00:24:46.449286+0000","last_became_peered":"2024-09-12T00:24:46.449286+0000","last_unstale":"2024-09-12T01:37:47.023075+0000","last_undegraded":"2024-09-12T01:37:47.023075+0000","last_fullsized":"2024-09-12T01:37:47.023075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:37:47.022957+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:37:47.022957+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.022957+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:19.767332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001069263,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'200","reported_seq":835,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.350405+0000","last_change":"2024-09-12T01:37:46.350307+0000","last_active":"2024-09-12T01:37:46.350405+0000","last_peered":"2024-09-12T01:37:46.350405+0000","last_clean":"2024-09-12T01:37:46.350405+0000","last_became_active":"2024-09-12T00:25:00.465691+0000","last_became_peered":"2024-09-12T00:25:00.465691+0000","last_unstale":"2024-09-12T01:37:46.350405+0000","last_undegraded":"2024-09-12T01:37:46.350405+0000","last_fullsized":"2024-09-12T01:37:46.350405+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'200","last_scrub_stamp":"2024-09-12T01:37:46.350175+0000","last_deep_scrub":"266'200","last_deep_scrub_stamp":"2024-09-12T01:37:46.350175+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.350175+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:03.453089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262165,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":3125,"num_write":969,"num_write_kb":16262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.872809+0000","last_change":"2024-09-12T01:38:01.872809+0000","last_active":"2024-09-12T01:38:01.872809+0000","last_peered":"2024-09-12T01:38:01.872809+0000","last_clean":"2024-09-12T01:38:01.872809+0000","last_became_active":"2024-09-12T00:25:04.483893+0000","last_became_peered":"2024-09-12T00:25:04.483893+0000","last_unstale":"2024-09-12T01:38:01.872809+0000","last_undegraded":"2024-09-12T01:38:01.872809+0000","last_fullsized":"2024-09-12T01:38:01.872809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:01.872703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:01.872703+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.872703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:44.504728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'334","reported_seq":1057,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.767482+0000","last_change":"2024-09-12T00:25:06.497651+0000","last_active":"2024-09-12T01:37:38.767482+0000","last_peered":"2024-09-12T01:37:38.767482+0000","last_clean":"2024-09-12T01:37:38.767482+0000","last_became_active":"2024-09-12T00:25:06.497261+0000","last_became_peered":"2024-09-12T00:25:06.497261+0000","last_unstale":"2024-09-12T01:37:38.767482+0000","last_undegraded":"2024-09-12T01:37:38.767482+0000","last_fullsized":"2024-09-12T01:37:38.767482+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:29.074252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36159,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":620,"num_read_kb":873,"num_write":540,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:28.995333+0000","last_change":"2024-09-12T00:25:08.509443+0000","last_active":"2024-09-12T01:34:28.995333+0000","last_peered":"2024-09-12T01:34:28.995333+0000","last_clean":"2024-09-12T01:34:28.995333+0000","last_became_active":"2024-09-12T00:25:08.509183+0000","last_became_peered":"2024-09-12T00:25:08.509183+0000","last_unstale":"2024-09-12T01:34:28.995333+0000","last_undegraded":"2024-09-12T01:34:28.995333+0000","last_fullsized":"2024-09-12T01:34:28.995333+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:07.848867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'216","reported_seq":927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.368080+0000","last_change":"2024-09-12T00:25:10.525926+0000","last_active":"2024-09-12T01:36:12.368080+0000","last_peered":"2024-09-12T01:36:12.368080+0000","last_clean":"2024-09-12T01:36:12.368080+0000","last_became_active":"2024-09-12T00:25:10.525441+0000","last_became_peered":"2024-09-12T00:25:10.525441+0000","last_unstale":"2024-09-12T01:36:12.368080+0000","last_undegraded":"2024-09-12T01:36:12.368080+0000","last_fullsized":"2024-09-12T01:36:12.368080+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:21.545364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":453,"num_read_kb":448,"num_write":488,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'808","reported_seq":2399,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.602855+0000","last_change":"2024-09-12T01:37:59.602855+0000","last_active":"2024-09-12T01:37:59.602855+0000","last_peered":"2024-09-12T01:37:59.602855+0000","last_clean":"2024-09-12T01:37:59.602855+0000","last_became_active":"2024-09-12T00:25:02.478919+0000","last_became_peered":"2024-09-12T00:25:02.478919+0000","last_unstale":"2024-09-12T01:37:59.602855+0000","last_undegraded":"2024-09-12T01:37:59.602855+0000","last_fullsized":"2024-09-12T01:37:59.602855+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'808","last_scrub_stamp":"2024-09-12T01:37:59.602772+0000","last_deep_scrub":"266'808","last_deep_scrub_stamp":"2024-09-12T01:37:59.602772+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.602772+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:55.142030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4003,"num_read_kb":3616,"num_write":1060,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":544,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.985922+0000","last_change":"2024-09-12T01:37:44.985922+0000","last_active":"2024-09-12T01:37:44.985922+0000","last_peered":"2024-09-12T01:37:44.985922+0000","last_clean":"2024-09-12T01:37:44.985922+0000","last_became_active":"2024-09-12T00:24:46.216398+0000","last_became_peered":"2024-09-12T00:24:46.216398+0000","last_unstale":"2024-09-12T01:37:44.985922+0000","last_undegraded":"2024-09-12T01:37:44.985922+0000","last_fullsized":"2024-09-12T01:37:44.985922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.985834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.985834+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.985834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:51.621846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00080348300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'237","reported_seq":911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.350538+0000","last_change":"2024-09-12T01:37:46.350466+0000","last_active":"2024-09-12T01:37:46.350538+0000","last_peered":"2024-09-12T01:37:46.350538+0000","last_clean":"2024-09-12T01:37:46.350538+0000","last_became_active":"2024-09-12T00:25:00.467622+0000","last_became_peered":"2024-09-12T00:25:00.467622+0000","last_unstale":"2024-09-12T01:37:46.350538+0000","last_undegraded":"2024-09-12T01:37:46.350538+0000","last_fullsized":"2024-09-12T01:37:46.350538+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'237","last_scrub_stamp":"2024-09-12T01:37:46.350355+0000","last_deep_scrub":"266'237","last_deep_scrub_stamp":"2024-09-12T01:37:46.350355+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.350355+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:45.435839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":667699,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":22643,"num_write":1048,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:24.529037+0000","last_change":"2024-09-12T00:25:04.484033+0000","last_active":"2024-09-12T01:34:24.529037+0000","last_peered":"2024-09-12T01:34:24.529037+0000","last_clean":"2024-09-12T01:34:24.529037+0000","last_became_active":"2024-09-12T00:25:04.483752+0000","last_became_peered":"2024-09-12T00:25:04.483752+0000","last_unstale":"2024-09-12T01:34:24.529037+0000","last_undegraded":"2024-09-12T01:34:24.529037+0000","last_fullsized":"2024-09-12T01:34:24.529037+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:45.784755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'935","reported_seq":2768,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.428621+0000","last_change":"2024-09-12T01:38:02.428563+0000","last_active":"2024-09-12T01:38:02.428621+0000","last_peered":"2024-09-12T01:38:02.428621+0000","last_clean":"2024-09-12T01:38:02.428621+0000","last_became_active":"2024-09-12T00:25:06.491919+0000","last_became_peered":"2024-09-12T00:25:06.491919+0000","last_unstale":"2024-09-12T01:38:02.428621+0000","last_undegraded":"2024-09-12T01:38:02.428621+0000","last_fullsized":"2024-09-12T01:38:02.428621+0000","mapping_epoch":32,"log_start":"266'900","ondisk_log_start":"266'900","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'935","last_scrub_stamp":"2024-09-12T01:38:02.428459+0000","last_deep_scrub":"266'935","last_deep_scrub_stamp":"2024-09-12T01:38:02.428459+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.428459+0000","objects_scrubbed":12,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:06.583646+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26860,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1263,"num_read_kb":1464,"num_write":378,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:59.525990+0000","last_change":"2024-09-12T00:25:08.514605+0000","last_active":"2024-09-12T01:33:59.525990+0000","last_peered":"2024-09-12T01:33:59.525990+0000","last_clean":"2024-09-12T01:33:59.525990+0000","last_became_active":"2024-09-12T00:25:08.514284+0000","last_became_peered":"2024-09-12T00:25:08.514284+0000","last_unstale":"2024-09-12T01:33:59.525990+0000","last_undegraded":"2024-09-12T01:33:59.525990+0000","last_fullsized":"2024-09-12T01:33:59.525990+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:57.005332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'199","reported_seq":729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.179557+0000","last_change":"2024-09-12T00:25:10.521984+0000","last_active":"2024-09-12T01:36:11.179557+0000","last_peered":"2024-09-12T01:36:11.179557+0000","last_clean":"2024-09-12T01:36:11.179557+0000","last_became_active":"2024-09-12T00:25:10.521686+0000","last_became_peered":"2024-09-12T00:25:10.521686+0000","last_unstale":"2024-09-12T01:36:11.179557+0000","last_undegraded":"2024-09-12T01:36:11.179557+0000","last_fullsized":"2024-09-12T01:36:11.179557+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:34:44.218223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":329,"num_write":450,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'458","reported_seq":1927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.324237+0000","last_change":"2024-09-12T01:37:56.324237+0000","last_active":"2024-09-12T01:37:56.324237+0000","last_peered":"2024-09-12T01:37:56.324237+0000","last_clean":"2024-09-12T01:37:56.324237+0000","last_became_active":"2024-09-12T00:25:02.472379+0000","last_became_peered":"2024-09-12T00:25:02.472379+0000","last_unstale":"2024-09-12T01:37:56.324237+0000","last_undegraded":"2024-09-12T01:37:56.324237+0000","last_fullsized":"2024-09-12T01:37:56.324237+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'458","last_scrub_stamp":"2024-09-12T01:37:56.324159+0000","last_deep_scrub":"266'458","last_deep_scrub_stamp":"2024-09-12T01:37:56.324159+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.324159+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:20.183702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2328,"num_read_kb":2161,"num_write":552,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":541,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.478045+0000","last_change":"2024-09-12T01:37:47.478045+0000","last_active":"2024-09-12T01:37:47.478045+0000","last_peered":"2024-09-12T01:37:47.478045+0000","last_clean":"2024-09-12T01:37:47.478045+0000","last_became_active":"2024-09-12T00:24:46.219148+0000","last_became_peered":"2024-09-12T00:24:46.219148+0000","last_unstale":"2024-09-12T01:37:47.478045+0000","last_undegraded":"2024-09-12T01:37:47.478045+0000","last_fullsized":"2024-09-12T01:37:47.478045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:47.477953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:47.477953+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.477953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.844122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040735800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'221","reported_seq":909,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.547177+0000","last_change":"2024-09-12T01:37:47.547177+0000","last_active":"2024-09-12T01:37:47.547177+0000","last_peered":"2024-09-12T01:37:47.547177+0000","last_clean":"2024-09-12T01:37:47.547177+0000","last_became_active":"2024-09-12T00:25:00.468270+0000","last_became_peered":"2024-09-12T00:25:00.468270+0000","last_unstale":"2024-09-12T01:37:47.547177+0000","last_undegraded":"2024-09-12T01:37:47.547177+0000","last_fullsized":"2024-09-12T01:37:47.547177+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'221","last_scrub_stamp":"2024-09-12T01:37:47.547063+0000","last_deep_scrub":"266'221","last_deep_scrub_stamp":"2024-09-12T01:37:47.547063+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.547063+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:35.859232+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":34464,"num_write":950,"num_write_kb":30398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.454003+0000","last_change":"2024-09-12T01:37:58.454003+0000","last_active":"2024-09-12T01:37:58.454003+0000","last_peered":"2024-09-12T01:37:58.454003+0000","last_clean":"2024-09-12T01:37:58.454003+0000","last_became_active":"2024-09-12T00:25:04.486554+0000","last_became_peered":"2024-09-12T00:25:04.486554+0000","last_unstale":"2024-09-12T01:37:58.454003+0000","last_undegraded":"2024-09-12T01:37:58.454003+0000","last_fullsized":"2024-09-12T01:37:58.454003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:37:58.453898+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:37:58.453898+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.453898+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:32.185064+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'319","reported_seq":1760,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.892740+0000","last_change":"2024-09-12T01:38:02.892740+0000","last_active":"2024-09-12T01:38:02.892740+0000","last_peered":"2024-09-12T01:38:02.892740+0000","last_clean":"2024-09-12T01:38:02.892740+0000","last_became_active":"2024-09-12T00:25:06.495269+0000","last_became_peered":"2024-09-12T00:25:06.495269+0000","last_unstale":"2024-09-12T01:38:02.892740+0000","last_undegraded":"2024-09-12T01:38:02.892740+0000","last_fullsized":"2024-09-12T01:38:02.892740+0000","mapping_epoch":32,"log_start":"266'301","ondisk_log_start":"266'301","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'319","last_scrub_stamp":"2024-09-12T01:38:02.892622+0000","last_deep_scrub":"266'319","last_deep_scrub_stamp":"2024-09-12T01:38:02.892622+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.892622+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":301,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:22.199556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":267,"num_read_kb":257,"num_write":249,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.242368+0000","last_change":"2024-09-12T00:25:08.512053+0000","last_active":"2024-09-12T01:33:57.242368+0000","last_peered":"2024-09-12T01:33:57.242368+0000","last_clean":"2024-09-12T01:33:57.242368+0000","last_became_active":"2024-09-12T00:25:08.511783+0000","last_became_peered":"2024-09-12T00:25:08.511783+0000","last_unstale":"2024-09-12T01:33:57.242368+0000","last_undegraded":"2024-09-12T01:33:57.242368+0000","last_fullsized":"2024-09-12T01:33:57.242368+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.395473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'269","reported_seq":883,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:12.270641+0000","last_change":"2024-09-12T00:25:10.525964+0000","last_active":"2024-09-12T01:37:12.270641+0000","last_peered":"2024-09-12T01:37:12.270641+0000","last_clean":"2024-09-12T01:37:12.270641+0000","last_became_active":"2024-09-12T00:25:10.525594+0000","last_became_peered":"2024-09-12T00:25:10.525594+0000","last_unstale":"2024-09-12T01:37:12.270641+0000","last_undegraded":"2024-09-12T01:37:12.270641+0000","last_fullsized":"2024-09-12T01:37:12.270641+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":200,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:52:12.216646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":513,"num_write":584,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'413","reported_seq":1899,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.287559+0000","last_change":"2024-09-12T01:37:53.287502+0000","last_active":"2024-09-12T01:37:53.287559+0000","last_peered":"2024-09-12T01:37:53.287559+0000","last_clean":"2024-09-12T01:37:53.287559+0000","last_became_active":"2024-09-12T00:25:02.467022+0000","last_became_peered":"2024-09-12T00:25:02.467022+0000","last_unstale":"2024-09-12T01:37:53.287559+0000","last_undegraded":"2024-09-12T01:37:53.287559+0000","last_fullsized":"2024-09-12T01:37:53.287559+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'413","last_scrub_stamp":"2024-09-12T01:37:53.287417+0000","last_deep_scrub":"266'413","last_deep_scrub_stamp":"2024-09-12T01:37:53.287417+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.287417+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:09.800269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2131,"num_read_kb":2016,"num_write":472,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":546,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.973514+0000","last_change":"2024-09-12T01:37:45.973514+0000","last_active":"2024-09-12T01:37:45.973514+0000","last_peered":"2024-09-12T01:37:45.973514+0000","last_clean":"2024-09-12T01:37:45.973514+0000","last_became_active":"2024-09-12T00:24:46.296014+0000","last_became_peered":"2024-09-12T00:24:46.296014+0000","last_unstale":"2024-09-12T01:37:45.973514+0000","last_undegraded":"2024-09-12T01:37:45.973514+0000","last_fullsized":"2024-09-12T01:37:45.973514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:37:45.973447+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:37:45.973447+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.973447+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:56.580285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00055221999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'227","reported_seq":868,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.739740+0000","last_change":"2024-09-12T01:37:55.739740+0000","last_active":"2024-09-12T01:37:55.739740+0000","last_peered":"2024-09-12T01:37:55.739740+0000","last_clean":"2024-09-12T01:37:55.739740+0000","last_became_active":"2024-09-12T00:25:00.480242+0000","last_became_peered":"2024-09-12T00:25:00.480242+0000","last_unstale":"2024-09-12T01:37:55.739740+0000","last_undegraded":"2024-09-12T01:37:55.739740+0000","last_fullsized":"2024-09-12T01:37:55.739740+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'227","last_scrub_stamp":"2024-09-12T01:37:55.739594+0000","last_deep_scrub":"266'227","last_deep_scrub_stamp":"2024-09-12T01:37:55.739594+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.739594+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:04.195794+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":8697,"num_write":1016,"num_write_kb":33114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.412798+0000","last_change":"2024-09-12T01:37:56.412798+0000","last_active":"2024-09-12T01:37:56.412798+0000","last_peered":"2024-09-12T01:37:56.412798+0000","last_clean":"2024-09-12T01:37:56.412798+0000","last_became_active":"2024-09-12T00:25:04.483224+0000","last_became_peered":"2024-09-12T00:25:04.483224+0000","last_unstale":"2024-09-12T01:37:56.412798+0000","last_undegraded":"2024-09-12T01:37:56.412798+0000","last_fullsized":"2024-09-12T01:37:56.412798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:56.412697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:56.412697+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.412697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:36.333449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'161","reported_seq":724,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:39.016537+0000","last_change":"2024-09-12T00:25:06.500894+0000","last_active":"2024-09-12T01:36:39.016537+0000","last_peered":"2024-09-12T01:36:39.016537+0000","last_clean":"2024-09-12T01:36:39.016537+0000","last_became_active":"2024-09-12T00:25:06.500406+0000","last_became_peered":"2024-09-12T00:25:06.500406+0000","last_unstale":"2024-09-12T01:36:39.016537+0000","last_undegraded":"2024-09-12T01:36:39.016537+0000","last_fullsized":"2024-09-12T01:36:39.016537+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:01.547439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":204,"num_read_kb":195,"num_write":150,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529656+0000","last_change":"2024-09-12T00:25:08.510581+0000","last_active":"2024-09-12T01:34:29.529656+0000","last_peered":"2024-09-12T01:34:29.529656+0000","last_clean":"2024-09-12T01:34:29.529656+0000","last_became_active":"2024-09-12T00:25:08.510287+0000","last_became_peered":"2024-09-12T00:25:08.510287+0000","last_unstale":"2024-09-12T01:34:29.529656+0000","last_undegraded":"2024-09-12T01:34:29.529656+0000","last_fullsized":"2024-09-12T01:34:29.529656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:48.633444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'158","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.085171+0000","last_change":"2024-09-12T00:25:10.523899+0000","last_active":"2024-09-12T01:34:34.085171+0000","last_peered":"2024-09-12T01:34:34.085171+0000","last_clean":"2024-09-12T01:34:34.085171+0000","last_became_active":"2024-09-12T00:25:10.523589+0000","last_became_peered":"2024-09-12T00:25:10.523589+0000","last_unstale":"2024-09-12T01:34:34.085171+0000","last_undegraded":"2024-09-12T01:34:34.085171+0000","last_fullsized":"2024-09-12T01:34:34.085171+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:46:20.406801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":189,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'1615","reported_seq":3220,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.249739+0000","last_change":"2024-09-12T01:37:51.249637+0000","last_active":"2024-09-12T01:37:51.249739+0000","last_peered":"2024-09-12T01:37:51.249739+0000","last_clean":"2024-09-12T01:37:51.249739+0000","last_became_active":"2024-09-12T00:25:02.471491+0000","last_became_peered":"2024-09-12T00:25:02.471491+0000","last_unstale":"2024-09-12T01:37:51.249739+0000","last_undegraded":"2024-09-12T01:37:51.249739+0000","last_fullsized":"2024-09-12T01:37:51.249739+0000","mapping_epoch":28,"log_start":"266'1600","ondisk_log_start":"266'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1615","last_scrub_stamp":"2024-09-12T01:37:51.249541+0000","last_deep_scrub":"266'1615","last_deep_scrub_stamp":"2024-09-12T01:37:51.249541+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.249541+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":1600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.798728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7163,"num_read_kb":6213,"num_write":2294,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'243","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.567520+0000","last_change":"2024-09-12T01:37:45.567458+0000","last_active":"2024-09-12T01:37:45.567520+0000","last_peered":"2024-09-12T01:37:45.567520+0000","last_clean":"2024-09-12T01:37:45.567520+0000","last_became_active":"2024-09-12T00:25:00.484147+0000","last_became_peered":"2024-09-12T00:25:00.484147+0000","last_unstale":"2024-09-12T01:37:45.567520+0000","last_undegraded":"2024-09-12T01:37:45.567520+0000","last_fullsized":"2024-09-12T01:37:45.567520+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'243","last_scrub_stamp":"2024-09-12T01:37:45.567385+0000","last_deep_scrub":"266'243","last_deep_scrub_stamp":"2024-09-12T01:37:45.567385+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.567385+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:40.545937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":38062,"num_write":1135,"num_write_kb":41091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":540,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.537738+0000","last_change":"2024-09-12T01:37:46.537738+0000","last_active":"2024-09-12T01:37:46.537738+0000","last_peered":"2024-09-12T01:37:46.537738+0000","last_clean":"2024-09-12T01:37:46.537738+0000","last_became_active":"2024-09-12T00:24:46.295839+0000","last_became_peered":"2024-09-12T00:24:46.295839+0000","last_unstale":"2024-09-12T01:37:46.537738+0000","last_undegraded":"2024-09-12T01:37:46.537738+0000","last_fullsized":"2024-09-12T01:37:46.537738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:46.537656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:46.537656+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.537656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:55.749892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045367200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:57.260180+0000","last_change":"2024-09-12T00:25:04.479203+0000","last_active":"2024-09-12T01:35:57.260180+0000","last_peered":"2024-09-12T01:35:57.260180+0000","last_clean":"2024-09-12T01:35:57.260180+0000","last_became_active":"2024-09-12T00:25:04.478947+0000","last_became_peered":"2024-09-12T00:25:04.478947+0000","last_unstale":"2024-09-12T01:35:57.260180+0000","last_undegraded":"2024-09-12T01:35:57.260180+0000","last_fullsized":"2024-09-12T01:35:57.260180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'324","reported_seq":1033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.470886+0000","last_change":"2024-09-12T01:38:01.470886+0000","last_active":"2024-09-12T01:38:01.470886+0000","last_peered":"2024-09-12T01:38:01.470886+0000","last_clean":"2024-09-12T01:38:01.470886+0000","last_became_active":"2024-09-12T00:25:06.496693+0000","last_became_peered":"2024-09-12T00:25:06.496693+0000","last_unstale":"2024-09-12T01:38:01.470886+0000","last_undegraded":"2024-09-12T01:38:01.470886+0000","last_fullsized":"2024-09-12T01:38:01.470886+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'324","last_scrub_stamp":"2024-09-12T01:38:01.470784+0000","last_deep_scrub":"266'324","last_deep_scrub_stamp":"2024-09-12T01:38:01.470784+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.470784+0000","objects_scrubbed":11,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:43.306882+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":458,"num_read_kb":584,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.715151+0000","last_change":"2024-09-12T01:38:04.715080+0000","last_active":"2024-09-12T01:38:04.715151+0000","last_peered":"2024-09-12T01:38:04.715151+0000","last_clean":"2024-09-12T01:38:04.715151+0000","last_became_active":"2024-09-12T00:25:08.509962+0000","last_became_peered":"2024-09-12T00:25:08.509962+0000","last_unstale":"2024-09-12T01:38:04.715151+0000","last_undegraded":"2024-09-12T01:38:04.715151+0000","last_fullsized":"2024-09-12T01:38:04.715151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:04.714993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:04.714993+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.714993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:04.273955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'143","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.243688+0000","last_change":"2024-09-12T00:25:10.522132+0000","last_active":"2024-09-12T01:36:11.243688+0000","last_peered":"2024-09-12T01:36:11.243688+0000","last_clean":"2024-09-12T01:36:11.243688+0000","last_became_active":"2024-09-12T00:25:10.521670+0000","last_became_peered":"2024-09-12T00:25:10.521670+0000","last_unstale":"2024-09-12T01:36:11.243688+0000","last_undegraded":"2024-09-12T01:36:11.243688+0000","last_fullsized":"2024-09-12T01:36:11.243688+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:41.340900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":347,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'1211","reported_seq":2867,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.294939+0000","last_change":"2024-09-12T01:37:55.294828+0000","last_active":"2024-09-12T01:37:55.294939+0000","last_peered":"2024-09-12T01:37:55.294939+0000","last_clean":"2024-09-12T01:37:55.294939+0000","last_became_active":"2024-09-12T00:25:02.473158+0000","last_became_peered":"2024-09-12T00:25:02.473158+0000","last_unstale":"2024-09-12T01:37:55.294939+0000","last_undegraded":"2024-09-12T01:37:55.294939+0000","last_fullsized":"2024-09-12T01:37:55.294939+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1211","last_scrub_stamp":"2024-09-12T01:37:55.294717+0000","last_deep_scrub":"266'1211","last_deep_scrub_stamp":"2024-09-12T01:37:55.294717+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.294717+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:49.131916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5007,"num_write":1669,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2709,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'191","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.291895+0000","last_change":"2024-09-12T01:37:48.291829+0000","last_active":"2024-09-12T01:37:48.291895+0000","last_peered":"2024-09-12T01:37:48.291895+0000","last_clean":"2024-09-12T01:37:48.291895+0000","last_became_active":"2024-09-12T00:25:00.465896+0000","last_became_peered":"2024-09-12T00:25:00.465896+0000","last_unstale":"2024-09-12T01:37:48.291895+0000","last_undegraded":"2024-09-12T01:37:48.291895+0000","last_fullsized":"2024-09-12T01:37:48.291895+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T01:37:48.291667+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T01:37:48.291667+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.291667+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.140550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702969,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":438,"num_read_kb":13303,"num_write":931,"num_write_kb":18974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":543,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.043936+0000","last_change":"2024-09-12T01:37:49.043879+0000","last_active":"2024-09-12T01:37:49.043936+0000","last_peered":"2024-09-12T01:37:49.043936+0000","last_clean":"2024-09-12T01:37:49.043936+0000","last_became_active":"2024-09-12T00:24:46.213839+0000","last_became_peered":"2024-09-12T00:24:46.213839+0000","last_unstale":"2024-09-12T01:37:49.043936+0000","last_undegraded":"2024-09-12T01:37:49.043936+0000","last_fullsized":"2024-09-12T01:37:49.043936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:49.043790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:49.043790+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.043790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:54.944893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050495300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.864056+0000","last_change":"2024-09-12T01:38:00.864056+0000","last_active":"2024-09-12T01:38:00.864056+0000","last_peered":"2024-09-12T01:38:00.864056+0000","last_clean":"2024-09-12T01:38:00.864056+0000","last_became_active":"2024-09-12T00:25:04.481137+0000","last_became_peered":"2024-09-12T00:25:04.481137+0000","last_unstale":"2024-09-12T01:38:00.864056+0000","last_undegraded":"2024-09-12T01:38:00.864056+0000","last_fullsized":"2024-09-12T01:38:00.864056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.863967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.863967+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.863967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:46.951205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'252","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.436169+0000","last_change":"2024-09-12T00:25:06.501412+0000","last_active":"2024-09-12T01:37:18.436169+0000","last_peered":"2024-09-12T01:37:18.436169+0000","last_clean":"2024-09-12T01:37:18.436169+0000","last_became_active":"2024-09-12T00:25:06.501118+0000","last_became_peered":"2024-09-12T00:25:06.501118+0000","last_unstale":"2024-09-12T01:37:18.436169+0000","last_undegraded":"2024-09-12T01:37:18.436169+0000","last_fullsized":"2024-09-12T01:37:18.436169+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":326,"num_read_kb":318,"num_write":296,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'774","reported_seq":2925,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.524835+0000","last_change":"2024-09-12T00:25:08.509879+0000","last_active":"2024-09-12T01:37:38.524835+0000","last_peered":"2024-09-12T01:37:38.524835+0000","last_clean":"2024-09-12T01:37:38.524835+0000","last_became_active":"2024-09-12T00:25:08.509511+0000","last_became_peered":"2024-09-12T00:25:08.509511+0000","last_unstale":"2024-09-12T01:37:38.524835+0000","last_undegraded":"2024-09-12T01:37:38.524835+0000","last_fullsized":"2024-09-12T01:37:38.524835+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:11.392274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'129","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.569096+0000","last_change":"2024-09-12T00:25:10.525336+0000","last_active":"2024-09-12T01:37:19.569096+0000","last_peered":"2024-09-12T01:37:19.569096+0000","last_clean":"2024-09-12T01:37:19.569096+0000","last_became_active":"2024-09-12T00:25:10.524804+0000","last_became_peered":"2024-09-12T00:25:10.524804+0000","last_unstale":"2024-09-12T01:37:19.569096+0000","last_undegraded":"2024-09-12T01:37:19.569096+0000","last_fullsized":"2024-09-12T01:37:19.569096+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:28:29.933357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'468","reported_seq":2167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.368204+0000","last_change":"2024-09-12T01:37:52.368204+0000","last_active":"2024-09-12T01:37:52.368204+0000","last_peered":"2024-09-12T01:37:52.368204+0000","last_clean":"2024-09-12T01:37:52.368204+0000","last_became_active":"2024-09-12T00:25:02.463232+0000","last_became_peered":"2024-09-12T00:25:02.463232+0000","last_unstale":"2024-09-12T01:37:52.368204+0000","last_undegraded":"2024-09-12T01:37:52.368204+0000","last_fullsized":"2024-09-12T01:37:52.368204+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'468","last_scrub_stamp":"2024-09-12T01:37:52.368113+0000","last_deep_scrub":"266'468","last_deep_scrub_stamp":"2024-09-12T01:37:52.368113+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.368113+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:14.544213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2494,"num_read_kb":2382,"num_write":536,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'241","reported_seq":949,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.376413+0000","last_change":"2024-09-12T01:37:48.376413+0000","last_active":"2024-09-12T01:37:48.376413+0000","last_peered":"2024-09-12T01:37:48.376413+0000","last_clean":"2024-09-12T01:37:48.376413+0000","last_became_active":"2024-09-12T00:25:00.452591+0000","last_became_peered":"2024-09-12T00:25:00.452591+0000","last_unstale":"2024-09-12T01:37:48.376413+0000","last_undegraded":"2024-09-12T01:37:48.376413+0000","last_fullsized":"2024-09-12T01:37:48.376413+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'241","last_scrub_stamp":"2024-09-12T01:37:48.376282+0000","last_deep_scrub":"266'241","last_deep_scrub_stamp":"2024-09-12T01:37:48.376282+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.376282+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:09.221130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":777,"num_read_kb":13125,"num_write":984,"num_write_kb":40186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":549,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.359471+0000","last_change":"2024-09-12T01:37:45.359471+0000","last_active":"2024-09-12T01:37:45.359471+0000","last_peered":"2024-09-12T01:37:45.359471+0000","last_clean":"2024-09-12T01:37:45.359471+0000","last_became_active":"2024-09-12T00:24:46.426160+0000","last_became_peered":"2024-09-12T00:24:46.426160+0000","last_unstale":"2024-09-12T01:37:45.359471+0000","last_undegraded":"2024-09-12T01:37:45.359471+0000","last_fullsized":"2024-09-12T01:37:45.359471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:45.359384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:45.359384+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.359384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:46.994285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:54.540195+0000","last_change":"2024-09-12T00:25:04.483165+0000","last_active":"2024-09-12T01:35:54.540195+0000","last_peered":"2024-09-12T01:35:54.540195+0000","last_clean":"2024-09-12T01:35:54.540195+0000","last_became_active":"2024-09-12T00:25:04.482856+0000","last_became_peered":"2024-09-12T00:25:04.482856+0000","last_unstale":"2024-09-12T01:35:54.540195+0000","last_undegraded":"2024-09-12T01:35:54.540195+0000","last_fullsized":"2024-09-12T01:35:54.540195+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'141","reported_seq":707,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.424822+0000","last_change":"2024-09-12T00:25:06.498471+0000","last_active":"2024-09-12T01:36:07.424822+0000","last_peered":"2024-09-12T01:36:07.424822+0000","last_clean":"2024-09-12T01:36:07.424822+0000","last_became_active":"2024-09-12T00:25:06.497888+0000","last_became_peered":"2024-09-12T00:25:06.497888+0000","last_unstale":"2024-09-12T01:36:07.424822+0000","last_undegraded":"2024-09-12T01:36:07.424822+0000","last_fullsized":"2024-09-12T01:36:07.424822+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":100,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":168,"num_write":116,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'802","reported_seq":2657,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.923986+0000","last_change":"2024-09-12T00:25:08.513106+0000","last_active":"2024-09-12T01:37:38.923986+0000","last_peered":"2024-09-12T01:37:38.923986+0000","last_clean":"2024-09-12T01:37:38.923986+0000","last_became_active":"2024-09-12T00:25:08.512784+0000","last_became_peered":"2024-09-12T00:25:08.512784+0000","last_unstale":"2024-09-12T01:37:38.923986+0000","last_undegraded":"2024-09-12T01:37:38.923986+0000","last_fullsized":"2024-09-12T01:37:38.923986+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'243","reported_seq":771,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:10.294224+0000","last_change":"2024-09-12T00:25:10.523553+0000","last_active":"2024-09-12T01:36:10.294224+0000","last_peered":"2024-09-12T01:36:10.294224+0000","last_clean":"2024-09-12T01:36:10.294224+0000","last_became_active":"2024-09-12T00:25:10.523258+0000","last_became_peered":"2024-09-12T00:25:10.523258+0000","last_unstale":"2024-09-12T01:36:10.294224+0000","last_undegraded":"2024-09-12T01:36:10.294224+0000","last_fullsized":"2024-09-12T01:36:10.294224+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:05.850202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'490","reported_seq":2085,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.705966+0000","last_change":"2024-09-12T01:37:51.705892+0000","last_active":"2024-09-12T01:37:51.705966+0000","last_peered":"2024-09-12T01:37:51.705966+0000","last_clean":"2024-09-12T01:37:51.705966+0000","last_became_active":"2024-09-12T00:25:02.468436+0000","last_became_peered":"2024-09-12T00:25:02.468436+0000","last_unstale":"2024-09-12T01:37:51.705966+0000","last_undegraded":"2024-09-12T01:37:51.705966+0000","last_fullsized":"2024-09-12T01:37:51.705966+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'490","last_scrub_stamp":"2024-09-12T01:37:51.705797+0000","last_deep_scrub":"266'490","last_deep_scrub_stamp":"2024-09-12T01:37:51.705797+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.705797+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:59.947035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2713,"num_read_kb":2534,"num_write":588,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'194","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.345506+0000","last_change":"2024-09-12T01:37:47.345506+0000","last_active":"2024-09-12T01:37:47.345506+0000","last_peered":"2024-09-12T01:37:47.345506+0000","last_clean":"2024-09-12T01:37:47.345506+0000","last_became_active":"2024-09-12T00:25:00.456071+0000","last_became_peered":"2024-09-12T00:25:00.456071+0000","last_unstale":"2024-09-12T01:37:47.345506+0000","last_undegraded":"2024-09-12T01:37:47.345506+0000","last_fullsized":"2024-09-12T01:37:47.345506+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T01:37:47.345386+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T01:37:47.345386+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.345386+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.275739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":39651,"num_write":895,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":541,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.027962+0000","last_change":"2024-09-12T01:37:48.027962+0000","last_active":"2024-09-12T01:37:48.027962+0000","last_peered":"2024-09-12T01:37:48.027962+0000","last_clean":"2024-09-12T01:37:48.027962+0000","last_became_active":"2024-09-12T00:24:46.425908+0000","last_became_peered":"2024-09-12T00:24:46.425908+0000","last_unstale":"2024-09-12T01:37:48.027962+0000","last_undegraded":"2024-09-12T01:37:48.027962+0000","last_fullsized":"2024-09-12T01:37:48.027962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:48.027858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:48.027858+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.027858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:23.250488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085110299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"38'3","reported_seq":992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.292360+0000","last_change":"2024-09-12T00:25:04.482182+0000","last_active":"2024-09-12T01:37:38.292360+0000","last_peered":"2024-09-12T01:37:38.292360+0000","last_clean":"2024-09-12T01:37:38.292360+0000","last_became_active":"2024-09-12T00:25:04.481193+0000","last_became_peered":"2024-09-12T00:25:04.481193+0000","last_unstale":"2024-09-12T01:37:38.292360+0000","last_undegraded":"2024-09-12T01:37:38.292360+0000","last_fullsized":"2024-09-12T01:37:38.292360+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:59.006487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'357","reported_seq":1110,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.894904+0000","last_change":"2024-09-12T00:25:06.492488+0000","last_active":"2024-09-12T01:37:38.894904+0000","last_peered":"2024-09-12T01:37:38.894904+0000","last_clean":"2024-09-12T01:37:38.894904+0000","last_became_active":"2024-09-12T00:25:06.492189+0000","last_became_peered":"2024-09-12T00:25:06.492189+0000","last_unstale":"2024-09-12T01:37:38.894904+0000","last_undegraded":"2024-09-12T01:37:38.894904+0000","last_fullsized":"2024-09-12T01:37:38.894904+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35877,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":729,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:57.242319+0000","last_change":"2024-09-12T00:25:08.510520+0000","last_active":"2024-09-12T01:33:57.242319+0000","last_peered":"2024-09-12T01:33:57.242319+0000","last_clean":"2024-09-12T01:33:57.242319+0000","last_became_active":"2024-09-12T00:25:08.510167+0000","last_became_peered":"2024-09-12T00:25:08.510167+0000","last_unstale":"2024-09-12T01:33:57.242319+0000","last_undegraded":"2024-09-12T01:33:57.242319+0000","last_fullsized":"2024-09-12T01:33:57.242319+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:26:02.351709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'112","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:12.478978+0000","last_change":"2024-09-12T00:25:10.526124+0000","last_active":"2024-09-12T01:36:12.478978+0000","last_peered":"2024-09-12T01:36:12.478978+0000","last_clean":"2024-09-12T01:36:12.478978+0000","last_became_active":"2024-09-12T00:25:10.525850+0000","last_became_peered":"2024-09-12T00:25:10.525850+0000","last_unstale":"2024-09-12T01:36:12.478978+0000","last_undegraded":"2024-09-12T01:36:12.478978+0000","last_fullsized":"2024-09-12T01:36:12.478978+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":100,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:52.252550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'144","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.336165+0000","last_change":"2024-09-12T00:25:10.527379+0000","last_active":"2024-09-12T01:36:11.336165+0000","last_peered":"2024-09-12T01:36:11.336165+0000","last_clean":"2024-09-12T01:36:11.336165+0000","last_became_active":"2024-09-12T00:25:10.526982+0000","last_became_peered":"2024-09-12T00:25:10.526982+0000","last_unstale":"2024-09-12T01:36:11.336165+0000","last_undegraded":"2024-09-12T01:36:11.336165+0000","last_fullsized":"2024-09-12T01:36:11.336165+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:40.227802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":212,"num_write":342,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'496","reported_seq":2085,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.678973+0000","last_change":"2024-09-12T01:37:58.678973+0000","last_active":"2024-09-12T01:37:58.678973+0000","last_peered":"2024-09-12T01:37:58.678973+0000","last_clean":"2024-09-12T01:37:58.678973+0000","last_became_active":"2024-09-12T00:25:02.472013+0000","last_became_peered":"2024-09-12T00:25:02.472013+0000","last_unstale":"2024-09-12T01:37:58.678973+0000","last_undegraded":"2024-09-12T01:37:58.678973+0000","last_fullsized":"2024-09-12T01:37:58.678973+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'496","last_scrub_stamp":"2024-09-12T01:37:58.678883+0000","last_deep_scrub":"266'496","last_deep_scrub_stamp":"2024-09-12T01:37:58.678883+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.678883+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:48.894785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2517,"num_read_kb":2353,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":915,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'215","reported_seq":925,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.079193+0000","last_change":"2024-09-12T01:37:54.079193+0000","last_active":"2024-09-12T01:37:54.079193+0000","last_peered":"2024-09-12T01:37:54.079193+0000","last_clean":"2024-09-12T01:37:54.079193+0000","last_became_active":"2024-09-12T00:25:00.473591+0000","last_became_peered":"2024-09-12T00:25:00.473591+0000","last_unstale":"2024-09-12T01:37:54.079193+0000","last_undegraded":"2024-09-12T01:37:54.079193+0000","last_fullsized":"2024-09-12T01:37:54.079193+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'215","last_scrub_stamp":"2024-09-12T01:37:54.079022+0000","last_deep_scrub":"266'215","last_deep_scrub_stamp":"2024-09-12T01:37:54.079022+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.079022+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:47.035499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308446,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":52508,"num_write":917,"num_write_kb":35191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.358724+0000","last_change":"2024-09-12T01:38:02.358724+0000","last_active":"2024-09-12T01:38:02.358724+0000","last_peered":"2024-09-12T01:38:02.358724+0000","last_clean":"2024-09-12T01:38:02.358724+0000","last_became_active":"2024-09-12T00:25:04.479701+0000","last_became_peered":"2024-09-12T00:25:04.479701+0000","last_unstale":"2024-09-12T01:38:02.358724+0000","last_undegraded":"2024-09-12T01:38:02.358724+0000","last_fullsized":"2024-09-12T01:38:02.358724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:02.358607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:02.358607+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.358607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:44.972389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'160","reported_seq":756,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.677507+0000","last_change":"2024-09-12T00:25:06.500803+0000","last_active":"2024-09-12T01:37:38.677507+0000","last_peered":"2024-09-12T01:37:38.677507+0000","last_clean":"2024-09-12T01:37:38.677507+0000","last_became_active":"2024-09-12T00:25:06.500315+0000","last_became_peered":"2024-09-12T00:25:06.500315+0000","last_unstale":"2024-09-12T01:37:38.677507+0000","last_undegraded":"2024-09-12T01:37:38.677507+0000","last_fullsized":"2024-09-12T01:37:38.677507+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:36.321812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6391,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":221,"num_read_kb":264,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.123727+0000","last_change":"2024-09-12T00:25:08.517253+0000","last_active":"2024-09-12T01:35:10.123727+0000","last_peered":"2024-09-12T01:35:10.123727+0000","last_clean":"2024-09-12T01:35:10.123727+0000","last_became_active":"2024-09-12T00:25:08.516921+0000","last_became_peered":"2024-09-12T00:25:08.516921+0000","last_unstale":"2024-09-12T01:35:10.123727+0000","last_undegraded":"2024-09-12T01:35:10.123727+0000","last_fullsized":"2024-09-12T01:35:10.123727+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:11.344858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'115","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:25.126051+0000","last_change":"2024-09-12T00:25:10.525063+0000","last_active":"2024-09-12T01:35:25.126051+0000","last_peered":"2024-09-12T01:35:25.126051+0000","last_clean":"2024-09-12T01:35:25.126051+0000","last_became_active":"2024-09-12T00:25:10.524416+0000","last_became_peered":"2024-09-12T00:25:10.524416+0000","last_unstale":"2024-09-12T01:35:25.126051+0000","last_undegraded":"2024-09-12T01:35:25.126051+0000","last_fullsized":"2024-09-12T01:35:25.126051+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:13.897999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":157,"num_read_kb":134,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'452","reported_seq":2023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.345223+0000","last_change":"2024-09-12T01:37:55.345223+0000","last_active":"2024-09-12T01:37:55.345223+0000","last_peered":"2024-09-12T01:37:55.345223+0000","last_clean":"2024-09-12T01:37:55.345223+0000","last_became_active":"2024-09-12T00:25:02.471242+0000","last_became_peered":"2024-09-12T00:25:02.471242+0000","last_unstale":"2024-09-12T01:37:55.345223+0000","last_undegraded":"2024-09-12T01:37:55.345223+0000","last_fullsized":"2024-09-12T01:37:55.345223+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'452","last_scrub_stamp":"2024-09-12T01:37:55.345130+0000","last_deep_scrub":"266'452","last_deep_scrub_stamp":"2024-09-12T01:37:55.345130+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.345130+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:12.582586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2437,"num_read_kb":2317,"num_write":523,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'218","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.943850+0000","last_change":"2024-09-12T01:37:45.943850+0000","last_active":"2024-09-12T01:37:45.943850+0000","last_peered":"2024-09-12T01:37:45.943850+0000","last_clean":"2024-09-12T01:37:45.943850+0000","last_became_active":"2024-09-12T00:25:00.480801+0000","last_became_peered":"2024-09-12T00:25:00.480801+0000","last_unstale":"2024-09-12T01:37:45.943850+0000","last_undegraded":"2024-09-12T01:37:45.943850+0000","last_fullsized":"2024-09-12T01:37:45.943850+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T01:37:45.943735+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T01:37:45.943735+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.943735+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:49.180449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288330,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":555,"num_read_kb":14522,"num_write":924,"num_write_kb":19421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:07.252680+0000","last_change":"2024-09-12T00:25:04.484027+0000","last_active":"2024-09-12T01:35:07.252680+0000","last_peered":"2024-09-12T01:35:07.252680+0000","last_clean":"2024-09-12T01:35:07.252680+0000","last_became_active":"2024-09-12T00:25:04.482891+0000","last_became_peered":"2024-09-12T00:25:04.482891+0000","last_unstale":"2024-09-12T01:35:07.252680+0000","last_undegraded":"2024-09-12T01:35:07.252680+0000","last_fullsized":"2024-09-12T01:35:07.252680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:48.325429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'68","reported_seq":592,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:43.925146+0000","last_change":"2024-09-12T00:25:06.501436+0000","last_active":"2024-09-12T01:35:43.925146+0000","last_peered":"2024-09-12T01:35:43.925146+0000","last_clean":"2024-09-12T01:35:43.925146+0000","last_became_active":"2024-09-12T00:25:06.501049+0000","last_became_peered":"2024-09-12T00:25:06.501049+0000","last_unstale":"2024-09-12T01:35:43.925146+0000","last_undegraded":"2024-09-12T01:35:43.925146+0000","last_fullsized":"2024-09-12T01:35:43.925146+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:26:39.787546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":50,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088627+0000","last_change":"2024-09-12T00:25:08.506372+0000","last_active":"2024-09-12T01:35:10.088627+0000","last_peered":"2024-09-12T01:35:10.088627+0000","last_clean":"2024-09-12T01:35:10.088627+0000","last_became_active":"2024-09-12T00:25:08.506052+0000","last_became_peered":"2024-09-12T00:25:08.506052+0000","last_unstale":"2024-09-12T01:35:10.088627+0000","last_undegraded":"2024-09-12T01:35:10.088627+0000","last_fullsized":"2024-09-12T01:35:10.088627+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:29.150145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'177","reported_seq":704,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.203143+0000","last_change":"2024-09-12T00:25:10.525258+0000","last_active":"2024-09-12T01:36:11.203143+0000","last_peered":"2024-09-12T01:36:11.203143+0000","last_clean":"2024-09-12T01:36:11.203143+0000","last_became_active":"2024-09-12T00:25:10.524992+0000","last_became_peered":"2024-09-12T00:25:10.524992+0000","last_unstale":"2024-09-12T01:36:11.203143+0000","last_undegraded":"2024-09-12T01:36:11.203143+0000","last_fullsized":"2024-09-12T01:36:11.203143+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:12:04.187071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":300,"num_read_kb":289,"num_write":406,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'595","reported_seq":2223,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.346689+0000","last_change":"2024-09-12T01:37:54.346689+0000","last_active":"2024-09-12T01:37:54.346689+0000","last_peered":"2024-09-12T01:37:54.346689+0000","last_clean":"2024-09-12T01:37:54.346689+0000","last_became_active":"2024-09-12T00:25:02.468715+0000","last_became_peered":"2024-09-12T00:25:02.468715+0000","last_unstale":"2024-09-12T01:37:54.346689+0000","last_undegraded":"2024-09-12T01:37:54.346689+0000","last_fullsized":"2024-09-12T01:37:54.346689+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'595","last_scrub_stamp":"2024-09-12T01:37:54.346601+0000","last_deep_scrub":"266'595","last_deep_scrub_stamp":"2024-09-12T01:37:54.346601+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.346601+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:05.177000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2927,"num_read_kb":2680,"num_write":750,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'255","reported_seq":912,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.596087+0000","last_change":"2024-09-12T01:37:46.596087+0000","last_active":"2024-09-12T01:37:46.596087+0000","last_peered":"2024-09-12T01:37:46.596087+0000","last_clean":"2024-09-12T01:37:46.596087+0000","last_became_active":"2024-09-12T00:25:00.481741+0000","last_became_peered":"2024-09-12T00:25:00.481741+0000","last_unstale":"2024-09-12T01:37:46.596087+0000","last_undegraded":"2024-09-12T01:37:46.596087+0000","last_fullsized":"2024-09-12T01:37:46.596087+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'255","last_scrub_stamp":"2024-09-12T01:37:46.595992+0000","last_deep_scrub":"266'255","last_deep_scrub_stamp":"2024-09-12T01:37:46.595992+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.595992+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:06.212123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":2782,"num_write":1086,"num_write_kb":27824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.701698+0000","last_change":"2024-09-12T01:37:56.701698+0000","last_active":"2024-09-12T01:37:56.701698+0000","last_peered":"2024-09-12T01:37:56.701698+0000","last_clean":"2024-09-12T01:37:56.701698+0000","last_became_active":"2024-09-12T00:25:04.476356+0000","last_became_peered":"2024-09-12T00:25:04.476356+0000","last_unstale":"2024-09-12T01:37:56.701698+0000","last_undegraded":"2024-09-12T01:37:56.701698+0000","last_fullsized":"2024-09-12T01:37:56.701698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:56.701593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:56.701593+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.701593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:08.927814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'190","reported_seq":805,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.376453+0000","last_change":"2024-09-12T01:38:03.376453+0000","last_active":"2024-09-12T01:38:03.376453+0000","last_peered":"2024-09-12T01:38:03.376453+0000","last_clean":"2024-09-12T01:38:03.376453+0000","last_became_active":"2024-09-12T00:25:06.496372+0000","last_became_peered":"2024-09-12T00:25:06.496372+0000","last_unstale":"2024-09-12T01:38:03.376453+0000","last_undegraded":"2024-09-12T01:38:03.376453+0000","last_fullsized":"2024-09-12T01:38:03.376453+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T01:38:03.376353+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T01:38:03.376353+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.376353+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:08.691744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11132,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":274,"num_read_kb":379,"num_write":160,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.088829+0000","last_change":"2024-09-12T00:25:08.509562+0000","last_active":"2024-09-12T01:35:09.088829+0000","last_peered":"2024-09-12T01:35:09.088829+0000","last_clean":"2024-09-12T01:35:09.088829+0000","last_became_active":"2024-09-12T00:25:08.508336+0000","last_became_peered":"2024-09-12T00:25:08.508336+0000","last_unstale":"2024-09-12T01:35:09.088829+0000","last_undegraded":"2024-09-12T01:35:09.088829+0000","last_fullsized":"2024-09-12T01:35:09.088829+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:42.261339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'122","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.535080+0000","last_change":"2024-09-12T00:25:10.524167+0000","last_active":"2024-09-12T01:35:14.535080+0000","last_peered":"2024-09-12T01:35:14.535080+0000","last_clean":"2024-09-12T01:35:14.535080+0000","last_became_active":"2024-09-12T00:25:10.522375+0000","last_became_peered":"2024-09-12T00:25:10.522375+0000","last_unstale":"2024-09-12T01:35:14.535080+0000","last_undegraded":"2024-09-12T01:35:14.535080+0000","last_fullsized":"2024-09-12T01:35:14.535080+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:07.393133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":308,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'820","reported_seq":2393,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.393858+0000","last_change":"2024-09-12T01:37:53.393858+0000","last_active":"2024-09-12T01:37:53.393858+0000","last_peered":"2024-09-12T01:37:53.393858+0000","last_clean":"2024-09-12T01:37:53.393858+0000","last_became_active":"2024-09-12T00:25:02.473631+0000","last_became_peered":"2024-09-12T00:25:02.473631+0000","last_unstale":"2024-09-12T01:37:53.393858+0000","last_undegraded":"2024-09-12T01:37:53.393858+0000","last_fullsized":"2024-09-12T01:37:53.393858+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'820","last_scrub_stamp":"2024-09-12T01:37:53.393766+0000","last_deep_scrub":"266'820","last_deep_scrub_stamp":"2024-09-12T01:37:53.393766+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.393766+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:41.670020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3838,"num_read_kb":3448,"num_write":1071,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'213","reported_seq":864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.499745+0000","last_change":"2024-09-12T01:37:48.499745+0000","last_active":"2024-09-12T01:37:48.499745+0000","last_peered":"2024-09-12T01:37:48.499745+0000","last_clean":"2024-09-12T01:37:48.499745+0000","last_became_active":"2024-09-12T00:25:00.461875+0000","last_became_peered":"2024-09-12T00:25:00.461875+0000","last_unstale":"2024-09-12T01:37:48.499745+0000","last_undegraded":"2024-09-12T01:37:48.499745+0000","last_fullsized":"2024-09-12T01:37:48.499745+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T01:37:48.499573+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T01:37:48.499573+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.499573+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:13.359367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288524,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":40693,"num_write":998,"num_write_kb":39273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533703+0000","last_change":"2024-09-12T00:25:04.486530+0000","last_active":"2024-09-12T01:35:04.533703+0000","last_peered":"2024-09-12T01:35:04.533703+0000","last_clean":"2024-09-12T01:35:04.533703+0000","last_became_active":"2024-09-12T00:25:04.486195+0000","last_became_peered":"2024-09-12T00:25:04.486195+0000","last_unstale":"2024-09-12T01:35:04.533703+0000","last_undegraded":"2024-09-12T01:35:04.533703+0000","last_fullsized":"2024-09-12T01:35:04.533703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:28.632757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'156","reported_seq":753,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.901261+0000","last_change":"2024-09-12T01:38:04.901261+0000","last_active":"2024-09-12T01:38:04.901261+0000","last_peered":"2024-09-12T01:38:04.901261+0000","last_clean":"2024-09-12T01:38:04.901261+0000","last_became_active":"2024-09-12T00:25:06.493276+0000","last_became_peered":"2024-09-12T00:25:06.493276+0000","last_unstale":"2024-09-12T01:38:04.901261+0000","last_undegraded":"2024-09-12T01:38:04.901261+0000","last_fullsized":"2024-09-12T01:38:04.901261+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'156","last_scrub_stamp":"2024-09-12T01:38:04.901177+0000","last_deep_scrub":"266'156","last_deep_scrub_stamp":"2024-09-12T01:38:04.901177+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.901177+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:57.450229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":282,"num_write":108,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.123775+0000","last_change":"2024-09-12T00:25:08.513038+0000","last_active":"2024-09-12T01:35:10.123775+0000","last_peered":"2024-09-12T01:35:10.123775+0000","last_clean":"2024-09-12T01:35:10.123775+0000","last_became_active":"2024-09-12T00:25:08.512647+0000","last_became_peered":"2024-09-12T00:25:08.512647+0000","last_unstale":"2024-09-12T01:35:10.123775+0000","last_undegraded":"2024-09-12T01:35:10.123775+0000","last_fullsized":"2024-09-12T01:35:10.123775+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:28.714653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'319","reported_seq":1616,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:54.540307+0000","last_change":"2024-09-12T00:25:02.475789+0000","last_active":"2024-09-12T01:35:54.540307+0000","last_peered":"2024-09-12T01:35:54.540307+0000","last_clean":"2024-09-12T01:35:54.540307+0000","last_became_active":"2024-09-12T00:25:02.475490+0000","last_became_peered":"2024-09-12T00:25:02.475490+0000","last_unstale":"2024-09-12T01:35:54.540307+0000","last_undegraded":"2024-09-12T01:35:54.540307+0000","last_fullsized":"2024-09-12T01:35:54.540307+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1691,"num_read_kb":1609,"num_write":373,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'212","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.535689+0000","last_change":"2024-09-12T01:37:49.535689+0000","last_active":"2024-09-12T01:37:49.535689+0000","last_peered":"2024-09-12T01:37:49.535689+0000","last_clean":"2024-09-12T01:37:49.535689+0000","last_became_active":"2024-09-12T00:25:00.462022+0000","last_became_peered":"2024-09-12T00:25:00.462022+0000","last_unstale":"2024-09-12T01:37:49.535689+0000","last_undegraded":"2024-09-12T01:37:49.535689+0000","last_fullsized":"2024-09-12T01:37:49.535689+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'212","last_scrub_stamp":"2024-09-12T01:37:49.535559+0000","last_deep_scrub":"266'212","last_deep_scrub_stamp":"2024-09-12T01:37:49.535559+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.535559+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:49.433083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":5153,"num_write":1017,"num_write_kb":32149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.330858+0000","last_change":"2024-09-12T01:38:03.330858+0000","last_active":"2024-09-12T01:38:03.330858+0000","last_peered":"2024-09-12T01:38:03.330858+0000","last_clean":"2024-09-12T01:38:03.330858+0000","last_became_active":"2024-09-12T00:25:04.487192+0000","last_became_peered":"2024-09-12T00:25:04.487192+0000","last_unstale":"2024-09-12T01:38:03.330858+0000","last_undegraded":"2024-09-12T01:38:03.330858+0000","last_fullsized":"2024-09-12T01:38:03.330858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:03.330758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:03.330758+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.330758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:15.689513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'229","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.864437+0000","last_change":"2024-09-12T00:25:06.498928+0000","last_active":"2024-09-12T01:37:38.864437+0000","last_peered":"2024-09-12T01:37:38.864437+0000","last_clean":"2024-09-12T01:37:38.864437+0000","last_became_active":"2024-09-12T00:25:06.498651+0000","last_became_peered":"2024-09-12T00:25:06.498651+0000","last_unstale":"2024-09-12T01:37:38.864437+0000","last_undegraded":"2024-09-12T01:37:38.864437+0000","last_fullsized":"2024-09-12T01:37:38.864437+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:22.315708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9365,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":332,"num_read_kb":425,"num_write":210,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:10.088704+0000","last_change":"2024-09-12T00:25:08.507366+0000","last_active":"2024-09-12T01:35:10.088704+0000","last_peered":"2024-09-12T01:35:10.088704+0000","last_clean":"2024-09-12T01:35:10.088704+0000","last_became_active":"2024-09-12T00:25:08.507090+0000","last_became_peered":"2024-09-12T00:25:08.507090+0000","last_unstale":"2024-09-12T01:35:10.088704+0000","last_undegraded":"2024-09-12T01:35:10.088704+0000","last_fullsized":"2024-09-12T01:35:10.088704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:09.874475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'186","reported_seq":707,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:09.725493+0000","last_change":"2024-09-12T00:25:10.522192+0000","last_active":"2024-09-12T01:36:09.725493+0000","last_peered":"2024-09-12T01:36:09.725493+0000","last_clean":"2024-09-12T01:36:09.725493+0000","last_became_active":"2024-09-12T00:25:10.521886+0000","last_became_peered":"2024-09-12T00:25:10.521886+0000","last_unstale":"2024-09-12T01:36:09.725493+0000","last_undegraded":"2024-09-12T01:36:09.725493+0000","last_fullsized":"2024-09-12T01:36:09.725493+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:33.743861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":280,"num_read_kb":274,"num_write":435,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'457","reported_seq":1954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.372563+0000","last_change":"2024-09-12T01:37:59.372563+0000","last_active":"2024-09-12T01:37:59.372563+0000","last_peered":"2024-09-12T01:37:59.372563+0000","last_clean":"2024-09-12T01:37:59.372563+0000","last_became_active":"2024-09-12T00:25:02.463187+0000","last_became_peered":"2024-09-12T00:25:02.463187+0000","last_unstale":"2024-09-12T01:37:59.372563+0000","last_undegraded":"2024-09-12T01:37:59.372563+0000","last_fullsized":"2024-09-12T01:37:59.372563+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'457","last_scrub_stamp":"2024-09-12T01:37:59.372473+0000","last_deep_scrub":"266'457","last_deep_scrub_stamp":"2024-09-12T01:37:59.372473+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.372473+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:38.818995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2353,"num_read_kb":2190,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'299","reported_seq":996,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.379895+0000","last_change":"2024-09-12T01:37:50.379895+0000","last_active":"2024-09-12T01:37:50.379895+0000","last_peered":"2024-09-12T01:37:50.379895+0000","last_clean":"2024-09-12T01:37:50.379895+0000","last_became_active":"2024-09-12T00:25:00.467785+0000","last_became_peered":"2024-09-12T00:25:00.467785+0000","last_unstale":"2024-09-12T01:37:50.379895+0000","last_undegraded":"2024-09-12T01:37:50.379895+0000","last_fullsized":"2024-09-12T01:37:50.379895+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'299","last_scrub_stamp":"2024-09-12T01:37:50.379775+0000","last_deep_scrub":"266'299","last_deep_scrub_stamp":"2024-09-12T01:37:50.379775+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.379775+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:15.751538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":731,"num_read_kb":946,"num_write":1133,"num_write_kb":20145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.756573+0000","last_change":"2024-09-12T01:38:02.756573+0000","last_active":"2024-09-12T01:38:02.756573+0000","last_peered":"2024-09-12T01:38:02.756573+0000","last_clean":"2024-09-12T01:38:02.756573+0000","last_became_active":"2024-09-12T00:25:04.484608+0000","last_became_peered":"2024-09-12T00:25:04.484608+0000","last_unstale":"2024-09-12T01:38:02.756573+0000","last_undegraded":"2024-09-12T01:38:02.756573+0000","last_fullsized":"2024-09-12T01:38:02.756573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:02.756483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:02.756483+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.756483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:30.789022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'198","reported_seq":805,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.885494+0000","last_change":"2024-09-12T00:25:06.490294+0000","last_active":"2024-09-12T01:37:38.885494+0000","last_peered":"2024-09-12T01:37:38.885494+0000","last_clean":"2024-09-12T01:37:38.885494+0000","last_became_active":"2024-09-12T00:25:06.489578+0000","last_became_peered":"2024-09-12T00:25:06.489578+0000","last_unstale":"2024-09-12T01:37:38.885494+0000","last_undegraded":"2024-09-12T01:37:38.885494+0000","last_fullsized":"2024-09-12T01:37:38.885494+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:10.076563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7791,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":284,"num_read_kb":342,"num_write":192,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":491,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.002258+0000","last_change":"2024-09-12T00:25:08.513646+0000","last_active":"2024-09-12T01:35:09.002258+0000","last_peered":"2024-09-12T01:35:09.002258+0000","last_clean":"2024-09-12T01:35:09.002258+0000","last_became_active":"2024-09-12T00:25:08.513330+0000","last_became_peered":"2024-09-12T00:25:08.513330+0000","last_unstale":"2024-09-12T01:35:09.002258+0000","last_undegraded":"2024-09-12T01:35:09.002258+0000","last_fullsized":"2024-09-12T01:35:09.002258+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:40.371456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'218","reported_seq":1100,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:08.536614+0000","last_change":"2024-09-12T00:25:10.527941+0000","last_active":"2024-09-12T01:36:08.536614+0000","last_peered":"2024-09-12T01:36:08.536614+0000","last_clean":"2024-09-12T01:36:08.536614+0000","last_became_active":"2024-09-12T00:25:10.527649+0000","last_became_peered":"2024-09-12T00:25:10.527649+0000","last_unstale":"2024-09-12T01:36:08.536614+0000","last_undegraded":"2024-09-12T01:36:08.536614+0000","last_fullsized":"2024-09-12T01:36:08.536614+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:30.223583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":648,"num_write":596,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'368","reported_seq":1826,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.442383+0000","last_change":"2024-09-12T01:37:54.442383+0000","last_active":"2024-09-12T01:37:54.442383+0000","last_peered":"2024-09-12T01:37:54.442383+0000","last_clean":"2024-09-12T01:37:54.442383+0000","last_became_active":"2024-09-12T00:25:02.479051+0000","last_became_peered":"2024-09-12T00:25:02.479051+0000","last_unstale":"2024-09-12T01:37:54.442383+0000","last_undegraded":"2024-09-12T01:37:54.442383+0000","last_fullsized":"2024-09-12T01:37:54.442383+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'368","last_scrub_stamp":"2024-09-12T01:37:54.442292+0000","last_deep_scrub":"266'368","last_deep_scrub_stamp":"2024-09-12T01:37:54.442292+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.442292+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:20.538747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1824,"num_write":392,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'196","reported_seq":837,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.788273+0000","last_change":"2024-09-12T01:37:45.788273+0000","last_active":"2024-09-12T01:37:45.788273+0000","last_peered":"2024-09-12T01:37:45.788273+0000","last_clean":"2024-09-12T01:37:45.788273+0000","last_became_active":"2024-09-12T00:25:00.454796+0000","last_became_peered":"2024-09-12T00:25:00.454796+0000","last_unstale":"2024-09-12T01:37:45.788273+0000","last_undegraded":"2024-09-12T01:37:45.788273+0000","last_fullsized":"2024-09-12T01:37:45.788273+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T01:37:45.788160+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T01:37:45.788160+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.788160+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:20.838772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661693,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":2462,"num_write":975,"num_write_kb":27053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.708068+0000","last_change":"2024-09-12T01:38:01.708068+0000","last_active":"2024-09-12T01:38:01.708068+0000","last_peered":"2024-09-12T01:38:01.708068+0000","last_clean":"2024-09-12T01:38:01.708068+0000","last_became_active":"2024-09-12T00:25:04.475432+0000","last_became_peered":"2024-09-12T00:25:04.475432+0000","last_unstale":"2024-09-12T01:38:01.708068+0000","last_undegraded":"2024-09-12T01:38:01.708068+0000","last_fullsized":"2024-09-12T01:38:01.708068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:01.707983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:01.707983+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.707983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.862812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'174","reported_seq":774,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.728005+0000","last_change":"2024-09-12T00:25:06.500060+0000","last_active":"2024-09-12T01:37:38.728005+0000","last_peered":"2024-09-12T01:37:38.728005+0000","last_clean":"2024-09-12T01:37:38.728005+0000","last_became_active":"2024-09-12T00:25:06.499452+0000","last_became_peered":"2024-09-12T00:25:06.499452+0000","last_unstale":"2024-09-12T01:37:38.728005+0000","last_undegraded":"2024-09-12T01:37:38.728005+0000","last_fullsized":"2024-09-12T01:37:38.728005+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6920,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":302,"num_write":132,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:20.125335+0000","last_change":"2024-09-12T00:25:08.514860+0000","last_active":"2024-09-12T01:35:20.125335+0000","last_peered":"2024-09-12T01:35:20.125335+0000","last_clean":"2024-09-12T01:35:20.125335+0000","last_became_active":"2024-09-12T00:25:08.514591+0000","last_became_peered":"2024-09-12T00:25:08.514591+0000","last_unstale":"2024-09-12T01:35:20.125335+0000","last_undegraded":"2024-09-12T01:35:20.125335+0000","last_fullsized":"2024-09-12T01:35:20.125335+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:20.635770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'120","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.574196+0000","last_change":"2024-09-12T00:25:10.527404+0000","last_active":"2024-09-12T01:37:19.574196+0000","last_peered":"2024-09-12T01:37:19.574196+0000","last_clean":"2024-09-12T01:37:19.574196+0000","last_became_active":"2024-09-12T00:25:10.527125+0000","last_became_peered":"2024-09-12T00:25:10.527125+0000","last_unstale":"2024-09-12T01:37:19.574196+0000","last_undegraded":"2024-09-12T01:37:19.574196+0000","last_fullsized":"2024-09-12T01:37:19.574196+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:04.270864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":179,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'798","reported_seq":2256,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.352870+0000","last_change":"2024-09-12T01:37:56.352870+0000","last_active":"2024-09-12T01:37:56.352870+0000","last_peered":"2024-09-12T01:37:56.352870+0000","last_clean":"2024-09-12T01:37:56.352870+0000","last_became_active":"2024-09-12T00:25:02.464409+0000","last_became_peered":"2024-09-12T00:25:02.464409+0000","last_unstale":"2024-09-12T01:37:56.352870+0000","last_undegraded":"2024-09-12T01:37:56.352870+0000","last_fullsized":"2024-09-12T01:37:56.352870+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'798","last_scrub_stamp":"2024-09-12T01:37:56.352774+0000","last_deep_scrub":"266'798","last_deep_scrub_stamp":"2024-09-12T01:37:56.352774+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.352774+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:36.258745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3724,"num_read_kb":3326,"num_write":1070,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'248","reported_seq":936,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.355633+0000","last_change":"2024-09-12T01:37:51.355633+0000","last_active":"2024-09-12T01:37:51.355633+0000","last_peered":"2024-09-12T01:37:51.355633+0000","last_clean":"2024-09-12T01:37:51.355633+0000","last_became_active":"2024-09-12T00:25:00.466015+0000","last_became_peered":"2024-09-12T00:25:00.466015+0000","last_unstale":"2024-09-12T01:37:51.355633+0000","last_undegraded":"2024-09-12T01:37:51.355633+0000","last_fullsized":"2024-09-12T01:37:51.355633+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'248","last_scrub_stamp":"2024-09-12T01:37:51.355483+0000","last_deep_scrub":"266'248","last_deep_scrub_stamp":"2024-09-12T01:37:51.355483+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.355483+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:25.590012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":59883,"num_write":1086,"num_write_kb":30675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:07.252715+0000","last_change":"2024-09-12T00:25:04.482399+0000","last_active":"2024-09-12T01:35:07.252715+0000","last_peered":"2024-09-12T01:35:07.252715+0000","last_clean":"2024-09-12T01:35:07.252715+0000","last_became_active":"2024-09-12T00:25:04.482091+0000","last_became_peered":"2024-09-12T00:25:04.482091+0000","last_unstale":"2024-09-12T01:35:07.252715+0000","last_undegraded":"2024-09-12T01:35:07.252715+0000","last_fullsized":"2024-09-12T01:35:07.252715+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:01.772204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'124","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.560906+0000","last_change":"2024-09-12T00:25:06.492106+0000","last_active":"2024-09-12T01:36:07.560906+0000","last_peered":"2024-09-12T01:36:07.560906+0000","last_clean":"2024-09-12T01:36:07.560906+0000","last_became_active":"2024-09-12T00:25:06.491582+0000","last_became_peered":"2024-09-12T00:25:06.491582+0000","last_unstale":"2024-09-12T01:36:07.560906+0000","last_undegraded":"2024-09-12T01:36:07.560906+0000","last_fullsized":"2024-09-12T01:36:07.560906+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:35.340695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":169,"num_read_kb":163,"num_write":166,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'765","reported_seq":2556,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.918642+0000","last_change":"2024-09-12T00:25:08.507545+0000","last_active":"2024-09-12T01:37:38.918642+0000","last_peered":"2024-09-12T01:37:38.918642+0000","last_clean":"2024-09-12T01:37:38.918642+0000","last_became_active":"2024-09-12T00:25:08.506288+0000","last_became_peered":"2024-09-12T00:25:08.506288+0000","last_unstale":"2024-09-12T01:37:38.918642+0000","last_undegraded":"2024-09-12T01:37:38.918642+0000","last_fullsized":"2024-09-12T01:37:38.918642+0000","mapping_epoch":34,"log_start":"266'701","ondisk_log_start":"266'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'126","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.534992+0000","last_change":"2024-09-12T00:25:10.525346+0000","last_active":"2024-09-12T01:35:14.534992+0000","last_peered":"2024-09-12T01:35:14.534992+0000","last_clean":"2024-09-12T01:35:14.534992+0000","last_became_active":"2024-09-12T00:25:10.525045+0000","last_became_peered":"2024-09-12T00:25:10.525045+0000","last_unstale":"2024-09-12T01:35:14.534992+0000","last_undegraded":"2024-09-12T01:35:14.534992+0000","last_fullsized":"2024-09-12T01:35:14.534992+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:19.669222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'459","reported_seq":2081,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.681716+0000","last_change":"2024-09-12T01:38:00.681716+0000","last_active":"2024-09-12T01:38:00.681716+0000","last_peered":"2024-09-12T01:38:00.681716+0000","last_clean":"2024-09-12T01:38:00.681716+0000","last_became_active":"2024-09-12T00:25:02.471255+0000","last_became_peered":"2024-09-12T00:25:02.471255+0000","last_unstale":"2024-09-12T01:38:00.681716+0000","last_undegraded":"2024-09-12T01:38:00.681716+0000","last_fullsized":"2024-09-12T01:38:00.681716+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'459","last_scrub_stamp":"2024-09-12T01:38:00.681548+0000","last_deep_scrub":"266'459","last_deep_scrub_stamp":"2024-09-12T01:38:00.681548+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.681548+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:56.359987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2599,"num_read_kb":2460,"num_write":533,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'175","reported_seq":819,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.829012+0000","last_change":"2024-09-12T01:37:44.829012+0000","last_active":"2024-09-12T01:37:44.829012+0000","last_peered":"2024-09-12T01:37:44.829012+0000","last_clean":"2024-09-12T01:37:44.829012+0000","last_became_active":"2024-09-12T00:25:00.456853+0000","last_became_peered":"2024-09-12T00:25:00.456853+0000","last_unstale":"2024-09-12T01:37:44.829012+0000","last_undegraded":"2024-09-12T01:37:44.829012+0000","last_fullsized":"2024-09-12T01:37:44.829012+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'175","last_scrub_stamp":"2024-09-12T01:37:44.828838+0000","last_deep_scrub":"266'175","last_deep_scrub_stamp":"2024-09-12T01:37:44.828838+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.828838+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:03.195827+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1794910,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":16809,"num_write":841,"num_write_kb":28613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.088296+0000","last_change":"2024-09-12T00:25:04.482756+0000","last_active":"2024-09-12T01:35:04.088296+0000","last_peered":"2024-09-12T01:35:04.088296+0000","last_clean":"2024-09-12T01:35:04.088296+0000","last_became_active":"2024-09-12T00:25:04.482441+0000","last_became_peered":"2024-09-12T00:25:04.482441+0000","last_unstale":"2024-09-12T01:35:04.088296+0000","last_undegraded":"2024-09-12T01:35:04.088296+0000","last_fullsized":"2024-09-12T01:35:04.088296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:42:06.666983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'219","reported_seq":855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.800411+0000","last_change":"2024-09-12T00:25:06.494170+0000","last_active":"2024-09-12T01:37:38.800411+0000","last_peered":"2024-09-12T01:37:38.800411+0000","last_clean":"2024-09-12T01:37:38.800411+0000","last_became_active":"2024-09-12T00:25:06.493625+0000","last_became_peered":"2024-09-12T00:25:06.493625+0000","last_unstale":"2024-09-12T01:37:38.800411+0000","last_undegraded":"2024-09-12T01:37:38.800411+0000","last_fullsized":"2024-09-12T01:37:38.800411+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9308,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":374,"num_write":180,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:17.254339+0000","last_change":"2024-09-12T00:25:08.511276+0000","last_active":"2024-09-12T01:35:17.254339+0000","last_peered":"2024-09-12T01:35:17.254339+0000","last_clean":"2024-09-12T01:35:17.254339+0000","last_became_active":"2024-09-12T00:25:08.511024+0000","last_became_peered":"2024-09-12T00:25:08.511024+0000","last_unstale":"2024-09-12T01:35:17.254339+0000","last_undegraded":"2024-09-12T01:35:17.254339+0000","last_fullsized":"2024-09-12T01:35:17.254339+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:43:18.243804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'102","reported_seq":611,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:08.631109+0000","last_change":"2024-09-12T00:25:10.526277+0000","last_active":"2024-09-12T01:36:08.631109+0000","last_peered":"2024-09-12T01:36:08.631109+0000","last_clean":"2024-09-12T01:36:08.631109+0000","last_became_active":"2024-09-12T00:25:10.525981+0000","last_became_peered":"2024-09-12T00:25:10.525981+0000","last_unstale":"2024-09-12T01:36:08.631109+0000","last_undegraded":"2024-09-12T01:36:08.631109+0000","last_fullsized":"2024-09-12T01:36:08.631109+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":244,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'803","reported_seq":2407,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.688246+0000","last_change":"2024-09-12T01:37:57.688246+0000","last_active":"2024-09-12T01:37:57.688246+0000","last_peered":"2024-09-12T01:37:57.688246+0000","last_clean":"2024-09-12T01:37:57.688246+0000","last_became_active":"2024-09-12T00:25:02.463545+0000","last_became_peered":"2024-09-12T00:25:02.463545+0000","last_unstale":"2024-09-12T01:37:57.688246+0000","last_undegraded":"2024-09-12T01:37:57.688246+0000","last_fullsized":"2024-09-12T01:37:57.688246+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'803","last_scrub_stamp":"2024-09-12T01:37:57.688138+0000","last_deep_scrub":"266'803","last_deep_scrub_stamp":"2024-09-12T01:37:57.688138+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.688138+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:00.009792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3630,"num_write":1061,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'201","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.073754+0000","last_change":"2024-09-12T01:37:56.073754+0000","last_active":"2024-09-12T01:37:56.073754+0000","last_peered":"2024-09-12T01:37:56.073754+0000","last_clean":"2024-09-12T01:37:56.073754+0000","last_became_active":"2024-09-12T00:25:00.478561+0000","last_became_peered":"2024-09-12T00:25:00.478561+0000","last_unstale":"2024-09-12T01:37:56.073754+0000","last_undegraded":"2024-09-12T01:37:56.073754+0000","last_fullsized":"2024-09-12T01:37:56.073754+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'201","last_scrub_stamp":"2024-09-12T01:37:56.073631+0000","last_deep_scrub":"266'201","last_deep_scrub_stamp":"2024-09-12T01:37:56.073631+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.073631+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:46.426001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568262,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":8616,"num_write":923,"num_write_kb":24681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.702621+0000","last_change":"2024-09-12T01:37:59.702621+0000","last_active":"2024-09-12T01:37:59.702621+0000","last_peered":"2024-09-12T01:37:59.702621+0000","last_clean":"2024-09-12T01:37:59.702621+0000","last_became_active":"2024-09-12T00:25:04.481146+0000","last_became_peered":"2024-09-12T00:25:04.481146+0000","last_unstale":"2024-09-12T01:37:59.702621+0000","last_undegraded":"2024-09-12T01:37:59.702621+0000","last_fullsized":"2024-09-12T01:37:59.702621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:59.702524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:59.702524+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.702524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:01.125016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'155","reported_seq":753,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.817743+0000","last_change":"2024-09-12T00:25:06.499351+0000","last_active":"2024-09-12T01:37:38.817743+0000","last_peered":"2024-09-12T01:37:38.817743+0000","last_clean":"2024-09-12T01:37:38.817743+0000","last_became_active":"2024-09-12T00:25:06.499065+0000","last_became_peered":"2024-09-12T00:25:06.499065+0000","last_unstale":"2024-09-12T01:37:38.817743+0000","last_undegraded":"2024-09-12T01:37:38.817743+0000","last_fullsized":"2024-09-12T01:37:38.817743+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:00.555004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":326,"num_write":120,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.535752+0000","last_change":"2024-09-12T00:25:08.510993+0000","last_active":"2024-09-12T01:35:19.535752+0000","last_peered":"2024-09-12T01:35:19.535752+0000","last_clean":"2024-09-12T01:35:19.535752+0000","last_became_active":"2024-09-12T00:25:08.510416+0000","last_became_peered":"2024-09-12T00:25:08.510416+0000","last_unstale":"2024-09-12T01:35:19.535752+0000","last_undegraded":"2024-09-12T01:35:19.535752+0000","last_fullsized":"2024-09-12T01:35:19.535752+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:07.820462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'116","reported_seq":638,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:07.676200+0000","last_change":"2024-09-12T00:25:10.521269+0000","last_active":"2024-09-12T01:36:07.676200+0000","last_peered":"2024-09-12T01:36:07.676200+0000","last_clean":"2024-09-12T01:36:07.676200+0000","last_became_active":"2024-09-12T00:25:10.520808+0000","last_became_peered":"2024-09-12T00:25:10.520808+0000","last_unstale":"2024-09-12T01:36:07.676200+0000","last_undegraded":"2024-09-12T01:36:07.676200+0000","last_fullsized":"2024-09-12T01:36:07.676200+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:03.946656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1152,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":290,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'801","reported_seq":2320,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.378858+0000","last_change":"2024-09-12T01:37:52.378858+0000","last_active":"2024-09-12T01:37:52.378858+0000","last_peered":"2024-09-12T01:37:52.378858+0000","last_clean":"2024-09-12T01:37:52.378858+0000","last_became_active":"2024-09-12T00:25:02.470607+0000","last_became_peered":"2024-09-12T00:25:02.470607+0000","last_unstale":"2024-09-12T01:37:52.378858+0000","last_undegraded":"2024-09-12T01:37:52.378858+0000","last_fullsized":"2024-09-12T01:37:52.378858+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T01:37:52.378752+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T01:37:52.378752+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.378752+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:52.413766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3788,"num_read_kb":3387,"num_write":1064,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1177,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'177","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.584965+0000","last_change":"2024-09-12T01:37:51.584965+0000","last_active":"2024-09-12T01:37:51.584965+0000","last_peered":"2024-09-12T01:37:51.584965+0000","last_clean":"2024-09-12T01:37:51.584965+0000","last_became_active":"2024-09-12T00:25:00.465095+0000","last_became_peered":"2024-09-12T00:25:00.465095+0000","last_unstale":"2024-09-12T01:37:51.584965+0000","last_undegraded":"2024-09-12T01:37:51.584965+0000","last_fullsized":"2024-09-12T01:37:51.584965+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T01:37:51.584835+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T01:37:51.584835+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.584835+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:25.271916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":87968,"num_write":861,"num_write_kb":34661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.833398+0000","last_change":"2024-09-12T01:38:00.833398+0000","last_active":"2024-09-12T01:38:00.833398+0000","last_peered":"2024-09-12T01:38:00.833398+0000","last_clean":"2024-09-12T01:38:00.833398+0000","last_became_active":"2024-09-12T00:25:04.483232+0000","last_became_peered":"2024-09-12T00:25:04.483232+0000","last_unstale":"2024-09-12T01:38:00.833398+0000","last_undegraded":"2024-09-12T01:38:00.833398+0000","last_fullsized":"2024-09-12T01:38:00.833398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.833313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.833313+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.833313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:19.117932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'120","reported_seq":690,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.707553+0000","last_change":"2024-09-12T00:25:06.500325+0000","last_active":"2024-09-12T01:37:38.707553+0000","last_peered":"2024-09-12T01:37:38.707553+0000","last_clean":"2024-09-12T01:37:38.707553+0000","last_became_active":"2024-09-12T00:25:06.499749+0000","last_became_peered":"2024-09-12T00:25:06.499749+0000","last_unstale":"2024-09-12T01:37:38.707553+0000","last_undegraded":"2024-09-12T01:37:38.707553+0000","last_fullsized":"2024-09-12T01:37:38.707553+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:39.445969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8122,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":217,"num_write":76,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534440+0000","last_change":"2024-09-12T00:25:08.514387+0000","last_active":"2024-09-12T01:35:09.534440+0000","last_peered":"2024-09-12T01:35:09.534440+0000","last_clean":"2024-09-12T01:35:09.534440+0000","last_became_active":"2024-09-12T00:25:08.513977+0000","last_became_peered":"2024-09-12T00:25:08.513977+0000","last_unstale":"2024-09-12T01:35:09.534440+0000","last_undegraded":"2024-09-12T01:35:09.534440+0000","last_fullsized":"2024-09-12T01:35:09.534440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.665951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'144","reported_seq":1248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.185545+0000","last_change":"2024-09-12T00:25:10.530536+0000","last_active":"2024-09-12T01:36:11.185545+0000","last_peered":"2024-09-12T01:36:11.185545+0000","last_clean":"2024-09-12T01:36:11.185545+0000","last_became_active":"2024-09-12T00:25:10.530103+0000","last_became_peered":"2024-09-12T00:25:10.530103+0000","last_unstale":"2024-09-12T01:36:11.185545+0000","last_undegraded":"2024-09-12T01:36:11.185545+0000","last_fullsized":"2024-09-12T01:36:11.185545+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.601805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":760,"num_write":344,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'1252","reported_seq":2953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.749655+0000","last_change":"2024-09-12T01:37:54.749655+0000","last_active":"2024-09-12T01:37:54.749655+0000","last_peered":"2024-09-12T01:37:54.749655+0000","last_clean":"2024-09-12T01:37:54.749655+0000","last_became_active":"2024-09-12T00:25:02.467159+0000","last_became_peered":"2024-09-12T00:25:02.467159+0000","last_unstale":"2024-09-12T01:37:54.749655+0000","last_undegraded":"2024-09-12T01:37:54.749655+0000","last_fullsized":"2024-09-12T01:37:54.749655+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1252","last_scrub_stamp":"2024-09-12T01:37:54.749564+0000","last_deep_scrub":"266'1252","last_deep_scrub_stamp":"2024-09-12T01:37:54.749564+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.749564+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":1200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.375412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5713,"num_read_kb":5033,"num_write":1731,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'181","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.585023+0000","last_change":"2024-09-12T01:37:50.584954+0000","last_active":"2024-09-12T01:37:50.585023+0000","last_peered":"2024-09-12T01:37:50.585023+0000","last_clean":"2024-09-12T01:37:50.585023+0000","last_became_active":"2024-09-12T00:25:00.458519+0000","last_became_peered":"2024-09-12T00:25:00.458519+0000","last_unstale":"2024-09-12T01:37:50.585023+0000","last_undegraded":"2024-09-12T01:37:50.585023+0000","last_fullsized":"2024-09-12T01:37:50.585023+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'181","last_scrub_stamp":"2024-09-12T01:37:50.584829+0000","last_deep_scrub":"266'181","last_deep_scrub_stamp":"2024-09-12T01:37:50.584829+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.584829+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:45.672695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174575,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":854,"num_write":913,"num_write_kb":13833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"31'1","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:22.255221+0000","last_change":"2024-09-12T00:25:04.482146+0000","last_active":"2024-09-12T01:35:22.255221+0000","last_peered":"2024-09-12T01:35:22.255221+0000","last_clean":"2024-09-12T01:35:22.255221+0000","last_became_active":"2024-09-12T00:25:04.481393+0000","last_became_peered":"2024-09-12T00:25:04.481393+0000","last_unstale":"2024-09-12T01:35:22.255221+0000","last_undegraded":"2024-09-12T01:35:22.255221+0000","last_fullsized":"2024-09-12T01:35:22.255221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:03.458751+0000","last_clean_scrub_stamp":"2024-09-12T00:25:03.458751+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'193","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.737443+0000","last_change":"2024-09-12T00:25:06.490707+0000","last_active":"2024-09-12T01:37:38.737443+0000","last_peered":"2024-09-12T01:37:38.737443+0000","last_clean":"2024-09-12T01:37:38.737443+0000","last_became_active":"2024-09-12T00:25:06.490384+0000","last_became_peered":"2024-09-12T00:25:06.490384+0000","last_unstale":"2024-09-12T01:37:38.737443+0000","last_undegraded":"2024-09-12T01:37:38.737443+0000","last_fullsized":"2024-09-12T01:37:38.737443+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:05.468903+0000","last_clean_scrub_stamp":"2024-09-12T00:25:05.468903+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:11.867492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8836,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:12.253423+0000","last_change":"2024-09-12T00:25:08.508294+0000","last_active":"2024-09-12T01:35:12.253423+0000","last_peered":"2024-09-12T01:35:12.253423+0000","last_clean":"2024-09-12T01:35:12.253423+0000","last_became_active":"2024-09-12T00:25:08.507837+0000","last_became_peered":"2024-09-12T00:25:08.507837+0000","last_unstale":"2024-09-12T01:35:12.253423+0000","last_undegraded":"2024-09-12T01:35:12.253423+0000","last_fullsized":"2024-09-12T01:35:12.253423+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:13.827697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'136","reported_seq":683,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:18.438271+0000","last_change":"2024-09-12T00:25:10.528310+0000","last_active":"2024-09-12T01:37:18.438271+0000","last_peered":"2024-09-12T01:37:18.438271+0000","last_clean":"2024-09-12T01:37:18.438271+0000","last_became_active":"2024-09-12T00:25:10.528040+0000","last_became_peered":"2024-09-12T00:25:10.528040+0000","last_unstale":"2024-09-12T01:37:18.438271+0000","last_undegraded":"2024-09-12T01:37:18.438271+0000","last_fullsized":"2024-09-12T01:37:18.438271+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":238,"num_write":307,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'1098","reported_seq":2617,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.388999+0000","last_change":"2024-09-12T01:37:57.388999+0000","last_active":"2024-09-12T01:37:57.388999+0000","last_peered":"2024-09-12T01:37:57.388999+0000","last_clean":"2024-09-12T01:37:57.388999+0000","last_became_active":"2024-09-12T00:25:02.474282+0000","last_became_peered":"2024-09-12T00:25:02.474282+0000","last_unstale":"2024-09-12T01:37:57.388999+0000","last_undegraded":"2024-09-12T01:37:57.388999+0000","last_fullsized":"2024-09-12T01:37:57.388999+0000","mapping_epoch":28,"log_start":"266'1000","ondisk_log_start":"266'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1098","last_scrub_stamp":"2024-09-12T01:37:57.388881+0000","last_deep_scrub":"266'1098","last_deep_scrub_stamp":"2024-09-12T01:37:57.388881+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.388881+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":1000,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:34.723161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4398,"num_write":1510,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'185","reported_seq":862,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.631943+0000","last_change":"2024-09-12T01:37:47.631887+0000","last_active":"2024-09-12T01:37:47.631943+0000","last_peered":"2024-09-12T01:37:47.631943+0000","last_clean":"2024-09-12T01:37:47.631943+0000","last_became_active":"2024-09-12T00:25:00.478259+0000","last_became_peered":"2024-09-12T00:25:00.478259+0000","last_unstale":"2024-09-12T01:37:47.631943+0000","last_undegraded":"2024-09-12T01:37:47.631943+0000","last_fullsized":"2024-09-12T01:37:47.631943+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:47.631770+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:47.631770+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.631770+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:29.806652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515600,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":41144,"num_write":873,"num_write_kb":35919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'755","reported_seq":2241,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.417543+0000","last_change":"2024-09-12T01:37:57.417543+0000","last_active":"2024-09-12T01:37:57.417543+0000","last_peered":"2024-09-12T01:37:57.417543+0000","last_clean":"2024-09-12T01:37:57.417543+0000","last_became_active":"2024-09-12T00:25:02.479450+0000","last_became_peered":"2024-09-12T00:25:02.479450+0000","last_unstale":"2024-09-12T01:37:57.417543+0000","last_undegraded":"2024-09-12T01:37:57.417543+0000","last_fullsized":"2024-09-12T01:37:57.417543+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'755","last_scrub_stamp":"2024-09-12T01:37:57.417454+0000","last_deep_scrub":"266'755","last_deep_scrub_stamp":"2024-09-12T01:37:57.417454+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.417454+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:04.776702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3526,"num_read_kb":3183,"num_write":976,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'207","reported_seq":851,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.446489+0000","last_change":"2024-09-12T01:37:49.446397+0000","last_active":"2024-09-12T01:37:49.446489+0000","last_peered":"2024-09-12T01:37:49.446489+0000","last_clean":"2024-09-12T01:37:49.446489+0000","last_became_active":"2024-09-12T00:25:00.468280+0000","last_became_peered":"2024-09-12T00:25:00.468280+0000","last_unstale":"2024-09-12T01:37:49.446489+0000","last_undegraded":"2024-09-12T01:37:49.446489+0000","last_fullsized":"2024-09-12T01:37:49.446489+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'207","last_scrub_stamp":"2024-09-12T01:37:49.446249+0000","last_deep_scrub":"266'207","last_deep_scrub_stamp":"2024-09-12T01:37:49.446249+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.446249+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:17.110576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":421,"num_read_kb":15096,"num_write":1006,"num_write_kb":29184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'365","reported_seq":1884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.192081+0000","last_change":"2024-09-12T00:25:02.477649+0000","last_active":"2024-09-12T01:36:11.192081+0000","last_peered":"2024-09-12T01:36:11.192081+0000","last_clean":"2024-09-12T01:36:11.192081+0000","last_became_active":"2024-09-12T00:25:02.476993+0000","last_became_peered":"2024-09-12T00:25:02.476993+0000","last_unstale":"2024-09-12T01:36:11.192081+0000","last_undegraded":"2024-09-12T01:36:11.192081+0000","last_fullsized":"2024-09-12T01:36:11.192081+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":300,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:43.749594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2221,"num_read_kb":2131,"num_write":417,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'201","reported_seq":894,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.122989+0000","last_change":"2024-09-12T01:37:53.122891+0000","last_active":"2024-09-12T01:37:53.122989+0000","last_peered":"2024-09-12T01:37:53.122989+0000","last_clean":"2024-09-12T01:37:53.122989+0000","last_became_active":"2024-09-12T00:25:00.477872+0000","last_became_peered":"2024-09-12T00:25:00.477872+0000","last_unstale":"2024-09-12T01:37:53.122989+0000","last_undegraded":"2024-09-12T01:37:53.122989+0000","last_fullsized":"2024-09-12T01:37:53.122989+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'201","last_scrub_stamp":"2024-09-12T01:37:53.122774+0000","last_deep_scrub":"266'201","last_deep_scrub_stamp":"2024-09-12T01:37:53.122774+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.122774+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:56.089470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590195,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":9353,"num_write":799,"num_write_kb":34820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'480","reported_seq":1991,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.625423+0000","last_change":"2024-09-12T01:38:02.625423+0000","last_active":"2024-09-12T01:38:02.625423+0000","last_peered":"2024-09-12T01:38:02.625423+0000","last_clean":"2024-09-12T01:38:02.625423+0000","last_became_active":"2024-09-12T00:25:02.468180+0000","last_became_peered":"2024-09-12T00:25:02.468180+0000","last_unstale":"2024-09-12T01:38:02.625423+0000","last_undegraded":"2024-09-12T01:38:02.625423+0000","last_fullsized":"2024-09-12T01:38:02.625423+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'480","last_scrub_stamp":"2024-09-12T01:38:02.625346+0000","last_deep_scrub":"266'480","last_deep_scrub_stamp":"2024-09-12T01:38:02.625346+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.625346+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:54.703998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2321,"num_read_kb":2166,"num_write":540,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'179","reported_seq":796,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.564029+0000","last_change":"2024-09-12T01:37:53.564029+0000","last_active":"2024-09-12T01:37:53.564029+0000","last_peered":"2024-09-12T01:37:53.564029+0000","last_clean":"2024-09-12T01:37:53.564029+0000","last_became_active":"2024-09-12T00:25:00.471412+0000","last_became_peered":"2024-09-12T00:25:00.471412+0000","last_unstale":"2024-09-12T01:37:53.564029+0000","last_undegraded":"2024-09-12T01:37:53.564029+0000","last_fullsized":"2024-09-12T01:37:53.564029+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'179","last_scrub_stamp":"2024-09-12T01:37:53.563879+0000","last_deep_scrub":"266'179","last_deep_scrub_stamp":"2024-09-12T01:37:53.563879+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.563879+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:48.342923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432317,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":354,"num_read_kb":25493,"num_write":898,"num_write_kb":19511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'502","reported_seq":2196,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.585436+0000","last_change":"2024-09-12T01:38:01.585436+0000","last_active":"2024-09-12T01:38:01.585436+0000","last_peered":"2024-09-12T01:38:01.585436+0000","last_clean":"2024-09-12T01:38:01.585436+0000","last_became_active":"2024-09-12T00:25:02.469251+0000","last_became_peered":"2024-09-12T00:25:02.469251+0000","last_unstale":"2024-09-12T01:38:01.585436+0000","last_undegraded":"2024-09-12T01:38:01.585436+0000","last_fullsized":"2024-09-12T01:38:01.585436+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'502","last_scrub_stamp":"2024-09-12T01:38:01.585337+0000","last_deep_scrub":"266'502","last_deep_scrub_stamp":"2024-09-12T01:38:01.585337+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.585337+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:58.395669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2750,"num_read_kb":2605,"num_write":624,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'206","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.248829+0000","last_change":"2024-09-12T01:37:49.248829+0000","last_active":"2024-09-12T01:37:49.248829+0000","last_peered":"2024-09-12T01:37:49.248829+0000","last_clean":"2024-09-12T01:37:49.248829+0000","last_became_active":"2024-09-12T00:25:00.466945+0000","last_became_peered":"2024-09-12T00:25:00.466945+0000","last_unstale":"2024-09-12T01:37:49.248829+0000","last_undegraded":"2024-09-12T01:37:49.248829+0000","last_fullsized":"2024-09-12T01:37:49.248829+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T01:37:49.248703+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T01:37:49.248703+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.248703+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:28.604127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":18851,"num_write":965,"num_write_kb":35048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'499","reported_seq":2048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.776962+0000","last_change":"2024-09-12T01:37:56.776897+0000","last_active":"2024-09-12T01:37:56.776962+0000","last_peered":"2024-09-12T01:37:56.776962+0000","last_clean":"2024-09-12T01:37:56.776962+0000","last_became_active":"2024-09-12T00:25:02.475225+0000","last_became_peered":"2024-09-12T00:25:02.475225+0000","last_unstale":"2024-09-12T01:37:56.776962+0000","last_undegraded":"2024-09-12T01:37:56.776962+0000","last_fullsized":"2024-09-12T01:37:56.776962+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T01:37:56.776795+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T01:37:56.776795+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.776795+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:34.741261+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2326,"num_write":604,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":947,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'195","reported_seq":836,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.258842+0000","last_change":"2024-09-12T01:37:54.258842+0000","last_active":"2024-09-12T01:37:54.258842+0000","last_peered":"2024-09-12T01:37:54.258842+0000","last_clean":"2024-09-12T01:37:54.258842+0000","last_became_active":"2024-09-12T00:25:00.468245+0000","last_became_peered":"2024-09-12T00:25:00.468245+0000","last_unstale":"2024-09-12T01:37:54.258842+0000","last_undegraded":"2024-09-12T01:37:54.258842+0000","last_fullsized":"2024-09-12T01:37:54.258842+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'195","last_scrub_stamp":"2024-09-12T01:37:54.258714+0000","last_deep_scrub":"266'195","last_deep_scrub_stamp":"2024-09-12T01:37:54.258714+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.258714+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:03.360749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":27275,"num_write":960,"num_write_kb":19137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'529","reported_seq":2295,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.334078+0000","last_change":"2024-09-12T01:37:58.334020+0000","last_active":"2024-09-12T01:37:58.334078+0000","last_peered":"2024-09-12T01:37:58.334078+0000","last_clean":"2024-09-12T01:37:58.334078+0000","last_became_active":"2024-09-12T00:25:02.469044+0000","last_became_peered":"2024-09-12T00:25:02.469044+0000","last_unstale":"2024-09-12T01:37:58.334078+0000","last_undegraded":"2024-09-12T01:37:58.334078+0000","last_fullsized":"2024-09-12T01:37:58.334078+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'529","last_scrub_stamp":"2024-09-12T01:37:58.333929+0000","last_deep_scrub":"266'529","last_deep_scrub_stamp":"2024-09-12T01:37:58.333929+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.333929+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:57.684362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2889,"num_read_kb":2724,"num_write":624,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3030,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'185","reported_seq":818,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.658264+0000","last_change":"2024-09-12T01:37:48.658264+0000","last_active":"2024-09-12T01:37:48.658264+0000","last_peered":"2024-09-12T01:37:48.658264+0000","last_clean":"2024-09-12T01:37:48.658264+0000","last_became_active":"2024-09-12T00:25:00.487526+0000","last_became_peered":"2024-09-12T00:25:00.487526+0000","last_unstale":"2024-09-12T01:37:48.658264+0000","last_undegraded":"2024-09-12T01:37:48.658264+0000","last_fullsized":"2024-09-12T01:37:48.658264+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:48.658138+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:48.658138+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.658138+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:27.351203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306655,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":3010,"num_write":923,"num_write_kb":19090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1186","reported_seq":2787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.889719+0000","last_change":"2024-09-12T01:37:50.889645+0000","last_active":"2024-09-12T01:37:50.889719+0000","last_peered":"2024-09-12T01:37:50.889719+0000","last_clean":"2024-09-12T01:37:50.889719+0000","last_became_active":"2024-09-12T00:25:02.465257+0000","last_became_peered":"2024-09-12T00:25:02.465257+0000","last_unstale":"2024-09-12T01:37:50.889719+0000","last_undegraded":"2024-09-12T01:37:50.889719+0000","last_fullsized":"2024-09-12T01:37:50.889719+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1186","last_scrub_stamp":"2024-09-12T01:37:50.889557+0000","last_deep_scrub":"266'1186","last_deep_scrub_stamp":"2024-09-12T01:37:50.889557+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.889557+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:33.235013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5507,"num_read_kb":4876,"num_write":1621,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'262","reported_seq":918,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.605167+0000","last_change":"2024-09-12T01:37:52.605167+0000","last_active":"2024-09-12T01:37:52.605167+0000","last_peered":"2024-09-12T01:37:52.605167+0000","last_clean":"2024-09-12T01:37:52.605167+0000","last_became_active":"2024-09-12T00:25:00.469159+0000","last_became_peered":"2024-09-12T00:25:00.469159+0000","last_unstale":"2024-09-12T01:37:52.605167+0000","last_undegraded":"2024-09-12T01:37:52.605167+0000","last_fullsized":"2024-09-12T01:37:52.605167+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'262","last_scrub_stamp":"2024-09-12T01:37:52.605010+0000","last_deep_scrub":"266'262","last_deep_scrub_stamp":"2024-09-12T01:37:52.605010+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.605010+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:46.615461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":57821,"num_write":1101,"num_write_kb":41989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'489","reported_seq":1932,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.485490+0000","last_change":"2024-09-12T01:38:00.485490+0000","last_active":"2024-09-12T01:38:00.485490+0000","last_peered":"2024-09-12T01:38:00.485490+0000","last_clean":"2024-09-12T01:38:00.485490+0000","last_became_active":"2024-09-12T00:25:02.470623+0000","last_became_peered":"2024-09-12T00:25:02.470623+0000","last_unstale":"2024-09-12T01:38:00.485490+0000","last_undegraded":"2024-09-12T01:38:00.485490+0000","last_fullsized":"2024-09-12T01:38:00.485490+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'489","last_scrub_stamp":"2024-09-12T01:38:00.485373+0000","last_deep_scrub":"266'489","last_deep_scrub_stamp":"2024-09-12T01:38:00.485373+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.485373+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:54.174690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2404,"num_read_kb":2207,"num_write":594,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":704,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'242","reported_seq":915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.082986+0000","last_change":"2024-09-12T01:37:55.082986+0000","last_active":"2024-09-12T01:37:55.082986+0000","last_peered":"2024-09-12T01:37:55.082986+0000","last_clean":"2024-09-12T01:37:55.082986+0000","last_became_active":"2024-09-12T00:25:00.469918+0000","last_became_peered":"2024-09-12T00:25:00.469918+0000","last_unstale":"2024-09-12T01:37:55.082986+0000","last_undegraded":"2024-09-12T01:37:55.082986+0000","last_fullsized":"2024-09-12T01:37:55.082986+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'242","last_scrub_stamp":"2024-09-12T01:37:55.082838+0000","last_deep_scrub":"266'242","last_deep_scrub_stamp":"2024-09-12T01:37:55.082838+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.082838+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:33.200370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":488,"num_read_kb":51750,"num_write":1103,"num_write_kb":39694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'615","reported_seq":2423,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.742975+0000","last_change":"2024-09-12T01:37:53.742975+0000","last_active":"2024-09-12T01:37:53.742975+0000","last_peered":"2024-09-12T01:37:53.742975+0000","last_clean":"2024-09-12T01:37:53.742975+0000","last_became_active":"2024-09-12T00:25:02.475864+0000","last_became_peered":"2024-09-12T00:25:02.475864+0000","last_unstale":"2024-09-12T01:37:53.742975+0000","last_undegraded":"2024-09-12T01:37:53.742975+0000","last_fullsized":"2024-09-12T01:37:53.742975+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'615","last_scrub_stamp":"2024-09-12T01:37:53.742862+0000","last_deep_scrub":"266'615","last_deep_scrub_stamp":"2024-09-12T01:37:53.742862+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.742862+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:34.727742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3105,"num_read_kb":2885,"num_write":734,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":934,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'287","reported_seq":994,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.594953+0000","last_change":"2024-09-12T01:37:54.594953+0000","last_active":"2024-09-12T01:37:54.594953+0000","last_peered":"2024-09-12T01:37:54.594953+0000","last_clean":"2024-09-12T01:37:54.594953+0000","last_became_active":"2024-09-12T00:25:00.468228+0000","last_became_peered":"2024-09-12T00:25:00.468228+0000","last_unstale":"2024-09-12T01:37:54.594953+0000","last_undegraded":"2024-09-12T01:37:54.594953+0000","last_fullsized":"2024-09-12T01:37:54.594953+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'287","last_scrub_stamp":"2024-09-12T01:37:54.594827+0000","last_deep_scrub":"266'287","last_deep_scrub_stamp":"2024-09-12T01:37:54.594827+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.594827+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:15.134217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":681,"num_read_kb":67032,"num_write":1230,"num_write_kb":28377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'949","reported_seq":2514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:23.490891+0000","last_change":"2024-09-12T00:25:02.476025+0000","last_active":"2024-09-12T01:35:23.490891+0000","last_peered":"2024-09-12T01:35:23.490891+0000","last_clean":"2024-09-12T01:35:23.490891+0000","last_became_active":"2024-09-12T00:25:02.473441+0000","last_became_peered":"2024-09-12T00:25:02.473441+0000","last_unstale":"2024-09-12T01:35:23.490891+0000","last_undegraded":"2024-09-12T01:35:23.490891+0000","last_fullsized":"2024-09-12T01:35:23.490891+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:01.441681+0000","last_clean_scrub_stamp":"2024-09-12T00:25:01.441681+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":900,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:50.101335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4462,"num_read_kb":3929,"num_write":1316,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'215","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.822790+0000","last_change":"2024-09-12T01:37:46.822790+0000","last_active":"2024-09-12T01:37:46.822790+0000","last_peered":"2024-09-12T01:37:46.822790+0000","last_clean":"2024-09-12T01:37:46.822790+0000","last_became_active":"2024-09-12T00:25:00.465127+0000","last_became_peered":"2024-09-12T00:25:00.465127+0000","last_unstale":"2024-09-12T01:37:46.822790+0000","last_undegraded":"2024-09-12T01:37:46.822790+0000","last_fullsized":"2024-09-12T01:37:46.822790+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'215","last_scrub_stamp":"2024-09-12T01:37:46.822705+0000","last_deep_scrub":"266'215","last_deep_scrub_stamp":"2024-09-12T01:37:46.822705+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.822705+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:52.870895+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":16638,"num_write":1049,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'829","reported_seq":2458,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.894009+0000","last_change":"2024-09-12T01:37:53.894009+0000","last_active":"2024-09-12T01:37:53.894009+0000","last_peered":"2024-09-12T01:37:53.894009+0000","last_clean":"2024-09-12T01:37:53.894009+0000","last_became_active":"2024-09-12T00:25:02.464386+0000","last_became_peered":"2024-09-12T00:25:02.464386+0000","last_unstale":"2024-09-12T01:37:53.894009+0000","last_undegraded":"2024-09-12T01:37:53.894009+0000","last_fullsized":"2024-09-12T01:37:53.894009+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'829","last_scrub_stamp":"2024-09-12T01:37:53.893911+0000","last_deep_scrub":"266'829","last_deep_scrub_stamp":"2024-09-12T01:37:53.893911+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.893911+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:08.882315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3522,"num_write":1059,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'166","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.385520+0000","last_change":"2024-09-12T01:37:53.385520+0000","last_active":"2024-09-12T01:37:53.385520+0000","last_peered":"2024-09-12T01:37:53.385520+0000","last_clean":"2024-09-12T01:37:53.385520+0000","last_became_active":"2024-09-12T00:25:00.465400+0000","last_became_peered":"2024-09-12T00:25:00.465400+0000","last_unstale":"2024-09-12T01:37:53.385520+0000","last_undegraded":"2024-09-12T01:37:53.385520+0000","last_fullsized":"2024-09-12T01:37:53.385520+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'166","last_scrub_stamp":"2024-09-12T01:37:53.385357+0000","last_deep_scrub":"266'166","last_deep_scrub_stamp":"2024-09-12T01:37:53.385357+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.385357+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:28.894338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":4582,"num_write":828,"num_write_kb":26519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'783","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.880976+0000","last_change":"2024-09-12T01:37:52.880976+0000","last_active":"2024-09-12T01:37:52.880976+0000","last_peered":"2024-09-12T01:37:52.880976+0000","last_clean":"2024-09-12T01:37:52.880976+0000","last_became_active":"2024-09-12T00:25:02.469046+0000","last_became_peered":"2024-09-12T00:25:02.469046+0000","last_unstale":"2024-09-12T01:37:52.880976+0000","last_undegraded":"2024-09-12T01:37:52.880976+0000","last_fullsized":"2024-09-12T01:37:52.880976+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'783","last_scrub_stamp":"2024-09-12T01:37:52.880841+0000","last_deep_scrub":"266'783","last_deep_scrub_stamp":"2024-09-12T01:37:52.880841+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.880841+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:39.288474+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3834,"num_read_kb":3478,"num_write":1008,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2140,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'208","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.906129+0000","last_change":"2024-09-12T01:37:46.906129+0000","last_active":"2024-09-12T01:37:46.906129+0000","last_peered":"2024-09-12T01:37:46.906129+0000","last_clean":"2024-09-12T01:37:46.906129+0000","last_became_active":"2024-09-12T00:25:00.468581+0000","last_became_peered":"2024-09-12T00:25:00.468581+0000","last_unstale":"2024-09-12T01:37:46.906129+0000","last_undegraded":"2024-09-12T01:37:46.906129+0000","last_fullsized":"2024-09-12T01:37:46.906129+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:37:46.906027+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:37:46.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.906027+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:01.027597+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323902,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":48643,"num_write":1011,"num_write_kb":19361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'801","reported_seq":2374,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.444482+0000","last_change":"2024-09-12T01:37:55.444482+0000","last_active":"2024-09-12T01:37:55.444482+0000","last_peered":"2024-09-12T01:37:55.444482+0000","last_clean":"2024-09-12T01:37:55.444482+0000","last_became_active":"2024-09-12T00:25:02.476825+0000","last_became_peered":"2024-09-12T00:25:02.476825+0000","last_unstale":"2024-09-12T01:37:55.444482+0000","last_undegraded":"2024-09-12T01:37:55.444482+0000","last_fullsized":"2024-09-12T01:37:55.444482+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T01:37:55.444397+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T01:37:55.444397+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.444397+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:39.143798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3888,"num_read_kb":3500,"num_write":1075,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'188","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.077782+0000","last_change":"2024-09-12T01:37:58.077782+0000","last_active":"2024-09-12T01:37:58.077782+0000","last_peered":"2024-09-12T01:37:58.077782+0000","last_clean":"2024-09-12T01:37:58.077782+0000","last_became_active":"2024-09-12T00:25:00.480122+0000","last_became_peered":"2024-09-12T00:25:00.480122+0000","last_unstale":"2024-09-12T01:37:58.077782+0000","last_undegraded":"2024-09-12T01:37:58.077782+0000","last_fullsized":"2024-09-12T01:37:58.077782+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:58.077623+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:58.077623+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.077623+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:26.959203+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399183,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":553,"num_read_kb":7914,"num_write":895,"num_write_kb":29144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'692","reported_seq":2154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.377713+0000","last_change":"2024-09-12T01:37:58.377713+0000","last_active":"2024-09-12T01:37:58.377713+0000","last_peered":"2024-09-12T01:37:58.377713+0000","last_clean":"2024-09-12T01:37:58.377713+0000","last_became_active":"2024-09-12T00:25:02.465790+0000","last_became_peered":"2024-09-12T00:25:02.465790+0000","last_unstale":"2024-09-12T01:37:58.377713+0000","last_undegraded":"2024-09-12T01:37:58.377713+0000","last_fullsized":"2024-09-12T01:37:58.377713+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'692","last_scrub_stamp":"2024-09-12T01:37:58.377612+0000","last_deep_scrub":"266'692","last_deep_scrub_stamp":"2024-09-12T01:37:58.377612+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.377612+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:21.790646+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3268,"num_read_kb":2971,"num_write":903,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'258","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.401918+0000","last_change":"2024-09-12T01:37:51.401918+0000","last_active":"2024-09-12T01:37:51.401918+0000","last_peered":"2024-09-12T01:37:51.401918+0000","last_clean":"2024-09-12T01:37:51.401918+0000","last_became_active":"2024-09-12T00:25:00.469634+0000","last_became_peered":"2024-09-12T00:25:00.469634+0000","last_unstale":"2024-09-12T01:37:51.401918+0000","last_undegraded":"2024-09-12T01:37:51.401918+0000","last_fullsized":"2024-09-12T01:37:51.401918+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'258","last_scrub_stamp":"2024-09-12T01:37:51.401778+0000","last_deep_scrub":"266'258","last_deep_scrub_stamp":"2024-09-12T01:37:51.401778+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.401778+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:00.034860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155756,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1718,"num_write":1162,"num_write_kb":27079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'436","reported_seq":2052,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.872718+0000","last_change":"2024-09-12T01:37:51.872718+0000","last_active":"2024-09-12T01:37:51.872718+0000","last_peered":"2024-09-12T01:37:51.872718+0000","last_clean":"2024-09-12T01:37:51.872718+0000","last_became_active":"2024-09-12T00:25:02.464112+0000","last_became_peered":"2024-09-12T00:25:02.464112+0000","last_unstale":"2024-09-12T01:37:51.872718+0000","last_undegraded":"2024-09-12T01:37:51.872718+0000","last_fullsized":"2024-09-12T01:37:51.872718+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'436","last_scrub_stamp":"2024-09-12T01:37:51.872608+0000","last_deep_scrub":"266'436","last_deep_scrub_stamp":"2024-09-12T01:37:51.872608+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.872608+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:01.236298+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2410,"num_read_kb":2284,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'226","reported_seq":884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.008992+0000","last_change":"2024-09-12T01:38:00.008992+0000","last_active":"2024-09-12T01:38:00.008992+0000","last_peered":"2024-09-12T01:38:00.008992+0000","last_clean":"2024-09-12T01:38:00.008992+0000","last_became_active":"2024-09-12T00:25:00.468600+0000","last_became_peered":"2024-09-12T00:25:00.468600+0000","last_unstale":"2024-09-12T01:38:00.008992+0000","last_undegraded":"2024-09-12T01:38:00.008992+0000","last_fullsized":"2024-09-12T01:38:00.008992+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:38:00.008790+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:38:00.008790+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.008790+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:56.789743+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133763,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":7263,"num_write":1147,"num_write_kb":27569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'182","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.002937+0000","last_change":"2024-09-12T01:38:01.002937+0000","last_active":"2024-09-12T01:38:01.002937+0000","last_peered":"2024-09-12T01:38:01.002937+0000","last_clean":"2024-09-12T01:38:01.002937+0000","last_became_active":"2024-09-12T00:25:00.469382+0000","last_became_peered":"2024-09-12T00:25:00.469382+0000","last_unstale":"2024-09-12T01:38:01.002937+0000","last_undegraded":"2024-09-12T01:38:01.002937+0000","last_fullsized":"2024-09-12T01:38:01.002937+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'182","last_scrub_stamp":"2024-09-12T01:38:01.002819+0000","last_deep_scrub":"266'182","last_deep_scrub_stamp":"2024-09-12T01:38:01.002819+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.002819+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:33.648707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":14411,"num_write":860,"num_write_kb":23706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'918","reported_seq":2496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.350546+0000","last_change":"2024-09-12T01:38:00.350546+0000","last_active":"2024-09-12T01:38:00.350546+0000","last_peered":"2024-09-12T01:38:00.350546+0000","last_clean":"2024-09-12T01:38:00.350546+0000","last_became_active":"2024-09-12T00:25:02.475004+0000","last_became_peered":"2024-09-12T00:25:02.475004+0000","last_unstale":"2024-09-12T01:38:00.350546+0000","last_undegraded":"2024-09-12T01:38:00.350546+0000","last_fullsized":"2024-09-12T01:38:00.350546+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'918","last_scrub_stamp":"2024-09-12T01:38:00.350456+0000","last_deep_scrub":"266'918","last_deep_scrub_stamp":"2024-09-12T01:38:00.350456+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.350456+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:25.819056+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4224,"num_read_kb":3778,"num_write":1247,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'230","reported_seq":963,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.567919+0000","last_change":"2024-09-12T01:37:55.567919+0000","last_active":"2024-09-12T01:37:55.567919+0000","last_peered":"2024-09-12T01:37:55.567919+0000","last_clean":"2024-09-12T01:37:55.567919+0000","last_became_active":"2024-09-12T00:25:00.471411+0000","last_became_peered":"2024-09-12T00:25:00.471411+0000","last_unstale":"2024-09-12T01:37:55.567919+0000","last_undegraded":"2024-09-12T01:37:55.567919+0000","last_fullsized":"2024-09-12T01:37:55.567919+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'230","last_scrub_stamp":"2024-09-12T01:37:55.567768+0000","last_deep_scrub":"266'230","last_deep_scrub_stamp":"2024-09-12T01:37:55.567768+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.567768+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:16.993814+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323861,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":157504,"num_write":954,"num_write_kb":45267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'651","reported_seq":2402,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.941466+0000","last_change":"2024-09-12T01:37:56.941466+0000","last_active":"2024-09-12T01:37:56.941466+0000","last_peered":"2024-09-12T01:37:56.941466+0000","last_clean":"2024-09-12T01:37:56.941466+0000","last_became_active":"2024-09-12T00:25:02.462993+0000","last_became_peered":"2024-09-12T00:25:02.462993+0000","last_unstale":"2024-09-12T01:37:56.941466+0000","last_undegraded":"2024-09-12T01:37:56.941466+0000","last_fullsized":"2024-09-12T01:37:56.941466+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'651","last_scrub_stamp":"2024-09-12T01:37:56.941361+0000","last_deep_scrub":"266'651","last_deep_scrub_stamp":"2024-09-12T01:37:56.941361+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.941361+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:04.170101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3586,"num_read_kb":3293,"num_write":883,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1767,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5955,"num_read_kb":4160,"num_write":1937,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1008,"ondisk_log_size":1008,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15084,"num_read_kb":14735,"num_write":16735,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1466,"ondisk_log_size":1466,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":676,"ondisk_log_size":676,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":318753,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":10187,"num_read_kb":12369,"num_write":7087,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":519012,"num_omap_keys":1198,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1642,"ondisk_log_size":1642,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2373,"num_read_kb":2833,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15,"ondisk_log_size":15,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212728,"num_read_kb":194072,"num_write":55276,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":36560,"num_omap_keys":149,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4231,"ondisk_log_size":4231,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":79547187,"num_objects":235,"num_object_clones":0,"num_object_copies":940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":235,"num_whiteouts":0,"num_read":33257,"num_read_kb":1810768,"num_write":62815,"num_write_kb":1904228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108691456,"data_stored":108691456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4112,"ondisk_log_size":4112,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":174385,"num_write":182,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":174274,"num_write":182,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477624,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":141120,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":125566,"kb_avail":94230720,"statfs":{"total":96636764160,"available":96492257280,"internally_reserved":0,"allocated":15908864,"data_stored":13922526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":128580037},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477622,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136056,"kb_used_data":24360,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94235784,"statfs":{"total":96636764160,"available":96497442816,"internally_reserved":0,"allocated":24944640,"data_stored":22945833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424510327,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214292,"kb_used_data":16580,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94157548,"statfs":{"total":96636764160,"available":96417329152,"internally_reserved":0,"allocated":16977920,"data_stored":14990871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510325,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106896,"kb_used_data":17408,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94264944,"statfs":{"total":96636764160,"available":96527302656,"internally_reserved":0,"allocated":17825792,"data_stored":15808424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510326,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239100,"kb_used_data":13548,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94132740,"statfs":{"total":96636764160,"available":96391925760,"internally_reserved":0,"allocated":13873152,"data_stored":11862637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510327,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253088,"kb_used_data":19216,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94118752,"statfs":{"total":96636764160,"available":96377602048,"internally_reserved":0,"allocated":19677184,"data_stored":17673901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510327,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291176,"kb_used_data":17048,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94080664,"statfs":{"total":96636764160,"available":96338599936,"internally_reserved":0,"allocated":17457152,"data_stored":15457736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575738,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188040,"kb_used_data":16696,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94183800,"statfs":{"total":96636764160,"available":96444211200,"internally_reserved":0,"allocated":17096704,"data_stored":15102370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20709376,"data_stored":20709376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12632064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11685888,"data_stored":11685888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15437824,"data_stored":15437824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12865536,"data_stored":12865536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9035776,"data_stored":9035776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13570048,"data_stored":13570048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12754944,"data_stored":12754944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:07.592 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.593 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.593 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.593 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.593 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.593 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.593 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.593 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.593 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.593 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.594 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.594 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.594 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.594 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.594 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.594 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.594 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.594 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.594 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.595 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.595 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.595 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.595 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.595 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.595 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.595 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.595 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.595 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.596 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.596 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.596 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.596 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.596 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.596 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.596 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.596 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.596 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.597 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.597 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.597 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.597 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.597 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.597 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.597 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.597 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.597 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.597 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.598 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.598 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.598 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.598 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.598 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.598 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.598 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.598 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.598 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.599 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.599 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.599 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.599 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.599 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.599 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.599 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.599 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.599 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.600 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.600 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.600 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.600 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.600 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.600 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.600 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.600 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.600 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.600 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.601 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.601 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.601 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.601 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.601 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.601 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.601 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.601 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.601 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.602 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.602 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.602 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.602 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.602 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.602 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.602 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.602 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.602 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.603 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.603 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.603 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.603 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.603 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.603 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.603 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.603 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.603 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.604 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.604 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.604 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.604 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.604 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.604 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.604 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.604 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.604 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.605 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.605 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.605 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.605 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.605 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.605 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.605 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.605 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.605 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.605 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.606 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.606 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.606 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.606 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.606 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.606 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.606 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.606 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.607 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.607 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.607 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.607 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.607 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.607 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.607 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.608 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.608 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.608 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.608 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.608 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.608 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.608 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.608 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.609 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.609 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.609 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.609 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.609 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.609 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.609 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.609 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.610 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.610 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.610 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.610 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.610 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.610 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.610 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.610 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.611 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.611 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.611 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.611 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.611 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.611 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.611 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.611 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.612 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.612 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.612 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.612 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.612 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.612 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.612 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.613 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.613 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.613 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.613 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.613 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.613 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.613 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.613 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.614 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.614 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.614 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.614 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.614 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.614 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.614 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.615 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.615 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.615 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.615 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.615 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.615 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.615 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.615 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.616 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.616 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.616 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.616 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.616 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.616 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.616 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.616 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.617 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.617 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.617 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.617 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.617 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.617 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.617 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.617 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.618 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.618 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.618 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.618 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.618 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.618 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.618 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.618 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.619 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.619 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.619 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.619 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.619 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.619 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.619 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.619 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.620 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.620 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.620 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:25:03.458751+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=3, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.620 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:25:05.468903+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=5, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.620 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.620 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.620 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.621 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:25:01.441681+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=1, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:07.621 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:38:27.623 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:27.974 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:38:27.986 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:38:27.988 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":2473,"stamp":"2024-09-12T01:38:26.788683+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80473315,"num_objects":722,"num_object_clones":0,"num_object_copies":1914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":279991,"num_read_kb":2387663,"num_write":144355,"num_write_kb":2165314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":727503,"num_omap_keys":1770,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13620,"ondisk_log_size":13620,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1573928,"kb_used_data":140392,"kb_used_omap":12,"kb_used_meta":1433395,"kb_avail":753400792,"statfs":{"total":773094113280,"available":771482411008,"internally_reserved":0,"allocated":143761408,"data_stored":127764298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1467797040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":130141,"num_omap_keys":319,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005837"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.805310+0000","last_change":"2024-09-12T01:38:21.805310+0000","last_active":"2024-09-12T01:38:21.805310+0000","last_peered":"2024-09-12T01:38:21.805310+0000","last_clean":"2024-09-12T01:38:21.805310+0000","last_became_active":"2024-09-12T01:02:03.925687+0000","last_became_peered":"2024-09-12T01:02:03.925687+0000","last_unstale":"2024-09-12T01:38:21.805310+0000","last_undegraded":"2024-09-12T01:38:21.805310+0000","last_fullsized":"2024-09-12T01:38:21.805310+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:21.805216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:21.805216+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.805216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:35.927340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.786824+0000","last_change":"2024-09-12T01:38:18.786824+0000","last_active":"2024-09-12T01:38:18.786824+0000","last_peered":"2024-09-12T01:38:18.786824+0000","last_clean":"2024-09-12T01:38:18.786824+0000","last_became_active":"2024-09-12T00:43:43.812701+0000","last_became_peered":"2024-09-12T00:43:43.812701+0000","last_unstale":"2024-09-12T01:38:18.786824+0000","last_undegraded":"2024-09-12T01:38:18.786824+0000","last_fullsized":"2024-09-12T01:38:18.786824+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:18.786735+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:18.786735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.786735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:25.075328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:40.110512+0000","last_change":"2024-09-12T00:43:38.799582+0000","last_active":"2024-09-12T01:33:40.110512+0000","last_peered":"2024-09-12T01:33:40.110512+0000","last_clean":"2024-09-12T01:33:40.110512+0000","last_became_active":"2024-09-12T00:43:38.799322+0000","last_became_peered":"2024-09-12T00:43:38.799322+0000","last_unstale":"2024-09-12T01:33:40.110512+0000","last_undegraded":"2024-09-12T01:33:40.110512+0000","last_fullsized":"2024-09-12T01:33:40.110512+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:52.804800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:32.256826+0000","last_change":"2024-09-12T00:39:17.764042+0000","last_active":"2024-09-12T01:35:32.256826+0000","last_peered":"2024-09-12T01:35:32.256826+0000","last_clean":"2024-09-12T01:35:32.256826+0000","last_became_active":"2024-09-12T00:39:17.763761+0000","last_became_peered":"2024-09-12T00:39:17.763761+0000","last_unstale":"2024-09-12T01:35:32.256826+0000","last_undegraded":"2024-09-12T01:35:32.256826+0000","last_fullsized":"2024-09-12T01:35:32.256826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:49.430258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.175890+0000","last_change":"2024-09-12T01:02:03.925619+0000","last_active":"2024-09-12T01:34:34.175890+0000","last_peered":"2024-09-12T01:34:34.175890+0000","last_clean":"2024-09-12T01:34:34.175890+0000","last_became_active":"2024-09-12T01:02:03.925338+0000","last_became_peered":"2024-09-12T01:02:03.925338+0000","last_unstale":"2024-09-12T01:34:34.175890+0000","last_undegraded":"2024-09-12T01:34:34.175890+0000","last_fullsized":"2024-09-12T01:34:34.175890+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:52:34.463430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"266'5","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:15.095648+0000","last_change":"2024-09-12T00:43:43.822539+0000","last_active":"2024-09-12T01:36:15.095648+0000","last_peered":"2024-09-12T01:36:15.095648+0000","last_clean":"2024-09-12T01:36:15.095648+0000","last_became_active":"2024-09-12T00:43:43.822189+0000","last_became_peered":"2024-09-12T00:43:43.822189+0000","last_unstale":"2024-09-12T01:36:15.095648+0000","last_undegraded":"2024-09-12T01:36:15.095648+0000","last_fullsized":"2024-09-12T01:36:15.095648+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:14.331070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987382+0000","last_change":"2024-09-12T00:43:38.794157+0000","last_active":"2024-09-12T01:33:38.987382+0000","last_peered":"2024-09-12T01:33:38.987382+0000","last_clean":"2024-09-12T01:33:38.987382+0000","last_became_active":"2024-09-12T00:43:38.793866+0000","last_became_peered":"2024-09-12T00:43:38.793866+0000","last_unstale":"2024-09-12T01:33:38.987382+0000","last_undegraded":"2024-09-12T01:33:38.987382+0000","last_fullsized":"2024-09-12T01:33:38.987382+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:51.874866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'33","reported_seq":147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256146+0000","last_change":"2024-09-12T00:39:17.769275+0000","last_active":"2024-09-12T01:35:27.256146+0000","last_peered":"2024-09-12T01:35:27.256146+0000","last_clean":"2024-09-12T01:35:27.256146+0000","last_became_active":"2024-09-12T00:39:17.768977+0000","last_became_peered":"2024-09-12T00:39:17.768977+0000","last_unstale":"2024-09-12T01:35:27.256146+0000","last_undegraded":"2024-09-12T01:35:27.256146+0000","last_fullsized":"2024-09-12T01:35:27.256146+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:10.855870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":119,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.830116+0000","last_change":"2024-09-12T01:38:19.830116+0000","last_active":"2024-09-12T01:38:19.830116+0000","last_peered":"2024-09-12T01:38:19.830116+0000","last_clean":"2024-09-12T01:38:19.830116+0000","last_became_active":"2024-09-12T01:02:03.921938+0000","last_became_peered":"2024-09-12T01:02:03.921938+0000","last_unstale":"2024-09-12T01:38:19.830116+0000","last_undegraded":"2024-09-12T01:38:19.830116+0000","last_fullsized":"2024-09-12T01:38:19.830116+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:19.830021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:19.830021+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.830021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:30.470507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"266'6","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.576973+0000","last_change":"2024-09-12T00:43:43.814192+0000","last_active":"2024-09-12T01:37:38.576973+0000","last_peered":"2024-09-12T01:37:38.576973+0000","last_clean":"2024-09-12T01:37:38.576973+0000","last_became_active":"2024-09-12T00:43:43.813568+0000","last_became_peered":"2024-09-12T00:43:43.813568+0000","last_unstale":"2024-09-12T01:37:38.576973+0000","last_undegraded":"2024-09-12T01:37:38.576973+0000","last_fullsized":"2024-09-12T01:37:38.576973+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7172,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'7","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.623425+0000","last_change":"2024-09-12T01:38:24.623425+0000","last_active":"2024-09-12T01:38:24.623425+0000","last_peered":"2024-09-12T01:38:24.623425+0000","last_clean":"2024-09-12T01:38:24.623425+0000","last_became_active":"2024-09-12T00:43:38.797520+0000","last_became_peered":"2024-09-12T00:43:38.797520+0000","last_unstale":"2024-09-12T01:38:24.623425+0000","last_undegraded":"2024-09-12T01:38:24.623425+0000","last_fullsized":"2024-09-12T01:38:24.623425+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T01:38:24.623344+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T01:38:24.623344+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.623344+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:12.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16390,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'41","reported_seq":179,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.446692+0000","last_change":"2024-09-12T01:38:20.446692+0000","last_active":"2024-09-12T01:38:20.446692+0000","last_peered":"2024-09-12T01:38:20.446692+0000","last_clean":"2024-09-12T01:38:20.446692+0000","last_became_active":"2024-09-12T00:39:17.768692+0000","last_became_peered":"2024-09-12T00:39:17.768692+0000","last_unstale":"2024-09-12T01:38:20.446692+0000","last_undegraded":"2024-09-12T01:38:20.446692+0000","last_fullsized":"2024-09-12T01:38:20.446692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:38:20.446587+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:38:20.446587+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.446587+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:25.292094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":161,"num_write":65,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:33:38.987313+0000","last_change":"2024-09-12T01:02:03.922647+0000","last_active":"2024-09-12T01:33:38.987313+0000","last_peered":"2024-09-12T01:33:38.987313+0000","last_clean":"2024-09-12T01:33:38.987313+0000","last_became_active":"2024-09-12T01:02:03.922297+0000","last_became_peered":"2024-09-12T01:02:03.922297+0000","last_unstale":"2024-09-12T01:33:38.987313+0000","last_undegraded":"2024-09-12T01:33:38.987313+0000","last_fullsized":"2024-09-12T01:33:38.987313+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:37.846980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:54.009642+0000","last_change":"2024-09-12T00:43:43.819023+0000","last_active":"2024-09-12T01:35:54.009642+0000","last_peered":"2024-09-12T01:35:54.009642+0000","last_clean":"2024-09-12T01:35:54.009642+0000","last_became_active":"2024-09-12T00:43:43.818668+0000","last_became_peered":"2024-09-12T00:43:43.818668+0000","last_unstale":"2024-09-12T01:35:54.009642+0000","last_undegraded":"2024-09-12T01:35:54.009642+0000","last_fullsized":"2024-09-12T01:35:54.009642+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.800578+0000","last_change":"2024-09-12T01:38:16.800578+0000","last_active":"2024-09-12T01:38:16.800578+0000","last_peered":"2024-09-12T01:38:16.800578+0000","last_clean":"2024-09-12T01:38:16.800578+0000","last_became_active":"2024-09-12T00:43:38.794121+0000","last_became_peered":"2024-09-12T00:43:38.794121+0000","last_unstale":"2024-09-12T01:38:16.800578+0000","last_undegraded":"2024-09-12T01:38:16.800578+0000","last_fullsized":"2024-09-12T01:38:16.800578+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.800478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.800478+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.800478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:59.159347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'16","reported_seq":101,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.479563+0000","last_change":"2024-09-12T01:38:19.479563+0000","last_active":"2024-09-12T01:38:19.479563+0000","last_peered":"2024-09-12T01:38:19.479563+0000","last_clean":"2024-09-12T01:38:19.479563+0000","last_became_active":"2024-09-12T00:39:17.759016+0000","last_became_peered":"2024-09-12T00:39:17.759016+0000","last_unstale":"2024-09-12T01:38:19.479563+0000","last_undegraded":"2024-09-12T01:38:19.479563+0000","last_fullsized":"2024-09-12T01:38:19.479563+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-12T01:38:19.479475+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-12T01:38:19.479475+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.479475+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:07.899876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:15.133311+0000","last_change":"2024-09-12T01:02:03.919665+0000","last_active":"2024-09-12T01:36:15.133311+0000","last_peered":"2024-09-12T01:36:15.133311+0000","last_clean":"2024-09-12T01:36:15.133311+0000","last_became_active":"2024-09-12T01:02:03.919293+0000","last_became_peered":"2024-09-12T01:02:03.919293+0000","last_unstale":"2024-09-12T01:36:15.133311+0000","last_undegraded":"2024-09-12T01:36:15.133311+0000","last_fullsized":"2024-09-12T01:36:15.133311+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.732052+0000","last_change":"2024-09-12T01:38:15.732052+0000","last_active":"2024-09-12T01:38:15.732052+0000","last_peered":"2024-09-12T01:38:15.732052+0000","last_clean":"2024-09-12T01:38:15.732052+0000","last_became_active":"2024-09-12T00:43:43.817714+0000","last_became_peered":"2024-09-12T00:43:43.817714+0000","last_unstale":"2024-09-12T01:38:15.732052+0000","last_undegraded":"2024-09-12T01:38:15.732052+0000","last_fullsized":"2024-09-12T01:38:15.732052+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:15.731960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:15.731960+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.731960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:50.516937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'15","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:49.017973+0000","last_change":"2024-09-12T00:43:38.795483+0000","last_active":"2024-09-12T01:36:49.017973+0000","last_peered":"2024-09-12T01:36:49.017973+0000","last_clean":"2024-09-12T01:36:49.017973+0000","last_became_active":"2024-09-12T00:43:38.795206+0000","last_became_peered":"2024-09-12T00:43:38.795206+0000","last_unstale":"2024-09-12T01:36:49.017973+0000","last_undegraded":"2024-09-12T01:36:49.017973+0000","last_fullsized":"2024-09-12T01:36:49.017973+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:51.351578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":29708,"num_write":20,"num_write_kb":14332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'31","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.453395+0000","last_change":"2024-09-12T01:38:18.453395+0000","last_active":"2024-09-12T01:38:18.453395+0000","last_peered":"2024-09-12T01:38:18.453395+0000","last_clean":"2024-09-12T01:38:18.453395+0000","last_became_active":"2024-09-12T00:39:17.762124+0000","last_became_peered":"2024-09-12T00:39:17.762124+0000","last_unstale":"2024-09-12T01:38:18.453395+0000","last_undegraded":"2024-09-12T01:38:18.453395+0000","last_fullsized":"2024-09-12T01:38:18.453395+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'31","last_scrub_stamp":"2024-09-12T01:38:18.453318+0000","last_deep_scrub":"266'31","last_deep_scrub_stamp":"2024-09-12T01:38:18.453318+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.453318+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:29.847076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:27.256179+0000","last_change":"2024-09-12T01:02:03.915670+0000","last_active":"2024-09-12T01:35:27.256179+0000","last_peered":"2024-09-12T01:35:27.256179+0000","last_clean":"2024-09-12T01:35:27.256179+0000","last_became_active":"2024-09-12T01:02:03.915387+0000","last_became_peered":"2024-09-12T01:02:03.915387+0000","last_unstale":"2024-09-12T01:35:27.256179+0000","last_undegraded":"2024-09-12T01:35:27.256179+0000","last_fullsized":"2024-09-12T01:35:27.256179+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:30.278716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529511+0000","last_change":"2024-09-12T00:43:43.825343+0000","last_active":"2024-09-12T01:34:29.529511+0000","last_peered":"2024-09-12T01:34:29.529511+0000","last_clean":"2024-09-12T01:34:29.529511+0000","last_became_active":"2024-09-12T00:43:43.825054+0000","last_became_peered":"2024-09-12T00:43:43.825054+0000","last_unstale":"2024-09-12T01:34:29.529511+0000","last_undegraded":"2024-09-12T01:34:29.529511+0000","last_fullsized":"2024-09-12T01:34:29.529511+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:57.949570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:54.547748+0000","last_change":"2024-09-12T00:43:38.794955+0000","last_active":"2024-09-12T01:36:54.547748+0000","last_peered":"2024-09-12T01:36:54.547748+0000","last_clean":"2024-09-12T01:36:54.547748+0000","last_became_active":"2024-09-12T00:43:38.794612+0000","last_became_peered":"2024-09-12T00:43:38.794612+0000","last_unstale":"2024-09-12T01:36:54.547748+0000","last_undegraded":"2024-09-12T01:36:54.547748+0000","last_fullsized":"2024-09-12T01:36:54.547748+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:55.593800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'16","reported_seq":100,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.519607+0000","last_change":"2024-09-12T01:38:20.519607+0000","last_active":"2024-09-12T01:38:20.519607+0000","last_peered":"2024-09-12T01:38:20.519607+0000","last_clean":"2024-09-12T01:38:20.519607+0000","last_became_active":"2024-09-12T00:39:17.771839+0000","last_became_peered":"2024-09-12T00:39:17.771839+0000","last_unstale":"2024-09-12T01:38:20.519607+0000","last_undegraded":"2024-09-12T01:38:20.519607+0000","last_fullsized":"2024-09-12T01:38:20.519607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'16","last_scrub_stamp":"2024-09-12T01:38:20.519518+0000","last_deep_scrub":"266'16","last_deep_scrub_stamp":"2024-09-12T01:38:20.519518+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.519518+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:51.296931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":43,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.084810+0000","last_change":"2024-09-12T01:02:03.928338+0000","last_active":"2024-09-12T01:34:35.084810+0000","last_peered":"2024-09-12T01:34:35.084810+0000","last_clean":"2024-09-12T01:34:35.084810+0000","last_became_active":"2024-09-12T01:02:03.928036+0000","last_became_peered":"2024-09-12T01:02:03.928036+0000","last_unstale":"2024-09-12T01:34:35.084810+0000","last_undegraded":"2024-09-12T01:34:35.084810+0000","last_fullsized":"2024-09-12T01:34:35.084810+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:58.545326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.544523+0000","last_change":"2024-09-12T01:38:24.544523+0000","last_active":"2024-09-12T01:38:24.544523+0000","last_peered":"2024-09-12T01:38:24.544523+0000","last_clean":"2024-09-12T01:38:24.544523+0000","last_became_active":"2024-09-12T00:43:43.819239+0000","last_became_peered":"2024-09-12T00:43:43.819239+0000","last_unstale":"2024-09-12T01:38:24.544523+0000","last_undegraded":"2024-09-12T01:38:24.544523+0000","last_fullsized":"2024-09-12T01:38:24.544523+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T01:38:24.544436+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T01:38:24.544436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.544436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:00.709590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8210,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"266'10","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.776399+0000","last_change":"2024-09-12T01:38:14.776399+0000","last_active":"2024-09-12T01:38:14.776399+0000","last_peered":"2024-09-12T01:38:14.776399+0000","last_clean":"2024-09-12T01:38:14.776399+0000","last_became_active":"2024-09-12T00:43:38.784746+0000","last_became_peered":"2024-09-12T00:43:38.784746+0000","last_unstale":"2024-09-12T01:38:14.776399+0000","last_undegraded":"2024-09-12T01:38:14.776399+0000","last_fullsized":"2024-09-12T01:38:14.776399+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T01:38:14.776310+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T01:38:14.776310+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.776310+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:21.911864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"257'30","reported_seq":151,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.627333+0000","last_change":"2024-09-12T01:38:17.627333+0000","last_active":"2024-09-12T01:38:17.627333+0000","last_peered":"2024-09-12T01:38:17.627333+0000","last_clean":"2024-09-12T01:38:17.627333+0000","last_became_active":"2024-09-12T00:39:17.764658+0000","last_became_peered":"2024-09-12T00:39:17.764658+0000","last_unstale":"2024-09-12T01:38:17.627333+0000","last_undegraded":"2024-09-12T01:38:17.627333+0000","last_fullsized":"2024-09-12T01:38:17.627333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'30","last_scrub_stamp":"2024-09-12T01:38:17.627235+0000","last_deep_scrub":"257'30","last_deep_scrub_stamp":"2024-09-12T01:38:17.627235+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.627235+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:49.790642+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":139,"num_write":41,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.785618+0000","last_change":"2024-09-12T01:38:22.785618+0000","last_active":"2024-09-12T01:38:22.785618+0000","last_peered":"2024-09-12T01:38:22.785618+0000","last_clean":"2024-09-12T01:38:22.785618+0000","last_became_active":"2024-09-12T01:02:03.917362+0000","last_became_peered":"2024-09-12T01:02:03.917362+0000","last_unstale":"2024-09-12T01:38:22.785618+0000","last_undegraded":"2024-09-12T01:38:22.785618+0000","last_fullsized":"2024-09-12T01:38:22.785618+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.785529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.785529+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.785529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:28.459935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"266'8","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.668909+0000","last_change":"2024-09-12T00:43:43.822843+0000","last_active":"2024-09-12T01:37:38.668909+0000","last_peered":"2024-09-12T01:37:38.668909+0000","last_clean":"2024-09-12T01:37:38.668909+0000","last_became_active":"2024-09-12T00:43:43.822574+0000","last_became_peered":"2024-09-12T00:43:43.822574+0000","last_unstale":"2024-09-12T01:37:38.668909+0000","last_undegraded":"2024-09-12T01:37:38.668909+0000","last_fullsized":"2024-09-12T01:37:38.668909+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:31.603888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9228,"num_write":8,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.528218+0000","last_change":"2024-09-12T01:38:22.528218+0000","last_active":"2024-09-12T01:38:22.528218+0000","last_peered":"2024-09-12T01:38:22.528218+0000","last_clean":"2024-09-12T01:38:22.528218+0000","last_became_active":"2024-09-12T00:43:38.799567+0000","last_became_peered":"2024-09-12T00:43:38.799567+0000","last_unstale":"2024-09-12T01:38:22.528218+0000","last_undegraded":"2024-09-12T01:38:22.528218+0000","last_fullsized":"2024-09-12T01:38:22.528218+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:22.528132+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:22.528132+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.528132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:58.801800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'52","reported_seq":204,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.404113+0000","last_change":"2024-09-12T01:38:17.404113+0000","last_active":"2024-09-12T01:38:17.404113+0000","last_peered":"2024-09-12T01:38:17.404113+0000","last_clean":"2024-09-12T01:38:17.404113+0000","last_became_active":"2024-09-12T00:39:17.760735+0000","last_became_peered":"2024-09-12T00:39:17.760735+0000","last_unstale":"2024-09-12T01:38:17.404113+0000","last_undegraded":"2024-09-12T01:38:17.404113+0000","last_fullsized":"2024-09-12T01:38:17.404113+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'52","last_scrub_stamp":"2024-09-12T01:38:17.404030+0000","last_deep_scrub":"266'52","last_deep_scrub_stamp":"2024-09-12T01:38:17.404030+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.404030+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:24.515267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":192,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997802+0000","last_change":"2024-09-12T01:02:03.925249+0000","last_active":"2024-09-12T01:34:43.997802+0000","last_peered":"2024-09-12T01:34:43.997802+0000","last_clean":"2024-09-12T01:34:43.997802+0000","last_became_active":"2024-09-12T01:02:03.924800+0000","last_became_peered":"2024-09-12T01:02:03.924800+0000","last_unstale":"2024-09-12T01:34:43.997802+0000","last_undegraded":"2024-09-12T01:34:43.997802+0000","last_fullsized":"2024-09-12T01:34:43.997802+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:42.824392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:30.118030+0000","last_change":"2024-09-12T00:43:43.822402+0000","last_active":"2024-09-12T01:34:30.118030+0000","last_peered":"2024-09-12T01:34:30.118030+0000","last_clean":"2024-09-12T01:34:30.118030+0000","last_became_active":"2024-09-12T00:43:43.822130+0000","last_became_peered":"2024-09-12T00:43:43.822130+0000","last_unstale":"2024-09-12T01:34:30.118030+0000","last_undegraded":"2024-09-12T01:34:30.118030+0000","last_fullsized":"2024-09-12T01:34:30.118030+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:52.855759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533810+0000","last_change":"2024-09-12T00:43:38.789538+0000","last_active":"2024-09-12T01:35:04.533810+0000","last_peered":"2024-09-12T01:35:04.533810+0000","last_clean":"2024-09-12T01:35:04.533810+0000","last_became_active":"2024-09-12T00:43:38.789198+0000","last_became_peered":"2024-09-12T00:43:38.789198+0000","last_unstale":"2024-09-12T01:35:04.533810+0000","last_undegraded":"2024-09-12T01:35:04.533810+0000","last_fullsized":"2024-09-12T01:35:04.533810+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:11.316230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'15","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250354+0000","last_change":"2024-09-12T00:39:17.767969+0000","last_active":"2024-09-12T01:34:52.250354+0000","last_peered":"2024-09-12T01:34:52.250354+0000","last_clean":"2024-09-12T01:34:52.250354+0000","last_became_active":"2024-09-12T00:39:17.767662+0000","last_became_peered":"2024-09-12T00:39:17.767662+0000","last_unstale":"2024-09-12T01:34:52.250354+0000","last_undegraded":"2024-09-12T01:34:52.250354+0000","last_fullsized":"2024-09-12T01:34:52.250354+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:30.457902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:44.177191+0000","last_change":"2024-09-12T01:02:03.924577+0000","last_active":"2024-09-12T01:34:44.177191+0000","last_peered":"2024-09-12T01:34:44.177191+0000","last_clean":"2024-09-12T01:34:44.177191+0000","last_became_active":"2024-09-12T01:02:03.924303+0000","last_became_peered":"2024-09-12T01:02:03.924303+0000","last_unstale":"2024-09-12T01:34:44.177191+0000","last_undegraded":"2024-09-12T01:34:44.177191+0000","last_fullsized":"2024-09-12T01:34:44.177191+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:24.298478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'9","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.843719+0000","last_change":"2024-09-12T00:43:43.821003+0000","last_active":"2024-09-12T01:37:38.843719+0000","last_peered":"2024-09-12T01:37:38.843719+0000","last_clean":"2024-09-12T01:37:38.843719+0000","last_became_active":"2024-09-12T00:43:43.819058+0000","last_became_peered":"2024-09-12T00:43:43.819058+0000","last_unstale":"2024-09-12T01:37:38.843719+0000","last_undegraded":"2024-09-12T01:37:38.843719+0000","last_fullsized":"2024-09-12T01:37:38.843719+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:13:02.246750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9222,"num_write":14,"num_write_kb":9222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"266'8","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.796535+0000","last_change":"2024-09-12T01:38:11.796535+0000","last_active":"2024-09-12T01:38:11.796535+0000","last_peered":"2024-09-12T01:38:11.796535+0000","last_clean":"2024-09-12T01:38:11.796535+0000","last_became_active":"2024-09-12T00:43:38.796426+0000","last_became_peered":"2024-09-12T00:43:38.796426+0000","last_unstale":"2024-09-12T01:38:11.796535+0000","last_undegraded":"2024-09-12T01:38:11.796535+0000","last_fullsized":"2024-09-12T01:38:11.796535+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'8","last_scrub_stamp":"2024-09-12T01:38:11.796424+0000","last_deep_scrub":"266'8","last_deep_scrub_stamp":"2024-09-12T01:38:11.796424+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.796424+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:18.250788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9226,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250340+0000","last_change":"2024-09-12T00:39:17.767397+0000","last_active":"2024-09-12T01:34:52.250340+0000","last_peered":"2024-09-12T01:34:52.250340+0000","last_clean":"2024-09-12T01:34:52.250340+0000","last_became_active":"2024-09-12T00:39:17.767088+0000","last_became_peered":"2024-09-12T00:39:17.767088+0000","last_unstale":"2024-09-12T01:34:52.250340+0000","last_undegraded":"2024-09-12T01:34:52.250340+0000","last_fullsized":"2024-09-12T01:34:52.250340+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:12.858828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:45.085791+0000","last_change":"2024-09-12T01:02:03.925759+0000","last_active":"2024-09-12T01:34:45.085791+0000","last_peered":"2024-09-12T01:34:45.085791+0000","last_clean":"2024-09-12T01:34:45.085791+0000","last_became_active":"2024-09-12T01:02:03.925482+0000","last_became_peered":"2024-09-12T01:02:03.925482+0000","last_unstale":"2024-09-12T01:34:45.085791+0000","last_undegraded":"2024-09-12T01:34:45.085791+0000","last_fullsized":"2024-09-12T01:34:45.085791+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:56:13.030524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:55.139373+0000","last_change":"2024-09-12T00:43:43.820868+0000","last_active":"2024-09-12T01:36:55.139373+0000","last_peered":"2024-09-12T01:36:55.139373+0000","last_clean":"2024-09-12T01:36:55.139373+0000","last_became_active":"2024-09-12T00:43:43.820272+0000","last_became_peered":"2024-09-12T00:43:43.820272+0000","last_unstale":"2024-09-12T01:36:55.139373+0000","last_undegraded":"2024-09-12T01:36:55.139373+0000","last_fullsized":"2024-09-12T01:36:55.139373+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:42.963849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'6","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.653601+0000","last_change":"2024-09-12T01:38:23.653601+0000","last_active":"2024-09-12T01:38:23.653601+0000","last_peered":"2024-09-12T01:38:23.653601+0000","last_clean":"2024-09-12T01:38:23.653601+0000","last_became_active":"2024-09-12T00:43:38.799719+0000","last_became_peered":"2024-09-12T00:43:38.799719+0000","last_unstale":"2024-09-12T01:38:23.653601+0000","last_undegraded":"2024-09-12T01:38:23.653601+0000","last_fullsized":"2024-09-12T01:38:23.653601+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T01:38:23.653489+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T01:38:23.653489+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.653489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:28.594858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20462,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'32","reported_seq":146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.668388+0000","last_change":"2024-09-12T01:38:18.668388+0000","last_active":"2024-09-12T01:38:18.668388+0000","last_peered":"2024-09-12T01:38:18.668388+0000","last_clean":"2024-09-12T01:38:18.668388+0000","last_became_active":"2024-09-12T00:39:17.762639+0000","last_became_peered":"2024-09-12T00:39:17.762639+0000","last_unstale":"2024-09-12T01:38:18.668388+0000","last_undegraded":"2024-09-12T01:38:18.668388+0000","last_fullsized":"2024-09-12T01:38:18.668388+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'32","last_scrub_stamp":"2024-09-12T01:38:18.668295+0000","last_deep_scrub":"266'32","last_deep_scrub_stamp":"2024-09-12T01:38:18.668295+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.668295+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:26.791956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.762492+0000","last_change":"2024-09-12T01:38:20.762492+0000","last_active":"2024-09-12T01:38:20.762492+0000","last_peered":"2024-09-12T01:38:20.762492+0000","last_clean":"2024-09-12T01:38:20.762492+0000","last_became_active":"2024-09-12T01:02:03.924892+0000","last_became_peered":"2024-09-12T01:02:03.924892+0000","last_unstale":"2024-09-12T01:38:20.762492+0000","last_undegraded":"2024-09-12T01:38:20.762492+0000","last_fullsized":"2024-09-12T01:38:20.762492+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:20.762384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:20.762384+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.762384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:19.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'4","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.775044+0000","last_change":"2024-09-12T01:38:16.775044+0000","last_active":"2024-09-12T01:38:16.775044+0000","last_peered":"2024-09-12T01:38:16.775044+0000","last_clean":"2024-09-12T01:38:16.775044+0000","last_became_active":"2024-09-12T00:43:43.819431+0000","last_became_peered":"2024-09-12T00:43:43.819431+0000","last_unstale":"2024-09-12T01:38:16.775044+0000","last_undegraded":"2024-09-12T01:38:16.775044+0000","last_fullsized":"2024-09-12T01:38:16.775044+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:16.774960+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:16.774960+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.774960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:08.495839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"266'3","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:49.018108+0000","last_change":"2024-09-12T00:43:38.797182+0000","last_active":"2024-09-12T01:36:49.018108+0000","last_peered":"2024-09-12T01:36:49.018108+0000","last_clean":"2024-09-12T01:36:49.018108+0000","last_became_active":"2024-09-12T00:43:38.796894+0000","last_became_peered":"2024-09-12T00:43:38.796894+0000","last_unstale":"2024-09-12T01:36:49.018108+0000","last_undegraded":"2024-09-12T01:36:49.018108+0000","last_fullsized":"2024-09-12T01:36:49.018108+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:57.433793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'47","reported_seq":182,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536474+0000","last_change":"2024-09-12T00:39:17.762269+0000","last_active":"2024-09-12T01:35:24.536474+0000","last_peered":"2024-09-12T01:35:24.536474+0000","last_clean":"2024-09-12T01:35:24.536474+0000","last_became_active":"2024-09-12T00:39:17.761972+0000","last_became_peered":"2024-09-12T00:39:17.761972+0000","last_unstale":"2024-09-12T01:35:24.536474+0000","last_undegraded":"2024-09-12T01:35:24.536474+0000","last_fullsized":"2024-09-12T01:35:24.536474+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:47.885908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":165,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:54.009614+0000","last_change":"2024-09-12T01:02:03.923742+0000","last_active":"2024-09-12T01:35:54.009614+0000","last_peered":"2024-09-12T01:35:54.009614+0000","last_clean":"2024-09-12T01:35:54.009614+0000","last_became_active":"2024-09-12T01:02:03.923464+0000","last_became_peered":"2024-09-12T01:02:03.923464+0000","last_unstale":"2024-09-12T01:35:54.009614+0000","last_undegraded":"2024-09-12T01:35:54.009614+0000","last_fullsized":"2024-09-12T01:35:54.009614+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'11","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.842146+0000","last_change":"2024-09-12T00:43:43.818258+0000","last_active":"2024-09-12T01:37:38.842146+0000","last_peered":"2024-09-12T01:37:38.842146+0000","last_clean":"2024-09-12T01:37:38.842146+0000","last_became_active":"2024-09-12T00:43:43.817990+0000","last_became_peered":"2024-09-12T00:43:43.817990+0000","last_unstale":"2024-09-12T01:37:38.842146+0000","last_undegraded":"2024-09-12T01:37:38.842146+0000","last_fullsized":"2024-09-12T01:37:38.842146+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:00.011210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14448,"num_write":16,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"266'2","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.870588+0000","last_change":"2024-09-12T01:38:21.870588+0000","last_active":"2024-09-12T01:38:21.870588+0000","last_peered":"2024-09-12T01:38:21.870588+0000","last_clean":"2024-09-12T01:38:21.870588+0000","last_became_active":"2024-09-12T00:43:38.793825+0000","last_became_peered":"2024-09-12T00:43:38.793825+0000","last_unstale":"2024-09-12T01:38:21.870588+0000","last_undegraded":"2024-09-12T01:38:21.870588+0000","last_fullsized":"2024-09-12T01:38:21.870588+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:21.870463+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:21.870463+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.870463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:20.910427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'20","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.535804+0000","last_change":"2024-09-12T00:39:17.770201+0000","last_active":"2024-09-12T01:35:19.535804+0000","last_peered":"2024-09-12T01:35:19.535804+0000","last_clean":"2024-09-12T01:35:19.535804+0000","last_became_active":"2024-09-12T00:39:17.769263+0000","last_became_peered":"2024-09-12T00:39:17.769263+0000","last_unstale":"2024-09-12T01:35:19.535804+0000","last_undegraded":"2024-09-12T01:35:19.535804+0000","last_fullsized":"2024-09-12T01:35:19.535804+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:15.097860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:54.187244+0000","last_change":"2024-09-12T01:02:03.924548+0000","last_active":"2024-09-12T01:35:54.187244+0000","last_peered":"2024-09-12T01:35:54.187244+0000","last_clean":"2024-09-12T01:35:54.187244+0000","last_became_active":"2024-09-12T01:02:03.924260+0000","last_became_peered":"2024-09-12T01:02:03.924260+0000","last_unstale":"2024-09-12T01:35:54.187244+0000","last_undegraded":"2024-09-12T01:35:54.187244+0000","last_fullsized":"2024-09-12T01:35:54.187244+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"266'3","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:24.023301+0000","last_change":"2024-09-12T00:43:43.824871+0000","last_active":"2024-09-12T01:37:24.023301+0000","last_peered":"2024-09-12T01:37:24.023301+0000","last_clean":"2024-09-12T01:37:24.023301+0000","last_became_active":"2024-09-12T00:43:43.824567+0000","last_became_peered":"2024-09-12T00:43:43.824567+0000","last_unstale":"2024-09-12T01:37:24.023301+0000","last_undegraded":"2024-09-12T01:37:24.023301+0000","last_fullsized":"2024-09-12T01:37:24.023301+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:24.293339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"266'5","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.022626+0000","last_change":"2024-09-12T00:43:38.798453+0000","last_active":"2024-09-12T01:37:19.022626+0000","last_peered":"2024-09-12T01:37:19.022626+0000","last_clean":"2024-09-12T01:37:19.022626+0000","last_became_active":"2024-09-12T00:43:38.798200+0000","last_became_peered":"2024-09-12T00:43:38.798200+0000","last_unstale":"2024-09-12T01:37:19.022626+0000","last_undegraded":"2024-09-12T01:37:19.022626+0000","last_fullsized":"2024-09-12T01:37:19.022626+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:27.881376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"266'30","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.595596+0000","last_change":"2024-09-12T01:38:16.595596+0000","last_active":"2024-09-12T01:38:16.595596+0000","last_peered":"2024-09-12T01:38:16.595596+0000","last_clean":"2024-09-12T01:38:16.595596+0000","last_became_active":"2024-09-12T00:39:17.766600+0000","last_became_peered":"2024-09-12T00:39:17.766600+0000","last_unstale":"2024-09-12T01:38:16.595596+0000","last_undegraded":"2024-09-12T01:38:16.595596+0000","last_fullsized":"2024-09-12T01:38:16.595596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'30","last_scrub_stamp":"2024-09-12T01:38:16.595514+0000","last_deep_scrub":"266'30","last_deep_scrub_stamp":"2024-09-12T01:38:16.595514+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.595514+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:59.336815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":112,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:52.250307+0000","last_change":"2024-09-12T01:02:03.919723+0000","last_active":"2024-09-12T01:34:52.250307+0000","last_peered":"2024-09-12T01:34:52.250307+0000","last_clean":"2024-09-12T01:34:52.250307+0000","last_became_active":"2024-09-12T01:02:03.919377+0000","last_became_peered":"2024-09-12T01:02:03.919377+0000","last_unstale":"2024-09-12T01:34:52.250307+0000","last_undegraded":"2024-09-12T01:34:52.250307+0000","last_fullsized":"2024-09-12T01:34:52.250307+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:59.358385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:05.123101+0000","last_change":"2024-09-12T00:43:43.818424+0000","last_active":"2024-09-12T01:35:05.123101+0000","last_peered":"2024-09-12T01:35:05.123101+0000","last_clean":"2024-09-12T01:35:05.123101+0000","last_became_active":"2024-09-12T00:43:43.818153+0000","last_became_peered":"2024-09-12T00:43:43.818153+0000","last_unstale":"2024-09-12T01:35:05.123101+0000","last_undegraded":"2024-09-12T01:35:05.123101+0000","last_fullsized":"2024-09-12T01:35:05.123101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:09.787318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'6","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.838737+0000","last_change":"2024-09-12T01:38:15.838737+0000","last_active":"2024-09-12T01:38:15.838737+0000","last_peered":"2024-09-12T01:38:15.838737+0000","last_clean":"2024-09-12T01:38:15.838737+0000","last_became_active":"2024-09-12T00:43:38.792135+0000","last_became_peered":"2024-09-12T00:43:38.792135+0000","last_unstale":"2024-09-12T01:38:15.838737+0000","last_undegraded":"2024-09-12T01:38:15.838737+0000","last_fullsized":"2024-09-12T01:38:15.838737+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T01:38:15.838637+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T01:38:15.838637+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.838637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:44.060727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8232,"num_write":6,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"266'12","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.545660+0000","last_change":"2024-09-12T01:38:19.545660+0000","last_active":"2024-09-12T01:38:19.545660+0000","last_peered":"2024-09-12T01:38:19.545660+0000","last_clean":"2024-09-12T01:38:19.545660+0000","last_became_active":"2024-09-12T00:39:17.767599+0000","last_became_peered":"2024-09-12T00:39:17.767599+0000","last_unstale":"2024-09-12T01:38:19.545660+0000","last_undegraded":"2024-09-12T01:38:19.545660+0000","last_fullsized":"2024-09-12T01:38:19.545660+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'12","last_scrub_stamp":"2024-09-12T01:38:19.545579+0000","last_deep_scrub":"266'12","last_deep_scrub_stamp":"2024-09-12T01:38:19.545579+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.545579+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:39.128051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:54.187210+0000","last_change":"2024-09-12T01:02:03.918519+0000","last_active":"2024-09-12T01:35:54.187210+0000","last_peered":"2024-09-12T01:35:54.187210+0000","last_clean":"2024-09-12T01:35:54.187210+0000","last_became_active":"2024-09-12T01:02:03.918248+0000","last_became_peered":"2024-09-12T01:02:03.918248+0000","last_unstale":"2024-09-12T01:35:54.187210+0000","last_undegraded":"2024-09-12T01:35:54.187210+0000","last_fullsized":"2024-09-12T01:35:54.187210+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:04.533744+0000","last_change":"2024-09-12T00:43:43.825033+0000","last_active":"2024-09-12T01:35:04.533744+0000","last_peered":"2024-09-12T01:35:04.533744+0000","last_clean":"2024-09-12T01:35:04.533744+0000","last_became_active":"2024-09-12T00:43:43.822993+0000","last_became_peered":"2024-09-12T00:43:43.822993+0000","last_unstale":"2024-09-12T01:35:04.533744+0000","last_undegraded":"2024-09-12T01:35:04.533744+0000","last_fullsized":"2024-09-12T01:35:04.533744+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:59.928486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.878486+0000","last_change":"2024-09-12T01:38:20.878486+0000","last_active":"2024-09-12T01:38:20.878486+0000","last_peered":"2024-09-12T01:38:20.878486+0000","last_clean":"2024-09-12T01:38:20.878486+0000","last_became_active":"2024-09-12T00:43:38.795625+0000","last_became_peered":"2024-09-12T00:43:38.795625+0000","last_unstale":"2024-09-12T01:38:20.878486+0000","last_undegraded":"2024-09-12T01:38:20.878486+0000","last_fullsized":"2024-09-12T01:38:20.878486+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:20.878394+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:20.878394+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.878394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:19.560370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'39","reported_seq":169,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.608898+0000","last_change":"2024-09-12T01:38:15.608898+0000","last_active":"2024-09-12T01:38:15.608898+0000","last_peered":"2024-09-12T01:38:15.608898+0000","last_clean":"2024-09-12T01:38:15.608898+0000","last_became_active":"2024-09-12T00:39:17.761517+0000","last_became_peered":"2024-09-12T00:39:17.761517+0000","last_unstale":"2024-09-12T01:38:15.608898+0000","last_undegraded":"2024-09-12T01:38:15.608898+0000","last_fullsized":"2024-09-12T01:38:15.608898+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'39","last_scrub_stamp":"2024-09-12T01:38:15.608812+0000","last_deep_scrub":"266'39","last_deep_scrub_stamp":"2024-09-12T01:38:15.608812+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.608812+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:08.341143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:43.997821+0000","last_change":"2024-09-12T01:02:03.924588+0000","last_active":"2024-09-12T01:34:43.997821+0000","last_peered":"2024-09-12T01:34:43.997821+0000","last_clean":"2024-09-12T01:34:43.997821+0000","last_became_active":"2024-09-12T01:02:03.923808+0000","last_became_peered":"2024-09-12T01:02:03.923808+0000","last_unstale":"2024-09-12T01:34:43.997821+0000","last_undegraded":"2024-09-12T01:34:43.997821+0000","last_fullsized":"2024-09-12T01:34:43.997821+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:42.299573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'5","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:30.126665+0000","last_change":"2024-09-12T00:43:43.819522+0000","last_active":"2024-09-12T01:35:30.126665+0000","last_peered":"2024-09-12T01:35:30.126665+0000","last_clean":"2024-09-12T01:35:30.126665+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:35:30.126665+0000","last_undegraded":"2024-09-12T01:35:30.126665+0000","last_fullsized":"2024-09-12T01:35:30.126665+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:30.323747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'4","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.600636+0000","last_change":"2024-09-12T01:38:17.600636+0000","last_active":"2024-09-12T01:38:17.600636+0000","last_peered":"2024-09-12T01:38:17.600636+0000","last_clean":"2024-09-12T01:38:17.600636+0000","last_became_active":"2024-09-12T00:43:38.795451+0000","last_became_peered":"2024-09-12T00:43:38.795451+0000","last_unstale":"2024-09-12T01:38:17.600636+0000","last_undegraded":"2024-09-12T01:38:17.600636+0000","last_fullsized":"2024-09-12T01:38:17.600636+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:17.600540+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:17.600540+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.600540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:39.401021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'134","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.599128+0000","last_change":"2024-09-12T01:38:14.599128+0000","last_active":"2024-09-12T01:38:14.599128+0000","last_peered":"2024-09-12T01:38:14.599128+0000","last_clean":"2024-09-12T01:38:14.599128+0000","last_became_active":"2024-09-12T00:39:17.762649+0000","last_became_peered":"2024-09-12T00:39:17.762649+0000","last_unstale":"2024-09-12T01:38:14.599128+0000","last_undegraded":"2024-09-12T01:38:14.599128+0000","last_fullsized":"2024-09-12T01:38:14.599128+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T01:38:14.599042+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T01:38:14.599042+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.599042+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:27.992122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":844,"num_read_kb":585,"num_write":185,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2988,"num_omap_keys":6,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.870467+0000","last_change":"2024-09-12T01:38:22.870467+0000","last_active":"2024-09-12T01:38:22.870467+0000","last_peered":"2024-09-12T01:38:22.870467+0000","last_clean":"2024-09-12T01:38:22.870467+0000","last_became_active":"2024-09-12T01:02:03.924934+0000","last_became_peered":"2024-09-12T01:02:03.924934+0000","last_unstale":"2024-09-12T01:38:22.870467+0000","last_undegraded":"2024-09-12T01:38:22.870467+0000","last_fullsized":"2024-09-12T01:38:22.870467+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.870368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.870368+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.870368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:26.023207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:30.126629+0000","last_change":"2024-09-12T00:43:43.822008+0000","last_active":"2024-09-12T01:35:30.126629+0000","last_peered":"2024-09-12T01:35:30.126629+0000","last_clean":"2024-09-12T01:35:30.126629+0000","last_became_active":"2024-09-12T00:43:43.821288+0000","last_became_peered":"2024-09-12T00:43:43.821288+0000","last_unstale":"2024-09-12T01:35:30.126629+0000","last_undegraded":"2024-09-12T01:35:30.126629+0000","last_fullsized":"2024-09-12T01:35:30.126629+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:12.223424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.182657+0000","last_change":"2024-09-12T00:43:38.798047+0000","last_active":"2024-09-12T01:35:24.182657+0000","last_peered":"2024-09-12T01:35:24.182657+0000","last_clean":"2024-09-12T01:35:24.182657+0000","last_became_active":"2024-09-12T00:43:38.797782+0000","last_became_peered":"2024-09-12T00:43:38.797782+0000","last_unstale":"2024-09-12T01:35:24.182657+0000","last_undegraded":"2024-09-12T01:35:24.182657+0000","last_fullsized":"2024-09-12T01:35:24.182657+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:08:52.438462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'33","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537703+0000","last_change":"2024-09-12T00:39:17.769240+0000","last_active":"2024-09-12T01:35:34.537703+0000","last_peered":"2024-09-12T01:35:34.537703+0000","last_clean":"2024-09-12T01:35:34.537703+0000","last_became_active":"2024-09-12T00:39:17.768151+0000","last_became_peered":"2024-09-12T00:39:17.768151+0000","last_unstale":"2024-09-12T01:35:34.537703+0000","last_undegraded":"2024-09-12T01:35:34.537703+0000","last_fullsized":"2024-09-12T01:35:34.537703+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.530106+0000","last_change":"2024-09-12T01:02:03.922540+0000","last_active":"2024-09-12T01:34:34.530106+0000","last_peered":"2024-09-12T01:34:34.530106+0000","last_clean":"2024-09-12T01:34:34.530106+0000","last_became_active":"2024-09-12T01:02:03.921595+0000","last_became_peered":"2024-09-12T01:02:03.921595+0000","last_unstale":"2024-09-12T01:34:34.530106+0000","last_undegraded":"2024-09-12T01:34:34.530106+0000","last_fullsized":"2024-09-12T01:34:34.530106+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.523672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"266'9","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.742220+0000","last_change":"2024-09-12T00:43:43.820529+0000","last_active":"2024-09-12T01:37:38.742220+0000","last_peered":"2024-09-12T01:37:38.742220+0000","last_clean":"2024-09-12T01:37:38.742220+0000","last_became_active":"2024-09-12T00:43:43.819990+0000","last_became_peered":"2024-09-12T00:43:43.819990+0000","last_unstale":"2024-09-12T01:37:38.742220+0000","last_undegraded":"2024-09-12T01:37:38.742220+0000","last_fullsized":"2024-09-12T01:37:38.742220+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8217,"num_write":14,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.680163+0000","last_change":"2024-09-12T01:38:21.680163+0000","last_active":"2024-09-12T01:38:21.680163+0000","last_peered":"2024-09-12T01:38:21.680163+0000","last_clean":"2024-09-12T01:38:21.680163+0000","last_became_active":"2024-09-12T00:43:38.798374+0000","last_became_peered":"2024-09-12T00:43:38.798374+0000","last_unstale":"2024-09-12T01:38:21.680163+0000","last_undegraded":"2024-09-12T01:38:21.680163+0000","last_fullsized":"2024-09-12T01:38:21.680163+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:21.680052+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:21.680052+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.680052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:51.883942+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":175,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.871137+0000","last_change":"2024-09-12T01:38:14.871137+0000","last_active":"2024-09-12T01:38:14.871137+0000","last_peered":"2024-09-12T01:38:14.871137+0000","last_clean":"2024-09-12T01:38:14.871137+0000","last_became_active":"2024-09-12T00:39:17.757795+0000","last_became_peered":"2024-09-12T00:39:17.757795+0000","last_unstale":"2024-09-12T01:38:14.871137+0000","last_undegraded":"2024-09-12T01:38:14.871137+0000","last_fullsized":"2024-09-12T01:38:14.871137+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'41","last_scrub_stamp":"2024-09-12T01:38:14.871052+0000","last_deep_scrub":"266'41","last_deep_scrub_stamp":"2024-09-12T01:38:14.871052+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.871052+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:14.098929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.841035+0000","last_change":"2024-09-12T01:38:23.841035+0000","last_active":"2024-09-12T01:38:23.841035+0000","last_peered":"2024-09-12T01:38:23.841035+0000","last_clean":"2024-09-12T01:38:23.841035+0000","last_became_active":"2024-09-12T01:02:03.923774+0000","last_became_peered":"2024-09-12T01:02:03.923774+0000","last_unstale":"2024-09-12T01:38:23.841035+0000","last_undegraded":"2024-09-12T01:38:23.841035+0000","last_fullsized":"2024-09-12T01:38:23.841035+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.840947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.840947+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.840947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:14.358788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.869482+0000","last_change":"2024-09-12T00:43:43.820925+0000","last_active":"2024-09-12T01:37:38.869482+0000","last_peered":"2024-09-12T01:37:38.869482+0000","last_clean":"2024-09-12T01:37:38.869482+0000","last_became_active":"2024-09-12T00:43:43.819044+0000","last_became_peered":"2024-09-12T00:43:43.819044+0000","last_unstale":"2024-09-12T01:37:38.869482+0000","last_undegraded":"2024-09-12T01:37:38.869482+0000","last_fullsized":"2024-09-12T01:37:38.869482+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:51.315359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6160,"num_write":14,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.683362+0000","last_change":"2024-09-12T01:38:22.683362+0000","last_active":"2024-09-12T01:38:22.683362+0000","last_peered":"2024-09-12T01:38:22.683362+0000","last_clean":"2024-09-12T01:38:22.683362+0000","last_became_active":"2024-09-12T00:43:38.797343+0000","last_became_peered":"2024-09-12T00:43:38.797343+0000","last_unstale":"2024-09-12T01:38:22.683362+0000","last_undegraded":"2024-09-12T01:38:22.683362+0000","last_fullsized":"2024-09-12T01:38:22.683362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.683272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.683272+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.683272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:21.575947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'33","reported_seq":146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.367708+0000","last_change":"2024-09-12T01:38:16.367708+0000","last_active":"2024-09-12T01:38:16.367708+0000","last_peered":"2024-09-12T01:38:16.367708+0000","last_clean":"2024-09-12T01:38:16.367708+0000","last_became_active":"2024-09-12T00:39:17.759701+0000","last_became_peered":"2024-09-12T00:39:17.759701+0000","last_unstale":"2024-09-12T01:38:16.367708+0000","last_undegraded":"2024-09-12T01:38:16.367708+0000","last_fullsized":"2024-09-12T01:38:16.367708+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T01:38:16.367624+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T01:38:16.367624+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.367624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:43.217655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":64,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.008862+0000","last_change":"2024-09-12T01:02:03.923765+0000","last_active":"2024-09-12T01:35:49.008862+0000","last_peered":"2024-09-12T01:35:49.008862+0000","last_clean":"2024-09-12T01:35:49.008862+0000","last_became_active":"2024-09-12T01:02:03.923440+0000","last_became_peered":"2024-09-12T01:02:03.923440+0000","last_unstale":"2024-09-12T01:35:49.008862+0000","last_undegraded":"2024-09-12T01:35:49.008862+0000","last_fullsized":"2024-09-12T01:35:49.008862+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'5","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.805088+0000","last_change":"2024-09-12T00:43:43.819656+0000","last_active":"2024-09-12T01:37:38.805088+0000","last_peered":"2024-09-12T01:37:38.805088+0000","last_clean":"2024-09-12T01:37:38.805088+0000","last_became_active":"2024-09-12T00:43:43.819247+0000","last_became_peered":"2024-09-12T00:43:43.819247+0000","last_unstale":"2024-09-12T01:37:38.805088+0000","last_undegraded":"2024-09-12T01:37:38.805088+0000","last_fullsized":"2024-09-12T01:37:38.805088+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"266'5","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.643141+0000","last_change":"2024-09-12T01:38:19.643141+0000","last_active":"2024-09-12T01:38:19.643141+0000","last_peered":"2024-09-12T01:38:19.643141+0000","last_clean":"2024-09-12T01:38:19.643141+0000","last_became_active":"2024-09-12T00:43:38.794286+0000","last_became_peered":"2024-09-12T00:43:38.794286+0000","last_unstale":"2024-09-12T01:38:19.643141+0000","last_undegraded":"2024-09-12T01:38:19.643141+0000","last_fullsized":"2024-09-12T01:38:19.643141+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:19.643059+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:19.643059+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.643059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:21.395512+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'28","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.354805+0000","last_change":"2024-09-12T01:38:14.354805+0000","last_active":"2024-09-12T01:38:14.354805+0000","last_peered":"2024-09-12T01:38:14.354805+0000","last_clean":"2024-09-12T01:38:14.354805+0000","last_became_active":"2024-09-12T00:39:17.761738+0000","last_became_peered":"2024-09-12T00:39:17.761738+0000","last_unstale":"2024-09-12T01:38:14.354805+0000","last_undegraded":"2024-09-12T01:38:14.354805+0000","last_fullsized":"2024-09-12T01:38:14.354805+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'28","last_scrub_stamp":"2024-09-12T01:38:14.354706+0000","last_deep_scrub":"266'28","last_deep_scrub_stamp":"2024-09-12T01:38:14.354706+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.354706+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:49.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":96,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:55.093352+0000","last_change":"2024-09-12T01:02:03.928768+0000","last_active":"2024-09-12T01:35:55.093352+0000","last_peered":"2024-09-12T01:35:55.093352+0000","last_clean":"2024-09-12T01:35:55.093352+0000","last_became_active":"2024-09-12T01:02:03.928475+0000","last_became_peered":"2024-09-12T01:02:03.928475+0000","last_unstale":"2024-09-12T01:35:55.093352+0000","last_undegraded":"2024-09-12T01:35:55.093352+0000","last_fullsized":"2024-09-12T01:35:55.093352+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'2","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.546533+0000","last_change":"2024-09-12T01:38:23.546533+0000","last_active":"2024-09-12T01:38:23.546533+0000","last_peered":"2024-09-12T01:38:23.546533+0000","last_clean":"2024-09-12T01:38:23.546533+0000","last_became_active":"2024-09-12T00:43:43.821149+0000","last_became_peered":"2024-09-12T00:43:43.821149+0000","last_unstale":"2024-09-12T01:38:23.546533+0000","last_undegraded":"2024-09-12T01:38:23.546533+0000","last_fullsized":"2024-09-12T01:38:23.546533+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:23.546436+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:23.546436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:54.182163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'9","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.723658+0000","last_change":"2024-09-12T00:43:38.799268+0000","last_active":"2024-09-12T01:37:38.723658+0000","last_peered":"2024-09-12T01:37:38.723658+0000","last_clean":"2024-09-12T01:37:38.723658+0000","last_became_active":"2024-09-12T00:43:38.798510+0000","last_became_peered":"2024-09-12T00:43:38.798510+0000","last_unstale":"2024-09-12T01:37:38.723658+0000","last_undegraded":"2024-09-12T01:37:38.723658+0000","last_fullsized":"2024-09-12T01:37:38.723658+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16416,"num_write":14,"num_write_kb":12320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'28","reported_seq":144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.676599+0000","last_change":"2024-09-12T01:38:15.676599+0000","last_active":"2024-09-12T01:38:15.676599+0000","last_peered":"2024-09-12T01:38:15.676599+0000","last_clean":"2024-09-12T01:38:15.676599+0000","last_became_active":"2024-09-12T00:39:17.770779+0000","last_became_peered":"2024-09-12T00:39:17.770779+0000","last_unstale":"2024-09-12T01:38:15.676599+0000","last_undegraded":"2024-09-12T01:38:15.676599+0000","last_fullsized":"2024-09-12T01:38:15.676599+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'28","last_scrub_stamp":"2024-09-12T01:38:15.676512+0000","last_deep_scrub":"266'28","last_deep_scrub_stamp":"2024-09-12T01:38:15.676512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.676512+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.231916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.769638+0000","last_change":"2024-09-12T01:38:19.769638+0000","last_active":"2024-09-12T01:38:19.769638+0000","last_peered":"2024-09-12T01:38:19.769638+0000","last_clean":"2024-09-12T01:38:19.769638+0000","last_became_active":"2024-09-12T01:02:03.925618+0000","last_became_peered":"2024-09-12T01:02:03.925618+0000","last_unstale":"2024-09-12T01:38:19.769638+0000","last_undegraded":"2024-09-12T01:38:19.769638+0000","last_fullsized":"2024-09-12T01:38:19.769638+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:19.769541+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:19.769541+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.769541+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:13.515910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"266'5","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.521264+0000","last_change":"2024-09-12T01:38:23.521264+0000","last_active":"2024-09-12T01:38:23.521264+0000","last_peered":"2024-09-12T01:38:23.521264+0000","last_clean":"2024-09-12T01:38:23.521264+0000","last_became_active":"2024-09-12T00:43:43.825380+0000","last_became_peered":"2024-09-12T00:43:43.825380+0000","last_unstale":"2024-09-12T01:38:23.521264+0000","last_undegraded":"2024-09-12T01:38:23.521264+0000","last_fullsized":"2024-09-12T01:38:23.521264+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:23.521124+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:23.521124+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.521124+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:57.370216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8232,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.636339+0000","last_change":"2024-09-12T01:38:20.636339+0000","last_active":"2024-09-12T01:38:20.636339+0000","last_peered":"2024-09-12T01:38:20.636339+0000","last_clean":"2024-09-12T01:38:20.636339+0000","last_became_active":"2024-09-12T00:43:38.791586+0000","last_became_peered":"2024-09-12T00:43:38.791586+0000","last_unstale":"2024-09-12T01:38:20.636339+0000","last_undegraded":"2024-09-12T01:38:20.636339+0000","last_fullsized":"2024-09-12T01:38:20.636339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:20.636233+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:20.636233+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.636233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:00.740486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'54","reported_seq":206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.007244+0000","last_change":"2024-09-12T00:39:17.762695+0000","last_active":"2024-09-12T01:35:39.007244+0000","last_peered":"2024-09-12T01:35:39.007244+0000","last_clean":"2024-09-12T01:35:39.007244+0000","last_became_active":"2024-09-12T00:39:17.762435+0000","last_became_peered":"2024-09-12T00:39:17.762435+0000","last_unstale":"2024-09-12T01:35:39.007244+0000","last_undegraded":"2024-09-12T01:35:39.007244+0000","last_fullsized":"2024-09-12T01:35:39.007244+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":202,"num_write":91,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:50.129663+0000","last_change":"2024-09-12T01:02:03.926151+0000","last_active":"2024-09-12T01:35:50.129663+0000","last_peered":"2024-09-12T01:35:50.129663+0000","last_clean":"2024-09-12T01:35:50.129663+0000","last_became_active":"2024-09-12T01:02:03.925866+0000","last_became_peered":"2024-09-12T01:02:03.925866+0000","last_unstale":"2024-09-12T01:35:50.129663+0000","last_undegraded":"2024-09-12T01:35:50.129663+0000","last_fullsized":"2024-09-12T01:35:50.129663+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'3","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.802693+0000","last_change":"2024-09-12T01:38:17.802693+0000","last_active":"2024-09-12T01:38:17.802693+0000","last_peered":"2024-09-12T01:38:17.802693+0000","last_clean":"2024-09-12T01:38:17.802693+0000","last_became_active":"2024-09-12T00:43:43.820153+0000","last_became_peered":"2024-09-12T00:43:43.820153+0000","last_unstale":"2024-09-12T01:38:17.802693+0000","last_undegraded":"2024-09-12T01:38:17.802693+0000","last_fullsized":"2024-09-12T01:38:17.802693+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:38:17.802589+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:38:17.802589+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.802589+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:44.846562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'3","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.628485+0000","last_change":"2024-09-12T00:43:38.790234+0000","last_active":"2024-09-12T01:37:38.628485+0000","last_peered":"2024-09-12T01:37:38.628485+0000","last_clean":"2024-09-12T01:37:38.628485+0000","last_became_active":"2024-09-12T00:43:38.789945+0000","last_became_peered":"2024-09-12T00:43:38.789945+0000","last_unstale":"2024-09-12T01:37:38.628485+0000","last_undegraded":"2024-09-12T01:37:38.628485+0000","last_fullsized":"2024-09-12T01:37:38.628485+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:12.330002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'34","reported_seq":159,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.794692+0000","last_change":"2024-09-12T01:38:12.794692+0000","last_active":"2024-09-12T01:38:12.794692+0000","last_peered":"2024-09-12T01:38:12.794692+0000","last_clean":"2024-09-12T01:38:12.794692+0000","last_became_active":"2024-09-12T00:39:17.759741+0000","last_became_peered":"2024-09-12T00:39:17.759741+0000","last_unstale":"2024-09-12T01:38:12.794692+0000","last_undegraded":"2024-09-12T01:38:12.794692+0000","last_fullsized":"2024-09-12T01:38:12.794692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'34","last_scrub_stamp":"2024-09-12T01:38:12.794595+0000","last_deep_scrub":"266'34","last_deep_scrub_stamp":"2024-09-12T01:38:12.794595+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.794595+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:04.466537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.764487+0000","last_change":"2024-09-12T01:38:18.764487+0000","last_active":"2024-09-12T01:38:18.764487+0000","last_peered":"2024-09-12T01:38:18.764487+0000","last_clean":"2024-09-12T01:38:18.764487+0000","last_became_active":"2024-09-12T01:02:03.918998+0000","last_became_peered":"2024-09-12T01:02:03.918998+0000","last_unstale":"2024-09-12T01:38:18.764487+0000","last_undegraded":"2024-09-12T01:38:18.764487+0000","last_fullsized":"2024-09-12T01:38:18.764487+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:18.764368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:18.764368+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.764368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:49.004598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:59.010566+0000","last_change":"2024-09-12T00:43:43.822054+0000","last_active":"2024-09-12T01:35:59.010566+0000","last_peered":"2024-09-12T01:35:59.010566+0000","last_clean":"2024-09-12T01:35:59.010566+0000","last_became_active":"2024-09-12T00:43:43.821691+0000","last_became_peered":"2024-09-12T00:43:43.821691+0000","last_unstale":"2024-09-12T01:35:59.010566+0000","last_undegraded":"2024-09-12T01:35:59.010566+0000","last_fullsized":"2024-09-12T01:35:59.010566+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.538879+0000","last_change":"2024-09-12T00:43:38.798045+0000","last_active":"2024-09-12T01:35:44.538879+0000","last_peered":"2024-09-12T01:35:44.538879+0000","last_clean":"2024-09-12T01:35:44.538879+0000","last_became_active":"2024-09-12T00:43:38.797711+0000","last_became_peered":"2024-09-12T00:43:38.797711+0000","last_unstale":"2024-09-12T01:35:44.538879+0000","last_undegraded":"2024-09-12T01:35:44.538879+0000","last_fullsized":"2024-09-12T01:35:44.538879+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'32","reported_seq":141,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:37.257485+0000","last_change":"2024-09-12T00:39:17.761142+0000","last_active":"2024-09-12T01:35:37.257485+0000","last_peered":"2024-09-12T01:35:37.257485+0000","last_clean":"2024-09-12T01:35:37.257485+0000","last_became_active":"2024-09-12T00:39:17.760839+0000","last_became_peered":"2024-09-12T00:39:17.760839+0000","last_unstale":"2024-09-12T01:35:37.257485+0000","last_undegraded":"2024-09-12T01:35:37.257485+0000","last_fullsized":"2024-09-12T01:35:37.257485+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.774169+0000","last_change":"2024-09-12T01:38:23.774169+0000","last_active":"2024-09-12T01:38:23.774169+0000","last_peered":"2024-09-12T01:38:23.774169+0000","last_clean":"2024-09-12T01:38:23.774169+0000","last_became_active":"2024-09-12T01:02:03.919706+0000","last_became_peered":"2024-09-12T01:02:03.919706+0000","last_unstale":"2024-09-12T01:38:23.774169+0000","last_undegraded":"2024-09-12T01:38:23.774169+0000","last_fullsized":"2024-09-12T01:38:23.774169+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.774067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.774067+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.774067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:59.231629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"266'2","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.660530+0000","last_change":"2024-09-12T00:43:43.818598+0000","last_active":"2024-09-12T01:37:38.660530+0000","last_peered":"2024-09-12T01:37:38.660530+0000","last_clean":"2024-09-12T01:37:38.660530+0000","last_became_active":"2024-09-12T00:43:43.818321+0000","last_became_peered":"2024-09-12T00:43:43.818321+0000","last_unstale":"2024-09-12T01:37:38.660530+0000","last_undegraded":"2024-09-12T01:37:38.660530+0000","last_fullsized":"2024-09-12T01:37:38.660530+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":96,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.749730+0000","last_change":"2024-09-12T00:43:38.792440+0000","last_active":"2024-09-12T01:37:38.749730+0000","last_peered":"2024-09-12T01:37:38.749730+0000","last_clean":"2024-09-12T01:37:38.749730+0000","last_became_active":"2024-09-12T00:43:38.792154+0000","last_became_peered":"2024-09-12T00:43:38.792154+0000","last_unstale":"2024-09-12T01:37:38.749730+0000","last_undegraded":"2024-09-12T01:37:38.749730+0000","last_fullsized":"2024-09-12T01:37:38.749730+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1034,"num_write":4,"num_write_kb":1034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"266'40","reported_seq":164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.538288+0000","last_change":"2024-09-12T00:39:17.770041+0000","last_active":"2024-09-12T01:35:39.538288+0000","last_peered":"2024-09-12T01:35:39.538288+0000","last_clean":"2024-09-12T01:35:39.538288+0000","last_became_active":"2024-09-12T00:39:17.767962+0000","last_became_peered":"2024-09-12T00:39:17.767962+0000","last_unstale":"2024-09-12T01:35:39.538288+0000","last_undegraded":"2024-09-12T01:35:39.538288+0000","last_fullsized":"2024-09-12T01:35:39.538288+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":136,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:14.012745+0000","last_change":"2024-09-12T01:02:03.922136+0000","last_active":"2024-09-12T01:36:14.012745+0000","last_peered":"2024-09-12T01:36:14.012745+0000","last_clean":"2024-09-12T01:36:14.012745+0000","last_became_active":"2024-09-12T01:02:03.918216+0000","last_became_peered":"2024-09-12T01:02:03.918216+0000","last_unstale":"2024-09-12T01:36:14.012745+0000","last_undegraded":"2024-09-12T01:36:14.012745+0000","last_fullsized":"2024-09-12T01:36:14.012745+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'10","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.765459+0000","last_change":"2024-09-12T01:38:13.765459+0000","last_active":"2024-09-12T01:38:13.765459+0000","last_peered":"2024-09-12T01:38:13.765459+0000","last_clean":"2024-09-12T01:38:13.765459+0000","last_became_active":"2024-09-12T00:43:43.820194+0000","last_became_peered":"2024-09-12T00:43:43.820194+0000","last_unstale":"2024-09-12T01:38:13.765459+0000","last_undegraded":"2024-09-12T01:38:13.765459+0000","last_fullsized":"2024-09-12T01:38:13.765459+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T01:38:13.765346+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T01:38:13.765346+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.765346+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:37.499066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"266'10","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.549561+0000","last_change":"2024-09-12T01:38:22.549561+0000","last_active":"2024-09-12T01:38:22.549561+0000","last_peered":"2024-09-12T01:38:22.549561+0000","last_clean":"2024-09-12T01:38:22.549561+0000","last_became_active":"2024-09-12T00:43:38.797428+0000","last_became_peered":"2024-09-12T00:43:38.797428+0000","last_unstale":"2024-09-12T01:38:22.549561+0000","last_undegraded":"2024-09-12T01:38:22.549561+0000","last_fullsized":"2024-09-12T01:38:22.549561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T01:38:22.549469+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T01:38:22.549469+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.549469+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:27.315172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12282,"num_write":20,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'86","reported_seq":380,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.760111+0000","last_change":"2024-09-12T01:38:13.760111+0000","last_active":"2024-09-12T01:38:13.760111+0000","last_peered":"2024-09-12T01:38:13.760111+0000","last_clean":"2024-09-12T01:38:13.760111+0000","last_became_active":"2024-09-12T00:39:17.767517+0000","last_became_peered":"2024-09-12T00:39:17.767517+0000","last_unstale":"2024-09-12T01:38:13.760111+0000","last_undegraded":"2024-09-12T01:38:13.760111+0000","last_fullsized":"2024-09-12T01:38:13.760111+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'86","last_scrub_stamp":"2024-09-12T01:38:13.760025+0000","last_deep_scrub":"266'86","last_deep_scrub_stamp":"2024-09-12T01:38:13.760025+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.760025+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:04.380421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":615,"num_read_kb":395,"num_write":114,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4990,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536407+0000","last_change":"2024-09-12T01:02:03.922775+0000","last_active":"2024-09-12T01:35:24.536407+0000","last_peered":"2024-09-12T01:35:24.536407+0000","last_clean":"2024-09-12T01:35:24.536407+0000","last_became_active":"2024-09-12T01:02:03.922479+0000","last_became_peered":"2024-09-12T01:02:03.922479+0000","last_unstale":"2024-09-12T01:35:24.536407+0000","last_undegraded":"2024-09-12T01:35:24.536407+0000","last_fullsized":"2024-09-12T01:35:24.536407+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.011531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"263'4","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.538933+0000","last_change":"2024-09-12T00:43:43.821630+0000","last_active":"2024-09-12T01:35:44.538933+0000","last_peered":"2024-09-12T01:35:44.538933+0000","last_clean":"2024-09-12T01:35:44.538933+0000","last_became_active":"2024-09-12T00:43:43.821303+0000","last_became_peered":"2024-09-12T00:43:43.821303+0000","last_unstale":"2024-09-12T01:35:44.538933+0000","last_undegraded":"2024-09-12T01:35:44.538933+0000","last_fullsized":"2024-09-12T01:35:44.538933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16370,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'2","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.586590+0000","last_change":"2024-09-12T00:43:38.800008+0000","last_active":"2024-09-12T01:37:38.586590+0000","last_peered":"2024-09-12T01:37:38.586590+0000","last_clean":"2024-09-12T01:37:38.586590+0000","last_became_active":"2024-09-12T00:43:38.799623+0000","last_became_peered":"2024-09-12T00:43:38.799623+0000","last_unstale":"2024-09-12T01:37:38.586590+0000","last_undegraded":"2024-09-12T01:37:38.586590+0000","last_fullsized":"2024-09-12T01:37:38.586590+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'30","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.581377+0000","last_change":"2024-09-12T01:38:13.581377+0000","last_active":"2024-09-12T01:38:13.581377+0000","last_peered":"2024-09-12T01:38:13.581377+0000","last_clean":"2024-09-12T01:38:13.581377+0000","last_became_active":"2024-09-12T00:39:17.768143+0000","last_became_peered":"2024-09-12T00:39:17.768143+0000","last_unstale":"2024-09-12T01:38:13.581377+0000","last_undegraded":"2024-09-12T01:38:13.581377+0000","last_fullsized":"2024-09-12T01:38:13.581377+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'30","last_scrub_stamp":"2024-09-12T01:38:13.581243+0000","last_deep_scrub":"266'30","last_deep_scrub_stamp":"2024-09-12T01:38:13.581243+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.581243+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:42.561923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":109,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:35.118947+0000","last_change":"2024-09-12T01:02:03.927047+0000","last_active":"2024-09-12T01:34:35.118947+0000","last_peered":"2024-09-12T01:34:35.118947+0000","last_clean":"2024-09-12T01:34:35.118947+0000","last_became_active":"2024-09-12T01:02:03.926699+0000","last_became_peered":"2024-09-12T01:02:03.926699+0000","last_unstale":"2024-09-12T01:34:35.118947+0000","last_undegraded":"2024-09-12T01:34:35.118947+0000","last_fullsized":"2024-09-12T01:34:35.118947+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:16.113729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'7","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:38.669277+0000","last_change":"2024-09-12T00:43:43.819559+0000","last_active":"2024-09-12T01:37:38.669277+0000","last_peered":"2024-09-12T01:37:38.669277+0000","last_clean":"2024-09-12T01:37:38.669277+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:37:38.669277+0000","last_undegraded":"2024-09-12T01:37:38.669277+0000","last_fullsized":"2024-09-12T01:37:38.669277+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24570,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.647787+0000","last_change":"2024-09-12T01:38:16.647787+0000","last_active":"2024-09-12T01:38:16.647787+0000","last_peered":"2024-09-12T01:38:16.647787+0000","last_clean":"2024-09-12T01:38:16.647787+0000","last_became_active":"2024-09-12T00:43:38.798431+0000","last_became_peered":"2024-09-12T00:43:38.798431+0000","last_unstale":"2024-09-12T01:38:16.647787+0000","last_undegraded":"2024-09-12T01:38:16.647787+0000","last_fullsized":"2024-09-12T01:38:16.647787+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.647689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.647689+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.647689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:10.062955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":132,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.714325+0000","last_change":"2024-09-12T01:38:14.714325+0000","last_active":"2024-09-12T01:38:14.714325+0000","last_peered":"2024-09-12T01:38:14.714325+0000","last_clean":"2024-09-12T01:38:14.714325+0000","last_became_active":"2024-09-12T00:39:17.768901+0000","last_became_peered":"2024-09-12T00:39:17.768901+0000","last_unstale":"2024-09-12T01:38:14.714325+0000","last_undegraded":"2024-09-12T01:38:14.714325+0000","last_fullsized":"2024-09-12T01:38:14.714325+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T01:38:14.714227+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T01:38:14.714227+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.714227+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:14.636195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:37.248104+0000","last_change":"2024-09-12T01:02:03.922843+0000","last_active":"2024-09-12T01:34:37.248104+0000","last_peered":"2024-09-12T01:34:37.248104+0000","last_clean":"2024-09-12T01:34:37.248104+0000","last_became_active":"2024-09-12T01:02:03.922500+0000","last_became_peered":"2024-09-12T01:02:03.922500+0000","last_unstale":"2024-09-12T01:34:37.248104+0000","last_undegraded":"2024-09-12T01:34:37.248104+0000","last_fullsized":"2024-09-12T01:34:37.248104+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:26.949487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:49.539497+0000","last_change":"2024-09-12T00:43:43.824719+0000","last_active":"2024-09-12T01:35:49.539497+0000","last_peered":"2024-09-12T01:35:49.539497+0000","last_clean":"2024-09-12T01:35:49.539497+0000","last_became_active":"2024-09-12T00:43:43.823554+0000","last_became_peered":"2024-09-12T00:43:43.823554+0000","last_unstale":"2024-09-12T01:35:49.539497+0000","last_undegraded":"2024-09-12T01:35:49.539497+0000","last_fullsized":"2024-09-12T01:35:49.539497+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.538793+0000","last_change":"2024-09-12T00:43:38.798395+0000","last_active":"2024-09-12T01:35:44.538793+0000","last_peered":"2024-09-12T01:35:44.538793+0000","last_clean":"2024-09-12T01:35:44.538793+0000","last_became_active":"2024-09-12T00:43:38.798117+0000","last_became_peered":"2024-09-12T00:43:38.798117+0000","last_unstale":"2024-09-12T01:35:44.538793+0000","last_undegraded":"2024-09-12T01:35:44.538793+0000","last_fullsized":"2024-09-12T01:35:44.538793+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'16","reported_seq":99,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537633+0000","last_change":"2024-09-12T00:39:17.768795+0000","last_active":"2024-09-12T01:35:34.537633+0000","last_peered":"2024-09-12T01:35:34.537633+0000","last_clean":"2024-09-12T01:35:34.537633+0000","last_became_active":"2024-09-12T00:39:17.768503+0000","last_became_peered":"2024-09-12T00:39:17.768503+0000","last_unstale":"2024-09-12T01:35:34.537633+0000","last_undegraded":"2024-09-12T01:35:34.537633+0000","last_fullsized":"2024-09-12T01:35:34.537633+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:39:49.617037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.004612+0000","last_change":"2024-09-12T01:02:03.928738+0000","last_active":"2024-09-12T01:35:24.004612+0000","last_peered":"2024-09-12T01:35:24.004612+0000","last_clean":"2024-09-12T01:35:24.004612+0000","last_became_active":"2024-09-12T01:02:03.928430+0000","last_became_peered":"2024-09-12T01:02:03.928430+0000","last_unstale":"2024-09-12T01:35:24.004612+0000","last_undegraded":"2024-09-12T01:35:24.004612+0000","last_fullsized":"2024-09-12T01:35:24.004612+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:55.731213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.512944+0000","last_change":"2024-09-12T01:38:21.512944+0000","last_active":"2024-09-12T01:38:21.512944+0000","last_peered":"2024-09-12T01:38:21.512944+0000","last_clean":"2024-09-12T01:38:21.512944+0000","last_became_active":"2024-09-12T00:43:43.822996+0000","last_became_peered":"2024-09-12T00:43:43.822996+0000","last_unstale":"2024-09-12T01:38:21.512944+0000","last_undegraded":"2024-09-12T01:38:21.512944+0000","last_fullsized":"2024-09-12T01:38:21.512944+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:21.512843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:21.512843+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.512843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:05.059540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'2","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.483184+0000","last_change":"2024-09-12T01:38:21.483184+0000","last_active":"2024-09-12T01:38:21.483184+0000","last_peered":"2024-09-12T01:38:21.483184+0000","last_clean":"2024-09-12T01:38:21.483184+0000","last_became_active":"2024-09-12T00:43:38.797367+0000","last_became_peered":"2024-09-12T00:43:38.797367+0000","last_unstale":"2024-09-12T01:38:21.483184+0000","last_undegraded":"2024-09-12T01:38:21.483184+0000","last_fullsized":"2024-09-12T01:38:21.483184+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:21.483069+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:21.483069+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.483069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:49.131655+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'9","reported_seq":83,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537587+0000","last_change":"2024-09-12T00:39:17.759644+0000","last_active":"2024-09-12T01:35:34.537587+0000","last_peered":"2024-09-12T01:35:34.537587+0000","last_clean":"2024-09-12T01:35:34.537587+0000","last_became_active":"2024-09-12T00:39:17.759327+0000","last_became_peered":"2024-09-12T00:39:17.759327+0000","last_unstale":"2024-09-12T01:35:34.537587+0000","last_undegraded":"2024-09-12T01:35:34.537587+0000","last_fullsized":"2024-09-12T01:35:34.537587+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:23:23.808909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":31,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536493+0000","last_change":"2024-09-12T01:02:03.925373+0000","last_active":"2024-09-12T01:35:24.536493+0000","last_peered":"2024-09-12T01:35:24.536493+0000","last_clean":"2024-09-12T01:35:24.536493+0000","last_became_active":"2024-09-12T01:02:03.925081+0000","last_became_peered":"2024-09-12T01:02:03.925081+0000","last_unstale":"2024-09-12T01:35:24.536493+0000","last_undegraded":"2024-09-12T01:35:24.536493+0000","last_fullsized":"2024-09-12T01:35:24.536493+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:09.007940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'4","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.581279+0000","last_change":"2024-09-12T01:38:18.581279+0000","last_active":"2024-09-12T01:38:18.581279+0000","last_peered":"2024-09-12T01:38:18.581279+0000","last_clean":"2024-09-12T01:38:18.581279+0000","last_became_active":"2024-09-12T00:43:43.822237+0000","last_became_peered":"2024-09-12T00:43:43.822237+0000","last_unstale":"2024-09-12T01:38:18.581279+0000","last_undegraded":"2024-09-12T01:38:18.581279+0000","last_fullsized":"2024-09-12T01:38:18.581279+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:18.581176+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:18.581176+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.581176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:25.657953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'6","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.761259+0000","last_change":"2024-09-12T01:38:17.761259+0000","last_active":"2024-09-12T01:38:17.761259+0000","last_peered":"2024-09-12T01:38:17.761259+0000","last_clean":"2024-09-12T01:38:17.761259+0000","last_became_active":"2024-09-12T00:43:38.793943+0000","last_became_peered":"2024-09-12T00:43:38.793943+0000","last_unstale":"2024-09-12T01:38:17.761259+0000","last_undegraded":"2024-09-12T01:38:17.761259+0000","last_fullsized":"2024-09-12T01:38:17.761259+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T01:38:17.761175+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T01:38:17.761175+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.761175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:37.005205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11272,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"266'26","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.707662+0000","last_change":"2024-09-12T01:38:11.707662+0000","last_active":"2024-09-12T01:38:11.707662+0000","last_peered":"2024-09-12T01:38:11.707662+0000","last_clean":"2024-09-12T01:38:11.707662+0000","last_became_active":"2024-09-12T00:39:17.770093+0000","last_became_peered":"2024-09-12T00:39:17.770093+0000","last_unstale":"2024-09-12T01:38:11.707662+0000","last_undegraded":"2024-09-12T01:38:11.707662+0000","last_fullsized":"2024-09-12T01:38:11.707662+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T01:38:11.707576+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T01:38:11.707576+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.707576+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:31.726573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'194","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.782554+0000","last_change":"2024-09-12T01:37:51.782461+0000","last_active":"2024-09-12T01:37:51.782554+0000","last_peered":"2024-09-12T01:37:51.782554+0000","last_clean":"2024-09-12T01:37:51.782554+0000","last_became_active":"2024-09-12T00:25:00.479764+0000","last_became_peered":"2024-09-12T00:25:00.479764+0000","last_unstale":"2024-09-12T01:37:51.782554+0000","last_undegraded":"2024-09-12T01:37:51.782554+0000","last_fullsized":"2024-09-12T01:37:51.782554+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T01:37:51.782310+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T01:37:51.782310+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.782310+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:39.097138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":6490,"num_write":862,"num_write_kb":17717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'386","reported_seq":1940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.837693+0000","last_change":"2024-09-12T01:37:59.837693+0000","last_active":"2024-09-12T01:37:59.837693+0000","last_peered":"2024-09-12T01:37:59.837693+0000","last_clean":"2024-09-12T01:37:59.837693+0000","last_became_active":"2024-09-12T00:25:02.474473+0000","last_became_peered":"2024-09-12T00:25:02.474473+0000","last_unstale":"2024-09-12T01:37:59.837693+0000","last_undegraded":"2024-09-12T01:37:59.837693+0000","last_fullsized":"2024-09-12T01:37:59.837693+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'386","last_scrub_stamp":"2024-09-12T01:37:59.837583+0000","last_deep_scrub":"266'386","last_deep_scrub_stamp":"2024-09-12T01:37:59.837583+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.837583+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:41.730695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2167,"num_read_kb":2073,"num_write":418,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'235","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.616677+0000","last_change":"2024-09-12T01:37:57.616619+0000","last_active":"2024-09-12T01:37:57.616677+0000","last_peered":"2024-09-12T01:37:57.616677+0000","last_clean":"2024-09-12T01:37:57.616677+0000","last_became_active":"2024-09-12T00:25:00.469588+0000","last_became_peered":"2024-09-12T00:25:00.469588+0000","last_unstale":"2024-09-12T01:37:57.616677+0000","last_undegraded":"2024-09-12T01:37:57.616677+0000","last_fullsized":"2024-09-12T01:37:57.616677+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'235","last_scrub_stamp":"2024-09-12T01:37:57.616503+0000","last_deep_scrub":"266'235","last_deep_scrub_stamp":"2024-09-12T01:37:57.616503+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.616503+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:16.143384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038976,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":700,"num_read_kb":64068,"num_write":1104,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'892","reported_seq":2586,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.970072+0000","last_change":"2024-09-12T01:38:08.970072+0000","last_active":"2024-09-12T01:38:08.970072+0000","last_peered":"2024-09-12T01:38:08.970072+0000","last_clean":"2024-09-12T01:38:08.970072+0000","last_became_active":"2024-09-12T00:25:02.476131+0000","last_became_peered":"2024-09-12T00:25:02.476131+0000","last_unstale":"2024-09-12T01:38:08.970072+0000","last_undegraded":"2024-09-12T01:38:08.970072+0000","last_fullsized":"2024-09-12T01:38:08.970072+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'892","last_scrub_stamp":"2024-09-12T01:38:08.969967+0000","last_deep_scrub":"266'892","last_deep_scrub_stamp":"2024-09-12T01:38:08.969967+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.969967+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:34.555648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4103,"num_read_kb":3695,"num_write":1128,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'210","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.565091+0000","last_change":"2024-09-12T01:37:58.565004+0000","last_active":"2024-09-12T01:37:58.565091+0000","last_peered":"2024-09-12T01:37:58.565091+0000","last_clean":"2024-09-12T01:37:58.565091+0000","last_became_active":"2024-09-12T00:25:00.458072+0000","last_became_peered":"2024-09-12T00:25:00.458072+0000","last_unstale":"2024-09-12T01:37:58.565091+0000","last_undegraded":"2024-09-12T01:37:58.565091+0000","last_fullsized":"2024-09-12T01:37:58.565091+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T01:37:58.564864+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T01:37:58.564864+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.564864+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:34.721743+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":12854,"num_write":984,"num_write_kb":25223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1328","reported_seq":2890,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.970587+0000","last_change":"2024-09-12T01:38:09.970587+0000","last_active":"2024-09-12T01:38:09.970587+0000","last_peered":"2024-09-12T01:38:09.970587+0000","last_clean":"2024-09-12T01:38:09.970587+0000","last_became_active":"2024-09-12T00:25:02.470249+0000","last_became_peered":"2024-09-12T00:25:02.470249+0000","last_unstale":"2024-09-12T01:38:09.970587+0000","last_undegraded":"2024-09-12T01:38:09.970587+0000","last_fullsized":"2024-09-12T01:38:09.970587+0000","mapping_epoch":28,"log_start":"266'1300","ondisk_log_start":"266'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1328","last_scrub_stamp":"2024-09-12T01:38:09.970500+0000","last_deep_scrub":"266'1328","last_deep_scrub_stamp":"2024-09-12T01:38:09.970500+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.970500+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":1300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:18.710168+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5936,"num_read_kb":5183,"num_write":1890,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'198","reported_seq":841,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.701005+0000","last_change":"2024-09-12T01:37:49.701005+0000","last_active":"2024-09-12T01:37:49.701005+0000","last_peered":"2024-09-12T01:37:49.701005+0000","last_clean":"2024-09-12T01:37:49.701005+0000","last_became_active":"2024-09-12T00:25:00.482357+0000","last_became_peered":"2024-09-12T00:25:00.482357+0000","last_unstale":"2024-09-12T01:37:49.701005+0000","last_undegraded":"2024-09-12T01:37:49.701005+0000","last_fullsized":"2024-09-12T01:37:49.701005+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'198","last_scrub_stamp":"2024-09-12T01:37:49.700861+0000","last_deep_scrub":"266'198","last_deep_scrub_stamp":"2024-09-12T01:37:49.700861+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.700861+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:41.600504+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":30861,"num_write":868,"num_write_kb":33122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'568","reported_seq":2123,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.305956+0000","last_change":"2024-09-12T01:38:01.305956+0000","last_active":"2024-09-12T01:38:01.305956+0000","last_peered":"2024-09-12T01:38:01.305956+0000","last_clean":"2024-09-12T01:38:01.305956+0000","last_became_active":"2024-09-12T00:25:02.467378+0000","last_became_peered":"2024-09-12T00:25:02.467378+0000","last_unstale":"2024-09-12T01:38:01.305956+0000","last_undegraded":"2024-09-12T01:38:01.305956+0000","last_fullsized":"2024-09-12T01:38:01.305956+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'568","last_scrub_stamp":"2024-09-12T01:38:01.305854+0000","last_deep_scrub":"266'568","last_deep_scrub_stamp":"2024-09-12T01:38:01.305854+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.305854+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:08.402665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2918,"num_read_kb":2656,"num_write":743,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'211","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.817464+0000","last_change":"2024-09-12T01:37:50.817464+0000","last_active":"2024-09-12T01:37:50.817464+0000","last_peered":"2024-09-12T01:37:50.817464+0000","last_clean":"2024-09-12T01:37:50.817464+0000","last_became_active":"2024-09-12T00:25:00.475340+0000","last_became_peered":"2024-09-12T00:25:00.475340+0000","last_unstale":"2024-09-12T01:37:50.817464+0000","last_undegraded":"2024-09-12T01:37:50.817464+0000","last_fullsized":"2024-09-12T01:37:50.817464+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T01:37:50.817350+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T01:37:50.817350+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.817350+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:44.835143+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":13966,"num_write":1015,"num_write_kb":23620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'576","reported_seq":2287,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.816314+0000","last_change":"2024-09-12T01:37:58.816314+0000","last_active":"2024-09-12T01:37:58.816314+0000","last_peered":"2024-09-12T01:37:58.816314+0000","last_clean":"2024-09-12T01:37:58.816314+0000","last_became_active":"2024-09-12T00:25:02.474229+0000","last_became_peered":"2024-09-12T00:25:02.474229+0000","last_unstale":"2024-09-12T01:37:58.816314+0000","last_undegraded":"2024-09-12T01:37:58.816314+0000","last_fullsized":"2024-09-12T01:37:58.816314+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'576","last_scrub_stamp":"2024-09-12T01:37:58.816221+0000","last_deep_scrub":"266'576","last_deep_scrub_stamp":"2024-09-12T01:37:58.816221+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.816221+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:01.221779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2896,"num_write":736,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1072,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'188","reported_seq":939,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.754127+0000","last_change":"2024-09-12T01:37:50.754127+0000","last_active":"2024-09-12T01:37:50.754127+0000","last_peered":"2024-09-12T01:37:50.754127+0000","last_clean":"2024-09-12T01:37:50.754127+0000","last_became_active":"2024-09-12T00:25:00.487589+0000","last_became_peered":"2024-09-12T00:25:00.487589+0000","last_unstale":"2024-09-12T01:37:50.754127+0000","last_undegraded":"2024-09-12T01:37:50.754127+0000","last_fullsized":"2024-09-12T01:37:50.754127+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:50.754013+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:50.754013+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.754013+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:08.640403+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8822595,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":942,"num_read_kb":45033,"num_write":954,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'529","reported_seq":2429,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.856271+0000","last_change":"2024-09-12T01:37:59.856187+0000","last_active":"2024-09-12T01:37:59.856271+0000","last_peered":"2024-09-12T01:37:59.856271+0000","last_clean":"2024-09-12T01:37:59.856271+0000","last_became_active":"2024-09-12T00:25:02.477395+0000","last_became_peered":"2024-09-12T00:25:02.477395+0000","last_unstale":"2024-09-12T01:37:59.856271+0000","last_undegraded":"2024-09-12T01:37:59.856271+0000","last_fullsized":"2024-09-12T01:37:59.856271+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'529","last_scrub_stamp":"2024-09-12T01:37:59.856094+0000","last_deep_scrub":"266'529","last_deep_scrub_stamp":"2024-09-12T01:37:59.856094+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.856094+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:03.807614+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3189,"num_read_kb":3033,"num_write":616,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2555,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'234","reported_seq":903,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.867960+0000","last_change":"2024-09-12T01:37:49.867960+0000","last_active":"2024-09-12T01:37:49.867960+0000","last_peered":"2024-09-12T01:37:49.867960+0000","last_clean":"2024-09-12T01:37:49.867960+0000","last_became_active":"2024-09-12T00:25:00.477590+0000","last_became_peered":"2024-09-12T00:25:00.477590+0000","last_unstale":"2024-09-12T01:37:49.867960+0000","last_undegraded":"2024-09-12T01:37:49.867960+0000","last_fullsized":"2024-09-12T01:37:49.867960+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'234","last_scrub_stamp":"2024-09-12T01:37:49.867814+0000","last_deep_scrub":"266'234","last_deep_scrub_stamp":"2024-09-12T01:37:49.867814+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.867814+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:35.864908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048652,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":24485,"num_write":1039,"num_write_kb":27596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'375","reported_seq":1766,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.698712+0000","last_change":"2024-09-12T01:37:55.698644+0000","last_active":"2024-09-12T01:37:55.698712+0000","last_peered":"2024-09-12T01:37:55.698712+0000","last_clean":"2024-09-12T01:37:55.698712+0000","last_became_active":"2024-09-12T00:25:02.466439+0000","last_became_peered":"2024-09-12T00:25:02.466439+0000","last_unstale":"2024-09-12T01:37:55.698712+0000","last_undegraded":"2024-09-12T01:37:55.698712+0000","last_fullsized":"2024-09-12T01:37:55.698712+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'375","last_scrub_stamp":"2024-09-12T01:37:55.698565+0000","last_deep_scrub":"266'375","last_deep_scrub_stamp":"2024-09-12T01:37:55.698565+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.698565+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:29.902650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1739,"num_write":422,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'188","reported_seq":801,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.564948+0000","last_change":"2024-09-12T01:37:56.564948+0000","last_active":"2024-09-12T01:37:56.564948+0000","last_peered":"2024-09-12T01:37:56.564948+0000","last_clean":"2024-09-12T01:37:56.564948+0000","last_became_active":"2024-09-12T00:25:00.472046+0000","last_became_peered":"2024-09-12T00:25:00.472046+0000","last_unstale":"2024-09-12T01:37:56.564948+0000","last_undegraded":"2024-09-12T01:37:56.564948+0000","last_fullsized":"2024-09-12T01:37:56.564948+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:56.564688+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:56.564688+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.564688+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:04.119213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":23076,"num_write":837,"num_write_kb":28135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'364","reported_seq":1848,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.628354+0000","last_change":"2024-09-12T01:38:07.628354+0000","last_active":"2024-09-12T01:38:07.628354+0000","last_peered":"2024-09-12T01:38:07.628354+0000","last_clean":"2024-09-12T01:38:07.628354+0000","last_became_active":"2024-09-12T00:25:02.474791+0000","last_became_peered":"2024-09-12T00:25:02.474791+0000","last_unstale":"2024-09-12T01:38:07.628354+0000","last_undegraded":"2024-09-12T01:38:07.628354+0000","last_fullsized":"2024-09-12T01:38:07.628354+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'364","last_scrub_stamp":"2024-09-12T01:38:07.628270+0000","last_deep_scrub":"266'364","last_deep_scrub_stamp":"2024-09-12T01:38:07.628270+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.628270+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:42.047911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2089,"num_read_kb":2020,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'478","reported_seq":2155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.938318+0000","last_change":"2024-09-12T01:38:07.938318+0000","last_active":"2024-09-12T01:38:07.938318+0000","last_peered":"2024-09-12T01:38:07.938318+0000","last_clean":"2024-09-12T01:38:07.938318+0000","last_became_active":"2024-09-12T00:25:02.471545+0000","last_became_peered":"2024-09-12T00:25:02.471545+0000","last_unstale":"2024-09-12T01:38:07.938318+0000","last_undegraded":"2024-09-12T01:38:07.938318+0000","last_fullsized":"2024-09-12T01:38:07.938318+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'478","last_scrub_stamp":"2024-09-12T01:38:07.938236+0000","last_deep_scrub":"266'478","last_deep_scrub_stamp":"2024-09-12T01:38:07.938236+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.938236+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:00.495364+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2642,"num_read_kb":2498,"num_write":559,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'202","reported_seq":1070,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.902175+0000","last_change":"2024-09-12T01:37:48.902175+0000","last_active":"2024-09-12T01:37:48.902175+0000","last_peered":"2024-09-12T01:37:48.902175+0000","last_clean":"2024-09-12T01:37:48.902175+0000","last_became_active":"2024-09-12T00:25:00.464783+0000","last_became_peered":"2024-09-12T00:25:00.464783+0000","last_unstale":"2024-09-12T01:37:48.902175+0000","last_undegraded":"2024-09-12T01:37:48.902175+0000","last_fullsized":"2024-09-12T01:37:48.902175+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'202","last_scrub_stamp":"2024-09-12T01:37:48.902072+0000","last_deep_scrub":"266'202","last_deep_scrub_stamp":"2024-09-12T01:37:48.902072+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.902072+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.439697+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":967,"num_read_kb":27994,"num_write":1073,"num_write_kb":26373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'504","reported_seq":2079,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.764743+0000","last_change":"2024-09-12T01:37:54.764743+0000","last_active":"2024-09-12T01:37:54.764743+0000","last_peered":"2024-09-12T01:37:54.764743+0000","last_clean":"2024-09-12T01:37:54.764743+0000","last_became_active":"2024-09-12T00:25:02.475032+0000","last_became_peered":"2024-09-12T00:25:02.475032+0000","last_unstale":"2024-09-12T01:37:54.764743+0000","last_undegraded":"2024-09-12T01:37:54.764743+0000","last_fullsized":"2024-09-12T01:37:54.764743+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'504","last_scrub_stamp":"2024-09-12T01:37:54.764639+0000","last_deep_scrub":"266'504","last_deep_scrub_stamp":"2024-09-12T01:37:54.764639+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.764639+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:07.905496+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2653,"num_read_kb":2473,"num_write":625,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'211","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.771568+0000","last_change":"2024-09-12T01:37:52.771568+0000","last_active":"2024-09-12T01:37:52.771568+0000","last_peered":"2024-09-12T01:37:52.771568+0000","last_clean":"2024-09-12T01:37:52.771568+0000","last_became_active":"2024-09-12T00:25:00.479635+0000","last_became_peered":"2024-09-12T00:25:00.479635+0000","last_unstale":"2024-09-12T01:37:52.771568+0000","last_undegraded":"2024-09-12T01:37:52.771568+0000","last_fullsized":"2024-09-12T01:37:52.771568+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T01:37:52.771466+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T01:37:52.771466+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.771466+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:45.884259+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279168,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":30051,"num_write":937,"num_write_kb":51711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'1151","reported_seq":2940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.880921+0000","last_change":"2024-09-12T01:37:54.880921+0000","last_active":"2024-09-12T01:37:54.880921+0000","last_peered":"2024-09-12T01:37:54.880921+0000","last_clean":"2024-09-12T01:37:54.880921+0000","last_became_active":"2024-09-12T00:25:02.467224+0000","last_became_peered":"2024-09-12T00:25:02.467224+0000","last_unstale":"2024-09-12T01:37:54.880921+0000","last_undegraded":"2024-09-12T01:37:54.880921+0000","last_fullsized":"2024-09-12T01:37:54.880921+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1151","last_scrub_stamp":"2024-09-12T01:37:54.880810+0000","last_deep_scrub":"266'1151","last_deep_scrub_stamp":"2024-09-12T01:37:54.880810+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.880810+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":1100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.639713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5645,"num_read_kb":4973,"num_write":1729,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'210","reported_seq":855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.874315+0000","last_change":"2024-09-12T01:37:48.874315+0000","last_active":"2024-09-12T01:37:48.874315+0000","last_peered":"2024-09-12T01:37:48.874315+0000","last_clean":"2024-09-12T01:37:48.874315+0000","last_became_active":"2024-09-12T00:25:00.477184+0000","last_became_peered":"2024-09-12T00:25:00.477184+0000","last_unstale":"2024-09-12T01:37:48.874315+0000","last_undegraded":"2024-09-12T01:37:48.874315+0000","last_fullsized":"2024-09-12T01:37:48.874315+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T01:37:48.874041+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T01:37:48.874041+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.874041+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:11.950680+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3321654,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":408,"num_read_kb":20227,"num_write":1015,"num_write_kb":31572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'487","reported_seq":2026,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.351017+0000","last_change":"2024-09-12T01:37:59.351017+0000","last_active":"2024-09-12T01:37:59.351017+0000","last_peered":"2024-09-12T01:37:59.351017+0000","last_clean":"2024-09-12T01:37:59.351017+0000","last_became_active":"2024-09-12T00:25:02.469463+0000","last_became_peered":"2024-09-12T00:25:02.469463+0000","last_unstale":"2024-09-12T01:37:59.351017+0000","last_undegraded":"2024-09-12T01:37:59.351017+0000","last_fullsized":"2024-09-12T01:37:59.351017+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'487","last_scrub_stamp":"2024-09-12T01:37:59.350932+0000","last_deep_scrub":"266'487","last_deep_scrub_stamp":"2024-09-12T01:37:59.350932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.350932+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:05.093460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2387,"num_write":615,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'190","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.874423+0000","last_change":"2024-09-12T01:37:47.874423+0000","last_active":"2024-09-12T01:37:47.874423+0000","last_peered":"2024-09-12T01:37:47.874423+0000","last_clean":"2024-09-12T01:37:47.874423+0000","last_became_active":"2024-09-12T00:25:00.483327+0000","last_became_peered":"2024-09-12T00:25:00.483327+0000","last_unstale":"2024-09-12T01:37:47.874423+0000","last_undegraded":"2024-09-12T01:37:47.874423+0000","last_fullsized":"2024-09-12T01:37:47.874423+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T01:37:47.874305+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T01:37:47.874305+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.874305+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:25.303987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395812,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":12020,"num_write":922,"num_write_kb":12011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'411","reported_seq":2010,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.626361+0000","last_change":"2024-09-12T01:38:06.626361+0000","last_active":"2024-09-12T01:38:06.626361+0000","last_peered":"2024-09-12T01:38:06.626361+0000","last_clean":"2024-09-12T01:38:06.626361+0000","last_became_active":"2024-09-12T00:25:02.471598+0000","last_became_peered":"2024-09-12T00:25:02.471598+0000","last_unstale":"2024-09-12T01:38:06.626361+0000","last_undegraded":"2024-09-12T01:38:06.626361+0000","last_fullsized":"2024-09-12T01:38:06.626361+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'411","last_scrub_stamp":"2024-09-12T01:38:06.626274+0000","last_deep_scrub":"266'411","last_deep_scrub_stamp":"2024-09-12T01:38:06.626274+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.626274+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:26.680294+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2389,"num_read_kb":2272,"num_write":462,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3460,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'177","reported_seq":844,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.284808+0000","last_change":"2024-09-12T01:37:52.284808+0000","last_active":"2024-09-12T01:37:52.284808+0000","last_peered":"2024-09-12T01:37:52.284808+0000","last_clean":"2024-09-12T01:37:52.284808+0000","last_became_active":"2024-09-12T00:25:00.478202+0000","last_became_peered":"2024-09-12T00:25:00.478202+0000","last_unstale":"2024-09-12T01:37:52.284808+0000","last_undegraded":"2024-09-12T01:37:52.284808+0000","last_fullsized":"2024-09-12T01:37:52.284808+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T01:37:52.284701+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T01:37:52.284701+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.284701+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:47.992887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":78408,"num_write":837,"num_write_kb":24955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'665","reported_seq":2206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.925694+0000","last_change":"2024-09-12T01:37:55.925694+0000","last_active":"2024-09-12T01:37:55.925694+0000","last_peered":"2024-09-12T01:37:55.925694+0000","last_clean":"2024-09-12T01:37:55.925694+0000","last_became_active":"2024-09-12T00:25:02.470278+0000","last_became_peered":"2024-09-12T00:25:02.470278+0000","last_unstale":"2024-09-12T01:37:55.925694+0000","last_undegraded":"2024-09-12T01:37:55.925694+0000","last_fullsized":"2024-09-12T01:37:55.925694+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'665","last_scrub_stamp":"2024-09-12T01:37:55.925590+0000","last_deep_scrub":"266'665","last_deep_scrub_stamp":"2024-09-12T01:37:55.925590+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.925590+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":600,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:59.829971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3455,"num_read_kb":3151,"num_write":936,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'238","reported_seq":915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.212407+0000","last_change":"2024-09-12T01:37:50.212407+0000","last_active":"2024-09-12T01:37:50.212407+0000","last_peered":"2024-09-12T01:37:50.212407+0000","last_clean":"2024-09-12T01:37:50.212407+0000","last_became_active":"2024-09-12T00:25:00.456765+0000","last_became_peered":"2024-09-12T00:25:00.456765+0000","last_unstale":"2024-09-12T01:37:50.212407+0000","last_undegraded":"2024-09-12T01:37:50.212407+0000","last_fullsized":"2024-09-12T01:37:50.212407+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'238","last_scrub_stamp":"2024-09-12T01:37:50.212298+0000","last_deep_scrub":"266'238","last_deep_scrub_stamp":"2024-09-12T01:37:50.212298+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.212298+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:59.941924+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496550,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":628,"num_read_kb":22861,"num_write":1212,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'130","reported_seq":650,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.818021+0000","last_change":"2024-09-12T01:38:10.818021+0000","last_active":"2024-09-12T01:38:10.818021+0000","last_peered":"2024-09-12T01:38:10.818021+0000","last_clean":"2024-09-12T01:38:10.818021+0000","last_became_active":"2024-09-12T00:25:10.523187+0000","last_became_peered":"2024-09-12T00:25:10.523187+0000","last_unstale":"2024-09-12T01:38:10.818021+0000","last_undegraded":"2024-09-12T01:38:10.818021+0000","last_fullsized":"2024-09-12T01:38:10.818021+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'130","last_scrub_stamp":"2024-09-12T01:38:10.817927+0000","last_deep_scrub":"266'130","last_deep_scrub_stamp":"2024-09-12T01:38:10.817927+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.817927+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:55.101000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'452","reported_seq":2147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.335059+0000","last_change":"2024-09-12T01:37:57.335059+0000","last_active":"2024-09-12T01:37:57.335059+0000","last_peered":"2024-09-12T01:37:57.335059+0000","last_clean":"2024-09-12T01:37:57.335059+0000","last_became_active":"2024-09-12T00:25:02.464035+0000","last_became_peered":"2024-09-12T00:25:02.464035+0000","last_unstale":"2024-09-12T01:37:57.335059+0000","last_undegraded":"2024-09-12T01:37:57.335059+0000","last_fullsized":"2024-09-12T01:37:57.335059+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'452","last_scrub_stamp":"2024-09-12T01:37:57.334965+0000","last_deep_scrub":"266'452","last_deep_scrub_stamp":"2024-09-12T01:37:57.334965+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.334965+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.139483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2614,"num_read_kb":2487,"num_write":526,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'214","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.033783+0000","last_change":"2024-09-12T01:37:51.033783+0000","last_active":"2024-09-12T01:37:51.033783+0000","last_peered":"2024-09-12T01:37:51.033783+0000","last_clean":"2024-09-12T01:37:51.033783+0000","last_became_active":"2024-09-12T00:25:00.479335+0000","last_became_peered":"2024-09-12T00:25:00.479335+0000","last_unstale":"2024-09-12T01:37:51.033783+0000","last_undegraded":"2024-09-12T01:37:51.033783+0000","last_fullsized":"2024-09-12T01:37:51.033783+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'214","last_scrub_stamp":"2024-09-12T01:37:51.033591+0000","last_deep_scrub":"266'214","last_deep_scrub_stamp":"2024-09-12T01:37:51.033591+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.033591+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:30.332562+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1920160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":7515,"num_write":984,"num_write_kb":32910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.898679+0000","last_change":"2024-09-12T01:38:14.898679+0000","last_active":"2024-09-12T01:38:14.898679+0000","last_peered":"2024-09-12T01:38:14.898679+0000","last_clean":"2024-09-12T01:38:14.898679+0000","last_became_active":"2024-09-12T00:25:04.485389+0000","last_became_peered":"2024-09-12T00:25:04.485389+0000","last_unstale":"2024-09-12T01:38:14.898679+0000","last_undegraded":"2024-09-12T01:38:14.898679+0000","last_fullsized":"2024-09-12T01:38:14.898679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:14.898574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:14.898574+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.898574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:20.316403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'226","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.400672+0000","last_change":"2024-09-12T01:38:13.400672+0000","last_active":"2024-09-12T01:38:13.400672+0000","last_peered":"2024-09-12T01:38:13.400672+0000","last_clean":"2024-09-12T01:38:13.400672+0000","last_became_active":"2024-09-12T00:25:06.499933+0000","last_became_peered":"2024-09-12T00:25:06.499933+0000","last_unstale":"2024-09-12T01:38:13.400672+0000","last_undegraded":"2024-09-12T01:38:13.400672+0000","last_fullsized":"2024-09-12T01:38:13.400672+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:38:13.400555+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:38:13.400555+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.400555+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:34.461485+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7477,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":376,"num_write":176,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.815984+0000","last_change":"2024-09-12T01:38:09.815984+0000","last_active":"2024-09-12T01:38:09.815984+0000","last_peered":"2024-09-12T01:38:09.815984+0000","last_clean":"2024-09-12T01:38:09.815984+0000","last_became_active":"2024-09-12T00:25:08.501137+0000","last_became_peered":"2024-09-12T00:25:08.501137+0000","last_unstale":"2024-09-12T01:38:09.815984+0000","last_undegraded":"2024-09-12T01:38:09.815984+0000","last_fullsized":"2024-09-12T01:38:09.815984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.815888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.815888+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.815888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:44.572150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2437","reported_seq":4343,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.824280+0000","last_change":"2024-09-12T01:38:12.824280+0000","last_active":"2024-09-12T01:38:12.824280+0000","last_peered":"2024-09-12T01:38:12.824280+0000","last_clean":"2024-09-12T01:38:12.824280+0000","last_became_active":"2024-09-12T00:25:10.526016+0000","last_became_peered":"2024-09-12T00:25:10.526016+0000","last_unstale":"2024-09-12T01:38:12.824280+0000","last_undegraded":"2024-09-12T01:38:12.824280+0000","last_fullsized":"2024-09-12T01:38:12.824280+0000","mapping_epoch":36,"log_start":"266'2400","ondisk_log_start":"266'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2437","last_scrub_stamp":"2024-09-12T01:38:12.824166+0000","last_deep_scrub":"266'2437","last_deep_scrub_stamp":"2024-09-12T01:38:12.824166+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.824166+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":2400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:50.109401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6097,"num_read_kb":6097,"num_write":4851,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'892","reported_seq":2339,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.973679+0000","last_change":"2024-09-12T01:38:04.973679+0000","last_active":"2024-09-12T01:38:04.973679+0000","last_peered":"2024-09-12T01:38:04.973679+0000","last_clean":"2024-09-12T01:38:04.973679+0000","last_became_active":"2024-09-12T00:25:02.477360+0000","last_became_peered":"2024-09-12T00:25:02.477360+0000","last_unstale":"2024-09-12T01:38:04.973679+0000","last_undegraded":"2024-09-12T01:38:04.973679+0000","last_fullsized":"2024-09-12T01:38:04.973679+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'892","last_scrub_stamp":"2024-09-12T01:38:04.973568+0000","last_deep_scrub":"266'892","last_deep_scrub_stamp":"2024-09-12T01:38:04.973568+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.973568+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:59.857176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4073,"num_read_kb":3587,"num_write":1238,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'213","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.310189+0000","last_change":"2024-09-12T01:37:47.310189+0000","last_active":"2024-09-12T01:37:47.310189+0000","last_peered":"2024-09-12T01:37:47.310189+0000","last_clean":"2024-09-12T01:37:47.310189+0000","last_became_active":"2024-09-12T00:25:00.452236+0000","last_became_peered":"2024-09-12T00:25:00.452236+0000","last_unstale":"2024-09-12T01:37:47.310189+0000","last_undegraded":"2024-09-12T01:37:47.310189+0000","last_fullsized":"2024-09-12T01:37:47.310189+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T01:37:47.310082+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T01:37:47.310082+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.310082+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:32.824803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084046,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":27979,"num_write":1022,"num_write_kb":43410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.365412+0000","last_change":"2024-09-12T01:38:06.365412+0000","last_active":"2024-09-12T01:38:06.365412+0000","last_peered":"2024-09-12T01:38:06.365412+0000","last_clean":"2024-09-12T01:38:06.365412+0000","last_became_active":"2024-09-12T00:25:04.481218+0000","last_became_peered":"2024-09-12T00:25:04.481218+0000","last_unstale":"2024-09-12T01:38:06.365412+0000","last_undegraded":"2024-09-12T01:38:06.365412+0000","last_fullsized":"2024-09-12T01:38:06.365412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.365322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.365322+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.365322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:31.549095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'131","reported_seq":688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.820345+0000","last_change":"2024-09-12T01:38:03.820345+0000","last_active":"2024-09-12T01:38:03.820345+0000","last_peered":"2024-09-12T01:38:03.820345+0000","last_clean":"2024-09-12T01:38:03.820345+0000","last_became_active":"2024-09-12T00:25:06.490463+0000","last_became_peered":"2024-09-12T00:25:06.490463+0000","last_unstale":"2024-09-12T01:38:03.820345+0000","last_undegraded":"2024-09-12T01:38:03.820345+0000","last_fullsized":"2024-09-12T01:38:03.820345+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'131","last_scrub_stamp":"2024-09-12T01:38:03.820249+0000","last_deep_scrub":"266'131","last_deep_scrub_stamp":"2024-09-12T01:38:03.820249+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.820249+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:39.548081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":131,"num_write":102,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.820695+0000","last_change":"2024-09-12T01:38:08.820695+0000","last_active":"2024-09-12T01:38:08.820695+0000","last_peered":"2024-09-12T01:38:08.820695+0000","last_clean":"2024-09-12T01:38:08.820695+0000","last_became_active":"2024-09-12T00:25:08.505492+0000","last_became_peered":"2024-09-12T00:25:08.505492+0000","last_unstale":"2024-09-12T01:38:08.820695+0000","last_undegraded":"2024-09-12T01:38:08.820695+0000","last_fullsized":"2024-09-12T01:38:08.820695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.820592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.820592+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.820592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:47.296176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'143","reported_seq":672,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.324625+0000","last_change":"2024-09-12T01:38:13.324625+0000","last_active":"2024-09-12T01:38:13.324625+0000","last_peered":"2024-09-12T01:38:13.324625+0000","last_clean":"2024-09-12T01:38:13.324625+0000","last_became_active":"2024-09-12T00:25:10.522822+0000","last_became_peered":"2024-09-12T00:25:10.522822+0000","last_unstale":"2024-09-12T01:38:13.324625+0000","last_undegraded":"2024-09-12T01:38:13.324625+0000","last_fullsized":"2024-09-12T01:38:13.324625+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'143","last_scrub_stamp":"2024-09-12T01:38:13.324526+0000","last_deep_scrub":"266'143","last_deep_scrub_stamp":"2024-09-12T01:38:13.324526+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.324526+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:12.809401+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":196,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'484","reported_seq":2032,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.634426+0000","last_change":"2024-09-12T01:38:03.634426+0000","last_active":"2024-09-12T01:38:03.634426+0000","last_peered":"2024-09-12T01:38:03.634426+0000","last_clean":"2024-09-12T01:38:03.634426+0000","last_became_active":"2024-09-12T00:25:02.478850+0000","last_became_peered":"2024-09-12T00:25:02.478850+0000","last_unstale":"2024-09-12T01:38:03.634426+0000","last_undegraded":"2024-09-12T01:38:03.634426+0000","last_fullsized":"2024-09-12T01:38:03.634426+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'484","last_scrub_stamp":"2024-09-12T01:38:03.634343+0000","last_deep_scrub":"266'484","last_deep_scrub_stamp":"2024-09-12T01:38:03.634343+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.634343+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:40.357076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2311,"num_write":575,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'203","reported_seq":871,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.039288+0000","last_change":"2024-09-12T01:37:59.039288+0000","last_active":"2024-09-12T01:37:59.039288+0000","last_peered":"2024-09-12T01:37:59.039288+0000","last_clean":"2024-09-12T01:37:59.039288+0000","last_became_active":"2024-09-12T00:25:00.475628+0000","last_became_peered":"2024-09-12T00:25:00.475628+0000","last_unstale":"2024-09-12T01:37:59.039288+0000","last_undegraded":"2024-09-12T01:37:59.039288+0000","last_fullsized":"2024-09-12T01:37:59.039288+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'203","last_scrub_stamp":"2024-09-12T01:37:59.039165+0000","last_deep_scrub":"266'203","last_deep_scrub_stamp":"2024-09-12T01:37:59.039165+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.039165+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:59.337559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":1110,"num_write":851,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.359178+0000","last_change":"2024-09-12T01:38:05.359178+0000","last_active":"2024-09-12T01:38:05.359178+0000","last_peered":"2024-09-12T01:38:05.359178+0000","last_clean":"2024-09-12T01:38:05.359178+0000","last_became_active":"2024-09-12T00:25:04.483774+0000","last_became_peered":"2024-09-12T00:25:04.483774+0000","last_unstale":"2024-09-12T01:38:05.359178+0000","last_undegraded":"2024-09-12T01:38:05.359178+0000","last_fullsized":"2024-09-12T01:38:05.359178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:05.359093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:05.359093+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.359093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:49.765095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'150","reported_seq":734,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.403260+0000","last_change":"2024-09-12T01:38:12.403260+0000","last_active":"2024-09-12T01:38:12.403260+0000","last_peered":"2024-09-12T01:38:12.403260+0000","last_clean":"2024-09-12T01:38:12.403260+0000","last_became_active":"2024-09-12T00:25:06.500991+0000","last_became_peered":"2024-09-12T00:25:06.500991+0000","last_unstale":"2024-09-12T01:38:12.403260+0000","last_undegraded":"2024-09-12T01:38:12.403260+0000","last_fullsized":"2024-09-12T01:38:12.403260+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'150","last_scrub_stamp":"2024-09-12T01:38:12.403148+0000","last_deep_scrub":"266'150","last_deep_scrub_stamp":"2024-09-12T01:38:12.403148+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.403148+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:48.895619+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'798","reported_seq":4875,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.825438+0000","last_change":"2024-09-12T01:38:23.825438+0000","last_active":"2024-09-12T01:38:23.825438+0000","last_peered":"2024-09-12T01:38:23.825438+0000","last_clean":"2024-09-12T01:38:23.825438+0000","last_became_active":"2024-09-12T00:25:08.514360+0000","last_became_peered":"2024-09-12T00:25:08.514360+0000","last_unstale":"2024-09-12T01:38:23.825438+0000","last_undegraded":"2024-09-12T01:38:23.825438+0000","last_fullsized":"2024-09-12T01:38:23.825438+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'798","last_scrub_stamp":"2024-09-12T01:38:23.825351+0000","last_deep_scrub":"266'798","last_deep_scrub_stamp":"2024-09-12T01:38:23.825351+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.825351+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:59.908771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'204","reported_seq":1047,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.745394+0000","last_change":"2024-09-12T01:38:12.745394+0000","last_active":"2024-09-12T01:38:12.745394+0000","last_peered":"2024-09-12T01:38:12.745394+0000","last_clean":"2024-09-12T01:38:12.745394+0000","last_became_active":"2024-09-12T00:25:10.518861+0000","last_became_peered":"2024-09-12T00:25:10.518861+0000","last_unstale":"2024-09-12T01:38:12.745394+0000","last_undegraded":"2024-09-12T01:38:12.745394+0000","last_fullsized":"2024-09-12T01:38:12.745394+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'204","last_scrub_stamp":"2024-09-12T01:38:12.745294+0000","last_deep_scrub":"266'204","last_deep_scrub_stamp":"2024-09-12T01:38:12.745294+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.745294+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:23.575790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":600,"num_write":435,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'469","reported_seq":1997,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.640342+0000","last_change":"2024-09-12T01:38:04.640342+0000","last_active":"2024-09-12T01:38:04.640342+0000","last_peered":"2024-09-12T01:38:04.640342+0000","last_clean":"2024-09-12T01:38:04.640342+0000","last_became_active":"2024-09-12T00:25:02.477052+0000","last_became_peered":"2024-09-12T00:25:02.477052+0000","last_unstale":"2024-09-12T01:38:04.640342+0000","last_undegraded":"2024-09-12T01:38:04.640342+0000","last_fullsized":"2024-09-12T01:38:04.640342+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'469","last_scrub_stamp":"2024-09-12T01:38:04.640258+0000","last_deep_scrub":"266'469","last_deep_scrub_stamp":"2024-09-12T01:38:04.640258+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.640258+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:13.597150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2388,"num_read_kb":2234,"num_write":549,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'224","reported_seq":877,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.855846+0000","last_change":"2024-09-12T01:37:47.855846+0000","last_active":"2024-09-12T01:37:47.855846+0000","last_peered":"2024-09-12T01:37:47.855846+0000","last_clean":"2024-09-12T01:37:47.855846+0000","last_became_active":"2024-09-12T00:25:00.457828+0000","last_became_peered":"2024-09-12T00:25:00.457828+0000","last_unstale":"2024-09-12T01:37:47.855846+0000","last_undegraded":"2024-09-12T01:37:47.855846+0000","last_fullsized":"2024-09-12T01:37:47.855846+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'224","last_scrub_stamp":"2024-09-12T01:37:47.855735+0000","last_deep_scrub":"266'224","last_deep_scrub_stamp":"2024-09-12T01:37:47.855735+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.855735+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:52.029177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":9782,"num_write":1039,"num_write_kb":35060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.933842+0000","last_change":"2024-09-12T01:38:13.933842+0000","last_active":"2024-09-12T01:38:13.933842+0000","last_peered":"2024-09-12T01:38:13.933842+0000","last_clean":"2024-09-12T01:38:13.933842+0000","last_became_active":"2024-09-12T00:25:04.482173+0000","last_became_peered":"2024-09-12T00:25:04.482173+0000","last_unstale":"2024-09-12T01:38:13.933842+0000","last_undegraded":"2024-09-12T01:38:13.933842+0000","last_fullsized":"2024-09-12T01:38:13.933842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:13.933756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:13.933756+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.933756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:45.433581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'162","reported_seq":763,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.723613+0000","last_change":"2024-09-12T01:38:03.723613+0000","last_active":"2024-09-12T01:38:03.723613+0000","last_peered":"2024-09-12T01:38:03.723613+0000","last_clean":"2024-09-12T01:38:03.723613+0000","last_became_active":"2024-09-12T00:25:06.491337+0000","last_became_peered":"2024-09-12T00:25:06.491337+0000","last_unstale":"2024-09-12T01:38:03.723613+0000","last_undegraded":"2024-09-12T01:38:03.723613+0000","last_fullsized":"2024-09-12T01:38:03.723613+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'162","last_scrub_stamp":"2024-09-12T01:38:03.723515+0000","last_deep_scrub":"266'162","last_deep_scrub_stamp":"2024-09-12T01:38:03.723515+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.723515+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:22.002913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5611,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":280,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'802","reported_seq":2777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.623540+0000","last_change":"2024-09-12T01:38:15.623540+0000","last_active":"2024-09-12T01:38:15.623540+0000","last_peered":"2024-09-12T01:38:15.623540+0000","last_clean":"2024-09-12T01:38:15.623540+0000","last_became_active":"2024-09-12T00:25:08.512125+0000","last_became_peered":"2024-09-12T00:25:08.512125+0000","last_unstale":"2024-09-12T01:38:15.623540+0000","last_undegraded":"2024-09-12T01:38:15.623540+0000","last_fullsized":"2024-09-12T01:38:15.623540+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'802","last_scrub_stamp":"2024-09-12T01:38:15.623462+0000","last_deep_scrub":"266'802","last_deep_scrub_stamp":"2024-09-12T01:38:15.623462+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.623462+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:58.941127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'2026","reported_seq":3654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.975474+0000","last_change":"2024-09-12T01:38:02.975474+0000","last_active":"2024-09-12T01:38:02.975474+0000","last_peered":"2024-09-12T01:38:02.975474+0000","last_clean":"2024-09-12T01:38:02.975474+0000","last_became_active":"2024-09-12T00:25:02.465239+0000","last_became_peered":"2024-09-12T00:25:02.465239+0000","last_unstale":"2024-09-12T01:38:02.975474+0000","last_undegraded":"2024-09-12T01:38:02.975474+0000","last_fullsized":"2024-09-12T01:38:02.975474+0000","mapping_epoch":28,"log_start":"266'2000","ondisk_log_start":"266'2000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2026","last_scrub_stamp":"2024-09-12T01:38:02.975389+0000","last_deep_scrub":"266'2026","last_deep_scrub_stamp":"2024-09-12T01:38:02.975389+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.975389+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":2000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:35.114687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8773,"num_read_kb":7539,"num_write":2902,"num_write_kb":1299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":707,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'179","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.933037+0000","last_change":"2024-09-12T01:37:44.933037+0000","last_active":"2024-09-12T01:37:44.933037+0000","last_peered":"2024-09-12T01:37:44.933037+0000","last_clean":"2024-09-12T01:37:44.933037+0000","last_became_active":"2024-09-12T00:25:00.466899+0000","last_became_peered":"2024-09-12T00:25:00.466899+0000","last_unstale":"2024-09-12T01:37:44.933037+0000","last_undegraded":"2024-09-12T01:37:44.933037+0000","last_fullsized":"2024-09-12T01:37:44.933037+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'179","last_scrub_stamp":"2024-09-12T01:37:44.932938+0000","last_deep_scrub":"266'179","last_deep_scrub_stamp":"2024-09-12T01:37:44.932938+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.932938+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:07.942233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":366,"num_read_kb":8806,"num_write":851,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.916231+0000","last_change":"2024-09-12T01:37:57.916231+0000","last_active":"2024-09-12T01:37:57.916231+0000","last_peered":"2024-09-12T01:37:57.916231+0000","last_clean":"2024-09-12T01:37:57.916231+0000","last_became_active":"2024-09-12T00:25:04.482885+0000","last_became_peered":"2024-09-12T00:25:04.482885+0000","last_unstale":"2024-09-12T01:37:57.916231+0000","last_undegraded":"2024-09-12T01:37:57.916231+0000","last_fullsized":"2024-09-12T01:37:57.916231+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:57.916140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:57.916140+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.916140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:21.912079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'273","reported_seq":934,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.883497+0000","last_change":"2024-09-12T01:38:03.883497+0000","last_active":"2024-09-12T01:38:03.883497+0000","last_peered":"2024-09-12T01:38:03.883497+0000","last_clean":"2024-09-12T01:38:03.883497+0000","last_became_active":"2024-09-12T00:25:06.497881+0000","last_became_peered":"2024-09-12T00:25:06.497881+0000","last_unstale":"2024-09-12T01:38:03.883497+0000","last_undegraded":"2024-09-12T01:38:03.883497+0000","last_fullsized":"2024-09-12T01:38:03.883497+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'273","last_scrub_stamp":"2024-09-12T01:38:03.883401+0000","last_deep_scrub":"266'273","last_deep_scrub_stamp":"2024-09-12T01:38:03.883401+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.883401+0000","objects_scrubbed":10,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:36.967915+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20748,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":371,"num_read_kb":470,"num_write":222,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.310704+0000","last_change":"2024-09-12T01:38:10.310704+0000","last_active":"2024-09-12T01:38:10.310704+0000","last_peered":"2024-09-12T01:38:10.310704+0000","last_clean":"2024-09-12T01:38:10.310704+0000","last_became_active":"2024-09-12T00:25:08.507993+0000","last_became_peered":"2024-09-12T00:25:08.507993+0000","last_unstale":"2024-09-12T01:38:10.310704+0000","last_undegraded":"2024-09-12T01:38:10.310704+0000","last_fullsized":"2024-09-12T01:38:10.310704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.310587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.310587+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.310587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:52.686063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'577","reported_seq":1431,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.706235+0000","last_change":"2024-09-12T01:38:09.706235+0000","last_active":"2024-09-12T01:38:09.706235+0000","last_peered":"2024-09-12T01:38:09.706235+0000","last_clean":"2024-09-12T01:38:09.706235+0000","last_became_active":"2024-09-12T00:25:10.528021+0000","last_became_peered":"2024-09-12T00:25:10.528021+0000","last_unstale":"2024-09-12T01:38:09.706235+0000","last_undegraded":"2024-09-12T01:38:09.706235+0000","last_fullsized":"2024-09-12T01:38:09.706235+0000","mapping_epoch":36,"log_start":"266'500","ondisk_log_start":"266'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'577","last_scrub_stamp":"2024-09-12T01:38:09.706127+0000","last_deep_scrub":"266'577","last_deep_scrub_stamp":"2024-09-12T01:38:09.706127+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.706127+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:29.078031+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1390,"num_read_kb":1363,"num_write":1223,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'495","reported_seq":2164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.900930+0000","last_change":"2024-09-12T01:37:49.900930+0000","last_active":"2024-09-12T01:37:49.900930+0000","last_peered":"2024-09-12T01:37:49.900930+0000","last_clean":"2024-09-12T01:37:49.900930+0000","last_became_active":"2024-09-12T00:25:02.467846+0000","last_became_peered":"2024-09-12T00:25:02.467846+0000","last_unstale":"2024-09-12T01:37:49.900930+0000","last_undegraded":"2024-09-12T01:37:49.900930+0000","last_fullsized":"2024-09-12T01:37:49.900930+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'495","last_scrub_stamp":"2024-09-12T01:37:49.900834+0000","last_deep_scrub":"266'495","last_deep_scrub_stamp":"2024-09-12T01:37:49.900834+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.900834+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.878364+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2600,"num_read_kb":2447,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'208","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.530686+0000","last_change":"2024-09-12T01:37:44.530686+0000","last_active":"2024-09-12T01:37:44.530686+0000","last_peered":"2024-09-12T01:37:44.530686+0000","last_clean":"2024-09-12T01:37:44.530686+0000","last_became_active":"2024-09-12T00:25:00.486471+0000","last_became_peered":"2024-09-12T00:25:00.486471+0000","last_unstale":"2024-09-12T01:37:44.530686+0000","last_undegraded":"2024-09-12T01:37:44.530686+0000","last_fullsized":"2024-09-12T01:37:44.530686+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:37:44.530555+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:37:44.530555+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.530555+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.391104+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706427,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":18784,"num_write":969,"num_write_kb":38470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.372242+0000","last_change":"2024-09-12T01:38:00.372242+0000","last_active":"2024-09-12T01:38:00.372242+0000","last_peered":"2024-09-12T01:38:00.372242+0000","last_clean":"2024-09-12T01:38:00.372242+0000","last_became_active":"2024-09-12T00:25:04.480469+0000","last_became_peered":"2024-09-12T00:25:04.480469+0000","last_unstale":"2024-09-12T01:38:00.372242+0000","last_undegraded":"2024-09-12T01:38:00.372242+0000","last_fullsized":"2024-09-12T01:38:00.372242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.372086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.372086+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.372086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:46.172826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'153","reported_seq":761,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.421598+0000","last_change":"2024-09-12T01:38:10.421598+0000","last_active":"2024-09-12T01:38:10.421598+0000","last_peered":"2024-09-12T01:38:10.421598+0000","last_clean":"2024-09-12T01:38:10.421598+0000","last_became_active":"2024-09-12T00:25:06.500036+0000","last_became_peered":"2024-09-12T00:25:06.500036+0000","last_unstale":"2024-09-12T01:38:10.421598+0000","last_undegraded":"2024-09-12T01:38:10.421598+0000","last_fullsized":"2024-09-12T01:38:10.421598+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'153","last_scrub_stamp":"2024-09-12T01:38:10.421495+0000","last_deep_scrub":"266'153","last_deep_scrub_stamp":"2024-09-12T01:38:10.421495+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.421495+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.772925+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11217,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":248,"num_write":100,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.346786+0000","last_change":"2024-09-12T01:38:17.346786+0000","last_active":"2024-09-12T01:38:17.346786+0000","last_peered":"2024-09-12T01:38:17.346786+0000","last_clean":"2024-09-12T01:38:17.346786+0000","last_became_active":"2024-09-12T00:25:08.509780+0000","last_became_peered":"2024-09-12T00:25:08.509780+0000","last_unstale":"2024-09-12T01:38:17.346786+0000","last_undegraded":"2024-09-12T01:38:17.346786+0000","last_fullsized":"2024-09-12T01:38:17.346786+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:17.346660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:17.346660+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.346660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:08.883336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'146","reported_seq":660,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.775739+0000","last_change":"2024-09-12T01:38:10.775680+0000","last_active":"2024-09-12T01:38:10.775739+0000","last_peered":"2024-09-12T01:38:10.775739+0000","last_clean":"2024-09-12T01:38:10.775739+0000","last_became_active":"2024-09-12T00:25:10.527984+0000","last_became_peered":"2024-09-12T00:25:10.527984+0000","last_unstale":"2024-09-12T01:38:10.775739+0000","last_undegraded":"2024-09-12T01:38:10.775739+0000","last_fullsized":"2024-09-12T01:38:10.775739+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'146","last_scrub_stamp":"2024-09-12T01:38:10.775577+0000","last_deep_scrub":"266'146","last_deep_scrub_stamp":"2024-09-12T01:38:10.775577+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.775577+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:53.577692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":124,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'456","reported_seq":2027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.745822+0000","last_change":"2024-09-12T01:37:53.745822+0000","last_active":"2024-09-12T01:37:53.745822+0000","last_peered":"2024-09-12T01:37:53.745822+0000","last_clean":"2024-09-12T01:37:53.745822+0000","last_became_active":"2024-09-12T00:25:02.469155+0000","last_became_peered":"2024-09-12T00:25:02.469155+0000","last_unstale":"2024-09-12T01:37:53.745822+0000","last_undegraded":"2024-09-12T01:37:53.745822+0000","last_fullsized":"2024-09-12T01:37:53.745822+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T01:37:53.745726+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T01:37:53.745726+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.745726+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:07.128486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2451,"num_write":541,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2546,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'226","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.078785+0000","last_change":"2024-09-12T01:37:52.078785+0000","last_active":"2024-09-12T01:37:52.078785+0000","last_peered":"2024-09-12T01:37:52.078785+0000","last_clean":"2024-09-12T01:37:52.078785+0000","last_became_active":"2024-09-12T00:25:32.563811+0000","last_became_peered":"2024-09-12T00:25:32.563811+0000","last_unstale":"2024-09-12T01:37:52.078785+0000","last_undegraded":"2024-09-12T01:37:52.078785+0000","last_fullsized":"2024-09-12T01:37:52.078785+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:37:52.078628+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:37:52.078628+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.078628+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:10.725907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442172,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":15150,"num_write":1090,"num_write_kb":21884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.666498+0000","last_change":"2024-09-12T01:38:08.666498+0000","last_active":"2024-09-12T01:38:08.666498+0000","last_peered":"2024-09-12T01:38:08.666498+0000","last_clean":"2024-09-12T01:38:08.666498+0000","last_became_active":"2024-09-12T00:25:04.484029+0000","last_became_peered":"2024-09-12T00:25:04.484029+0000","last_unstale":"2024-09-12T01:38:08.666498+0000","last_undegraded":"2024-09-12T01:38:08.666498+0000","last_fullsized":"2024-09-12T01:38:08.666498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.666375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.666375+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.666375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:47.538392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'226","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.956358+0000","last_change":"2024-09-12T01:38:19.956358+0000","last_active":"2024-09-12T01:38:19.956358+0000","last_peered":"2024-09-12T01:38:19.956358+0000","last_clean":"2024-09-12T01:38:19.956358+0000","last_became_active":"2024-09-12T00:25:06.496348+0000","last_became_peered":"2024-09-12T00:25:06.496348+0000","last_unstale":"2024-09-12T01:38:19.956358+0000","last_undegraded":"2024-09-12T01:38:19.956358+0000","last_fullsized":"2024-09-12T01:38:19.956358+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:38:19.956252+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:38:19.956252+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.956252+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:51.627975+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22554,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":293,"num_read_kb":420,"num_write":176,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'801","reported_seq":4597,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.603922+0000","last_change":"2024-09-12T01:38:14.603922+0000","last_active":"2024-09-12T01:38:14.603922+0000","last_peered":"2024-09-12T01:38:14.603922+0000","last_clean":"2024-09-12T01:38:14.603922+0000","last_became_active":"2024-09-12T00:25:08.512086+0000","last_became_peered":"2024-09-12T00:25:08.512086+0000","last_unstale":"2024-09-12T01:38:14.603922+0000","last_undegraded":"2024-09-12T01:38:14.603922+0000","last_fullsized":"2024-09-12T01:38:14.603922+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T01:38:14.603818+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T01:38:14.603818+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.603818+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:14.911689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'132","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.309541+0000","last_change":"2024-09-12T01:38:12.309541+0000","last_active":"2024-09-12T01:38:12.309541+0000","last_peered":"2024-09-12T01:38:12.309541+0000","last_clean":"2024-09-12T01:38:12.309541+0000","last_became_active":"2024-09-12T00:25:10.521322+0000","last_became_peered":"2024-09-12T00:25:10.521322+0000","last_unstale":"2024-09-12T01:38:12.309541+0000","last_undegraded":"2024-09-12T01:38:12.309541+0000","last_fullsized":"2024-09-12T01:38:12.309541+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'132","last_scrub_stamp":"2024-09-12T01:38:12.309452+0000","last_deep_scrub":"266'132","last_deep_scrub_stamp":"2024-09-12T01:38:12.309452+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.309452+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:02.874478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":104,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'397","reported_seq":1849,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.583073+0000","last_change":"2024-09-12T01:38:00.583073+0000","last_active":"2024-09-12T01:38:00.583073+0000","last_peered":"2024-09-12T01:38:00.583073+0000","last_clean":"2024-09-12T01:38:00.583073+0000","last_became_active":"2024-09-12T00:25:02.468609+0000","last_became_peered":"2024-09-12T00:25:02.468609+0000","last_unstale":"2024-09-12T01:38:00.583073+0000","last_undegraded":"2024-09-12T01:38:00.583073+0000","last_fullsized":"2024-09-12T01:38:00.583073+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'397","last_scrub_stamp":"2024-09-12T01:38:00.582971+0000","last_deep_scrub":"266'397","last_deep_scrub_stamp":"2024-09-12T01:38:00.582971+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.582971+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:02.412743+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2038,"num_read_kb":1930,"num_write":430,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'219","reported_seq":978,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.965862+0000","last_change":"2024-09-12T01:37:43.965862+0000","last_active":"2024-09-12T01:37:43.965862+0000","last_peered":"2024-09-12T01:37:43.965862+0000","last_clean":"2024-09-12T01:37:43.965862+0000","last_became_active":"2024-09-12T00:25:00.472065+0000","last_became_peered":"2024-09-12T00:25:00.472065+0000","last_unstale":"2024-09-12T01:37:43.965862+0000","last_undegraded":"2024-09-12T01:37:43.965862+0000","last_fullsized":"2024-09-12T01:37:43.965862+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'219","last_scrub_stamp":"2024-09-12T01:37:43.965697+0000","last_deep_scrub":"266'219","last_deep_scrub_stamp":"2024-09-12T01:37:43.965697+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.965697+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:29.632688+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9573531,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1000,"num_read_kb":31471,"num_write":994,"num_write_kb":39869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"266'5","reported_seq":986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.364416+0000","last_change":"2024-09-12T01:38:01.364416+0000","last_active":"2024-09-12T01:38:01.364416+0000","last_peered":"2024-09-12T01:38:01.364416+0000","last_clean":"2024-09-12T01:38:01.364416+0000","last_became_active":"2024-09-12T00:25:04.482518+0000","last_became_peered":"2024-09-12T00:25:04.482518+0000","last_unstale":"2024-09-12T01:38:01.364416+0000","last_undegraded":"2024-09-12T01:38:01.364416+0000","last_fullsized":"2024-09-12T01:38:01.364416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:01.364313+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:01.364313+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.364313+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.761280+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'231","reported_seq":907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.417330+0000","last_change":"2024-09-12T01:38:09.417330+0000","last_active":"2024-09-12T01:38:09.417330+0000","last_peered":"2024-09-12T01:38:09.417330+0000","last_clean":"2024-09-12T01:38:09.417330+0000","last_became_active":"2024-09-12T00:25:06.497269+0000","last_became_peered":"2024-09-12T00:25:06.497269+0000","last_unstale":"2024-09-12T01:38:09.417330+0000","last_undegraded":"2024-09-12T01:38:09.417330+0000","last_fullsized":"2024-09-12T01:38:09.417330+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'231","last_scrub_stamp":"2024-09-12T01:38:09.417231+0000","last_deep_scrub":"266'231","last_deep_scrub_stamp":"2024-09-12T01:38:09.417231+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.417231+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:22.167254+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14775,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":319,"num_read_kb":439,"num_write":162,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.587151+0000","last_change":"2024-09-12T01:38:13.587151+0000","last_active":"2024-09-12T01:38:13.587151+0000","last_peered":"2024-09-12T01:38:13.587151+0000","last_clean":"2024-09-12T01:38:13.587151+0000","last_became_active":"2024-09-12T00:25:08.513758+0000","last_became_peered":"2024-09-12T00:25:08.513758+0000","last_unstale":"2024-09-12T01:38:13.587151+0000","last_undegraded":"2024-09-12T01:38:13.587151+0000","last_fullsized":"2024-09-12T01:38:13.587151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:13.587070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:13.587070+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.587070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:46.236900+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'133","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.598660+0000","last_change":"2024-09-12T01:38:10.598660+0000","last_active":"2024-09-12T01:38:10.598660+0000","last_peered":"2024-09-12T01:38:10.598660+0000","last_clean":"2024-09-12T01:38:10.598660+0000","last_became_active":"2024-09-12T00:25:10.524500+0000","last_became_peered":"2024-09-12T00:25:10.524500+0000","last_unstale":"2024-09-12T01:38:10.598660+0000","last_undegraded":"2024-09-12T01:38:10.598660+0000","last_fullsized":"2024-09-12T01:38:10.598660+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'133","last_scrub_stamp":"2024-09-12T01:38:10.598557+0000","last_deep_scrub":"266'133","last_deep_scrub_stamp":"2024-09-12T01:38:10.598557+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.598557+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:16.839450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":199,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'395","reported_seq":2036,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.771482+0000","last_change":"2024-09-12T01:37:57.771482+0000","last_active":"2024-09-12T01:37:57.771482+0000","last_peered":"2024-09-12T01:37:57.771482+0000","last_clean":"2024-09-12T01:37:57.771482+0000","last_became_active":"2024-09-12T00:25:02.476549+0000","last_became_peered":"2024-09-12T00:25:02.476549+0000","last_unstale":"2024-09-12T01:37:57.771482+0000","last_undegraded":"2024-09-12T01:37:57.771482+0000","last_fullsized":"2024-09-12T01:37:57.771482+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'395","last_scrub_stamp":"2024-09-12T01:37:57.771387+0000","last_deep_scrub":"266'395","last_deep_scrub_stamp":"2024-09-12T01:37:57.771387+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.771387+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:48.184452+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2368,"num_read_kb":2274,"num_write":449,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2987,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'195","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.440332+0000","last_change":"2024-09-12T01:37:48.440332+0000","last_active":"2024-09-12T01:37:48.440332+0000","last_peered":"2024-09-12T01:37:48.440332+0000","last_clean":"2024-09-12T01:37:48.440332+0000","last_became_active":"2024-09-12T00:25:00.471314+0000","last_became_peered":"2024-09-12T00:25:00.471314+0000","last_unstale":"2024-09-12T01:37:48.440332+0000","last_undegraded":"2024-09-12T01:37:48.440332+0000","last_fullsized":"2024-09-12T01:37:48.440332+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'195","last_scrub_stamp":"2024-09-12T01:37:48.440227+0000","last_deep_scrub":"266'195","last_deep_scrub_stamp":"2024-09-12T01:37:48.440227+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.440227+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:08.826724+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190278,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":11373,"num_write":891,"num_write_kb":19982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.455784+0000","last_change":"2024-09-12T01:37:59.455784+0000","last_active":"2024-09-12T01:37:59.455784+0000","last_peered":"2024-09-12T01:37:59.455784+0000","last_clean":"2024-09-12T01:37:59.455784+0000","last_became_active":"2024-09-12T00:25:04.486111+0000","last_became_peered":"2024-09-12T00:25:04.486111+0000","last_unstale":"2024-09-12T01:37:59.455784+0000","last_undegraded":"2024-09-12T01:37:59.455784+0000","last_fullsized":"2024-09-12T01:37:59.455784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:59.455680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:59.455680+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.455680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:07.373369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'208","reported_seq":820,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.785612+0000","last_change":"2024-09-12T01:38:02.785612+0000","last_active":"2024-09-12T01:38:02.785612+0000","last_peered":"2024-09-12T01:38:02.785612+0000","last_clean":"2024-09-12T01:38:02.785612+0000","last_became_active":"2024-09-12T00:25:06.497247+0000","last_became_peered":"2024-09-12T00:25:06.497247+0000","last_unstale":"2024-09-12T01:38:02.785612+0000","last_undegraded":"2024-09-12T01:38:02.785612+0000","last_fullsized":"2024-09-12T01:38:02.785612+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:38:02.785506+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:38:02.785506+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.785506+0000","objects_scrubbed":7,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:48.928001+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":347,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.405837+0000","last_change":"2024-09-12T01:38:04.405837+0000","last_active":"2024-09-12T01:38:04.405837+0000","last_peered":"2024-09-12T01:38:04.405837+0000","last_clean":"2024-09-12T01:38:04.405837+0000","last_became_active":"2024-09-12T00:25:08.516949+0000","last_became_peered":"2024-09-12T00:25:08.516949+0000","last_unstale":"2024-09-12T01:38:04.405837+0000","last_undegraded":"2024-09-12T01:38:04.405837+0000","last_fullsized":"2024-09-12T01:38:04.405837+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:04.405722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:04.405722+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.405722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'128","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.696334+0000","last_change":"2024-09-12T01:38:18.696334+0000","last_active":"2024-09-12T01:38:18.696334+0000","last_peered":"2024-09-12T01:38:18.696334+0000","last_clean":"2024-09-12T01:38:18.696334+0000","last_became_active":"2024-09-12T00:25:10.530731+0000","last_became_peered":"2024-09-12T00:25:10.530731+0000","last_unstale":"2024-09-12T01:38:18.696334+0000","last_undegraded":"2024-09-12T01:38:18.696334+0000","last_fullsized":"2024-09-12T01:38:18.696334+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'128","last_scrub_stamp":"2024-09-12T01:38:18.696231+0000","last_deep_scrub":"266'128","last_deep_scrub_stamp":"2024-09-12T01:38:18.696231+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.696231+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:55.932641+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":124,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'668","reported_seq":2312,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.971255+0000","last_change":"2024-09-12T01:38:03.971255+0000","last_active":"2024-09-12T01:38:03.971255+0000","last_peered":"2024-09-12T01:38:03.971255+0000","last_clean":"2024-09-12T01:38:03.971255+0000","last_became_active":"2024-09-12T00:25:02.474113+0000","last_became_peered":"2024-09-12T00:25:02.474113+0000","last_unstale":"2024-09-12T01:38:03.971255+0000","last_undegraded":"2024-09-12T01:38:03.971255+0000","last_fullsized":"2024-09-12T01:38:03.971255+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'668","last_scrub_stamp":"2024-09-12T01:38:03.971165+0000","last_deep_scrub":"266'668","last_deep_scrub_stamp":"2024-09-12T01:38:03.971165+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.971165+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:26.531769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3250,"num_read_kb":2990,"num_write":879,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'185","reported_seq":905,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.071985+0000","last_change":"2024-09-12T01:37:50.071985+0000","last_active":"2024-09-12T01:37:50.071985+0000","last_peered":"2024-09-12T01:37:50.071985+0000","last_clean":"2024-09-12T01:37:50.071985+0000","last_became_active":"2024-09-12T00:25:32.562005+0000","last_became_peered":"2024-09-12T00:25:32.562005+0000","last_unstale":"2024-09-12T01:37:50.071985+0000","last_undegraded":"2024-09-12T01:37:50.071985+0000","last_fullsized":"2024-09-12T01:37:50.071985+0000","mapping_epoch":39,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:50.071880+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:50.071880+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.071880+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:27.878944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568762,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":135425,"num_write":898,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.654606+0000","last_change":"2024-09-12T01:38:09.654606+0000","last_active":"2024-09-12T01:38:09.654606+0000","last_peered":"2024-09-12T01:38:09.654606+0000","last_clean":"2024-09-12T01:38:09.654606+0000","last_became_active":"2024-09-12T00:25:04.482744+0000","last_became_peered":"2024-09-12T00:25:04.482744+0000","last_unstale":"2024-09-12T01:38:09.654606+0000","last_undegraded":"2024-09-12T01:38:09.654606+0000","last_fullsized":"2024-09-12T01:38:09.654606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.654507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.654507+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.654507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:26.656064+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'199","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.620669+0000","last_change":"2024-09-12T01:38:10.620669+0000","last_active":"2024-09-12T01:38:10.620669+0000","last_peered":"2024-09-12T01:38:10.620669+0000","last_clean":"2024-09-12T01:38:10.620669+0000","last_became_active":"2024-09-12T00:25:06.497448+0000","last_became_peered":"2024-09-12T00:25:06.497448+0000","last_unstale":"2024-09-12T01:38:10.620669+0000","last_undegraded":"2024-09-12T01:38:10.620669+0000","last_fullsized":"2024-09-12T01:38:10.620669+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'199","last_scrub_stamp":"2024-09-12T01:38:10.620543+0000","last_deep_scrub":"266'199","last_deep_scrub_stamp":"2024-09-12T01:38:10.620543+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.620543+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:40.059609+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":247,"num_read_kb":253,"num_write":136,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'764","reported_seq":2729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.490499+0000","last_change":"2024-09-12T01:38:07.490499+0000","last_active":"2024-09-12T01:38:07.490499+0000","last_peered":"2024-09-12T01:38:07.490499+0000","last_clean":"2024-09-12T01:38:07.490499+0000","last_became_active":"2024-09-12T00:25:08.510134+0000","last_became_peered":"2024-09-12T00:25:08.510134+0000","last_unstale":"2024-09-12T01:38:07.490499+0000","last_undegraded":"2024-09-12T01:38:07.490499+0000","last_fullsized":"2024-09-12T01:38:07.490499+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'764","last_scrub_stamp":"2024-09-12T01:38:07.490413+0000","last_deep_scrub":"266'764","last_deep_scrub_stamp":"2024-09-12T01:38:07.490413+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.490413+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:12.012845+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'129","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.289694+0000","last_change":"2024-09-12T01:38:11.289694+0000","last_active":"2024-09-12T01:38:11.289694+0000","last_peered":"2024-09-12T01:38:11.289694+0000","last_clean":"2024-09-12T01:38:11.289694+0000","last_became_active":"2024-09-12T00:25:10.521992+0000","last_became_peered":"2024-09-12T00:25:10.521992+0000","last_unstale":"2024-09-12T01:38:11.289694+0000","last_undegraded":"2024-09-12T01:38:11.289694+0000","last_fullsized":"2024-09-12T01:38:11.289694+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'129","last_scrub_stamp":"2024-09-12T01:38:11.289614+0000","last_deep_scrub":"266'129","last_deep_scrub_stamp":"2024-09-12T01:38:11.289614+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.289614+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:02.917202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":300,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1939,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.708159+0000","last_change":"2024-09-12T01:37:52.708159+0000","last_active":"2024-09-12T01:37:52.708159+0000","last_peered":"2024-09-12T01:37:52.708159+0000","last_clean":"2024-09-12T01:37:52.708159+0000","last_became_active":"2024-09-12T00:25:02.468401+0000","last_became_peered":"2024-09-12T00:25:02.468401+0000","last_unstale":"2024-09-12T01:37:52.708159+0000","last_undegraded":"2024-09-12T01:37:52.708159+0000","last_fullsized":"2024-09-12T01:37:52.708159+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T01:37:52.708072+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T01:37:52.708072+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.708072+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.220170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2162,"num_read_kb":2053,"num_write":481,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'266","reported_seq":944,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.032506+0000","last_change":"2024-09-12T01:37:57.032506+0000","last_active":"2024-09-12T01:37:57.032506+0000","last_peered":"2024-09-12T01:37:57.032506+0000","last_clean":"2024-09-12T01:37:57.032506+0000","last_became_active":"2024-09-12T00:25:00.474471+0000","last_became_peered":"2024-09-12T00:25:00.474471+0000","last_unstale":"2024-09-12T01:37:57.032506+0000","last_undegraded":"2024-09-12T01:37:57.032506+0000","last_fullsized":"2024-09-12T01:37:57.032506+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'266","last_scrub_stamp":"2024-09-12T01:37:57.032348+0000","last_deep_scrub":"266'266","last_deep_scrub_stamp":"2024-09-12T01:37:57.032348+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.032348+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:38.613541+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2612534,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":560,"num_read_kb":17654,"num_write":1154,"num_write_kb":37946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"266'4","reported_seq":1463,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.871477+0000","last_change":"2024-09-12T01:37:58.871477+0000","last_active":"2024-09-12T01:37:58.871477+0000","last_peered":"2024-09-12T01:37:58.871477+0000","last_clean":"2024-09-12T01:37:58.871477+0000","last_became_active":"2024-09-12T00:25:04.482824+0000","last_became_peered":"2024-09-12T00:25:04.482824+0000","last_unstale":"2024-09-12T01:37:58.871477+0000","last_undegraded":"2024-09-12T01:37:58.871477+0000","last_fullsized":"2024-09-12T01:37:58.871477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:37:58.871389+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:37:58.871389+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.871389+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:22.816712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":942,"num_read_kb":942,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'108","reported_seq":654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.360718+0000","last_change":"2024-09-12T01:38:04.360718+0000","last_active":"2024-09-12T01:38:04.360718+0000","last_peered":"2024-09-12T01:38:04.360718+0000","last_clean":"2024-09-12T01:38:04.360718+0000","last_became_active":"2024-09-12T00:25:06.499937+0000","last_became_peered":"2024-09-12T00:25:06.499937+0000","last_unstale":"2024-09-12T01:38:04.360718+0000","last_undegraded":"2024-09-12T01:38:04.360718+0000","last_fullsized":"2024-09-12T01:38:04.360718+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'108","last_scrub_stamp":"2024-09-12T01:38:04.360634+0000","last_deep_scrub":"266'108","last_deep_scrub_stamp":"2024-09-12T01:38:04.360634+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.360634+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:51.903468+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'774","reported_seq":2640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.819477+0000","last_change":"2024-09-12T01:38:05.819477+0000","last_active":"2024-09-12T01:38:05.819477+0000","last_peered":"2024-09-12T01:38:05.819477+0000","last_clean":"2024-09-12T01:38:05.819477+0000","last_became_active":"2024-09-12T00:25:08.501192+0000","last_became_peered":"2024-09-12T00:25:08.501192+0000","last_unstale":"2024-09-12T01:38:05.819477+0000","last_undegraded":"2024-09-12T01:38:05.819477+0000","last_fullsized":"2024-09-12T01:38:05.819477+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'774","last_scrub_stamp":"2024-09-12T01:38:05.819387+0000","last_deep_scrub":"266'774","last_deep_scrub_stamp":"2024-09-12T01:38:05.819387+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.819387+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:39.786391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'108","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.742781+0000","last_change":"2024-09-12T01:38:08.742781+0000","last_active":"2024-09-12T01:38:08.742781+0000","last_peered":"2024-09-12T01:38:08.742781+0000","last_clean":"2024-09-12T01:38:08.742781+0000","last_became_active":"2024-09-12T00:25:10.524610+0000","last_became_peered":"2024-09-12T00:25:10.524610+0000","last_unstale":"2024-09-12T01:38:08.742781+0000","last_undegraded":"2024-09-12T01:38:08.742781+0000","last_fullsized":"2024-09-12T01:38:08.742781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'108","last_scrub_stamp":"2024-09-12T01:38:08.742692+0000","last_deep_scrub":"266'108","last_deep_scrub_stamp":"2024-09-12T01:38:08.742692+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.742692+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:44.228250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'791","reported_seq":2446,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.447463+0000","last_change":"2024-09-12T01:37:50.447463+0000","last_active":"2024-09-12T01:37:50.447463+0000","last_peered":"2024-09-12T01:37:50.447463+0000","last_clean":"2024-09-12T01:37:50.447463+0000","last_became_active":"2024-09-12T00:25:02.478793+0000","last_became_peered":"2024-09-12T00:25:02.478793+0000","last_unstale":"2024-09-12T01:37:50.447463+0000","last_undegraded":"2024-09-12T01:37:50.447463+0000","last_fullsized":"2024-09-12T01:37:50.447463+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'791","last_scrub_stamp":"2024-09-12T01:37:50.447358+0000","last_deep_scrub":"266'791","last_deep_scrub_stamp":"2024-09-12T01:37:50.447358+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.447358+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:46.059048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3638,"num_write":1039,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'228","reported_seq":953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.371550+0000","last_change":"2024-09-12T01:37:49.371550+0000","last_active":"2024-09-12T01:37:49.371550+0000","last_peered":"2024-09-12T01:37:49.371550+0000","last_clean":"2024-09-12T01:37:49.371550+0000","last_became_active":"2024-09-12T00:25:32.561102+0000","last_became_peered":"2024-09-12T00:25:32.561102+0000","last_unstale":"2024-09-12T01:37:49.371550+0000","last_undegraded":"2024-09-12T01:37:49.371550+0000","last_fullsized":"2024-09-12T01:37:49.371550+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'228","last_scrub_stamp":"2024-09-12T01:37:49.371405+0000","last_deep_scrub":"266'228","last_deep_scrub_stamp":"2024-09-12T01:37:49.371405+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.371405+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:27.224790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":554,"num_read_kb":71561,"num_write":1047,"num_write_kb":46306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6,0],"acting":[4,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.948026+0000","last_change":"2024-09-12T01:38:11.948026+0000","last_active":"2024-09-12T01:38:11.948026+0000","last_peered":"2024-09-12T01:38:11.948026+0000","last_clean":"2024-09-12T01:38:11.948026+0000","last_became_active":"2024-09-12T00:25:04.484543+0000","last_became_peered":"2024-09-12T00:25:04.484543+0000","last_unstale":"2024-09-12T01:38:11.948026+0000","last_undegraded":"2024-09-12T01:38:11.948026+0000","last_fullsized":"2024-09-12T01:38:11.948026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.947905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.947905+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.947905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:14.132174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'313","reported_seq":959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.822832+0000","last_change":"2024-09-12T01:38:01.822832+0000","last_active":"2024-09-12T01:38:01.822832+0000","last_peered":"2024-09-12T01:38:01.822832+0000","last_clean":"2024-09-12T01:38:01.822832+0000","last_became_active":"2024-09-12T00:25:06.496949+0000","last_became_peered":"2024-09-12T00:25:06.496949+0000","last_unstale":"2024-09-12T01:38:01.822832+0000","last_undegraded":"2024-09-12T01:38:01.822832+0000","last_fullsized":"2024-09-12T01:38:01.822832+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'313","last_scrub_stamp":"2024-09-12T01:38:01.822725+0000","last_deep_scrub":"266'313","last_deep_scrub_stamp":"2024-09-12T01:38:01.822725+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.822725+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:53.190581+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9140,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1014,"num_read_kb":1082,"num_write":1556,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487892,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.684493+0000","last_change":"2024-09-12T01:38:05.684493+0000","last_active":"2024-09-12T01:38:05.684493+0000","last_peered":"2024-09-12T01:38:05.684493+0000","last_clean":"2024-09-12T01:38:05.684493+0000","last_became_active":"2024-09-12T00:25:08.511103+0000","last_became_peered":"2024-09-12T00:25:08.511103+0000","last_unstale":"2024-09-12T01:38:05.684493+0000","last_undegraded":"2024-09-12T01:38:05.684493+0000","last_fullsized":"2024-09-12T01:38:05.684493+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:05.684405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:05.684405+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.684405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:26.132586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'158","reported_seq":671,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.562464+0000","last_change":"2024-09-12T01:38:09.562402+0000","last_active":"2024-09-12T01:38:09.562464+0000","last_peered":"2024-09-12T01:38:09.562464+0000","last_clean":"2024-09-12T01:38:09.562464+0000","last_became_active":"2024-09-12T00:25:10.524399+0000","last_became_peered":"2024-09-12T00:25:10.524399+0000","last_unstale":"2024-09-12T01:38:09.562464+0000","last_undegraded":"2024-09-12T01:38:09.562464+0000","last_fullsized":"2024-09-12T01:38:09.562464+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'158","last_scrub_stamp":"2024-09-12T01:38:09.562318+0000","last_deep_scrub":"266'158","last_deep_scrub_stamp":"2024-09-12T01:38:09.562318+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.562318+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:43.334096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":348,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'526","reported_seq":2120,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.008055+0000","last_change":"2024-09-12T01:38:02.007992+0000","last_active":"2024-09-12T01:38:02.008055+0000","last_peered":"2024-09-12T01:38:02.008055+0000","last_clean":"2024-09-12T01:38:02.008055+0000","last_became_active":"2024-09-12T00:25:02.470508+0000","last_became_peered":"2024-09-12T00:25:02.470508+0000","last_unstale":"2024-09-12T01:38:02.008055+0000","last_undegraded":"2024-09-12T01:38:02.008055+0000","last_fullsized":"2024-09-12T01:38:02.008055+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'526","last_scrub_stamp":"2024-09-12T01:38:02.007907+0000","last_deep_scrub":"266'526","last_deep_scrub_stamp":"2024-09-12T01:38:02.007907+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.007907+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:07.439245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2852,"num_read_kb":2640,"num_write":653,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.840458+0000","last_change":"2024-09-12T01:37:43.840458+0000","last_active":"2024-09-12T01:37:43.840458+0000","last_peered":"2024-09-12T01:37:43.840458+0000","last_clean":"2024-09-12T01:37:43.840458+0000","last_became_active":"2024-09-12T00:24:40.255060+0000","last_became_peered":"2024-09-12T00:24:40.255060+0000","last_unstale":"2024-09-12T01:37:43.840458+0000","last_undegraded":"2024-09-12T01:37:43.840458+0000","last_fullsized":"2024-09-12T01:37:43.840458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T01:37:43.840360+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T01:37:43.840360+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.840360+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:24.816378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":545,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.023075+0000","last_change":"2024-09-12T01:37:47.023075+0000","last_active":"2024-09-12T01:37:47.023075+0000","last_peered":"2024-09-12T01:37:47.023075+0000","last_clean":"2024-09-12T01:37:47.023075+0000","last_became_active":"2024-09-12T00:24:46.449286+0000","last_became_peered":"2024-09-12T00:24:46.449286+0000","last_unstale":"2024-09-12T01:37:47.023075+0000","last_undegraded":"2024-09-12T01:37:47.023075+0000","last_fullsized":"2024-09-12T01:37:47.023075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:37:47.022957+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:37:47.022957+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.022957+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:19.767332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001069263,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'200","reported_seq":835,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.350405+0000","last_change":"2024-09-12T01:37:46.350307+0000","last_active":"2024-09-12T01:37:46.350405+0000","last_peered":"2024-09-12T01:37:46.350405+0000","last_clean":"2024-09-12T01:37:46.350405+0000","last_became_active":"2024-09-12T00:25:00.465691+0000","last_became_peered":"2024-09-12T00:25:00.465691+0000","last_unstale":"2024-09-12T01:37:46.350405+0000","last_undegraded":"2024-09-12T01:37:46.350405+0000","last_fullsized":"2024-09-12T01:37:46.350405+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'200","last_scrub_stamp":"2024-09-12T01:37:46.350175+0000","last_deep_scrub":"266'200","last_deep_scrub_stamp":"2024-09-12T01:37:46.350175+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.350175+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:03.453089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262165,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":3125,"num_write":969,"num_write_kb":16262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.872809+0000","last_change":"2024-09-12T01:38:01.872809+0000","last_active":"2024-09-12T01:38:01.872809+0000","last_peered":"2024-09-12T01:38:01.872809+0000","last_clean":"2024-09-12T01:38:01.872809+0000","last_became_active":"2024-09-12T00:25:04.483893+0000","last_became_peered":"2024-09-12T00:25:04.483893+0000","last_unstale":"2024-09-12T01:38:01.872809+0000","last_undegraded":"2024-09-12T01:38:01.872809+0000","last_fullsized":"2024-09-12T01:38:01.872809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:01.872703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:01.872703+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.872703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:44.504728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'341","reported_seq":1072,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.954237+0000","last_change":"2024-09-12T01:38:15.954237+0000","last_active":"2024-09-12T01:38:15.954237+0000","last_peered":"2024-09-12T01:38:15.954237+0000","last_clean":"2024-09-12T01:38:15.954237+0000","last_became_active":"2024-09-12T00:25:06.497261+0000","last_became_peered":"2024-09-12T00:25:06.497261+0000","last_unstale":"2024-09-12T01:38:15.954237+0000","last_undegraded":"2024-09-12T01:38:15.954237+0000","last_fullsized":"2024-09-12T01:38:15.954237+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'341","last_scrub_stamp":"2024-09-12T01:38:15.954131+0000","last_deep_scrub":"266'341","last_deep_scrub_stamp":"2024-09-12T01:38:15.954131+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.954131+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:23.333266+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36159,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":620,"num_read_kb":873,"num_write":540,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90450,"num_omap_keys":220,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.663298+0000","last_change":"2024-09-12T01:38:16.663298+0000","last_active":"2024-09-12T01:38:16.663298+0000","last_peered":"2024-09-12T01:38:16.663298+0000","last_clean":"2024-09-12T01:38:16.663298+0000","last_became_active":"2024-09-12T00:25:08.509183+0000","last_became_peered":"2024-09-12T00:25:08.509183+0000","last_unstale":"2024-09-12T01:38:16.663298+0000","last_undegraded":"2024-09-12T01:38:16.663298+0000","last_fullsized":"2024-09-12T01:38:16.663298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.663221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.663221+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.663221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:38.187616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'218","reported_seq":937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.859715+0000","last_change":"2024-09-12T01:38:09.859715+0000","last_active":"2024-09-12T01:38:09.859715+0000","last_peered":"2024-09-12T01:38:09.859715+0000","last_clean":"2024-09-12T01:38:09.859715+0000","last_became_active":"2024-09-12T00:25:10.525441+0000","last_became_peered":"2024-09-12T00:25:10.525441+0000","last_unstale":"2024-09-12T01:38:09.859715+0000","last_undegraded":"2024-09-12T01:38:09.859715+0000","last_fullsized":"2024-09-12T01:38:09.859715+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T01:38:09.859599+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T01:38:09.859599+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.859599+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:13.164657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":453,"num_read_kb":448,"num_write":488,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'808","reported_seq":2399,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.602855+0000","last_change":"2024-09-12T01:37:59.602855+0000","last_active":"2024-09-12T01:37:59.602855+0000","last_peered":"2024-09-12T01:37:59.602855+0000","last_clean":"2024-09-12T01:37:59.602855+0000","last_became_active":"2024-09-12T00:25:02.478919+0000","last_became_peered":"2024-09-12T00:25:02.478919+0000","last_unstale":"2024-09-12T01:37:59.602855+0000","last_undegraded":"2024-09-12T01:37:59.602855+0000","last_fullsized":"2024-09-12T01:37:59.602855+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'808","last_scrub_stamp":"2024-09-12T01:37:59.602772+0000","last_deep_scrub":"266'808","last_deep_scrub_stamp":"2024-09-12T01:37:59.602772+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.602772+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:55.142030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4003,"num_read_kb":3616,"num_write":1060,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":544,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.985922+0000","last_change":"2024-09-12T01:37:44.985922+0000","last_active":"2024-09-12T01:37:44.985922+0000","last_peered":"2024-09-12T01:37:44.985922+0000","last_clean":"2024-09-12T01:37:44.985922+0000","last_became_active":"2024-09-12T00:24:46.216398+0000","last_became_peered":"2024-09-12T00:24:46.216398+0000","last_unstale":"2024-09-12T01:37:44.985922+0000","last_undegraded":"2024-09-12T01:37:44.985922+0000","last_fullsized":"2024-09-12T01:37:44.985922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.985834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.985834+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.985834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:51.621846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00080348300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'237","reported_seq":911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.350538+0000","last_change":"2024-09-12T01:37:46.350466+0000","last_active":"2024-09-12T01:37:46.350538+0000","last_peered":"2024-09-12T01:37:46.350538+0000","last_clean":"2024-09-12T01:37:46.350538+0000","last_became_active":"2024-09-12T00:25:00.467622+0000","last_became_peered":"2024-09-12T00:25:00.467622+0000","last_unstale":"2024-09-12T01:37:46.350538+0000","last_undegraded":"2024-09-12T01:37:46.350538+0000","last_fullsized":"2024-09-12T01:37:46.350538+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'237","last_scrub_stamp":"2024-09-12T01:37:46.350355+0000","last_deep_scrub":"266'237","last_deep_scrub_stamp":"2024-09-12T01:37:46.350355+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.350355+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:45.435839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":667699,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":22643,"num_write":1048,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.985481+0000","last_change":"2024-09-12T01:38:10.985481+0000","last_active":"2024-09-12T01:38:10.985481+0000","last_peered":"2024-09-12T01:38:10.985481+0000","last_clean":"2024-09-12T01:38:10.985481+0000","last_became_active":"2024-09-12T00:25:04.483752+0000","last_became_peered":"2024-09-12T00:25:04.483752+0000","last_unstale":"2024-09-12T01:38:10.985481+0000","last_undegraded":"2024-09-12T01:38:10.985481+0000","last_fullsized":"2024-09-12T01:38:10.985481+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.985395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.985395+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.985395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:15.823115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'935","reported_seq":2768,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.428621+0000","last_change":"2024-09-12T01:38:02.428563+0000","last_active":"2024-09-12T01:38:02.428621+0000","last_peered":"2024-09-12T01:38:02.428621+0000","last_clean":"2024-09-12T01:38:02.428621+0000","last_became_active":"2024-09-12T00:25:06.491919+0000","last_became_peered":"2024-09-12T00:25:06.491919+0000","last_unstale":"2024-09-12T01:38:02.428621+0000","last_undegraded":"2024-09-12T01:38:02.428621+0000","last_fullsized":"2024-09-12T01:38:02.428621+0000","mapping_epoch":32,"log_start":"266'900","ondisk_log_start":"266'900","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'935","last_scrub_stamp":"2024-09-12T01:38:02.428459+0000","last_deep_scrub":"266'935","last_deep_scrub_stamp":"2024-09-12T01:38:02.428459+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.428459+0000","objects_scrubbed":12,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:06.583646+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26860,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1263,"num_read_kb":1464,"num_write":378,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.852101+0000","last_change":"2024-09-12T01:38:22.852101+0000","last_active":"2024-09-12T01:38:22.852101+0000","last_peered":"2024-09-12T01:38:22.852101+0000","last_clean":"2024-09-12T01:38:22.852101+0000","last_became_active":"2024-09-12T00:25:08.514284+0000","last_became_peered":"2024-09-12T00:25:08.514284+0000","last_unstale":"2024-09-12T01:38:22.852101+0000","last_undegraded":"2024-09-12T01:38:22.852101+0000","last_fullsized":"2024-09-12T01:38:22.852101+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.852005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.852005+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.852005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:27.984299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'201","reported_seq":739,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.725082+0000","last_change":"2024-09-12T01:38:19.725082+0000","last_active":"2024-09-12T01:38:19.725082+0000","last_peered":"2024-09-12T01:38:19.725082+0000","last_clean":"2024-09-12T01:38:19.725082+0000","last_became_active":"2024-09-12T00:25:10.521686+0000","last_became_peered":"2024-09-12T00:25:10.521686+0000","last_unstale":"2024-09-12T01:38:19.725082+0000","last_undegraded":"2024-09-12T01:38:19.725082+0000","last_fullsized":"2024-09-12T01:38:19.725082+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'201","last_scrub_stamp":"2024-09-12T01:38:19.725001+0000","last_deep_scrub":"266'201","last_deep_scrub_stamp":"2024-09-12T01:38:19.725001+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.725001+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.902788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":329,"num_write":450,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'458","reported_seq":1927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.324237+0000","last_change":"2024-09-12T01:37:56.324237+0000","last_active":"2024-09-12T01:37:56.324237+0000","last_peered":"2024-09-12T01:37:56.324237+0000","last_clean":"2024-09-12T01:37:56.324237+0000","last_became_active":"2024-09-12T00:25:02.472379+0000","last_became_peered":"2024-09-12T00:25:02.472379+0000","last_unstale":"2024-09-12T01:37:56.324237+0000","last_undegraded":"2024-09-12T01:37:56.324237+0000","last_fullsized":"2024-09-12T01:37:56.324237+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'458","last_scrub_stamp":"2024-09-12T01:37:56.324159+0000","last_deep_scrub":"266'458","last_deep_scrub_stamp":"2024-09-12T01:37:56.324159+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.324159+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:20.183702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2328,"num_read_kb":2161,"num_write":552,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":541,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.478045+0000","last_change":"2024-09-12T01:37:47.478045+0000","last_active":"2024-09-12T01:37:47.478045+0000","last_peered":"2024-09-12T01:37:47.478045+0000","last_clean":"2024-09-12T01:37:47.478045+0000","last_became_active":"2024-09-12T00:24:46.219148+0000","last_became_peered":"2024-09-12T00:24:46.219148+0000","last_unstale":"2024-09-12T01:37:47.478045+0000","last_undegraded":"2024-09-12T01:37:47.478045+0000","last_fullsized":"2024-09-12T01:37:47.478045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:47.477953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:47.477953+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.477953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.844122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040735800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'221","reported_seq":909,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.547177+0000","last_change":"2024-09-12T01:37:47.547177+0000","last_active":"2024-09-12T01:37:47.547177+0000","last_peered":"2024-09-12T01:37:47.547177+0000","last_clean":"2024-09-12T01:37:47.547177+0000","last_became_active":"2024-09-12T00:25:00.468270+0000","last_became_peered":"2024-09-12T00:25:00.468270+0000","last_unstale":"2024-09-12T01:37:47.547177+0000","last_undegraded":"2024-09-12T01:37:47.547177+0000","last_fullsized":"2024-09-12T01:37:47.547177+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'221","last_scrub_stamp":"2024-09-12T01:37:47.547063+0000","last_deep_scrub":"266'221","last_deep_scrub_stamp":"2024-09-12T01:37:47.547063+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.547063+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:35.859232+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":34464,"num_write":950,"num_write_kb":30398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.454003+0000","last_change":"2024-09-12T01:37:58.454003+0000","last_active":"2024-09-12T01:37:58.454003+0000","last_peered":"2024-09-12T01:37:58.454003+0000","last_clean":"2024-09-12T01:37:58.454003+0000","last_became_active":"2024-09-12T00:25:04.486554+0000","last_became_peered":"2024-09-12T00:25:04.486554+0000","last_unstale":"2024-09-12T01:37:58.454003+0000","last_undegraded":"2024-09-12T01:37:58.454003+0000","last_fullsized":"2024-09-12T01:37:58.454003+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:37:58.453898+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:37:58.453898+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.453898+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:32.185064+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'319","reported_seq":1761,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.892800+0000","last_change":"2024-09-12T01:38:02.892740+0000","last_active":"2024-09-12T01:38:02.892800+0000","last_peered":"2024-09-12T01:38:02.892800+0000","last_clean":"2024-09-12T01:38:02.892800+0000","last_became_active":"2024-09-12T00:25:06.495269+0000","last_became_peered":"2024-09-12T00:25:06.495269+0000","last_unstale":"2024-09-12T01:38:02.892800+0000","last_undegraded":"2024-09-12T01:38:02.892800+0000","last_fullsized":"2024-09-12T01:38:02.892800+0000","mapping_epoch":32,"log_start":"266'301","ondisk_log_start":"266'301","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'319","last_scrub_stamp":"2024-09-12T01:38:02.892622+0000","last_deep_scrub":"266'319","last_deep_scrub_stamp":"2024-09-12T01:38:02.892622+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.892622+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":301,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:22.199556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":267,"num_read_kb":257,"num_write":249,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.357753+0000","last_change":"2024-09-12T01:38:15.357753+0000","last_active":"2024-09-12T01:38:15.357753+0000","last_peered":"2024-09-12T01:38:15.357753+0000","last_clean":"2024-09-12T01:38:15.357753+0000","last_became_active":"2024-09-12T00:25:08.511783+0000","last_became_peered":"2024-09-12T00:25:08.511783+0000","last_unstale":"2024-09-12T01:38:15.357753+0000","last_undegraded":"2024-09-12T01:38:15.357753+0000","last_fullsized":"2024-09-12T01:38:15.357753+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:15.357673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:15.357673+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.357673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:32.899032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'272","reported_seq":894,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.324690+0000","last_change":"2024-09-12T01:38:20.324690+0000","last_active":"2024-09-12T01:38:20.324690+0000","last_peered":"2024-09-12T01:38:20.324690+0000","last_clean":"2024-09-12T01:38:20.324690+0000","last_became_active":"2024-09-12T00:25:10.525594+0000","last_became_peered":"2024-09-12T00:25:10.525594+0000","last_unstale":"2024-09-12T01:38:20.324690+0000","last_undegraded":"2024-09-12T01:38:20.324690+0000","last_fullsized":"2024-09-12T01:38:20.324690+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'272","last_scrub_stamp":"2024-09-12T01:38:20.324599+0000","last_deep_scrub":"266'272","last_deep_scrub_stamp":"2024-09-12T01:38:20.324599+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.324599+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:08.489446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":513,"num_write":584,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'413","reported_seq":1899,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.287559+0000","last_change":"2024-09-12T01:37:53.287502+0000","last_active":"2024-09-12T01:37:53.287559+0000","last_peered":"2024-09-12T01:37:53.287559+0000","last_clean":"2024-09-12T01:37:53.287559+0000","last_became_active":"2024-09-12T00:25:02.467022+0000","last_became_peered":"2024-09-12T00:25:02.467022+0000","last_unstale":"2024-09-12T01:37:53.287559+0000","last_undegraded":"2024-09-12T01:37:53.287559+0000","last_fullsized":"2024-09-12T01:37:53.287559+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'413","last_scrub_stamp":"2024-09-12T01:37:53.287417+0000","last_deep_scrub":"266'413","last_deep_scrub_stamp":"2024-09-12T01:37:53.287417+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.287417+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:09.800269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2131,"num_read_kb":2016,"num_write":472,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":546,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.973514+0000","last_change":"2024-09-12T01:37:45.973514+0000","last_active":"2024-09-12T01:37:45.973514+0000","last_peered":"2024-09-12T01:37:45.973514+0000","last_clean":"2024-09-12T01:37:45.973514+0000","last_became_active":"2024-09-12T00:24:46.296014+0000","last_became_peered":"2024-09-12T00:24:46.296014+0000","last_unstale":"2024-09-12T01:37:45.973514+0000","last_undegraded":"2024-09-12T01:37:45.973514+0000","last_fullsized":"2024-09-12T01:37:45.973514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:37:45.973447+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:37:45.973447+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.973447+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:56.580285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00055221999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'227","reported_seq":868,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.739740+0000","last_change":"2024-09-12T01:37:55.739740+0000","last_active":"2024-09-12T01:37:55.739740+0000","last_peered":"2024-09-12T01:37:55.739740+0000","last_clean":"2024-09-12T01:37:55.739740+0000","last_became_active":"2024-09-12T00:25:00.480242+0000","last_became_peered":"2024-09-12T00:25:00.480242+0000","last_unstale":"2024-09-12T01:37:55.739740+0000","last_undegraded":"2024-09-12T01:37:55.739740+0000","last_fullsized":"2024-09-12T01:37:55.739740+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'227","last_scrub_stamp":"2024-09-12T01:37:55.739594+0000","last_deep_scrub":"266'227","last_deep_scrub_stamp":"2024-09-12T01:37:55.739594+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.739594+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:04.195794+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":8697,"num_write":1016,"num_write_kb":33114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.412878+0000","last_change":"2024-09-12T01:37:56.412798+0000","last_active":"2024-09-12T01:37:56.412878+0000","last_peered":"2024-09-12T01:37:56.412878+0000","last_clean":"2024-09-12T01:37:56.412878+0000","last_became_active":"2024-09-12T00:25:04.483224+0000","last_became_peered":"2024-09-12T00:25:04.483224+0000","last_unstale":"2024-09-12T01:37:56.412878+0000","last_undegraded":"2024-09-12T01:37:56.412878+0000","last_fullsized":"2024-09-12T01:37:56.412878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:56.412697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:56.412697+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.412697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:36.333449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'168","reported_seq":739,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.576475+0000","last_change":"2024-09-12T01:38:12.576475+0000","last_active":"2024-09-12T01:38:12.576475+0000","last_peered":"2024-09-12T01:38:12.576475+0000","last_clean":"2024-09-12T01:38:12.576475+0000","last_became_active":"2024-09-12T00:25:06.500406+0000","last_became_peered":"2024-09-12T00:25:06.500406+0000","last_unstale":"2024-09-12T01:38:12.576475+0000","last_undegraded":"2024-09-12T01:38:12.576475+0000","last_fullsized":"2024-09-12T01:38:12.576475+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'168","last_scrub_stamp":"2024-09-12T01:38:12.576363+0000","last_deep_scrub":"266'168","last_deep_scrub_stamp":"2024-09-12T01:38:12.576363+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.576363+0000","objects_scrubbed":7,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:43.416406+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":204,"num_read_kb":195,"num_write":150,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529656+0000","last_change":"2024-09-12T00:25:08.510581+0000","last_active":"2024-09-12T01:34:29.529656+0000","last_peered":"2024-09-12T01:34:29.529656+0000","last_clean":"2024-09-12T01:34:29.529656+0000","last_became_active":"2024-09-12T00:25:08.510287+0000","last_became_peered":"2024-09-12T00:25:08.510287+0000","last_unstale":"2024-09-12T01:34:29.529656+0000","last_undegraded":"2024-09-12T01:34:29.529656+0000","last_fullsized":"2024-09-12T01:34:29.529656+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:47:48.633444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'161","reported_seq":726,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.793611+0000","last_change":"2024-09-12T01:38:11.793611+0000","last_active":"2024-09-12T01:38:11.793611+0000","last_peered":"2024-09-12T01:38:11.793611+0000","last_clean":"2024-09-12T01:38:11.793611+0000","last_became_active":"2024-09-12T00:25:10.523589+0000","last_became_peered":"2024-09-12T00:25:10.523589+0000","last_unstale":"2024-09-12T01:38:11.793611+0000","last_undegraded":"2024-09-12T01:38:11.793611+0000","last_fullsized":"2024-09-12T01:38:11.793611+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'161","last_scrub_stamp":"2024-09-12T01:38:11.793512+0000","last_deep_scrub":"266'161","last_deep_scrub_stamp":"2024-09-12T01:38:11.793512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.793512+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:42.925878+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":189,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'1615","reported_seq":3220,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.249739+0000","last_change":"2024-09-12T01:37:51.249637+0000","last_active":"2024-09-12T01:37:51.249739+0000","last_peered":"2024-09-12T01:37:51.249739+0000","last_clean":"2024-09-12T01:37:51.249739+0000","last_became_active":"2024-09-12T00:25:02.471491+0000","last_became_peered":"2024-09-12T00:25:02.471491+0000","last_unstale":"2024-09-12T01:37:51.249739+0000","last_undegraded":"2024-09-12T01:37:51.249739+0000","last_fullsized":"2024-09-12T01:37:51.249739+0000","mapping_epoch":28,"log_start":"266'1600","ondisk_log_start":"266'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1615","last_scrub_stamp":"2024-09-12T01:37:51.249541+0000","last_deep_scrub":"266'1615","last_deep_scrub_stamp":"2024-09-12T01:37:51.249541+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.249541+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":1600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.798728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7163,"num_read_kb":6213,"num_write":2294,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'243","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.567520+0000","last_change":"2024-09-12T01:37:45.567458+0000","last_active":"2024-09-12T01:37:45.567520+0000","last_peered":"2024-09-12T01:37:45.567520+0000","last_clean":"2024-09-12T01:37:45.567520+0000","last_became_active":"2024-09-12T00:25:00.484147+0000","last_became_peered":"2024-09-12T00:25:00.484147+0000","last_unstale":"2024-09-12T01:37:45.567520+0000","last_undegraded":"2024-09-12T01:37:45.567520+0000","last_fullsized":"2024-09-12T01:37:45.567520+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'243","last_scrub_stamp":"2024-09-12T01:37:45.567385+0000","last_deep_scrub":"266'243","last_deep_scrub_stamp":"2024-09-12T01:37:45.567385+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.567385+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:40.545937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":38062,"num_write":1135,"num_write_kb":41091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":540,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.537738+0000","last_change":"2024-09-12T01:37:46.537738+0000","last_active":"2024-09-12T01:37:46.537738+0000","last_peered":"2024-09-12T01:37:46.537738+0000","last_clean":"2024-09-12T01:37:46.537738+0000","last_became_active":"2024-09-12T00:24:46.295839+0000","last_became_peered":"2024-09-12T00:24:46.295839+0000","last_unstale":"2024-09-12T01:37:46.537738+0000","last_undegraded":"2024-09-12T01:37:46.537738+0000","last_fullsized":"2024-09-12T01:37:46.537738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:46.537656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:46.537656+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.537656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:55.749892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045367200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.299479+0000","last_change":"2024-09-12T01:38:03.299479+0000","last_active":"2024-09-12T01:38:03.299479+0000","last_peered":"2024-09-12T01:38:03.299479+0000","last_clean":"2024-09-12T01:38:03.299479+0000","last_became_active":"2024-09-12T00:25:04.478947+0000","last_became_peered":"2024-09-12T00:25:04.478947+0000","last_unstale":"2024-09-12T01:38:03.299479+0000","last_undegraded":"2024-09-12T01:38:03.299479+0000","last_fullsized":"2024-09-12T01:38:03.299479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:03.299354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:03.299354+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.299354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:24.646538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'324","reported_seq":1033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.470886+0000","last_change":"2024-09-12T01:38:01.470886+0000","last_active":"2024-09-12T01:38:01.470886+0000","last_peered":"2024-09-12T01:38:01.470886+0000","last_clean":"2024-09-12T01:38:01.470886+0000","last_became_active":"2024-09-12T00:25:06.496693+0000","last_became_peered":"2024-09-12T00:25:06.496693+0000","last_unstale":"2024-09-12T01:38:01.470886+0000","last_undegraded":"2024-09-12T01:38:01.470886+0000","last_fullsized":"2024-09-12T01:38:01.470886+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'324","last_scrub_stamp":"2024-09-12T01:38:01.470784+0000","last_deep_scrub":"266'324","last_deep_scrub_stamp":"2024-09-12T01:38:01.470784+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.470784+0000","objects_scrubbed":11,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:43.306882+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":458,"num_read_kb":584,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.715151+0000","last_change":"2024-09-12T01:38:04.715080+0000","last_active":"2024-09-12T01:38:04.715151+0000","last_peered":"2024-09-12T01:38:04.715151+0000","last_clean":"2024-09-12T01:38:04.715151+0000","last_became_active":"2024-09-12T00:25:08.509962+0000","last_became_peered":"2024-09-12T00:25:08.509962+0000","last_unstale":"2024-09-12T01:38:04.715151+0000","last_undegraded":"2024-09-12T01:38:04.715151+0000","last_fullsized":"2024-09-12T01:38:04.715151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:04.714993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:04.714993+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.714993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:04.273955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'146","reported_seq":666,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.667907+0000","last_change":"2024-09-12T01:38:22.667907+0000","last_active":"2024-09-12T01:38:22.667907+0000","last_peered":"2024-09-12T01:38:22.667907+0000","last_clean":"2024-09-12T01:38:22.667907+0000","last_became_active":"2024-09-12T00:25:10.521670+0000","last_became_peered":"2024-09-12T00:25:10.521670+0000","last_unstale":"2024-09-12T01:38:22.667907+0000","last_undegraded":"2024-09-12T01:38:22.667907+0000","last_fullsized":"2024-09-12T01:38:22.667907+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'146","last_scrub_stamp":"2024-09-12T01:38:22.667807+0000","last_deep_scrub":"266'146","last_deep_scrub_stamp":"2024-09-12T01:38:22.667807+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.667807+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:34.880802+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":347,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'1211","reported_seq":2867,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.294939+0000","last_change":"2024-09-12T01:37:55.294828+0000","last_active":"2024-09-12T01:37:55.294939+0000","last_peered":"2024-09-12T01:37:55.294939+0000","last_clean":"2024-09-12T01:37:55.294939+0000","last_became_active":"2024-09-12T00:25:02.473158+0000","last_became_peered":"2024-09-12T00:25:02.473158+0000","last_unstale":"2024-09-12T01:37:55.294939+0000","last_undegraded":"2024-09-12T01:37:55.294939+0000","last_fullsized":"2024-09-12T01:37:55.294939+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1211","last_scrub_stamp":"2024-09-12T01:37:55.294717+0000","last_deep_scrub":"266'1211","last_deep_scrub_stamp":"2024-09-12T01:37:55.294717+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.294717+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:49.131916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5007,"num_write":1669,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2709,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'191","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.291895+0000","last_change":"2024-09-12T01:37:48.291829+0000","last_active":"2024-09-12T01:37:48.291895+0000","last_peered":"2024-09-12T01:37:48.291895+0000","last_clean":"2024-09-12T01:37:48.291895+0000","last_became_active":"2024-09-12T00:25:00.465896+0000","last_became_peered":"2024-09-12T00:25:00.465896+0000","last_unstale":"2024-09-12T01:37:48.291895+0000","last_undegraded":"2024-09-12T01:37:48.291895+0000","last_fullsized":"2024-09-12T01:37:48.291895+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T01:37:48.291667+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T01:37:48.291667+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.291667+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.140550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702969,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":438,"num_read_kb":13303,"num_write":931,"num_write_kb":18974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":543,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.043936+0000","last_change":"2024-09-12T01:37:49.043879+0000","last_active":"2024-09-12T01:37:49.043936+0000","last_peered":"2024-09-12T01:37:49.043936+0000","last_clean":"2024-09-12T01:37:49.043936+0000","last_became_active":"2024-09-12T00:24:46.213839+0000","last_became_peered":"2024-09-12T00:24:46.213839+0000","last_unstale":"2024-09-12T01:37:49.043936+0000","last_undegraded":"2024-09-12T01:37:49.043936+0000","last_fullsized":"2024-09-12T01:37:49.043936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:49.043790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:49.043790+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.043790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:54.944893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050495300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.864056+0000","last_change":"2024-09-12T01:38:00.864056+0000","last_active":"2024-09-12T01:38:00.864056+0000","last_peered":"2024-09-12T01:38:00.864056+0000","last_clean":"2024-09-12T01:38:00.864056+0000","last_became_active":"2024-09-12T00:25:04.481137+0000","last_became_peered":"2024-09-12T00:25:04.481137+0000","last_unstale":"2024-09-12T01:38:00.864056+0000","last_undegraded":"2024-09-12T01:38:00.864056+0000","last_fullsized":"2024-09-12T01:38:00.864056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.863967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.863967+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.863967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:46.951205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'261","reported_seq":864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.387347+0000","last_change":"2024-09-12T01:38:07.387347+0000","last_active":"2024-09-12T01:38:07.387347+0000","last_peered":"2024-09-12T01:38:07.387347+0000","last_clean":"2024-09-12T01:38:07.387347+0000","last_became_active":"2024-09-12T00:25:06.501118+0000","last_became_peered":"2024-09-12T00:25:06.501118+0000","last_unstale":"2024-09-12T01:38:07.387347+0000","last_undegraded":"2024-09-12T01:38:07.387347+0000","last_fullsized":"2024-09-12T01:38:07.387347+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'261","last_scrub_stamp":"2024-09-12T01:38:07.387238+0000","last_deep_scrub":"266'261","last_deep_scrub_stamp":"2024-09-12T01:38:07.387238+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.387238+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:26.161968+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":326,"num_read_kb":318,"num_write":296,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'774","reported_seq":2933,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.824281+0000","last_change":"2024-09-12T01:38:04.824281+0000","last_active":"2024-09-12T01:38:04.824281+0000","last_peered":"2024-09-12T01:38:04.824281+0000","last_clean":"2024-09-12T01:38:04.824281+0000","last_became_active":"2024-09-12T00:25:08.509511+0000","last_became_peered":"2024-09-12T00:25:08.509511+0000","last_unstale":"2024-09-12T01:38:04.824281+0000","last_undegraded":"2024-09-12T01:38:04.824281+0000","last_fullsized":"2024-09-12T01:38:04.824281+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'774","last_scrub_stamp":"2024-09-12T01:38:04.824196+0000","last_deep_scrub":"266'774","last_deep_scrub_stamp":"2024-09-12T01:38:04.824196+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.824196+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:41.848726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'131","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.605406+0000","last_change":"2024-09-12T01:38:11.605406+0000","last_active":"2024-09-12T01:38:11.605406+0000","last_peered":"2024-09-12T01:38:11.605406+0000","last_clean":"2024-09-12T01:38:11.605406+0000","last_became_active":"2024-09-12T00:25:10.524804+0000","last_became_peered":"2024-09-12T00:25:10.524804+0000","last_unstale":"2024-09-12T01:38:11.605406+0000","last_undegraded":"2024-09-12T01:38:11.605406+0000","last_fullsized":"2024-09-12T01:38:11.605406+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'131","last_scrub_stamp":"2024-09-12T01:38:11.605314+0000","last_deep_scrub":"266'131","last_deep_scrub_stamp":"2024-09-12T01:38:11.605314+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.605314+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:05.600758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'468","reported_seq":2167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.368204+0000","last_change":"2024-09-12T01:37:52.368204+0000","last_active":"2024-09-12T01:37:52.368204+0000","last_peered":"2024-09-12T01:37:52.368204+0000","last_clean":"2024-09-12T01:37:52.368204+0000","last_became_active":"2024-09-12T00:25:02.463232+0000","last_became_peered":"2024-09-12T00:25:02.463232+0000","last_unstale":"2024-09-12T01:37:52.368204+0000","last_undegraded":"2024-09-12T01:37:52.368204+0000","last_fullsized":"2024-09-12T01:37:52.368204+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'468","last_scrub_stamp":"2024-09-12T01:37:52.368113+0000","last_deep_scrub":"266'468","last_deep_scrub_stamp":"2024-09-12T01:37:52.368113+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.368113+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:14.544213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2494,"num_read_kb":2382,"num_write":536,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'241","reported_seq":949,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.376413+0000","last_change":"2024-09-12T01:37:48.376413+0000","last_active":"2024-09-12T01:37:48.376413+0000","last_peered":"2024-09-12T01:37:48.376413+0000","last_clean":"2024-09-12T01:37:48.376413+0000","last_became_active":"2024-09-12T00:25:00.452591+0000","last_became_peered":"2024-09-12T00:25:00.452591+0000","last_unstale":"2024-09-12T01:37:48.376413+0000","last_undegraded":"2024-09-12T01:37:48.376413+0000","last_fullsized":"2024-09-12T01:37:48.376413+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'241","last_scrub_stamp":"2024-09-12T01:37:48.376282+0000","last_deep_scrub":"266'241","last_deep_scrub_stamp":"2024-09-12T01:37:48.376282+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.376282+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:09.221130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":777,"num_read_kb":13125,"num_write":984,"num_write_kb":40186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":549,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.359471+0000","last_change":"2024-09-12T01:37:45.359471+0000","last_active":"2024-09-12T01:37:45.359471+0000","last_peered":"2024-09-12T01:37:45.359471+0000","last_clean":"2024-09-12T01:37:45.359471+0000","last_became_active":"2024-09-12T00:24:46.426160+0000","last_became_peered":"2024-09-12T00:24:46.426160+0000","last_unstale":"2024-09-12T01:37:45.359471+0000","last_undegraded":"2024-09-12T01:37:45.359471+0000","last_fullsized":"2024-09-12T01:37:45.359471+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:45.359384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:45.359384+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.359384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:46.994285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.957234+0000","last_change":"2024-09-12T01:38:12.957234+0000","last_active":"2024-09-12T01:38:12.957234+0000","last_peered":"2024-09-12T01:38:12.957234+0000","last_clean":"2024-09-12T01:38:12.957234+0000","last_became_active":"2024-09-12T00:25:04.482856+0000","last_became_peered":"2024-09-12T00:25:04.482856+0000","last_unstale":"2024-09-12T01:38:12.957234+0000","last_undegraded":"2024-09-12T01:38:12.957234+0000","last_fullsized":"2024-09-12T01:38:12.957234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:12.957150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:12.957150+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.957150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:39.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'147","reported_seq":721,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.975688+0000","last_change":"2024-09-12T01:38:17.975688+0000","last_active":"2024-09-12T01:38:17.975688+0000","last_peered":"2024-09-12T01:38:17.975688+0000","last_clean":"2024-09-12T01:38:17.975688+0000","last_became_active":"2024-09-12T00:25:06.497888+0000","last_became_peered":"2024-09-12T00:25:06.497888+0000","last_unstale":"2024-09-12T01:38:17.975688+0000","last_undegraded":"2024-09-12T01:38:17.975688+0000","last_fullsized":"2024-09-12T01:38:17.975688+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'147","last_scrub_stamp":"2024-09-12T01:38:17.975589+0000","last_deep_scrub":"266'147","last_deep_scrub_stamp":"2024-09-12T01:38:17.975589+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.975589+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:15.586228+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":168,"num_write":116,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'803","reported_seq":2666,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.569758+0000","last_change":"2024-09-12T01:38:11.569758+0000","last_active":"2024-09-12T01:38:11.569758+0000","last_peered":"2024-09-12T01:38:11.569758+0000","last_clean":"2024-09-12T01:38:11.569758+0000","last_became_active":"2024-09-12T00:25:08.512784+0000","last_became_peered":"2024-09-12T00:25:08.512784+0000","last_unstale":"2024-09-12T01:38:11.569758+0000","last_undegraded":"2024-09-12T01:38:11.569758+0000","last_fullsized":"2024-09-12T01:38:11.569758+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'803","last_scrub_stamp":"2024-09-12T01:38:11.569667+0000","last_deep_scrub":"266'803","last_deep_scrub_stamp":"2024-09-12T01:38:11.569667+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.569667+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:56.839480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'246","reported_seq":782,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.733053+0000","last_change":"2024-09-12T01:38:20.733053+0000","last_active":"2024-09-12T01:38:20.733053+0000","last_peered":"2024-09-12T01:38:20.733053+0000","last_clean":"2024-09-12T01:38:20.733053+0000","last_became_active":"2024-09-12T00:25:10.523258+0000","last_became_peered":"2024-09-12T00:25:10.523258+0000","last_unstale":"2024-09-12T01:38:20.733053+0000","last_undegraded":"2024-09-12T01:38:20.733053+0000","last_fullsized":"2024-09-12T01:38:20.733053+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'246","last_scrub_stamp":"2024-09-12T01:38:20.732964+0000","last_deep_scrub":"266'246","last_deep_scrub_stamp":"2024-09-12T01:38:20.732964+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.732964+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:03.600893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'490","reported_seq":2085,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.705966+0000","last_change":"2024-09-12T01:37:51.705892+0000","last_active":"2024-09-12T01:37:51.705966+0000","last_peered":"2024-09-12T01:37:51.705966+0000","last_clean":"2024-09-12T01:37:51.705966+0000","last_became_active":"2024-09-12T00:25:02.468436+0000","last_became_peered":"2024-09-12T00:25:02.468436+0000","last_unstale":"2024-09-12T01:37:51.705966+0000","last_undegraded":"2024-09-12T01:37:51.705966+0000","last_fullsized":"2024-09-12T01:37:51.705966+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'490","last_scrub_stamp":"2024-09-12T01:37:51.705797+0000","last_deep_scrub":"266'490","last_deep_scrub_stamp":"2024-09-12T01:37:51.705797+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.705797+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:59.947035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2713,"num_read_kb":2534,"num_write":588,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'194","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.345506+0000","last_change":"2024-09-12T01:37:47.345506+0000","last_active":"2024-09-12T01:37:47.345506+0000","last_peered":"2024-09-12T01:37:47.345506+0000","last_clean":"2024-09-12T01:37:47.345506+0000","last_became_active":"2024-09-12T00:25:00.456071+0000","last_became_peered":"2024-09-12T00:25:00.456071+0000","last_unstale":"2024-09-12T01:37:47.345506+0000","last_undegraded":"2024-09-12T01:37:47.345506+0000","last_fullsized":"2024-09-12T01:37:47.345506+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T01:37:47.345386+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T01:37:47.345386+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.345386+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.275739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":39651,"num_write":895,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":541,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.027962+0000","last_change":"2024-09-12T01:37:48.027962+0000","last_active":"2024-09-12T01:37:48.027962+0000","last_peered":"2024-09-12T01:37:48.027962+0000","last_clean":"2024-09-12T01:37:48.027962+0000","last_became_active":"2024-09-12T00:24:46.425908+0000","last_became_peered":"2024-09-12T00:24:46.425908+0000","last_unstale":"2024-09-12T01:37:48.027962+0000","last_undegraded":"2024-09-12T01:37:48.027962+0000","last_fullsized":"2024-09-12T01:37:48.027962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:48.027858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:48.027858+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.027858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:23.250488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085110299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"266'4","reported_seq":1001,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.324004+0000","last_change":"2024-09-12T01:38:02.324004+0000","last_active":"2024-09-12T01:38:02.324004+0000","last_peered":"2024-09-12T01:38:02.324004+0000","last_clean":"2024-09-12T01:38:02.324004+0000","last_became_active":"2024-09-12T00:25:04.481193+0000","last_became_peered":"2024-09-12T00:25:04.481193+0000","last_unstale":"2024-09-12T01:38:02.324004+0000","last_undegraded":"2024-09-12T01:38:02.324004+0000","last_fullsized":"2024-09-12T01:38:02.324004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:02.323921+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:02.323921+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.323921+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:10.000536+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'363","reported_seq":1124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.905478+0000","last_change":"2024-09-12T01:38:07.905478+0000","last_active":"2024-09-12T01:38:07.905478+0000","last_peered":"2024-09-12T01:38:07.905478+0000","last_clean":"2024-09-12T01:38:07.905478+0000","last_became_active":"2024-09-12T00:25:06.492189+0000","last_became_peered":"2024-09-12T00:25:06.492189+0000","last_unstale":"2024-09-12T01:38:07.905478+0000","last_undegraded":"2024-09-12T01:38:07.905478+0000","last_fullsized":"2024-09-12T01:38:07.905478+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'363","last_scrub_stamp":"2024-09-12T01:38:07.905398+0000","last_deep_scrub":"266'363","last_deep_scrub_stamp":"2024-09-12T01:38:07.905398+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.905398+0000","objects_scrubbed":9,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:03.334289+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35877,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":729,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.320472+0000","last_change":"2024-09-12T01:38:16.320472+0000","last_active":"2024-09-12T01:38:16.320472+0000","last_peered":"2024-09-12T01:38:16.320472+0000","last_clean":"2024-09-12T01:38:16.320472+0000","last_became_active":"2024-09-12T00:25:08.510167+0000","last_became_peered":"2024-09-12T00:25:08.510167+0000","last_unstale":"2024-09-12T01:38:16.320472+0000","last_undegraded":"2024-09-12T01:38:16.320472+0000","last_fullsized":"2024-09-12T01:38:16.320472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.320380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.320380+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.320380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:41.231640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'114","reported_seq":638,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.715272+0000","last_change":"2024-09-12T01:38:10.715272+0000","last_active":"2024-09-12T01:38:10.715272+0000","last_peered":"2024-09-12T01:38:10.715272+0000","last_clean":"2024-09-12T01:38:10.715272+0000","last_became_active":"2024-09-12T00:25:10.525850+0000","last_became_peered":"2024-09-12T00:25:10.525850+0000","last_unstale":"2024-09-12T01:38:10.715272+0000","last_undegraded":"2024-09-12T01:38:10.715272+0000","last_fullsized":"2024-09-12T01:38:10.715272+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'114","last_scrub_stamp":"2024-09-12T01:38:10.715162+0000","last_deep_scrub":"266'114","last_deep_scrub_stamp":"2024-09-12T01:38:10.715162+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.715162+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:08.764289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'145","reported_seq":725,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.343143+0000","last_change":"2024-09-12T01:38:21.343143+0000","last_active":"2024-09-12T01:38:21.343143+0000","last_peered":"2024-09-12T01:38:21.343143+0000","last_clean":"2024-09-12T01:38:21.343143+0000","last_became_active":"2024-09-12T00:25:10.526982+0000","last_became_peered":"2024-09-12T00:25:10.526982+0000","last_unstale":"2024-09-12T01:38:21.343143+0000","last_undegraded":"2024-09-12T01:38:21.343143+0000","last_fullsized":"2024-09-12T01:38:21.343143+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'145","last_scrub_stamp":"2024-09-12T01:38:21.343057+0000","last_deep_scrub":"266'145","last_deep_scrub_stamp":"2024-09-12T01:38:21.343057+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.343057+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:23.156543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":212,"num_write":342,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'496","reported_seq":2085,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.678973+0000","last_change":"2024-09-12T01:37:58.678973+0000","last_active":"2024-09-12T01:37:58.678973+0000","last_peered":"2024-09-12T01:37:58.678973+0000","last_clean":"2024-09-12T01:37:58.678973+0000","last_became_active":"2024-09-12T00:25:02.472013+0000","last_became_peered":"2024-09-12T00:25:02.472013+0000","last_unstale":"2024-09-12T01:37:58.678973+0000","last_undegraded":"2024-09-12T01:37:58.678973+0000","last_fullsized":"2024-09-12T01:37:58.678973+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'496","last_scrub_stamp":"2024-09-12T01:37:58.678883+0000","last_deep_scrub":"266'496","last_deep_scrub_stamp":"2024-09-12T01:37:58.678883+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.678883+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:48.894785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2517,"num_read_kb":2353,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":915,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'215","reported_seq":925,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.079193+0000","last_change":"2024-09-12T01:37:54.079193+0000","last_active":"2024-09-12T01:37:54.079193+0000","last_peered":"2024-09-12T01:37:54.079193+0000","last_clean":"2024-09-12T01:37:54.079193+0000","last_became_active":"2024-09-12T00:25:00.473591+0000","last_became_peered":"2024-09-12T00:25:00.473591+0000","last_unstale":"2024-09-12T01:37:54.079193+0000","last_undegraded":"2024-09-12T01:37:54.079193+0000","last_fullsized":"2024-09-12T01:37:54.079193+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'215","last_scrub_stamp":"2024-09-12T01:37:54.079022+0000","last_deep_scrub":"266'215","last_deep_scrub_stamp":"2024-09-12T01:37:54.079022+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.079022+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:47.035499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308446,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":52508,"num_write":917,"num_write_kb":35191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.358724+0000","last_change":"2024-09-12T01:38:02.358724+0000","last_active":"2024-09-12T01:38:02.358724+0000","last_peered":"2024-09-12T01:38:02.358724+0000","last_clean":"2024-09-12T01:38:02.358724+0000","last_became_active":"2024-09-12T00:25:04.479701+0000","last_became_peered":"2024-09-12T00:25:04.479701+0000","last_unstale":"2024-09-12T01:38:02.358724+0000","last_undegraded":"2024-09-12T01:38:02.358724+0000","last_fullsized":"2024-09-12T01:38:02.358724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:02.358607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:02.358607+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.358607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:44.972389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'165","reported_seq":769,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.346059+0000","last_change":"2024-09-12T01:38:05.346059+0000","last_active":"2024-09-12T01:38:05.346059+0000","last_peered":"2024-09-12T01:38:05.346059+0000","last_clean":"2024-09-12T01:38:05.346059+0000","last_became_active":"2024-09-12T00:25:06.500315+0000","last_became_peered":"2024-09-12T00:25:06.500315+0000","last_unstale":"2024-09-12T01:38:05.346059+0000","last_undegraded":"2024-09-12T01:38:05.346059+0000","last_fullsized":"2024-09-12T01:38:05.346059+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'165","last_scrub_stamp":"2024-09-12T01:38:05.345948+0000","last_deep_scrub":"266'165","last_deep_scrub_stamp":"2024-09-12T01:38:05.345948+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.345948+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:21.892254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6391,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":221,"num_read_kb":264,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.455856+0000","last_change":"2024-09-12T01:38:05.455856+0000","last_active":"2024-09-12T01:38:05.455856+0000","last_peered":"2024-09-12T01:38:05.455856+0000","last_clean":"2024-09-12T01:38:05.455856+0000","last_became_active":"2024-09-12T00:25:08.516921+0000","last_became_peered":"2024-09-12T00:25:08.516921+0000","last_unstale":"2024-09-12T01:38:05.455856+0000","last_undegraded":"2024-09-12T01:38:05.455856+0000","last_fullsized":"2024-09-12T01:38:05.455856+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:05.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:05.455763+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:59.136353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'117","reported_seq":646,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.600520+0000","last_change":"2024-09-12T01:38:12.600520+0000","last_active":"2024-09-12T01:38:12.600520+0000","last_peered":"2024-09-12T01:38:12.600520+0000","last_clean":"2024-09-12T01:38:12.600520+0000","last_became_active":"2024-09-12T00:25:10.524416+0000","last_became_peered":"2024-09-12T00:25:10.524416+0000","last_unstale":"2024-09-12T01:38:12.600520+0000","last_undegraded":"2024-09-12T01:38:12.600520+0000","last_fullsized":"2024-09-12T01:38:12.600520+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'117","last_scrub_stamp":"2024-09-12T01:38:12.600439+0000","last_deep_scrub":"266'117","last_deep_scrub_stamp":"2024-09-12T01:38:12.600439+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.600439+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:05.748283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":157,"num_read_kb":134,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'452","reported_seq":2023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.345223+0000","last_change":"2024-09-12T01:37:55.345223+0000","last_active":"2024-09-12T01:37:55.345223+0000","last_peered":"2024-09-12T01:37:55.345223+0000","last_clean":"2024-09-12T01:37:55.345223+0000","last_became_active":"2024-09-12T00:25:02.471242+0000","last_became_peered":"2024-09-12T00:25:02.471242+0000","last_unstale":"2024-09-12T01:37:55.345223+0000","last_undegraded":"2024-09-12T01:37:55.345223+0000","last_fullsized":"2024-09-12T01:37:55.345223+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'452","last_scrub_stamp":"2024-09-12T01:37:55.345130+0000","last_deep_scrub":"266'452","last_deep_scrub_stamp":"2024-09-12T01:37:55.345130+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.345130+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:12.582586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2437,"num_read_kb":2317,"num_write":523,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'218","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.943850+0000","last_change":"2024-09-12T01:37:45.943850+0000","last_active":"2024-09-12T01:37:45.943850+0000","last_peered":"2024-09-12T01:37:45.943850+0000","last_clean":"2024-09-12T01:37:45.943850+0000","last_became_active":"2024-09-12T00:25:00.480801+0000","last_became_peered":"2024-09-12T00:25:00.480801+0000","last_unstale":"2024-09-12T01:37:45.943850+0000","last_undegraded":"2024-09-12T01:37:45.943850+0000","last_fullsized":"2024-09-12T01:37:45.943850+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T01:37:45.943735+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T01:37:45.943735+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.943735+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:49.180449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288330,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":555,"num_read_kb":14522,"num_write":924,"num_write_kb":19421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.322852+0000","last_change":"2024-09-12T01:38:04.322852+0000","last_active":"2024-09-12T01:38:04.322852+0000","last_peered":"2024-09-12T01:38:04.322852+0000","last_clean":"2024-09-12T01:38:04.322852+0000","last_became_active":"2024-09-12T00:25:04.482891+0000","last_became_peered":"2024-09-12T00:25:04.482891+0000","last_unstale":"2024-09-12T01:38:04.322852+0000","last_undegraded":"2024-09-12T01:38:04.322852+0000","last_fullsized":"2024-09-12T01:38:04.322852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:04.322768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:04.322768+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.322768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:45.135306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'71","reported_seq":603,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.383729+0000","last_change":"2024-09-12T01:38:11.383729+0000","last_active":"2024-09-12T01:38:11.383729+0000","last_peered":"2024-09-12T01:38:11.383729+0000","last_clean":"2024-09-12T01:38:11.383729+0000","last_became_active":"2024-09-12T00:25:06.501049+0000","last_became_peered":"2024-09-12T00:25:06.501049+0000","last_unstale":"2024-09-12T01:38:11.383729+0000","last_undegraded":"2024-09-12T01:38:11.383729+0000","last_fullsized":"2024-09-12T01:38:11.383729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'71","last_scrub_stamp":"2024-09-12T01:38:11.383640+0000","last_deep_scrub":"266'71","last_deep_scrub_stamp":"2024-09-12T01:38:11.383640+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.383640+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:10.663064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":50,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.719255+0000","last_change":"2024-09-12T01:38:06.719255+0000","last_active":"2024-09-12T01:38:06.719255+0000","last_peered":"2024-09-12T01:38:06.719255+0000","last_clean":"2024-09-12T01:38:06.719255+0000","last_became_active":"2024-09-12T00:25:08.506052+0000","last_became_peered":"2024-09-12T00:25:08.506052+0000","last_unstale":"2024-09-12T01:38:06.719255+0000","last_undegraded":"2024-09-12T01:38:06.719255+0000","last_fullsized":"2024-09-12T01:38:06.719255+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.719155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.719155+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.719155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:28.734275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'180","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.347388+0000","last_change":"2024-09-12T01:38:15.347388+0000","last_active":"2024-09-12T01:38:15.347388+0000","last_peered":"2024-09-12T01:38:15.347388+0000","last_clean":"2024-09-12T01:38:15.347388+0000","last_became_active":"2024-09-12T00:25:10.524992+0000","last_became_peered":"2024-09-12T00:25:10.524992+0000","last_unstale":"2024-09-12T01:38:15.347388+0000","last_undegraded":"2024-09-12T01:38:15.347388+0000","last_fullsized":"2024-09-12T01:38:15.347388+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'180","last_scrub_stamp":"2024-09-12T01:38:15.347294+0000","last_deep_scrub":"266'180","last_deep_scrub_stamp":"2024-09-12T01:38:15.347294+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.347294+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:01.054437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":300,"num_read_kb":289,"num_write":406,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'595","reported_seq":2223,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.346689+0000","last_change":"2024-09-12T01:37:54.346689+0000","last_active":"2024-09-12T01:37:54.346689+0000","last_peered":"2024-09-12T01:37:54.346689+0000","last_clean":"2024-09-12T01:37:54.346689+0000","last_became_active":"2024-09-12T00:25:02.468715+0000","last_became_peered":"2024-09-12T00:25:02.468715+0000","last_unstale":"2024-09-12T01:37:54.346689+0000","last_undegraded":"2024-09-12T01:37:54.346689+0000","last_fullsized":"2024-09-12T01:37:54.346689+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'595","last_scrub_stamp":"2024-09-12T01:37:54.346601+0000","last_deep_scrub":"266'595","last_deep_scrub_stamp":"2024-09-12T01:37:54.346601+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.346601+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:05.177000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2927,"num_read_kb":2680,"num_write":750,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'255","reported_seq":912,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.596087+0000","last_change":"2024-09-12T01:37:46.596087+0000","last_active":"2024-09-12T01:37:46.596087+0000","last_peered":"2024-09-12T01:37:46.596087+0000","last_clean":"2024-09-12T01:37:46.596087+0000","last_became_active":"2024-09-12T00:25:00.481741+0000","last_became_peered":"2024-09-12T00:25:00.481741+0000","last_unstale":"2024-09-12T01:37:46.596087+0000","last_undegraded":"2024-09-12T01:37:46.596087+0000","last_fullsized":"2024-09-12T01:37:46.596087+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'255","last_scrub_stamp":"2024-09-12T01:37:46.595992+0000","last_deep_scrub":"266'255","last_deep_scrub_stamp":"2024-09-12T01:37:46.595992+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.595992+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:06.212123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":2782,"num_write":1086,"num_write_kb":27824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.701698+0000","last_change":"2024-09-12T01:37:56.701698+0000","last_active":"2024-09-12T01:37:56.701698+0000","last_peered":"2024-09-12T01:37:56.701698+0000","last_clean":"2024-09-12T01:37:56.701698+0000","last_became_active":"2024-09-12T00:25:04.476356+0000","last_became_peered":"2024-09-12T00:25:04.476356+0000","last_unstale":"2024-09-12T01:37:56.701698+0000","last_undegraded":"2024-09-12T01:37:56.701698+0000","last_fullsized":"2024-09-12T01:37:56.701698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:56.701593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:56.701593+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.701593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:08.927814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'190","reported_seq":805,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.376453+0000","last_change":"2024-09-12T01:38:03.376453+0000","last_active":"2024-09-12T01:38:03.376453+0000","last_peered":"2024-09-12T01:38:03.376453+0000","last_clean":"2024-09-12T01:38:03.376453+0000","last_became_active":"2024-09-12T00:25:06.496372+0000","last_became_peered":"2024-09-12T00:25:06.496372+0000","last_unstale":"2024-09-12T01:38:03.376453+0000","last_undegraded":"2024-09-12T01:38:03.376453+0000","last_fullsized":"2024-09-12T01:38:03.376453+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T01:38:03.376353+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T01:38:03.376353+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.376353+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:08.691744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11132,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":274,"num_read_kb":379,"num_write":160,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.840360+0000","last_change":"2024-09-12T01:38:07.840360+0000","last_active":"2024-09-12T01:38:07.840360+0000","last_peered":"2024-09-12T01:38:07.840360+0000","last_clean":"2024-09-12T01:38:07.840360+0000","last_became_active":"2024-09-12T00:25:08.508336+0000","last_became_peered":"2024-09-12T00:25:08.508336+0000","last_unstale":"2024-09-12T01:38:07.840360+0000","last_undegraded":"2024-09-12T01:38:07.840360+0000","last_fullsized":"2024-09-12T01:38:07.840360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.840285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.840285+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.840285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:32.057572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'122","reported_seq":645,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.535080+0000","last_change":"2024-09-12T00:25:10.524167+0000","last_active":"2024-09-12T01:35:14.535080+0000","last_peered":"2024-09-12T01:35:14.535080+0000","last_clean":"2024-09-12T01:35:14.535080+0000","last_became_active":"2024-09-12T00:25:10.522375+0000","last_became_peered":"2024-09-12T00:25:10.522375+0000","last_unstale":"2024-09-12T01:35:14.535080+0000","last_undegraded":"2024-09-12T01:35:14.535080+0000","last_fullsized":"2024-09-12T01:35:14.535080+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:41:07.393133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":308,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'820","reported_seq":2393,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.393858+0000","last_change":"2024-09-12T01:37:53.393858+0000","last_active":"2024-09-12T01:37:53.393858+0000","last_peered":"2024-09-12T01:37:53.393858+0000","last_clean":"2024-09-12T01:37:53.393858+0000","last_became_active":"2024-09-12T00:25:02.473631+0000","last_became_peered":"2024-09-12T00:25:02.473631+0000","last_unstale":"2024-09-12T01:37:53.393858+0000","last_undegraded":"2024-09-12T01:37:53.393858+0000","last_fullsized":"2024-09-12T01:37:53.393858+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'820","last_scrub_stamp":"2024-09-12T01:37:53.393766+0000","last_deep_scrub":"266'820","last_deep_scrub_stamp":"2024-09-12T01:37:53.393766+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.393766+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:41.670020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3838,"num_read_kb":3448,"num_write":1071,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'213","reported_seq":864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.499745+0000","last_change":"2024-09-12T01:37:48.499745+0000","last_active":"2024-09-12T01:37:48.499745+0000","last_peered":"2024-09-12T01:37:48.499745+0000","last_clean":"2024-09-12T01:37:48.499745+0000","last_became_active":"2024-09-12T00:25:00.461875+0000","last_became_peered":"2024-09-12T00:25:00.461875+0000","last_unstale":"2024-09-12T01:37:48.499745+0000","last_undegraded":"2024-09-12T01:37:48.499745+0000","last_fullsized":"2024-09-12T01:37:48.499745+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T01:37:48.499573+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T01:37:48.499573+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.499573+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:13.359367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288524,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":40693,"num_write":998,"num_write_kb":39273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.973594+0000","last_change":"2024-09-12T01:38:16.973594+0000","last_active":"2024-09-12T01:38:16.973594+0000","last_peered":"2024-09-12T01:38:16.973594+0000","last_clean":"2024-09-12T01:38:16.973594+0000","last_became_active":"2024-09-12T00:25:04.486195+0000","last_became_peered":"2024-09-12T00:25:04.486195+0000","last_unstale":"2024-09-12T01:38:16.973594+0000","last_undegraded":"2024-09-12T01:38:16.973594+0000","last_fullsized":"2024-09-12T01:38:16.973594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.973512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.973512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.973512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:16.357642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'156","reported_seq":753,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.901261+0000","last_change":"2024-09-12T01:38:04.901261+0000","last_active":"2024-09-12T01:38:04.901261+0000","last_peered":"2024-09-12T01:38:04.901261+0000","last_clean":"2024-09-12T01:38:04.901261+0000","last_became_active":"2024-09-12T00:25:06.493276+0000","last_became_peered":"2024-09-12T00:25:06.493276+0000","last_unstale":"2024-09-12T01:38:04.901261+0000","last_undegraded":"2024-09-12T01:38:04.901261+0000","last_fullsized":"2024-09-12T01:38:04.901261+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'156","last_scrub_stamp":"2024-09-12T01:38:04.901177+0000","last_deep_scrub":"266'156","last_deep_scrub_stamp":"2024-09-12T01:38:04.901177+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.901177+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:57.450229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":282,"num_write":108,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.500037+0000","last_change":"2024-09-12T01:38:06.500037+0000","last_active":"2024-09-12T01:38:06.500037+0000","last_peered":"2024-09-12T01:38:06.500037+0000","last_clean":"2024-09-12T01:38:06.500037+0000","last_became_active":"2024-09-12T00:25:08.512647+0000","last_became_peered":"2024-09-12T00:25:08.512647+0000","last_unstale":"2024-09-12T01:38:06.500037+0000","last_undegraded":"2024-09-12T01:38:06.500037+0000","last_fullsized":"2024-09-12T01:38:06.500037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.499944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.499944+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.499944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:02.711620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'319","reported_seq":1624,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.948895+0000","last_change":"2024-09-12T01:38:05.948895+0000","last_active":"2024-09-12T01:38:05.948895+0000","last_peered":"2024-09-12T01:38:05.948895+0000","last_clean":"2024-09-12T01:38:05.948895+0000","last_became_active":"2024-09-12T00:25:02.475490+0000","last_became_peered":"2024-09-12T00:25:02.475490+0000","last_unstale":"2024-09-12T01:38:05.948895+0000","last_undegraded":"2024-09-12T01:38:05.948895+0000","last_fullsized":"2024-09-12T01:38:05.948895+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'319","last_scrub_stamp":"2024-09-12T01:38:05.948806+0000","last_deep_scrub":"266'319","last_deep_scrub_stamp":"2024-09-12T01:38:05.948806+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.948806+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:54.471792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1691,"num_read_kb":1609,"num_write":373,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'212","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.535689+0000","last_change":"2024-09-12T01:37:49.535689+0000","last_active":"2024-09-12T01:37:49.535689+0000","last_peered":"2024-09-12T01:37:49.535689+0000","last_clean":"2024-09-12T01:37:49.535689+0000","last_became_active":"2024-09-12T00:25:00.462022+0000","last_became_peered":"2024-09-12T00:25:00.462022+0000","last_unstale":"2024-09-12T01:37:49.535689+0000","last_undegraded":"2024-09-12T01:37:49.535689+0000","last_fullsized":"2024-09-12T01:37:49.535689+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'212","last_scrub_stamp":"2024-09-12T01:37:49.535559+0000","last_deep_scrub":"266'212","last_deep_scrub_stamp":"2024-09-12T01:37:49.535559+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.535559+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:49.433083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":5153,"num_write":1017,"num_write_kb":32149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.330858+0000","last_change":"2024-09-12T01:38:03.330858+0000","last_active":"2024-09-12T01:38:03.330858+0000","last_peered":"2024-09-12T01:38:03.330858+0000","last_clean":"2024-09-12T01:38:03.330858+0000","last_became_active":"2024-09-12T00:25:04.487192+0000","last_became_peered":"2024-09-12T00:25:04.487192+0000","last_unstale":"2024-09-12T01:38:03.330858+0000","last_undegraded":"2024-09-12T01:38:03.330858+0000","last_fullsized":"2024-09-12T01:38:03.330858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:03.330758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:03.330758+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.330758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:15.689513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'234","reported_seq":889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.365222+0000","last_change":"2024-09-12T01:38:08.365222+0000","last_active":"2024-09-12T01:38:08.365222+0000","last_peered":"2024-09-12T01:38:08.365222+0000","last_clean":"2024-09-12T01:38:08.365222+0000","last_became_active":"2024-09-12T00:25:06.498651+0000","last_became_peered":"2024-09-12T00:25:06.498651+0000","last_unstale":"2024-09-12T01:38:08.365222+0000","last_undegraded":"2024-09-12T01:38:08.365222+0000","last_fullsized":"2024-09-12T01:38:08.365222+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'234","last_scrub_stamp":"2024-09-12T01:38:08.365132+0000","last_deep_scrub":"266'234","last_deep_scrub_stamp":"2024-09-12T01:38:08.365132+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.365132+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:46.680906+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9365,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":332,"num_read_kb":425,"num_write":210,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.764797+0000","last_change":"2024-09-12T01:38:07.764797+0000","last_active":"2024-09-12T01:38:07.764797+0000","last_peered":"2024-09-12T01:38:07.764797+0000","last_clean":"2024-09-12T01:38:07.764797+0000","last_became_active":"2024-09-12T00:25:08.507090+0000","last_became_peered":"2024-09-12T00:25:08.507090+0000","last_unstale":"2024-09-12T01:38:07.764797+0000","last_undegraded":"2024-09-12T01:38:07.764797+0000","last_fullsized":"2024-09-12T01:38:07.764797+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.764725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.764725+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.764725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:45.746935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'189","reported_seq":718,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.683694+0000","last_change":"2024-09-12T01:38:21.683694+0000","last_active":"2024-09-12T01:38:21.683694+0000","last_peered":"2024-09-12T01:38:21.683694+0000","last_clean":"2024-09-12T01:38:21.683694+0000","last_became_active":"2024-09-12T00:25:10.521886+0000","last_became_peered":"2024-09-12T00:25:10.521886+0000","last_unstale":"2024-09-12T01:38:21.683694+0000","last_undegraded":"2024-09-12T01:38:21.683694+0000","last_fullsized":"2024-09-12T01:38:21.683694+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'189","last_scrub_stamp":"2024-09-12T01:38:21.683585+0000","last_deep_scrub":"266'189","last_deep_scrub_stamp":"2024-09-12T01:38:21.683585+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.683585+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:09.718529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":280,"num_read_kb":274,"num_write":435,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'457","reported_seq":1954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.372563+0000","last_change":"2024-09-12T01:37:59.372563+0000","last_active":"2024-09-12T01:37:59.372563+0000","last_peered":"2024-09-12T01:37:59.372563+0000","last_clean":"2024-09-12T01:37:59.372563+0000","last_became_active":"2024-09-12T00:25:02.463187+0000","last_became_peered":"2024-09-12T00:25:02.463187+0000","last_unstale":"2024-09-12T01:37:59.372563+0000","last_undegraded":"2024-09-12T01:37:59.372563+0000","last_fullsized":"2024-09-12T01:37:59.372563+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'457","last_scrub_stamp":"2024-09-12T01:37:59.372473+0000","last_deep_scrub":"266'457","last_deep_scrub_stamp":"2024-09-12T01:37:59.372473+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.372473+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:38.818995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2353,"num_read_kb":2190,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'299","reported_seq":996,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.379895+0000","last_change":"2024-09-12T01:37:50.379895+0000","last_active":"2024-09-12T01:37:50.379895+0000","last_peered":"2024-09-12T01:37:50.379895+0000","last_clean":"2024-09-12T01:37:50.379895+0000","last_became_active":"2024-09-12T00:25:00.467785+0000","last_became_peered":"2024-09-12T00:25:00.467785+0000","last_unstale":"2024-09-12T01:37:50.379895+0000","last_undegraded":"2024-09-12T01:37:50.379895+0000","last_fullsized":"2024-09-12T01:37:50.379895+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'299","last_scrub_stamp":"2024-09-12T01:37:50.379775+0000","last_deep_scrub":"266'299","last_deep_scrub_stamp":"2024-09-12T01:37:50.379775+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.379775+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:15.751538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":731,"num_read_kb":946,"num_write":1133,"num_write_kb":20145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.756573+0000","last_change":"2024-09-12T01:38:02.756573+0000","last_active":"2024-09-12T01:38:02.756573+0000","last_peered":"2024-09-12T01:38:02.756573+0000","last_clean":"2024-09-12T01:38:02.756573+0000","last_became_active":"2024-09-12T00:25:04.484608+0000","last_became_peered":"2024-09-12T00:25:04.484608+0000","last_unstale":"2024-09-12T01:38:02.756573+0000","last_undegraded":"2024-09-12T01:38:02.756573+0000","last_fullsized":"2024-09-12T01:38:02.756573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:02.756483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:02.756483+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.756483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:30.789022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'206","reported_seq":821,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.911197+0000","last_change":"2024-09-12T01:38:20.911197+0000","last_active":"2024-09-12T01:38:20.911197+0000","last_peered":"2024-09-12T01:38:20.911197+0000","last_clean":"2024-09-12T01:38:20.911197+0000","last_became_active":"2024-09-12T00:25:06.489578+0000","last_became_peered":"2024-09-12T00:25:06.489578+0000","last_unstale":"2024-09-12T01:38:20.911197+0000","last_undegraded":"2024-09-12T01:38:20.911197+0000","last_fullsized":"2024-09-12T01:38:20.911197+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T01:38:20.911089+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T01:38:20.911089+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.911089+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.469452+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7791,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":284,"num_read_kb":342,"num_write":192,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.642906+0000","last_change":"2024-09-12T01:38:17.642906+0000","last_active":"2024-09-12T01:38:17.642906+0000","last_peered":"2024-09-12T01:38:17.642906+0000","last_clean":"2024-09-12T01:38:17.642906+0000","last_became_active":"2024-09-12T00:25:08.513330+0000","last_became_peered":"2024-09-12T00:25:08.513330+0000","last_unstale":"2024-09-12T01:38:17.642906+0000","last_undegraded":"2024-09-12T01:38:17.642906+0000","last_fullsized":"2024-09-12T01:38:17.642906+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:17.642819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:17.642819+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.642819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.634535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'218","reported_seq":1100,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:08.536614+0000","last_change":"2024-09-12T00:25:10.527941+0000","last_active":"2024-09-12T01:36:08.536614+0000","last_peered":"2024-09-12T01:36:08.536614+0000","last_clean":"2024-09-12T01:36:08.536614+0000","last_became_active":"2024-09-12T00:25:10.527649+0000","last_became_peered":"2024-09-12T00:25:10.527649+0000","last_unstale":"2024-09-12T01:36:08.536614+0000","last_undegraded":"2024-09-12T01:36:08.536614+0000","last_fullsized":"2024-09-12T01:36:08.536614+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:30.223583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":648,"num_write":596,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'368","reported_seq":1826,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.442383+0000","last_change":"2024-09-12T01:37:54.442383+0000","last_active":"2024-09-12T01:37:54.442383+0000","last_peered":"2024-09-12T01:37:54.442383+0000","last_clean":"2024-09-12T01:37:54.442383+0000","last_became_active":"2024-09-12T00:25:02.479051+0000","last_became_peered":"2024-09-12T00:25:02.479051+0000","last_unstale":"2024-09-12T01:37:54.442383+0000","last_undegraded":"2024-09-12T01:37:54.442383+0000","last_fullsized":"2024-09-12T01:37:54.442383+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'368","last_scrub_stamp":"2024-09-12T01:37:54.442292+0000","last_deep_scrub":"266'368","last_deep_scrub_stamp":"2024-09-12T01:37:54.442292+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.442292+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:20.538747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1824,"num_write":392,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'196","reported_seq":837,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.788273+0000","last_change":"2024-09-12T01:37:45.788273+0000","last_active":"2024-09-12T01:37:45.788273+0000","last_peered":"2024-09-12T01:37:45.788273+0000","last_clean":"2024-09-12T01:37:45.788273+0000","last_became_active":"2024-09-12T00:25:00.454796+0000","last_became_peered":"2024-09-12T00:25:00.454796+0000","last_unstale":"2024-09-12T01:37:45.788273+0000","last_undegraded":"2024-09-12T01:37:45.788273+0000","last_fullsized":"2024-09-12T01:37:45.788273+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T01:37:45.788160+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T01:37:45.788160+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.788160+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:20.838772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661693,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":2462,"num_write":975,"num_write_kb":27053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.708068+0000","last_change":"2024-09-12T01:38:01.708068+0000","last_active":"2024-09-12T01:38:01.708068+0000","last_peered":"2024-09-12T01:38:01.708068+0000","last_clean":"2024-09-12T01:38:01.708068+0000","last_became_active":"2024-09-12T00:25:04.475432+0000","last_became_peered":"2024-09-12T00:25:04.475432+0000","last_unstale":"2024-09-12T01:38:01.708068+0000","last_undegraded":"2024-09-12T01:38:01.708068+0000","last_fullsized":"2024-09-12T01:38:01.708068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:01.707983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:01.707983+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.707983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.862812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'180","reported_seq":788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.331794+0000","last_change":"2024-09-12T01:38:09.331794+0000","last_active":"2024-09-12T01:38:09.331794+0000","last_peered":"2024-09-12T01:38:09.331794+0000","last_clean":"2024-09-12T01:38:09.331794+0000","last_became_active":"2024-09-12T00:25:06.499452+0000","last_became_peered":"2024-09-12T00:25:06.499452+0000","last_unstale":"2024-09-12T01:38:09.331794+0000","last_undegraded":"2024-09-12T01:38:09.331794+0000","last_fullsized":"2024-09-12T01:38:09.331794+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'180","last_scrub_stamp":"2024-09-12T01:38:09.331674+0000","last_deep_scrub":"266'180","last_deep_scrub_stamp":"2024-09-12T01:38:09.331674+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.331674+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.045246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6920,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":302,"num_write":132,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.518586+0000","last_change":"2024-09-12T01:38:08.518586+0000","last_active":"2024-09-12T01:38:08.518586+0000","last_peered":"2024-09-12T01:38:08.518586+0000","last_clean":"2024-09-12T01:38:08.518586+0000","last_became_active":"2024-09-12T00:25:08.514591+0000","last_became_peered":"2024-09-12T00:25:08.514591+0000","last_unstale":"2024-09-12T01:38:08.518586+0000","last_undegraded":"2024-09-12T01:38:08.518586+0000","last_fullsized":"2024-09-12T01:38:08.518586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.518472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.518472+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.518472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:53.955684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'120","reported_seq":644,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:19.574196+0000","last_change":"2024-09-12T00:25:10.527404+0000","last_active":"2024-09-12T01:37:19.574196+0000","last_peered":"2024-09-12T01:37:19.574196+0000","last_clean":"2024-09-12T01:37:19.574196+0000","last_became_active":"2024-09-12T00:25:10.527125+0000","last_became_peered":"2024-09-12T00:25:10.527125+0000","last_unstale":"2024-09-12T01:37:19.574196+0000","last_undegraded":"2024-09-12T01:37:19.574196+0000","last_fullsized":"2024-09-12T01:37:19.574196+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:04.270864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":179,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'798","reported_seq":2256,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.352870+0000","last_change":"2024-09-12T01:37:56.352870+0000","last_active":"2024-09-12T01:37:56.352870+0000","last_peered":"2024-09-12T01:37:56.352870+0000","last_clean":"2024-09-12T01:37:56.352870+0000","last_became_active":"2024-09-12T00:25:02.464409+0000","last_became_peered":"2024-09-12T00:25:02.464409+0000","last_unstale":"2024-09-12T01:37:56.352870+0000","last_undegraded":"2024-09-12T01:37:56.352870+0000","last_fullsized":"2024-09-12T01:37:56.352870+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'798","last_scrub_stamp":"2024-09-12T01:37:56.352774+0000","last_deep_scrub":"266'798","last_deep_scrub_stamp":"2024-09-12T01:37:56.352774+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.352774+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:36.258745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3724,"num_read_kb":3326,"num_write":1070,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'248","reported_seq":936,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.355633+0000","last_change":"2024-09-12T01:37:51.355633+0000","last_active":"2024-09-12T01:37:51.355633+0000","last_peered":"2024-09-12T01:37:51.355633+0000","last_clean":"2024-09-12T01:37:51.355633+0000","last_became_active":"2024-09-12T00:25:00.466015+0000","last_became_peered":"2024-09-12T00:25:00.466015+0000","last_unstale":"2024-09-12T01:37:51.355633+0000","last_undegraded":"2024-09-12T01:37:51.355633+0000","last_fullsized":"2024-09-12T01:37:51.355633+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'248","last_scrub_stamp":"2024-09-12T01:37:51.355483+0000","last_deep_scrub":"266'248","last_deep_scrub_stamp":"2024-09-12T01:37:51.355483+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.355483+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:25.590012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":59883,"num_write":1086,"num_write_kb":30675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.424591+0000","last_change":"2024-09-12T01:38:08.424591+0000","last_active":"2024-09-12T01:38:08.424591+0000","last_peered":"2024-09-12T01:38:08.424591+0000","last_clean":"2024-09-12T01:38:08.424591+0000","last_became_active":"2024-09-12T00:25:04.482091+0000","last_became_peered":"2024-09-12T00:25:04.482091+0000","last_unstale":"2024-09-12T01:38:08.424591+0000","last_undegraded":"2024-09-12T01:38:08.424591+0000","last_fullsized":"2024-09-12T01:38:08.424591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.424471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.424471+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.424471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:04.775940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'132","reported_seq":691,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.875332+0000","last_change":"2024-09-12T01:38:21.875332+0000","last_active":"2024-09-12T01:38:21.875332+0000","last_peered":"2024-09-12T01:38:21.875332+0000","last_clean":"2024-09-12T01:38:21.875332+0000","last_became_active":"2024-09-12T00:25:06.491582+0000","last_became_peered":"2024-09-12T00:25:06.491582+0000","last_unstale":"2024-09-12T01:38:21.875332+0000","last_undegraded":"2024-09-12T01:38:21.875332+0000","last_fullsized":"2024-09-12T01:38:21.875332+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'132","last_scrub_stamp":"2024-09-12T01:38:21.875228+0000","last_deep_scrub":"266'132","last_deep_scrub_stamp":"2024-09-12T01:38:21.875228+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.875228+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:52.692943+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":169,"num_read_kb":163,"num_write":166,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'765","reported_seq":2564,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.858683+0000","last_change":"2024-09-12T01:38:06.858683+0000","last_active":"2024-09-12T01:38:06.858683+0000","last_peered":"2024-09-12T01:38:06.858683+0000","last_clean":"2024-09-12T01:38:06.858683+0000","last_became_active":"2024-09-12T00:25:08.506288+0000","last_became_peered":"2024-09-12T00:25:08.506288+0000","last_unstale":"2024-09-12T01:38:06.858683+0000","last_undegraded":"2024-09-12T01:38:06.858683+0000","last_fullsized":"2024-09-12T01:38:06.858683+0000","mapping_epoch":34,"log_start":"266'701","ondisk_log_start":"266'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'765","last_scrub_stamp":"2024-09-12T01:38:06.858588+0000","last_deep_scrub":"266'765","last_deep_scrub_stamp":"2024-09-12T01:38:06.858588+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.858588+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:00.301952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'126","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:14.534992+0000","last_change":"2024-09-12T00:25:10.525346+0000","last_active":"2024-09-12T01:35:14.534992+0000","last_peered":"2024-09-12T01:35:14.534992+0000","last_clean":"2024-09-12T01:35:14.534992+0000","last_became_active":"2024-09-12T00:25:10.525045+0000","last_became_peered":"2024-09-12T00:25:10.525045+0000","last_unstale":"2024-09-12T01:35:14.534992+0000","last_undegraded":"2024-09-12T01:35:14.534992+0000","last_fullsized":"2024-09-12T01:35:14.534992+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:19.669222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'459","reported_seq":2081,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.681716+0000","last_change":"2024-09-12T01:38:00.681716+0000","last_active":"2024-09-12T01:38:00.681716+0000","last_peered":"2024-09-12T01:38:00.681716+0000","last_clean":"2024-09-12T01:38:00.681716+0000","last_became_active":"2024-09-12T00:25:02.471255+0000","last_became_peered":"2024-09-12T00:25:02.471255+0000","last_unstale":"2024-09-12T01:38:00.681716+0000","last_undegraded":"2024-09-12T01:38:00.681716+0000","last_fullsized":"2024-09-12T01:38:00.681716+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'459","last_scrub_stamp":"2024-09-12T01:38:00.681548+0000","last_deep_scrub":"266'459","last_deep_scrub_stamp":"2024-09-12T01:38:00.681548+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.681548+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:56.359987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2599,"num_read_kb":2460,"num_write":533,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'175","reported_seq":819,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.829012+0000","last_change":"2024-09-12T01:37:44.829012+0000","last_active":"2024-09-12T01:37:44.829012+0000","last_peered":"2024-09-12T01:37:44.829012+0000","last_clean":"2024-09-12T01:37:44.829012+0000","last_became_active":"2024-09-12T00:25:00.456853+0000","last_became_peered":"2024-09-12T00:25:00.456853+0000","last_unstale":"2024-09-12T01:37:44.829012+0000","last_undegraded":"2024-09-12T01:37:44.829012+0000","last_fullsized":"2024-09-12T01:37:44.829012+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'175","last_scrub_stamp":"2024-09-12T01:37:44.828838+0000","last_deep_scrub":"266'175","last_deep_scrub_stamp":"2024-09-12T01:37:44.828838+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.828838+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:03.195827+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1794910,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":16809,"num_write":841,"num_write_kb":28613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.857909+0000","last_change":"2024-09-12T01:38:06.857909+0000","last_active":"2024-09-12T01:38:06.857909+0000","last_peered":"2024-09-12T01:38:06.857909+0000","last_clean":"2024-09-12T01:38:06.857909+0000","last_became_active":"2024-09-12T00:25:04.482441+0000","last_became_peered":"2024-09-12T00:25:04.482441+0000","last_unstale":"2024-09-12T01:38:06.857909+0000","last_undegraded":"2024-09-12T01:38:06.857909+0000","last_fullsized":"2024-09-12T01:38:06.857909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.857801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.857801+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.857801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:24.285527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'229","reported_seq":873,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.911624+0000","last_change":"2024-09-12T01:38:05.911624+0000","last_active":"2024-09-12T01:38:05.911624+0000","last_peered":"2024-09-12T01:38:05.911624+0000","last_clean":"2024-09-12T01:38:05.911624+0000","last_became_active":"2024-09-12T00:25:06.493625+0000","last_became_peered":"2024-09-12T00:25:06.493625+0000","last_unstale":"2024-09-12T01:38:05.911624+0000","last_undegraded":"2024-09-12T01:38:05.911624+0000","last_fullsized":"2024-09-12T01:38:05.911624+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T01:38:05.911522+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T01:38:05.911522+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.911522+0000","objects_scrubbed":11,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.127866+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9308,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":374,"num_write":180,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.388205+0000","last_change":"2024-09-12T01:38:18.388205+0000","last_active":"2024-09-12T01:38:18.388205+0000","last_peered":"2024-09-12T01:38:18.388205+0000","last_clean":"2024-09-12T01:38:18.388205+0000","last_became_active":"2024-09-12T00:25:08.511024+0000","last_became_peered":"2024-09-12T00:25:08.511024+0000","last_unstale":"2024-09-12T01:38:18.388205+0000","last_undegraded":"2024-09-12T01:38:18.388205+0000","last_fullsized":"2024-09-12T01:38:18.388205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:18.388125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:18.388125+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.388125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:57.927807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'104","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.837798+0000","last_change":"2024-09-12T01:38:13.837798+0000","last_active":"2024-09-12T01:38:13.837798+0000","last_peered":"2024-09-12T01:38:13.837798+0000","last_clean":"2024-09-12T01:38:13.837798+0000","last_became_active":"2024-09-12T00:25:10.525981+0000","last_became_peered":"2024-09-12T00:25:10.525981+0000","last_unstale":"2024-09-12T01:38:13.837798+0000","last_undegraded":"2024-09-12T01:38:13.837798+0000","last_fullsized":"2024-09-12T01:38:13.837798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'104","last_scrub_stamp":"2024-09-12T01:38:13.837710+0000","last_deep_scrub":"266'104","last_deep_scrub_stamp":"2024-09-12T01:38:13.837710+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.837710+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:27.183275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":244,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'803","reported_seq":2407,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.688246+0000","last_change":"2024-09-12T01:37:57.688246+0000","last_active":"2024-09-12T01:37:57.688246+0000","last_peered":"2024-09-12T01:37:57.688246+0000","last_clean":"2024-09-12T01:37:57.688246+0000","last_became_active":"2024-09-12T00:25:02.463545+0000","last_became_peered":"2024-09-12T00:25:02.463545+0000","last_unstale":"2024-09-12T01:37:57.688246+0000","last_undegraded":"2024-09-12T01:37:57.688246+0000","last_fullsized":"2024-09-12T01:37:57.688246+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'803","last_scrub_stamp":"2024-09-12T01:37:57.688138+0000","last_deep_scrub":"266'803","last_deep_scrub_stamp":"2024-09-12T01:37:57.688138+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.688138+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:00.009792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3630,"num_write":1061,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'201","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.073754+0000","last_change":"2024-09-12T01:37:56.073754+0000","last_active":"2024-09-12T01:37:56.073754+0000","last_peered":"2024-09-12T01:37:56.073754+0000","last_clean":"2024-09-12T01:37:56.073754+0000","last_became_active":"2024-09-12T00:25:00.478561+0000","last_became_peered":"2024-09-12T00:25:00.478561+0000","last_unstale":"2024-09-12T01:37:56.073754+0000","last_undegraded":"2024-09-12T01:37:56.073754+0000","last_fullsized":"2024-09-12T01:37:56.073754+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'201","last_scrub_stamp":"2024-09-12T01:37:56.073631+0000","last_deep_scrub":"266'201","last_deep_scrub_stamp":"2024-09-12T01:37:56.073631+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.073631+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:46.426001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568262,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":8616,"num_write":923,"num_write_kb":24681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.702621+0000","last_change":"2024-09-12T01:37:59.702621+0000","last_active":"2024-09-12T01:37:59.702621+0000","last_peered":"2024-09-12T01:37:59.702621+0000","last_clean":"2024-09-12T01:37:59.702621+0000","last_became_active":"2024-09-12T00:25:04.481146+0000","last_became_peered":"2024-09-12T00:25:04.481146+0000","last_unstale":"2024-09-12T01:37:59.702621+0000","last_undegraded":"2024-09-12T01:37:59.702621+0000","last_fullsized":"2024-09-12T01:37:59.702621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:59.702524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:59.702524+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.702524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:01.125016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'160","reported_seq":766,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.376066+0000","last_change":"2024-09-12T01:38:14.376066+0000","last_active":"2024-09-12T01:38:14.376066+0000","last_peered":"2024-09-12T01:38:14.376066+0000","last_clean":"2024-09-12T01:38:14.376066+0000","last_became_active":"2024-09-12T00:25:06.499065+0000","last_became_peered":"2024-09-12T00:25:06.499065+0000","last_unstale":"2024-09-12T01:38:14.376066+0000","last_undegraded":"2024-09-12T01:38:14.376066+0000","last_fullsized":"2024-09-12T01:38:14.376066+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'160","last_scrub_stamp":"2024-09-12T01:38:14.375983+0000","last_deep_scrub":"266'160","last_deep_scrub_stamp":"2024-09-12T01:38:14.375983+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.375983+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:14.670939+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":326,"num_write":120,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:19.535752+0000","last_change":"2024-09-12T00:25:08.510993+0000","last_active":"2024-09-12T01:35:19.535752+0000","last_peered":"2024-09-12T01:35:19.535752+0000","last_clean":"2024-09-12T01:35:19.535752+0000","last_became_active":"2024-09-12T00:25:08.510416+0000","last_became_peered":"2024-09-12T00:25:08.510416+0000","last_unstale":"2024-09-12T01:35:19.535752+0000","last_undegraded":"2024-09-12T01:35:19.535752+0000","last_fullsized":"2024-09-12T01:35:19.535752+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:41:07.820462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'119","reported_seq":649,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.645711+0000","last_change":"2024-09-12T01:38:23.645711+0000","last_active":"2024-09-12T01:38:23.645711+0000","last_peered":"2024-09-12T01:38:23.645711+0000","last_clean":"2024-09-12T01:38:23.645711+0000","last_became_active":"2024-09-12T00:25:10.520808+0000","last_became_peered":"2024-09-12T00:25:10.520808+0000","last_unstale":"2024-09-12T01:38:23.645711+0000","last_undegraded":"2024-09-12T01:38:23.645711+0000","last_fullsized":"2024-09-12T01:38:23.645711+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'119","last_scrub_stamp":"2024-09-12T01:38:23.645619+0000","last_deep_scrub":"266'119","last_deep_scrub_stamp":"2024-09-12T01:38:23.645619+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.645619+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:58.532369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1152,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":290,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'801","reported_seq":2320,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.378858+0000","last_change":"2024-09-12T01:37:52.378858+0000","last_active":"2024-09-12T01:37:52.378858+0000","last_peered":"2024-09-12T01:37:52.378858+0000","last_clean":"2024-09-12T01:37:52.378858+0000","last_became_active":"2024-09-12T00:25:02.470607+0000","last_became_peered":"2024-09-12T00:25:02.470607+0000","last_unstale":"2024-09-12T01:37:52.378858+0000","last_undegraded":"2024-09-12T01:37:52.378858+0000","last_fullsized":"2024-09-12T01:37:52.378858+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T01:37:52.378752+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T01:37:52.378752+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.378752+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:52.413766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3788,"num_read_kb":3387,"num_write":1064,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1177,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'177","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.584965+0000","last_change":"2024-09-12T01:37:51.584965+0000","last_active":"2024-09-12T01:37:51.584965+0000","last_peered":"2024-09-12T01:37:51.584965+0000","last_clean":"2024-09-12T01:37:51.584965+0000","last_became_active":"2024-09-12T00:25:00.465095+0000","last_became_peered":"2024-09-12T00:25:00.465095+0000","last_unstale":"2024-09-12T01:37:51.584965+0000","last_undegraded":"2024-09-12T01:37:51.584965+0000","last_fullsized":"2024-09-12T01:37:51.584965+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T01:37:51.584835+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T01:37:51.584835+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.584835+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:25.271916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":87968,"num_write":861,"num_write_kb":34661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.833398+0000","last_change":"2024-09-12T01:38:00.833398+0000","last_active":"2024-09-12T01:38:00.833398+0000","last_peered":"2024-09-12T01:38:00.833398+0000","last_clean":"2024-09-12T01:38:00.833398+0000","last_became_active":"2024-09-12T00:25:04.483232+0000","last_became_peered":"2024-09-12T00:25:04.483232+0000","last_unstale":"2024-09-12T01:38:00.833398+0000","last_undegraded":"2024-09-12T01:38:00.833398+0000","last_fullsized":"2024-09-12T01:38:00.833398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.833313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.833313+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.833313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:19.117932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'122","reported_seq":700,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.379862+0000","last_change":"2024-09-12T01:38:06.379862+0000","last_active":"2024-09-12T01:38:06.379862+0000","last_peered":"2024-09-12T01:38:06.379862+0000","last_clean":"2024-09-12T01:38:06.379862+0000","last_became_active":"2024-09-12T00:25:06.499749+0000","last_became_peered":"2024-09-12T00:25:06.499749+0000","last_unstale":"2024-09-12T01:38:06.379862+0000","last_undegraded":"2024-09-12T01:38:06.379862+0000","last_fullsized":"2024-09-12T01:38:06.379862+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'122","last_scrub_stamp":"2024-09-12T01:38:06.379758+0000","last_deep_scrub":"266'122","last_deep_scrub_stamp":"2024-09-12T01:38:06.379758+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.379758+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:20.201626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8122,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":217,"num_write":76,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:09.534440+0000","last_change":"2024-09-12T00:25:08.514387+0000","last_active":"2024-09-12T01:35:09.534440+0000","last_peered":"2024-09-12T01:35:09.534440+0000","last_clean":"2024-09-12T01:35:09.534440+0000","last_became_active":"2024-09-12T00:25:08.513977+0000","last_became_peered":"2024-09-12T00:25:08.513977+0000","last_unstale":"2024-09-12T01:35:09.534440+0000","last_undegraded":"2024-09-12T01:35:09.534440+0000","last_fullsized":"2024-09-12T01:35:09.534440+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:07.485754+0000","last_clean_scrub_stamp":"2024-09-12T00:25:07.485754+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:30.665951+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'144","reported_seq":1248,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:11.185545+0000","last_change":"2024-09-12T00:25:10.530536+0000","last_active":"2024-09-12T01:36:11.185545+0000","last_peered":"2024-09-12T01:36:11.185545+0000","last_clean":"2024-09-12T01:36:11.185545+0000","last_became_active":"2024-09-12T00:25:10.530103+0000","last_became_peered":"2024-09-12T00:25:10.530103+0000","last_unstale":"2024-09-12T01:36:11.185545+0000","last_undegraded":"2024-09-12T01:36:11.185545+0000","last_fullsized":"2024-09-12T01:36:11.185545+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:25:09.500994+0000","last_clean_scrub_stamp":"2024-09-12T00:25:09.500994+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":100,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:52:55.601805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":760,"num_write":344,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'1252","reported_seq":2953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.749655+0000","last_change":"2024-09-12T01:37:54.749655+0000","last_active":"2024-09-12T01:37:54.749655+0000","last_peered":"2024-09-12T01:37:54.749655+0000","last_clean":"2024-09-12T01:37:54.749655+0000","last_became_active":"2024-09-12T00:25:02.467159+0000","last_became_peered":"2024-09-12T00:25:02.467159+0000","last_unstale":"2024-09-12T01:37:54.749655+0000","last_undegraded":"2024-09-12T01:37:54.749655+0000","last_fullsized":"2024-09-12T01:37:54.749655+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1252","last_scrub_stamp":"2024-09-12T01:37:54.749564+0000","last_deep_scrub":"266'1252","last_deep_scrub_stamp":"2024-09-12T01:37:54.749564+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.749564+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":1200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.375412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5713,"num_read_kb":5033,"num_write":1731,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'181","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.585023+0000","last_change":"2024-09-12T01:37:50.584954+0000","last_active":"2024-09-12T01:37:50.585023+0000","last_peered":"2024-09-12T01:37:50.585023+0000","last_clean":"2024-09-12T01:37:50.585023+0000","last_became_active":"2024-09-12T00:25:00.458519+0000","last_became_peered":"2024-09-12T00:25:00.458519+0000","last_unstale":"2024-09-12T01:37:50.585023+0000","last_undegraded":"2024-09-12T01:37:50.585023+0000","last_fullsized":"2024-09-12T01:37:50.585023+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'181","last_scrub_stamp":"2024-09-12T01:37:50.584829+0000","last_deep_scrub":"266'181","last_deep_scrub_stamp":"2024-09-12T01:37:50.584829+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.584829+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:45.672695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174575,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":854,"num_write":913,"num_write_kb":13833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"266'2","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.380392+0000","last_change":"2024-09-12T01:38:07.380392+0000","last_active":"2024-09-12T01:38:07.380392+0000","last_peered":"2024-09-12T01:38:07.380392+0000","last_clean":"2024-09-12T01:38:07.380392+0000","last_became_active":"2024-09-12T00:25:04.481393+0000","last_became_peered":"2024-09-12T00:25:04.481393+0000","last_unstale":"2024-09-12T01:38:07.380392+0000","last_undegraded":"2024-09-12T01:38:07.380392+0000","last_fullsized":"2024-09-12T01:38:07.380392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:07.380252+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:07.380252+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.380252+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:36.278038+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'199","reported_seq":818,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.932702+0000","last_change":"2024-09-12T01:38:18.932702+0000","last_active":"2024-09-12T01:38:18.932702+0000","last_peered":"2024-09-12T01:38:18.932702+0000","last_clean":"2024-09-12T01:38:18.932702+0000","last_became_active":"2024-09-12T00:25:06.490384+0000","last_became_peered":"2024-09-12T00:25:06.490384+0000","last_unstale":"2024-09-12T01:38:18.932702+0000","last_undegraded":"2024-09-12T01:38:18.932702+0000","last_fullsized":"2024-09-12T01:38:18.932702+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'199","last_scrub_stamp":"2024-09-12T01:38:18.932589+0000","last_deep_scrub":"266'199","last_deep_scrub_stamp":"2024-09-12T01:38:18.932589+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.932589+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:42.938759+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8836,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.365895+0000","last_change":"2024-09-12T01:38:19.365895+0000","last_active":"2024-09-12T01:38:19.365895+0000","last_peered":"2024-09-12T01:38:19.365895+0000","last_clean":"2024-09-12T01:38:19.365895+0000","last_became_active":"2024-09-12T00:25:08.507837+0000","last_became_peered":"2024-09-12T00:25:08.507837+0000","last_unstale":"2024-09-12T01:38:19.365895+0000","last_undegraded":"2024-09-12T01:38:19.365895+0000","last_fullsized":"2024-09-12T01:38:19.365895+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:19.365805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:19.365805+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.365805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:54.035348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'138","reported_seq":693,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.899999+0000","last_change":"2024-09-12T01:38:08.899999+0000","last_active":"2024-09-12T01:38:08.899999+0000","last_peered":"2024-09-12T01:38:08.899999+0000","last_clean":"2024-09-12T01:38:08.899999+0000","last_became_active":"2024-09-12T00:25:10.528040+0000","last_became_peered":"2024-09-12T00:25:10.528040+0000","last_unstale":"2024-09-12T01:38:08.899999+0000","last_undegraded":"2024-09-12T01:38:08.899999+0000","last_fullsized":"2024-09-12T01:38:08.899999+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'138","last_scrub_stamp":"2024-09-12T01:38:08.899912+0000","last_deep_scrub":"266'138","last_deep_scrub_stamp":"2024-09-12T01:38:08.899912+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.899912+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:42.982946+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":238,"num_write":307,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'1098","reported_seq":2617,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.388999+0000","last_change":"2024-09-12T01:37:57.388999+0000","last_active":"2024-09-12T01:37:57.388999+0000","last_peered":"2024-09-12T01:37:57.388999+0000","last_clean":"2024-09-12T01:37:57.388999+0000","last_became_active":"2024-09-12T00:25:02.474282+0000","last_became_peered":"2024-09-12T00:25:02.474282+0000","last_unstale":"2024-09-12T01:37:57.388999+0000","last_undegraded":"2024-09-12T01:37:57.388999+0000","last_fullsized":"2024-09-12T01:37:57.388999+0000","mapping_epoch":28,"log_start":"266'1000","ondisk_log_start":"266'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1098","last_scrub_stamp":"2024-09-12T01:37:57.388881+0000","last_deep_scrub":"266'1098","last_deep_scrub_stamp":"2024-09-12T01:37:57.388881+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.388881+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":1000,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:34.723161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4398,"num_write":1510,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'185","reported_seq":862,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.631943+0000","last_change":"2024-09-12T01:37:47.631887+0000","last_active":"2024-09-12T01:37:47.631943+0000","last_peered":"2024-09-12T01:37:47.631943+0000","last_clean":"2024-09-12T01:37:47.631943+0000","last_became_active":"2024-09-12T00:25:00.478259+0000","last_became_peered":"2024-09-12T00:25:00.478259+0000","last_unstale":"2024-09-12T01:37:47.631943+0000","last_undegraded":"2024-09-12T01:37:47.631943+0000","last_fullsized":"2024-09-12T01:37:47.631943+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:47.631770+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:47.631770+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.631770+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:29.806652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515600,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":41144,"num_write":873,"num_write_kb":35919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'755","reported_seq":2241,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.417543+0000","last_change":"2024-09-12T01:37:57.417543+0000","last_active":"2024-09-12T01:37:57.417543+0000","last_peered":"2024-09-12T01:37:57.417543+0000","last_clean":"2024-09-12T01:37:57.417543+0000","last_became_active":"2024-09-12T00:25:02.479450+0000","last_became_peered":"2024-09-12T00:25:02.479450+0000","last_unstale":"2024-09-12T01:37:57.417543+0000","last_undegraded":"2024-09-12T01:37:57.417543+0000","last_fullsized":"2024-09-12T01:37:57.417543+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'755","last_scrub_stamp":"2024-09-12T01:37:57.417454+0000","last_deep_scrub":"266'755","last_deep_scrub_stamp":"2024-09-12T01:37:57.417454+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.417454+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:04.776702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3526,"num_read_kb":3183,"num_write":976,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'207","reported_seq":851,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.446489+0000","last_change":"2024-09-12T01:37:49.446397+0000","last_active":"2024-09-12T01:37:49.446489+0000","last_peered":"2024-09-12T01:37:49.446489+0000","last_clean":"2024-09-12T01:37:49.446489+0000","last_became_active":"2024-09-12T00:25:00.468280+0000","last_became_peered":"2024-09-12T00:25:00.468280+0000","last_unstale":"2024-09-12T01:37:49.446489+0000","last_undegraded":"2024-09-12T01:37:49.446489+0000","last_fullsized":"2024-09-12T01:37:49.446489+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'207","last_scrub_stamp":"2024-09-12T01:37:49.446249+0000","last_deep_scrub":"266'207","last_deep_scrub_stamp":"2024-09-12T01:37:49.446249+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.446249+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:17.110576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":421,"num_read_kb":15096,"num_write":1006,"num_write_kb":29184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'368","reported_seq":1895,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.941131+0000","last_change":"2024-09-12T01:38:06.941131+0000","last_active":"2024-09-12T01:38:06.941131+0000","last_peered":"2024-09-12T01:38:06.941131+0000","last_clean":"2024-09-12T01:38:06.941131+0000","last_became_active":"2024-09-12T00:25:02.476993+0000","last_became_peered":"2024-09-12T00:25:02.476993+0000","last_unstale":"2024-09-12T01:38:06.941131+0000","last_undegraded":"2024-09-12T01:38:06.941131+0000","last_fullsized":"2024-09-12T01:38:06.941131+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'368","last_scrub_stamp":"2024-09-12T01:38:06.941039+0000","last_deep_scrub":"266'368","last_deep_scrub_stamp":"2024-09-12T01:38:06.941039+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.941039+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:55.933049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2221,"num_read_kb":2131,"num_write":417,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'201","reported_seq":894,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.122989+0000","last_change":"2024-09-12T01:37:53.122891+0000","last_active":"2024-09-12T01:37:53.122989+0000","last_peered":"2024-09-12T01:37:53.122989+0000","last_clean":"2024-09-12T01:37:53.122989+0000","last_became_active":"2024-09-12T00:25:00.477872+0000","last_became_peered":"2024-09-12T00:25:00.477872+0000","last_unstale":"2024-09-12T01:37:53.122989+0000","last_undegraded":"2024-09-12T01:37:53.122989+0000","last_fullsized":"2024-09-12T01:37:53.122989+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'201","last_scrub_stamp":"2024-09-12T01:37:53.122774+0000","last_deep_scrub":"266'201","last_deep_scrub_stamp":"2024-09-12T01:37:53.122774+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.122774+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:56.089470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590195,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":9353,"num_write":799,"num_write_kb":34820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'480","reported_seq":1991,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.625423+0000","last_change":"2024-09-12T01:38:02.625423+0000","last_active":"2024-09-12T01:38:02.625423+0000","last_peered":"2024-09-12T01:38:02.625423+0000","last_clean":"2024-09-12T01:38:02.625423+0000","last_became_active":"2024-09-12T00:25:02.468180+0000","last_became_peered":"2024-09-12T00:25:02.468180+0000","last_unstale":"2024-09-12T01:38:02.625423+0000","last_undegraded":"2024-09-12T01:38:02.625423+0000","last_fullsized":"2024-09-12T01:38:02.625423+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'480","last_scrub_stamp":"2024-09-12T01:38:02.625346+0000","last_deep_scrub":"266'480","last_deep_scrub_stamp":"2024-09-12T01:38:02.625346+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.625346+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:54.703998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2321,"num_read_kb":2166,"num_write":540,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'179","reported_seq":797,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.564089+0000","last_change":"2024-09-12T01:37:53.564029+0000","last_active":"2024-09-12T01:37:53.564089+0000","last_peered":"2024-09-12T01:37:53.564089+0000","last_clean":"2024-09-12T01:37:53.564089+0000","last_became_active":"2024-09-12T00:25:00.471412+0000","last_became_peered":"2024-09-12T00:25:00.471412+0000","last_unstale":"2024-09-12T01:37:53.564089+0000","last_undegraded":"2024-09-12T01:37:53.564089+0000","last_fullsized":"2024-09-12T01:37:53.564089+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'179","last_scrub_stamp":"2024-09-12T01:37:53.563879+0000","last_deep_scrub":"266'179","last_deep_scrub_stamp":"2024-09-12T01:37:53.563879+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.563879+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:48.342923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432317,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":354,"num_read_kb":25493,"num_write":898,"num_write_kb":19511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'502","reported_seq":2197,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.585527+0000","last_change":"2024-09-12T01:38:01.585436+0000","last_active":"2024-09-12T01:38:01.585527+0000","last_peered":"2024-09-12T01:38:01.585527+0000","last_clean":"2024-09-12T01:38:01.585527+0000","last_became_active":"2024-09-12T00:25:02.469251+0000","last_became_peered":"2024-09-12T00:25:02.469251+0000","last_unstale":"2024-09-12T01:38:01.585527+0000","last_undegraded":"2024-09-12T01:38:01.585527+0000","last_fullsized":"2024-09-12T01:38:01.585527+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'502","last_scrub_stamp":"2024-09-12T01:38:01.585337+0000","last_deep_scrub":"266'502","last_deep_scrub_stamp":"2024-09-12T01:38:01.585337+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.585337+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:58.395669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2750,"num_read_kb":2605,"num_write":624,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'206","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.248829+0000","last_change":"2024-09-12T01:37:49.248829+0000","last_active":"2024-09-12T01:37:49.248829+0000","last_peered":"2024-09-12T01:37:49.248829+0000","last_clean":"2024-09-12T01:37:49.248829+0000","last_became_active":"2024-09-12T00:25:00.466945+0000","last_became_peered":"2024-09-12T00:25:00.466945+0000","last_unstale":"2024-09-12T01:37:49.248829+0000","last_undegraded":"2024-09-12T01:37:49.248829+0000","last_fullsized":"2024-09-12T01:37:49.248829+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T01:37:49.248703+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T01:37:49.248703+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.248703+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:28.604127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":18851,"num_write":965,"num_write_kb":35048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'499","reported_seq":2048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.776962+0000","last_change":"2024-09-12T01:37:56.776897+0000","last_active":"2024-09-12T01:37:56.776962+0000","last_peered":"2024-09-12T01:37:56.776962+0000","last_clean":"2024-09-12T01:37:56.776962+0000","last_became_active":"2024-09-12T00:25:02.475225+0000","last_became_peered":"2024-09-12T00:25:02.475225+0000","last_unstale":"2024-09-12T01:37:56.776962+0000","last_undegraded":"2024-09-12T01:37:56.776962+0000","last_fullsized":"2024-09-12T01:37:56.776962+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T01:37:56.776795+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T01:37:56.776795+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.776795+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:34.741261+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2326,"num_write":604,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":947,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'195","reported_seq":836,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.258842+0000","last_change":"2024-09-12T01:37:54.258842+0000","last_active":"2024-09-12T01:37:54.258842+0000","last_peered":"2024-09-12T01:37:54.258842+0000","last_clean":"2024-09-12T01:37:54.258842+0000","last_became_active":"2024-09-12T00:25:00.468245+0000","last_became_peered":"2024-09-12T00:25:00.468245+0000","last_unstale":"2024-09-12T01:37:54.258842+0000","last_undegraded":"2024-09-12T01:37:54.258842+0000","last_fullsized":"2024-09-12T01:37:54.258842+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'195","last_scrub_stamp":"2024-09-12T01:37:54.258714+0000","last_deep_scrub":"266'195","last_deep_scrub_stamp":"2024-09-12T01:37:54.258714+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.258714+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:03.360749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":27275,"num_write":960,"num_write_kb":19137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'529","reported_seq":2295,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.334078+0000","last_change":"2024-09-12T01:37:58.334020+0000","last_active":"2024-09-12T01:37:58.334078+0000","last_peered":"2024-09-12T01:37:58.334078+0000","last_clean":"2024-09-12T01:37:58.334078+0000","last_became_active":"2024-09-12T00:25:02.469044+0000","last_became_peered":"2024-09-12T00:25:02.469044+0000","last_unstale":"2024-09-12T01:37:58.334078+0000","last_undegraded":"2024-09-12T01:37:58.334078+0000","last_fullsized":"2024-09-12T01:37:58.334078+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'529","last_scrub_stamp":"2024-09-12T01:37:58.333929+0000","last_deep_scrub":"266'529","last_deep_scrub_stamp":"2024-09-12T01:37:58.333929+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.333929+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:57.684362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2889,"num_read_kb":2724,"num_write":624,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3030,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'185","reported_seq":818,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.658264+0000","last_change":"2024-09-12T01:37:48.658264+0000","last_active":"2024-09-12T01:37:48.658264+0000","last_peered":"2024-09-12T01:37:48.658264+0000","last_clean":"2024-09-12T01:37:48.658264+0000","last_became_active":"2024-09-12T00:25:00.487526+0000","last_became_peered":"2024-09-12T00:25:00.487526+0000","last_unstale":"2024-09-12T01:37:48.658264+0000","last_undegraded":"2024-09-12T01:37:48.658264+0000","last_fullsized":"2024-09-12T01:37:48.658264+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:48.658138+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:48.658138+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.658138+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:27.351203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306655,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":3010,"num_write":923,"num_write_kb":19090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1186","reported_seq":2787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.889719+0000","last_change":"2024-09-12T01:37:50.889645+0000","last_active":"2024-09-12T01:37:50.889719+0000","last_peered":"2024-09-12T01:37:50.889719+0000","last_clean":"2024-09-12T01:37:50.889719+0000","last_became_active":"2024-09-12T00:25:02.465257+0000","last_became_peered":"2024-09-12T00:25:02.465257+0000","last_unstale":"2024-09-12T01:37:50.889719+0000","last_undegraded":"2024-09-12T01:37:50.889719+0000","last_fullsized":"2024-09-12T01:37:50.889719+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1186","last_scrub_stamp":"2024-09-12T01:37:50.889557+0000","last_deep_scrub":"266'1186","last_deep_scrub_stamp":"2024-09-12T01:37:50.889557+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.889557+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:33.235013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5507,"num_read_kb":4876,"num_write":1621,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'262","reported_seq":918,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.605167+0000","last_change":"2024-09-12T01:37:52.605167+0000","last_active":"2024-09-12T01:37:52.605167+0000","last_peered":"2024-09-12T01:37:52.605167+0000","last_clean":"2024-09-12T01:37:52.605167+0000","last_became_active":"2024-09-12T00:25:00.469159+0000","last_became_peered":"2024-09-12T00:25:00.469159+0000","last_unstale":"2024-09-12T01:37:52.605167+0000","last_undegraded":"2024-09-12T01:37:52.605167+0000","last_fullsized":"2024-09-12T01:37:52.605167+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'262","last_scrub_stamp":"2024-09-12T01:37:52.605010+0000","last_deep_scrub":"266'262","last_deep_scrub_stamp":"2024-09-12T01:37:52.605010+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.605010+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:46.615461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":57821,"num_write":1101,"num_write_kb":41989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'489","reported_seq":1932,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.485490+0000","last_change":"2024-09-12T01:38:00.485490+0000","last_active":"2024-09-12T01:38:00.485490+0000","last_peered":"2024-09-12T01:38:00.485490+0000","last_clean":"2024-09-12T01:38:00.485490+0000","last_became_active":"2024-09-12T00:25:02.470623+0000","last_became_peered":"2024-09-12T00:25:02.470623+0000","last_unstale":"2024-09-12T01:38:00.485490+0000","last_undegraded":"2024-09-12T01:38:00.485490+0000","last_fullsized":"2024-09-12T01:38:00.485490+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'489","last_scrub_stamp":"2024-09-12T01:38:00.485373+0000","last_deep_scrub":"266'489","last_deep_scrub_stamp":"2024-09-12T01:38:00.485373+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.485373+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:54.174690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2404,"num_read_kb":2207,"num_write":594,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":704,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'242","reported_seq":915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.082986+0000","last_change":"2024-09-12T01:37:55.082986+0000","last_active":"2024-09-12T01:37:55.082986+0000","last_peered":"2024-09-12T01:37:55.082986+0000","last_clean":"2024-09-12T01:37:55.082986+0000","last_became_active":"2024-09-12T00:25:00.469918+0000","last_became_peered":"2024-09-12T00:25:00.469918+0000","last_unstale":"2024-09-12T01:37:55.082986+0000","last_undegraded":"2024-09-12T01:37:55.082986+0000","last_fullsized":"2024-09-12T01:37:55.082986+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'242","last_scrub_stamp":"2024-09-12T01:37:55.082838+0000","last_deep_scrub":"266'242","last_deep_scrub_stamp":"2024-09-12T01:37:55.082838+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.082838+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:33.200370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":488,"num_read_kb":51750,"num_write":1103,"num_write_kb":39694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'615","reported_seq":2423,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.742975+0000","last_change":"2024-09-12T01:37:53.742975+0000","last_active":"2024-09-12T01:37:53.742975+0000","last_peered":"2024-09-12T01:37:53.742975+0000","last_clean":"2024-09-12T01:37:53.742975+0000","last_became_active":"2024-09-12T00:25:02.475864+0000","last_became_peered":"2024-09-12T00:25:02.475864+0000","last_unstale":"2024-09-12T01:37:53.742975+0000","last_undegraded":"2024-09-12T01:37:53.742975+0000","last_fullsized":"2024-09-12T01:37:53.742975+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'615","last_scrub_stamp":"2024-09-12T01:37:53.742862+0000","last_deep_scrub":"266'615","last_deep_scrub_stamp":"2024-09-12T01:37:53.742862+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.742862+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:34.727742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3105,"num_read_kb":2885,"num_write":734,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":934,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'287","reported_seq":994,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.594953+0000","last_change":"2024-09-12T01:37:54.594953+0000","last_active":"2024-09-12T01:37:54.594953+0000","last_peered":"2024-09-12T01:37:54.594953+0000","last_clean":"2024-09-12T01:37:54.594953+0000","last_became_active":"2024-09-12T00:25:00.468228+0000","last_became_peered":"2024-09-12T00:25:00.468228+0000","last_unstale":"2024-09-12T01:37:54.594953+0000","last_undegraded":"2024-09-12T01:37:54.594953+0000","last_fullsized":"2024-09-12T01:37:54.594953+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'287","last_scrub_stamp":"2024-09-12T01:37:54.594827+0000","last_deep_scrub":"266'287","last_deep_scrub_stamp":"2024-09-12T01:37:54.594827+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.594827+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:15.134217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":681,"num_read_kb":67032,"num_write":1230,"num_write_kb":28377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'952","reported_seq":2525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.669075+0000","last_change":"2024-09-12T01:38:05.669075+0000","last_active":"2024-09-12T01:38:05.669075+0000","last_peered":"2024-09-12T01:38:05.669075+0000","last_clean":"2024-09-12T01:38:05.669075+0000","last_became_active":"2024-09-12T00:25:02.473441+0000","last_became_peered":"2024-09-12T00:25:02.473441+0000","last_unstale":"2024-09-12T01:38:05.669075+0000","last_undegraded":"2024-09-12T01:38:05.669075+0000","last_fullsized":"2024-09-12T01:38:05.669075+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'952","last_scrub_stamp":"2024-09-12T01:38:05.668932+0000","last_deep_scrub":"266'952","last_deep_scrub_stamp":"2024-09-12T01:38:05.668932+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.668932+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":900,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:46.937367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4462,"num_read_kb":3929,"num_write":1316,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'215","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.822790+0000","last_change":"2024-09-12T01:37:46.822790+0000","last_active":"2024-09-12T01:37:46.822790+0000","last_peered":"2024-09-12T01:37:46.822790+0000","last_clean":"2024-09-12T01:37:46.822790+0000","last_became_active":"2024-09-12T00:25:00.465127+0000","last_became_peered":"2024-09-12T00:25:00.465127+0000","last_unstale":"2024-09-12T01:37:46.822790+0000","last_undegraded":"2024-09-12T01:37:46.822790+0000","last_fullsized":"2024-09-12T01:37:46.822790+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'215","last_scrub_stamp":"2024-09-12T01:37:46.822705+0000","last_deep_scrub":"266'215","last_deep_scrub_stamp":"2024-09-12T01:37:46.822705+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.822705+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:52.870895+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":16638,"num_write":1049,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'829","reported_seq":2458,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.894009+0000","last_change":"2024-09-12T01:37:53.894009+0000","last_active":"2024-09-12T01:37:53.894009+0000","last_peered":"2024-09-12T01:37:53.894009+0000","last_clean":"2024-09-12T01:37:53.894009+0000","last_became_active":"2024-09-12T00:25:02.464386+0000","last_became_peered":"2024-09-12T00:25:02.464386+0000","last_unstale":"2024-09-12T01:37:53.894009+0000","last_undegraded":"2024-09-12T01:37:53.894009+0000","last_fullsized":"2024-09-12T01:37:53.894009+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'829","last_scrub_stamp":"2024-09-12T01:37:53.893911+0000","last_deep_scrub":"266'829","last_deep_scrub_stamp":"2024-09-12T01:37:53.893911+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.893911+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:08.882315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3522,"num_write":1059,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'166","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.385520+0000","last_change":"2024-09-12T01:37:53.385520+0000","last_active":"2024-09-12T01:37:53.385520+0000","last_peered":"2024-09-12T01:37:53.385520+0000","last_clean":"2024-09-12T01:37:53.385520+0000","last_became_active":"2024-09-12T00:25:00.465400+0000","last_became_peered":"2024-09-12T00:25:00.465400+0000","last_unstale":"2024-09-12T01:37:53.385520+0000","last_undegraded":"2024-09-12T01:37:53.385520+0000","last_fullsized":"2024-09-12T01:37:53.385520+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'166","last_scrub_stamp":"2024-09-12T01:37:53.385357+0000","last_deep_scrub":"266'166","last_deep_scrub_stamp":"2024-09-12T01:37:53.385357+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.385357+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:28.894338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":4582,"num_write":828,"num_write_kb":26519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'783","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.880976+0000","last_change":"2024-09-12T01:37:52.880976+0000","last_active":"2024-09-12T01:37:52.880976+0000","last_peered":"2024-09-12T01:37:52.880976+0000","last_clean":"2024-09-12T01:37:52.880976+0000","last_became_active":"2024-09-12T00:25:02.469046+0000","last_became_peered":"2024-09-12T00:25:02.469046+0000","last_unstale":"2024-09-12T01:37:52.880976+0000","last_undegraded":"2024-09-12T01:37:52.880976+0000","last_fullsized":"2024-09-12T01:37:52.880976+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'783","last_scrub_stamp":"2024-09-12T01:37:52.880841+0000","last_deep_scrub":"266'783","last_deep_scrub_stamp":"2024-09-12T01:37:52.880841+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.880841+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:39.288474+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3834,"num_read_kb":3478,"num_write":1008,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2140,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'208","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.906129+0000","last_change":"2024-09-12T01:37:46.906129+0000","last_active":"2024-09-12T01:37:46.906129+0000","last_peered":"2024-09-12T01:37:46.906129+0000","last_clean":"2024-09-12T01:37:46.906129+0000","last_became_active":"2024-09-12T00:25:00.468581+0000","last_became_peered":"2024-09-12T00:25:00.468581+0000","last_unstale":"2024-09-12T01:37:46.906129+0000","last_undegraded":"2024-09-12T01:37:46.906129+0000","last_fullsized":"2024-09-12T01:37:46.906129+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:37:46.906027+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:37:46.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.906027+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:01.027597+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323902,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":48643,"num_write":1011,"num_write_kb":19361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'801","reported_seq":2374,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.444482+0000","last_change":"2024-09-12T01:37:55.444482+0000","last_active":"2024-09-12T01:37:55.444482+0000","last_peered":"2024-09-12T01:37:55.444482+0000","last_clean":"2024-09-12T01:37:55.444482+0000","last_became_active":"2024-09-12T00:25:02.476825+0000","last_became_peered":"2024-09-12T00:25:02.476825+0000","last_unstale":"2024-09-12T01:37:55.444482+0000","last_undegraded":"2024-09-12T01:37:55.444482+0000","last_fullsized":"2024-09-12T01:37:55.444482+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T01:37:55.444397+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T01:37:55.444397+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.444397+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:39.143798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3888,"num_read_kb":3500,"num_write":1075,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'188","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.077782+0000","last_change":"2024-09-12T01:37:58.077782+0000","last_active":"2024-09-12T01:37:58.077782+0000","last_peered":"2024-09-12T01:37:58.077782+0000","last_clean":"2024-09-12T01:37:58.077782+0000","last_became_active":"2024-09-12T00:25:00.480122+0000","last_became_peered":"2024-09-12T00:25:00.480122+0000","last_unstale":"2024-09-12T01:37:58.077782+0000","last_undegraded":"2024-09-12T01:37:58.077782+0000","last_fullsized":"2024-09-12T01:37:58.077782+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:58.077623+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:58.077623+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.077623+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:26.959203+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399183,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":553,"num_read_kb":7914,"num_write":895,"num_write_kb":29144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'692","reported_seq":2154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.377713+0000","last_change":"2024-09-12T01:37:58.377713+0000","last_active":"2024-09-12T01:37:58.377713+0000","last_peered":"2024-09-12T01:37:58.377713+0000","last_clean":"2024-09-12T01:37:58.377713+0000","last_became_active":"2024-09-12T00:25:02.465790+0000","last_became_peered":"2024-09-12T00:25:02.465790+0000","last_unstale":"2024-09-12T01:37:58.377713+0000","last_undegraded":"2024-09-12T01:37:58.377713+0000","last_fullsized":"2024-09-12T01:37:58.377713+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'692","last_scrub_stamp":"2024-09-12T01:37:58.377612+0000","last_deep_scrub":"266'692","last_deep_scrub_stamp":"2024-09-12T01:37:58.377612+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.377612+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:21.790646+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3268,"num_read_kb":2971,"num_write":903,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'258","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.401918+0000","last_change":"2024-09-12T01:37:51.401918+0000","last_active":"2024-09-12T01:37:51.401918+0000","last_peered":"2024-09-12T01:37:51.401918+0000","last_clean":"2024-09-12T01:37:51.401918+0000","last_became_active":"2024-09-12T00:25:00.469634+0000","last_became_peered":"2024-09-12T00:25:00.469634+0000","last_unstale":"2024-09-12T01:37:51.401918+0000","last_undegraded":"2024-09-12T01:37:51.401918+0000","last_fullsized":"2024-09-12T01:37:51.401918+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'258","last_scrub_stamp":"2024-09-12T01:37:51.401778+0000","last_deep_scrub":"266'258","last_deep_scrub_stamp":"2024-09-12T01:37:51.401778+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.401778+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:00.034860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155756,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1718,"num_write":1162,"num_write_kb":27079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'436","reported_seq":2052,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.872718+0000","last_change":"2024-09-12T01:37:51.872718+0000","last_active":"2024-09-12T01:37:51.872718+0000","last_peered":"2024-09-12T01:37:51.872718+0000","last_clean":"2024-09-12T01:37:51.872718+0000","last_became_active":"2024-09-12T00:25:02.464112+0000","last_became_peered":"2024-09-12T00:25:02.464112+0000","last_unstale":"2024-09-12T01:37:51.872718+0000","last_undegraded":"2024-09-12T01:37:51.872718+0000","last_fullsized":"2024-09-12T01:37:51.872718+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'436","last_scrub_stamp":"2024-09-12T01:37:51.872608+0000","last_deep_scrub":"266'436","last_deep_scrub_stamp":"2024-09-12T01:37:51.872608+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.872608+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:01.236298+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2410,"num_read_kb":2284,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'226","reported_seq":884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.008992+0000","last_change":"2024-09-12T01:38:00.008992+0000","last_active":"2024-09-12T01:38:00.008992+0000","last_peered":"2024-09-12T01:38:00.008992+0000","last_clean":"2024-09-12T01:38:00.008992+0000","last_became_active":"2024-09-12T00:25:00.468600+0000","last_became_peered":"2024-09-12T00:25:00.468600+0000","last_unstale":"2024-09-12T01:38:00.008992+0000","last_undegraded":"2024-09-12T01:38:00.008992+0000","last_fullsized":"2024-09-12T01:38:00.008992+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:38:00.008790+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:38:00.008790+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.008790+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:56.789743+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133763,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":7263,"num_write":1147,"num_write_kb":27569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'182","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.002937+0000","last_change":"2024-09-12T01:38:01.002937+0000","last_active":"2024-09-12T01:38:01.002937+0000","last_peered":"2024-09-12T01:38:01.002937+0000","last_clean":"2024-09-12T01:38:01.002937+0000","last_became_active":"2024-09-12T00:25:00.469382+0000","last_became_peered":"2024-09-12T00:25:00.469382+0000","last_unstale":"2024-09-12T01:38:01.002937+0000","last_undegraded":"2024-09-12T01:38:01.002937+0000","last_fullsized":"2024-09-12T01:38:01.002937+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'182","last_scrub_stamp":"2024-09-12T01:38:01.002819+0000","last_deep_scrub":"266'182","last_deep_scrub_stamp":"2024-09-12T01:38:01.002819+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.002819+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:33.648707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":14411,"num_write":860,"num_write_kb":23706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'918","reported_seq":2496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.350546+0000","last_change":"2024-09-12T01:38:00.350546+0000","last_active":"2024-09-12T01:38:00.350546+0000","last_peered":"2024-09-12T01:38:00.350546+0000","last_clean":"2024-09-12T01:38:00.350546+0000","last_became_active":"2024-09-12T00:25:02.475004+0000","last_became_peered":"2024-09-12T00:25:02.475004+0000","last_unstale":"2024-09-12T01:38:00.350546+0000","last_undegraded":"2024-09-12T01:38:00.350546+0000","last_fullsized":"2024-09-12T01:38:00.350546+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'918","last_scrub_stamp":"2024-09-12T01:38:00.350456+0000","last_deep_scrub":"266'918","last_deep_scrub_stamp":"2024-09-12T01:38:00.350456+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.350456+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:25.819056+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4224,"num_read_kb":3778,"num_write":1247,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'230","reported_seq":963,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.567919+0000","last_change":"2024-09-12T01:37:55.567919+0000","last_active":"2024-09-12T01:37:55.567919+0000","last_peered":"2024-09-12T01:37:55.567919+0000","last_clean":"2024-09-12T01:37:55.567919+0000","last_became_active":"2024-09-12T00:25:00.471411+0000","last_became_peered":"2024-09-12T00:25:00.471411+0000","last_unstale":"2024-09-12T01:37:55.567919+0000","last_undegraded":"2024-09-12T01:37:55.567919+0000","last_fullsized":"2024-09-12T01:37:55.567919+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'230","last_scrub_stamp":"2024-09-12T01:37:55.567768+0000","last_deep_scrub":"266'230","last_deep_scrub_stamp":"2024-09-12T01:37:55.567768+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.567768+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:16.993814+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323861,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":157504,"num_write":954,"num_write_kb":45267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'651","reported_seq":2402,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.941466+0000","last_change":"2024-09-12T01:37:56.941466+0000","last_active":"2024-09-12T01:37:56.941466+0000","last_peered":"2024-09-12T01:37:56.941466+0000","last_clean":"2024-09-12T01:37:56.941466+0000","last_became_active":"2024-09-12T00:25:02.462993+0000","last_became_peered":"2024-09-12T00:25:02.462993+0000","last_unstale":"2024-09-12T01:37:56.941466+0000","last_undegraded":"2024-09-12T01:37:56.941466+0000","last_fullsized":"2024-09-12T01:37:56.941466+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'651","last_scrub_stamp":"2024-09-12T01:37:56.941361+0000","last_deep_scrub":"266'651","last_deep_scrub_stamp":"2024-09-12T01:37:56.941361+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.941361+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:04.170101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3586,"num_read_kb":3293,"num_write":883,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1767,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5955,"num_read_kb":4160,"num_write":1937,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7978,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1010,"ondisk_log_size":1010,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15084,"num_read_kb":14735,"num_write":16735,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2619,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1536,"ondisk_log_size":1536,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":680,"ondisk_log_size":680,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":318753,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":10187,"num_read_kb":12369,"num_write":7087,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673448,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1781,"ondisk_log_size":1781,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2373,"num_read_kb":2833,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212728,"num_read_kb":194072,"num_write":55276,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43270,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4154,"ondisk_log_size":4154,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":79547187,"num_objects":235,"num_object_clones":0,"num_object_copies":940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":235,"num_whiteouts":0,"num_read":33257,"num_read_kb":1810768,"num_write":62815,"num_write_kb":1904228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108691456,"data_stored":108691456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4112,"ondisk_log_size":4112,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":174385,"num_write":182,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":174274,"num_write":182,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477628,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145280,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94226560,"statfs":{"total":96636764160,"available":96487997440,"internally_reserved":0,"allocated":15908864,"data_stored":13922526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477626,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136056,"kb_used_data":24360,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94235784,"statfs":{"total":96636764160,"available":96497442816,"internally_reserved":0,"allocated":24944640,"data_stored":22945833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424510331,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214292,"kb_used_data":16580,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94157548,"statfs":{"total":96636764160,"available":96417329152,"internally_reserved":0,"allocated":16977920,"data_stored":14990871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510329,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106896,"kb_used_data":17408,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94264944,"statfs":{"total":96636764160,"available":96527302656,"internally_reserved":0,"allocated":17825792,"data_stored":15808424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510330,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239100,"kb_used_data":13548,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94132740,"statfs":{"total":96636764160,"available":96391925760,"internally_reserved":0,"allocated":13873152,"data_stored":11862637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510331,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253088,"kb_used_data":19216,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94118752,"statfs":{"total":96636764160,"available":96377602048,"internally_reserved":0,"allocated":19677184,"data_stored":17673901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510331,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291176,"kb_used_data":17048,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94080664,"statfs":{"total":96636764160,"available":96338599936,"internally_reserved":0,"allocated":17457152,"data_stored":15457736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575742,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188040,"kb_used_data":16696,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94183800,"statfs":{"total":96636764160,"available":96444211200,"internally_reserved":0,"allocated":17096704,"data_stored":15102370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20709376,"data_stored":20709376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12632064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11685888,"data_stored":11685888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15437824,"data_stored":15437824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12865536,"data_stored":12865536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9035776,"data_stored":9035776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13570048,"data_stored":13570048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12754944,"data_stored":12754944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:28.004 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.004 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.005 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.005 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.005 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.005 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.005 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.005 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.005 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.005 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.006 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.006 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.006 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.006 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.006 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.006 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.006 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.007 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.007 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.007 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.007 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.007 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.007 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.007 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.007 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.007 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.008 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.008 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.008 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.008 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.008 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.008 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.008 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.008 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.009 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.009 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.009 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.009 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.009 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.009 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.009 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.009 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.009 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.010 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.010 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.010 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.010 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.010 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.010 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.010 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.010 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.011 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.011 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.011 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.011 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.011 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.011 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.012 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.012 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.012 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.012 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.012 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.013 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.013 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.013 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.013 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.013 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.013 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.014 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.014 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.014 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.015 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.016 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.016 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.016 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.017 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.017 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.017 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:25:07.485754+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=7, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.017 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:25:09.500994+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=25, tm_sec=9, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:28.018 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:38:48.018 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:38:48.376 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:38:48.388 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:38:48.391 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":2483,"stamp":"2024-09-12T01:38:46.798351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80473315,"num_objects":722,"num_object_clones":0,"num_object_copies":1914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":279991,"num_read_kb":2387663,"num_write":144355,"num_write_kb":2165314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":728443,"num_omap_keys":1780,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13639,"ondisk_log_size":13639,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1573928,"kb_used_data":140392,"kb_used_omap":12,"kb_used_meta":1433395,"kb_avail":753400792,"statfs":{"total":773094113280,"available":771482411008,"internally_reserved":0,"allocated":143761408,"data_stored":127764298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1467797040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005960"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.805310+0000","last_change":"2024-09-12T01:38:21.805310+0000","last_active":"2024-09-12T01:38:21.805310+0000","last_peered":"2024-09-12T01:38:21.805310+0000","last_clean":"2024-09-12T01:38:21.805310+0000","last_became_active":"2024-09-12T01:02:03.925687+0000","last_became_peered":"2024-09-12T01:02:03.925687+0000","last_unstale":"2024-09-12T01:38:21.805310+0000","last_undegraded":"2024-09-12T01:38:21.805310+0000","last_fullsized":"2024-09-12T01:38:21.805310+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:21.805216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:21.805216+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.805216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:35.927340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.786887+0000","last_change":"2024-09-12T01:38:18.786824+0000","last_active":"2024-09-12T01:38:18.786887+0000","last_peered":"2024-09-12T01:38:18.786887+0000","last_clean":"2024-09-12T01:38:18.786887+0000","last_became_active":"2024-09-12T00:43:43.812701+0000","last_became_peered":"2024-09-12T00:43:43.812701+0000","last_unstale":"2024-09-12T01:38:18.786887+0000","last_undegraded":"2024-09-12T01:38:18.786887+0000","last_fullsized":"2024-09-12T01:38:18.786887+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:18.786735+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:18.786735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.786735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:25.075328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.653428+0000","last_change":"2024-09-12T01:38:25.653376+0000","last_active":"2024-09-12T01:38:25.653428+0000","last_peered":"2024-09-12T01:38:25.653428+0000","last_clean":"2024-09-12T01:38:25.653428+0000","last_became_active":"2024-09-12T00:43:38.799322+0000","last_became_peered":"2024-09-12T00:43:38.799322+0000","last_unstale":"2024-09-12T01:38:25.653428+0000","last_undegraded":"2024-09-12T01:38:25.653428+0000","last_fullsized":"2024-09-12T01:38:25.653428+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:25.653271+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:25.653271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.653271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:57.413192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.351537+0000","last_change":"2024-09-12T01:38:26.351537+0000","last_active":"2024-09-12T01:38:26.351537+0000","last_peered":"2024-09-12T01:38:26.351537+0000","last_clean":"2024-09-12T01:38:26.351537+0000","last_became_active":"2024-09-12T00:39:17.763761+0000","last_became_peered":"2024-09-12T00:39:17.763761+0000","last_unstale":"2024-09-12T01:38:26.351537+0000","last_undegraded":"2024-09-12T01:38:26.351537+0000","last_fullsized":"2024-09-12T01:38:26.351537+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:26.351429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:26.351429+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.351429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.772537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.559725+0000","last_change":"2024-09-12T01:38:28.559725+0000","last_active":"2024-09-12T01:38:28.559725+0000","last_peered":"2024-09-12T01:38:28.559725+0000","last_clean":"2024-09-12T01:38:28.559725+0000","last_became_active":"2024-09-12T01:02:03.925338+0000","last_became_peered":"2024-09-12T01:02:03.925338+0000","last_unstale":"2024-09-12T01:38:28.559725+0000","last_undegraded":"2024-09-12T01:38:28.559725+0000","last_fullsized":"2024-09-12T01:38:28.559725+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.559629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.559629+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.559629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:53.602786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"266'5","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.585192+0000","last_change":"2024-09-12T01:38:25.585122+0000","last_active":"2024-09-12T01:38:25.585192+0000","last_peered":"2024-09-12T01:38:25.585192+0000","last_clean":"2024-09-12T01:38:25.585192+0000","last_became_active":"2024-09-12T00:43:43.822189+0000","last_became_peered":"2024-09-12T00:43:43.822189+0000","last_unstale":"2024-09-12T01:38:25.585192+0000","last_undegraded":"2024-09-12T01:38:25.585192+0000","last_fullsized":"2024-09-12T01:38:25.585192+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:25.585035+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:25.585035+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.585035+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:23.533593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.691393+0000","last_change":"2024-09-12T01:38:29.691283+0000","last_active":"2024-09-12T01:38:29.691393+0000","last_peered":"2024-09-12T01:38:29.691393+0000","last_clean":"2024-09-12T01:38:29.691393+0000","last_became_active":"2024-09-12T00:43:38.793866+0000","last_became_peered":"2024-09-12T00:43:38.793866+0000","last_unstale":"2024-09-12T01:38:29.691393+0000","last_undegraded":"2024-09-12T01:38:29.691393+0000","last_fullsized":"2024-09-12T01:38:29.691393+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:29.691186+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:29.691186+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.691186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:34.042551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'33","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.306035+0000","last_change":"2024-09-12T01:38:25.306035+0000","last_active":"2024-09-12T01:38:25.306035+0000","last_peered":"2024-09-12T01:38:25.306035+0000","last_clean":"2024-09-12T01:38:25.306035+0000","last_became_active":"2024-09-12T00:39:17.768977+0000","last_became_peered":"2024-09-12T00:39:17.768977+0000","last_unstale":"2024-09-12T01:38:25.306035+0000","last_undegraded":"2024-09-12T01:38:25.306035+0000","last_fullsized":"2024-09-12T01:38:25.306035+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T01:38:25.305920+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T01:38:25.305920+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.305920+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:51.244315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":119,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.830116+0000","last_change":"2024-09-12T01:38:19.830116+0000","last_active":"2024-09-12T01:38:19.830116+0000","last_peered":"2024-09-12T01:38:19.830116+0000","last_clean":"2024-09-12T01:38:19.830116+0000","last_became_active":"2024-09-12T01:02:03.921938+0000","last_became_peered":"2024-09-12T01:02:03.921938+0000","last_unstale":"2024-09-12T01:38:19.830116+0000","last_undegraded":"2024-09-12T01:38:19.830116+0000","last_fullsized":"2024-09-12T01:38:19.830116+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:19.830021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:19.830021+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.830021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:30.470507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"266'6","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.768559+0000","last_change":"2024-09-12T01:38:37.768559+0000","last_active":"2024-09-12T01:38:37.768559+0000","last_peered":"2024-09-12T01:38:37.768559+0000","last_clean":"2024-09-12T01:38:37.768559+0000","last_became_active":"2024-09-12T00:43:43.813568+0000","last_became_peered":"2024-09-12T00:43:43.813568+0000","last_unstale":"2024-09-12T01:38:37.768559+0000","last_undegraded":"2024-09-12T01:38:37.768559+0000","last_fullsized":"2024-09-12T01:38:37.768559+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T01:38:37.768469+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T01:38:37.768469+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.768469+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:29.116430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7172,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'7","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.623425+0000","last_change":"2024-09-12T01:38:24.623425+0000","last_active":"2024-09-12T01:38:24.623425+0000","last_peered":"2024-09-12T01:38:24.623425+0000","last_clean":"2024-09-12T01:38:24.623425+0000","last_became_active":"2024-09-12T00:43:38.797520+0000","last_became_peered":"2024-09-12T00:43:38.797520+0000","last_unstale":"2024-09-12T01:38:24.623425+0000","last_undegraded":"2024-09-12T01:38:24.623425+0000","last_fullsized":"2024-09-12T01:38:24.623425+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T01:38:24.623344+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T01:38:24.623344+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.623344+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:12.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16390,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'41","reported_seq":179,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.446692+0000","last_change":"2024-09-12T01:38:20.446692+0000","last_active":"2024-09-12T01:38:20.446692+0000","last_peered":"2024-09-12T01:38:20.446692+0000","last_clean":"2024-09-12T01:38:20.446692+0000","last_became_active":"2024-09-12T00:39:17.768692+0000","last_became_peered":"2024-09-12T00:39:17.768692+0000","last_unstale":"2024-09-12T01:38:20.446692+0000","last_undegraded":"2024-09-12T01:38:20.446692+0000","last_fullsized":"2024-09-12T01:38:20.446692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:38:20.446587+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:38:20.446587+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.446587+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:25.292094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":161,"num_write":65,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:04.011321+0000","last_change":"2024-09-12T01:02:03.922647+0000","last_active":"2024-09-12T01:36:04.011321+0000","last_peered":"2024-09-12T01:36:04.011321+0000","last_clean":"2024-09-12T01:36:04.011321+0000","last_became_active":"2024-09-12T01:02:03.922297+0000","last_became_peered":"2024-09-12T01:02:03.922297+0000","last_unstale":"2024-09-12T01:36:04.011321+0000","last_undegraded":"2024-09-12T01:36:04.011321+0000","last_fullsized":"2024-09-12T01:36:04.011321+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.779536+0000","last_change":"2024-09-12T01:38:36.779536+0000","last_active":"2024-09-12T01:38:36.779536+0000","last_peered":"2024-09-12T01:38:36.779536+0000","last_clean":"2024-09-12T01:38:36.779536+0000","last_became_active":"2024-09-12T00:43:43.818668+0000","last_became_peered":"2024-09-12T00:43:43.818668+0000","last_unstale":"2024-09-12T01:38:36.779536+0000","last_undegraded":"2024-09-12T01:38:36.779536+0000","last_fullsized":"2024-09-12T01:38:36.779536+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:36.779426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:36.779426+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.779426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:00.142878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.800578+0000","last_change":"2024-09-12T01:38:16.800578+0000","last_active":"2024-09-12T01:38:16.800578+0000","last_peered":"2024-09-12T01:38:16.800578+0000","last_clean":"2024-09-12T01:38:16.800578+0000","last_became_active":"2024-09-12T00:43:38.794121+0000","last_became_peered":"2024-09-12T00:43:38.794121+0000","last_unstale":"2024-09-12T01:38:16.800578+0000","last_undegraded":"2024-09-12T01:38:16.800578+0000","last_fullsized":"2024-09-12T01:38:16.800578+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.800478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.800478+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.800478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:59.159347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'16","reported_seq":101,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.479563+0000","last_change":"2024-09-12T01:38:19.479563+0000","last_active":"2024-09-12T01:38:19.479563+0000","last_peered":"2024-09-12T01:38:19.479563+0000","last_clean":"2024-09-12T01:38:19.479563+0000","last_became_active":"2024-09-12T00:39:17.759016+0000","last_became_peered":"2024-09-12T00:39:17.759016+0000","last_unstale":"2024-09-12T01:38:19.479563+0000","last_undegraded":"2024-09-12T01:38:19.479563+0000","last_fullsized":"2024-09-12T01:38:19.479563+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-12T01:38:19.479475+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-12T01:38:19.479475+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.479475+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:07.899876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.692849+0000","last_change":"2024-09-12T01:38:34.692849+0000","last_active":"2024-09-12T01:38:34.692849+0000","last_peered":"2024-09-12T01:38:34.692849+0000","last_clean":"2024-09-12T01:38:34.692849+0000","last_became_active":"2024-09-12T01:02:03.919293+0000","last_became_peered":"2024-09-12T01:02:03.919293+0000","last_unstale":"2024-09-12T01:38:34.692849+0000","last_undegraded":"2024-09-12T01:38:34.692849+0000","last_fullsized":"2024-09-12T01:38:34.692849+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.692743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.692743+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.692743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:45.590739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.732052+0000","last_change":"2024-09-12T01:38:15.732052+0000","last_active":"2024-09-12T01:38:15.732052+0000","last_peered":"2024-09-12T01:38:15.732052+0000","last_clean":"2024-09-12T01:38:15.732052+0000","last_became_active":"2024-09-12T00:43:43.817714+0000","last_became_peered":"2024-09-12T00:43:43.817714+0000","last_unstale":"2024-09-12T01:38:15.732052+0000","last_undegraded":"2024-09-12T01:38:15.732052+0000","last_fullsized":"2024-09-12T01:38:15.732052+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:15.731960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:15.731960+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.731960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:50.516937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'15","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.670852+0000","last_change":"2024-09-12T01:38:28.670852+0000","last_active":"2024-09-12T01:38:28.670852+0000","last_peered":"2024-09-12T01:38:28.670852+0000","last_clean":"2024-09-12T01:38:28.670852+0000","last_became_active":"2024-09-12T00:43:38.795206+0000","last_became_peered":"2024-09-12T00:43:38.795206+0000","last_unstale":"2024-09-12T01:38:28.670852+0000","last_undegraded":"2024-09-12T01:38:28.670852+0000","last_fullsized":"2024-09-12T01:38:28.670852+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'15","last_scrub_stamp":"2024-09-12T01:38:28.670766+0000","last_deep_scrub":"266'15","last_deep_scrub_stamp":"2024-09-12T01:38:28.670766+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.670766+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:51.434106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":29708,"num_write":20,"num_write_kb":14332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'31","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.453395+0000","last_change":"2024-09-12T01:38:18.453395+0000","last_active":"2024-09-12T01:38:18.453395+0000","last_peered":"2024-09-12T01:38:18.453395+0000","last_clean":"2024-09-12T01:38:18.453395+0000","last_became_active":"2024-09-12T00:39:17.762124+0000","last_became_peered":"2024-09-12T00:39:17.762124+0000","last_unstale":"2024-09-12T01:38:18.453395+0000","last_undegraded":"2024-09-12T01:38:18.453395+0000","last_fullsized":"2024-09-12T01:38:18.453395+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'31","last_scrub_stamp":"2024-09-12T01:38:18.453318+0000","last_deep_scrub":"266'31","last_deep_scrub_stamp":"2024-09-12T01:38:18.453318+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.453318+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:29.847076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.411249+0000","last_change":"2024-09-12T01:38:31.411249+0000","last_active":"2024-09-12T01:38:31.411249+0000","last_peered":"2024-09-12T01:38:31.411249+0000","last_clean":"2024-09-12T01:38:31.411249+0000","last_became_active":"2024-09-12T01:02:03.915387+0000","last_became_peered":"2024-09-12T01:02:03.915387+0000","last_unstale":"2024-09-12T01:38:31.411249+0000","last_undegraded":"2024-09-12T01:38:31.411249+0000","last_fullsized":"2024-09-12T01:38:31.411249+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.411159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.411159+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.411159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:59.301258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:29.529511+0000","last_change":"2024-09-12T00:43:43.825343+0000","last_active":"2024-09-12T01:34:29.529511+0000","last_peered":"2024-09-12T01:34:29.529511+0000","last_clean":"2024-09-12T01:34:29.529511+0000","last_became_active":"2024-09-12T00:43:43.825054+0000","last_became_peered":"2024-09-12T00:43:43.825054+0000","last_unstale":"2024-09-12T01:34:29.529511+0000","last_undegraded":"2024-09-12T01:34:29.529511+0000","last_fullsized":"2024-09-12T01:34:29.529511+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:57.949570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:36:54.547748+0000","last_change":"2024-09-12T00:43:38.794955+0000","last_active":"2024-09-12T01:36:54.547748+0000","last_peered":"2024-09-12T01:36:54.547748+0000","last_clean":"2024-09-12T01:36:54.547748+0000","last_became_active":"2024-09-12T00:43:38.794612+0000","last_became_peered":"2024-09-12T00:43:38.794612+0000","last_unstale":"2024-09-12T01:36:54.547748+0000","last_undegraded":"2024-09-12T01:36:54.547748+0000","last_fullsized":"2024-09-12T01:36:54.547748+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:37.770139+0000","last_clean_scrub_stamp":"2024-09-12T00:43:37.770139+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:55.593800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'16","reported_seq":100,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.519607+0000","last_change":"2024-09-12T01:38:20.519607+0000","last_active":"2024-09-12T01:38:20.519607+0000","last_peered":"2024-09-12T01:38:20.519607+0000","last_clean":"2024-09-12T01:38:20.519607+0000","last_became_active":"2024-09-12T00:39:17.771839+0000","last_became_peered":"2024-09-12T00:39:17.771839+0000","last_unstale":"2024-09-12T01:38:20.519607+0000","last_undegraded":"2024-09-12T01:38:20.519607+0000","last_fullsized":"2024-09-12T01:38:20.519607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'16","last_scrub_stamp":"2024-09-12T01:38:20.519518+0000","last_deep_scrub":"266'16","last_deep_scrub_stamp":"2024-09-12T01:38:20.519518+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.519518+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:51.296931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":43,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'2","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.534682+0000","last_change":"2024-09-12T01:38:28.534682+0000","last_active":"2024-09-12T01:38:28.534682+0000","last_peered":"2024-09-12T01:38:28.534682+0000","last_clean":"2024-09-12T01:38:28.534682+0000","last_became_active":"2024-09-12T01:02:03.928036+0000","last_became_peered":"2024-09-12T01:02:03.928036+0000","last_unstale":"2024-09-12T01:38:28.534682+0000","last_undegraded":"2024-09-12T01:38:28.534682+0000","last_fullsized":"2024-09-12T01:38:28.534682+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:28.534599+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:28.534599+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.534599+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:07.555874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.544592+0000","last_change":"2024-09-12T01:38:24.544523+0000","last_active":"2024-09-12T01:38:24.544592+0000","last_peered":"2024-09-12T01:38:24.544592+0000","last_clean":"2024-09-12T01:38:24.544592+0000","last_became_active":"2024-09-12T00:43:43.819239+0000","last_became_peered":"2024-09-12T00:43:43.819239+0000","last_unstale":"2024-09-12T01:38:24.544592+0000","last_undegraded":"2024-09-12T01:38:24.544592+0000","last_fullsized":"2024-09-12T01:38:24.544592+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T01:38:24.544436+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T01:38:24.544436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.544436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:00.709590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8210,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"266'10","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.776460+0000","last_change":"2024-09-12T01:38:14.776399+0000","last_active":"2024-09-12T01:38:14.776460+0000","last_peered":"2024-09-12T01:38:14.776460+0000","last_clean":"2024-09-12T01:38:14.776460+0000","last_became_active":"2024-09-12T00:43:38.784746+0000","last_became_peered":"2024-09-12T00:43:38.784746+0000","last_unstale":"2024-09-12T01:38:14.776460+0000","last_undegraded":"2024-09-12T01:38:14.776460+0000","last_fullsized":"2024-09-12T01:38:14.776460+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T01:38:14.776310+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T01:38:14.776310+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.776310+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:21.911864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"257'30","reported_seq":151,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.627333+0000","last_change":"2024-09-12T01:38:17.627333+0000","last_active":"2024-09-12T01:38:17.627333+0000","last_peered":"2024-09-12T01:38:17.627333+0000","last_clean":"2024-09-12T01:38:17.627333+0000","last_became_active":"2024-09-12T00:39:17.764658+0000","last_became_peered":"2024-09-12T00:39:17.764658+0000","last_unstale":"2024-09-12T01:38:17.627333+0000","last_undegraded":"2024-09-12T01:38:17.627333+0000","last_fullsized":"2024-09-12T01:38:17.627333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'30","last_scrub_stamp":"2024-09-12T01:38:17.627235+0000","last_deep_scrub":"257'30","last_deep_scrub_stamp":"2024-09-12T01:38:17.627235+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.627235+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:49.790642+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":139,"num_write":41,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.785618+0000","last_change":"2024-09-12T01:38:22.785618+0000","last_active":"2024-09-12T01:38:22.785618+0000","last_peered":"2024-09-12T01:38:22.785618+0000","last_clean":"2024-09-12T01:38:22.785618+0000","last_became_active":"2024-09-12T01:02:03.917362+0000","last_became_peered":"2024-09-12T01:02:03.917362+0000","last_unstale":"2024-09-12T01:38:22.785618+0000","last_undegraded":"2024-09-12T01:38:22.785618+0000","last_fullsized":"2024-09-12T01:38:22.785618+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.785529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.785529+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.785529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:28.459935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"266'8","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.692079+0000","last_change":"2024-09-12T01:38:31.691980+0000","last_active":"2024-09-12T01:38:31.692079+0000","last_peered":"2024-09-12T01:38:31.692079+0000","last_clean":"2024-09-12T01:38:31.692079+0000","last_became_active":"2024-09-12T00:43:43.822574+0000","last_became_peered":"2024-09-12T00:43:43.822574+0000","last_unstale":"2024-09-12T01:38:31.692079+0000","last_undegraded":"2024-09-12T01:38:31.692079+0000","last_fullsized":"2024-09-12T01:38:31.692079+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'8","last_scrub_stamp":"2024-09-12T01:38:31.691880+0000","last_deep_scrub":"266'8","last_deep_scrub_stamp":"2024-09-12T01:38:31.691880+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.691880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:48.567611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9228,"num_write":8,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.528282+0000","last_change":"2024-09-12T01:38:22.528218+0000","last_active":"2024-09-12T01:38:22.528282+0000","last_peered":"2024-09-12T01:38:22.528282+0000","last_clean":"2024-09-12T01:38:22.528282+0000","last_became_active":"2024-09-12T00:43:38.799567+0000","last_became_peered":"2024-09-12T00:43:38.799567+0000","last_unstale":"2024-09-12T01:38:22.528282+0000","last_undegraded":"2024-09-12T01:38:22.528282+0000","last_fullsized":"2024-09-12T01:38:22.528282+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:22.528132+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:22.528132+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.528132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:58.801800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'52","reported_seq":204,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.404113+0000","last_change":"2024-09-12T01:38:17.404113+0000","last_active":"2024-09-12T01:38:17.404113+0000","last_peered":"2024-09-12T01:38:17.404113+0000","last_clean":"2024-09-12T01:38:17.404113+0000","last_became_active":"2024-09-12T00:39:17.760735+0000","last_became_peered":"2024-09-12T00:39:17.760735+0000","last_unstale":"2024-09-12T01:38:17.404113+0000","last_undegraded":"2024-09-12T01:38:17.404113+0000","last_fullsized":"2024-09-12T01:38:17.404113+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'52","last_scrub_stamp":"2024-09-12T01:38:17.404030+0000","last_deep_scrub":"266'52","last_deep_scrub_stamp":"2024-09-12T01:38:17.404030+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.404030+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:24.515267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":192,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.831519+0000","last_change":"2024-09-12T01:38:42.831519+0000","last_active":"2024-09-12T01:38:42.831519+0000","last_peered":"2024-09-12T01:38:42.831519+0000","last_clean":"2024-09-12T01:38:42.831519+0000","last_became_active":"2024-09-12T01:02:03.924800+0000","last_became_peered":"2024-09-12T01:02:03.924800+0000","last_unstale":"2024-09-12T01:38:42.831519+0000","last_undegraded":"2024-09-12T01:38:42.831519+0000","last_fullsized":"2024-09-12T01:38:42.831519+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:42.831432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:42.831432+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.831432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:52.296885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.724564+0000","last_change":"2024-09-12T01:38:35.724564+0000","last_active":"2024-09-12T01:38:35.724564+0000","last_peered":"2024-09-12T01:38:35.724564+0000","last_clean":"2024-09-12T01:38:35.724564+0000","last_became_active":"2024-09-12T00:43:43.822130+0000","last_became_peered":"2024-09-12T00:43:43.822130+0000","last_unstale":"2024-09-12T01:38:35.724564+0000","last_undegraded":"2024-09-12T01:38:35.724564+0000","last_fullsized":"2024-09-12T01:38:35.724564+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.724479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.724479+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.724479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:00.962758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.122389+0000","last_change":"2024-09-12T01:38:44.122389+0000","last_active":"2024-09-12T01:38:44.122389+0000","last_peered":"2024-09-12T01:38:44.122389+0000","last_clean":"2024-09-12T01:38:44.122389+0000","last_became_active":"2024-09-12T00:43:38.789198+0000","last_became_peered":"2024-09-12T00:43:38.789198+0000","last_unstale":"2024-09-12T01:38:44.122389+0000","last_undegraded":"2024-09-12T01:38:44.122389+0000","last_fullsized":"2024-09-12T01:38:44.122389+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:44.122298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:44.122298+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.122298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:44.340207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'15","reported_seq":105,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.333313+0000","last_change":"2024-09-12T01:38:24.333313+0000","last_active":"2024-09-12T01:38:24.333313+0000","last_peered":"2024-09-12T01:38:24.333313+0000","last_clean":"2024-09-12T01:38:24.333313+0000","last_became_active":"2024-09-12T00:39:17.767662+0000","last_became_peered":"2024-09-12T00:39:17.767662+0000","last_unstale":"2024-09-12T01:38:24.333313+0000","last_undegraded":"2024-09-12T01:38:24.333313+0000","last_fullsized":"2024-09-12T01:38:24.333313+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'15","last_scrub_stamp":"2024-09-12T01:38:24.333221+0000","last_deep_scrub":"266'15","last_deep_scrub_stamp":"2024-09-12T01:38:24.333221+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.333221+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:32.331840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'2","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.564727+0000","last_change":"2024-09-12T01:38:25.564727+0000","last_active":"2024-09-12T01:38:25.564727+0000","last_peered":"2024-09-12T01:38:25.564727+0000","last_clean":"2024-09-12T01:38:25.564727+0000","last_became_active":"2024-09-12T01:02:03.924303+0000","last_became_peered":"2024-09-12T01:02:03.924303+0000","last_unstale":"2024-09-12T01:38:25.564727+0000","last_undegraded":"2024-09-12T01:38:25.564727+0000","last_fullsized":"2024-09-12T01:38:25.564727+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:25.564609+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:25.564609+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.564609+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:41.068482+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'9","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.747212+0000","last_change":"2024-09-12T01:38:35.747212+0000","last_active":"2024-09-12T01:38:35.747212+0000","last_peered":"2024-09-12T01:38:35.747212+0000","last_clean":"2024-09-12T01:38:35.747212+0000","last_became_active":"2024-09-12T00:43:43.819058+0000","last_became_peered":"2024-09-12T00:43:43.819058+0000","last_unstale":"2024-09-12T01:38:35.747212+0000","last_undegraded":"2024-09-12T01:38:35.747212+0000","last_fullsized":"2024-09-12T01:38:35.747212+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T01:38:35.747130+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T01:38:35.747130+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.747130+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:01.602606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9222,"num_write":14,"num_write_kb":9222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"266'8","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.796535+0000","last_change":"2024-09-12T01:38:11.796535+0000","last_active":"2024-09-12T01:38:11.796535+0000","last_peered":"2024-09-12T01:38:11.796535+0000","last_clean":"2024-09-12T01:38:11.796535+0000","last_became_active":"2024-09-12T00:43:38.796426+0000","last_became_peered":"2024-09-12T00:43:38.796426+0000","last_unstale":"2024-09-12T01:38:11.796535+0000","last_undegraded":"2024-09-12T01:38:11.796535+0000","last_fullsized":"2024-09-12T01:38:11.796535+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'8","last_scrub_stamp":"2024-09-12T01:38:11.796424+0000","last_deep_scrub":"266'8","last_deep_scrub_stamp":"2024-09-12T01:38:11.796424+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.796424+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:18.250788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9226,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":189,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.373291+0000","last_change":"2024-09-12T01:38:23.373291+0000","last_active":"2024-09-12T01:38:23.373291+0000","last_peered":"2024-09-12T01:38:23.373291+0000","last_clean":"2024-09-12T01:38:23.373291+0000","last_became_active":"2024-09-12T00:39:17.767088+0000","last_became_peered":"2024-09-12T00:39:17.767088+0000","last_unstale":"2024-09-12T01:38:23.373291+0000","last_undegraded":"2024-09-12T01:38:23.373291+0000","last_fullsized":"2024-09-12T01:38:23.373291+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'46","last_scrub_stamp":"2024-09-12T01:38:23.373200+0000","last_deep_scrub":"266'46","last_deep_scrub_stamp":"2024-09-12T01:38:23.373200+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.373200+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:20.765820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.548716+0000","last_change":"2024-09-12T01:38:27.548716+0000","last_active":"2024-09-12T01:38:27.548716+0000","last_peered":"2024-09-12T01:38:27.548716+0000","last_clean":"2024-09-12T01:38:27.548716+0000","last_became_active":"2024-09-12T01:02:03.925482+0000","last_became_peered":"2024-09-12T01:02:03.925482+0000","last_unstale":"2024-09-12T01:38:27.548716+0000","last_undegraded":"2024-09-12T01:38:27.548716+0000","last_fullsized":"2024-09-12T01:38:27.548716+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.548612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.548612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.548612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:03.482492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.710424+0000","last_change":"2024-09-12T01:38:30.710424+0000","last_active":"2024-09-12T01:38:30.710424+0000","last_peered":"2024-09-12T01:38:30.710424+0000","last_clean":"2024-09-12T01:38:30.710424+0000","last_became_active":"2024-09-12T00:43:43.820272+0000","last_became_peered":"2024-09-12T00:43:43.820272+0000","last_unstale":"2024-09-12T01:38:30.710424+0000","last_undegraded":"2024-09-12T01:38:30.710424+0000","last_fullsized":"2024-09-12T01:38:30.710424+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:30.710333+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:30.710333+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.710333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:30.438823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'6","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.653601+0000","last_change":"2024-09-12T01:38:23.653601+0000","last_active":"2024-09-12T01:38:23.653601+0000","last_peered":"2024-09-12T01:38:23.653601+0000","last_clean":"2024-09-12T01:38:23.653601+0000","last_became_active":"2024-09-12T00:43:38.799719+0000","last_became_peered":"2024-09-12T00:43:38.799719+0000","last_unstale":"2024-09-12T01:38:23.653601+0000","last_undegraded":"2024-09-12T01:38:23.653601+0000","last_fullsized":"2024-09-12T01:38:23.653601+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T01:38:23.653489+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T01:38:23.653489+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.653489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:28.594858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20462,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'32","reported_seq":146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.668388+0000","last_change":"2024-09-12T01:38:18.668388+0000","last_active":"2024-09-12T01:38:18.668388+0000","last_peered":"2024-09-12T01:38:18.668388+0000","last_clean":"2024-09-12T01:38:18.668388+0000","last_became_active":"2024-09-12T00:39:17.762639+0000","last_became_peered":"2024-09-12T00:39:17.762639+0000","last_unstale":"2024-09-12T01:38:18.668388+0000","last_undegraded":"2024-09-12T01:38:18.668388+0000","last_fullsized":"2024-09-12T01:38:18.668388+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'32","last_scrub_stamp":"2024-09-12T01:38:18.668295+0000","last_deep_scrub":"266'32","last_deep_scrub_stamp":"2024-09-12T01:38:18.668295+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.668295+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:26.791956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.762492+0000","last_change":"2024-09-12T01:38:20.762492+0000","last_active":"2024-09-12T01:38:20.762492+0000","last_peered":"2024-09-12T01:38:20.762492+0000","last_clean":"2024-09-12T01:38:20.762492+0000","last_became_active":"2024-09-12T01:02:03.924892+0000","last_became_peered":"2024-09-12T01:02:03.924892+0000","last_unstale":"2024-09-12T01:38:20.762492+0000","last_undegraded":"2024-09-12T01:38:20.762492+0000","last_fullsized":"2024-09-12T01:38:20.762492+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:20.762384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:20.762384+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.762384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:19.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'4","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.775044+0000","last_change":"2024-09-12T01:38:16.775044+0000","last_active":"2024-09-12T01:38:16.775044+0000","last_peered":"2024-09-12T01:38:16.775044+0000","last_clean":"2024-09-12T01:38:16.775044+0000","last_became_active":"2024-09-12T00:43:43.819431+0000","last_became_peered":"2024-09-12T00:43:43.819431+0000","last_unstale":"2024-09-12T01:38:16.775044+0000","last_undegraded":"2024-09-12T01:38:16.775044+0000","last_fullsized":"2024-09-12T01:38:16.775044+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:16.774960+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:16.774960+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.774960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:08.495839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"266'3","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.709702+0000","last_change":"2024-09-12T01:38:27.709702+0000","last_active":"2024-09-12T01:38:27.709702+0000","last_peered":"2024-09-12T01:38:27.709702+0000","last_clean":"2024-09-12T01:38:27.709702+0000","last_became_active":"2024-09-12T00:43:38.796894+0000","last_became_peered":"2024-09-12T00:43:38.796894+0000","last_unstale":"2024-09-12T01:38:27.709702+0000","last_undegraded":"2024-09-12T01:38:27.709702+0000","last_fullsized":"2024-09-12T01:38:27.709702+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:38:27.709616+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:38:27.709616+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.709616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:41.316461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'47","reported_seq":190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.986156+0000","last_change":"2024-09-12T01:38:34.986156+0000","last_active":"2024-09-12T01:38:34.986156+0000","last_peered":"2024-09-12T01:38:34.986156+0000","last_clean":"2024-09-12T01:38:34.986156+0000","last_became_active":"2024-09-12T00:39:17.761972+0000","last_became_peered":"2024-09-12T00:39:17.761972+0000","last_unstale":"2024-09-12T01:38:34.986156+0000","last_undegraded":"2024-09-12T01:38:34.986156+0000","last_fullsized":"2024-09-12T01:38:34.986156+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'47","last_scrub_stamp":"2024-09-12T01:38:34.986063+0000","last_deep_scrub":"266'47","last_deep_scrub_stamp":"2024-09-12T01:38:34.986063+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.986063+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:28.554751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":165,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.815023+0000","last_change":"2024-09-12T01:38:43.815023+0000","last_active":"2024-09-12T01:38:43.815023+0000","last_peered":"2024-09-12T01:38:43.815023+0000","last_clean":"2024-09-12T01:38:43.815023+0000","last_became_active":"2024-09-12T01:02:03.923464+0000","last_became_peered":"2024-09-12T01:02:03.923464+0000","last_unstale":"2024-09-12T01:38:43.815023+0000","last_undegraded":"2024-09-12T01:38:43.815023+0000","last_fullsized":"2024-09-12T01:38:43.815023+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:43.814919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:43.814919+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.814919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:29.136159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'11","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.711444+0000","last_change":"2024-09-12T01:38:34.711444+0000","last_active":"2024-09-12T01:38:34.711444+0000","last_peered":"2024-09-12T01:38:34.711444+0000","last_clean":"2024-09-12T01:38:34.711444+0000","last_became_active":"2024-09-12T00:43:43.817990+0000","last_became_peered":"2024-09-12T00:43:43.817990+0000","last_unstale":"2024-09-12T01:38:34.711444+0000","last_undegraded":"2024-09-12T01:38:34.711444+0000","last_fullsized":"2024-09-12T01:38:34.711444+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'11","last_scrub_stamp":"2024-09-12T01:38:34.711364+0000","last_deep_scrub":"266'11","last_deep_scrub_stamp":"2024-09-12T01:38:34.711364+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.711364+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:26.219791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14448,"num_write":16,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"266'2","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.870588+0000","last_change":"2024-09-12T01:38:21.870588+0000","last_active":"2024-09-12T01:38:21.870588+0000","last_peered":"2024-09-12T01:38:21.870588+0000","last_clean":"2024-09-12T01:38:21.870588+0000","last_became_active":"2024-09-12T00:43:38.793825+0000","last_became_peered":"2024-09-12T00:43:38.793825+0000","last_unstale":"2024-09-12T01:38:21.870588+0000","last_undegraded":"2024-09-12T01:38:21.870588+0000","last_fullsized":"2024-09-12T01:38:21.870588+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:21.870463+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:21.870463+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.870463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:20.910427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'20","reported_seq":119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.959826+0000","last_change":"2024-09-12T01:38:35.959826+0000","last_active":"2024-09-12T01:38:35.959826+0000","last_peered":"2024-09-12T01:38:35.959826+0000","last_clean":"2024-09-12T01:38:35.959826+0000","last_became_active":"2024-09-12T00:39:17.769263+0000","last_became_peered":"2024-09-12T00:39:17.769263+0000","last_unstale":"2024-09-12T01:38:35.959826+0000","last_undegraded":"2024-09-12T01:38:35.959826+0000","last_fullsized":"2024-09-12T01:38:35.959826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'20","last_scrub_stamp":"2024-09-12T01:38:35.959736+0000","last_deep_scrub":"266'20","last_deep_scrub_stamp":"2024-09-12T01:38:35.959736+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.959736+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:42.104077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.547821+0000","last_change":"2024-09-12T01:38:26.547821+0000","last_active":"2024-09-12T01:38:26.547821+0000","last_peered":"2024-09-12T01:38:26.547821+0000","last_clean":"2024-09-12T01:38:26.547821+0000","last_became_active":"2024-09-12T01:02:03.924260+0000","last_became_peered":"2024-09-12T01:02:03.924260+0000","last_unstale":"2024-09-12T01:38:26.547821+0000","last_undegraded":"2024-09-12T01:38:26.547821+0000","last_fullsized":"2024-09-12T01:38:26.547821+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:26.547703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:26.547703+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.547703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:35.224610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"266'3","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.732164+0000","last_change":"2024-09-12T01:38:33.732164+0000","last_active":"2024-09-12T01:38:33.732164+0000","last_peered":"2024-09-12T01:38:33.732164+0000","last_clean":"2024-09-12T01:38:33.732164+0000","last_became_active":"2024-09-12T00:43:43.824567+0000","last_became_peered":"2024-09-12T00:43:43.824567+0000","last_unstale":"2024-09-12T01:38:33.732164+0000","last_undegraded":"2024-09-12T01:38:33.732164+0000","last_fullsized":"2024-09-12T01:38:33.732164+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:38:33.732084+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:38:33.732084+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.732084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:33.936391+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"266'5","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.744335+0000","last_change":"2024-09-12T01:38:26.744335+0000","last_active":"2024-09-12T01:38:26.744335+0000","last_peered":"2024-09-12T01:38:26.744335+0000","last_clean":"2024-09-12T01:38:26.744335+0000","last_became_active":"2024-09-12T00:43:38.798200+0000","last_became_peered":"2024-09-12T00:43:38.798200+0000","last_unstale":"2024-09-12T01:38:26.744335+0000","last_undegraded":"2024-09-12T01:38:26.744335+0000","last_fullsized":"2024-09-12T01:38:26.744335+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:26.744259+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:26.744259+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.744259+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:10.712076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"266'30","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.595596+0000","last_change":"2024-09-12T01:38:16.595596+0000","last_active":"2024-09-12T01:38:16.595596+0000","last_peered":"2024-09-12T01:38:16.595596+0000","last_clean":"2024-09-12T01:38:16.595596+0000","last_became_active":"2024-09-12T00:39:17.766600+0000","last_became_peered":"2024-09-12T00:39:17.766600+0000","last_unstale":"2024-09-12T01:38:16.595596+0000","last_undegraded":"2024-09-12T01:38:16.595596+0000","last_fullsized":"2024-09-12T01:38:16.595596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'30","last_scrub_stamp":"2024-09-12T01:38:16.595514+0000","last_deep_scrub":"266'30","last_deep_scrub_stamp":"2024-09-12T01:38:16.595514+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.595514+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:59.336815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":112,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'2","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.417034+0000","last_change":"2024-09-12T01:38:30.417034+0000","last_active":"2024-09-12T01:38:30.417034+0000","last_peered":"2024-09-12T01:38:30.417034+0000","last_clean":"2024-09-12T01:38:30.417034+0000","last_became_active":"2024-09-12T01:02:03.919377+0000","last_became_peered":"2024-09-12T01:02:03.919377+0000","last_unstale":"2024-09-12T01:38:30.417034+0000","last_undegraded":"2024-09-12T01:38:30.417034+0000","last_fullsized":"2024-09-12T01:38:30.417034+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:30.416946+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:30.416946+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.416946+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:28.682962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.673676+0000","last_change":"2024-09-12T01:38:29.673676+0000","last_active":"2024-09-12T01:38:29.673676+0000","last_peered":"2024-09-12T01:38:29.673676+0000","last_clean":"2024-09-12T01:38:29.673676+0000","last_became_active":"2024-09-12T00:43:43.818153+0000","last_became_peered":"2024-09-12T00:43:43.818153+0000","last_unstale":"2024-09-12T01:38:29.673676+0000","last_undegraded":"2024-09-12T01:38:29.673676+0000","last_fullsized":"2024-09-12T01:38:29.673676+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.673582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.673582+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.673582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:21.169336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'6","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.838737+0000","last_change":"2024-09-12T01:38:15.838737+0000","last_active":"2024-09-12T01:38:15.838737+0000","last_peered":"2024-09-12T01:38:15.838737+0000","last_clean":"2024-09-12T01:38:15.838737+0000","last_became_active":"2024-09-12T00:43:38.792135+0000","last_became_peered":"2024-09-12T00:43:38.792135+0000","last_unstale":"2024-09-12T01:38:15.838737+0000","last_undegraded":"2024-09-12T01:38:15.838737+0000","last_fullsized":"2024-09-12T01:38:15.838737+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T01:38:15.838637+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T01:38:15.838637+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.838637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:44.060727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8232,"num_write":6,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"266'12","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.545660+0000","last_change":"2024-09-12T01:38:19.545660+0000","last_active":"2024-09-12T01:38:19.545660+0000","last_peered":"2024-09-12T01:38:19.545660+0000","last_clean":"2024-09-12T01:38:19.545660+0000","last_became_active":"2024-09-12T00:39:17.767599+0000","last_became_peered":"2024-09-12T00:39:17.767599+0000","last_unstale":"2024-09-12T01:38:19.545660+0000","last_undegraded":"2024-09-12T01:38:19.545660+0000","last_fullsized":"2024-09-12T01:38:19.545660+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'12","last_scrub_stamp":"2024-09-12T01:38:19.545579+0000","last_deep_scrub":"266'12","last_deep_scrub_stamp":"2024-09-12T01:38:19.545579+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.545579+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:39.128051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'2","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.579509+0000","last_change":"2024-09-12T01:38:27.579509+0000","last_active":"2024-09-12T01:38:27.579509+0000","last_peered":"2024-09-12T01:38:27.579509+0000","last_clean":"2024-09-12T01:38:27.579509+0000","last_became_active":"2024-09-12T01:02:03.918248+0000","last_became_peered":"2024-09-12T01:02:03.918248+0000","last_unstale":"2024-09-12T01:38:27.579509+0000","last_undegraded":"2024-09-12T01:38:27.579509+0000","last_fullsized":"2024-09-12T01:38:27.579509+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:27.579381+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:27.579381+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.579381+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:26.100306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.177242+0000","last_change":"2024-09-12T01:38:42.177242+0000","last_active":"2024-09-12T01:38:42.177242+0000","last_peered":"2024-09-12T01:38:42.177242+0000","last_clean":"2024-09-12T01:38:42.177242+0000","last_became_active":"2024-09-12T00:43:43.822993+0000","last_became_peered":"2024-09-12T00:43:43.822993+0000","last_unstale":"2024-09-12T01:38:42.177242+0000","last_undegraded":"2024-09-12T01:38:42.177242+0000","last_fullsized":"2024-09-12T01:38:42.177242+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:42.177145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:42.177145+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.177145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.760381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.878486+0000","last_change":"2024-09-12T01:38:20.878486+0000","last_active":"2024-09-12T01:38:20.878486+0000","last_peered":"2024-09-12T01:38:20.878486+0000","last_clean":"2024-09-12T01:38:20.878486+0000","last_became_active":"2024-09-12T00:43:38.795625+0000","last_became_peered":"2024-09-12T00:43:38.795625+0000","last_unstale":"2024-09-12T01:38:20.878486+0000","last_undegraded":"2024-09-12T01:38:20.878486+0000","last_fullsized":"2024-09-12T01:38:20.878486+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:20.878394+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:20.878394+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.878394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:19.560370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'39","reported_seq":169,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.608898+0000","last_change":"2024-09-12T01:38:15.608898+0000","last_active":"2024-09-12T01:38:15.608898+0000","last_peered":"2024-09-12T01:38:15.608898+0000","last_clean":"2024-09-12T01:38:15.608898+0000","last_became_active":"2024-09-12T00:39:17.761517+0000","last_became_peered":"2024-09-12T00:39:17.761517+0000","last_unstale":"2024-09-12T01:38:15.608898+0000","last_undegraded":"2024-09-12T01:38:15.608898+0000","last_fullsized":"2024-09-12T01:38:15.608898+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'39","last_scrub_stamp":"2024-09-12T01:38:15.608812+0000","last_deep_scrub":"266'39","last_deep_scrub_stamp":"2024-09-12T01:38:15.608812+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.608812+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:08.341143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.815764+0000","last_change":"2024-09-12T01:38:40.815764+0000","last_active":"2024-09-12T01:38:40.815764+0000","last_peered":"2024-09-12T01:38:40.815764+0000","last_clean":"2024-09-12T01:38:40.815764+0000","last_became_active":"2024-09-12T01:02:03.923808+0000","last_became_peered":"2024-09-12T01:02:03.923808+0000","last_unstale":"2024-09-12T01:38:40.815764+0000","last_undegraded":"2024-09-12T01:38:40.815764+0000","last_fullsized":"2024-09-12T01:38:40.815764+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.815640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.815640+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.815640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:48.736677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'5","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.726528+0000","last_change":"2024-09-12T01:38:27.726528+0000","last_active":"2024-09-12T01:38:27.726528+0000","last_peered":"2024-09-12T01:38:27.726528+0000","last_clean":"2024-09-12T01:38:27.726528+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:38:27.726528+0000","last_undegraded":"2024-09-12T01:38:27.726528+0000","last_fullsized":"2024-09-12T01:38:27.726528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:38:27.726340+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:38:27.726340+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.726340+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:47.178630+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'4","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.600636+0000","last_change":"2024-09-12T01:38:17.600636+0000","last_active":"2024-09-12T01:38:17.600636+0000","last_peered":"2024-09-12T01:38:17.600636+0000","last_clean":"2024-09-12T01:38:17.600636+0000","last_became_active":"2024-09-12T00:43:38.795451+0000","last_became_peered":"2024-09-12T00:43:38.795451+0000","last_unstale":"2024-09-12T01:38:17.600636+0000","last_undegraded":"2024-09-12T01:38:17.600636+0000","last_fullsized":"2024-09-12T01:38:17.600636+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:17.600540+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:17.600540+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.600540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:39.401021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'134","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.599128+0000","last_change":"2024-09-12T01:38:14.599128+0000","last_active":"2024-09-12T01:38:14.599128+0000","last_peered":"2024-09-12T01:38:14.599128+0000","last_clean":"2024-09-12T01:38:14.599128+0000","last_became_active":"2024-09-12T00:39:17.762649+0000","last_became_peered":"2024-09-12T00:39:17.762649+0000","last_unstale":"2024-09-12T01:38:14.599128+0000","last_undegraded":"2024-09-12T01:38:14.599128+0000","last_fullsized":"2024-09-12T01:38:14.599128+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T01:38:14.599042+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T01:38:14.599042+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.599042+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:27.992122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":844,"num_read_kb":585,"num_write":185,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2988,"num_omap_keys":6,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.870467+0000","last_change":"2024-09-12T01:38:22.870467+0000","last_active":"2024-09-12T01:38:22.870467+0000","last_peered":"2024-09-12T01:38:22.870467+0000","last_clean":"2024-09-12T01:38:22.870467+0000","last_became_active":"2024-09-12T01:02:03.924934+0000","last_became_peered":"2024-09-12T01:02:03.924934+0000","last_unstale":"2024-09-12T01:38:22.870467+0000","last_undegraded":"2024-09-12T01:38:22.870467+0000","last_fullsized":"2024-09-12T01:38:22.870467+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.870368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.870368+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.870368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:26.023207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.693772+0000","last_change":"2024-09-12T01:38:26.693772+0000","last_active":"2024-09-12T01:38:26.693772+0000","last_peered":"2024-09-12T01:38:26.693772+0000","last_clean":"2024-09-12T01:38:26.693772+0000","last_became_active":"2024-09-12T00:43:43.821288+0000","last_became_peered":"2024-09-12T00:43:43.821288+0000","last_unstale":"2024-09-12T01:38:26.693772+0000","last_undegraded":"2024-09-12T01:38:26.693772+0000","last_fullsized":"2024-09-12T01:38:26.693772+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:26.693678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:26.693678+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.693678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.289087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.552114+0000","last_change":"2024-09-12T01:38:24.552114+0000","last_active":"2024-09-12T01:38:24.552114+0000","last_peered":"2024-09-12T01:38:24.552114+0000","last_clean":"2024-09-12T01:38:24.552114+0000","last_became_active":"2024-09-12T00:43:38.797782+0000","last_became_peered":"2024-09-12T00:43:38.797782+0000","last_unstale":"2024-09-12T01:38:24.552114+0000","last_undegraded":"2024-09-12T01:38:24.552114+0000","last_fullsized":"2024-09-12T01:38:24.552114+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.552020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.552020+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.552020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:58.592170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'33","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:34.537703+0000","last_change":"2024-09-12T00:39:17.769240+0000","last_active":"2024-09-12T01:35:34.537703+0000","last_peered":"2024-09-12T01:35:34.537703+0000","last_clean":"2024-09-12T01:35:34.537703+0000","last_became_active":"2024-09-12T00:39:17.768151+0000","last_became_peered":"2024-09-12T00:39:17.768151+0000","last_unstale":"2024-09-12T01:35:34.537703+0000","last_undegraded":"2024-09-12T01:35:34.537703+0000","last_fullsized":"2024-09-12T01:35:34.537703+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:34:34.530106+0000","last_change":"2024-09-12T01:02:03.922540+0000","last_active":"2024-09-12T01:34:34.530106+0000","last_peered":"2024-09-12T01:34:34.530106+0000","last_clean":"2024-09-12T01:34:34.530106+0000","last_became_active":"2024-09-12T01:02:03.921595+0000","last_became_peered":"2024-09-12T01:02:03.921595+0000","last_unstale":"2024-09-12T01:34:34.530106+0000","last_undegraded":"2024-09-12T01:34:34.530106+0000","last_fullsized":"2024-09-12T01:34:34.530106+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:36.523672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"266'9","reported_seq":69,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.719936+0000","last_change":"2024-09-12T01:38:28.719936+0000","last_active":"2024-09-12T01:38:28.719936+0000","last_peered":"2024-09-12T01:38:28.719936+0000","last_clean":"2024-09-12T01:38:28.719936+0000","last_became_active":"2024-09-12T00:43:43.819990+0000","last_became_peered":"2024-09-12T00:43:43.819990+0000","last_unstale":"2024-09-12T01:38:28.719936+0000","last_undegraded":"2024-09-12T01:38:28.719936+0000","last_fullsized":"2024-09-12T01:38:28.719936+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T01:38:28.719833+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T01:38:28.719833+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.719833+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:36.029595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8217,"num_write":14,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.680163+0000","last_change":"2024-09-12T01:38:21.680163+0000","last_active":"2024-09-12T01:38:21.680163+0000","last_peered":"2024-09-12T01:38:21.680163+0000","last_clean":"2024-09-12T01:38:21.680163+0000","last_became_active":"2024-09-12T00:43:38.798374+0000","last_became_peered":"2024-09-12T00:43:38.798374+0000","last_unstale":"2024-09-12T01:38:21.680163+0000","last_undegraded":"2024-09-12T01:38:21.680163+0000","last_fullsized":"2024-09-12T01:38:21.680163+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:21.680052+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:21.680052+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.680052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:51.883942+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":175,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.871137+0000","last_change":"2024-09-12T01:38:14.871137+0000","last_active":"2024-09-12T01:38:14.871137+0000","last_peered":"2024-09-12T01:38:14.871137+0000","last_clean":"2024-09-12T01:38:14.871137+0000","last_became_active":"2024-09-12T00:39:17.757795+0000","last_became_peered":"2024-09-12T00:39:17.757795+0000","last_unstale":"2024-09-12T01:38:14.871137+0000","last_undegraded":"2024-09-12T01:38:14.871137+0000","last_fullsized":"2024-09-12T01:38:14.871137+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'41","last_scrub_stamp":"2024-09-12T01:38:14.871052+0000","last_deep_scrub":"266'41","last_deep_scrub_stamp":"2024-09-12T01:38:14.871052+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.871052+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:14.098929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.841035+0000","last_change":"2024-09-12T01:38:23.841035+0000","last_active":"2024-09-12T01:38:23.841035+0000","last_peered":"2024-09-12T01:38:23.841035+0000","last_clean":"2024-09-12T01:38:23.841035+0000","last_became_active":"2024-09-12T01:02:03.923774+0000","last_became_peered":"2024-09-12T01:02:03.923774+0000","last_unstale":"2024-09-12T01:38:23.841035+0000","last_undegraded":"2024-09-12T01:38:23.841035+0000","last_fullsized":"2024-09-12T01:38:23.841035+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.840947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.840947+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.840947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:14.358788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.723897+0000","last_change":"2024-09-12T01:38:31.723897+0000","last_active":"2024-09-12T01:38:31.723897+0000","last_peered":"2024-09-12T01:38:31.723897+0000","last_clean":"2024-09-12T01:38:31.723897+0000","last_became_active":"2024-09-12T00:43:43.819044+0000","last_became_peered":"2024-09-12T00:43:43.819044+0000","last_unstale":"2024-09-12T01:38:31.723897+0000","last_undegraded":"2024-09-12T01:38:31.723897+0000","last_fullsized":"2024-09-12T01:38:31.723897+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T01:38:31.723806+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T01:38:31.723806+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.723806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:47.665405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6160,"num_write":14,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.683362+0000","last_change":"2024-09-12T01:38:22.683362+0000","last_active":"2024-09-12T01:38:22.683362+0000","last_peered":"2024-09-12T01:38:22.683362+0000","last_clean":"2024-09-12T01:38:22.683362+0000","last_became_active":"2024-09-12T00:43:38.797343+0000","last_became_peered":"2024-09-12T00:43:38.797343+0000","last_unstale":"2024-09-12T01:38:22.683362+0000","last_undegraded":"2024-09-12T01:38:22.683362+0000","last_fullsized":"2024-09-12T01:38:22.683362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.683272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.683272+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.683272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:21.575947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'33","reported_seq":146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.367708+0000","last_change":"2024-09-12T01:38:16.367708+0000","last_active":"2024-09-12T01:38:16.367708+0000","last_peered":"2024-09-12T01:38:16.367708+0000","last_clean":"2024-09-12T01:38:16.367708+0000","last_became_active":"2024-09-12T00:39:17.759701+0000","last_became_peered":"2024-09-12T00:39:17.759701+0000","last_unstale":"2024-09-12T01:38:16.367708+0000","last_undegraded":"2024-09-12T01:38:16.367708+0000","last_fullsized":"2024-09-12T01:38:16.367708+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T01:38:16.367624+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T01:38:16.367624+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.367624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:43.217655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":64,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.802543+0000","last_change":"2024-09-12T01:38:41.802543+0000","last_active":"2024-09-12T01:38:41.802543+0000","last_peered":"2024-09-12T01:38:41.802543+0000","last_clean":"2024-09-12T01:38:41.802543+0000","last_became_active":"2024-09-12T01:02:03.923440+0000","last_became_peered":"2024-09-12T01:02:03.923440+0000","last_unstale":"2024-09-12T01:38:41.802543+0000","last_undegraded":"2024-09-12T01:38:41.802543+0000","last_fullsized":"2024-09-12T01:38:41.802543+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:41.802436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:41.802436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.802436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:03.698172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'5","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.155185+0000","last_change":"2024-09-12T01:38:43.155185+0000","last_active":"2024-09-12T01:38:43.155185+0000","last_peered":"2024-09-12T01:38:43.155185+0000","last_clean":"2024-09-12T01:38:43.155185+0000","last_became_active":"2024-09-12T00:43:43.819247+0000","last_became_peered":"2024-09-12T00:43:43.819247+0000","last_unstale":"2024-09-12T01:38:43.155185+0000","last_undegraded":"2024-09-12T01:38:43.155185+0000","last_fullsized":"2024-09-12T01:38:43.155185+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:43.155100+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:43.155100+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.155100+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:34.762482+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"266'5","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.643141+0000","last_change":"2024-09-12T01:38:19.643141+0000","last_active":"2024-09-12T01:38:19.643141+0000","last_peered":"2024-09-12T01:38:19.643141+0000","last_clean":"2024-09-12T01:38:19.643141+0000","last_became_active":"2024-09-12T00:43:38.794286+0000","last_became_peered":"2024-09-12T00:43:38.794286+0000","last_unstale":"2024-09-12T01:38:19.643141+0000","last_undegraded":"2024-09-12T01:38:19.643141+0000","last_fullsized":"2024-09-12T01:38:19.643141+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:19.643059+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:19.643059+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.643059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:21.395512+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'28","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.354805+0000","last_change":"2024-09-12T01:38:14.354805+0000","last_active":"2024-09-12T01:38:14.354805+0000","last_peered":"2024-09-12T01:38:14.354805+0000","last_clean":"2024-09-12T01:38:14.354805+0000","last_became_active":"2024-09-12T00:39:17.761738+0000","last_became_peered":"2024-09-12T00:39:17.761738+0000","last_unstale":"2024-09-12T01:38:14.354805+0000","last_undegraded":"2024-09-12T01:38:14.354805+0000","last_fullsized":"2024-09-12T01:38:14.354805+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'28","last_scrub_stamp":"2024-09-12T01:38:14.354706+0000","last_deep_scrub":"266'28","last_deep_scrub_stamp":"2024-09-12T01:38:14.354706+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.354706+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:49.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":96,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.542659+0000","last_change":"2024-09-12T01:38:26.542659+0000","last_active":"2024-09-12T01:38:26.542659+0000","last_peered":"2024-09-12T01:38:26.542659+0000","last_clean":"2024-09-12T01:38:26.542659+0000","last_became_active":"2024-09-12T01:02:03.928475+0000","last_became_peered":"2024-09-12T01:02:03.928475+0000","last_unstale":"2024-09-12T01:38:26.542659+0000","last_undegraded":"2024-09-12T01:38:26.542659+0000","last_fullsized":"2024-09-12T01:38:26.542659+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:26.542527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:26.542527+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.542527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:09.925002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'2","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.546533+0000","last_change":"2024-09-12T01:38:23.546533+0000","last_active":"2024-09-12T01:38:23.546533+0000","last_peered":"2024-09-12T01:38:23.546533+0000","last_clean":"2024-09-12T01:38:23.546533+0000","last_became_active":"2024-09-12T00:43:43.821149+0000","last_became_peered":"2024-09-12T00:43:43.821149+0000","last_unstale":"2024-09-12T01:38:23.546533+0000","last_undegraded":"2024-09-12T01:38:23.546533+0000","last_fullsized":"2024-09-12T01:38:23.546533+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:23.546436+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:23.546436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:54.182163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'9","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.707999+0000","last_change":"2024-09-12T01:38:25.707999+0000","last_active":"2024-09-12T01:38:25.707999+0000","last_peered":"2024-09-12T01:38:25.707999+0000","last_clean":"2024-09-12T01:38:25.707999+0000","last_became_active":"2024-09-12T00:43:38.798510+0000","last_became_peered":"2024-09-12T00:43:38.798510+0000","last_unstale":"2024-09-12T01:38:25.707999+0000","last_undegraded":"2024-09-12T01:38:25.707999+0000","last_fullsized":"2024-09-12T01:38:25.707999+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T01:38:25.707910+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T01:38:25.707910+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.707910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.643408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16416,"num_write":14,"num_write_kb":12320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'28","reported_seq":144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.676599+0000","last_change":"2024-09-12T01:38:15.676599+0000","last_active":"2024-09-12T01:38:15.676599+0000","last_peered":"2024-09-12T01:38:15.676599+0000","last_clean":"2024-09-12T01:38:15.676599+0000","last_became_active":"2024-09-12T00:39:17.770779+0000","last_became_peered":"2024-09-12T00:39:17.770779+0000","last_unstale":"2024-09-12T01:38:15.676599+0000","last_undegraded":"2024-09-12T01:38:15.676599+0000","last_fullsized":"2024-09-12T01:38:15.676599+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'28","last_scrub_stamp":"2024-09-12T01:38:15.676512+0000","last_deep_scrub":"266'28","last_deep_scrub_stamp":"2024-09-12T01:38:15.676512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.676512+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.231916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.769638+0000","last_change":"2024-09-12T01:38:19.769638+0000","last_active":"2024-09-12T01:38:19.769638+0000","last_peered":"2024-09-12T01:38:19.769638+0000","last_clean":"2024-09-12T01:38:19.769638+0000","last_became_active":"2024-09-12T01:02:03.925618+0000","last_became_peered":"2024-09-12T01:02:03.925618+0000","last_unstale":"2024-09-12T01:38:19.769638+0000","last_undegraded":"2024-09-12T01:38:19.769638+0000","last_fullsized":"2024-09-12T01:38:19.769638+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:19.769541+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:19.769541+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.769541+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:13.515910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"266'5","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.521264+0000","last_change":"2024-09-12T01:38:23.521264+0000","last_active":"2024-09-12T01:38:23.521264+0000","last_peered":"2024-09-12T01:38:23.521264+0000","last_clean":"2024-09-12T01:38:23.521264+0000","last_became_active":"2024-09-12T00:43:43.825380+0000","last_became_peered":"2024-09-12T00:43:43.825380+0000","last_unstale":"2024-09-12T01:38:23.521264+0000","last_undegraded":"2024-09-12T01:38:23.521264+0000","last_fullsized":"2024-09-12T01:38:23.521264+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:23.521124+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:23.521124+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.521124+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:57.370216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8232,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.636339+0000","last_change":"2024-09-12T01:38:20.636339+0000","last_active":"2024-09-12T01:38:20.636339+0000","last_peered":"2024-09-12T01:38:20.636339+0000","last_clean":"2024-09-12T01:38:20.636339+0000","last_became_active":"2024-09-12T00:43:38.791586+0000","last_became_peered":"2024-09-12T00:43:38.791586+0000","last_unstale":"2024-09-12T01:38:20.636339+0000","last_undegraded":"2024-09-12T01:38:20.636339+0000","last_fullsized":"2024-09-12T01:38:20.636339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:20.636233+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:20.636233+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.636233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:00.740486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'54","reported_seq":214,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.683082+0000","last_change":"2024-09-12T01:38:24.683082+0000","last_active":"2024-09-12T01:38:24.683082+0000","last_peered":"2024-09-12T01:38:24.683082+0000","last_clean":"2024-09-12T01:38:24.683082+0000","last_became_active":"2024-09-12T00:39:17.762435+0000","last_became_peered":"2024-09-12T00:39:17.762435+0000","last_unstale":"2024-09-12T01:38:24.683082+0000","last_undegraded":"2024-09-12T01:38:24.683082+0000","last_fullsized":"2024-09-12T01:38:24.683082+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'54","last_scrub_stamp":"2024-09-12T01:38:24.682985+0000","last_deep_scrub":"266'54","last_deep_scrub_stamp":"2024-09-12T01:38:24.682985+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.682985+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:47.728351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":202,"num_write":91,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.665472+0000","last_change":"2024-09-12T01:38:33.665472+0000","last_active":"2024-09-12T01:38:33.665472+0000","last_peered":"2024-09-12T01:38:33.665472+0000","last_clean":"2024-09-12T01:38:33.665472+0000","last_became_active":"2024-09-12T01:02:03.925866+0000","last_became_peered":"2024-09-12T01:02:03.925866+0000","last_unstale":"2024-09-12T01:38:33.665472+0000","last_undegraded":"2024-09-12T01:38:33.665472+0000","last_fullsized":"2024-09-12T01:38:33.665472+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:33.665384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:33.665384+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.665384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:53.898358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'3","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.802693+0000","last_change":"2024-09-12T01:38:17.802693+0000","last_active":"2024-09-12T01:38:17.802693+0000","last_peered":"2024-09-12T01:38:17.802693+0000","last_clean":"2024-09-12T01:38:17.802693+0000","last_became_active":"2024-09-12T00:43:43.820153+0000","last_became_peered":"2024-09-12T00:43:43.820153+0000","last_unstale":"2024-09-12T01:38:17.802693+0000","last_undegraded":"2024-09-12T01:38:17.802693+0000","last_fullsized":"2024-09-12T01:38:17.802693+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:38:17.802589+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:38:17.802589+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.802589+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:44.846562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'3","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.127605+0000","last_change":"2024-09-12T01:38:41.127605+0000","last_active":"2024-09-12T01:38:41.127605+0000","last_peered":"2024-09-12T01:38:41.127605+0000","last_clean":"2024-09-12T01:38:41.127605+0000","last_became_active":"2024-09-12T00:43:38.789945+0000","last_became_peered":"2024-09-12T00:43:38.789945+0000","last_unstale":"2024-09-12T01:38:41.127605+0000","last_undegraded":"2024-09-12T01:38:41.127605+0000","last_fullsized":"2024-09-12T01:38:41.127605+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:38:41.127506+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:38:41.127506+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.127506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:17.032445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'34","reported_seq":159,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.794692+0000","last_change":"2024-09-12T01:38:12.794692+0000","last_active":"2024-09-12T01:38:12.794692+0000","last_peered":"2024-09-12T01:38:12.794692+0000","last_clean":"2024-09-12T01:38:12.794692+0000","last_became_active":"2024-09-12T00:39:17.759741+0000","last_became_peered":"2024-09-12T00:39:17.759741+0000","last_unstale":"2024-09-12T01:38:12.794692+0000","last_undegraded":"2024-09-12T01:38:12.794692+0000","last_fullsized":"2024-09-12T01:38:12.794692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'34","last_scrub_stamp":"2024-09-12T01:38:12.794595+0000","last_deep_scrub":"266'34","last_deep_scrub_stamp":"2024-09-12T01:38:12.794595+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.794595+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:04.466537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.764487+0000","last_change":"2024-09-12T01:38:18.764487+0000","last_active":"2024-09-12T01:38:18.764487+0000","last_peered":"2024-09-12T01:38:18.764487+0000","last_clean":"2024-09-12T01:38:18.764487+0000","last_became_active":"2024-09-12T01:02:03.918998+0000","last_became_peered":"2024-09-12T01:02:03.918998+0000","last_unstale":"2024-09-12T01:38:18.764487+0000","last_undegraded":"2024-09-12T01:38:18.764487+0000","last_fullsized":"2024-09-12T01:38:18.764487+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:18.764368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:18.764368+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.764368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:49.004598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.709836+0000","last_change":"2024-09-12T01:38:32.709836+0000","last_active":"2024-09-12T01:38:32.709836+0000","last_peered":"2024-09-12T01:38:32.709836+0000","last_clean":"2024-09-12T01:38:32.709836+0000","last_became_active":"2024-09-12T00:43:43.821691+0000","last_became_peered":"2024-09-12T00:43:43.821691+0000","last_unstale":"2024-09-12T01:38:32.709836+0000","last_undegraded":"2024-09-12T01:38:32.709836+0000","last_fullsized":"2024-09-12T01:38:32.709836+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:32.709751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:32.709751+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.709751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:16.213860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.078337+0000","last_change":"2024-09-12T01:38:40.078337+0000","last_active":"2024-09-12T01:38:40.078337+0000","last_peered":"2024-09-12T01:38:40.078337+0000","last_clean":"2024-09-12T01:38:40.078337+0000","last_became_active":"2024-09-12T00:43:38.797711+0000","last_became_peered":"2024-09-12T00:43:38.797711+0000","last_unstale":"2024-09-12T01:38:40.078337+0000","last_undegraded":"2024-09-12T01:38:40.078337+0000","last_fullsized":"2024-09-12T01:38:40.078337+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.078228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.078228+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.078228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:18.325950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'32","reported_seq":149,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.381497+0000","last_change":"2024-09-12T01:38:22.381497+0000","last_active":"2024-09-12T01:38:22.381497+0000","last_peered":"2024-09-12T01:38:22.381497+0000","last_clean":"2024-09-12T01:38:22.381497+0000","last_became_active":"2024-09-12T00:39:17.760839+0000","last_became_peered":"2024-09-12T00:39:17.760839+0000","last_unstale":"2024-09-12T01:38:22.381497+0000","last_undegraded":"2024-09-12T01:38:22.381497+0000","last_fullsized":"2024-09-12T01:38:22.381497+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'32","last_scrub_stamp":"2024-09-12T01:38:22.381412+0000","last_deep_scrub":"266'32","last_deep_scrub_stamp":"2024-09-12T01:38:22.381412+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.381412+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:25.888813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.774169+0000","last_change":"2024-09-12T01:38:23.774169+0000","last_active":"2024-09-12T01:38:23.774169+0000","last_peered":"2024-09-12T01:38:23.774169+0000","last_clean":"2024-09-12T01:38:23.774169+0000","last_became_active":"2024-09-12T01:02:03.919706+0000","last_became_peered":"2024-09-12T01:02:03.919706+0000","last_unstale":"2024-09-12T01:38:23.774169+0000","last_undegraded":"2024-09-12T01:38:23.774169+0000","last_fullsized":"2024-09-12T01:38:23.774169+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.774067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.774067+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.774067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:59.231629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"266'2","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.736137+0000","last_change":"2024-09-12T01:38:30.736137+0000","last_active":"2024-09-12T01:38:30.736137+0000","last_peered":"2024-09-12T01:38:30.736137+0000","last_clean":"2024-09-12T01:38:30.736137+0000","last_became_active":"2024-09-12T00:43:43.818321+0000","last_became_peered":"2024-09-12T00:43:43.818321+0000","last_unstale":"2024-09-12T01:38:30.736137+0000","last_undegraded":"2024-09-12T01:38:30.736137+0000","last_fullsized":"2024-09-12T01:38:30.736137+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:30.736052+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:30.736052+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.736052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:37.453306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":96,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.378189+0000","last_change":"2024-09-12T01:38:27.378189+0000","last_active":"2024-09-12T01:38:27.378189+0000","last_peered":"2024-09-12T01:38:27.378189+0000","last_clean":"2024-09-12T01:38:27.378189+0000","last_became_active":"2024-09-12T00:43:38.792154+0000","last_became_peered":"2024-09-12T00:43:38.792154+0000","last_unstale":"2024-09-12T01:38:27.378189+0000","last_undegraded":"2024-09-12T01:38:27.378189+0000","last_fullsized":"2024-09-12T01:38:27.378189+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:27.378099+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:27.378099+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.378099+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:05.015242+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1034,"num_write":4,"num_write_kb":1034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"266'40","reported_seq":164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:39.538288+0000","last_change":"2024-09-12T00:39:17.770041+0000","last_active":"2024-09-12T01:35:39.538288+0000","last_peered":"2024-09-12T01:35:39.538288+0000","last_clean":"2024-09-12T01:35:39.538288+0000","last_became_active":"2024-09-12T00:39:17.767962+0000","last_became_peered":"2024-09-12T00:39:17.767962+0000","last_unstale":"2024-09-12T01:35:39.538288+0000","last_undegraded":"2024-09-12T01:35:39.538288+0000","last_fullsized":"2024-09-12T01:35:39.538288+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:16.736665+0000","last_clean_scrub_stamp":"2024-09-12T00:39:16.736665+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":136,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.795444+0000","last_change":"2024-09-12T01:38:38.795444+0000","last_active":"2024-09-12T01:38:38.795444+0000","last_peered":"2024-09-12T01:38:38.795444+0000","last_clean":"2024-09-12T01:38:38.795444+0000","last_became_active":"2024-09-12T01:02:03.918216+0000","last_became_peered":"2024-09-12T01:02:03.918216+0000","last_unstale":"2024-09-12T01:38:38.795444+0000","last_undegraded":"2024-09-12T01:38:38.795444+0000","last_fullsized":"2024-09-12T01:38:38.795444+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.795348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.795348+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.795348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:07.256077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'10","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.765459+0000","last_change":"2024-09-12T01:38:13.765459+0000","last_active":"2024-09-12T01:38:13.765459+0000","last_peered":"2024-09-12T01:38:13.765459+0000","last_clean":"2024-09-12T01:38:13.765459+0000","last_became_active":"2024-09-12T00:43:43.820194+0000","last_became_peered":"2024-09-12T00:43:43.820194+0000","last_unstale":"2024-09-12T01:38:13.765459+0000","last_undegraded":"2024-09-12T01:38:13.765459+0000","last_fullsized":"2024-09-12T01:38:13.765459+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T01:38:13.765346+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T01:38:13.765346+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.765346+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:37.499066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"266'10","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.549561+0000","last_change":"2024-09-12T01:38:22.549561+0000","last_active":"2024-09-12T01:38:22.549561+0000","last_peered":"2024-09-12T01:38:22.549561+0000","last_clean":"2024-09-12T01:38:22.549561+0000","last_became_active":"2024-09-12T00:43:38.797428+0000","last_became_peered":"2024-09-12T00:43:38.797428+0000","last_unstale":"2024-09-12T01:38:22.549561+0000","last_undegraded":"2024-09-12T01:38:22.549561+0000","last_fullsized":"2024-09-12T01:38:22.549561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T01:38:22.549469+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T01:38:22.549469+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.549469+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:27.315172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12282,"num_write":20,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'86","reported_seq":380,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.760111+0000","last_change":"2024-09-12T01:38:13.760111+0000","last_active":"2024-09-12T01:38:13.760111+0000","last_peered":"2024-09-12T01:38:13.760111+0000","last_clean":"2024-09-12T01:38:13.760111+0000","last_became_active":"2024-09-12T00:39:17.767517+0000","last_became_peered":"2024-09-12T00:39:17.767517+0000","last_unstale":"2024-09-12T01:38:13.760111+0000","last_undegraded":"2024-09-12T01:38:13.760111+0000","last_fullsized":"2024-09-12T01:38:13.760111+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'86","last_scrub_stamp":"2024-09-12T01:38:13.760025+0000","last_deep_scrub":"266'86","last_deep_scrub_stamp":"2024-09-12T01:38:13.760025+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.760025+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:04.380421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":615,"num_read_kb":395,"num_write":114,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4990,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536407+0000","last_change":"2024-09-12T01:02:03.922775+0000","last_active":"2024-09-12T01:35:24.536407+0000","last_peered":"2024-09-12T01:35:24.536407+0000","last_clean":"2024-09-12T01:35:24.536407+0000","last_became_active":"2024-09-12T01:02:03.922479+0000","last_became_peered":"2024-09-12T01:02:03.922479+0000","last_unstale":"2024-09-12T01:35:24.536407+0000","last_undegraded":"2024-09-12T01:35:24.536407+0000","last_fullsized":"2024-09-12T01:35:24.536407+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:34.011531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"263'4","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:44.538933+0000","last_change":"2024-09-12T00:43:43.821630+0000","last_active":"2024-09-12T01:35:44.538933+0000","last_peered":"2024-09-12T01:35:44.538933+0000","last_clean":"2024-09-12T01:35:44.538933+0000","last_became_active":"2024-09-12T00:43:43.821303+0000","last_became_peered":"2024-09-12T00:43:43.821303+0000","last_unstale":"2024-09-12T01:35:44.538933+0000","last_undegraded":"2024-09-12T01:35:44.538933+0000","last_fullsized":"2024-09-12T01:35:44.538933+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:43:42.795570+0000","last_clean_scrub_stamp":"2024-09-12T00:43:42.795570+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16370,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'2","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.042646+0000","last_change":"2024-09-12T01:38:38.042646+0000","last_active":"2024-09-12T01:38:38.042646+0000","last_peered":"2024-09-12T01:38:38.042646+0000","last_clean":"2024-09-12T01:38:38.042646+0000","last_became_active":"2024-09-12T00:43:38.799623+0000","last_became_peered":"2024-09-12T00:43:38.799623+0000","last_unstale":"2024-09-12T01:38:38.042646+0000","last_undegraded":"2024-09-12T01:38:38.042646+0000","last_fullsized":"2024-09-12T01:38:38.042646+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:38.042545+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:38.042545+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.042545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:16.881875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'30","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.581377+0000","last_change":"2024-09-12T01:38:13.581377+0000","last_active":"2024-09-12T01:38:13.581377+0000","last_peered":"2024-09-12T01:38:13.581377+0000","last_clean":"2024-09-12T01:38:13.581377+0000","last_became_active":"2024-09-12T00:39:17.768143+0000","last_became_peered":"2024-09-12T00:39:17.768143+0000","last_unstale":"2024-09-12T01:38:13.581377+0000","last_undegraded":"2024-09-12T01:38:13.581377+0000","last_fullsized":"2024-09-12T01:38:13.581377+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'30","last_scrub_stamp":"2024-09-12T01:38:13.581243+0000","last_deep_scrub":"266'30","last_deep_scrub_stamp":"2024-09-12T01:38:13.581243+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.581243+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:42.561923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":109,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.692957+0000","last_change":"2024-09-12T01:38:32.692957+0000","last_active":"2024-09-12T01:38:32.692957+0000","last_peered":"2024-09-12T01:38:32.692957+0000","last_clean":"2024-09-12T01:38:32.692957+0000","last_became_active":"2024-09-12T01:02:03.926699+0000","last_became_peered":"2024-09-12T01:02:03.926699+0000","last_unstale":"2024-09-12T01:38:32.692957+0000","last_undegraded":"2024-09-12T01:38:32.692957+0000","last_fullsized":"2024-09-12T01:38:32.692957+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:32.692862+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:32.692862+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.692862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:16.889559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'7","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.397880+0000","last_change":"2024-09-12T01:38:28.397880+0000","last_active":"2024-09-12T01:38:28.397880+0000","last_peered":"2024-09-12T01:38:28.397880+0000","last_clean":"2024-09-12T01:38:28.397880+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:38:28.397880+0000","last_undegraded":"2024-09-12T01:38:28.397880+0000","last_fullsized":"2024-09-12T01:38:28.397880+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T01:38:28.397795+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T01:38:28.397795+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.397795+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:41.062741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24570,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.647787+0000","last_change":"2024-09-12T01:38:16.647787+0000","last_active":"2024-09-12T01:38:16.647787+0000","last_peered":"2024-09-12T01:38:16.647787+0000","last_clean":"2024-09-12T01:38:16.647787+0000","last_became_active":"2024-09-12T00:43:38.798431+0000","last_became_peered":"2024-09-12T00:43:38.798431+0000","last_unstale":"2024-09-12T01:38:16.647787+0000","last_undegraded":"2024-09-12T01:38:16.647787+0000","last_fullsized":"2024-09-12T01:38:16.647787+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.647689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.647689+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.647689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:10.062955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":132,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.714325+0000","last_change":"2024-09-12T01:38:14.714325+0000","last_active":"2024-09-12T01:38:14.714325+0000","last_peered":"2024-09-12T01:38:14.714325+0000","last_clean":"2024-09-12T01:38:14.714325+0000","last_became_active":"2024-09-12T00:39:17.768901+0000","last_became_peered":"2024-09-12T00:39:17.768901+0000","last_unstale":"2024-09-12T01:38:14.714325+0000","last_undegraded":"2024-09-12T01:38:14.714325+0000","last_fullsized":"2024-09-12T01:38:14.714325+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T01:38:14.714227+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T01:38:14.714227+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.714227+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:14.636195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.406868+0000","last_change":"2024-09-12T01:38:29.406868+0000","last_active":"2024-09-12T01:38:29.406868+0000","last_peered":"2024-09-12T01:38:29.406868+0000","last_clean":"2024-09-12T01:38:29.406868+0000","last_became_active":"2024-09-12T01:02:03.922500+0000","last_became_peered":"2024-09-12T01:02:03.922500+0000","last_unstale":"2024-09-12T01:38:29.406868+0000","last_undegraded":"2024-09-12T01:38:29.406868+0000","last_fullsized":"2024-09-12T01:38:29.406868+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.406767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.406767+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.406767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:46.533720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.075338+0000","last_change":"2024-09-12T01:38:39.075338+0000","last_active":"2024-09-12T01:38:39.075338+0000","last_peered":"2024-09-12T01:38:39.075338+0000","last_clean":"2024-09-12T01:38:39.075338+0000","last_became_active":"2024-09-12T00:43:43.823554+0000","last_became_peered":"2024-09-12T00:43:43.823554+0000","last_unstale":"2024-09-12T01:38:39.075338+0000","last_undegraded":"2024-09-12T01:38:39.075338+0000","last_fullsized":"2024-09-12T01:38:39.075338+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.075247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.075247+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.075247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:01.960706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.008896+0000","last_change":"2024-09-12T01:38:37.008896+0000","last_active":"2024-09-12T01:38:37.008896+0000","last_peered":"2024-09-12T01:38:37.008896+0000","last_clean":"2024-09-12T01:38:37.008896+0000","last_became_active":"2024-09-12T00:43:38.798117+0000","last_became_peered":"2024-09-12T00:43:38.798117+0000","last_unstale":"2024-09-12T01:38:37.008896+0000","last_undegraded":"2024-09-12T01:38:37.008896+0000","last_fullsized":"2024-09-12T01:38:37.008896+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.008802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.008802+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.008802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:22.178386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'16","reported_seq":107,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.957703+0000","last_change":"2024-09-12T01:38:32.957703+0000","last_active":"2024-09-12T01:38:32.957703+0000","last_peered":"2024-09-12T01:38:32.957703+0000","last_clean":"2024-09-12T01:38:32.957703+0000","last_became_active":"2024-09-12T00:39:17.768503+0000","last_became_peered":"2024-09-12T00:39:17.768503+0000","last_unstale":"2024-09-12T01:38:32.957703+0000","last_undegraded":"2024-09-12T01:38:32.957703+0000","last_fullsized":"2024-09-12T01:38:32.957703+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'16","last_scrub_stamp":"2024-09-12T01:38:32.957591+0000","last_deep_scrub":"266'16","last_deep_scrub_stamp":"2024-09-12T01:38:32.957591+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.957591+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:43.460982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.774843+0000","last_change":"2024-09-12T01:38:39.774843+0000","last_active":"2024-09-12T01:38:39.774843+0000","last_peered":"2024-09-12T01:38:39.774843+0000","last_clean":"2024-09-12T01:38:39.774843+0000","last_became_active":"2024-09-12T01:02:03.928430+0000","last_became_peered":"2024-09-12T01:02:03.928430+0000","last_unstale":"2024-09-12T01:38:39.774843+0000","last_undegraded":"2024-09-12T01:38:39.774843+0000","last_fullsized":"2024-09-12T01:38:39.774843+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.774745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.774745+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.774745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:48.613287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.512944+0000","last_change":"2024-09-12T01:38:21.512944+0000","last_active":"2024-09-12T01:38:21.512944+0000","last_peered":"2024-09-12T01:38:21.512944+0000","last_clean":"2024-09-12T01:38:21.512944+0000","last_became_active":"2024-09-12T00:43:43.822996+0000","last_became_peered":"2024-09-12T00:43:43.822996+0000","last_unstale":"2024-09-12T01:38:21.512944+0000","last_undegraded":"2024-09-12T01:38:21.512944+0000","last_fullsized":"2024-09-12T01:38:21.512944+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:21.512843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:21.512843+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.512843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:05.059540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'2","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.483184+0000","last_change":"2024-09-12T01:38:21.483184+0000","last_active":"2024-09-12T01:38:21.483184+0000","last_peered":"2024-09-12T01:38:21.483184+0000","last_clean":"2024-09-12T01:38:21.483184+0000","last_became_active":"2024-09-12T00:43:38.797367+0000","last_became_peered":"2024-09-12T00:43:38.797367+0000","last_unstale":"2024-09-12T01:38:21.483184+0000","last_undegraded":"2024-09-12T01:38:21.483184+0000","last_fullsized":"2024-09-12T01:38:21.483184+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:21.483069+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:21.483069+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.483069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:49.131655+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'9","reported_seq":91,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.979713+0000","last_change":"2024-09-12T01:38:33.979713+0000","last_active":"2024-09-12T01:38:33.979713+0000","last_peered":"2024-09-12T01:38:33.979713+0000","last_clean":"2024-09-12T01:38:33.979713+0000","last_became_active":"2024-09-12T00:39:17.759327+0000","last_became_peered":"2024-09-12T00:39:17.759327+0000","last_unstale":"2024-09-12T01:38:33.979713+0000","last_undegraded":"2024-09-12T01:38:33.979713+0000","last_fullsized":"2024-09-12T01:38:33.979713+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T01:38:33.979612+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T01:38:33.979612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.979612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:18.592523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":31,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:35:24.536493+0000","last_change":"2024-09-12T01:02:03.925373+0000","last_active":"2024-09-12T01:35:24.536493+0000","last_peered":"2024-09-12T01:35:24.536493+0000","last_clean":"2024-09-12T01:35:24.536493+0000","last_became_active":"2024-09-12T01:02:03.925081+0000","last_became_peered":"2024-09-12T01:02:03.925081+0000","last_unstale":"2024-09-12T01:35:24.536493+0000","last_undegraded":"2024-09-12T01:35:24.536493+0000","last_fullsized":"2024-09-12T01:35:24.536493+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:02:02.898962+0000","last_clean_scrub_stamp":"2024-09-12T01:02:02.898962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:09.007940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'4","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.581279+0000","last_change":"2024-09-12T01:38:18.581279+0000","last_active":"2024-09-12T01:38:18.581279+0000","last_peered":"2024-09-12T01:38:18.581279+0000","last_clean":"2024-09-12T01:38:18.581279+0000","last_became_active":"2024-09-12T00:43:43.822237+0000","last_became_peered":"2024-09-12T00:43:43.822237+0000","last_unstale":"2024-09-12T01:38:18.581279+0000","last_undegraded":"2024-09-12T01:38:18.581279+0000","last_fullsized":"2024-09-12T01:38:18.581279+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:18.581176+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:18.581176+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.581176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:25.657953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'6","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.761259+0000","last_change":"2024-09-12T01:38:17.761259+0000","last_active":"2024-09-12T01:38:17.761259+0000","last_peered":"2024-09-12T01:38:17.761259+0000","last_clean":"2024-09-12T01:38:17.761259+0000","last_became_active":"2024-09-12T00:43:38.793943+0000","last_became_peered":"2024-09-12T00:43:38.793943+0000","last_unstale":"2024-09-12T01:38:17.761259+0000","last_undegraded":"2024-09-12T01:38:17.761259+0000","last_fullsized":"2024-09-12T01:38:17.761259+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T01:38:17.761175+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T01:38:17.761175+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.761175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:37.005205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11272,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"266'26","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.707662+0000","last_change":"2024-09-12T01:38:11.707662+0000","last_active":"2024-09-12T01:38:11.707662+0000","last_peered":"2024-09-12T01:38:11.707662+0000","last_clean":"2024-09-12T01:38:11.707662+0000","last_became_active":"2024-09-12T00:39:17.770093+0000","last_became_peered":"2024-09-12T00:39:17.770093+0000","last_unstale":"2024-09-12T01:38:11.707662+0000","last_undegraded":"2024-09-12T01:38:11.707662+0000","last_fullsized":"2024-09-12T01:38:11.707662+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T01:38:11.707576+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T01:38:11.707576+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.707576+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:31.726573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'194","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.782554+0000","last_change":"2024-09-12T01:37:51.782461+0000","last_active":"2024-09-12T01:37:51.782554+0000","last_peered":"2024-09-12T01:37:51.782554+0000","last_clean":"2024-09-12T01:37:51.782554+0000","last_became_active":"2024-09-12T00:25:00.479764+0000","last_became_peered":"2024-09-12T00:25:00.479764+0000","last_unstale":"2024-09-12T01:37:51.782554+0000","last_undegraded":"2024-09-12T01:37:51.782554+0000","last_fullsized":"2024-09-12T01:37:51.782554+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T01:37:51.782310+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T01:37:51.782310+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.782310+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:39.097138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":6490,"num_write":862,"num_write_kb":17717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'386","reported_seq":1940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.837693+0000","last_change":"2024-09-12T01:37:59.837693+0000","last_active":"2024-09-12T01:37:59.837693+0000","last_peered":"2024-09-12T01:37:59.837693+0000","last_clean":"2024-09-12T01:37:59.837693+0000","last_became_active":"2024-09-12T00:25:02.474473+0000","last_became_peered":"2024-09-12T00:25:02.474473+0000","last_unstale":"2024-09-12T01:37:59.837693+0000","last_undegraded":"2024-09-12T01:37:59.837693+0000","last_fullsized":"2024-09-12T01:37:59.837693+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'386","last_scrub_stamp":"2024-09-12T01:37:59.837583+0000","last_deep_scrub":"266'386","last_deep_scrub_stamp":"2024-09-12T01:37:59.837583+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.837583+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:41.730695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2167,"num_read_kb":2073,"num_write":418,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'235","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.616677+0000","last_change":"2024-09-12T01:37:57.616619+0000","last_active":"2024-09-12T01:37:57.616677+0000","last_peered":"2024-09-12T01:37:57.616677+0000","last_clean":"2024-09-12T01:37:57.616677+0000","last_became_active":"2024-09-12T00:25:00.469588+0000","last_became_peered":"2024-09-12T00:25:00.469588+0000","last_unstale":"2024-09-12T01:37:57.616677+0000","last_undegraded":"2024-09-12T01:37:57.616677+0000","last_fullsized":"2024-09-12T01:37:57.616677+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'235","last_scrub_stamp":"2024-09-12T01:37:57.616503+0000","last_deep_scrub":"266'235","last_deep_scrub_stamp":"2024-09-12T01:37:57.616503+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.616503+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:16.143384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038976,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":700,"num_read_kb":64068,"num_write":1104,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'892","reported_seq":2586,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.970072+0000","last_change":"2024-09-12T01:38:08.970072+0000","last_active":"2024-09-12T01:38:08.970072+0000","last_peered":"2024-09-12T01:38:08.970072+0000","last_clean":"2024-09-12T01:38:08.970072+0000","last_became_active":"2024-09-12T00:25:02.476131+0000","last_became_peered":"2024-09-12T00:25:02.476131+0000","last_unstale":"2024-09-12T01:38:08.970072+0000","last_undegraded":"2024-09-12T01:38:08.970072+0000","last_fullsized":"2024-09-12T01:38:08.970072+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'892","last_scrub_stamp":"2024-09-12T01:38:08.969967+0000","last_deep_scrub":"266'892","last_deep_scrub_stamp":"2024-09-12T01:38:08.969967+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.969967+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:34.555648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4103,"num_read_kb":3695,"num_write":1128,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'210","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.565091+0000","last_change":"2024-09-12T01:37:58.565004+0000","last_active":"2024-09-12T01:37:58.565091+0000","last_peered":"2024-09-12T01:37:58.565091+0000","last_clean":"2024-09-12T01:37:58.565091+0000","last_became_active":"2024-09-12T00:25:00.458072+0000","last_became_peered":"2024-09-12T00:25:00.458072+0000","last_unstale":"2024-09-12T01:37:58.565091+0000","last_undegraded":"2024-09-12T01:37:58.565091+0000","last_fullsized":"2024-09-12T01:37:58.565091+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T01:37:58.564864+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T01:37:58.564864+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.564864+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:34.721743+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":12854,"num_write":984,"num_write_kb":25223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1328","reported_seq":2890,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.970587+0000","last_change":"2024-09-12T01:38:09.970587+0000","last_active":"2024-09-12T01:38:09.970587+0000","last_peered":"2024-09-12T01:38:09.970587+0000","last_clean":"2024-09-12T01:38:09.970587+0000","last_became_active":"2024-09-12T00:25:02.470249+0000","last_became_peered":"2024-09-12T00:25:02.470249+0000","last_unstale":"2024-09-12T01:38:09.970587+0000","last_undegraded":"2024-09-12T01:38:09.970587+0000","last_fullsized":"2024-09-12T01:38:09.970587+0000","mapping_epoch":28,"log_start":"266'1300","ondisk_log_start":"266'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1328","last_scrub_stamp":"2024-09-12T01:38:09.970500+0000","last_deep_scrub":"266'1328","last_deep_scrub_stamp":"2024-09-12T01:38:09.970500+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.970500+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":1300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:18.710168+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5936,"num_read_kb":5183,"num_write":1890,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'198","reported_seq":841,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.701005+0000","last_change":"2024-09-12T01:37:49.701005+0000","last_active":"2024-09-12T01:37:49.701005+0000","last_peered":"2024-09-12T01:37:49.701005+0000","last_clean":"2024-09-12T01:37:49.701005+0000","last_became_active":"2024-09-12T00:25:00.482357+0000","last_became_peered":"2024-09-12T00:25:00.482357+0000","last_unstale":"2024-09-12T01:37:49.701005+0000","last_undegraded":"2024-09-12T01:37:49.701005+0000","last_fullsized":"2024-09-12T01:37:49.701005+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'198","last_scrub_stamp":"2024-09-12T01:37:49.700861+0000","last_deep_scrub":"266'198","last_deep_scrub_stamp":"2024-09-12T01:37:49.700861+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.700861+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:41.600504+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":30861,"num_write":868,"num_write_kb":33122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'568","reported_seq":2123,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.305956+0000","last_change":"2024-09-12T01:38:01.305956+0000","last_active":"2024-09-12T01:38:01.305956+0000","last_peered":"2024-09-12T01:38:01.305956+0000","last_clean":"2024-09-12T01:38:01.305956+0000","last_became_active":"2024-09-12T00:25:02.467378+0000","last_became_peered":"2024-09-12T00:25:02.467378+0000","last_unstale":"2024-09-12T01:38:01.305956+0000","last_undegraded":"2024-09-12T01:38:01.305956+0000","last_fullsized":"2024-09-12T01:38:01.305956+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'568","last_scrub_stamp":"2024-09-12T01:38:01.305854+0000","last_deep_scrub":"266'568","last_deep_scrub_stamp":"2024-09-12T01:38:01.305854+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.305854+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:08.402665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2918,"num_read_kb":2656,"num_write":743,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'211","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.817464+0000","last_change":"2024-09-12T01:37:50.817464+0000","last_active":"2024-09-12T01:37:50.817464+0000","last_peered":"2024-09-12T01:37:50.817464+0000","last_clean":"2024-09-12T01:37:50.817464+0000","last_became_active":"2024-09-12T00:25:00.475340+0000","last_became_peered":"2024-09-12T00:25:00.475340+0000","last_unstale":"2024-09-12T01:37:50.817464+0000","last_undegraded":"2024-09-12T01:37:50.817464+0000","last_fullsized":"2024-09-12T01:37:50.817464+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T01:37:50.817350+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T01:37:50.817350+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.817350+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:44.835143+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":13966,"num_write":1015,"num_write_kb":23620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'576","reported_seq":2287,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.816314+0000","last_change":"2024-09-12T01:37:58.816314+0000","last_active":"2024-09-12T01:37:58.816314+0000","last_peered":"2024-09-12T01:37:58.816314+0000","last_clean":"2024-09-12T01:37:58.816314+0000","last_became_active":"2024-09-12T00:25:02.474229+0000","last_became_peered":"2024-09-12T00:25:02.474229+0000","last_unstale":"2024-09-12T01:37:58.816314+0000","last_undegraded":"2024-09-12T01:37:58.816314+0000","last_fullsized":"2024-09-12T01:37:58.816314+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'576","last_scrub_stamp":"2024-09-12T01:37:58.816221+0000","last_deep_scrub":"266'576","last_deep_scrub_stamp":"2024-09-12T01:37:58.816221+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.816221+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:01.221779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2896,"num_write":736,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1072,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'188","reported_seq":939,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.754127+0000","last_change":"2024-09-12T01:37:50.754127+0000","last_active":"2024-09-12T01:37:50.754127+0000","last_peered":"2024-09-12T01:37:50.754127+0000","last_clean":"2024-09-12T01:37:50.754127+0000","last_became_active":"2024-09-12T00:25:00.487589+0000","last_became_peered":"2024-09-12T00:25:00.487589+0000","last_unstale":"2024-09-12T01:37:50.754127+0000","last_undegraded":"2024-09-12T01:37:50.754127+0000","last_fullsized":"2024-09-12T01:37:50.754127+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:50.754013+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:50.754013+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.754013+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:08.640403+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8822595,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":942,"num_read_kb":45033,"num_write":954,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'529","reported_seq":2429,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.856271+0000","last_change":"2024-09-12T01:37:59.856187+0000","last_active":"2024-09-12T01:37:59.856271+0000","last_peered":"2024-09-12T01:37:59.856271+0000","last_clean":"2024-09-12T01:37:59.856271+0000","last_became_active":"2024-09-12T00:25:02.477395+0000","last_became_peered":"2024-09-12T00:25:02.477395+0000","last_unstale":"2024-09-12T01:37:59.856271+0000","last_undegraded":"2024-09-12T01:37:59.856271+0000","last_fullsized":"2024-09-12T01:37:59.856271+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'529","last_scrub_stamp":"2024-09-12T01:37:59.856094+0000","last_deep_scrub":"266'529","last_deep_scrub_stamp":"2024-09-12T01:37:59.856094+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.856094+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:03.807614+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3189,"num_read_kb":3033,"num_write":616,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2555,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'234","reported_seq":903,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.867960+0000","last_change":"2024-09-12T01:37:49.867960+0000","last_active":"2024-09-12T01:37:49.867960+0000","last_peered":"2024-09-12T01:37:49.867960+0000","last_clean":"2024-09-12T01:37:49.867960+0000","last_became_active":"2024-09-12T00:25:00.477590+0000","last_became_peered":"2024-09-12T00:25:00.477590+0000","last_unstale":"2024-09-12T01:37:49.867960+0000","last_undegraded":"2024-09-12T01:37:49.867960+0000","last_fullsized":"2024-09-12T01:37:49.867960+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'234","last_scrub_stamp":"2024-09-12T01:37:49.867814+0000","last_deep_scrub":"266'234","last_deep_scrub_stamp":"2024-09-12T01:37:49.867814+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.867814+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:35.864908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048652,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":24485,"num_write":1039,"num_write_kb":27596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'375","reported_seq":1766,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.698712+0000","last_change":"2024-09-12T01:37:55.698644+0000","last_active":"2024-09-12T01:37:55.698712+0000","last_peered":"2024-09-12T01:37:55.698712+0000","last_clean":"2024-09-12T01:37:55.698712+0000","last_became_active":"2024-09-12T00:25:02.466439+0000","last_became_peered":"2024-09-12T00:25:02.466439+0000","last_unstale":"2024-09-12T01:37:55.698712+0000","last_undegraded":"2024-09-12T01:37:55.698712+0000","last_fullsized":"2024-09-12T01:37:55.698712+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'375","last_scrub_stamp":"2024-09-12T01:37:55.698565+0000","last_deep_scrub":"266'375","last_deep_scrub_stamp":"2024-09-12T01:37:55.698565+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.698565+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:29.902650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1739,"num_write":422,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'188","reported_seq":801,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.564948+0000","last_change":"2024-09-12T01:37:56.564948+0000","last_active":"2024-09-12T01:37:56.564948+0000","last_peered":"2024-09-12T01:37:56.564948+0000","last_clean":"2024-09-12T01:37:56.564948+0000","last_became_active":"2024-09-12T00:25:00.472046+0000","last_became_peered":"2024-09-12T00:25:00.472046+0000","last_unstale":"2024-09-12T01:37:56.564948+0000","last_undegraded":"2024-09-12T01:37:56.564948+0000","last_fullsized":"2024-09-12T01:37:56.564948+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:56.564688+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:56.564688+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.564688+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:04.119213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":23076,"num_write":837,"num_write_kb":28135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'364","reported_seq":1848,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.628354+0000","last_change":"2024-09-12T01:38:07.628354+0000","last_active":"2024-09-12T01:38:07.628354+0000","last_peered":"2024-09-12T01:38:07.628354+0000","last_clean":"2024-09-12T01:38:07.628354+0000","last_became_active":"2024-09-12T00:25:02.474791+0000","last_became_peered":"2024-09-12T00:25:02.474791+0000","last_unstale":"2024-09-12T01:38:07.628354+0000","last_undegraded":"2024-09-12T01:38:07.628354+0000","last_fullsized":"2024-09-12T01:38:07.628354+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'364","last_scrub_stamp":"2024-09-12T01:38:07.628270+0000","last_deep_scrub":"266'364","last_deep_scrub_stamp":"2024-09-12T01:38:07.628270+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.628270+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:42.047911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2089,"num_read_kb":2020,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'478","reported_seq":2155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.938318+0000","last_change":"2024-09-12T01:38:07.938318+0000","last_active":"2024-09-12T01:38:07.938318+0000","last_peered":"2024-09-12T01:38:07.938318+0000","last_clean":"2024-09-12T01:38:07.938318+0000","last_became_active":"2024-09-12T00:25:02.471545+0000","last_became_peered":"2024-09-12T00:25:02.471545+0000","last_unstale":"2024-09-12T01:38:07.938318+0000","last_undegraded":"2024-09-12T01:38:07.938318+0000","last_fullsized":"2024-09-12T01:38:07.938318+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'478","last_scrub_stamp":"2024-09-12T01:38:07.938236+0000","last_deep_scrub":"266'478","last_deep_scrub_stamp":"2024-09-12T01:38:07.938236+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.938236+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:00.495364+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2642,"num_read_kb":2498,"num_write":559,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'202","reported_seq":1070,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.902175+0000","last_change":"2024-09-12T01:37:48.902175+0000","last_active":"2024-09-12T01:37:48.902175+0000","last_peered":"2024-09-12T01:37:48.902175+0000","last_clean":"2024-09-12T01:37:48.902175+0000","last_became_active":"2024-09-12T00:25:00.464783+0000","last_became_peered":"2024-09-12T00:25:00.464783+0000","last_unstale":"2024-09-12T01:37:48.902175+0000","last_undegraded":"2024-09-12T01:37:48.902175+0000","last_fullsized":"2024-09-12T01:37:48.902175+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'202","last_scrub_stamp":"2024-09-12T01:37:48.902072+0000","last_deep_scrub":"266'202","last_deep_scrub_stamp":"2024-09-12T01:37:48.902072+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.902072+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.439697+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":967,"num_read_kb":27994,"num_write":1073,"num_write_kb":26373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'504","reported_seq":2079,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.764743+0000","last_change":"2024-09-12T01:37:54.764743+0000","last_active":"2024-09-12T01:37:54.764743+0000","last_peered":"2024-09-12T01:37:54.764743+0000","last_clean":"2024-09-12T01:37:54.764743+0000","last_became_active":"2024-09-12T00:25:02.475032+0000","last_became_peered":"2024-09-12T00:25:02.475032+0000","last_unstale":"2024-09-12T01:37:54.764743+0000","last_undegraded":"2024-09-12T01:37:54.764743+0000","last_fullsized":"2024-09-12T01:37:54.764743+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'504","last_scrub_stamp":"2024-09-12T01:37:54.764639+0000","last_deep_scrub":"266'504","last_deep_scrub_stamp":"2024-09-12T01:37:54.764639+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.764639+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:07.905496+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2653,"num_read_kb":2473,"num_write":625,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'211","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.771568+0000","last_change":"2024-09-12T01:37:52.771568+0000","last_active":"2024-09-12T01:37:52.771568+0000","last_peered":"2024-09-12T01:37:52.771568+0000","last_clean":"2024-09-12T01:37:52.771568+0000","last_became_active":"2024-09-12T00:25:00.479635+0000","last_became_peered":"2024-09-12T00:25:00.479635+0000","last_unstale":"2024-09-12T01:37:52.771568+0000","last_undegraded":"2024-09-12T01:37:52.771568+0000","last_fullsized":"2024-09-12T01:37:52.771568+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T01:37:52.771466+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T01:37:52.771466+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.771466+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:45.884259+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279168,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":30051,"num_write":937,"num_write_kb":51711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'1151","reported_seq":2940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.880921+0000","last_change":"2024-09-12T01:37:54.880921+0000","last_active":"2024-09-12T01:37:54.880921+0000","last_peered":"2024-09-12T01:37:54.880921+0000","last_clean":"2024-09-12T01:37:54.880921+0000","last_became_active":"2024-09-12T00:25:02.467224+0000","last_became_peered":"2024-09-12T00:25:02.467224+0000","last_unstale":"2024-09-12T01:37:54.880921+0000","last_undegraded":"2024-09-12T01:37:54.880921+0000","last_fullsized":"2024-09-12T01:37:54.880921+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1151","last_scrub_stamp":"2024-09-12T01:37:54.880810+0000","last_deep_scrub":"266'1151","last_deep_scrub_stamp":"2024-09-12T01:37:54.880810+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.880810+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":1100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.639713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5645,"num_read_kb":4973,"num_write":1729,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'210","reported_seq":855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.874315+0000","last_change":"2024-09-12T01:37:48.874315+0000","last_active":"2024-09-12T01:37:48.874315+0000","last_peered":"2024-09-12T01:37:48.874315+0000","last_clean":"2024-09-12T01:37:48.874315+0000","last_became_active":"2024-09-12T00:25:00.477184+0000","last_became_peered":"2024-09-12T00:25:00.477184+0000","last_unstale":"2024-09-12T01:37:48.874315+0000","last_undegraded":"2024-09-12T01:37:48.874315+0000","last_fullsized":"2024-09-12T01:37:48.874315+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T01:37:48.874041+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T01:37:48.874041+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.874041+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:11.950680+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3321654,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":408,"num_read_kb":20227,"num_write":1015,"num_write_kb":31572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'487","reported_seq":2026,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.351017+0000","last_change":"2024-09-12T01:37:59.351017+0000","last_active":"2024-09-12T01:37:59.351017+0000","last_peered":"2024-09-12T01:37:59.351017+0000","last_clean":"2024-09-12T01:37:59.351017+0000","last_became_active":"2024-09-12T00:25:02.469463+0000","last_became_peered":"2024-09-12T00:25:02.469463+0000","last_unstale":"2024-09-12T01:37:59.351017+0000","last_undegraded":"2024-09-12T01:37:59.351017+0000","last_fullsized":"2024-09-12T01:37:59.351017+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'487","last_scrub_stamp":"2024-09-12T01:37:59.350932+0000","last_deep_scrub":"266'487","last_deep_scrub_stamp":"2024-09-12T01:37:59.350932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.350932+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:05.093460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2387,"num_write":615,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'190","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.874423+0000","last_change":"2024-09-12T01:37:47.874423+0000","last_active":"2024-09-12T01:37:47.874423+0000","last_peered":"2024-09-12T01:37:47.874423+0000","last_clean":"2024-09-12T01:37:47.874423+0000","last_became_active":"2024-09-12T00:25:00.483327+0000","last_became_peered":"2024-09-12T00:25:00.483327+0000","last_unstale":"2024-09-12T01:37:47.874423+0000","last_undegraded":"2024-09-12T01:37:47.874423+0000","last_fullsized":"2024-09-12T01:37:47.874423+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T01:37:47.874305+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T01:37:47.874305+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.874305+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:25.303987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395812,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":12020,"num_write":922,"num_write_kb":12011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'411","reported_seq":2010,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.626361+0000","last_change":"2024-09-12T01:38:06.626361+0000","last_active":"2024-09-12T01:38:06.626361+0000","last_peered":"2024-09-12T01:38:06.626361+0000","last_clean":"2024-09-12T01:38:06.626361+0000","last_became_active":"2024-09-12T00:25:02.471598+0000","last_became_peered":"2024-09-12T00:25:02.471598+0000","last_unstale":"2024-09-12T01:38:06.626361+0000","last_undegraded":"2024-09-12T01:38:06.626361+0000","last_fullsized":"2024-09-12T01:38:06.626361+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'411","last_scrub_stamp":"2024-09-12T01:38:06.626274+0000","last_deep_scrub":"266'411","last_deep_scrub_stamp":"2024-09-12T01:38:06.626274+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.626274+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:26.680294+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2389,"num_read_kb":2272,"num_write":462,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3460,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'177","reported_seq":844,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.284808+0000","last_change":"2024-09-12T01:37:52.284808+0000","last_active":"2024-09-12T01:37:52.284808+0000","last_peered":"2024-09-12T01:37:52.284808+0000","last_clean":"2024-09-12T01:37:52.284808+0000","last_became_active":"2024-09-12T00:25:00.478202+0000","last_became_peered":"2024-09-12T00:25:00.478202+0000","last_unstale":"2024-09-12T01:37:52.284808+0000","last_undegraded":"2024-09-12T01:37:52.284808+0000","last_fullsized":"2024-09-12T01:37:52.284808+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T01:37:52.284701+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T01:37:52.284701+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.284701+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:47.992887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":78408,"num_write":837,"num_write_kb":24955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'665","reported_seq":2206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.925694+0000","last_change":"2024-09-12T01:37:55.925694+0000","last_active":"2024-09-12T01:37:55.925694+0000","last_peered":"2024-09-12T01:37:55.925694+0000","last_clean":"2024-09-12T01:37:55.925694+0000","last_became_active":"2024-09-12T00:25:02.470278+0000","last_became_peered":"2024-09-12T00:25:02.470278+0000","last_unstale":"2024-09-12T01:37:55.925694+0000","last_undegraded":"2024-09-12T01:37:55.925694+0000","last_fullsized":"2024-09-12T01:37:55.925694+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'665","last_scrub_stamp":"2024-09-12T01:37:55.925590+0000","last_deep_scrub":"266'665","last_deep_scrub_stamp":"2024-09-12T01:37:55.925590+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.925590+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":600,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:59.829971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3455,"num_read_kb":3151,"num_write":936,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'238","reported_seq":915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.212407+0000","last_change":"2024-09-12T01:37:50.212407+0000","last_active":"2024-09-12T01:37:50.212407+0000","last_peered":"2024-09-12T01:37:50.212407+0000","last_clean":"2024-09-12T01:37:50.212407+0000","last_became_active":"2024-09-12T00:25:00.456765+0000","last_became_peered":"2024-09-12T00:25:00.456765+0000","last_unstale":"2024-09-12T01:37:50.212407+0000","last_undegraded":"2024-09-12T01:37:50.212407+0000","last_fullsized":"2024-09-12T01:37:50.212407+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'238","last_scrub_stamp":"2024-09-12T01:37:50.212298+0000","last_deep_scrub":"266'238","last_deep_scrub_stamp":"2024-09-12T01:37:50.212298+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.212298+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:59.941924+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496550,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":628,"num_read_kb":22861,"num_write":1212,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'130","reported_seq":650,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.818021+0000","last_change":"2024-09-12T01:38:10.818021+0000","last_active":"2024-09-12T01:38:10.818021+0000","last_peered":"2024-09-12T01:38:10.818021+0000","last_clean":"2024-09-12T01:38:10.818021+0000","last_became_active":"2024-09-12T00:25:10.523187+0000","last_became_peered":"2024-09-12T00:25:10.523187+0000","last_unstale":"2024-09-12T01:38:10.818021+0000","last_undegraded":"2024-09-12T01:38:10.818021+0000","last_fullsized":"2024-09-12T01:38:10.818021+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'130","last_scrub_stamp":"2024-09-12T01:38:10.817927+0000","last_deep_scrub":"266'130","last_deep_scrub_stamp":"2024-09-12T01:38:10.817927+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.817927+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:55.101000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'452","reported_seq":2147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.335059+0000","last_change":"2024-09-12T01:37:57.335059+0000","last_active":"2024-09-12T01:37:57.335059+0000","last_peered":"2024-09-12T01:37:57.335059+0000","last_clean":"2024-09-12T01:37:57.335059+0000","last_became_active":"2024-09-12T00:25:02.464035+0000","last_became_peered":"2024-09-12T00:25:02.464035+0000","last_unstale":"2024-09-12T01:37:57.335059+0000","last_undegraded":"2024-09-12T01:37:57.335059+0000","last_fullsized":"2024-09-12T01:37:57.335059+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'452","last_scrub_stamp":"2024-09-12T01:37:57.334965+0000","last_deep_scrub":"266'452","last_deep_scrub_stamp":"2024-09-12T01:37:57.334965+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.334965+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.139483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2614,"num_read_kb":2487,"num_write":526,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'214","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.033783+0000","last_change":"2024-09-12T01:37:51.033783+0000","last_active":"2024-09-12T01:37:51.033783+0000","last_peered":"2024-09-12T01:37:51.033783+0000","last_clean":"2024-09-12T01:37:51.033783+0000","last_became_active":"2024-09-12T00:25:00.479335+0000","last_became_peered":"2024-09-12T00:25:00.479335+0000","last_unstale":"2024-09-12T01:37:51.033783+0000","last_undegraded":"2024-09-12T01:37:51.033783+0000","last_fullsized":"2024-09-12T01:37:51.033783+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'214","last_scrub_stamp":"2024-09-12T01:37:51.033591+0000","last_deep_scrub":"266'214","last_deep_scrub_stamp":"2024-09-12T01:37:51.033591+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.033591+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:30.332562+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1920160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":7515,"num_write":984,"num_write_kb":32910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.898679+0000","last_change":"2024-09-12T01:38:14.898679+0000","last_active":"2024-09-12T01:38:14.898679+0000","last_peered":"2024-09-12T01:38:14.898679+0000","last_clean":"2024-09-12T01:38:14.898679+0000","last_became_active":"2024-09-12T00:25:04.485389+0000","last_became_peered":"2024-09-12T00:25:04.485389+0000","last_unstale":"2024-09-12T01:38:14.898679+0000","last_undegraded":"2024-09-12T01:38:14.898679+0000","last_fullsized":"2024-09-12T01:38:14.898679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:14.898574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:14.898574+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.898574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:20.316403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'226","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.400672+0000","last_change":"2024-09-12T01:38:13.400672+0000","last_active":"2024-09-12T01:38:13.400672+0000","last_peered":"2024-09-12T01:38:13.400672+0000","last_clean":"2024-09-12T01:38:13.400672+0000","last_became_active":"2024-09-12T00:25:06.499933+0000","last_became_peered":"2024-09-12T00:25:06.499933+0000","last_unstale":"2024-09-12T01:38:13.400672+0000","last_undegraded":"2024-09-12T01:38:13.400672+0000","last_fullsized":"2024-09-12T01:38:13.400672+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:38:13.400555+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:38:13.400555+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.400555+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:34.461485+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7477,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":376,"num_write":176,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.815984+0000","last_change":"2024-09-12T01:38:09.815984+0000","last_active":"2024-09-12T01:38:09.815984+0000","last_peered":"2024-09-12T01:38:09.815984+0000","last_clean":"2024-09-12T01:38:09.815984+0000","last_became_active":"2024-09-12T00:25:08.501137+0000","last_became_peered":"2024-09-12T00:25:08.501137+0000","last_unstale":"2024-09-12T01:38:09.815984+0000","last_undegraded":"2024-09-12T01:38:09.815984+0000","last_fullsized":"2024-09-12T01:38:09.815984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.815888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.815888+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.815888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:44.572150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2437","reported_seq":4343,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.824280+0000","last_change":"2024-09-12T01:38:12.824280+0000","last_active":"2024-09-12T01:38:12.824280+0000","last_peered":"2024-09-12T01:38:12.824280+0000","last_clean":"2024-09-12T01:38:12.824280+0000","last_became_active":"2024-09-12T00:25:10.526016+0000","last_became_peered":"2024-09-12T00:25:10.526016+0000","last_unstale":"2024-09-12T01:38:12.824280+0000","last_undegraded":"2024-09-12T01:38:12.824280+0000","last_fullsized":"2024-09-12T01:38:12.824280+0000","mapping_epoch":36,"log_start":"266'2400","ondisk_log_start":"266'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2437","last_scrub_stamp":"2024-09-12T01:38:12.824166+0000","last_deep_scrub":"266'2437","last_deep_scrub_stamp":"2024-09-12T01:38:12.824166+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.824166+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":2400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:50.109401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6097,"num_read_kb":6097,"num_write":4851,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'892","reported_seq":2339,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.973679+0000","last_change":"2024-09-12T01:38:04.973679+0000","last_active":"2024-09-12T01:38:04.973679+0000","last_peered":"2024-09-12T01:38:04.973679+0000","last_clean":"2024-09-12T01:38:04.973679+0000","last_became_active":"2024-09-12T00:25:02.477360+0000","last_became_peered":"2024-09-12T00:25:02.477360+0000","last_unstale":"2024-09-12T01:38:04.973679+0000","last_undegraded":"2024-09-12T01:38:04.973679+0000","last_fullsized":"2024-09-12T01:38:04.973679+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'892","last_scrub_stamp":"2024-09-12T01:38:04.973568+0000","last_deep_scrub":"266'892","last_deep_scrub_stamp":"2024-09-12T01:38:04.973568+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.973568+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:59.857176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4073,"num_read_kb":3587,"num_write":1238,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'213","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.310189+0000","last_change":"2024-09-12T01:37:47.310189+0000","last_active":"2024-09-12T01:37:47.310189+0000","last_peered":"2024-09-12T01:37:47.310189+0000","last_clean":"2024-09-12T01:37:47.310189+0000","last_became_active":"2024-09-12T00:25:00.452236+0000","last_became_peered":"2024-09-12T00:25:00.452236+0000","last_unstale":"2024-09-12T01:37:47.310189+0000","last_undegraded":"2024-09-12T01:37:47.310189+0000","last_fullsized":"2024-09-12T01:37:47.310189+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T01:37:47.310082+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T01:37:47.310082+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.310082+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:32.824803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084046,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":27979,"num_write":1022,"num_write_kb":43410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.365412+0000","last_change":"2024-09-12T01:38:06.365412+0000","last_active":"2024-09-12T01:38:06.365412+0000","last_peered":"2024-09-12T01:38:06.365412+0000","last_clean":"2024-09-12T01:38:06.365412+0000","last_became_active":"2024-09-12T00:25:04.481218+0000","last_became_peered":"2024-09-12T00:25:04.481218+0000","last_unstale":"2024-09-12T01:38:06.365412+0000","last_undegraded":"2024-09-12T01:38:06.365412+0000","last_fullsized":"2024-09-12T01:38:06.365412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.365322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.365322+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.365322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:31.549095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'131","reported_seq":688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.820345+0000","last_change":"2024-09-12T01:38:03.820345+0000","last_active":"2024-09-12T01:38:03.820345+0000","last_peered":"2024-09-12T01:38:03.820345+0000","last_clean":"2024-09-12T01:38:03.820345+0000","last_became_active":"2024-09-12T00:25:06.490463+0000","last_became_peered":"2024-09-12T00:25:06.490463+0000","last_unstale":"2024-09-12T01:38:03.820345+0000","last_undegraded":"2024-09-12T01:38:03.820345+0000","last_fullsized":"2024-09-12T01:38:03.820345+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'131","last_scrub_stamp":"2024-09-12T01:38:03.820249+0000","last_deep_scrub":"266'131","last_deep_scrub_stamp":"2024-09-12T01:38:03.820249+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.820249+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:39.548081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":131,"num_write":102,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.820695+0000","last_change":"2024-09-12T01:38:08.820695+0000","last_active":"2024-09-12T01:38:08.820695+0000","last_peered":"2024-09-12T01:38:08.820695+0000","last_clean":"2024-09-12T01:38:08.820695+0000","last_became_active":"2024-09-12T00:25:08.505492+0000","last_became_peered":"2024-09-12T00:25:08.505492+0000","last_unstale":"2024-09-12T01:38:08.820695+0000","last_undegraded":"2024-09-12T01:38:08.820695+0000","last_fullsized":"2024-09-12T01:38:08.820695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.820592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.820592+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.820592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:47.296176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'143","reported_seq":672,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.324625+0000","last_change":"2024-09-12T01:38:13.324625+0000","last_active":"2024-09-12T01:38:13.324625+0000","last_peered":"2024-09-12T01:38:13.324625+0000","last_clean":"2024-09-12T01:38:13.324625+0000","last_became_active":"2024-09-12T00:25:10.522822+0000","last_became_peered":"2024-09-12T00:25:10.522822+0000","last_unstale":"2024-09-12T01:38:13.324625+0000","last_undegraded":"2024-09-12T01:38:13.324625+0000","last_fullsized":"2024-09-12T01:38:13.324625+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'143","last_scrub_stamp":"2024-09-12T01:38:13.324526+0000","last_deep_scrub":"266'143","last_deep_scrub_stamp":"2024-09-12T01:38:13.324526+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.324526+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:12.809401+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":196,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'484","reported_seq":2032,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.634426+0000","last_change":"2024-09-12T01:38:03.634426+0000","last_active":"2024-09-12T01:38:03.634426+0000","last_peered":"2024-09-12T01:38:03.634426+0000","last_clean":"2024-09-12T01:38:03.634426+0000","last_became_active":"2024-09-12T00:25:02.478850+0000","last_became_peered":"2024-09-12T00:25:02.478850+0000","last_unstale":"2024-09-12T01:38:03.634426+0000","last_undegraded":"2024-09-12T01:38:03.634426+0000","last_fullsized":"2024-09-12T01:38:03.634426+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'484","last_scrub_stamp":"2024-09-12T01:38:03.634343+0000","last_deep_scrub":"266'484","last_deep_scrub_stamp":"2024-09-12T01:38:03.634343+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.634343+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:40.357076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2311,"num_write":575,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'203","reported_seq":871,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.039288+0000","last_change":"2024-09-12T01:37:59.039288+0000","last_active":"2024-09-12T01:37:59.039288+0000","last_peered":"2024-09-12T01:37:59.039288+0000","last_clean":"2024-09-12T01:37:59.039288+0000","last_became_active":"2024-09-12T00:25:00.475628+0000","last_became_peered":"2024-09-12T00:25:00.475628+0000","last_unstale":"2024-09-12T01:37:59.039288+0000","last_undegraded":"2024-09-12T01:37:59.039288+0000","last_fullsized":"2024-09-12T01:37:59.039288+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'203","last_scrub_stamp":"2024-09-12T01:37:59.039165+0000","last_deep_scrub":"266'203","last_deep_scrub_stamp":"2024-09-12T01:37:59.039165+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.039165+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:59.337559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":1110,"num_write":851,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.359178+0000","last_change":"2024-09-12T01:38:05.359178+0000","last_active":"2024-09-12T01:38:05.359178+0000","last_peered":"2024-09-12T01:38:05.359178+0000","last_clean":"2024-09-12T01:38:05.359178+0000","last_became_active":"2024-09-12T00:25:04.483774+0000","last_became_peered":"2024-09-12T00:25:04.483774+0000","last_unstale":"2024-09-12T01:38:05.359178+0000","last_undegraded":"2024-09-12T01:38:05.359178+0000","last_fullsized":"2024-09-12T01:38:05.359178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:05.359093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:05.359093+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.359093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:49.765095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'150","reported_seq":734,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.403260+0000","last_change":"2024-09-12T01:38:12.403260+0000","last_active":"2024-09-12T01:38:12.403260+0000","last_peered":"2024-09-12T01:38:12.403260+0000","last_clean":"2024-09-12T01:38:12.403260+0000","last_became_active":"2024-09-12T00:25:06.500991+0000","last_became_peered":"2024-09-12T00:25:06.500991+0000","last_unstale":"2024-09-12T01:38:12.403260+0000","last_undegraded":"2024-09-12T01:38:12.403260+0000","last_fullsized":"2024-09-12T01:38:12.403260+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'150","last_scrub_stamp":"2024-09-12T01:38:12.403148+0000","last_deep_scrub":"266'150","last_deep_scrub_stamp":"2024-09-12T01:38:12.403148+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.403148+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:48.895619+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'798","reported_seq":4875,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.825438+0000","last_change":"2024-09-12T01:38:23.825438+0000","last_active":"2024-09-12T01:38:23.825438+0000","last_peered":"2024-09-12T01:38:23.825438+0000","last_clean":"2024-09-12T01:38:23.825438+0000","last_became_active":"2024-09-12T00:25:08.514360+0000","last_became_peered":"2024-09-12T00:25:08.514360+0000","last_unstale":"2024-09-12T01:38:23.825438+0000","last_undegraded":"2024-09-12T01:38:23.825438+0000","last_fullsized":"2024-09-12T01:38:23.825438+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'798","last_scrub_stamp":"2024-09-12T01:38:23.825351+0000","last_deep_scrub":"266'798","last_deep_scrub_stamp":"2024-09-12T01:38:23.825351+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.825351+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:59.908771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'204","reported_seq":1047,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.745394+0000","last_change":"2024-09-12T01:38:12.745394+0000","last_active":"2024-09-12T01:38:12.745394+0000","last_peered":"2024-09-12T01:38:12.745394+0000","last_clean":"2024-09-12T01:38:12.745394+0000","last_became_active":"2024-09-12T00:25:10.518861+0000","last_became_peered":"2024-09-12T00:25:10.518861+0000","last_unstale":"2024-09-12T01:38:12.745394+0000","last_undegraded":"2024-09-12T01:38:12.745394+0000","last_fullsized":"2024-09-12T01:38:12.745394+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'204","last_scrub_stamp":"2024-09-12T01:38:12.745294+0000","last_deep_scrub":"266'204","last_deep_scrub_stamp":"2024-09-12T01:38:12.745294+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.745294+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:23.575790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":600,"num_write":435,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'469","reported_seq":1997,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.640342+0000","last_change":"2024-09-12T01:38:04.640342+0000","last_active":"2024-09-12T01:38:04.640342+0000","last_peered":"2024-09-12T01:38:04.640342+0000","last_clean":"2024-09-12T01:38:04.640342+0000","last_became_active":"2024-09-12T00:25:02.477052+0000","last_became_peered":"2024-09-12T00:25:02.477052+0000","last_unstale":"2024-09-12T01:38:04.640342+0000","last_undegraded":"2024-09-12T01:38:04.640342+0000","last_fullsized":"2024-09-12T01:38:04.640342+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'469","last_scrub_stamp":"2024-09-12T01:38:04.640258+0000","last_deep_scrub":"266'469","last_deep_scrub_stamp":"2024-09-12T01:38:04.640258+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.640258+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:13.597150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2388,"num_read_kb":2234,"num_write":549,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'224","reported_seq":877,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.855846+0000","last_change":"2024-09-12T01:37:47.855846+0000","last_active":"2024-09-12T01:37:47.855846+0000","last_peered":"2024-09-12T01:37:47.855846+0000","last_clean":"2024-09-12T01:37:47.855846+0000","last_became_active":"2024-09-12T00:25:00.457828+0000","last_became_peered":"2024-09-12T00:25:00.457828+0000","last_unstale":"2024-09-12T01:37:47.855846+0000","last_undegraded":"2024-09-12T01:37:47.855846+0000","last_fullsized":"2024-09-12T01:37:47.855846+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'224","last_scrub_stamp":"2024-09-12T01:37:47.855735+0000","last_deep_scrub":"266'224","last_deep_scrub_stamp":"2024-09-12T01:37:47.855735+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.855735+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:52.029177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":9782,"num_write":1039,"num_write_kb":35060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.933842+0000","last_change":"2024-09-12T01:38:13.933842+0000","last_active":"2024-09-12T01:38:13.933842+0000","last_peered":"2024-09-12T01:38:13.933842+0000","last_clean":"2024-09-12T01:38:13.933842+0000","last_became_active":"2024-09-12T00:25:04.482173+0000","last_became_peered":"2024-09-12T00:25:04.482173+0000","last_unstale":"2024-09-12T01:38:13.933842+0000","last_undegraded":"2024-09-12T01:38:13.933842+0000","last_fullsized":"2024-09-12T01:38:13.933842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:13.933756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:13.933756+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.933756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:45.433581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'162","reported_seq":763,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.723613+0000","last_change":"2024-09-12T01:38:03.723613+0000","last_active":"2024-09-12T01:38:03.723613+0000","last_peered":"2024-09-12T01:38:03.723613+0000","last_clean":"2024-09-12T01:38:03.723613+0000","last_became_active":"2024-09-12T00:25:06.491337+0000","last_became_peered":"2024-09-12T00:25:06.491337+0000","last_unstale":"2024-09-12T01:38:03.723613+0000","last_undegraded":"2024-09-12T01:38:03.723613+0000","last_fullsized":"2024-09-12T01:38:03.723613+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'162","last_scrub_stamp":"2024-09-12T01:38:03.723515+0000","last_deep_scrub":"266'162","last_deep_scrub_stamp":"2024-09-12T01:38:03.723515+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.723515+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:22.002913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5611,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":280,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'802","reported_seq":2777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.623540+0000","last_change":"2024-09-12T01:38:15.623540+0000","last_active":"2024-09-12T01:38:15.623540+0000","last_peered":"2024-09-12T01:38:15.623540+0000","last_clean":"2024-09-12T01:38:15.623540+0000","last_became_active":"2024-09-12T00:25:08.512125+0000","last_became_peered":"2024-09-12T00:25:08.512125+0000","last_unstale":"2024-09-12T01:38:15.623540+0000","last_undegraded":"2024-09-12T01:38:15.623540+0000","last_fullsized":"2024-09-12T01:38:15.623540+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'802","last_scrub_stamp":"2024-09-12T01:38:15.623462+0000","last_deep_scrub":"266'802","last_deep_scrub_stamp":"2024-09-12T01:38:15.623462+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.623462+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:58.941127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'2026","reported_seq":3655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.975531+0000","last_change":"2024-09-12T01:38:02.975474+0000","last_active":"2024-09-12T01:38:02.975531+0000","last_peered":"2024-09-12T01:38:02.975531+0000","last_clean":"2024-09-12T01:38:02.975531+0000","last_became_active":"2024-09-12T00:25:02.465239+0000","last_became_peered":"2024-09-12T00:25:02.465239+0000","last_unstale":"2024-09-12T01:38:02.975531+0000","last_undegraded":"2024-09-12T01:38:02.975531+0000","last_fullsized":"2024-09-12T01:38:02.975531+0000","mapping_epoch":28,"log_start":"266'2000","ondisk_log_start":"266'2000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2026","last_scrub_stamp":"2024-09-12T01:38:02.975389+0000","last_deep_scrub":"266'2026","last_deep_scrub_stamp":"2024-09-12T01:38:02.975389+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.975389+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":2000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:35.114687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8773,"num_read_kb":7539,"num_write":2902,"num_write_kb":1299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":707,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'179","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.933037+0000","last_change":"2024-09-12T01:37:44.933037+0000","last_active":"2024-09-12T01:37:44.933037+0000","last_peered":"2024-09-12T01:37:44.933037+0000","last_clean":"2024-09-12T01:37:44.933037+0000","last_became_active":"2024-09-12T00:25:00.466899+0000","last_became_peered":"2024-09-12T00:25:00.466899+0000","last_unstale":"2024-09-12T01:37:44.933037+0000","last_undegraded":"2024-09-12T01:37:44.933037+0000","last_fullsized":"2024-09-12T01:37:44.933037+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'179","last_scrub_stamp":"2024-09-12T01:37:44.932938+0000","last_deep_scrub":"266'179","last_deep_scrub_stamp":"2024-09-12T01:37:44.932938+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.932938+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:07.942233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":366,"num_read_kb":8806,"num_write":851,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.916283+0000","last_change":"2024-09-12T01:37:57.916231+0000","last_active":"2024-09-12T01:37:57.916283+0000","last_peered":"2024-09-12T01:37:57.916283+0000","last_clean":"2024-09-12T01:37:57.916283+0000","last_became_active":"2024-09-12T00:25:04.482885+0000","last_became_peered":"2024-09-12T00:25:04.482885+0000","last_unstale":"2024-09-12T01:37:57.916283+0000","last_undegraded":"2024-09-12T01:37:57.916283+0000","last_fullsized":"2024-09-12T01:37:57.916283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:57.916140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:57.916140+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.916140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:21.912079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'273","reported_seq":934,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.883497+0000","last_change":"2024-09-12T01:38:03.883497+0000","last_active":"2024-09-12T01:38:03.883497+0000","last_peered":"2024-09-12T01:38:03.883497+0000","last_clean":"2024-09-12T01:38:03.883497+0000","last_became_active":"2024-09-12T00:25:06.497881+0000","last_became_peered":"2024-09-12T00:25:06.497881+0000","last_unstale":"2024-09-12T01:38:03.883497+0000","last_undegraded":"2024-09-12T01:38:03.883497+0000","last_fullsized":"2024-09-12T01:38:03.883497+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'273","last_scrub_stamp":"2024-09-12T01:38:03.883401+0000","last_deep_scrub":"266'273","last_deep_scrub_stamp":"2024-09-12T01:38:03.883401+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.883401+0000","objects_scrubbed":10,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:36.967915+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20748,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":371,"num_read_kb":470,"num_write":222,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.310704+0000","last_change":"2024-09-12T01:38:10.310704+0000","last_active":"2024-09-12T01:38:10.310704+0000","last_peered":"2024-09-12T01:38:10.310704+0000","last_clean":"2024-09-12T01:38:10.310704+0000","last_became_active":"2024-09-12T00:25:08.507993+0000","last_became_peered":"2024-09-12T00:25:08.507993+0000","last_unstale":"2024-09-12T01:38:10.310704+0000","last_undegraded":"2024-09-12T01:38:10.310704+0000","last_fullsized":"2024-09-12T01:38:10.310704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.310587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.310587+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.310587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:52.686063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'577","reported_seq":1431,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.706235+0000","last_change":"2024-09-12T01:38:09.706235+0000","last_active":"2024-09-12T01:38:09.706235+0000","last_peered":"2024-09-12T01:38:09.706235+0000","last_clean":"2024-09-12T01:38:09.706235+0000","last_became_active":"2024-09-12T00:25:10.528021+0000","last_became_peered":"2024-09-12T00:25:10.528021+0000","last_unstale":"2024-09-12T01:38:09.706235+0000","last_undegraded":"2024-09-12T01:38:09.706235+0000","last_fullsized":"2024-09-12T01:38:09.706235+0000","mapping_epoch":36,"log_start":"266'500","ondisk_log_start":"266'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'577","last_scrub_stamp":"2024-09-12T01:38:09.706127+0000","last_deep_scrub":"266'577","last_deep_scrub_stamp":"2024-09-12T01:38:09.706127+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.706127+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:29.078031+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1390,"num_read_kb":1363,"num_write":1223,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'495","reported_seq":2165,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.901052+0000","last_change":"2024-09-12T01:37:49.900930+0000","last_active":"2024-09-12T01:37:49.901052+0000","last_peered":"2024-09-12T01:37:49.901052+0000","last_clean":"2024-09-12T01:37:49.901052+0000","last_became_active":"2024-09-12T00:25:02.467846+0000","last_became_peered":"2024-09-12T00:25:02.467846+0000","last_unstale":"2024-09-12T01:37:49.901052+0000","last_undegraded":"2024-09-12T01:37:49.901052+0000","last_fullsized":"2024-09-12T01:37:49.901052+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'495","last_scrub_stamp":"2024-09-12T01:37:49.900834+0000","last_deep_scrub":"266'495","last_deep_scrub_stamp":"2024-09-12T01:37:49.900834+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.900834+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.878364+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2600,"num_read_kb":2447,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'208","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.530686+0000","last_change":"2024-09-12T01:37:44.530686+0000","last_active":"2024-09-12T01:37:44.530686+0000","last_peered":"2024-09-12T01:37:44.530686+0000","last_clean":"2024-09-12T01:37:44.530686+0000","last_became_active":"2024-09-12T00:25:00.486471+0000","last_became_peered":"2024-09-12T00:25:00.486471+0000","last_unstale":"2024-09-12T01:37:44.530686+0000","last_undegraded":"2024-09-12T01:37:44.530686+0000","last_fullsized":"2024-09-12T01:37:44.530686+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:37:44.530555+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:37:44.530555+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.530555+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.391104+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706427,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":18784,"num_write":969,"num_write_kb":38470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.372296+0000","last_change":"2024-09-12T01:38:00.372242+0000","last_active":"2024-09-12T01:38:00.372296+0000","last_peered":"2024-09-12T01:38:00.372296+0000","last_clean":"2024-09-12T01:38:00.372296+0000","last_became_active":"2024-09-12T00:25:04.480469+0000","last_became_peered":"2024-09-12T00:25:04.480469+0000","last_unstale":"2024-09-12T01:38:00.372296+0000","last_undegraded":"2024-09-12T01:38:00.372296+0000","last_fullsized":"2024-09-12T01:38:00.372296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.372086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.372086+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.372086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:46.172826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'153","reported_seq":761,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.421598+0000","last_change":"2024-09-12T01:38:10.421598+0000","last_active":"2024-09-12T01:38:10.421598+0000","last_peered":"2024-09-12T01:38:10.421598+0000","last_clean":"2024-09-12T01:38:10.421598+0000","last_became_active":"2024-09-12T00:25:06.500036+0000","last_became_peered":"2024-09-12T00:25:06.500036+0000","last_unstale":"2024-09-12T01:38:10.421598+0000","last_undegraded":"2024-09-12T01:38:10.421598+0000","last_fullsized":"2024-09-12T01:38:10.421598+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'153","last_scrub_stamp":"2024-09-12T01:38:10.421495+0000","last_deep_scrub":"266'153","last_deep_scrub_stamp":"2024-09-12T01:38:10.421495+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.421495+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.772925+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11217,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":248,"num_write":100,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.346786+0000","last_change":"2024-09-12T01:38:17.346786+0000","last_active":"2024-09-12T01:38:17.346786+0000","last_peered":"2024-09-12T01:38:17.346786+0000","last_clean":"2024-09-12T01:38:17.346786+0000","last_became_active":"2024-09-12T00:25:08.509780+0000","last_became_peered":"2024-09-12T00:25:08.509780+0000","last_unstale":"2024-09-12T01:38:17.346786+0000","last_undegraded":"2024-09-12T01:38:17.346786+0000","last_fullsized":"2024-09-12T01:38:17.346786+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:17.346660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:17.346660+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.346660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:08.883336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'146","reported_seq":660,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.775739+0000","last_change":"2024-09-12T01:38:10.775680+0000","last_active":"2024-09-12T01:38:10.775739+0000","last_peered":"2024-09-12T01:38:10.775739+0000","last_clean":"2024-09-12T01:38:10.775739+0000","last_became_active":"2024-09-12T00:25:10.527984+0000","last_became_peered":"2024-09-12T00:25:10.527984+0000","last_unstale":"2024-09-12T01:38:10.775739+0000","last_undegraded":"2024-09-12T01:38:10.775739+0000","last_fullsized":"2024-09-12T01:38:10.775739+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'146","last_scrub_stamp":"2024-09-12T01:38:10.775577+0000","last_deep_scrub":"266'146","last_deep_scrub_stamp":"2024-09-12T01:38:10.775577+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.775577+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:53.577692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":124,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'456","reported_seq":2027,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.745822+0000","last_change":"2024-09-12T01:37:53.745822+0000","last_active":"2024-09-12T01:37:53.745822+0000","last_peered":"2024-09-12T01:37:53.745822+0000","last_clean":"2024-09-12T01:37:53.745822+0000","last_became_active":"2024-09-12T00:25:02.469155+0000","last_became_peered":"2024-09-12T00:25:02.469155+0000","last_unstale":"2024-09-12T01:37:53.745822+0000","last_undegraded":"2024-09-12T01:37:53.745822+0000","last_fullsized":"2024-09-12T01:37:53.745822+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T01:37:53.745726+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T01:37:53.745726+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.745726+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:07.128486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2451,"num_write":541,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2546,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'226","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.078785+0000","last_change":"2024-09-12T01:37:52.078785+0000","last_active":"2024-09-12T01:37:52.078785+0000","last_peered":"2024-09-12T01:37:52.078785+0000","last_clean":"2024-09-12T01:37:52.078785+0000","last_became_active":"2024-09-12T00:25:32.563811+0000","last_became_peered":"2024-09-12T00:25:32.563811+0000","last_unstale":"2024-09-12T01:37:52.078785+0000","last_undegraded":"2024-09-12T01:37:52.078785+0000","last_fullsized":"2024-09-12T01:37:52.078785+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:37:52.078628+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:37:52.078628+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.078628+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:10.725907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442172,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":15150,"num_write":1090,"num_write_kb":21884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.666498+0000","last_change":"2024-09-12T01:38:08.666498+0000","last_active":"2024-09-12T01:38:08.666498+0000","last_peered":"2024-09-12T01:38:08.666498+0000","last_clean":"2024-09-12T01:38:08.666498+0000","last_became_active":"2024-09-12T00:25:04.484029+0000","last_became_peered":"2024-09-12T00:25:04.484029+0000","last_unstale":"2024-09-12T01:38:08.666498+0000","last_undegraded":"2024-09-12T01:38:08.666498+0000","last_fullsized":"2024-09-12T01:38:08.666498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.666375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.666375+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.666375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:47.538392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'226","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.956358+0000","last_change":"2024-09-12T01:38:19.956358+0000","last_active":"2024-09-12T01:38:19.956358+0000","last_peered":"2024-09-12T01:38:19.956358+0000","last_clean":"2024-09-12T01:38:19.956358+0000","last_became_active":"2024-09-12T00:25:06.496348+0000","last_became_peered":"2024-09-12T00:25:06.496348+0000","last_unstale":"2024-09-12T01:38:19.956358+0000","last_undegraded":"2024-09-12T01:38:19.956358+0000","last_fullsized":"2024-09-12T01:38:19.956358+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:38:19.956252+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:38:19.956252+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.956252+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:51.627975+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22554,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":293,"num_read_kb":420,"num_write":176,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'801","reported_seq":4597,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.603922+0000","last_change":"2024-09-12T01:38:14.603922+0000","last_active":"2024-09-12T01:38:14.603922+0000","last_peered":"2024-09-12T01:38:14.603922+0000","last_clean":"2024-09-12T01:38:14.603922+0000","last_became_active":"2024-09-12T00:25:08.512086+0000","last_became_peered":"2024-09-12T00:25:08.512086+0000","last_unstale":"2024-09-12T01:38:14.603922+0000","last_undegraded":"2024-09-12T01:38:14.603922+0000","last_fullsized":"2024-09-12T01:38:14.603922+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T01:38:14.603818+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T01:38:14.603818+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.603818+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:14.911689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'132","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.309541+0000","last_change":"2024-09-12T01:38:12.309541+0000","last_active":"2024-09-12T01:38:12.309541+0000","last_peered":"2024-09-12T01:38:12.309541+0000","last_clean":"2024-09-12T01:38:12.309541+0000","last_became_active":"2024-09-12T00:25:10.521322+0000","last_became_peered":"2024-09-12T00:25:10.521322+0000","last_unstale":"2024-09-12T01:38:12.309541+0000","last_undegraded":"2024-09-12T01:38:12.309541+0000","last_fullsized":"2024-09-12T01:38:12.309541+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'132","last_scrub_stamp":"2024-09-12T01:38:12.309452+0000","last_deep_scrub":"266'132","last_deep_scrub_stamp":"2024-09-12T01:38:12.309452+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.309452+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:02.874478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":104,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'397","reported_seq":1849,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.583073+0000","last_change":"2024-09-12T01:38:00.583073+0000","last_active":"2024-09-12T01:38:00.583073+0000","last_peered":"2024-09-12T01:38:00.583073+0000","last_clean":"2024-09-12T01:38:00.583073+0000","last_became_active":"2024-09-12T00:25:02.468609+0000","last_became_peered":"2024-09-12T00:25:02.468609+0000","last_unstale":"2024-09-12T01:38:00.583073+0000","last_undegraded":"2024-09-12T01:38:00.583073+0000","last_fullsized":"2024-09-12T01:38:00.583073+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'397","last_scrub_stamp":"2024-09-12T01:38:00.582971+0000","last_deep_scrub":"266'397","last_deep_scrub_stamp":"2024-09-12T01:38:00.582971+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.582971+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:02.412743+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2038,"num_read_kb":1930,"num_write":430,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'219","reported_seq":978,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.965862+0000","last_change":"2024-09-12T01:37:43.965862+0000","last_active":"2024-09-12T01:37:43.965862+0000","last_peered":"2024-09-12T01:37:43.965862+0000","last_clean":"2024-09-12T01:37:43.965862+0000","last_became_active":"2024-09-12T00:25:00.472065+0000","last_became_peered":"2024-09-12T00:25:00.472065+0000","last_unstale":"2024-09-12T01:37:43.965862+0000","last_undegraded":"2024-09-12T01:37:43.965862+0000","last_fullsized":"2024-09-12T01:37:43.965862+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'219","last_scrub_stamp":"2024-09-12T01:37:43.965697+0000","last_deep_scrub":"266'219","last_deep_scrub_stamp":"2024-09-12T01:37:43.965697+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.965697+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:29.632688+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9573531,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1000,"num_read_kb":31471,"num_write":994,"num_write_kb":39869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"266'5","reported_seq":986,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.364416+0000","last_change":"2024-09-12T01:38:01.364416+0000","last_active":"2024-09-12T01:38:01.364416+0000","last_peered":"2024-09-12T01:38:01.364416+0000","last_clean":"2024-09-12T01:38:01.364416+0000","last_became_active":"2024-09-12T00:25:04.482518+0000","last_became_peered":"2024-09-12T00:25:04.482518+0000","last_unstale":"2024-09-12T01:38:01.364416+0000","last_undegraded":"2024-09-12T01:38:01.364416+0000","last_fullsized":"2024-09-12T01:38:01.364416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:01.364313+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:01.364313+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.364313+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.761280+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'231","reported_seq":907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.417330+0000","last_change":"2024-09-12T01:38:09.417330+0000","last_active":"2024-09-12T01:38:09.417330+0000","last_peered":"2024-09-12T01:38:09.417330+0000","last_clean":"2024-09-12T01:38:09.417330+0000","last_became_active":"2024-09-12T00:25:06.497269+0000","last_became_peered":"2024-09-12T00:25:06.497269+0000","last_unstale":"2024-09-12T01:38:09.417330+0000","last_undegraded":"2024-09-12T01:38:09.417330+0000","last_fullsized":"2024-09-12T01:38:09.417330+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'231","last_scrub_stamp":"2024-09-12T01:38:09.417231+0000","last_deep_scrub":"266'231","last_deep_scrub_stamp":"2024-09-12T01:38:09.417231+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.417231+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:22.167254+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14775,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":319,"num_read_kb":439,"num_write":162,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.587151+0000","last_change":"2024-09-12T01:38:13.587151+0000","last_active":"2024-09-12T01:38:13.587151+0000","last_peered":"2024-09-12T01:38:13.587151+0000","last_clean":"2024-09-12T01:38:13.587151+0000","last_became_active":"2024-09-12T00:25:08.513758+0000","last_became_peered":"2024-09-12T00:25:08.513758+0000","last_unstale":"2024-09-12T01:38:13.587151+0000","last_undegraded":"2024-09-12T01:38:13.587151+0000","last_fullsized":"2024-09-12T01:38:13.587151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:13.587070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:13.587070+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.587070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:46.236900+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'133","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.598660+0000","last_change":"2024-09-12T01:38:10.598660+0000","last_active":"2024-09-12T01:38:10.598660+0000","last_peered":"2024-09-12T01:38:10.598660+0000","last_clean":"2024-09-12T01:38:10.598660+0000","last_became_active":"2024-09-12T00:25:10.524500+0000","last_became_peered":"2024-09-12T00:25:10.524500+0000","last_unstale":"2024-09-12T01:38:10.598660+0000","last_undegraded":"2024-09-12T01:38:10.598660+0000","last_fullsized":"2024-09-12T01:38:10.598660+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'133","last_scrub_stamp":"2024-09-12T01:38:10.598557+0000","last_deep_scrub":"266'133","last_deep_scrub_stamp":"2024-09-12T01:38:10.598557+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.598557+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:16.839450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":199,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'395","reported_seq":2036,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.771482+0000","last_change":"2024-09-12T01:37:57.771482+0000","last_active":"2024-09-12T01:37:57.771482+0000","last_peered":"2024-09-12T01:37:57.771482+0000","last_clean":"2024-09-12T01:37:57.771482+0000","last_became_active":"2024-09-12T00:25:02.476549+0000","last_became_peered":"2024-09-12T00:25:02.476549+0000","last_unstale":"2024-09-12T01:37:57.771482+0000","last_undegraded":"2024-09-12T01:37:57.771482+0000","last_fullsized":"2024-09-12T01:37:57.771482+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'395","last_scrub_stamp":"2024-09-12T01:37:57.771387+0000","last_deep_scrub":"266'395","last_deep_scrub_stamp":"2024-09-12T01:37:57.771387+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.771387+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:48.184452+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2368,"num_read_kb":2274,"num_write":449,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2987,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'195","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.440332+0000","last_change":"2024-09-12T01:37:48.440332+0000","last_active":"2024-09-12T01:37:48.440332+0000","last_peered":"2024-09-12T01:37:48.440332+0000","last_clean":"2024-09-12T01:37:48.440332+0000","last_became_active":"2024-09-12T00:25:00.471314+0000","last_became_peered":"2024-09-12T00:25:00.471314+0000","last_unstale":"2024-09-12T01:37:48.440332+0000","last_undegraded":"2024-09-12T01:37:48.440332+0000","last_fullsized":"2024-09-12T01:37:48.440332+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'195","last_scrub_stamp":"2024-09-12T01:37:48.440227+0000","last_deep_scrub":"266'195","last_deep_scrub_stamp":"2024-09-12T01:37:48.440227+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.440227+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:08.826724+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190278,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":11373,"num_write":891,"num_write_kb":19982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.455784+0000","last_change":"2024-09-12T01:37:59.455784+0000","last_active":"2024-09-12T01:37:59.455784+0000","last_peered":"2024-09-12T01:37:59.455784+0000","last_clean":"2024-09-12T01:37:59.455784+0000","last_became_active":"2024-09-12T00:25:04.486111+0000","last_became_peered":"2024-09-12T00:25:04.486111+0000","last_unstale":"2024-09-12T01:37:59.455784+0000","last_undegraded":"2024-09-12T01:37:59.455784+0000","last_fullsized":"2024-09-12T01:37:59.455784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:59.455680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:59.455680+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.455680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:07.373369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'208","reported_seq":820,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.785612+0000","last_change":"2024-09-12T01:38:02.785612+0000","last_active":"2024-09-12T01:38:02.785612+0000","last_peered":"2024-09-12T01:38:02.785612+0000","last_clean":"2024-09-12T01:38:02.785612+0000","last_became_active":"2024-09-12T00:25:06.497247+0000","last_became_peered":"2024-09-12T00:25:06.497247+0000","last_unstale":"2024-09-12T01:38:02.785612+0000","last_undegraded":"2024-09-12T01:38:02.785612+0000","last_fullsized":"2024-09-12T01:38:02.785612+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:38:02.785506+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:38:02.785506+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.785506+0000","objects_scrubbed":7,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:48.928001+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":347,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.405837+0000","last_change":"2024-09-12T01:38:04.405837+0000","last_active":"2024-09-12T01:38:04.405837+0000","last_peered":"2024-09-12T01:38:04.405837+0000","last_clean":"2024-09-12T01:38:04.405837+0000","last_became_active":"2024-09-12T00:25:08.516949+0000","last_became_peered":"2024-09-12T00:25:08.516949+0000","last_unstale":"2024-09-12T01:38:04.405837+0000","last_undegraded":"2024-09-12T01:38:04.405837+0000","last_fullsized":"2024-09-12T01:38:04.405837+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:04.405722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:04.405722+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.405722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'128","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.696334+0000","last_change":"2024-09-12T01:38:18.696334+0000","last_active":"2024-09-12T01:38:18.696334+0000","last_peered":"2024-09-12T01:38:18.696334+0000","last_clean":"2024-09-12T01:38:18.696334+0000","last_became_active":"2024-09-12T00:25:10.530731+0000","last_became_peered":"2024-09-12T00:25:10.530731+0000","last_unstale":"2024-09-12T01:38:18.696334+0000","last_undegraded":"2024-09-12T01:38:18.696334+0000","last_fullsized":"2024-09-12T01:38:18.696334+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'128","last_scrub_stamp":"2024-09-12T01:38:18.696231+0000","last_deep_scrub":"266'128","last_deep_scrub_stamp":"2024-09-12T01:38:18.696231+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.696231+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:55.932641+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":124,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'668","reported_seq":2312,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.971255+0000","last_change":"2024-09-12T01:38:03.971255+0000","last_active":"2024-09-12T01:38:03.971255+0000","last_peered":"2024-09-12T01:38:03.971255+0000","last_clean":"2024-09-12T01:38:03.971255+0000","last_became_active":"2024-09-12T00:25:02.474113+0000","last_became_peered":"2024-09-12T00:25:02.474113+0000","last_unstale":"2024-09-12T01:38:03.971255+0000","last_undegraded":"2024-09-12T01:38:03.971255+0000","last_fullsized":"2024-09-12T01:38:03.971255+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'668","last_scrub_stamp":"2024-09-12T01:38:03.971165+0000","last_deep_scrub":"266'668","last_deep_scrub_stamp":"2024-09-12T01:38:03.971165+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.971165+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:26.531769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3250,"num_read_kb":2990,"num_write":879,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'185","reported_seq":905,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.071985+0000","last_change":"2024-09-12T01:37:50.071985+0000","last_active":"2024-09-12T01:37:50.071985+0000","last_peered":"2024-09-12T01:37:50.071985+0000","last_clean":"2024-09-12T01:37:50.071985+0000","last_became_active":"2024-09-12T00:25:32.562005+0000","last_became_peered":"2024-09-12T00:25:32.562005+0000","last_unstale":"2024-09-12T01:37:50.071985+0000","last_undegraded":"2024-09-12T01:37:50.071985+0000","last_fullsized":"2024-09-12T01:37:50.071985+0000","mapping_epoch":39,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:50.071880+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:50.071880+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.071880+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:27.878944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568762,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":135425,"num_write":898,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.654606+0000","last_change":"2024-09-12T01:38:09.654606+0000","last_active":"2024-09-12T01:38:09.654606+0000","last_peered":"2024-09-12T01:38:09.654606+0000","last_clean":"2024-09-12T01:38:09.654606+0000","last_became_active":"2024-09-12T00:25:04.482744+0000","last_became_peered":"2024-09-12T00:25:04.482744+0000","last_unstale":"2024-09-12T01:38:09.654606+0000","last_undegraded":"2024-09-12T01:38:09.654606+0000","last_fullsized":"2024-09-12T01:38:09.654606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.654507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.654507+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.654507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:26.656064+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'199","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.620669+0000","last_change":"2024-09-12T01:38:10.620669+0000","last_active":"2024-09-12T01:38:10.620669+0000","last_peered":"2024-09-12T01:38:10.620669+0000","last_clean":"2024-09-12T01:38:10.620669+0000","last_became_active":"2024-09-12T00:25:06.497448+0000","last_became_peered":"2024-09-12T00:25:06.497448+0000","last_unstale":"2024-09-12T01:38:10.620669+0000","last_undegraded":"2024-09-12T01:38:10.620669+0000","last_fullsized":"2024-09-12T01:38:10.620669+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'199","last_scrub_stamp":"2024-09-12T01:38:10.620543+0000","last_deep_scrub":"266'199","last_deep_scrub_stamp":"2024-09-12T01:38:10.620543+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.620543+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:40.059609+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":247,"num_read_kb":253,"num_write":136,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'764","reported_seq":2729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.490499+0000","last_change":"2024-09-12T01:38:07.490499+0000","last_active":"2024-09-12T01:38:07.490499+0000","last_peered":"2024-09-12T01:38:07.490499+0000","last_clean":"2024-09-12T01:38:07.490499+0000","last_became_active":"2024-09-12T00:25:08.510134+0000","last_became_peered":"2024-09-12T00:25:08.510134+0000","last_unstale":"2024-09-12T01:38:07.490499+0000","last_undegraded":"2024-09-12T01:38:07.490499+0000","last_fullsized":"2024-09-12T01:38:07.490499+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'764","last_scrub_stamp":"2024-09-12T01:38:07.490413+0000","last_deep_scrub":"266'764","last_deep_scrub_stamp":"2024-09-12T01:38:07.490413+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.490413+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:12.012845+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'129","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.289694+0000","last_change":"2024-09-12T01:38:11.289694+0000","last_active":"2024-09-12T01:38:11.289694+0000","last_peered":"2024-09-12T01:38:11.289694+0000","last_clean":"2024-09-12T01:38:11.289694+0000","last_became_active":"2024-09-12T00:25:10.521992+0000","last_became_peered":"2024-09-12T00:25:10.521992+0000","last_unstale":"2024-09-12T01:38:11.289694+0000","last_undegraded":"2024-09-12T01:38:11.289694+0000","last_fullsized":"2024-09-12T01:38:11.289694+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'129","last_scrub_stamp":"2024-09-12T01:38:11.289614+0000","last_deep_scrub":"266'129","last_deep_scrub_stamp":"2024-09-12T01:38:11.289614+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.289614+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:02.917202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":300,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1939,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.708159+0000","last_change":"2024-09-12T01:37:52.708159+0000","last_active":"2024-09-12T01:37:52.708159+0000","last_peered":"2024-09-12T01:37:52.708159+0000","last_clean":"2024-09-12T01:37:52.708159+0000","last_became_active":"2024-09-12T00:25:02.468401+0000","last_became_peered":"2024-09-12T00:25:02.468401+0000","last_unstale":"2024-09-12T01:37:52.708159+0000","last_undegraded":"2024-09-12T01:37:52.708159+0000","last_fullsized":"2024-09-12T01:37:52.708159+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T01:37:52.708072+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T01:37:52.708072+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.708072+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.220170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2162,"num_read_kb":2053,"num_write":481,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'266","reported_seq":945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.032571+0000","last_change":"2024-09-12T01:37:57.032506+0000","last_active":"2024-09-12T01:37:57.032571+0000","last_peered":"2024-09-12T01:37:57.032571+0000","last_clean":"2024-09-12T01:37:57.032571+0000","last_became_active":"2024-09-12T00:25:00.474471+0000","last_became_peered":"2024-09-12T00:25:00.474471+0000","last_unstale":"2024-09-12T01:37:57.032571+0000","last_undegraded":"2024-09-12T01:37:57.032571+0000","last_fullsized":"2024-09-12T01:37:57.032571+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'266","last_scrub_stamp":"2024-09-12T01:37:57.032348+0000","last_deep_scrub":"266'266","last_deep_scrub_stamp":"2024-09-12T01:37:57.032348+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.032348+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:38.613541+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2612534,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":560,"num_read_kb":17654,"num_write":1154,"num_write_kb":37946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"266'4","reported_seq":1463,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.871477+0000","last_change":"2024-09-12T01:37:58.871477+0000","last_active":"2024-09-12T01:37:58.871477+0000","last_peered":"2024-09-12T01:37:58.871477+0000","last_clean":"2024-09-12T01:37:58.871477+0000","last_became_active":"2024-09-12T00:25:04.482824+0000","last_became_peered":"2024-09-12T00:25:04.482824+0000","last_unstale":"2024-09-12T01:37:58.871477+0000","last_undegraded":"2024-09-12T01:37:58.871477+0000","last_fullsized":"2024-09-12T01:37:58.871477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:37:58.871389+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:37:58.871389+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.871389+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:22.816712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":942,"num_read_kb":942,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'108","reported_seq":654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.360718+0000","last_change":"2024-09-12T01:38:04.360718+0000","last_active":"2024-09-12T01:38:04.360718+0000","last_peered":"2024-09-12T01:38:04.360718+0000","last_clean":"2024-09-12T01:38:04.360718+0000","last_became_active":"2024-09-12T00:25:06.499937+0000","last_became_peered":"2024-09-12T00:25:06.499937+0000","last_unstale":"2024-09-12T01:38:04.360718+0000","last_undegraded":"2024-09-12T01:38:04.360718+0000","last_fullsized":"2024-09-12T01:38:04.360718+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'108","last_scrub_stamp":"2024-09-12T01:38:04.360634+0000","last_deep_scrub":"266'108","last_deep_scrub_stamp":"2024-09-12T01:38:04.360634+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.360634+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:51.903468+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'774","reported_seq":2640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.819477+0000","last_change":"2024-09-12T01:38:05.819477+0000","last_active":"2024-09-12T01:38:05.819477+0000","last_peered":"2024-09-12T01:38:05.819477+0000","last_clean":"2024-09-12T01:38:05.819477+0000","last_became_active":"2024-09-12T00:25:08.501192+0000","last_became_peered":"2024-09-12T00:25:08.501192+0000","last_unstale":"2024-09-12T01:38:05.819477+0000","last_undegraded":"2024-09-12T01:38:05.819477+0000","last_fullsized":"2024-09-12T01:38:05.819477+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'774","last_scrub_stamp":"2024-09-12T01:38:05.819387+0000","last_deep_scrub":"266'774","last_deep_scrub_stamp":"2024-09-12T01:38:05.819387+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.819387+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:39.786391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'108","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.742781+0000","last_change":"2024-09-12T01:38:08.742781+0000","last_active":"2024-09-12T01:38:08.742781+0000","last_peered":"2024-09-12T01:38:08.742781+0000","last_clean":"2024-09-12T01:38:08.742781+0000","last_became_active":"2024-09-12T00:25:10.524610+0000","last_became_peered":"2024-09-12T00:25:10.524610+0000","last_unstale":"2024-09-12T01:38:08.742781+0000","last_undegraded":"2024-09-12T01:38:08.742781+0000","last_fullsized":"2024-09-12T01:38:08.742781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'108","last_scrub_stamp":"2024-09-12T01:38:08.742692+0000","last_deep_scrub":"266'108","last_deep_scrub_stamp":"2024-09-12T01:38:08.742692+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.742692+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:44.228250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'791","reported_seq":2446,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.447463+0000","last_change":"2024-09-12T01:37:50.447463+0000","last_active":"2024-09-12T01:37:50.447463+0000","last_peered":"2024-09-12T01:37:50.447463+0000","last_clean":"2024-09-12T01:37:50.447463+0000","last_became_active":"2024-09-12T00:25:02.478793+0000","last_became_peered":"2024-09-12T00:25:02.478793+0000","last_unstale":"2024-09-12T01:37:50.447463+0000","last_undegraded":"2024-09-12T01:37:50.447463+0000","last_fullsized":"2024-09-12T01:37:50.447463+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'791","last_scrub_stamp":"2024-09-12T01:37:50.447358+0000","last_deep_scrub":"266'791","last_deep_scrub_stamp":"2024-09-12T01:37:50.447358+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.447358+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:46.059048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3638,"num_write":1039,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'228","reported_seq":954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.371610+0000","last_change":"2024-09-12T01:37:49.371550+0000","last_active":"2024-09-12T01:37:49.371610+0000","last_peered":"2024-09-12T01:37:49.371610+0000","last_clean":"2024-09-12T01:37:49.371610+0000","last_became_active":"2024-09-12T00:25:32.561102+0000","last_became_peered":"2024-09-12T00:25:32.561102+0000","last_unstale":"2024-09-12T01:37:49.371610+0000","last_undegraded":"2024-09-12T01:37:49.371610+0000","last_fullsized":"2024-09-12T01:37:49.371610+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'228","last_scrub_stamp":"2024-09-12T01:37:49.371405+0000","last_deep_scrub":"266'228","last_deep_scrub_stamp":"2024-09-12T01:37:49.371405+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.371405+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:27.224790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":554,"num_read_kb":71561,"num_write":1047,"num_write_kb":46306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6,0],"acting":[4,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.948026+0000","last_change":"2024-09-12T01:38:11.948026+0000","last_active":"2024-09-12T01:38:11.948026+0000","last_peered":"2024-09-12T01:38:11.948026+0000","last_clean":"2024-09-12T01:38:11.948026+0000","last_became_active":"2024-09-12T00:25:04.484543+0000","last_became_peered":"2024-09-12T00:25:04.484543+0000","last_unstale":"2024-09-12T01:38:11.948026+0000","last_undegraded":"2024-09-12T01:38:11.948026+0000","last_fullsized":"2024-09-12T01:38:11.948026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.947905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.947905+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.947905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:14.132174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'313","reported_seq":959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.822832+0000","last_change":"2024-09-12T01:38:01.822832+0000","last_active":"2024-09-12T01:38:01.822832+0000","last_peered":"2024-09-12T01:38:01.822832+0000","last_clean":"2024-09-12T01:38:01.822832+0000","last_became_active":"2024-09-12T00:25:06.496949+0000","last_became_peered":"2024-09-12T00:25:06.496949+0000","last_unstale":"2024-09-12T01:38:01.822832+0000","last_undegraded":"2024-09-12T01:38:01.822832+0000","last_fullsized":"2024-09-12T01:38:01.822832+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'313","last_scrub_stamp":"2024-09-12T01:38:01.822725+0000","last_deep_scrub":"266'313","last_deep_scrub_stamp":"2024-09-12T01:38:01.822725+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.822725+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:53.190581+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9140,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1014,"num_read_kb":1082,"num_write":1556,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487892,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.684493+0000","last_change":"2024-09-12T01:38:05.684493+0000","last_active":"2024-09-12T01:38:05.684493+0000","last_peered":"2024-09-12T01:38:05.684493+0000","last_clean":"2024-09-12T01:38:05.684493+0000","last_became_active":"2024-09-12T00:25:08.511103+0000","last_became_peered":"2024-09-12T00:25:08.511103+0000","last_unstale":"2024-09-12T01:38:05.684493+0000","last_undegraded":"2024-09-12T01:38:05.684493+0000","last_fullsized":"2024-09-12T01:38:05.684493+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:05.684405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:05.684405+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.684405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:26.132586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'158","reported_seq":671,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.562464+0000","last_change":"2024-09-12T01:38:09.562402+0000","last_active":"2024-09-12T01:38:09.562464+0000","last_peered":"2024-09-12T01:38:09.562464+0000","last_clean":"2024-09-12T01:38:09.562464+0000","last_became_active":"2024-09-12T00:25:10.524399+0000","last_became_peered":"2024-09-12T00:25:10.524399+0000","last_unstale":"2024-09-12T01:38:09.562464+0000","last_undegraded":"2024-09-12T01:38:09.562464+0000","last_fullsized":"2024-09-12T01:38:09.562464+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'158","last_scrub_stamp":"2024-09-12T01:38:09.562318+0000","last_deep_scrub":"266'158","last_deep_scrub_stamp":"2024-09-12T01:38:09.562318+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.562318+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:43.334096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":348,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'526","reported_seq":2120,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.008055+0000","last_change":"2024-09-12T01:38:02.007992+0000","last_active":"2024-09-12T01:38:02.008055+0000","last_peered":"2024-09-12T01:38:02.008055+0000","last_clean":"2024-09-12T01:38:02.008055+0000","last_became_active":"2024-09-12T00:25:02.470508+0000","last_became_peered":"2024-09-12T00:25:02.470508+0000","last_unstale":"2024-09-12T01:38:02.008055+0000","last_undegraded":"2024-09-12T01:38:02.008055+0000","last_fullsized":"2024-09-12T01:38:02.008055+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'526","last_scrub_stamp":"2024-09-12T01:38:02.007907+0000","last_deep_scrub":"266'526","last_deep_scrub_stamp":"2024-09-12T01:38:02.007907+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.007907+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:07.439245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2852,"num_read_kb":2640,"num_write":653,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.840458+0000","last_change":"2024-09-12T01:37:43.840458+0000","last_active":"2024-09-12T01:37:43.840458+0000","last_peered":"2024-09-12T01:37:43.840458+0000","last_clean":"2024-09-12T01:37:43.840458+0000","last_became_active":"2024-09-12T00:24:40.255060+0000","last_became_peered":"2024-09-12T00:24:40.255060+0000","last_unstale":"2024-09-12T01:37:43.840458+0000","last_undegraded":"2024-09-12T01:37:43.840458+0000","last_fullsized":"2024-09-12T01:37:43.840458+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T01:37:43.840360+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T01:37:43.840360+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.840360+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:24.816378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":545,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.023075+0000","last_change":"2024-09-12T01:37:47.023075+0000","last_active":"2024-09-12T01:37:47.023075+0000","last_peered":"2024-09-12T01:37:47.023075+0000","last_clean":"2024-09-12T01:37:47.023075+0000","last_became_active":"2024-09-12T00:24:46.449286+0000","last_became_peered":"2024-09-12T00:24:46.449286+0000","last_unstale":"2024-09-12T01:37:47.023075+0000","last_undegraded":"2024-09-12T01:37:47.023075+0000","last_fullsized":"2024-09-12T01:37:47.023075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:37:47.022957+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:37:47.022957+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.022957+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:19.767332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001069263,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'200","reported_seq":835,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.350405+0000","last_change":"2024-09-12T01:37:46.350307+0000","last_active":"2024-09-12T01:37:46.350405+0000","last_peered":"2024-09-12T01:37:46.350405+0000","last_clean":"2024-09-12T01:37:46.350405+0000","last_became_active":"2024-09-12T00:25:00.465691+0000","last_became_peered":"2024-09-12T00:25:00.465691+0000","last_unstale":"2024-09-12T01:37:46.350405+0000","last_undegraded":"2024-09-12T01:37:46.350405+0000","last_fullsized":"2024-09-12T01:37:46.350405+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'200","last_scrub_stamp":"2024-09-12T01:37:46.350175+0000","last_deep_scrub":"266'200","last_deep_scrub_stamp":"2024-09-12T01:37:46.350175+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.350175+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:03.453089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262165,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":3125,"num_write":969,"num_write_kb":16262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.872809+0000","last_change":"2024-09-12T01:38:01.872809+0000","last_active":"2024-09-12T01:38:01.872809+0000","last_peered":"2024-09-12T01:38:01.872809+0000","last_clean":"2024-09-12T01:38:01.872809+0000","last_became_active":"2024-09-12T00:25:04.483893+0000","last_became_peered":"2024-09-12T00:25:04.483893+0000","last_unstale":"2024-09-12T01:38:01.872809+0000","last_undegraded":"2024-09-12T01:38:01.872809+0000","last_fullsized":"2024-09-12T01:38:01.872809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:01.872703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:01.872703+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.872703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:44.504728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'341","reported_seq":1072,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.954237+0000","last_change":"2024-09-12T01:38:15.954237+0000","last_active":"2024-09-12T01:38:15.954237+0000","last_peered":"2024-09-12T01:38:15.954237+0000","last_clean":"2024-09-12T01:38:15.954237+0000","last_became_active":"2024-09-12T00:25:06.497261+0000","last_became_peered":"2024-09-12T00:25:06.497261+0000","last_unstale":"2024-09-12T01:38:15.954237+0000","last_undegraded":"2024-09-12T01:38:15.954237+0000","last_fullsized":"2024-09-12T01:38:15.954237+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'341","last_scrub_stamp":"2024-09-12T01:38:15.954131+0000","last_deep_scrub":"266'341","last_deep_scrub_stamp":"2024-09-12T01:38:15.954131+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.954131+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:23.333266+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36159,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":620,"num_read_kb":873,"num_write":540,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90450,"num_omap_keys":220,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.663298+0000","last_change":"2024-09-12T01:38:16.663298+0000","last_active":"2024-09-12T01:38:16.663298+0000","last_peered":"2024-09-12T01:38:16.663298+0000","last_clean":"2024-09-12T01:38:16.663298+0000","last_became_active":"2024-09-12T00:25:08.509183+0000","last_became_peered":"2024-09-12T00:25:08.509183+0000","last_unstale":"2024-09-12T01:38:16.663298+0000","last_undegraded":"2024-09-12T01:38:16.663298+0000","last_fullsized":"2024-09-12T01:38:16.663298+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.663221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.663221+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.663221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:38.187616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'218","reported_seq":937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.859715+0000","last_change":"2024-09-12T01:38:09.859715+0000","last_active":"2024-09-12T01:38:09.859715+0000","last_peered":"2024-09-12T01:38:09.859715+0000","last_clean":"2024-09-12T01:38:09.859715+0000","last_became_active":"2024-09-12T00:25:10.525441+0000","last_became_peered":"2024-09-12T00:25:10.525441+0000","last_unstale":"2024-09-12T01:38:09.859715+0000","last_undegraded":"2024-09-12T01:38:09.859715+0000","last_fullsized":"2024-09-12T01:38:09.859715+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T01:38:09.859599+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T01:38:09.859599+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.859599+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:13.164657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":453,"num_read_kb":448,"num_write":488,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'808","reported_seq":2400,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.602928+0000","last_change":"2024-09-12T01:37:59.602855+0000","last_active":"2024-09-12T01:37:59.602928+0000","last_peered":"2024-09-12T01:37:59.602928+0000","last_clean":"2024-09-12T01:37:59.602928+0000","last_became_active":"2024-09-12T00:25:02.478919+0000","last_became_peered":"2024-09-12T00:25:02.478919+0000","last_unstale":"2024-09-12T01:37:59.602928+0000","last_undegraded":"2024-09-12T01:37:59.602928+0000","last_fullsized":"2024-09-12T01:37:59.602928+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'808","last_scrub_stamp":"2024-09-12T01:37:59.602772+0000","last_deep_scrub":"266'808","last_deep_scrub_stamp":"2024-09-12T01:37:59.602772+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.602772+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:55.142030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4003,"num_read_kb":3616,"num_write":1060,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":544,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.985922+0000","last_change":"2024-09-12T01:37:44.985922+0000","last_active":"2024-09-12T01:37:44.985922+0000","last_peered":"2024-09-12T01:37:44.985922+0000","last_clean":"2024-09-12T01:37:44.985922+0000","last_became_active":"2024-09-12T00:24:46.216398+0000","last_became_peered":"2024-09-12T00:24:46.216398+0000","last_unstale":"2024-09-12T01:37:44.985922+0000","last_undegraded":"2024-09-12T01:37:44.985922+0000","last_fullsized":"2024-09-12T01:37:44.985922+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.985834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.985834+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.985834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:51.621846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00080348300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'237","reported_seq":911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.350538+0000","last_change":"2024-09-12T01:37:46.350466+0000","last_active":"2024-09-12T01:37:46.350538+0000","last_peered":"2024-09-12T01:37:46.350538+0000","last_clean":"2024-09-12T01:37:46.350538+0000","last_became_active":"2024-09-12T00:25:00.467622+0000","last_became_peered":"2024-09-12T00:25:00.467622+0000","last_unstale":"2024-09-12T01:37:46.350538+0000","last_undegraded":"2024-09-12T01:37:46.350538+0000","last_fullsized":"2024-09-12T01:37:46.350538+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'237","last_scrub_stamp":"2024-09-12T01:37:46.350355+0000","last_deep_scrub":"266'237","last_deep_scrub_stamp":"2024-09-12T01:37:46.350355+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.350355+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:45.435839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":667699,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":22643,"num_write":1048,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.985551+0000","last_change":"2024-09-12T01:38:10.985481+0000","last_active":"2024-09-12T01:38:10.985551+0000","last_peered":"2024-09-12T01:38:10.985551+0000","last_clean":"2024-09-12T01:38:10.985551+0000","last_became_active":"2024-09-12T00:25:04.483752+0000","last_became_peered":"2024-09-12T00:25:04.483752+0000","last_unstale":"2024-09-12T01:38:10.985551+0000","last_undegraded":"2024-09-12T01:38:10.985551+0000","last_fullsized":"2024-09-12T01:38:10.985551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.985395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.985395+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.985395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:15.823115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'935","reported_seq":2768,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.428621+0000","last_change":"2024-09-12T01:38:02.428563+0000","last_active":"2024-09-12T01:38:02.428621+0000","last_peered":"2024-09-12T01:38:02.428621+0000","last_clean":"2024-09-12T01:38:02.428621+0000","last_became_active":"2024-09-12T00:25:06.491919+0000","last_became_peered":"2024-09-12T00:25:06.491919+0000","last_unstale":"2024-09-12T01:38:02.428621+0000","last_undegraded":"2024-09-12T01:38:02.428621+0000","last_fullsized":"2024-09-12T01:38:02.428621+0000","mapping_epoch":32,"log_start":"266'900","ondisk_log_start":"266'900","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'935","last_scrub_stamp":"2024-09-12T01:38:02.428459+0000","last_deep_scrub":"266'935","last_deep_scrub_stamp":"2024-09-12T01:38:02.428459+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.428459+0000","objects_scrubbed":12,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:06.583646+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26860,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1263,"num_read_kb":1464,"num_write":378,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.852101+0000","last_change":"2024-09-12T01:38:22.852101+0000","last_active":"2024-09-12T01:38:22.852101+0000","last_peered":"2024-09-12T01:38:22.852101+0000","last_clean":"2024-09-12T01:38:22.852101+0000","last_became_active":"2024-09-12T00:25:08.514284+0000","last_became_peered":"2024-09-12T00:25:08.514284+0000","last_unstale":"2024-09-12T01:38:22.852101+0000","last_undegraded":"2024-09-12T01:38:22.852101+0000","last_fullsized":"2024-09-12T01:38:22.852101+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.852005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.852005+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.852005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:27.984299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'201","reported_seq":739,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.725082+0000","last_change":"2024-09-12T01:38:19.725082+0000","last_active":"2024-09-12T01:38:19.725082+0000","last_peered":"2024-09-12T01:38:19.725082+0000","last_clean":"2024-09-12T01:38:19.725082+0000","last_became_active":"2024-09-12T00:25:10.521686+0000","last_became_peered":"2024-09-12T00:25:10.521686+0000","last_unstale":"2024-09-12T01:38:19.725082+0000","last_undegraded":"2024-09-12T01:38:19.725082+0000","last_fullsized":"2024-09-12T01:38:19.725082+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'201","last_scrub_stamp":"2024-09-12T01:38:19.725001+0000","last_deep_scrub":"266'201","last_deep_scrub_stamp":"2024-09-12T01:38:19.725001+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.725001+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.902788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":329,"num_write":450,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'458","reported_seq":1928,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.324299+0000","last_change":"2024-09-12T01:37:56.324237+0000","last_active":"2024-09-12T01:37:56.324299+0000","last_peered":"2024-09-12T01:37:56.324299+0000","last_clean":"2024-09-12T01:37:56.324299+0000","last_became_active":"2024-09-12T00:25:02.472379+0000","last_became_peered":"2024-09-12T00:25:02.472379+0000","last_unstale":"2024-09-12T01:37:56.324299+0000","last_undegraded":"2024-09-12T01:37:56.324299+0000","last_fullsized":"2024-09-12T01:37:56.324299+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'458","last_scrub_stamp":"2024-09-12T01:37:56.324159+0000","last_deep_scrub":"266'458","last_deep_scrub_stamp":"2024-09-12T01:37:56.324159+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.324159+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:20.183702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2328,"num_read_kb":2161,"num_write":552,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":541,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.478045+0000","last_change":"2024-09-12T01:37:47.478045+0000","last_active":"2024-09-12T01:37:47.478045+0000","last_peered":"2024-09-12T01:37:47.478045+0000","last_clean":"2024-09-12T01:37:47.478045+0000","last_became_active":"2024-09-12T00:24:46.219148+0000","last_became_peered":"2024-09-12T00:24:46.219148+0000","last_unstale":"2024-09-12T01:37:47.478045+0000","last_undegraded":"2024-09-12T01:37:47.478045+0000","last_fullsized":"2024-09-12T01:37:47.478045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:47.477953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:47.477953+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.477953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.844122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040735800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'221","reported_seq":909,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.547177+0000","last_change":"2024-09-12T01:37:47.547177+0000","last_active":"2024-09-12T01:37:47.547177+0000","last_peered":"2024-09-12T01:37:47.547177+0000","last_clean":"2024-09-12T01:37:47.547177+0000","last_became_active":"2024-09-12T00:25:00.468270+0000","last_became_peered":"2024-09-12T00:25:00.468270+0000","last_unstale":"2024-09-12T01:37:47.547177+0000","last_undegraded":"2024-09-12T01:37:47.547177+0000","last_fullsized":"2024-09-12T01:37:47.547177+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'221","last_scrub_stamp":"2024-09-12T01:37:47.547063+0000","last_deep_scrub":"266'221","last_deep_scrub_stamp":"2024-09-12T01:37:47.547063+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.547063+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:35.859232+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":34464,"num_write":950,"num_write_kb":30398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.454089+0000","last_change":"2024-09-12T01:37:58.454003+0000","last_active":"2024-09-12T01:37:58.454089+0000","last_peered":"2024-09-12T01:37:58.454089+0000","last_clean":"2024-09-12T01:37:58.454089+0000","last_became_active":"2024-09-12T00:25:04.486554+0000","last_became_peered":"2024-09-12T00:25:04.486554+0000","last_unstale":"2024-09-12T01:37:58.454089+0000","last_undegraded":"2024-09-12T01:37:58.454089+0000","last_fullsized":"2024-09-12T01:37:58.454089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:37:58.453898+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:37:58.453898+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.453898+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:32.185064+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'319","reported_seq":1761,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.892800+0000","last_change":"2024-09-12T01:38:02.892740+0000","last_active":"2024-09-12T01:38:02.892800+0000","last_peered":"2024-09-12T01:38:02.892800+0000","last_clean":"2024-09-12T01:38:02.892800+0000","last_became_active":"2024-09-12T00:25:06.495269+0000","last_became_peered":"2024-09-12T00:25:06.495269+0000","last_unstale":"2024-09-12T01:38:02.892800+0000","last_undegraded":"2024-09-12T01:38:02.892800+0000","last_fullsized":"2024-09-12T01:38:02.892800+0000","mapping_epoch":32,"log_start":"266'301","ondisk_log_start":"266'301","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'319","last_scrub_stamp":"2024-09-12T01:38:02.892622+0000","last_deep_scrub":"266'319","last_deep_scrub_stamp":"2024-09-12T01:38:02.892622+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.892622+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":301,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:22.199556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":267,"num_read_kb":257,"num_write":249,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.357753+0000","last_change":"2024-09-12T01:38:15.357753+0000","last_active":"2024-09-12T01:38:15.357753+0000","last_peered":"2024-09-12T01:38:15.357753+0000","last_clean":"2024-09-12T01:38:15.357753+0000","last_became_active":"2024-09-12T00:25:08.511783+0000","last_became_peered":"2024-09-12T00:25:08.511783+0000","last_unstale":"2024-09-12T01:38:15.357753+0000","last_undegraded":"2024-09-12T01:38:15.357753+0000","last_fullsized":"2024-09-12T01:38:15.357753+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:15.357673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:15.357673+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.357673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:32.899032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'272","reported_seq":894,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.324690+0000","last_change":"2024-09-12T01:38:20.324690+0000","last_active":"2024-09-12T01:38:20.324690+0000","last_peered":"2024-09-12T01:38:20.324690+0000","last_clean":"2024-09-12T01:38:20.324690+0000","last_became_active":"2024-09-12T00:25:10.525594+0000","last_became_peered":"2024-09-12T00:25:10.525594+0000","last_unstale":"2024-09-12T01:38:20.324690+0000","last_undegraded":"2024-09-12T01:38:20.324690+0000","last_fullsized":"2024-09-12T01:38:20.324690+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'272","last_scrub_stamp":"2024-09-12T01:38:20.324599+0000","last_deep_scrub":"266'272","last_deep_scrub_stamp":"2024-09-12T01:38:20.324599+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.324599+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:08.489446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":513,"num_write":584,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'413","reported_seq":1899,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.287559+0000","last_change":"2024-09-12T01:37:53.287502+0000","last_active":"2024-09-12T01:37:53.287559+0000","last_peered":"2024-09-12T01:37:53.287559+0000","last_clean":"2024-09-12T01:37:53.287559+0000","last_became_active":"2024-09-12T00:25:02.467022+0000","last_became_peered":"2024-09-12T00:25:02.467022+0000","last_unstale":"2024-09-12T01:37:53.287559+0000","last_undegraded":"2024-09-12T01:37:53.287559+0000","last_fullsized":"2024-09-12T01:37:53.287559+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'413","last_scrub_stamp":"2024-09-12T01:37:53.287417+0000","last_deep_scrub":"266'413","last_deep_scrub_stamp":"2024-09-12T01:37:53.287417+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.287417+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:09.800269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2131,"num_read_kb":2016,"num_write":472,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":546,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.973514+0000","last_change":"2024-09-12T01:37:45.973514+0000","last_active":"2024-09-12T01:37:45.973514+0000","last_peered":"2024-09-12T01:37:45.973514+0000","last_clean":"2024-09-12T01:37:45.973514+0000","last_became_active":"2024-09-12T00:24:46.296014+0000","last_became_peered":"2024-09-12T00:24:46.296014+0000","last_unstale":"2024-09-12T01:37:45.973514+0000","last_undegraded":"2024-09-12T01:37:45.973514+0000","last_fullsized":"2024-09-12T01:37:45.973514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:37:45.973447+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:37:45.973447+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.973447+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:56.580285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00055221999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'227","reported_seq":868,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.739740+0000","last_change":"2024-09-12T01:37:55.739740+0000","last_active":"2024-09-12T01:37:55.739740+0000","last_peered":"2024-09-12T01:37:55.739740+0000","last_clean":"2024-09-12T01:37:55.739740+0000","last_became_active":"2024-09-12T00:25:00.480242+0000","last_became_peered":"2024-09-12T00:25:00.480242+0000","last_unstale":"2024-09-12T01:37:55.739740+0000","last_undegraded":"2024-09-12T01:37:55.739740+0000","last_fullsized":"2024-09-12T01:37:55.739740+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'227","last_scrub_stamp":"2024-09-12T01:37:55.739594+0000","last_deep_scrub":"266'227","last_deep_scrub_stamp":"2024-09-12T01:37:55.739594+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.739594+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:04.195794+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":8697,"num_write":1016,"num_write_kb":33114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.412878+0000","last_change":"2024-09-12T01:37:56.412798+0000","last_active":"2024-09-12T01:37:56.412878+0000","last_peered":"2024-09-12T01:37:56.412878+0000","last_clean":"2024-09-12T01:37:56.412878+0000","last_became_active":"2024-09-12T00:25:04.483224+0000","last_became_peered":"2024-09-12T00:25:04.483224+0000","last_unstale":"2024-09-12T01:37:56.412878+0000","last_undegraded":"2024-09-12T01:37:56.412878+0000","last_fullsized":"2024-09-12T01:37:56.412878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:56.412697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:56.412697+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.412697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:36.333449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'168","reported_seq":739,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.576475+0000","last_change":"2024-09-12T01:38:12.576475+0000","last_active":"2024-09-12T01:38:12.576475+0000","last_peered":"2024-09-12T01:38:12.576475+0000","last_clean":"2024-09-12T01:38:12.576475+0000","last_became_active":"2024-09-12T00:25:06.500406+0000","last_became_peered":"2024-09-12T00:25:06.500406+0000","last_unstale":"2024-09-12T01:38:12.576475+0000","last_undegraded":"2024-09-12T01:38:12.576475+0000","last_fullsized":"2024-09-12T01:38:12.576475+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'168","last_scrub_stamp":"2024-09-12T01:38:12.576363+0000","last_deep_scrub":"266'168","last_deep_scrub_stamp":"2024-09-12T01:38:12.576363+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.576363+0000","objects_scrubbed":7,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:43.416406+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":204,"num_read_kb":195,"num_write":150,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.877023+0000","last_change":"2024-09-12T01:38:25.877023+0000","last_active":"2024-09-12T01:38:25.877023+0000","last_peered":"2024-09-12T01:38:25.877023+0000","last_clean":"2024-09-12T01:38:25.877023+0000","last_became_active":"2024-09-12T00:25:08.510287+0000","last_became_peered":"2024-09-12T00:25:08.510287+0000","last_unstale":"2024-09-12T01:38:25.877023+0000","last_undegraded":"2024-09-12T01:38:25.877023+0000","last_fullsized":"2024-09-12T01:38:25.877023+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:25.876939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:25.876939+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.876939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:03.157923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'161","reported_seq":726,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.793611+0000","last_change":"2024-09-12T01:38:11.793611+0000","last_active":"2024-09-12T01:38:11.793611+0000","last_peered":"2024-09-12T01:38:11.793611+0000","last_clean":"2024-09-12T01:38:11.793611+0000","last_became_active":"2024-09-12T00:25:10.523589+0000","last_became_peered":"2024-09-12T00:25:10.523589+0000","last_unstale":"2024-09-12T01:38:11.793611+0000","last_undegraded":"2024-09-12T01:38:11.793611+0000","last_fullsized":"2024-09-12T01:38:11.793611+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'161","last_scrub_stamp":"2024-09-12T01:38:11.793512+0000","last_deep_scrub":"266'161","last_deep_scrub_stamp":"2024-09-12T01:38:11.793512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.793512+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:42.925878+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":189,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'1615","reported_seq":3220,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.249739+0000","last_change":"2024-09-12T01:37:51.249637+0000","last_active":"2024-09-12T01:37:51.249739+0000","last_peered":"2024-09-12T01:37:51.249739+0000","last_clean":"2024-09-12T01:37:51.249739+0000","last_became_active":"2024-09-12T00:25:02.471491+0000","last_became_peered":"2024-09-12T00:25:02.471491+0000","last_unstale":"2024-09-12T01:37:51.249739+0000","last_undegraded":"2024-09-12T01:37:51.249739+0000","last_fullsized":"2024-09-12T01:37:51.249739+0000","mapping_epoch":28,"log_start":"266'1600","ondisk_log_start":"266'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1615","last_scrub_stamp":"2024-09-12T01:37:51.249541+0000","last_deep_scrub":"266'1615","last_deep_scrub_stamp":"2024-09-12T01:37:51.249541+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.249541+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":1600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.798728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7163,"num_read_kb":6213,"num_write":2294,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'243","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.567520+0000","last_change":"2024-09-12T01:37:45.567458+0000","last_active":"2024-09-12T01:37:45.567520+0000","last_peered":"2024-09-12T01:37:45.567520+0000","last_clean":"2024-09-12T01:37:45.567520+0000","last_became_active":"2024-09-12T00:25:00.484147+0000","last_became_peered":"2024-09-12T00:25:00.484147+0000","last_unstale":"2024-09-12T01:37:45.567520+0000","last_undegraded":"2024-09-12T01:37:45.567520+0000","last_fullsized":"2024-09-12T01:37:45.567520+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'243","last_scrub_stamp":"2024-09-12T01:37:45.567385+0000","last_deep_scrub":"266'243","last_deep_scrub_stamp":"2024-09-12T01:37:45.567385+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.567385+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:40.545937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":38062,"num_write":1135,"num_write_kb":41091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":540,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.537738+0000","last_change":"2024-09-12T01:37:46.537738+0000","last_active":"2024-09-12T01:37:46.537738+0000","last_peered":"2024-09-12T01:37:46.537738+0000","last_clean":"2024-09-12T01:37:46.537738+0000","last_became_active":"2024-09-12T00:24:46.295839+0000","last_became_peered":"2024-09-12T00:24:46.295839+0000","last_unstale":"2024-09-12T01:37:46.537738+0000","last_undegraded":"2024-09-12T01:37:46.537738+0000","last_fullsized":"2024-09-12T01:37:46.537738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:46.537656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:46.537656+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.537656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:55.749892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045367200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.299479+0000","last_change":"2024-09-12T01:38:03.299479+0000","last_active":"2024-09-12T01:38:03.299479+0000","last_peered":"2024-09-12T01:38:03.299479+0000","last_clean":"2024-09-12T01:38:03.299479+0000","last_became_active":"2024-09-12T00:25:04.478947+0000","last_became_peered":"2024-09-12T00:25:04.478947+0000","last_unstale":"2024-09-12T01:38:03.299479+0000","last_undegraded":"2024-09-12T01:38:03.299479+0000","last_fullsized":"2024-09-12T01:38:03.299479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:03.299354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:03.299354+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.299354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:24.646538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'324","reported_seq":1033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.470886+0000","last_change":"2024-09-12T01:38:01.470886+0000","last_active":"2024-09-12T01:38:01.470886+0000","last_peered":"2024-09-12T01:38:01.470886+0000","last_clean":"2024-09-12T01:38:01.470886+0000","last_became_active":"2024-09-12T00:25:06.496693+0000","last_became_peered":"2024-09-12T00:25:06.496693+0000","last_unstale":"2024-09-12T01:38:01.470886+0000","last_undegraded":"2024-09-12T01:38:01.470886+0000","last_fullsized":"2024-09-12T01:38:01.470886+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'324","last_scrub_stamp":"2024-09-12T01:38:01.470784+0000","last_deep_scrub":"266'324","last_deep_scrub_stamp":"2024-09-12T01:38:01.470784+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.470784+0000","objects_scrubbed":11,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:43.306882+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":458,"num_read_kb":584,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.715151+0000","last_change":"2024-09-12T01:38:04.715080+0000","last_active":"2024-09-12T01:38:04.715151+0000","last_peered":"2024-09-12T01:38:04.715151+0000","last_clean":"2024-09-12T01:38:04.715151+0000","last_became_active":"2024-09-12T00:25:08.509962+0000","last_became_peered":"2024-09-12T00:25:08.509962+0000","last_unstale":"2024-09-12T01:38:04.715151+0000","last_undegraded":"2024-09-12T01:38:04.715151+0000","last_fullsized":"2024-09-12T01:38:04.715151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:04.714993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:04.714993+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.714993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:04.273955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'146","reported_seq":666,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.667907+0000","last_change":"2024-09-12T01:38:22.667907+0000","last_active":"2024-09-12T01:38:22.667907+0000","last_peered":"2024-09-12T01:38:22.667907+0000","last_clean":"2024-09-12T01:38:22.667907+0000","last_became_active":"2024-09-12T00:25:10.521670+0000","last_became_peered":"2024-09-12T00:25:10.521670+0000","last_unstale":"2024-09-12T01:38:22.667907+0000","last_undegraded":"2024-09-12T01:38:22.667907+0000","last_fullsized":"2024-09-12T01:38:22.667907+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'146","last_scrub_stamp":"2024-09-12T01:38:22.667807+0000","last_deep_scrub":"266'146","last_deep_scrub_stamp":"2024-09-12T01:38:22.667807+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.667807+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:34.880802+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":347,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'1211","reported_seq":2867,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.294939+0000","last_change":"2024-09-12T01:37:55.294828+0000","last_active":"2024-09-12T01:37:55.294939+0000","last_peered":"2024-09-12T01:37:55.294939+0000","last_clean":"2024-09-12T01:37:55.294939+0000","last_became_active":"2024-09-12T00:25:02.473158+0000","last_became_peered":"2024-09-12T00:25:02.473158+0000","last_unstale":"2024-09-12T01:37:55.294939+0000","last_undegraded":"2024-09-12T01:37:55.294939+0000","last_fullsized":"2024-09-12T01:37:55.294939+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1211","last_scrub_stamp":"2024-09-12T01:37:55.294717+0000","last_deep_scrub":"266'1211","last_deep_scrub_stamp":"2024-09-12T01:37:55.294717+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.294717+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:49.131916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5007,"num_write":1669,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2709,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'191","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.291895+0000","last_change":"2024-09-12T01:37:48.291829+0000","last_active":"2024-09-12T01:37:48.291895+0000","last_peered":"2024-09-12T01:37:48.291895+0000","last_clean":"2024-09-12T01:37:48.291895+0000","last_became_active":"2024-09-12T00:25:00.465896+0000","last_became_peered":"2024-09-12T00:25:00.465896+0000","last_unstale":"2024-09-12T01:37:48.291895+0000","last_undegraded":"2024-09-12T01:37:48.291895+0000","last_fullsized":"2024-09-12T01:37:48.291895+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T01:37:48.291667+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T01:37:48.291667+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.291667+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.140550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702969,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":438,"num_read_kb":13303,"num_write":931,"num_write_kb":18974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":543,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.043936+0000","last_change":"2024-09-12T01:37:49.043879+0000","last_active":"2024-09-12T01:37:49.043936+0000","last_peered":"2024-09-12T01:37:49.043936+0000","last_clean":"2024-09-12T01:37:49.043936+0000","last_became_active":"2024-09-12T00:24:46.213839+0000","last_became_peered":"2024-09-12T00:24:46.213839+0000","last_unstale":"2024-09-12T01:37:49.043936+0000","last_undegraded":"2024-09-12T01:37:49.043936+0000","last_fullsized":"2024-09-12T01:37:49.043936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:49.043790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:49.043790+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.043790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:54.944893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050495300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.864056+0000","last_change":"2024-09-12T01:38:00.864056+0000","last_active":"2024-09-12T01:38:00.864056+0000","last_peered":"2024-09-12T01:38:00.864056+0000","last_clean":"2024-09-12T01:38:00.864056+0000","last_became_active":"2024-09-12T00:25:04.481137+0000","last_became_peered":"2024-09-12T00:25:04.481137+0000","last_unstale":"2024-09-12T01:38:00.864056+0000","last_undegraded":"2024-09-12T01:38:00.864056+0000","last_fullsized":"2024-09-12T01:38:00.864056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.863967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.863967+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.863967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:46.951205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'261","reported_seq":864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.387347+0000","last_change":"2024-09-12T01:38:07.387347+0000","last_active":"2024-09-12T01:38:07.387347+0000","last_peered":"2024-09-12T01:38:07.387347+0000","last_clean":"2024-09-12T01:38:07.387347+0000","last_became_active":"2024-09-12T00:25:06.501118+0000","last_became_peered":"2024-09-12T00:25:06.501118+0000","last_unstale":"2024-09-12T01:38:07.387347+0000","last_undegraded":"2024-09-12T01:38:07.387347+0000","last_fullsized":"2024-09-12T01:38:07.387347+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'261","last_scrub_stamp":"2024-09-12T01:38:07.387238+0000","last_deep_scrub":"266'261","last_deep_scrub_stamp":"2024-09-12T01:38:07.387238+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.387238+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:26.161968+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":326,"num_read_kb":318,"num_write":296,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'774","reported_seq":2933,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.824281+0000","last_change":"2024-09-12T01:38:04.824281+0000","last_active":"2024-09-12T01:38:04.824281+0000","last_peered":"2024-09-12T01:38:04.824281+0000","last_clean":"2024-09-12T01:38:04.824281+0000","last_became_active":"2024-09-12T00:25:08.509511+0000","last_became_peered":"2024-09-12T00:25:08.509511+0000","last_unstale":"2024-09-12T01:38:04.824281+0000","last_undegraded":"2024-09-12T01:38:04.824281+0000","last_fullsized":"2024-09-12T01:38:04.824281+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'774","last_scrub_stamp":"2024-09-12T01:38:04.824196+0000","last_deep_scrub":"266'774","last_deep_scrub_stamp":"2024-09-12T01:38:04.824196+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.824196+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:41.848726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'131","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.605406+0000","last_change":"2024-09-12T01:38:11.605406+0000","last_active":"2024-09-12T01:38:11.605406+0000","last_peered":"2024-09-12T01:38:11.605406+0000","last_clean":"2024-09-12T01:38:11.605406+0000","last_became_active":"2024-09-12T00:25:10.524804+0000","last_became_peered":"2024-09-12T00:25:10.524804+0000","last_unstale":"2024-09-12T01:38:11.605406+0000","last_undegraded":"2024-09-12T01:38:11.605406+0000","last_fullsized":"2024-09-12T01:38:11.605406+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'131","last_scrub_stamp":"2024-09-12T01:38:11.605314+0000","last_deep_scrub":"266'131","last_deep_scrub_stamp":"2024-09-12T01:38:11.605314+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.605314+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:05.600758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'468","reported_seq":2167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.368204+0000","last_change":"2024-09-12T01:37:52.368204+0000","last_active":"2024-09-12T01:37:52.368204+0000","last_peered":"2024-09-12T01:37:52.368204+0000","last_clean":"2024-09-12T01:37:52.368204+0000","last_became_active":"2024-09-12T00:25:02.463232+0000","last_became_peered":"2024-09-12T00:25:02.463232+0000","last_unstale":"2024-09-12T01:37:52.368204+0000","last_undegraded":"2024-09-12T01:37:52.368204+0000","last_fullsized":"2024-09-12T01:37:52.368204+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'468","last_scrub_stamp":"2024-09-12T01:37:52.368113+0000","last_deep_scrub":"266'468","last_deep_scrub_stamp":"2024-09-12T01:37:52.368113+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.368113+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:14.544213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2494,"num_read_kb":2382,"num_write":536,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'241","reported_seq":950,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.376472+0000","last_change":"2024-09-12T01:37:48.376413+0000","last_active":"2024-09-12T01:37:48.376472+0000","last_peered":"2024-09-12T01:37:48.376472+0000","last_clean":"2024-09-12T01:37:48.376472+0000","last_became_active":"2024-09-12T00:25:00.452591+0000","last_became_peered":"2024-09-12T00:25:00.452591+0000","last_unstale":"2024-09-12T01:37:48.376472+0000","last_undegraded":"2024-09-12T01:37:48.376472+0000","last_fullsized":"2024-09-12T01:37:48.376472+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'241","last_scrub_stamp":"2024-09-12T01:37:48.376282+0000","last_deep_scrub":"266'241","last_deep_scrub_stamp":"2024-09-12T01:37:48.376282+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.376282+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:09.221130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":777,"num_read_kb":13125,"num_write":984,"num_write_kb":40186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":550,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.359531+0000","last_change":"2024-09-12T01:37:45.359471+0000","last_active":"2024-09-12T01:37:45.359531+0000","last_peered":"2024-09-12T01:37:45.359531+0000","last_clean":"2024-09-12T01:37:45.359531+0000","last_became_active":"2024-09-12T00:24:46.426160+0000","last_became_peered":"2024-09-12T00:24:46.426160+0000","last_unstale":"2024-09-12T01:37:45.359531+0000","last_undegraded":"2024-09-12T01:37:45.359531+0000","last_fullsized":"2024-09-12T01:37:45.359531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:45.359384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:45.359384+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.359384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:46.994285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.957234+0000","last_change":"2024-09-12T01:38:12.957234+0000","last_active":"2024-09-12T01:38:12.957234+0000","last_peered":"2024-09-12T01:38:12.957234+0000","last_clean":"2024-09-12T01:38:12.957234+0000","last_became_active":"2024-09-12T00:25:04.482856+0000","last_became_peered":"2024-09-12T00:25:04.482856+0000","last_unstale":"2024-09-12T01:38:12.957234+0000","last_undegraded":"2024-09-12T01:38:12.957234+0000","last_fullsized":"2024-09-12T01:38:12.957234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:12.957150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:12.957150+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.957150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:39.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'147","reported_seq":721,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.975688+0000","last_change":"2024-09-12T01:38:17.975688+0000","last_active":"2024-09-12T01:38:17.975688+0000","last_peered":"2024-09-12T01:38:17.975688+0000","last_clean":"2024-09-12T01:38:17.975688+0000","last_became_active":"2024-09-12T00:25:06.497888+0000","last_became_peered":"2024-09-12T00:25:06.497888+0000","last_unstale":"2024-09-12T01:38:17.975688+0000","last_undegraded":"2024-09-12T01:38:17.975688+0000","last_fullsized":"2024-09-12T01:38:17.975688+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'147","last_scrub_stamp":"2024-09-12T01:38:17.975589+0000","last_deep_scrub":"266'147","last_deep_scrub_stamp":"2024-09-12T01:38:17.975589+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.975589+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:15.586228+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":168,"num_write":116,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'803","reported_seq":2666,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.569758+0000","last_change":"2024-09-12T01:38:11.569758+0000","last_active":"2024-09-12T01:38:11.569758+0000","last_peered":"2024-09-12T01:38:11.569758+0000","last_clean":"2024-09-12T01:38:11.569758+0000","last_became_active":"2024-09-12T00:25:08.512784+0000","last_became_peered":"2024-09-12T00:25:08.512784+0000","last_unstale":"2024-09-12T01:38:11.569758+0000","last_undegraded":"2024-09-12T01:38:11.569758+0000","last_fullsized":"2024-09-12T01:38:11.569758+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'803","last_scrub_stamp":"2024-09-12T01:38:11.569667+0000","last_deep_scrub":"266'803","last_deep_scrub_stamp":"2024-09-12T01:38:11.569667+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.569667+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:56.839480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'246","reported_seq":782,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.733053+0000","last_change":"2024-09-12T01:38:20.733053+0000","last_active":"2024-09-12T01:38:20.733053+0000","last_peered":"2024-09-12T01:38:20.733053+0000","last_clean":"2024-09-12T01:38:20.733053+0000","last_became_active":"2024-09-12T00:25:10.523258+0000","last_became_peered":"2024-09-12T00:25:10.523258+0000","last_unstale":"2024-09-12T01:38:20.733053+0000","last_undegraded":"2024-09-12T01:38:20.733053+0000","last_fullsized":"2024-09-12T01:38:20.733053+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'246","last_scrub_stamp":"2024-09-12T01:38:20.732964+0000","last_deep_scrub":"266'246","last_deep_scrub_stamp":"2024-09-12T01:38:20.732964+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.732964+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:03.600893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'490","reported_seq":2085,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.705966+0000","last_change":"2024-09-12T01:37:51.705892+0000","last_active":"2024-09-12T01:37:51.705966+0000","last_peered":"2024-09-12T01:37:51.705966+0000","last_clean":"2024-09-12T01:37:51.705966+0000","last_became_active":"2024-09-12T00:25:02.468436+0000","last_became_peered":"2024-09-12T00:25:02.468436+0000","last_unstale":"2024-09-12T01:37:51.705966+0000","last_undegraded":"2024-09-12T01:37:51.705966+0000","last_fullsized":"2024-09-12T01:37:51.705966+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'490","last_scrub_stamp":"2024-09-12T01:37:51.705797+0000","last_deep_scrub":"266'490","last_deep_scrub_stamp":"2024-09-12T01:37:51.705797+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.705797+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:59.947035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2713,"num_read_kb":2534,"num_write":588,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'194","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.345563+0000","last_change":"2024-09-12T01:37:47.345506+0000","last_active":"2024-09-12T01:37:47.345563+0000","last_peered":"2024-09-12T01:37:47.345563+0000","last_clean":"2024-09-12T01:37:47.345563+0000","last_became_active":"2024-09-12T00:25:00.456071+0000","last_became_peered":"2024-09-12T00:25:00.456071+0000","last_unstale":"2024-09-12T01:37:47.345563+0000","last_undegraded":"2024-09-12T01:37:47.345563+0000","last_fullsized":"2024-09-12T01:37:47.345563+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T01:37:47.345386+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T01:37:47.345386+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.345386+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.275739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":39651,"num_write":895,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":542,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.028063+0000","last_change":"2024-09-12T01:37:48.027962+0000","last_active":"2024-09-12T01:37:48.028063+0000","last_peered":"2024-09-12T01:37:48.028063+0000","last_clean":"2024-09-12T01:37:48.028063+0000","last_became_active":"2024-09-12T00:24:46.425908+0000","last_became_peered":"2024-09-12T00:24:46.425908+0000","last_unstale":"2024-09-12T01:37:48.028063+0000","last_undegraded":"2024-09-12T01:37:48.028063+0000","last_fullsized":"2024-09-12T01:37:48.028063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:48.027858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:48.027858+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.027858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:23.250488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085110299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"266'4","reported_seq":1001,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.324004+0000","last_change":"2024-09-12T01:38:02.324004+0000","last_active":"2024-09-12T01:38:02.324004+0000","last_peered":"2024-09-12T01:38:02.324004+0000","last_clean":"2024-09-12T01:38:02.324004+0000","last_became_active":"2024-09-12T00:25:04.481193+0000","last_became_peered":"2024-09-12T00:25:04.481193+0000","last_unstale":"2024-09-12T01:38:02.324004+0000","last_undegraded":"2024-09-12T01:38:02.324004+0000","last_fullsized":"2024-09-12T01:38:02.324004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:02.323921+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:02.323921+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.323921+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:10.000536+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'363","reported_seq":1124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.905478+0000","last_change":"2024-09-12T01:38:07.905478+0000","last_active":"2024-09-12T01:38:07.905478+0000","last_peered":"2024-09-12T01:38:07.905478+0000","last_clean":"2024-09-12T01:38:07.905478+0000","last_became_active":"2024-09-12T00:25:06.492189+0000","last_became_peered":"2024-09-12T00:25:06.492189+0000","last_unstale":"2024-09-12T01:38:07.905478+0000","last_undegraded":"2024-09-12T01:38:07.905478+0000","last_fullsized":"2024-09-12T01:38:07.905478+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'363","last_scrub_stamp":"2024-09-12T01:38:07.905398+0000","last_deep_scrub":"266'363","last_deep_scrub_stamp":"2024-09-12T01:38:07.905398+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.905398+0000","objects_scrubbed":9,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:03.334289+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35877,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":729,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.320472+0000","last_change":"2024-09-12T01:38:16.320472+0000","last_active":"2024-09-12T01:38:16.320472+0000","last_peered":"2024-09-12T01:38:16.320472+0000","last_clean":"2024-09-12T01:38:16.320472+0000","last_became_active":"2024-09-12T00:25:08.510167+0000","last_became_peered":"2024-09-12T00:25:08.510167+0000","last_unstale":"2024-09-12T01:38:16.320472+0000","last_undegraded":"2024-09-12T01:38:16.320472+0000","last_fullsized":"2024-09-12T01:38:16.320472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.320380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.320380+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.320380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:41.231640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'114","reported_seq":638,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.715272+0000","last_change":"2024-09-12T01:38:10.715272+0000","last_active":"2024-09-12T01:38:10.715272+0000","last_peered":"2024-09-12T01:38:10.715272+0000","last_clean":"2024-09-12T01:38:10.715272+0000","last_became_active":"2024-09-12T00:25:10.525850+0000","last_became_peered":"2024-09-12T00:25:10.525850+0000","last_unstale":"2024-09-12T01:38:10.715272+0000","last_undegraded":"2024-09-12T01:38:10.715272+0000","last_fullsized":"2024-09-12T01:38:10.715272+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'114","last_scrub_stamp":"2024-09-12T01:38:10.715162+0000","last_deep_scrub":"266'114","last_deep_scrub_stamp":"2024-09-12T01:38:10.715162+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.715162+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:08.764289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'145","reported_seq":725,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.343143+0000","last_change":"2024-09-12T01:38:21.343143+0000","last_active":"2024-09-12T01:38:21.343143+0000","last_peered":"2024-09-12T01:38:21.343143+0000","last_clean":"2024-09-12T01:38:21.343143+0000","last_became_active":"2024-09-12T00:25:10.526982+0000","last_became_peered":"2024-09-12T00:25:10.526982+0000","last_unstale":"2024-09-12T01:38:21.343143+0000","last_undegraded":"2024-09-12T01:38:21.343143+0000","last_fullsized":"2024-09-12T01:38:21.343143+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'145","last_scrub_stamp":"2024-09-12T01:38:21.343057+0000","last_deep_scrub":"266'145","last_deep_scrub_stamp":"2024-09-12T01:38:21.343057+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.343057+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:23.156543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":212,"num_write":342,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'496","reported_seq":2085,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.678973+0000","last_change":"2024-09-12T01:37:58.678973+0000","last_active":"2024-09-12T01:37:58.678973+0000","last_peered":"2024-09-12T01:37:58.678973+0000","last_clean":"2024-09-12T01:37:58.678973+0000","last_became_active":"2024-09-12T00:25:02.472013+0000","last_became_peered":"2024-09-12T00:25:02.472013+0000","last_unstale":"2024-09-12T01:37:58.678973+0000","last_undegraded":"2024-09-12T01:37:58.678973+0000","last_fullsized":"2024-09-12T01:37:58.678973+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'496","last_scrub_stamp":"2024-09-12T01:37:58.678883+0000","last_deep_scrub":"266'496","last_deep_scrub_stamp":"2024-09-12T01:37:58.678883+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.678883+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:48.894785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2517,"num_read_kb":2353,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":915,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'215","reported_seq":925,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.079193+0000","last_change":"2024-09-12T01:37:54.079193+0000","last_active":"2024-09-12T01:37:54.079193+0000","last_peered":"2024-09-12T01:37:54.079193+0000","last_clean":"2024-09-12T01:37:54.079193+0000","last_became_active":"2024-09-12T00:25:00.473591+0000","last_became_peered":"2024-09-12T00:25:00.473591+0000","last_unstale":"2024-09-12T01:37:54.079193+0000","last_undegraded":"2024-09-12T01:37:54.079193+0000","last_fullsized":"2024-09-12T01:37:54.079193+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'215","last_scrub_stamp":"2024-09-12T01:37:54.079022+0000","last_deep_scrub":"266'215","last_deep_scrub_stamp":"2024-09-12T01:37:54.079022+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.079022+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:47.035499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308446,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":52508,"num_write":917,"num_write_kb":35191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.358724+0000","last_change":"2024-09-12T01:38:02.358724+0000","last_active":"2024-09-12T01:38:02.358724+0000","last_peered":"2024-09-12T01:38:02.358724+0000","last_clean":"2024-09-12T01:38:02.358724+0000","last_became_active":"2024-09-12T00:25:04.479701+0000","last_became_peered":"2024-09-12T00:25:04.479701+0000","last_unstale":"2024-09-12T01:38:02.358724+0000","last_undegraded":"2024-09-12T01:38:02.358724+0000","last_fullsized":"2024-09-12T01:38:02.358724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:02.358607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:02.358607+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.358607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:44.972389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'165","reported_seq":769,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.346059+0000","last_change":"2024-09-12T01:38:05.346059+0000","last_active":"2024-09-12T01:38:05.346059+0000","last_peered":"2024-09-12T01:38:05.346059+0000","last_clean":"2024-09-12T01:38:05.346059+0000","last_became_active":"2024-09-12T00:25:06.500315+0000","last_became_peered":"2024-09-12T00:25:06.500315+0000","last_unstale":"2024-09-12T01:38:05.346059+0000","last_undegraded":"2024-09-12T01:38:05.346059+0000","last_fullsized":"2024-09-12T01:38:05.346059+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'165","last_scrub_stamp":"2024-09-12T01:38:05.345948+0000","last_deep_scrub":"266'165","last_deep_scrub_stamp":"2024-09-12T01:38:05.345948+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.345948+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:21.892254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6391,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":221,"num_read_kb":264,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.455856+0000","last_change":"2024-09-12T01:38:05.455856+0000","last_active":"2024-09-12T01:38:05.455856+0000","last_peered":"2024-09-12T01:38:05.455856+0000","last_clean":"2024-09-12T01:38:05.455856+0000","last_became_active":"2024-09-12T00:25:08.516921+0000","last_became_peered":"2024-09-12T00:25:08.516921+0000","last_unstale":"2024-09-12T01:38:05.455856+0000","last_undegraded":"2024-09-12T01:38:05.455856+0000","last_fullsized":"2024-09-12T01:38:05.455856+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:05.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:05.455763+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:59.136353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'117","reported_seq":646,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.600520+0000","last_change":"2024-09-12T01:38:12.600520+0000","last_active":"2024-09-12T01:38:12.600520+0000","last_peered":"2024-09-12T01:38:12.600520+0000","last_clean":"2024-09-12T01:38:12.600520+0000","last_became_active":"2024-09-12T00:25:10.524416+0000","last_became_peered":"2024-09-12T00:25:10.524416+0000","last_unstale":"2024-09-12T01:38:12.600520+0000","last_undegraded":"2024-09-12T01:38:12.600520+0000","last_fullsized":"2024-09-12T01:38:12.600520+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'117","last_scrub_stamp":"2024-09-12T01:38:12.600439+0000","last_deep_scrub":"266'117","last_deep_scrub_stamp":"2024-09-12T01:38:12.600439+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.600439+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:05.748283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":157,"num_read_kb":134,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'452","reported_seq":2023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.345223+0000","last_change":"2024-09-12T01:37:55.345223+0000","last_active":"2024-09-12T01:37:55.345223+0000","last_peered":"2024-09-12T01:37:55.345223+0000","last_clean":"2024-09-12T01:37:55.345223+0000","last_became_active":"2024-09-12T00:25:02.471242+0000","last_became_peered":"2024-09-12T00:25:02.471242+0000","last_unstale":"2024-09-12T01:37:55.345223+0000","last_undegraded":"2024-09-12T01:37:55.345223+0000","last_fullsized":"2024-09-12T01:37:55.345223+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'452","last_scrub_stamp":"2024-09-12T01:37:55.345130+0000","last_deep_scrub":"266'452","last_deep_scrub_stamp":"2024-09-12T01:37:55.345130+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.345130+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:12.582586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2437,"num_read_kb":2317,"num_write":523,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'218","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.943850+0000","last_change":"2024-09-12T01:37:45.943850+0000","last_active":"2024-09-12T01:37:45.943850+0000","last_peered":"2024-09-12T01:37:45.943850+0000","last_clean":"2024-09-12T01:37:45.943850+0000","last_became_active":"2024-09-12T00:25:00.480801+0000","last_became_peered":"2024-09-12T00:25:00.480801+0000","last_unstale":"2024-09-12T01:37:45.943850+0000","last_undegraded":"2024-09-12T01:37:45.943850+0000","last_fullsized":"2024-09-12T01:37:45.943850+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T01:37:45.943735+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T01:37:45.943735+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.943735+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:49.180449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288330,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":555,"num_read_kb":14522,"num_write":924,"num_write_kb":19421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.322852+0000","last_change":"2024-09-12T01:38:04.322852+0000","last_active":"2024-09-12T01:38:04.322852+0000","last_peered":"2024-09-12T01:38:04.322852+0000","last_clean":"2024-09-12T01:38:04.322852+0000","last_became_active":"2024-09-12T00:25:04.482891+0000","last_became_peered":"2024-09-12T00:25:04.482891+0000","last_unstale":"2024-09-12T01:38:04.322852+0000","last_undegraded":"2024-09-12T01:38:04.322852+0000","last_fullsized":"2024-09-12T01:38:04.322852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:04.322768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:04.322768+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.322768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:45.135306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'71","reported_seq":603,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.383729+0000","last_change":"2024-09-12T01:38:11.383729+0000","last_active":"2024-09-12T01:38:11.383729+0000","last_peered":"2024-09-12T01:38:11.383729+0000","last_clean":"2024-09-12T01:38:11.383729+0000","last_became_active":"2024-09-12T00:25:06.501049+0000","last_became_peered":"2024-09-12T00:25:06.501049+0000","last_unstale":"2024-09-12T01:38:11.383729+0000","last_undegraded":"2024-09-12T01:38:11.383729+0000","last_fullsized":"2024-09-12T01:38:11.383729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'71","last_scrub_stamp":"2024-09-12T01:38:11.383640+0000","last_deep_scrub":"266'71","last_deep_scrub_stamp":"2024-09-12T01:38:11.383640+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.383640+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:10.663064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":50,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.719255+0000","last_change":"2024-09-12T01:38:06.719255+0000","last_active":"2024-09-12T01:38:06.719255+0000","last_peered":"2024-09-12T01:38:06.719255+0000","last_clean":"2024-09-12T01:38:06.719255+0000","last_became_active":"2024-09-12T00:25:08.506052+0000","last_became_peered":"2024-09-12T00:25:08.506052+0000","last_unstale":"2024-09-12T01:38:06.719255+0000","last_undegraded":"2024-09-12T01:38:06.719255+0000","last_fullsized":"2024-09-12T01:38:06.719255+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.719155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.719155+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.719155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:28.734275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'180","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.347388+0000","last_change":"2024-09-12T01:38:15.347388+0000","last_active":"2024-09-12T01:38:15.347388+0000","last_peered":"2024-09-12T01:38:15.347388+0000","last_clean":"2024-09-12T01:38:15.347388+0000","last_became_active":"2024-09-12T00:25:10.524992+0000","last_became_peered":"2024-09-12T00:25:10.524992+0000","last_unstale":"2024-09-12T01:38:15.347388+0000","last_undegraded":"2024-09-12T01:38:15.347388+0000","last_fullsized":"2024-09-12T01:38:15.347388+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'180","last_scrub_stamp":"2024-09-12T01:38:15.347294+0000","last_deep_scrub":"266'180","last_deep_scrub_stamp":"2024-09-12T01:38:15.347294+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.347294+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:01.054437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":300,"num_read_kb":289,"num_write":406,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'595","reported_seq":2223,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.346689+0000","last_change":"2024-09-12T01:37:54.346689+0000","last_active":"2024-09-12T01:37:54.346689+0000","last_peered":"2024-09-12T01:37:54.346689+0000","last_clean":"2024-09-12T01:37:54.346689+0000","last_became_active":"2024-09-12T00:25:02.468715+0000","last_became_peered":"2024-09-12T00:25:02.468715+0000","last_unstale":"2024-09-12T01:37:54.346689+0000","last_undegraded":"2024-09-12T01:37:54.346689+0000","last_fullsized":"2024-09-12T01:37:54.346689+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'595","last_scrub_stamp":"2024-09-12T01:37:54.346601+0000","last_deep_scrub":"266'595","last_deep_scrub_stamp":"2024-09-12T01:37:54.346601+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.346601+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:05.177000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2927,"num_read_kb":2680,"num_write":750,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'255","reported_seq":912,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.596087+0000","last_change":"2024-09-12T01:37:46.596087+0000","last_active":"2024-09-12T01:37:46.596087+0000","last_peered":"2024-09-12T01:37:46.596087+0000","last_clean":"2024-09-12T01:37:46.596087+0000","last_became_active":"2024-09-12T00:25:00.481741+0000","last_became_peered":"2024-09-12T00:25:00.481741+0000","last_unstale":"2024-09-12T01:37:46.596087+0000","last_undegraded":"2024-09-12T01:37:46.596087+0000","last_fullsized":"2024-09-12T01:37:46.596087+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'255","last_scrub_stamp":"2024-09-12T01:37:46.595992+0000","last_deep_scrub":"266'255","last_deep_scrub_stamp":"2024-09-12T01:37:46.595992+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.595992+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:06.212123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":2782,"num_write":1086,"num_write_kb":27824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.701698+0000","last_change":"2024-09-12T01:37:56.701698+0000","last_active":"2024-09-12T01:37:56.701698+0000","last_peered":"2024-09-12T01:37:56.701698+0000","last_clean":"2024-09-12T01:37:56.701698+0000","last_became_active":"2024-09-12T00:25:04.476356+0000","last_became_peered":"2024-09-12T00:25:04.476356+0000","last_unstale":"2024-09-12T01:37:56.701698+0000","last_undegraded":"2024-09-12T01:37:56.701698+0000","last_fullsized":"2024-09-12T01:37:56.701698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:56.701593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:56.701593+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.701593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:08.927814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'190","reported_seq":805,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.376453+0000","last_change":"2024-09-12T01:38:03.376453+0000","last_active":"2024-09-12T01:38:03.376453+0000","last_peered":"2024-09-12T01:38:03.376453+0000","last_clean":"2024-09-12T01:38:03.376453+0000","last_became_active":"2024-09-12T00:25:06.496372+0000","last_became_peered":"2024-09-12T00:25:06.496372+0000","last_unstale":"2024-09-12T01:38:03.376453+0000","last_undegraded":"2024-09-12T01:38:03.376453+0000","last_fullsized":"2024-09-12T01:38:03.376453+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T01:38:03.376353+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T01:38:03.376353+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.376353+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:08.691744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11132,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":274,"num_read_kb":379,"num_write":160,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.840360+0000","last_change":"2024-09-12T01:38:07.840360+0000","last_active":"2024-09-12T01:38:07.840360+0000","last_peered":"2024-09-12T01:38:07.840360+0000","last_clean":"2024-09-12T01:38:07.840360+0000","last_became_active":"2024-09-12T00:25:08.508336+0000","last_became_peered":"2024-09-12T00:25:08.508336+0000","last_unstale":"2024-09-12T01:38:07.840360+0000","last_undegraded":"2024-09-12T01:38:07.840360+0000","last_fullsized":"2024-09-12T01:38:07.840360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.840285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.840285+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.840285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:32.057572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'123","reported_seq":654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.955167+0000","last_change":"2024-09-12T01:38:31.955167+0000","last_active":"2024-09-12T01:38:31.955167+0000","last_peered":"2024-09-12T01:38:31.955167+0000","last_clean":"2024-09-12T01:38:31.955167+0000","last_became_active":"2024-09-12T00:25:10.522375+0000","last_became_peered":"2024-09-12T00:25:10.522375+0000","last_unstale":"2024-09-12T01:38:31.955167+0000","last_undegraded":"2024-09-12T01:38:31.955167+0000","last_fullsized":"2024-09-12T01:38:31.955167+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'123","last_scrub_stamp":"2024-09-12T01:38:31.955067+0000","last_deep_scrub":"266'123","last_deep_scrub_stamp":"2024-09-12T01:38:31.955067+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.955067+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:16.929043+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":308,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'820","reported_seq":2393,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.393858+0000","last_change":"2024-09-12T01:37:53.393858+0000","last_active":"2024-09-12T01:37:53.393858+0000","last_peered":"2024-09-12T01:37:53.393858+0000","last_clean":"2024-09-12T01:37:53.393858+0000","last_became_active":"2024-09-12T00:25:02.473631+0000","last_became_peered":"2024-09-12T00:25:02.473631+0000","last_unstale":"2024-09-12T01:37:53.393858+0000","last_undegraded":"2024-09-12T01:37:53.393858+0000","last_fullsized":"2024-09-12T01:37:53.393858+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'820","last_scrub_stamp":"2024-09-12T01:37:53.393766+0000","last_deep_scrub":"266'820","last_deep_scrub_stamp":"2024-09-12T01:37:53.393766+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.393766+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:41.670020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3838,"num_read_kb":3448,"num_write":1071,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'213","reported_seq":864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.499745+0000","last_change":"2024-09-12T01:37:48.499745+0000","last_active":"2024-09-12T01:37:48.499745+0000","last_peered":"2024-09-12T01:37:48.499745+0000","last_clean":"2024-09-12T01:37:48.499745+0000","last_became_active":"2024-09-12T00:25:00.461875+0000","last_became_peered":"2024-09-12T00:25:00.461875+0000","last_unstale":"2024-09-12T01:37:48.499745+0000","last_undegraded":"2024-09-12T01:37:48.499745+0000","last_fullsized":"2024-09-12T01:37:48.499745+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T01:37:48.499573+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T01:37:48.499573+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.499573+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:13.359367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288524,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":40693,"num_write":998,"num_write_kb":39273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.973594+0000","last_change":"2024-09-12T01:38:16.973594+0000","last_active":"2024-09-12T01:38:16.973594+0000","last_peered":"2024-09-12T01:38:16.973594+0000","last_clean":"2024-09-12T01:38:16.973594+0000","last_became_active":"2024-09-12T00:25:04.486195+0000","last_became_peered":"2024-09-12T00:25:04.486195+0000","last_unstale":"2024-09-12T01:38:16.973594+0000","last_undegraded":"2024-09-12T01:38:16.973594+0000","last_fullsized":"2024-09-12T01:38:16.973594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.973512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.973512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.973512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:16.357642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'156","reported_seq":753,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.901261+0000","last_change":"2024-09-12T01:38:04.901261+0000","last_active":"2024-09-12T01:38:04.901261+0000","last_peered":"2024-09-12T01:38:04.901261+0000","last_clean":"2024-09-12T01:38:04.901261+0000","last_became_active":"2024-09-12T00:25:06.493276+0000","last_became_peered":"2024-09-12T00:25:06.493276+0000","last_unstale":"2024-09-12T01:38:04.901261+0000","last_undegraded":"2024-09-12T01:38:04.901261+0000","last_fullsized":"2024-09-12T01:38:04.901261+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'156","last_scrub_stamp":"2024-09-12T01:38:04.901177+0000","last_deep_scrub":"266'156","last_deep_scrub_stamp":"2024-09-12T01:38:04.901177+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.901177+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:57.450229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":282,"num_write":108,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.500037+0000","last_change":"2024-09-12T01:38:06.500037+0000","last_active":"2024-09-12T01:38:06.500037+0000","last_peered":"2024-09-12T01:38:06.500037+0000","last_clean":"2024-09-12T01:38:06.500037+0000","last_became_active":"2024-09-12T00:25:08.512647+0000","last_became_peered":"2024-09-12T00:25:08.512647+0000","last_unstale":"2024-09-12T01:38:06.500037+0000","last_undegraded":"2024-09-12T01:38:06.500037+0000","last_fullsized":"2024-09-12T01:38:06.500037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.499944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.499944+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.499944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:02.711620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'319","reported_seq":1624,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.948895+0000","last_change":"2024-09-12T01:38:05.948895+0000","last_active":"2024-09-12T01:38:05.948895+0000","last_peered":"2024-09-12T01:38:05.948895+0000","last_clean":"2024-09-12T01:38:05.948895+0000","last_became_active":"2024-09-12T00:25:02.475490+0000","last_became_peered":"2024-09-12T00:25:02.475490+0000","last_unstale":"2024-09-12T01:38:05.948895+0000","last_undegraded":"2024-09-12T01:38:05.948895+0000","last_fullsized":"2024-09-12T01:38:05.948895+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'319","last_scrub_stamp":"2024-09-12T01:38:05.948806+0000","last_deep_scrub":"266'319","last_deep_scrub_stamp":"2024-09-12T01:38:05.948806+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.948806+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:54.471792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1691,"num_read_kb":1609,"num_write":373,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'212","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.535689+0000","last_change":"2024-09-12T01:37:49.535689+0000","last_active":"2024-09-12T01:37:49.535689+0000","last_peered":"2024-09-12T01:37:49.535689+0000","last_clean":"2024-09-12T01:37:49.535689+0000","last_became_active":"2024-09-12T00:25:00.462022+0000","last_became_peered":"2024-09-12T00:25:00.462022+0000","last_unstale":"2024-09-12T01:37:49.535689+0000","last_undegraded":"2024-09-12T01:37:49.535689+0000","last_fullsized":"2024-09-12T01:37:49.535689+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'212","last_scrub_stamp":"2024-09-12T01:37:49.535559+0000","last_deep_scrub":"266'212","last_deep_scrub_stamp":"2024-09-12T01:37:49.535559+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.535559+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:49.433083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":5153,"num_write":1017,"num_write_kb":32149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.330858+0000","last_change":"2024-09-12T01:38:03.330858+0000","last_active":"2024-09-12T01:38:03.330858+0000","last_peered":"2024-09-12T01:38:03.330858+0000","last_clean":"2024-09-12T01:38:03.330858+0000","last_became_active":"2024-09-12T00:25:04.487192+0000","last_became_peered":"2024-09-12T00:25:04.487192+0000","last_unstale":"2024-09-12T01:38:03.330858+0000","last_undegraded":"2024-09-12T01:38:03.330858+0000","last_fullsized":"2024-09-12T01:38:03.330858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:03.330758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:03.330758+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.330758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:15.689513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'234","reported_seq":889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.365222+0000","last_change":"2024-09-12T01:38:08.365222+0000","last_active":"2024-09-12T01:38:08.365222+0000","last_peered":"2024-09-12T01:38:08.365222+0000","last_clean":"2024-09-12T01:38:08.365222+0000","last_became_active":"2024-09-12T00:25:06.498651+0000","last_became_peered":"2024-09-12T00:25:06.498651+0000","last_unstale":"2024-09-12T01:38:08.365222+0000","last_undegraded":"2024-09-12T01:38:08.365222+0000","last_fullsized":"2024-09-12T01:38:08.365222+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'234","last_scrub_stamp":"2024-09-12T01:38:08.365132+0000","last_deep_scrub":"266'234","last_deep_scrub_stamp":"2024-09-12T01:38:08.365132+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.365132+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:46.680906+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9365,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":332,"num_read_kb":425,"num_write":210,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.764797+0000","last_change":"2024-09-12T01:38:07.764797+0000","last_active":"2024-09-12T01:38:07.764797+0000","last_peered":"2024-09-12T01:38:07.764797+0000","last_clean":"2024-09-12T01:38:07.764797+0000","last_became_active":"2024-09-12T00:25:08.507090+0000","last_became_peered":"2024-09-12T00:25:08.507090+0000","last_unstale":"2024-09-12T01:38:07.764797+0000","last_undegraded":"2024-09-12T01:38:07.764797+0000","last_fullsized":"2024-09-12T01:38:07.764797+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.764725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.764725+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.764725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:45.746935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'189","reported_seq":718,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.683694+0000","last_change":"2024-09-12T01:38:21.683694+0000","last_active":"2024-09-12T01:38:21.683694+0000","last_peered":"2024-09-12T01:38:21.683694+0000","last_clean":"2024-09-12T01:38:21.683694+0000","last_became_active":"2024-09-12T00:25:10.521886+0000","last_became_peered":"2024-09-12T00:25:10.521886+0000","last_unstale":"2024-09-12T01:38:21.683694+0000","last_undegraded":"2024-09-12T01:38:21.683694+0000","last_fullsized":"2024-09-12T01:38:21.683694+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'189","last_scrub_stamp":"2024-09-12T01:38:21.683585+0000","last_deep_scrub":"266'189","last_deep_scrub_stamp":"2024-09-12T01:38:21.683585+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.683585+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:09.718529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":280,"num_read_kb":274,"num_write":435,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'457","reported_seq":1954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.372563+0000","last_change":"2024-09-12T01:37:59.372563+0000","last_active":"2024-09-12T01:37:59.372563+0000","last_peered":"2024-09-12T01:37:59.372563+0000","last_clean":"2024-09-12T01:37:59.372563+0000","last_became_active":"2024-09-12T00:25:02.463187+0000","last_became_peered":"2024-09-12T00:25:02.463187+0000","last_unstale":"2024-09-12T01:37:59.372563+0000","last_undegraded":"2024-09-12T01:37:59.372563+0000","last_fullsized":"2024-09-12T01:37:59.372563+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'457","last_scrub_stamp":"2024-09-12T01:37:59.372473+0000","last_deep_scrub":"266'457","last_deep_scrub_stamp":"2024-09-12T01:37:59.372473+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.372473+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:38.818995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2353,"num_read_kb":2190,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'299","reported_seq":996,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.379895+0000","last_change":"2024-09-12T01:37:50.379895+0000","last_active":"2024-09-12T01:37:50.379895+0000","last_peered":"2024-09-12T01:37:50.379895+0000","last_clean":"2024-09-12T01:37:50.379895+0000","last_became_active":"2024-09-12T00:25:00.467785+0000","last_became_peered":"2024-09-12T00:25:00.467785+0000","last_unstale":"2024-09-12T01:37:50.379895+0000","last_undegraded":"2024-09-12T01:37:50.379895+0000","last_fullsized":"2024-09-12T01:37:50.379895+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'299","last_scrub_stamp":"2024-09-12T01:37:50.379775+0000","last_deep_scrub":"266'299","last_deep_scrub_stamp":"2024-09-12T01:37:50.379775+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.379775+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:15.751538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":731,"num_read_kb":946,"num_write":1133,"num_write_kb":20145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.756573+0000","last_change":"2024-09-12T01:38:02.756573+0000","last_active":"2024-09-12T01:38:02.756573+0000","last_peered":"2024-09-12T01:38:02.756573+0000","last_clean":"2024-09-12T01:38:02.756573+0000","last_became_active":"2024-09-12T00:25:04.484608+0000","last_became_peered":"2024-09-12T00:25:04.484608+0000","last_unstale":"2024-09-12T01:38:02.756573+0000","last_undegraded":"2024-09-12T01:38:02.756573+0000","last_fullsized":"2024-09-12T01:38:02.756573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:02.756483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:02.756483+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.756483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:30.789022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'206","reported_seq":821,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.911197+0000","last_change":"2024-09-12T01:38:20.911197+0000","last_active":"2024-09-12T01:38:20.911197+0000","last_peered":"2024-09-12T01:38:20.911197+0000","last_clean":"2024-09-12T01:38:20.911197+0000","last_became_active":"2024-09-12T00:25:06.489578+0000","last_became_peered":"2024-09-12T00:25:06.489578+0000","last_unstale":"2024-09-12T01:38:20.911197+0000","last_undegraded":"2024-09-12T01:38:20.911197+0000","last_fullsized":"2024-09-12T01:38:20.911197+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T01:38:20.911089+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T01:38:20.911089+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.911089+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.469452+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7791,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":284,"num_read_kb":342,"num_write":192,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.642906+0000","last_change":"2024-09-12T01:38:17.642906+0000","last_active":"2024-09-12T01:38:17.642906+0000","last_peered":"2024-09-12T01:38:17.642906+0000","last_clean":"2024-09-12T01:38:17.642906+0000","last_became_active":"2024-09-12T00:25:08.513330+0000","last_became_peered":"2024-09-12T00:25:08.513330+0000","last_unstale":"2024-09-12T01:38:17.642906+0000","last_undegraded":"2024-09-12T01:38:17.642906+0000","last_fullsized":"2024-09-12T01:38:17.642906+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:17.642819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:17.642819+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.642819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.634535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'224","reported_seq":1114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.965993+0000","last_change":"2024-09-12T01:38:27.965993+0000","last_active":"2024-09-12T01:38:27.965993+0000","last_peered":"2024-09-12T01:38:27.965993+0000","last_clean":"2024-09-12T01:38:27.965993+0000","last_became_active":"2024-09-12T00:25:10.527649+0000","last_became_peered":"2024-09-12T00:25:10.527649+0000","last_unstale":"2024-09-12T01:38:27.965993+0000","last_undegraded":"2024-09-12T01:38:27.965993+0000","last_fullsized":"2024-09-12T01:38:27.965993+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'224","last_scrub_stamp":"2024-09-12T01:38:27.965920+0000","last_deep_scrub":"266'224","last_deep_scrub_stamp":"2024-09-12T01:38:27.965920+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.965920+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:55.228327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":648,"num_write":596,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'368","reported_seq":1826,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.442383+0000","last_change":"2024-09-12T01:37:54.442383+0000","last_active":"2024-09-12T01:37:54.442383+0000","last_peered":"2024-09-12T01:37:54.442383+0000","last_clean":"2024-09-12T01:37:54.442383+0000","last_became_active":"2024-09-12T00:25:02.479051+0000","last_became_peered":"2024-09-12T00:25:02.479051+0000","last_unstale":"2024-09-12T01:37:54.442383+0000","last_undegraded":"2024-09-12T01:37:54.442383+0000","last_fullsized":"2024-09-12T01:37:54.442383+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'368","last_scrub_stamp":"2024-09-12T01:37:54.442292+0000","last_deep_scrub":"266'368","last_deep_scrub_stamp":"2024-09-12T01:37:54.442292+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.442292+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:20.538747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1824,"num_write":392,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'196","reported_seq":837,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.788273+0000","last_change":"2024-09-12T01:37:45.788273+0000","last_active":"2024-09-12T01:37:45.788273+0000","last_peered":"2024-09-12T01:37:45.788273+0000","last_clean":"2024-09-12T01:37:45.788273+0000","last_became_active":"2024-09-12T00:25:00.454796+0000","last_became_peered":"2024-09-12T00:25:00.454796+0000","last_unstale":"2024-09-12T01:37:45.788273+0000","last_undegraded":"2024-09-12T01:37:45.788273+0000","last_fullsized":"2024-09-12T01:37:45.788273+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T01:37:45.788160+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T01:37:45.788160+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.788160+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:20.838772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661693,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":2462,"num_write":975,"num_write_kb":27053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.708068+0000","last_change":"2024-09-12T01:38:01.708068+0000","last_active":"2024-09-12T01:38:01.708068+0000","last_peered":"2024-09-12T01:38:01.708068+0000","last_clean":"2024-09-12T01:38:01.708068+0000","last_became_active":"2024-09-12T00:25:04.475432+0000","last_became_peered":"2024-09-12T00:25:04.475432+0000","last_unstale":"2024-09-12T01:38:01.708068+0000","last_undegraded":"2024-09-12T01:38:01.708068+0000","last_fullsized":"2024-09-12T01:38:01.708068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:01.707983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:01.707983+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.707983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.862812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'180","reported_seq":788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.331794+0000","last_change":"2024-09-12T01:38:09.331794+0000","last_active":"2024-09-12T01:38:09.331794+0000","last_peered":"2024-09-12T01:38:09.331794+0000","last_clean":"2024-09-12T01:38:09.331794+0000","last_became_active":"2024-09-12T00:25:06.499452+0000","last_became_peered":"2024-09-12T00:25:06.499452+0000","last_unstale":"2024-09-12T01:38:09.331794+0000","last_undegraded":"2024-09-12T01:38:09.331794+0000","last_fullsized":"2024-09-12T01:38:09.331794+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'180","last_scrub_stamp":"2024-09-12T01:38:09.331674+0000","last_deep_scrub":"266'180","last_deep_scrub_stamp":"2024-09-12T01:38:09.331674+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.331674+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.045246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6920,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":302,"num_write":132,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.518586+0000","last_change":"2024-09-12T01:38:08.518586+0000","last_active":"2024-09-12T01:38:08.518586+0000","last_peered":"2024-09-12T01:38:08.518586+0000","last_clean":"2024-09-12T01:38:08.518586+0000","last_became_active":"2024-09-12T00:25:08.514591+0000","last_became_peered":"2024-09-12T00:25:08.514591+0000","last_unstale":"2024-09-12T01:38:08.518586+0000","last_undegraded":"2024-09-12T01:38:08.518586+0000","last_fullsized":"2024-09-12T01:38:08.518586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.518472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.518472+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.518472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:53.955684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'123","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.016171+0000","last_change":"2024-09-12T01:38:30.016171+0000","last_active":"2024-09-12T01:38:30.016171+0000","last_peered":"2024-09-12T01:38:30.016171+0000","last_clean":"2024-09-12T01:38:30.016171+0000","last_became_active":"2024-09-12T00:25:10.527125+0000","last_became_peered":"2024-09-12T00:25:10.527125+0000","last_unstale":"2024-09-12T01:38:30.016171+0000","last_undegraded":"2024-09-12T01:38:30.016171+0000","last_fullsized":"2024-09-12T01:38:30.016171+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'123","last_scrub_stamp":"2024-09-12T01:38:30.016066+0000","last_deep_scrub":"266'123","last_deep_scrub_stamp":"2024-09-12T01:38:30.016066+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.016066+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:51.613078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":179,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'798","reported_seq":2256,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.352870+0000","last_change":"2024-09-12T01:37:56.352870+0000","last_active":"2024-09-12T01:37:56.352870+0000","last_peered":"2024-09-12T01:37:56.352870+0000","last_clean":"2024-09-12T01:37:56.352870+0000","last_became_active":"2024-09-12T00:25:02.464409+0000","last_became_peered":"2024-09-12T00:25:02.464409+0000","last_unstale":"2024-09-12T01:37:56.352870+0000","last_undegraded":"2024-09-12T01:37:56.352870+0000","last_fullsized":"2024-09-12T01:37:56.352870+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'798","last_scrub_stamp":"2024-09-12T01:37:56.352774+0000","last_deep_scrub":"266'798","last_deep_scrub_stamp":"2024-09-12T01:37:56.352774+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.352774+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:36.258745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3724,"num_read_kb":3326,"num_write":1070,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'248","reported_seq":936,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.355633+0000","last_change":"2024-09-12T01:37:51.355633+0000","last_active":"2024-09-12T01:37:51.355633+0000","last_peered":"2024-09-12T01:37:51.355633+0000","last_clean":"2024-09-12T01:37:51.355633+0000","last_became_active":"2024-09-12T00:25:00.466015+0000","last_became_peered":"2024-09-12T00:25:00.466015+0000","last_unstale":"2024-09-12T01:37:51.355633+0000","last_undegraded":"2024-09-12T01:37:51.355633+0000","last_fullsized":"2024-09-12T01:37:51.355633+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'248","last_scrub_stamp":"2024-09-12T01:37:51.355483+0000","last_deep_scrub":"266'248","last_deep_scrub_stamp":"2024-09-12T01:37:51.355483+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.355483+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:25.590012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":59883,"num_write":1086,"num_write_kb":30675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.424591+0000","last_change":"2024-09-12T01:38:08.424591+0000","last_active":"2024-09-12T01:38:08.424591+0000","last_peered":"2024-09-12T01:38:08.424591+0000","last_clean":"2024-09-12T01:38:08.424591+0000","last_became_active":"2024-09-12T00:25:04.482091+0000","last_became_peered":"2024-09-12T00:25:04.482091+0000","last_unstale":"2024-09-12T01:38:08.424591+0000","last_undegraded":"2024-09-12T01:38:08.424591+0000","last_fullsized":"2024-09-12T01:38:08.424591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.424471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.424471+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.424471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:04.775940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'132","reported_seq":691,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.875332+0000","last_change":"2024-09-12T01:38:21.875332+0000","last_active":"2024-09-12T01:38:21.875332+0000","last_peered":"2024-09-12T01:38:21.875332+0000","last_clean":"2024-09-12T01:38:21.875332+0000","last_became_active":"2024-09-12T00:25:06.491582+0000","last_became_peered":"2024-09-12T00:25:06.491582+0000","last_unstale":"2024-09-12T01:38:21.875332+0000","last_undegraded":"2024-09-12T01:38:21.875332+0000","last_fullsized":"2024-09-12T01:38:21.875332+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'132","last_scrub_stamp":"2024-09-12T01:38:21.875228+0000","last_deep_scrub":"266'132","last_deep_scrub_stamp":"2024-09-12T01:38:21.875228+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.875228+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:52.692943+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":169,"num_read_kb":163,"num_write":166,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'765","reported_seq":2564,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.858683+0000","last_change":"2024-09-12T01:38:06.858683+0000","last_active":"2024-09-12T01:38:06.858683+0000","last_peered":"2024-09-12T01:38:06.858683+0000","last_clean":"2024-09-12T01:38:06.858683+0000","last_became_active":"2024-09-12T00:25:08.506288+0000","last_became_peered":"2024-09-12T00:25:08.506288+0000","last_unstale":"2024-09-12T01:38:06.858683+0000","last_undegraded":"2024-09-12T01:38:06.858683+0000","last_fullsized":"2024-09-12T01:38:06.858683+0000","mapping_epoch":34,"log_start":"266'701","ondisk_log_start":"266'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'765","last_scrub_stamp":"2024-09-12T01:38:06.858588+0000","last_deep_scrub":"266'765","last_deep_scrub_stamp":"2024-09-12T01:38:06.858588+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.858588+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:00.301952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'126","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.008235+0000","last_change":"2024-09-12T01:38:29.008235+0000","last_active":"2024-09-12T01:38:29.008235+0000","last_peered":"2024-09-12T01:38:29.008235+0000","last_clean":"2024-09-12T01:38:29.008235+0000","last_became_active":"2024-09-12T00:25:10.525045+0000","last_became_peered":"2024-09-12T00:25:10.525045+0000","last_unstale":"2024-09-12T01:38:29.008235+0000","last_undegraded":"2024-09-12T01:38:29.008235+0000","last_fullsized":"2024-09-12T01:38:29.008235+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'126","last_scrub_stamp":"2024-09-12T01:38:29.008106+0000","last_deep_scrub":"266'126","last_deep_scrub_stamp":"2024-09-12T01:38:29.008106+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.008106+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:03.560503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'459","reported_seq":2081,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.681716+0000","last_change":"2024-09-12T01:38:00.681716+0000","last_active":"2024-09-12T01:38:00.681716+0000","last_peered":"2024-09-12T01:38:00.681716+0000","last_clean":"2024-09-12T01:38:00.681716+0000","last_became_active":"2024-09-12T00:25:02.471255+0000","last_became_peered":"2024-09-12T00:25:02.471255+0000","last_unstale":"2024-09-12T01:38:00.681716+0000","last_undegraded":"2024-09-12T01:38:00.681716+0000","last_fullsized":"2024-09-12T01:38:00.681716+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'459","last_scrub_stamp":"2024-09-12T01:38:00.681548+0000","last_deep_scrub":"266'459","last_deep_scrub_stamp":"2024-09-12T01:38:00.681548+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.681548+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:56.359987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2599,"num_read_kb":2460,"num_write":533,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'175","reported_seq":819,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.829012+0000","last_change":"2024-09-12T01:37:44.829012+0000","last_active":"2024-09-12T01:37:44.829012+0000","last_peered":"2024-09-12T01:37:44.829012+0000","last_clean":"2024-09-12T01:37:44.829012+0000","last_became_active":"2024-09-12T00:25:00.456853+0000","last_became_peered":"2024-09-12T00:25:00.456853+0000","last_unstale":"2024-09-12T01:37:44.829012+0000","last_undegraded":"2024-09-12T01:37:44.829012+0000","last_fullsized":"2024-09-12T01:37:44.829012+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'175","last_scrub_stamp":"2024-09-12T01:37:44.828838+0000","last_deep_scrub":"266'175","last_deep_scrub_stamp":"2024-09-12T01:37:44.828838+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.828838+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:03.195827+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1794910,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":16809,"num_write":841,"num_write_kb":28613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.857909+0000","last_change":"2024-09-12T01:38:06.857909+0000","last_active":"2024-09-12T01:38:06.857909+0000","last_peered":"2024-09-12T01:38:06.857909+0000","last_clean":"2024-09-12T01:38:06.857909+0000","last_became_active":"2024-09-12T00:25:04.482441+0000","last_became_peered":"2024-09-12T00:25:04.482441+0000","last_unstale":"2024-09-12T01:38:06.857909+0000","last_undegraded":"2024-09-12T01:38:06.857909+0000","last_fullsized":"2024-09-12T01:38:06.857909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.857801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.857801+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.857801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:24.285527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'229","reported_seq":873,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.911624+0000","last_change":"2024-09-12T01:38:05.911624+0000","last_active":"2024-09-12T01:38:05.911624+0000","last_peered":"2024-09-12T01:38:05.911624+0000","last_clean":"2024-09-12T01:38:05.911624+0000","last_became_active":"2024-09-12T00:25:06.493625+0000","last_became_peered":"2024-09-12T00:25:06.493625+0000","last_unstale":"2024-09-12T01:38:05.911624+0000","last_undegraded":"2024-09-12T01:38:05.911624+0000","last_fullsized":"2024-09-12T01:38:05.911624+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T01:38:05.911522+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T01:38:05.911522+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.911522+0000","objects_scrubbed":11,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.127866+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9308,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":374,"num_write":180,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.388205+0000","last_change":"2024-09-12T01:38:18.388205+0000","last_active":"2024-09-12T01:38:18.388205+0000","last_peered":"2024-09-12T01:38:18.388205+0000","last_clean":"2024-09-12T01:38:18.388205+0000","last_became_active":"2024-09-12T00:25:08.511024+0000","last_became_peered":"2024-09-12T00:25:08.511024+0000","last_unstale":"2024-09-12T01:38:18.388205+0000","last_undegraded":"2024-09-12T01:38:18.388205+0000","last_fullsized":"2024-09-12T01:38:18.388205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:18.388125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:18.388125+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.388125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:57.927807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'104","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.837798+0000","last_change":"2024-09-12T01:38:13.837798+0000","last_active":"2024-09-12T01:38:13.837798+0000","last_peered":"2024-09-12T01:38:13.837798+0000","last_clean":"2024-09-12T01:38:13.837798+0000","last_became_active":"2024-09-12T00:25:10.525981+0000","last_became_peered":"2024-09-12T00:25:10.525981+0000","last_unstale":"2024-09-12T01:38:13.837798+0000","last_undegraded":"2024-09-12T01:38:13.837798+0000","last_fullsized":"2024-09-12T01:38:13.837798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'104","last_scrub_stamp":"2024-09-12T01:38:13.837710+0000","last_deep_scrub":"266'104","last_deep_scrub_stamp":"2024-09-12T01:38:13.837710+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.837710+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:27.183275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":244,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'803","reported_seq":2407,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.688246+0000","last_change":"2024-09-12T01:37:57.688246+0000","last_active":"2024-09-12T01:37:57.688246+0000","last_peered":"2024-09-12T01:37:57.688246+0000","last_clean":"2024-09-12T01:37:57.688246+0000","last_became_active":"2024-09-12T00:25:02.463545+0000","last_became_peered":"2024-09-12T00:25:02.463545+0000","last_unstale":"2024-09-12T01:37:57.688246+0000","last_undegraded":"2024-09-12T01:37:57.688246+0000","last_fullsized":"2024-09-12T01:37:57.688246+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'803","last_scrub_stamp":"2024-09-12T01:37:57.688138+0000","last_deep_scrub":"266'803","last_deep_scrub_stamp":"2024-09-12T01:37:57.688138+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.688138+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:00.009792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3630,"num_write":1061,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'201","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.073754+0000","last_change":"2024-09-12T01:37:56.073754+0000","last_active":"2024-09-12T01:37:56.073754+0000","last_peered":"2024-09-12T01:37:56.073754+0000","last_clean":"2024-09-12T01:37:56.073754+0000","last_became_active":"2024-09-12T00:25:00.478561+0000","last_became_peered":"2024-09-12T00:25:00.478561+0000","last_unstale":"2024-09-12T01:37:56.073754+0000","last_undegraded":"2024-09-12T01:37:56.073754+0000","last_fullsized":"2024-09-12T01:37:56.073754+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'201","last_scrub_stamp":"2024-09-12T01:37:56.073631+0000","last_deep_scrub":"266'201","last_deep_scrub_stamp":"2024-09-12T01:37:56.073631+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.073631+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:46.426001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568262,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":8616,"num_write":923,"num_write_kb":24681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.702621+0000","last_change":"2024-09-12T01:37:59.702621+0000","last_active":"2024-09-12T01:37:59.702621+0000","last_peered":"2024-09-12T01:37:59.702621+0000","last_clean":"2024-09-12T01:37:59.702621+0000","last_became_active":"2024-09-12T00:25:04.481146+0000","last_became_peered":"2024-09-12T00:25:04.481146+0000","last_unstale":"2024-09-12T01:37:59.702621+0000","last_undegraded":"2024-09-12T01:37:59.702621+0000","last_fullsized":"2024-09-12T01:37:59.702621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:59.702524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:59.702524+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.702524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:01.125016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'160","reported_seq":766,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.376066+0000","last_change":"2024-09-12T01:38:14.376066+0000","last_active":"2024-09-12T01:38:14.376066+0000","last_peered":"2024-09-12T01:38:14.376066+0000","last_clean":"2024-09-12T01:38:14.376066+0000","last_became_active":"2024-09-12T00:25:06.499065+0000","last_became_peered":"2024-09-12T00:25:06.499065+0000","last_unstale":"2024-09-12T01:38:14.376066+0000","last_undegraded":"2024-09-12T01:38:14.376066+0000","last_fullsized":"2024-09-12T01:38:14.376066+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'160","last_scrub_stamp":"2024-09-12T01:38:14.375983+0000","last_deep_scrub":"266'160","last_deep_scrub_stamp":"2024-09-12T01:38:14.375983+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.375983+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:14.670939+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":326,"num_write":120,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.831061+0000","last_change":"2024-09-12T01:38:24.831061+0000","last_active":"2024-09-12T01:38:24.831061+0000","last_peered":"2024-09-12T01:38:24.831061+0000","last_clean":"2024-09-12T01:38:24.831061+0000","last_became_active":"2024-09-12T00:25:08.510416+0000","last_became_peered":"2024-09-12T00:25:08.510416+0000","last_unstale":"2024-09-12T01:38:24.831061+0000","last_undegraded":"2024-09-12T01:38:24.831061+0000","last_fullsized":"2024-09-12T01:38:24.831061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.830963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.830963+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.830963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:16.618145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'119","reported_seq":649,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.645711+0000","last_change":"2024-09-12T01:38:23.645711+0000","last_active":"2024-09-12T01:38:23.645711+0000","last_peered":"2024-09-12T01:38:23.645711+0000","last_clean":"2024-09-12T01:38:23.645711+0000","last_became_active":"2024-09-12T00:25:10.520808+0000","last_became_peered":"2024-09-12T00:25:10.520808+0000","last_unstale":"2024-09-12T01:38:23.645711+0000","last_undegraded":"2024-09-12T01:38:23.645711+0000","last_fullsized":"2024-09-12T01:38:23.645711+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'119","last_scrub_stamp":"2024-09-12T01:38:23.645619+0000","last_deep_scrub":"266'119","last_deep_scrub_stamp":"2024-09-12T01:38:23.645619+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.645619+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:58.532369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1152,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":290,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'801","reported_seq":2320,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.378858+0000","last_change":"2024-09-12T01:37:52.378858+0000","last_active":"2024-09-12T01:37:52.378858+0000","last_peered":"2024-09-12T01:37:52.378858+0000","last_clean":"2024-09-12T01:37:52.378858+0000","last_became_active":"2024-09-12T00:25:02.470607+0000","last_became_peered":"2024-09-12T00:25:02.470607+0000","last_unstale":"2024-09-12T01:37:52.378858+0000","last_undegraded":"2024-09-12T01:37:52.378858+0000","last_fullsized":"2024-09-12T01:37:52.378858+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T01:37:52.378752+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T01:37:52.378752+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.378752+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:52.413766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3788,"num_read_kb":3387,"num_write":1064,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1177,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'177","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.584965+0000","last_change":"2024-09-12T01:37:51.584965+0000","last_active":"2024-09-12T01:37:51.584965+0000","last_peered":"2024-09-12T01:37:51.584965+0000","last_clean":"2024-09-12T01:37:51.584965+0000","last_became_active":"2024-09-12T00:25:00.465095+0000","last_became_peered":"2024-09-12T00:25:00.465095+0000","last_unstale":"2024-09-12T01:37:51.584965+0000","last_undegraded":"2024-09-12T01:37:51.584965+0000","last_fullsized":"2024-09-12T01:37:51.584965+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T01:37:51.584835+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T01:37:51.584835+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.584835+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:25.271916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":87968,"num_write":861,"num_write_kb":34661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.833398+0000","last_change":"2024-09-12T01:38:00.833398+0000","last_active":"2024-09-12T01:38:00.833398+0000","last_peered":"2024-09-12T01:38:00.833398+0000","last_clean":"2024-09-12T01:38:00.833398+0000","last_became_active":"2024-09-12T00:25:04.483232+0000","last_became_peered":"2024-09-12T00:25:04.483232+0000","last_unstale":"2024-09-12T01:38:00.833398+0000","last_undegraded":"2024-09-12T01:38:00.833398+0000","last_fullsized":"2024-09-12T01:38:00.833398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.833313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.833313+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.833313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:19.117932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'122","reported_seq":700,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.379862+0000","last_change":"2024-09-12T01:38:06.379862+0000","last_active":"2024-09-12T01:38:06.379862+0000","last_peered":"2024-09-12T01:38:06.379862+0000","last_clean":"2024-09-12T01:38:06.379862+0000","last_became_active":"2024-09-12T00:25:06.499749+0000","last_became_peered":"2024-09-12T00:25:06.499749+0000","last_unstale":"2024-09-12T01:38:06.379862+0000","last_undegraded":"2024-09-12T01:38:06.379862+0000","last_fullsized":"2024-09-12T01:38:06.379862+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'122","last_scrub_stamp":"2024-09-12T01:38:06.379758+0000","last_deep_scrub":"266'122","last_deep_scrub_stamp":"2024-09-12T01:38:06.379758+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.379758+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:20.201626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8122,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":217,"num_write":76,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.920038+0000","last_change":"2024-09-12T01:38:26.920038+0000","last_active":"2024-09-12T01:38:26.920038+0000","last_peered":"2024-09-12T01:38:26.920038+0000","last_clean":"2024-09-12T01:38:26.920038+0000","last_became_active":"2024-09-12T00:25:08.513977+0000","last_became_peered":"2024-09-12T00:25:08.513977+0000","last_unstale":"2024-09-12T01:38:26.920038+0000","last_undegraded":"2024-09-12T01:38:26.920038+0000","last_fullsized":"2024-09-12T01:38:26.920038+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:26.919953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:26.919953+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.919953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:03.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'148","reported_seq":1260,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.005038+0000","last_change":"2024-09-12T01:38:31.005038+0000","last_active":"2024-09-12T01:38:31.005038+0000","last_peered":"2024-09-12T01:38:31.005038+0000","last_clean":"2024-09-12T01:38:31.005038+0000","last_became_active":"2024-09-12T00:25:10.530103+0000","last_became_peered":"2024-09-12T00:25:10.530103+0000","last_unstale":"2024-09-12T01:38:31.005038+0000","last_undegraded":"2024-09-12T01:38:31.005038+0000","last_fullsized":"2024-09-12T01:38:31.005038+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'148","last_scrub_stamp":"2024-09-12T01:38:31.004943+0000","last_deep_scrub":"266'148","last_deep_scrub_stamp":"2024-09-12T01:38:31.004943+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.004943+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:00.895189+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":760,"num_write":344,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'1252","reported_seq":2953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.749655+0000","last_change":"2024-09-12T01:37:54.749655+0000","last_active":"2024-09-12T01:37:54.749655+0000","last_peered":"2024-09-12T01:37:54.749655+0000","last_clean":"2024-09-12T01:37:54.749655+0000","last_became_active":"2024-09-12T00:25:02.467159+0000","last_became_peered":"2024-09-12T00:25:02.467159+0000","last_unstale":"2024-09-12T01:37:54.749655+0000","last_undegraded":"2024-09-12T01:37:54.749655+0000","last_fullsized":"2024-09-12T01:37:54.749655+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1252","last_scrub_stamp":"2024-09-12T01:37:54.749564+0000","last_deep_scrub":"266'1252","last_deep_scrub_stamp":"2024-09-12T01:37:54.749564+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.749564+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":1200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.375412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5713,"num_read_kb":5033,"num_write":1731,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'181","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.585023+0000","last_change":"2024-09-12T01:37:50.584954+0000","last_active":"2024-09-12T01:37:50.585023+0000","last_peered":"2024-09-12T01:37:50.585023+0000","last_clean":"2024-09-12T01:37:50.585023+0000","last_became_active":"2024-09-12T00:25:00.458519+0000","last_became_peered":"2024-09-12T00:25:00.458519+0000","last_unstale":"2024-09-12T01:37:50.585023+0000","last_undegraded":"2024-09-12T01:37:50.585023+0000","last_fullsized":"2024-09-12T01:37:50.585023+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'181","last_scrub_stamp":"2024-09-12T01:37:50.584829+0000","last_deep_scrub":"266'181","last_deep_scrub_stamp":"2024-09-12T01:37:50.584829+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.584829+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:45.672695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174575,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":854,"num_write":913,"num_write_kb":13833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"266'2","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.380392+0000","last_change":"2024-09-12T01:38:07.380392+0000","last_active":"2024-09-12T01:38:07.380392+0000","last_peered":"2024-09-12T01:38:07.380392+0000","last_clean":"2024-09-12T01:38:07.380392+0000","last_became_active":"2024-09-12T00:25:04.481393+0000","last_became_peered":"2024-09-12T00:25:04.481393+0000","last_unstale":"2024-09-12T01:38:07.380392+0000","last_undegraded":"2024-09-12T01:38:07.380392+0000","last_fullsized":"2024-09-12T01:38:07.380392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:07.380252+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:07.380252+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.380252+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:36.278038+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'199","reported_seq":818,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.932702+0000","last_change":"2024-09-12T01:38:18.932702+0000","last_active":"2024-09-12T01:38:18.932702+0000","last_peered":"2024-09-12T01:38:18.932702+0000","last_clean":"2024-09-12T01:38:18.932702+0000","last_became_active":"2024-09-12T00:25:06.490384+0000","last_became_peered":"2024-09-12T00:25:06.490384+0000","last_unstale":"2024-09-12T01:38:18.932702+0000","last_undegraded":"2024-09-12T01:38:18.932702+0000","last_fullsized":"2024-09-12T01:38:18.932702+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'199","last_scrub_stamp":"2024-09-12T01:38:18.932589+0000","last_deep_scrub":"266'199","last_deep_scrub_stamp":"2024-09-12T01:38:18.932589+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.932589+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:42.938759+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8836,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.365895+0000","last_change":"2024-09-12T01:38:19.365895+0000","last_active":"2024-09-12T01:38:19.365895+0000","last_peered":"2024-09-12T01:38:19.365895+0000","last_clean":"2024-09-12T01:38:19.365895+0000","last_became_active":"2024-09-12T00:25:08.507837+0000","last_became_peered":"2024-09-12T00:25:08.507837+0000","last_unstale":"2024-09-12T01:38:19.365895+0000","last_undegraded":"2024-09-12T01:38:19.365895+0000","last_fullsized":"2024-09-12T01:38:19.365895+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:19.365805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:19.365805+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.365805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:54.035348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'138","reported_seq":693,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.899999+0000","last_change":"2024-09-12T01:38:08.899999+0000","last_active":"2024-09-12T01:38:08.899999+0000","last_peered":"2024-09-12T01:38:08.899999+0000","last_clean":"2024-09-12T01:38:08.899999+0000","last_became_active":"2024-09-12T00:25:10.528040+0000","last_became_peered":"2024-09-12T00:25:10.528040+0000","last_unstale":"2024-09-12T01:38:08.899999+0000","last_undegraded":"2024-09-12T01:38:08.899999+0000","last_fullsized":"2024-09-12T01:38:08.899999+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'138","last_scrub_stamp":"2024-09-12T01:38:08.899912+0000","last_deep_scrub":"266'138","last_deep_scrub_stamp":"2024-09-12T01:38:08.899912+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.899912+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:42.982946+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":238,"num_write":307,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'1098","reported_seq":2618,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.389104+0000","last_change":"2024-09-12T01:37:57.388999+0000","last_active":"2024-09-12T01:37:57.389104+0000","last_peered":"2024-09-12T01:37:57.389104+0000","last_clean":"2024-09-12T01:37:57.389104+0000","last_became_active":"2024-09-12T00:25:02.474282+0000","last_became_peered":"2024-09-12T00:25:02.474282+0000","last_unstale":"2024-09-12T01:37:57.389104+0000","last_undegraded":"2024-09-12T01:37:57.389104+0000","last_fullsized":"2024-09-12T01:37:57.389104+0000","mapping_epoch":28,"log_start":"266'1000","ondisk_log_start":"266'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1098","last_scrub_stamp":"2024-09-12T01:37:57.388881+0000","last_deep_scrub":"266'1098","last_deep_scrub_stamp":"2024-09-12T01:37:57.388881+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.388881+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":1000,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:34.723161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4398,"num_write":1510,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'185","reported_seq":862,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.631943+0000","last_change":"2024-09-12T01:37:47.631887+0000","last_active":"2024-09-12T01:37:47.631943+0000","last_peered":"2024-09-12T01:37:47.631943+0000","last_clean":"2024-09-12T01:37:47.631943+0000","last_became_active":"2024-09-12T00:25:00.478259+0000","last_became_peered":"2024-09-12T00:25:00.478259+0000","last_unstale":"2024-09-12T01:37:47.631943+0000","last_undegraded":"2024-09-12T01:37:47.631943+0000","last_fullsized":"2024-09-12T01:37:47.631943+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:47.631770+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:47.631770+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.631770+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:29.806652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515600,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":41144,"num_write":873,"num_write_kb":35919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'755","reported_seq":2242,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.417599+0000","last_change":"2024-09-12T01:37:57.417543+0000","last_active":"2024-09-12T01:37:57.417599+0000","last_peered":"2024-09-12T01:37:57.417599+0000","last_clean":"2024-09-12T01:37:57.417599+0000","last_became_active":"2024-09-12T00:25:02.479450+0000","last_became_peered":"2024-09-12T00:25:02.479450+0000","last_unstale":"2024-09-12T01:37:57.417599+0000","last_undegraded":"2024-09-12T01:37:57.417599+0000","last_fullsized":"2024-09-12T01:37:57.417599+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'755","last_scrub_stamp":"2024-09-12T01:37:57.417454+0000","last_deep_scrub":"266'755","last_deep_scrub_stamp":"2024-09-12T01:37:57.417454+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.417454+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:04.776702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3526,"num_read_kb":3183,"num_write":976,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'207","reported_seq":851,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.446489+0000","last_change":"2024-09-12T01:37:49.446397+0000","last_active":"2024-09-12T01:37:49.446489+0000","last_peered":"2024-09-12T01:37:49.446489+0000","last_clean":"2024-09-12T01:37:49.446489+0000","last_became_active":"2024-09-12T00:25:00.468280+0000","last_became_peered":"2024-09-12T00:25:00.468280+0000","last_unstale":"2024-09-12T01:37:49.446489+0000","last_undegraded":"2024-09-12T01:37:49.446489+0000","last_fullsized":"2024-09-12T01:37:49.446489+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'207","last_scrub_stamp":"2024-09-12T01:37:49.446249+0000","last_deep_scrub":"266'207","last_deep_scrub_stamp":"2024-09-12T01:37:49.446249+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.446249+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:17.110576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":421,"num_read_kb":15096,"num_write":1006,"num_write_kb":29184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'368","reported_seq":1896,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.941203+0000","last_change":"2024-09-12T01:38:06.941131+0000","last_active":"2024-09-12T01:38:06.941203+0000","last_peered":"2024-09-12T01:38:06.941203+0000","last_clean":"2024-09-12T01:38:06.941203+0000","last_became_active":"2024-09-12T00:25:02.476993+0000","last_became_peered":"2024-09-12T00:25:02.476993+0000","last_unstale":"2024-09-12T01:38:06.941203+0000","last_undegraded":"2024-09-12T01:38:06.941203+0000","last_fullsized":"2024-09-12T01:38:06.941203+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'368","last_scrub_stamp":"2024-09-12T01:38:06.941039+0000","last_deep_scrub":"266'368","last_deep_scrub_stamp":"2024-09-12T01:38:06.941039+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.941039+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:55.933049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2221,"num_read_kb":2131,"num_write":417,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'201","reported_seq":894,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.122989+0000","last_change":"2024-09-12T01:37:53.122891+0000","last_active":"2024-09-12T01:37:53.122989+0000","last_peered":"2024-09-12T01:37:53.122989+0000","last_clean":"2024-09-12T01:37:53.122989+0000","last_became_active":"2024-09-12T00:25:00.477872+0000","last_became_peered":"2024-09-12T00:25:00.477872+0000","last_unstale":"2024-09-12T01:37:53.122989+0000","last_undegraded":"2024-09-12T01:37:53.122989+0000","last_fullsized":"2024-09-12T01:37:53.122989+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'201","last_scrub_stamp":"2024-09-12T01:37:53.122774+0000","last_deep_scrub":"266'201","last_deep_scrub_stamp":"2024-09-12T01:37:53.122774+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.122774+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:56.089470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590195,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":9353,"num_write":799,"num_write_kb":34820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'480","reported_seq":1992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.625492+0000","last_change":"2024-09-12T01:38:02.625423+0000","last_active":"2024-09-12T01:38:02.625492+0000","last_peered":"2024-09-12T01:38:02.625492+0000","last_clean":"2024-09-12T01:38:02.625492+0000","last_became_active":"2024-09-12T00:25:02.468180+0000","last_became_peered":"2024-09-12T00:25:02.468180+0000","last_unstale":"2024-09-12T01:38:02.625492+0000","last_undegraded":"2024-09-12T01:38:02.625492+0000","last_fullsized":"2024-09-12T01:38:02.625492+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'480","last_scrub_stamp":"2024-09-12T01:38:02.625346+0000","last_deep_scrub":"266'480","last_deep_scrub_stamp":"2024-09-12T01:38:02.625346+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.625346+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:54.703998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2321,"num_read_kb":2166,"num_write":540,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'179","reported_seq":797,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.564089+0000","last_change":"2024-09-12T01:37:53.564029+0000","last_active":"2024-09-12T01:37:53.564089+0000","last_peered":"2024-09-12T01:37:53.564089+0000","last_clean":"2024-09-12T01:37:53.564089+0000","last_became_active":"2024-09-12T00:25:00.471412+0000","last_became_peered":"2024-09-12T00:25:00.471412+0000","last_unstale":"2024-09-12T01:37:53.564089+0000","last_undegraded":"2024-09-12T01:37:53.564089+0000","last_fullsized":"2024-09-12T01:37:53.564089+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'179","last_scrub_stamp":"2024-09-12T01:37:53.563879+0000","last_deep_scrub":"266'179","last_deep_scrub_stamp":"2024-09-12T01:37:53.563879+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.563879+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:48.342923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432317,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":354,"num_read_kb":25493,"num_write":898,"num_write_kb":19511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'502","reported_seq":2197,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.585527+0000","last_change":"2024-09-12T01:38:01.585436+0000","last_active":"2024-09-12T01:38:01.585527+0000","last_peered":"2024-09-12T01:38:01.585527+0000","last_clean":"2024-09-12T01:38:01.585527+0000","last_became_active":"2024-09-12T00:25:02.469251+0000","last_became_peered":"2024-09-12T00:25:02.469251+0000","last_unstale":"2024-09-12T01:38:01.585527+0000","last_undegraded":"2024-09-12T01:38:01.585527+0000","last_fullsized":"2024-09-12T01:38:01.585527+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'502","last_scrub_stamp":"2024-09-12T01:38:01.585337+0000","last_deep_scrub":"266'502","last_deep_scrub_stamp":"2024-09-12T01:38:01.585337+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.585337+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:58.395669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2750,"num_read_kb":2605,"num_write":624,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'206","reported_seq":841,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.248892+0000","last_change":"2024-09-12T01:37:49.248829+0000","last_active":"2024-09-12T01:37:49.248892+0000","last_peered":"2024-09-12T01:37:49.248892+0000","last_clean":"2024-09-12T01:37:49.248892+0000","last_became_active":"2024-09-12T00:25:00.466945+0000","last_became_peered":"2024-09-12T00:25:00.466945+0000","last_unstale":"2024-09-12T01:37:49.248892+0000","last_undegraded":"2024-09-12T01:37:49.248892+0000","last_fullsized":"2024-09-12T01:37:49.248892+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T01:37:49.248703+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T01:37:49.248703+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.248703+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:28.604127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":18851,"num_write":965,"num_write_kb":35048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'499","reported_seq":2048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.776962+0000","last_change":"2024-09-12T01:37:56.776897+0000","last_active":"2024-09-12T01:37:56.776962+0000","last_peered":"2024-09-12T01:37:56.776962+0000","last_clean":"2024-09-12T01:37:56.776962+0000","last_became_active":"2024-09-12T00:25:02.475225+0000","last_became_peered":"2024-09-12T00:25:02.475225+0000","last_unstale":"2024-09-12T01:37:56.776962+0000","last_undegraded":"2024-09-12T01:37:56.776962+0000","last_fullsized":"2024-09-12T01:37:56.776962+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T01:37:56.776795+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T01:37:56.776795+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.776795+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:34.741261+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2326,"num_write":604,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":947,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'195","reported_seq":837,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.258913+0000","last_change":"2024-09-12T01:37:54.258842+0000","last_active":"2024-09-12T01:37:54.258913+0000","last_peered":"2024-09-12T01:37:54.258913+0000","last_clean":"2024-09-12T01:37:54.258913+0000","last_became_active":"2024-09-12T00:25:00.468245+0000","last_became_peered":"2024-09-12T00:25:00.468245+0000","last_unstale":"2024-09-12T01:37:54.258913+0000","last_undegraded":"2024-09-12T01:37:54.258913+0000","last_fullsized":"2024-09-12T01:37:54.258913+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'195","last_scrub_stamp":"2024-09-12T01:37:54.258714+0000","last_deep_scrub":"266'195","last_deep_scrub_stamp":"2024-09-12T01:37:54.258714+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.258714+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:03.360749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":27275,"num_write":960,"num_write_kb":19137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'529","reported_seq":2295,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.334078+0000","last_change":"2024-09-12T01:37:58.334020+0000","last_active":"2024-09-12T01:37:58.334078+0000","last_peered":"2024-09-12T01:37:58.334078+0000","last_clean":"2024-09-12T01:37:58.334078+0000","last_became_active":"2024-09-12T00:25:02.469044+0000","last_became_peered":"2024-09-12T00:25:02.469044+0000","last_unstale":"2024-09-12T01:37:58.334078+0000","last_undegraded":"2024-09-12T01:37:58.334078+0000","last_fullsized":"2024-09-12T01:37:58.334078+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'529","last_scrub_stamp":"2024-09-12T01:37:58.333929+0000","last_deep_scrub":"266'529","last_deep_scrub_stamp":"2024-09-12T01:37:58.333929+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.333929+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:57.684362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2889,"num_read_kb":2724,"num_write":624,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3030,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'185","reported_seq":819,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.658331+0000","last_change":"2024-09-12T01:37:48.658264+0000","last_active":"2024-09-12T01:37:48.658331+0000","last_peered":"2024-09-12T01:37:48.658331+0000","last_clean":"2024-09-12T01:37:48.658331+0000","last_became_active":"2024-09-12T00:25:00.487526+0000","last_became_peered":"2024-09-12T00:25:00.487526+0000","last_unstale":"2024-09-12T01:37:48.658331+0000","last_undegraded":"2024-09-12T01:37:48.658331+0000","last_fullsized":"2024-09-12T01:37:48.658331+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:48.658138+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:48.658138+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.658138+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:27.351203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306655,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":3010,"num_write":923,"num_write_kb":19090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1186","reported_seq":2787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.889719+0000","last_change":"2024-09-12T01:37:50.889645+0000","last_active":"2024-09-12T01:37:50.889719+0000","last_peered":"2024-09-12T01:37:50.889719+0000","last_clean":"2024-09-12T01:37:50.889719+0000","last_became_active":"2024-09-12T00:25:02.465257+0000","last_became_peered":"2024-09-12T00:25:02.465257+0000","last_unstale":"2024-09-12T01:37:50.889719+0000","last_undegraded":"2024-09-12T01:37:50.889719+0000","last_fullsized":"2024-09-12T01:37:50.889719+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1186","last_scrub_stamp":"2024-09-12T01:37:50.889557+0000","last_deep_scrub":"266'1186","last_deep_scrub_stamp":"2024-09-12T01:37:50.889557+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.889557+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:33.235013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5507,"num_read_kb":4876,"num_write":1621,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'262","reported_seq":919,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.605261+0000","last_change":"2024-09-12T01:37:52.605167+0000","last_active":"2024-09-12T01:37:52.605261+0000","last_peered":"2024-09-12T01:37:52.605261+0000","last_clean":"2024-09-12T01:37:52.605261+0000","last_became_active":"2024-09-12T00:25:00.469159+0000","last_became_peered":"2024-09-12T00:25:00.469159+0000","last_unstale":"2024-09-12T01:37:52.605261+0000","last_undegraded":"2024-09-12T01:37:52.605261+0000","last_fullsized":"2024-09-12T01:37:52.605261+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'262","last_scrub_stamp":"2024-09-12T01:37:52.605010+0000","last_deep_scrub":"266'262","last_deep_scrub_stamp":"2024-09-12T01:37:52.605010+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.605010+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:46.615461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":57821,"num_write":1101,"num_write_kb":41989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'489","reported_seq":1932,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.485490+0000","last_change":"2024-09-12T01:38:00.485490+0000","last_active":"2024-09-12T01:38:00.485490+0000","last_peered":"2024-09-12T01:38:00.485490+0000","last_clean":"2024-09-12T01:38:00.485490+0000","last_became_active":"2024-09-12T00:25:02.470623+0000","last_became_peered":"2024-09-12T00:25:02.470623+0000","last_unstale":"2024-09-12T01:38:00.485490+0000","last_undegraded":"2024-09-12T01:38:00.485490+0000","last_fullsized":"2024-09-12T01:38:00.485490+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'489","last_scrub_stamp":"2024-09-12T01:38:00.485373+0000","last_deep_scrub":"266'489","last_deep_scrub_stamp":"2024-09-12T01:38:00.485373+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.485373+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:54.174690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2404,"num_read_kb":2207,"num_write":594,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":704,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'242","reported_seq":915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.082986+0000","last_change":"2024-09-12T01:37:55.082986+0000","last_active":"2024-09-12T01:37:55.082986+0000","last_peered":"2024-09-12T01:37:55.082986+0000","last_clean":"2024-09-12T01:37:55.082986+0000","last_became_active":"2024-09-12T00:25:00.469918+0000","last_became_peered":"2024-09-12T00:25:00.469918+0000","last_unstale":"2024-09-12T01:37:55.082986+0000","last_undegraded":"2024-09-12T01:37:55.082986+0000","last_fullsized":"2024-09-12T01:37:55.082986+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'242","last_scrub_stamp":"2024-09-12T01:37:55.082838+0000","last_deep_scrub":"266'242","last_deep_scrub_stamp":"2024-09-12T01:37:55.082838+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.082838+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:33.200370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":488,"num_read_kb":51750,"num_write":1103,"num_write_kb":39694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'615","reported_seq":2423,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.742975+0000","last_change":"2024-09-12T01:37:53.742975+0000","last_active":"2024-09-12T01:37:53.742975+0000","last_peered":"2024-09-12T01:37:53.742975+0000","last_clean":"2024-09-12T01:37:53.742975+0000","last_became_active":"2024-09-12T00:25:02.475864+0000","last_became_peered":"2024-09-12T00:25:02.475864+0000","last_unstale":"2024-09-12T01:37:53.742975+0000","last_undegraded":"2024-09-12T01:37:53.742975+0000","last_fullsized":"2024-09-12T01:37:53.742975+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'615","last_scrub_stamp":"2024-09-12T01:37:53.742862+0000","last_deep_scrub":"266'615","last_deep_scrub_stamp":"2024-09-12T01:37:53.742862+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.742862+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:34.727742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3105,"num_read_kb":2885,"num_write":734,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":934,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'287","reported_seq":994,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.594953+0000","last_change":"2024-09-12T01:37:54.594953+0000","last_active":"2024-09-12T01:37:54.594953+0000","last_peered":"2024-09-12T01:37:54.594953+0000","last_clean":"2024-09-12T01:37:54.594953+0000","last_became_active":"2024-09-12T00:25:00.468228+0000","last_became_peered":"2024-09-12T00:25:00.468228+0000","last_unstale":"2024-09-12T01:37:54.594953+0000","last_undegraded":"2024-09-12T01:37:54.594953+0000","last_fullsized":"2024-09-12T01:37:54.594953+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'287","last_scrub_stamp":"2024-09-12T01:37:54.594827+0000","last_deep_scrub":"266'287","last_deep_scrub_stamp":"2024-09-12T01:37:54.594827+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.594827+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:15.134217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":681,"num_read_kb":67032,"num_write":1230,"num_write_kb":28377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'952","reported_seq":2525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.669075+0000","last_change":"2024-09-12T01:38:05.669075+0000","last_active":"2024-09-12T01:38:05.669075+0000","last_peered":"2024-09-12T01:38:05.669075+0000","last_clean":"2024-09-12T01:38:05.669075+0000","last_became_active":"2024-09-12T00:25:02.473441+0000","last_became_peered":"2024-09-12T00:25:02.473441+0000","last_unstale":"2024-09-12T01:38:05.669075+0000","last_undegraded":"2024-09-12T01:38:05.669075+0000","last_fullsized":"2024-09-12T01:38:05.669075+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'952","last_scrub_stamp":"2024-09-12T01:38:05.668932+0000","last_deep_scrub":"266'952","last_deep_scrub_stamp":"2024-09-12T01:38:05.668932+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.668932+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":900,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:46.937367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4462,"num_read_kb":3929,"num_write":1316,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'215","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.822790+0000","last_change":"2024-09-12T01:37:46.822790+0000","last_active":"2024-09-12T01:37:46.822790+0000","last_peered":"2024-09-12T01:37:46.822790+0000","last_clean":"2024-09-12T01:37:46.822790+0000","last_became_active":"2024-09-12T00:25:00.465127+0000","last_became_peered":"2024-09-12T00:25:00.465127+0000","last_unstale":"2024-09-12T01:37:46.822790+0000","last_undegraded":"2024-09-12T01:37:46.822790+0000","last_fullsized":"2024-09-12T01:37:46.822790+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'215","last_scrub_stamp":"2024-09-12T01:37:46.822705+0000","last_deep_scrub":"266'215","last_deep_scrub_stamp":"2024-09-12T01:37:46.822705+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.822705+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:52.870895+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":16638,"num_write":1049,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'829","reported_seq":2458,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.894009+0000","last_change":"2024-09-12T01:37:53.894009+0000","last_active":"2024-09-12T01:37:53.894009+0000","last_peered":"2024-09-12T01:37:53.894009+0000","last_clean":"2024-09-12T01:37:53.894009+0000","last_became_active":"2024-09-12T00:25:02.464386+0000","last_became_peered":"2024-09-12T00:25:02.464386+0000","last_unstale":"2024-09-12T01:37:53.894009+0000","last_undegraded":"2024-09-12T01:37:53.894009+0000","last_fullsized":"2024-09-12T01:37:53.894009+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'829","last_scrub_stamp":"2024-09-12T01:37:53.893911+0000","last_deep_scrub":"266'829","last_deep_scrub_stamp":"2024-09-12T01:37:53.893911+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.893911+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:08.882315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3522,"num_write":1059,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'166","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.385520+0000","last_change":"2024-09-12T01:37:53.385520+0000","last_active":"2024-09-12T01:37:53.385520+0000","last_peered":"2024-09-12T01:37:53.385520+0000","last_clean":"2024-09-12T01:37:53.385520+0000","last_became_active":"2024-09-12T00:25:00.465400+0000","last_became_peered":"2024-09-12T00:25:00.465400+0000","last_unstale":"2024-09-12T01:37:53.385520+0000","last_undegraded":"2024-09-12T01:37:53.385520+0000","last_fullsized":"2024-09-12T01:37:53.385520+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'166","last_scrub_stamp":"2024-09-12T01:37:53.385357+0000","last_deep_scrub":"266'166","last_deep_scrub_stamp":"2024-09-12T01:37:53.385357+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.385357+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:28.894338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":4582,"num_write":828,"num_write_kb":26519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'783","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.880976+0000","last_change":"2024-09-12T01:37:52.880976+0000","last_active":"2024-09-12T01:37:52.880976+0000","last_peered":"2024-09-12T01:37:52.880976+0000","last_clean":"2024-09-12T01:37:52.880976+0000","last_became_active":"2024-09-12T00:25:02.469046+0000","last_became_peered":"2024-09-12T00:25:02.469046+0000","last_unstale":"2024-09-12T01:37:52.880976+0000","last_undegraded":"2024-09-12T01:37:52.880976+0000","last_fullsized":"2024-09-12T01:37:52.880976+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'783","last_scrub_stamp":"2024-09-12T01:37:52.880841+0000","last_deep_scrub":"266'783","last_deep_scrub_stamp":"2024-09-12T01:37:52.880841+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.880841+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:39.288474+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3834,"num_read_kb":3478,"num_write":1008,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2140,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'208","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.906129+0000","last_change":"2024-09-12T01:37:46.906129+0000","last_active":"2024-09-12T01:37:46.906129+0000","last_peered":"2024-09-12T01:37:46.906129+0000","last_clean":"2024-09-12T01:37:46.906129+0000","last_became_active":"2024-09-12T00:25:00.468581+0000","last_became_peered":"2024-09-12T00:25:00.468581+0000","last_unstale":"2024-09-12T01:37:46.906129+0000","last_undegraded":"2024-09-12T01:37:46.906129+0000","last_fullsized":"2024-09-12T01:37:46.906129+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:37:46.906027+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:37:46.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.906027+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:01.027597+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323902,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":48643,"num_write":1011,"num_write_kb":19361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'801","reported_seq":2374,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.444482+0000","last_change":"2024-09-12T01:37:55.444482+0000","last_active":"2024-09-12T01:37:55.444482+0000","last_peered":"2024-09-12T01:37:55.444482+0000","last_clean":"2024-09-12T01:37:55.444482+0000","last_became_active":"2024-09-12T00:25:02.476825+0000","last_became_peered":"2024-09-12T00:25:02.476825+0000","last_unstale":"2024-09-12T01:37:55.444482+0000","last_undegraded":"2024-09-12T01:37:55.444482+0000","last_fullsized":"2024-09-12T01:37:55.444482+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T01:37:55.444397+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T01:37:55.444397+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.444397+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:39.143798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3888,"num_read_kb":3500,"num_write":1075,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'188","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.077782+0000","last_change":"2024-09-12T01:37:58.077782+0000","last_active":"2024-09-12T01:37:58.077782+0000","last_peered":"2024-09-12T01:37:58.077782+0000","last_clean":"2024-09-12T01:37:58.077782+0000","last_became_active":"2024-09-12T00:25:00.480122+0000","last_became_peered":"2024-09-12T00:25:00.480122+0000","last_unstale":"2024-09-12T01:37:58.077782+0000","last_undegraded":"2024-09-12T01:37:58.077782+0000","last_fullsized":"2024-09-12T01:37:58.077782+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:58.077623+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:58.077623+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.077623+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:26.959203+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399183,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":553,"num_read_kb":7914,"num_write":895,"num_write_kb":29144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'692","reported_seq":2154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.377713+0000","last_change":"2024-09-12T01:37:58.377713+0000","last_active":"2024-09-12T01:37:58.377713+0000","last_peered":"2024-09-12T01:37:58.377713+0000","last_clean":"2024-09-12T01:37:58.377713+0000","last_became_active":"2024-09-12T00:25:02.465790+0000","last_became_peered":"2024-09-12T00:25:02.465790+0000","last_unstale":"2024-09-12T01:37:58.377713+0000","last_undegraded":"2024-09-12T01:37:58.377713+0000","last_fullsized":"2024-09-12T01:37:58.377713+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'692","last_scrub_stamp":"2024-09-12T01:37:58.377612+0000","last_deep_scrub":"266'692","last_deep_scrub_stamp":"2024-09-12T01:37:58.377612+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.377612+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:21.790646+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3268,"num_read_kb":2971,"num_write":903,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'258","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.401918+0000","last_change":"2024-09-12T01:37:51.401918+0000","last_active":"2024-09-12T01:37:51.401918+0000","last_peered":"2024-09-12T01:37:51.401918+0000","last_clean":"2024-09-12T01:37:51.401918+0000","last_became_active":"2024-09-12T00:25:00.469634+0000","last_became_peered":"2024-09-12T00:25:00.469634+0000","last_unstale":"2024-09-12T01:37:51.401918+0000","last_undegraded":"2024-09-12T01:37:51.401918+0000","last_fullsized":"2024-09-12T01:37:51.401918+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'258","last_scrub_stamp":"2024-09-12T01:37:51.401778+0000","last_deep_scrub":"266'258","last_deep_scrub_stamp":"2024-09-12T01:37:51.401778+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.401778+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:00.034860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155756,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1718,"num_write":1162,"num_write_kb":27079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'436","reported_seq":2052,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.872718+0000","last_change":"2024-09-12T01:37:51.872718+0000","last_active":"2024-09-12T01:37:51.872718+0000","last_peered":"2024-09-12T01:37:51.872718+0000","last_clean":"2024-09-12T01:37:51.872718+0000","last_became_active":"2024-09-12T00:25:02.464112+0000","last_became_peered":"2024-09-12T00:25:02.464112+0000","last_unstale":"2024-09-12T01:37:51.872718+0000","last_undegraded":"2024-09-12T01:37:51.872718+0000","last_fullsized":"2024-09-12T01:37:51.872718+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'436","last_scrub_stamp":"2024-09-12T01:37:51.872608+0000","last_deep_scrub":"266'436","last_deep_scrub_stamp":"2024-09-12T01:37:51.872608+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.872608+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:01.236298+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2410,"num_read_kb":2284,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'226","reported_seq":884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.008992+0000","last_change":"2024-09-12T01:38:00.008992+0000","last_active":"2024-09-12T01:38:00.008992+0000","last_peered":"2024-09-12T01:38:00.008992+0000","last_clean":"2024-09-12T01:38:00.008992+0000","last_became_active":"2024-09-12T00:25:00.468600+0000","last_became_peered":"2024-09-12T00:25:00.468600+0000","last_unstale":"2024-09-12T01:38:00.008992+0000","last_undegraded":"2024-09-12T01:38:00.008992+0000","last_fullsized":"2024-09-12T01:38:00.008992+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:38:00.008790+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:38:00.008790+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.008790+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:56.789743+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133763,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":7263,"num_write":1147,"num_write_kb":27569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'182","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.002937+0000","last_change":"2024-09-12T01:38:01.002937+0000","last_active":"2024-09-12T01:38:01.002937+0000","last_peered":"2024-09-12T01:38:01.002937+0000","last_clean":"2024-09-12T01:38:01.002937+0000","last_became_active":"2024-09-12T00:25:00.469382+0000","last_became_peered":"2024-09-12T00:25:00.469382+0000","last_unstale":"2024-09-12T01:38:01.002937+0000","last_undegraded":"2024-09-12T01:38:01.002937+0000","last_fullsized":"2024-09-12T01:38:01.002937+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'182","last_scrub_stamp":"2024-09-12T01:38:01.002819+0000","last_deep_scrub":"266'182","last_deep_scrub_stamp":"2024-09-12T01:38:01.002819+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.002819+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:33.648707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":14411,"num_write":860,"num_write_kb":23706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'918","reported_seq":2496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.350546+0000","last_change":"2024-09-12T01:38:00.350546+0000","last_active":"2024-09-12T01:38:00.350546+0000","last_peered":"2024-09-12T01:38:00.350546+0000","last_clean":"2024-09-12T01:38:00.350546+0000","last_became_active":"2024-09-12T00:25:02.475004+0000","last_became_peered":"2024-09-12T00:25:02.475004+0000","last_unstale":"2024-09-12T01:38:00.350546+0000","last_undegraded":"2024-09-12T01:38:00.350546+0000","last_fullsized":"2024-09-12T01:38:00.350546+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'918","last_scrub_stamp":"2024-09-12T01:38:00.350456+0000","last_deep_scrub":"266'918","last_deep_scrub_stamp":"2024-09-12T01:38:00.350456+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.350456+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:25.819056+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4224,"num_read_kb":3778,"num_write":1247,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'230","reported_seq":963,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.567919+0000","last_change":"2024-09-12T01:37:55.567919+0000","last_active":"2024-09-12T01:37:55.567919+0000","last_peered":"2024-09-12T01:37:55.567919+0000","last_clean":"2024-09-12T01:37:55.567919+0000","last_became_active":"2024-09-12T00:25:00.471411+0000","last_became_peered":"2024-09-12T00:25:00.471411+0000","last_unstale":"2024-09-12T01:37:55.567919+0000","last_undegraded":"2024-09-12T01:37:55.567919+0000","last_fullsized":"2024-09-12T01:37:55.567919+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'230","last_scrub_stamp":"2024-09-12T01:37:55.567768+0000","last_deep_scrub":"266'230","last_deep_scrub_stamp":"2024-09-12T01:37:55.567768+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.567768+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:16.993814+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323861,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":157504,"num_write":954,"num_write_kb":45267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'651","reported_seq":2402,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.941466+0000","last_change":"2024-09-12T01:37:56.941466+0000","last_active":"2024-09-12T01:37:56.941466+0000","last_peered":"2024-09-12T01:37:56.941466+0000","last_clean":"2024-09-12T01:37:56.941466+0000","last_became_active":"2024-09-12T00:25:02.462993+0000","last_became_peered":"2024-09-12T00:25:02.462993+0000","last_unstale":"2024-09-12T01:37:56.941466+0000","last_undegraded":"2024-09-12T01:37:56.941466+0000","last_fullsized":"2024-09-12T01:37:56.941466+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'651","last_scrub_stamp":"2024-09-12T01:37:56.941361+0000","last_deep_scrub":"266'651","last_deep_scrub_stamp":"2024-09-12T01:37:56.941361+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.941361+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:04.170101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3586,"num_read_kb":3293,"num_write":883,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1767,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5955,"num_read_kb":4160,"num_write":1937,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7978,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1010,"ondisk_log_size":1010,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15084,"num_read_kb":14735,"num_write":16735,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2619,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1550,"ondisk_log_size":1550,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":680,"ondisk_log_size":680,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":318753,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":10187,"num_read_kb":12369,"num_write":7087,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673448,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1781,"ondisk_log_size":1781,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2373,"num_read_kb":2833,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212728,"num_read_kb":194072,"num_write":55276,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43270,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4154,"ondisk_log_size":4154,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":79547187,"num_objects":235,"num_object_clones":0,"num_object_copies":940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":235,"num_whiteouts":0,"num_read":33257,"num_read_kb":1810768,"num_write":62815,"num_write_kb":1904228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108691456,"data_stored":108691456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4112,"ondisk_log_size":4112,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":174385,"num_write":182,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":174274,"num_write":182,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477632,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145280,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94226560,"statfs":{"total":96636764160,"available":96487997440,"internally_reserved":0,"allocated":15908864,"data_stored":13922526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477630,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136056,"kb_used_data":24360,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94235784,"statfs":{"total":96636764160,"available":96497442816,"internally_reserved":0,"allocated":24944640,"data_stored":22945833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424510335,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214292,"kb_used_data":16580,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94157548,"statfs":{"total":96636764160,"available":96417329152,"internally_reserved":0,"allocated":16977920,"data_stored":14990871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510333,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106896,"kb_used_data":17408,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94264944,"statfs":{"total":96636764160,"available":96527302656,"internally_reserved":0,"allocated":17825792,"data_stored":15808424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510334,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239100,"kb_used_data":13548,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94132740,"statfs":{"total":96636764160,"available":96391925760,"internally_reserved":0,"allocated":13873152,"data_stored":11862637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510335,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253088,"kb_used_data":19216,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94118752,"statfs":{"total":96636764160,"available":96377602048,"internally_reserved":0,"allocated":19677184,"data_stored":17673901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510335,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291176,"kb_used_data":17048,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94080664,"statfs":{"total":96636764160,"available":96338599936,"internally_reserved":0,"allocated":17457152,"data_stored":15457736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575746,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188040,"kb_used_data":16696,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94183800,"statfs":{"total":96636764160,"available":96444211200,"internally_reserved":0,"allocated":17096704,"data_stored":15102370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20709376,"data_stored":20709376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12632064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11685888,"data_stored":11685888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15437824,"data_stored":15437824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12865536,"data_stored":12865536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9035776,"data_stored":9035776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13570048,"data_stored":13570048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12754944,"data_stored":12754944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:38:48.410 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:48.410 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:48.410 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:43:37.770139+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=37, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:48.411 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:48.411 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:48.411 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:39:16.736665+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:48.412 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:48.412 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:43:42.795570+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=43, tm_sec=42, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:48.412 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T01:02:02.898962+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=2, tm_sec=2, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=1, tm_min=37, tm_sec=41, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T01:38:48.415 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T01:39:08.415 DEBUG:teuthology.orchestra.run.smithi019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T01:39:08.770 INFO:teuthology.orchestra.run.smithi019.stdout: 2024-09-12T01:39:08.782 INFO:teuthology.orchestra.run.smithi019.stderr:dumped all 2024-09-12T01:39:08.784 INFO:teuthology.orchestra.run.smithi019.stdout:{"pg_ready":true,"pg_map":{"version":2493,"stamp":"2024-09-12T01:39:06.807920+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":80473315,"num_objects":722,"num_object_clones":0,"num_object_copies":1914,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":722,"num_whiteouts":0,"num_read":279991,"num_read_kb":2387663,"num_write":144355,"num_write_kb":2165314,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":728443,"num_omap_keys":1780,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13639,"ondisk_log_size":13639,"up":914,"acting":914,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":914,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1573928,"kb_used_data":140392,"kb_used_omap":12,"kb_used_meta":1433395,"kb_avail":753400792,"statfs":{"total":773094113280,"available":771482411008,"internally_reserved":0,"allocated":143761408,"data_stored":127764298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":1467797040},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005779"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.805310+0000","last_change":"2024-09-12T01:38:21.805310+0000","last_active":"2024-09-12T01:38:21.805310+0000","last_peered":"2024-09-12T01:38:21.805310+0000","last_clean":"2024-09-12T01:38:21.805310+0000","last_became_active":"2024-09-12T01:02:03.925687+0000","last_became_peered":"2024-09-12T01:02:03.925687+0000","last_unstale":"2024-09-12T01:38:21.805310+0000","last_undegraded":"2024-09-12T01:38:21.805310+0000","last_fullsized":"2024-09-12T01:38:21.805310+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:21.805216+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:21.805216+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.805216+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:35.927340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"266'2","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.786887+0000","last_change":"2024-09-12T01:38:18.786824+0000","last_active":"2024-09-12T01:38:18.786887+0000","last_peered":"2024-09-12T01:38:18.786887+0000","last_clean":"2024-09-12T01:38:18.786887+0000","last_became_active":"2024-09-12T00:43:43.812701+0000","last_became_peered":"2024-09-12T00:43:43.812701+0000","last_unstale":"2024-09-12T01:38:18.786887+0000","last_undegraded":"2024-09-12T01:38:18.786887+0000","last_fullsized":"2024-09-12T01:38:18.786887+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:18.786735+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:18.786735+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.786735+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:12:25.075328+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"263'3","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.653428+0000","last_change":"2024-09-12T01:38:25.653376+0000","last_active":"2024-09-12T01:38:25.653428+0000","last_peered":"2024-09-12T01:38:25.653428+0000","last_clean":"2024-09-12T01:38:25.653428+0000","last_became_active":"2024-09-12T00:43:38.799322+0000","last_became_peered":"2024-09-12T00:43:38.799322+0000","last_unstale":"2024-09-12T01:38:25.653428+0000","last_undegraded":"2024-09-12T01:38:25.653428+0000","last_fullsized":"2024-09-12T01:38:25.653428+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T01:38:25.653271+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T01:38:25.653271+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.653271+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:57.413192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"0'0","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.351537+0000","last_change":"2024-09-12T01:38:26.351537+0000","last_active":"2024-09-12T01:38:26.351537+0000","last_peered":"2024-09-12T01:38:26.351537+0000","last_clean":"2024-09-12T01:38:26.351537+0000","last_became_active":"2024-09-12T00:39:17.763761+0000","last_became_peered":"2024-09-12T00:39:17.763761+0000","last_unstale":"2024-09-12T01:38:26.351537+0000","last_undegraded":"2024-09-12T01:38:26.351537+0000","last_fullsized":"2024-09-12T01:38:26.351537+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:26.351429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:26.351429+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.351429+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:40.772537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.559725+0000","last_change":"2024-09-12T01:38:28.559725+0000","last_active":"2024-09-12T01:38:28.559725+0000","last_peered":"2024-09-12T01:38:28.559725+0000","last_clean":"2024-09-12T01:38:28.559725+0000","last_became_active":"2024-09-12T01:02:03.925338+0000","last_became_peered":"2024-09-12T01:02:03.925338+0000","last_unstale":"2024-09-12T01:38:28.559725+0000","last_undegraded":"2024-09-12T01:38:28.559725+0000","last_fullsized":"2024-09-12T01:38:28.559725+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:28.559629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:28.559629+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.559629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:53.602786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"266'5","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.585192+0000","last_change":"2024-09-12T01:38:25.585122+0000","last_active":"2024-09-12T01:38:25.585192+0000","last_peered":"2024-09-12T01:38:25.585192+0000","last_clean":"2024-09-12T01:38:25.585192+0000","last_became_active":"2024-09-12T00:43:43.822189+0000","last_became_peered":"2024-09-12T00:43:43.822189+0000","last_unstale":"2024-09-12T01:38:25.585192+0000","last_undegraded":"2024-09-12T01:38:25.585192+0000","last_fullsized":"2024-09-12T01:38:25.585192+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:25.585035+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:25.585035+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.585035+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:23.533593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":12284,"num_write":10,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'2","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.691393+0000","last_change":"2024-09-12T01:38:29.691283+0000","last_active":"2024-09-12T01:38:29.691393+0000","last_peered":"2024-09-12T01:38:29.691393+0000","last_clean":"2024-09-12T01:38:29.691393+0000","last_became_active":"2024-09-12T00:43:38.793866+0000","last_became_peered":"2024-09-12T00:43:38.793866+0000","last_unstale":"2024-09-12T01:38:29.691393+0000","last_undegraded":"2024-09-12T01:38:29.691393+0000","last_fullsized":"2024-09-12T01:38:29.691393+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:29.691186+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:29.691186+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.691186+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:34.042551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1028,"num_write":2,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'33","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.306035+0000","last_change":"2024-09-12T01:38:25.306035+0000","last_active":"2024-09-12T01:38:25.306035+0000","last_peered":"2024-09-12T01:38:25.306035+0000","last_clean":"2024-09-12T01:38:25.306035+0000","last_became_active":"2024-09-12T00:39:17.768977+0000","last_became_peered":"2024-09-12T00:39:17.768977+0000","last_unstale":"2024-09-12T01:38:25.306035+0000","last_undegraded":"2024-09-12T01:38:25.306035+0000","last_fullsized":"2024-09-12T01:38:25.306035+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T01:38:25.305920+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T01:38:25.305920+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.305920+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:51.244315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":160,"num_read_kb":119,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.830116+0000","last_change":"2024-09-12T01:38:19.830116+0000","last_active":"2024-09-12T01:38:19.830116+0000","last_peered":"2024-09-12T01:38:19.830116+0000","last_clean":"2024-09-12T01:38:19.830116+0000","last_became_active":"2024-09-12T01:02:03.921938+0000","last_became_peered":"2024-09-12T01:02:03.921938+0000","last_unstale":"2024-09-12T01:38:19.830116+0000","last_undegraded":"2024-09-12T01:38:19.830116+0000","last_fullsized":"2024-09-12T01:38:19.830116+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:19.830021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:19.830021+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.830021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:30.470507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"266'6","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.768559+0000","last_change":"2024-09-12T01:38:37.768559+0000","last_active":"2024-09-12T01:38:37.768559+0000","last_peered":"2024-09-12T01:38:37.768559+0000","last_clean":"2024-09-12T01:38:37.768559+0000","last_became_active":"2024-09-12T00:43:43.813568+0000","last_became_peered":"2024-09-12T00:43:43.813568+0000","last_unstale":"2024-09-12T01:38:37.768559+0000","last_undegraded":"2024-09-12T01:38:37.768559+0000","last_fullsized":"2024-09-12T01:38:37.768559+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T01:38:37.768469+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T01:38:37.768469+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.768469+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:29.116430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7172,"num_write":6,"num_write_kb":8196,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'7","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.623425+0000","last_change":"2024-09-12T01:38:24.623425+0000","last_active":"2024-09-12T01:38:24.623425+0000","last_peered":"2024-09-12T01:38:24.623425+0000","last_clean":"2024-09-12T01:38:24.623425+0000","last_became_active":"2024-09-12T00:43:38.797520+0000","last_became_peered":"2024-09-12T00:43:38.797520+0000","last_unstale":"2024-09-12T01:38:24.623425+0000","last_undegraded":"2024-09-12T01:38:24.623425+0000","last_fullsized":"2024-09-12T01:38:24.623425+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T01:38:24.623344+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T01:38:24.623344+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.623344+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:06:12.189910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16390,"num_write":12,"num_write_kb":4100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"263'41","reported_seq":179,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.446692+0000","last_change":"2024-09-12T01:38:20.446692+0000","last_active":"2024-09-12T01:38:20.446692+0000","last_peered":"2024-09-12T01:38:20.446692+0000","last_clean":"2024-09-12T01:38:20.446692+0000","last_became_active":"2024-09-12T00:39:17.768692+0000","last_became_peered":"2024-09-12T00:39:17.768692+0000","last_unstale":"2024-09-12T01:38:20.446692+0000","last_undegraded":"2024-09-12T01:38:20.446692+0000","last_fullsized":"2024-09-12T01:38:20.446692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'41","last_scrub_stamp":"2024-09-12T01:38:20.446587+0000","last_deep_scrub":"263'41","last_deep_scrub_stamp":"2024-09-12T01:38:20.446587+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.446587+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:25.292094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":226,"num_read_kb":161,"num_write":65,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.830368+0000","last_change":"2024-09-12T01:38:44.830368+0000","last_active":"2024-09-12T01:38:44.830368+0000","last_peered":"2024-09-12T01:38:44.830368+0000","last_clean":"2024-09-12T01:38:44.830368+0000","last_became_active":"2024-09-12T01:02:03.922297+0000","last_became_peered":"2024-09-12T01:02:03.922297+0000","last_unstale":"2024-09-12T01:38:44.830368+0000","last_undegraded":"2024-09-12T01:38:44.830368+0000","last_fullsized":"2024-09-12T01:38:44.830368+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:44.830272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:44.830272+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.830272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:36.930746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"0'0","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:36.779536+0000","last_change":"2024-09-12T01:38:36.779536+0000","last_active":"2024-09-12T01:38:36.779536+0000","last_peered":"2024-09-12T01:38:36.779536+0000","last_clean":"2024-09-12T01:38:36.779536+0000","last_became_active":"2024-09-12T00:43:43.818668+0000","last_became_peered":"2024-09-12T00:43:43.818668+0000","last_unstale":"2024-09-12T01:38:36.779536+0000","last_undegraded":"2024-09-12T01:38:36.779536+0000","last_fullsized":"2024-09-12T01:38:36.779536+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:36.779426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:36.779426+0000","last_clean_scrub_stamp":"2024-09-12T01:38:36.779426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:00.142878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.800578+0000","last_change":"2024-09-12T01:38:16.800578+0000","last_active":"2024-09-12T01:38:16.800578+0000","last_peered":"2024-09-12T01:38:16.800578+0000","last_clean":"2024-09-12T01:38:16.800578+0000","last_became_active":"2024-09-12T00:43:38.794121+0000","last_became_peered":"2024-09-12T00:43:38.794121+0000","last_unstale":"2024-09-12T01:38:16.800578+0000","last_undegraded":"2024-09-12T01:38:16.800578+0000","last_fullsized":"2024-09-12T01:38:16.800578+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.800478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.800478+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.800478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:33:59.159347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"263'16","reported_seq":101,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.479563+0000","last_change":"2024-09-12T01:38:19.479563+0000","last_active":"2024-09-12T01:38:19.479563+0000","last_peered":"2024-09-12T01:38:19.479563+0000","last_clean":"2024-09-12T01:38:19.479563+0000","last_became_active":"2024-09-12T00:39:17.759016+0000","last_became_peered":"2024-09-12T00:39:17.759016+0000","last_unstale":"2024-09-12T01:38:19.479563+0000","last_undegraded":"2024-09-12T01:38:19.479563+0000","last_fullsized":"2024-09-12T01:38:19.479563+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'16","last_scrub_stamp":"2024-09-12T01:38:19.479475+0000","last_deep_scrub":"263'16","last_deep_scrub_stamp":"2024-09-12T01:38:19.479475+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.479475+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:38:07.899876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":48,"num_write":34,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.692849+0000","last_change":"2024-09-12T01:38:34.692849+0000","last_active":"2024-09-12T01:38:34.692849+0000","last_peered":"2024-09-12T01:38:34.692849+0000","last_clean":"2024-09-12T01:38:34.692849+0000","last_became_active":"2024-09-12T01:02:03.919293+0000","last_became_peered":"2024-09-12T01:02:03.919293+0000","last_unstale":"2024-09-12T01:38:34.692849+0000","last_undegraded":"2024-09-12T01:38:34.692849+0000","last_fullsized":"2024-09-12T01:38:34.692849+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:34.692743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:34.692743+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.692743+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:45.590739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.732052+0000","last_change":"2024-09-12T01:38:15.732052+0000","last_active":"2024-09-12T01:38:15.732052+0000","last_peered":"2024-09-12T01:38:15.732052+0000","last_clean":"2024-09-12T01:38:15.732052+0000","last_became_active":"2024-09-12T00:43:43.817714+0000","last_became_peered":"2024-09-12T00:43:43.817714+0000","last_unstale":"2024-09-12T01:38:15.732052+0000","last_undegraded":"2024-09-12T01:38:15.732052+0000","last_fullsized":"2024-09-12T01:38:15.732052+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:15.731960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:15.731960+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.731960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:50.516937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'15","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.670852+0000","last_change":"2024-09-12T01:38:28.670852+0000","last_active":"2024-09-12T01:38:28.670852+0000","last_peered":"2024-09-12T01:38:28.670852+0000","last_clean":"2024-09-12T01:38:28.670852+0000","last_became_active":"2024-09-12T00:43:38.795206+0000","last_became_peered":"2024-09-12T00:43:38.795206+0000","last_unstale":"2024-09-12T01:38:28.670852+0000","last_undegraded":"2024-09-12T01:38:28.670852+0000","last_fullsized":"2024-09-12T01:38:28.670852+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'15","last_scrub_stamp":"2024-09-12T01:38:28.670766+0000","last_deep_scrub":"266'15","last_deep_scrub_stamp":"2024-09-12T01:38:28.670766+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.670766+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:51.434106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":29708,"num_write":20,"num_write_kb":14332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'31","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.453395+0000","last_change":"2024-09-12T01:38:18.453395+0000","last_active":"2024-09-12T01:38:18.453395+0000","last_peered":"2024-09-12T01:38:18.453395+0000","last_clean":"2024-09-12T01:38:18.453395+0000","last_became_active":"2024-09-12T00:39:17.762124+0000","last_became_peered":"2024-09-12T00:39:17.762124+0000","last_unstale":"2024-09-12T01:38:18.453395+0000","last_undegraded":"2024-09-12T01:38:18.453395+0000","last_fullsized":"2024-09-12T01:38:18.453395+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'31","last_scrub_stamp":"2024-09-12T01:38:18.453318+0000","last_deep_scrub":"266'31","last_deep_scrub_stamp":"2024-09-12T01:38:18.453318+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.453318+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:29.847076+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":57,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.411249+0000","last_change":"2024-09-12T01:38:31.411249+0000","last_active":"2024-09-12T01:38:31.411249+0000","last_peered":"2024-09-12T01:38:31.411249+0000","last_clean":"2024-09-12T01:38:31.411249+0000","last_became_active":"2024-09-12T01:02:03.915387+0000","last_became_peered":"2024-09-12T01:02:03.915387+0000","last_unstale":"2024-09-12T01:38:31.411249+0000","last_undegraded":"2024-09-12T01:38:31.411249+0000","last_fullsized":"2024-09-12T01:38:31.411249+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:31.411159+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:31.411159+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.411159+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:59.301258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:45.088448+0000","last_change":"2024-09-12T01:38:45.088448+0000","last_active":"2024-09-12T01:38:45.088448+0000","last_peered":"2024-09-12T01:38:45.088448+0000","last_clean":"2024-09-12T01:38:45.088448+0000","last_became_active":"2024-09-12T00:43:43.825054+0000","last_became_peered":"2024-09-12T00:43:43.825054+0000","last_unstale":"2024-09-12T01:38:45.088448+0000","last_undegraded":"2024-09-12T01:38:45.088448+0000","last_fullsized":"2024-09-12T01:38:45.088448+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:45.088357+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:45.088357+0000","last_clean_scrub_stamp":"2024-09-12T01:38:45.088357+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:28:55.941482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:49.197581+0000","last_change":"2024-09-12T01:38:49.197581+0000","last_active":"2024-09-12T01:38:49.197581+0000","last_peered":"2024-09-12T01:38:49.197581+0000","last_clean":"2024-09-12T01:38:49.197581+0000","last_became_active":"2024-09-12T00:43:38.794612+0000","last_became_peered":"2024-09-12T00:43:38.794612+0000","last_unstale":"2024-09-12T01:38:49.197581+0000","last_undegraded":"2024-09-12T01:38:49.197581+0000","last_fullsized":"2024-09-12T01:38:49.197581+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:49.197480+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:49.197480+0000","last_clean_scrub_stamp":"2024-09-12T01:38:49.197480+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:44:14.506579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'16","reported_seq":100,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.519607+0000","last_change":"2024-09-12T01:38:20.519607+0000","last_active":"2024-09-12T01:38:20.519607+0000","last_peered":"2024-09-12T01:38:20.519607+0000","last_clean":"2024-09-12T01:38:20.519607+0000","last_became_active":"2024-09-12T00:39:17.771839+0000","last_became_peered":"2024-09-12T00:39:17.771839+0000","last_unstale":"2024-09-12T01:38:20.519607+0000","last_undegraded":"2024-09-12T01:38:20.519607+0000","last_fullsized":"2024-09-12T01:38:20.519607+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'16","last_scrub_stamp":"2024-09-12T01:38:20.519518+0000","last_deep_scrub":"266'16","last_deep_scrub_stamp":"2024-09-12T01:38:20.519518+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.519518+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:51.296931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":64,"num_read_kb":43,"num_write":37,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'2","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.534682+0000","last_change":"2024-09-12T01:38:28.534682+0000","last_active":"2024-09-12T01:38:28.534682+0000","last_peered":"2024-09-12T01:38:28.534682+0000","last_clean":"2024-09-12T01:38:28.534682+0000","last_became_active":"2024-09-12T01:02:03.928036+0000","last_became_peered":"2024-09-12T01:02:03.928036+0000","last_unstale":"2024-09-12T01:38:28.534682+0000","last_undegraded":"2024-09-12T01:38:28.534682+0000","last_fullsized":"2024-09-12T01:38:28.534682+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:28.534599+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:28.534599+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.534599+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:07.555874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'7","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.544592+0000","last_change":"2024-09-12T01:38:24.544523+0000","last_active":"2024-09-12T01:38:24.544592+0000","last_peered":"2024-09-12T01:38:24.544592+0000","last_clean":"2024-09-12T01:38:24.544592+0000","last_became_active":"2024-09-12T00:43:43.819239+0000","last_became_peered":"2024-09-12T00:43:43.819239+0000","last_unstale":"2024-09-12T01:38:24.544592+0000","last_undegraded":"2024-09-12T01:38:24.544592+0000","last_fullsized":"2024-09-12T01:38:24.544592+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'7","last_scrub_stamp":"2024-09-12T01:38:24.544436+0000","last_deep_scrub":"263'7","last_deep_scrub_stamp":"2024-09-12T01:38:24.544436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.544436+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:00.709590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8210,"num_write":12,"num_write_kb":5124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"266'10","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.776460+0000","last_change":"2024-09-12T01:38:14.776399+0000","last_active":"2024-09-12T01:38:14.776460+0000","last_peered":"2024-09-12T01:38:14.776460+0000","last_clean":"2024-09-12T01:38:14.776460+0000","last_became_active":"2024-09-12T00:43:38.784746+0000","last_became_peered":"2024-09-12T00:43:38.784746+0000","last_unstale":"2024-09-12T01:38:14.776460+0000","last_undegraded":"2024-09-12T01:38:14.776460+0000","last_fullsized":"2024-09-12T01:38:14.776460+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T01:38:14.776310+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T01:38:14.776310+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.776310+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:21.911864+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":5122,"num_write":20,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"257'30","reported_seq":151,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.627333+0000","last_change":"2024-09-12T01:38:17.627333+0000","last_active":"2024-09-12T01:38:17.627333+0000","last_peered":"2024-09-12T01:38:17.627333+0000","last_clean":"2024-09-12T01:38:17.627333+0000","last_became_active":"2024-09-12T00:39:17.764658+0000","last_became_peered":"2024-09-12T00:39:17.764658+0000","last_unstale":"2024-09-12T01:38:17.627333+0000","last_undegraded":"2024-09-12T01:38:17.627333+0000","last_fullsized":"2024-09-12T01:38:17.627333+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"257'30","last_scrub_stamp":"2024-09-12T01:38:17.627235+0000","last_deep_scrub":"257'30","last_deep_scrub_stamp":"2024-09-12T01:38:17.627235+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.627235+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:49.790642+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":139,"num_write":41,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.785618+0000","last_change":"2024-09-12T01:38:22.785618+0000","last_active":"2024-09-12T01:38:22.785618+0000","last_peered":"2024-09-12T01:38:22.785618+0000","last_clean":"2024-09-12T01:38:22.785618+0000","last_became_active":"2024-09-12T01:02:03.917362+0000","last_became_peered":"2024-09-12T01:02:03.917362+0000","last_unstale":"2024-09-12T01:38:22.785618+0000","last_undegraded":"2024-09-12T01:38:22.785618+0000","last_fullsized":"2024-09-12T01:38:22.785618+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.785529+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.785529+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.785529+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:28.459935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"266'8","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.692079+0000","last_change":"2024-09-12T01:38:31.691980+0000","last_active":"2024-09-12T01:38:31.692079+0000","last_peered":"2024-09-12T01:38:31.692079+0000","last_clean":"2024-09-12T01:38:31.692079+0000","last_became_active":"2024-09-12T00:43:43.822574+0000","last_became_peered":"2024-09-12T00:43:43.822574+0000","last_unstale":"2024-09-12T01:38:31.692079+0000","last_undegraded":"2024-09-12T01:38:31.692079+0000","last_fullsized":"2024-09-12T01:38:31.692079+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'8","last_scrub_stamp":"2024-09-12T01:38:31.691880+0000","last_deep_scrub":"266'8","last_deep_scrub_stamp":"2024-09-12T01:38:31.691880+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.691880+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:43:48.567611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":9228,"num_write":8,"num_write_kb":7172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.528282+0000","last_change":"2024-09-12T01:38:22.528218+0000","last_active":"2024-09-12T01:38:22.528282+0000","last_peered":"2024-09-12T01:38:22.528282+0000","last_clean":"2024-09-12T01:38:22.528282+0000","last_became_active":"2024-09-12T00:43:38.799567+0000","last_became_peered":"2024-09-12T00:43:38.799567+0000","last_unstale":"2024-09-12T01:38:22.528282+0000","last_undegraded":"2024-09-12T01:38:22.528282+0000","last_fullsized":"2024-09-12T01:38:22.528282+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:22.528132+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:22.528132+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.528132+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:58.801800+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'52","reported_seq":204,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.404113+0000","last_change":"2024-09-12T01:38:17.404113+0000","last_active":"2024-09-12T01:38:17.404113+0000","last_peered":"2024-09-12T01:38:17.404113+0000","last_clean":"2024-09-12T01:38:17.404113+0000","last_became_active":"2024-09-12T00:39:17.760735+0000","last_became_peered":"2024-09-12T00:39:17.760735+0000","last_unstale":"2024-09-12T01:38:17.404113+0000","last_undegraded":"2024-09-12T01:38:17.404113+0000","last_fullsized":"2024-09-12T01:38:17.404113+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'52","last_scrub_stamp":"2024-09-12T01:38:17.404030+0000","last_deep_scrub":"266'52","last_deep_scrub_stamp":"2024-09-12T01:38:17.404030+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.404030+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:24.515267+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":263,"num_read_kb":192,"num_write":98,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.831519+0000","last_change":"2024-09-12T01:38:42.831519+0000","last_active":"2024-09-12T01:38:42.831519+0000","last_peered":"2024-09-12T01:38:42.831519+0000","last_clean":"2024-09-12T01:38:42.831519+0000","last_became_active":"2024-09-12T01:02:03.924800+0000","last_became_peered":"2024-09-12T01:02:03.924800+0000","last_unstale":"2024-09-12T01:38:42.831519+0000","last_undegraded":"2024-09-12T01:38:42.831519+0000","last_fullsized":"2024-09-12T01:38:42.831519+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:42.831432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:42.831432+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.831432+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:52.296885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"0'0","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.724564+0000","last_change":"2024-09-12T01:38:35.724564+0000","last_active":"2024-09-12T01:38:35.724564+0000","last_peered":"2024-09-12T01:38:35.724564+0000","last_clean":"2024-09-12T01:38:35.724564+0000","last_became_active":"2024-09-12T00:43:43.822130+0000","last_became_peered":"2024-09-12T00:43:43.822130+0000","last_unstale":"2024-09-12T01:38:35.724564+0000","last_undegraded":"2024-09-12T01:38:35.724564+0000","last_fullsized":"2024-09-12T01:38:35.724564+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:35.724479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:35.724479+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.724479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:06:00.962758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:44.122389+0000","last_change":"2024-09-12T01:38:44.122389+0000","last_active":"2024-09-12T01:38:44.122389+0000","last_peered":"2024-09-12T01:38:44.122389+0000","last_clean":"2024-09-12T01:38:44.122389+0000","last_became_active":"2024-09-12T00:43:38.789198+0000","last_became_peered":"2024-09-12T00:43:38.789198+0000","last_unstale":"2024-09-12T01:38:44.122389+0000","last_undegraded":"2024-09-12T01:38:44.122389+0000","last_fullsized":"2024-09-12T01:38:44.122389+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:44.122298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:44.122298+0000","last_clean_scrub_stamp":"2024-09-12T01:38:44.122298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:44.340207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'15","reported_seq":105,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.333313+0000","last_change":"2024-09-12T01:38:24.333313+0000","last_active":"2024-09-12T01:38:24.333313+0000","last_peered":"2024-09-12T01:38:24.333313+0000","last_clean":"2024-09-12T01:38:24.333313+0000","last_became_active":"2024-09-12T00:39:17.767662+0000","last_became_peered":"2024-09-12T00:39:17.767662+0000","last_unstale":"2024-09-12T01:38:24.333313+0000","last_undegraded":"2024-09-12T01:38:24.333313+0000","last_fullsized":"2024-09-12T01:38:24.333313+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'15","last_scrub_stamp":"2024-09-12T01:38:24.333221+0000","last_deep_scrub":"266'15","last_deep_scrub_stamp":"2024-09-12T01:38:24.333221+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.333221+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:32.331840+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":56,"num_write":29,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'2","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.564727+0000","last_change":"2024-09-12T01:38:25.564727+0000","last_active":"2024-09-12T01:38:25.564727+0000","last_peered":"2024-09-12T01:38:25.564727+0000","last_clean":"2024-09-12T01:38:25.564727+0000","last_became_active":"2024-09-12T01:02:03.924303+0000","last_became_peered":"2024-09-12T01:02:03.924303+0000","last_unstale":"2024-09-12T01:38:25.564727+0000","last_undegraded":"2024-09-12T01:38:25.564727+0000","last_fullsized":"2024-09-12T01:38:25.564727+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:25.564609+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:25.564609+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.564609+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:10:41.068482+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'9","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.747212+0000","last_change":"2024-09-12T01:38:35.747212+0000","last_active":"2024-09-12T01:38:35.747212+0000","last_peered":"2024-09-12T01:38:35.747212+0000","last_clean":"2024-09-12T01:38:35.747212+0000","last_became_active":"2024-09-12T00:43:43.819058+0000","last_became_peered":"2024-09-12T00:43:43.819058+0000","last_unstale":"2024-09-12T01:38:35.747212+0000","last_undegraded":"2024-09-12T01:38:35.747212+0000","last_fullsized":"2024-09-12T01:38:35.747212+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T01:38:35.747130+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T01:38:35.747130+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.747130+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:01.602606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9222,"num_write":14,"num_write_kb":9222,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"266'8","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.796535+0000","last_change":"2024-09-12T01:38:11.796535+0000","last_active":"2024-09-12T01:38:11.796535+0000","last_peered":"2024-09-12T01:38:11.796535+0000","last_clean":"2024-09-12T01:38:11.796535+0000","last_became_active":"2024-09-12T00:43:38.796426+0000","last_became_peered":"2024-09-12T00:43:38.796426+0000","last_unstale":"2024-09-12T01:38:11.796535+0000","last_undegraded":"2024-09-12T01:38:11.796535+0000","last_fullsized":"2024-09-12T01:38:11.796535+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'8","last_scrub_stamp":"2024-09-12T01:38:11.796424+0000","last_deep_scrub":"266'8","last_deep_scrub_stamp":"2024-09-12T01:38:11.796424+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.796424+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:03:18.250788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":9226,"num_write":8,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'46","reported_seq":189,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.373291+0000","last_change":"2024-09-12T01:38:23.373291+0000","last_active":"2024-09-12T01:38:23.373291+0000","last_peered":"2024-09-12T01:38:23.373291+0000","last_clean":"2024-09-12T01:38:23.373291+0000","last_became_active":"2024-09-12T00:39:17.767088+0000","last_became_peered":"2024-09-12T00:39:17.767088+0000","last_unstale":"2024-09-12T01:38:23.373291+0000","last_undegraded":"2024-09-12T01:38:23.373291+0000","last_fullsized":"2024-09-12T01:38:23.373291+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'46","last_scrub_stamp":"2024-09-12T01:38:23.373200+0000","last_deep_scrub":"266'46","last_deep_scrub_stamp":"2024-09-12T01:38:23.373200+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.373200+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:20.765820+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":242,"num_read_kb":166,"num_write":75,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.548716+0000","last_change":"2024-09-12T01:38:27.548716+0000","last_active":"2024-09-12T01:38:27.548716+0000","last_peered":"2024-09-12T01:38:27.548716+0000","last_clean":"2024-09-12T01:38:27.548716+0000","last_became_active":"2024-09-12T01:02:03.925482+0000","last_became_peered":"2024-09-12T01:02:03.925482+0000","last_unstale":"2024-09-12T01:38:27.548716+0000","last_undegraded":"2024-09-12T01:38:27.548716+0000","last_fullsized":"2024-09-12T01:38:27.548716+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:27.548612+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:27.548612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.548612+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:19:03.482492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"266'2","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.710424+0000","last_change":"2024-09-12T01:38:30.710424+0000","last_active":"2024-09-12T01:38:30.710424+0000","last_peered":"2024-09-12T01:38:30.710424+0000","last_clean":"2024-09-12T01:38:30.710424+0000","last_became_active":"2024-09-12T00:43:43.820272+0000","last_became_peered":"2024-09-12T00:43:43.820272+0000","last_unstale":"2024-09-12T01:38:30.710424+0000","last_undegraded":"2024-09-12T01:38:30.710424+0000","last_fullsized":"2024-09-12T01:38:30.710424+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:30.710333+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:30.710333+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.710333+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:30.438823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'6","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.653601+0000","last_change":"2024-09-12T01:38:23.653601+0000","last_active":"2024-09-12T01:38:23.653601+0000","last_peered":"2024-09-12T01:38:23.653601+0000","last_clean":"2024-09-12T01:38:23.653601+0000","last_became_active":"2024-09-12T00:43:38.799719+0000","last_became_peered":"2024-09-12T00:43:38.799719+0000","last_unstale":"2024-09-12T01:38:23.653601+0000","last_undegraded":"2024-09-12T01:38:23.653601+0000","last_fullsized":"2024-09-12T01:38:23.653601+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T01:38:23.653489+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T01:38:23.653489+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.653489+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:28.594858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20462,"num_write":6,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'32","reported_seq":146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.668388+0000","last_change":"2024-09-12T01:38:18.668388+0000","last_active":"2024-09-12T01:38:18.668388+0000","last_peered":"2024-09-12T01:38:18.668388+0000","last_clean":"2024-09-12T01:38:18.668388+0000","last_became_active":"2024-09-12T00:39:17.762639+0000","last_became_peered":"2024-09-12T00:39:17.762639+0000","last_unstale":"2024-09-12T01:38:18.668388+0000","last_undegraded":"2024-09-12T01:38:18.668388+0000","last_fullsized":"2024-09-12T01:38:18.668388+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'32","last_scrub_stamp":"2024-09-12T01:38:18.668295+0000","last_deep_scrub":"266'32","last_deep_scrub_stamp":"2024-09-12T01:38:18.668295+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.668295+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:53:26.791956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.762492+0000","last_change":"2024-09-12T01:38:20.762492+0000","last_active":"2024-09-12T01:38:20.762492+0000","last_peered":"2024-09-12T01:38:20.762492+0000","last_clean":"2024-09-12T01:38:20.762492+0000","last_became_active":"2024-09-12T01:02:03.924892+0000","last_became_peered":"2024-09-12T01:02:03.924892+0000","last_unstale":"2024-09-12T01:38:20.762492+0000","last_undegraded":"2024-09-12T01:38:20.762492+0000","last_fullsized":"2024-09-12T01:38:20.762492+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:20.762384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:20.762384+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.762384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:38:19.806795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'4","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.775044+0000","last_change":"2024-09-12T01:38:16.775044+0000","last_active":"2024-09-12T01:38:16.775044+0000","last_peered":"2024-09-12T01:38:16.775044+0000","last_clean":"2024-09-12T01:38:16.775044+0000","last_became_active":"2024-09-12T00:43:43.819431+0000","last_became_peered":"2024-09-12T00:43:43.819431+0000","last_unstale":"2024-09-12T01:38:16.775044+0000","last_undegraded":"2024-09-12T01:38:16.775044+0000","last_fullsized":"2024-09-12T01:38:16.775044+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:16.774960+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:16.774960+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.774960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:08.495839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":6148,"num_write":4,"num_write_kb":6148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"266'3","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.709702+0000","last_change":"2024-09-12T01:38:27.709702+0000","last_active":"2024-09-12T01:38:27.709702+0000","last_peered":"2024-09-12T01:38:27.709702+0000","last_clean":"2024-09-12T01:38:27.709702+0000","last_became_active":"2024-09-12T00:43:38.796894+0000","last_became_peered":"2024-09-12T00:43:38.796894+0000","last_unstale":"2024-09-12T01:38:27.709702+0000","last_undegraded":"2024-09-12T01:38:27.709702+0000","last_fullsized":"2024-09-12T01:38:27.709702+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:38:27.709616+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:38:27.709616+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.709616+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:41.316461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'47","reported_seq":190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.986156+0000","last_change":"2024-09-12T01:38:34.986156+0000","last_active":"2024-09-12T01:38:34.986156+0000","last_peered":"2024-09-12T01:38:34.986156+0000","last_clean":"2024-09-12T01:38:34.986156+0000","last_became_active":"2024-09-12T00:39:17.761972+0000","last_became_peered":"2024-09-12T00:39:17.761972+0000","last_unstale":"2024-09-12T01:38:34.986156+0000","last_undegraded":"2024-09-12T01:38:34.986156+0000","last_fullsized":"2024-09-12T01:38:34.986156+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'47","last_scrub_stamp":"2024-09-12T01:38:34.986063+0000","last_deep_scrub":"266'47","last_deep_scrub_stamp":"2024-09-12T01:38:34.986063+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.986063+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:28.554751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":236,"num_read_kb":165,"num_write":89,"num_write_kb":31,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.815023+0000","last_change":"2024-09-12T01:38:43.815023+0000","last_active":"2024-09-12T01:38:43.815023+0000","last_peered":"2024-09-12T01:38:43.815023+0000","last_clean":"2024-09-12T01:38:43.815023+0000","last_became_active":"2024-09-12T01:02:03.923464+0000","last_became_peered":"2024-09-12T01:02:03.923464+0000","last_unstale":"2024-09-12T01:38:43.815023+0000","last_undegraded":"2024-09-12T01:38:43.815023+0000","last_fullsized":"2024-09-12T01:38:43.815023+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:43.814919+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:43.814919+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.814919+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:29.136159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'11","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:34.711444+0000","last_change":"2024-09-12T01:38:34.711444+0000","last_active":"2024-09-12T01:38:34.711444+0000","last_peered":"2024-09-12T01:38:34.711444+0000","last_clean":"2024-09-12T01:38:34.711444+0000","last_became_active":"2024-09-12T00:43:43.817990+0000","last_became_peered":"2024-09-12T00:43:43.817990+0000","last_unstale":"2024-09-12T01:38:34.711444+0000","last_undegraded":"2024-09-12T01:38:34.711444+0000","last_fullsized":"2024-09-12T01:38:34.711444+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'11","last_scrub_stamp":"2024-09-12T01:38:34.711364+0000","last_deep_scrub":"266'11","last_deep_scrub_stamp":"2024-09-12T01:38:34.711364+0000","last_clean_scrub_stamp":"2024-09-12T01:38:34.711364+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:26.219791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":14448,"num_write":16,"num_write_kb":6199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"266'2","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.870588+0000","last_change":"2024-09-12T01:38:21.870588+0000","last_active":"2024-09-12T01:38:21.870588+0000","last_peered":"2024-09-12T01:38:21.870588+0000","last_clean":"2024-09-12T01:38:21.870588+0000","last_became_active":"2024-09-12T00:43:38.793825+0000","last_became_peered":"2024-09-12T00:43:38.793825+0000","last_unstale":"2024-09-12T01:38:21.870588+0000","last_undegraded":"2024-09-12T01:38:21.870588+0000","last_fullsized":"2024-09-12T01:38:21.870588+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:21.870463+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:21.870463+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.870463+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:27:20.910427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'20","reported_seq":119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:35.959826+0000","last_change":"2024-09-12T01:38:35.959826+0000","last_active":"2024-09-12T01:38:35.959826+0000","last_peered":"2024-09-12T01:38:35.959826+0000","last_clean":"2024-09-12T01:38:35.959826+0000","last_became_active":"2024-09-12T00:39:17.769263+0000","last_became_peered":"2024-09-12T00:39:17.769263+0000","last_unstale":"2024-09-12T01:38:35.959826+0000","last_undegraded":"2024-09-12T01:38:35.959826+0000","last_fullsized":"2024-09-12T01:38:35.959826+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'20","last_scrub_stamp":"2024-09-12T01:38:35.959736+0000","last_deep_scrub":"266'20","last_deep_scrub_stamp":"2024-09-12T01:38:35.959736+0000","last_clean_scrub_stamp":"2024-09-12T01:38:35.959736+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:42.104077+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":103,"num_read_kb":73,"num_write":43,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.547821+0000","last_change":"2024-09-12T01:38:26.547821+0000","last_active":"2024-09-12T01:38:26.547821+0000","last_peered":"2024-09-12T01:38:26.547821+0000","last_clean":"2024-09-12T01:38:26.547821+0000","last_became_active":"2024-09-12T01:02:03.924260+0000","last_became_peered":"2024-09-12T01:02:03.924260+0000","last_unstale":"2024-09-12T01:38:26.547821+0000","last_undegraded":"2024-09-12T01:38:26.547821+0000","last_fullsized":"2024-09-12T01:38:26.547821+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:26.547703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:26.547703+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.547703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:35.224610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"266'3","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.732164+0000","last_change":"2024-09-12T01:38:33.732164+0000","last_active":"2024-09-12T01:38:33.732164+0000","last_peered":"2024-09-12T01:38:33.732164+0000","last_clean":"2024-09-12T01:38:33.732164+0000","last_became_active":"2024-09-12T00:43:43.824567+0000","last_became_peered":"2024-09-12T00:43:43.824567+0000","last_unstale":"2024-09-12T01:38:33.732164+0000","last_undegraded":"2024-09-12T01:38:33.732164+0000","last_fullsized":"2024-09-12T01:38:33.732164+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:38:33.732084+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:38:33.732084+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.732084+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:33.936391+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"266'5","reported_seq":65,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.744335+0000","last_change":"2024-09-12T01:38:26.744335+0000","last_active":"2024-09-12T01:38:26.744335+0000","last_peered":"2024-09-12T01:38:26.744335+0000","last_clean":"2024-09-12T01:38:26.744335+0000","last_became_active":"2024-09-12T00:43:38.798200+0000","last_became_peered":"2024-09-12T00:43:38.798200+0000","last_unstale":"2024-09-12T01:38:26.744335+0000","last_undegraded":"2024-09-12T01:38:26.744335+0000","last_fullsized":"2024-09-12T01:38:26.744335+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:26.744259+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:26.744259+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.744259+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:10.712076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"266'30","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.595596+0000","last_change":"2024-09-12T01:38:16.595596+0000","last_active":"2024-09-12T01:38:16.595596+0000","last_peered":"2024-09-12T01:38:16.595596+0000","last_clean":"2024-09-12T01:38:16.595596+0000","last_became_active":"2024-09-12T00:39:17.766600+0000","last_became_peered":"2024-09-12T00:39:17.766600+0000","last_unstale":"2024-09-12T01:38:16.595596+0000","last_undegraded":"2024-09-12T01:38:16.595596+0000","last_fullsized":"2024-09-12T01:38:16.595596+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'30","last_scrub_stamp":"2024-09-12T01:38:16.595514+0000","last_deep_scrub":"266'30","last_deep_scrub_stamp":"2024-09-12T01:38:16.595514+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.595514+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:59.336815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":158,"num_read_kb":112,"num_write":61,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'2","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.417034+0000","last_change":"2024-09-12T01:38:30.417034+0000","last_active":"2024-09-12T01:38:30.417034+0000","last_peered":"2024-09-12T01:38:30.417034+0000","last_clean":"2024-09-12T01:38:30.417034+0000","last_became_active":"2024-09-12T01:02:03.919377+0000","last_became_peered":"2024-09-12T01:02:03.919377+0000","last_unstale":"2024-09-12T01:38:30.417034+0000","last_undegraded":"2024-09-12T01:38:30.417034+0000","last_fullsized":"2024-09-12T01:38:30.417034+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:30.416946+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:30.416946+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.416946+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:28.682962+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.673676+0000","last_change":"2024-09-12T01:38:29.673676+0000","last_active":"2024-09-12T01:38:29.673676+0000","last_peered":"2024-09-12T01:38:29.673676+0000","last_clean":"2024-09-12T01:38:29.673676+0000","last_became_active":"2024-09-12T00:43:43.818153+0000","last_became_peered":"2024-09-12T00:43:43.818153+0000","last_unstale":"2024-09-12T01:38:29.673676+0000","last_undegraded":"2024-09-12T01:38:29.673676+0000","last_fullsized":"2024-09-12T01:38:29.673676+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.673582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.673582+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.673582+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:21.169336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'6","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.838737+0000","last_change":"2024-09-12T01:38:15.838737+0000","last_active":"2024-09-12T01:38:15.838737+0000","last_peered":"2024-09-12T01:38:15.838737+0000","last_clean":"2024-09-12T01:38:15.838737+0000","last_became_active":"2024-09-12T00:43:38.792135+0000","last_became_peered":"2024-09-12T00:43:38.792135+0000","last_unstale":"2024-09-12T01:38:15.838737+0000","last_undegraded":"2024-09-12T01:38:15.838737+0000","last_fullsized":"2024-09-12T01:38:15.838737+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T01:38:15.838637+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T01:38:15.838637+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.838637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:44.060727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":8232,"num_write":6,"num_write_kb":8232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"266'12","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.545660+0000","last_change":"2024-09-12T01:38:19.545660+0000","last_active":"2024-09-12T01:38:19.545660+0000","last_peered":"2024-09-12T01:38:19.545660+0000","last_clean":"2024-09-12T01:38:19.545660+0000","last_became_active":"2024-09-12T00:39:17.767599+0000","last_became_peered":"2024-09-12T00:39:17.767599+0000","last_unstale":"2024-09-12T01:38:19.545660+0000","last_undegraded":"2024-09-12T01:38:19.545660+0000","last_fullsized":"2024-09-12T01:38:19.545660+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'12","last_scrub_stamp":"2024-09-12T01:38:19.545579+0000","last_deep_scrub":"266'12","last_deep_scrub_stamp":"2024-09-12T01:38:19.545579+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.545579+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:39.128051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":43,"num_write":23,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'2","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.579509+0000","last_change":"2024-09-12T01:38:27.579509+0000","last_active":"2024-09-12T01:38:27.579509+0000","last_peered":"2024-09-12T01:38:27.579509+0000","last_clean":"2024-09-12T01:38:27.579509+0000","last_became_active":"2024-09-12T01:02:03.918248+0000","last_became_peered":"2024-09-12T01:02:03.918248+0000","last_unstale":"2024-09-12T01:38:27.579509+0000","last_undegraded":"2024-09-12T01:38:27.579509+0000","last_fullsized":"2024-09-12T01:38:27.579509+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:27.579381+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:27.579381+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.579381+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:26.100306+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:42.177242+0000","last_change":"2024-09-12T01:38:42.177242+0000","last_active":"2024-09-12T01:38:42.177242+0000","last_peered":"2024-09-12T01:38:42.177242+0000","last_clean":"2024-09-12T01:38:42.177242+0000","last_became_active":"2024-09-12T00:43:43.822993+0000","last_became_peered":"2024-09-12T00:43:43.822993+0000","last_unstale":"2024-09-12T01:38:42.177242+0000","last_undegraded":"2024-09-12T01:38:42.177242+0000","last_fullsized":"2024-09-12T01:38:42.177242+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:42.177145+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:42.177145+0000","last_clean_scrub_stamp":"2024-09-12T01:38:42.177145+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:45.760381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"263'2","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.878486+0000","last_change":"2024-09-12T01:38:20.878486+0000","last_active":"2024-09-12T01:38:20.878486+0000","last_peered":"2024-09-12T01:38:20.878486+0000","last_clean":"2024-09-12T01:38:20.878486+0000","last_became_active":"2024-09-12T00:43:38.795625+0000","last_became_peered":"2024-09-12T00:43:38.795625+0000","last_unstale":"2024-09-12T01:38:20.878486+0000","last_undegraded":"2024-09-12T01:38:20.878486+0000","last_fullsized":"2024-09-12T01:38:20.878486+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:20.878394+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:20.878394+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.878394+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:19.560370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":27,"num_write":2,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'39","reported_seq":169,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.608898+0000","last_change":"2024-09-12T01:38:15.608898+0000","last_active":"2024-09-12T01:38:15.608898+0000","last_peered":"2024-09-12T01:38:15.608898+0000","last_clean":"2024-09-12T01:38:15.608898+0000","last_became_active":"2024-09-12T00:39:17.761517+0000","last_became_peered":"2024-09-12T00:39:17.761517+0000","last_unstale":"2024-09-12T01:38:15.608898+0000","last_undegraded":"2024-09-12T01:38:15.608898+0000","last_fullsized":"2024-09-12T01:38:15.608898+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'39","last_scrub_stamp":"2024-09-12T01:38:15.608812+0000","last_deep_scrub":"266'39","last_deep_scrub_stamp":"2024-09-12T01:38:15.608812+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.608812+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:08.341143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":198,"num_read_kb":138,"num_write":69,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.815824+0000","last_change":"2024-09-12T01:38:40.815764+0000","last_active":"2024-09-12T01:38:40.815824+0000","last_peered":"2024-09-12T01:38:40.815824+0000","last_clean":"2024-09-12T01:38:40.815824+0000","last_became_active":"2024-09-12T01:02:03.923808+0000","last_became_peered":"2024-09-12T01:02:03.923808+0000","last_unstale":"2024-09-12T01:38:40.815824+0000","last_undegraded":"2024-09-12T01:38:40.815824+0000","last_fullsized":"2024-09-12T01:38:40.815824+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.815640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.815640+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.815640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:48.736677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"263'5","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.726528+0000","last_change":"2024-09-12T01:38:27.726528+0000","last_active":"2024-09-12T01:38:27.726528+0000","last_peered":"2024-09-12T01:38:27.726528+0000","last_clean":"2024-09-12T01:38:27.726528+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:38:27.726528+0000","last_undegraded":"2024-09-12T01:38:27.726528+0000","last_fullsized":"2024-09-12T01:38:27.726528+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T01:38:27.726340+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T01:38:27.726340+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.726340+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:47.178630+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'4","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.600636+0000","last_change":"2024-09-12T01:38:17.600636+0000","last_active":"2024-09-12T01:38:17.600636+0000","last_peered":"2024-09-12T01:38:17.600636+0000","last_clean":"2024-09-12T01:38:17.600636+0000","last_became_active":"2024-09-12T00:43:38.795451+0000","last_became_peered":"2024-09-12T00:43:38.795451+0000","last_unstale":"2024-09-12T01:38:17.600636+0000","last_undegraded":"2024-09-12T01:38:17.600636+0000","last_fullsized":"2024-09-12T01:38:17.600636+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:17.600540+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:17.600540+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.600540+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:39.401021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":4,"num_write_kb":5116,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'134","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.599128+0000","last_change":"2024-09-12T01:38:14.599128+0000","last_active":"2024-09-12T01:38:14.599128+0000","last_peered":"2024-09-12T01:38:14.599128+0000","last_clean":"2024-09-12T01:38:14.599128+0000","last_became_active":"2024-09-12T00:39:17.762649+0000","last_became_peered":"2024-09-12T00:39:17.762649+0000","last_unstale":"2024-09-12T01:38:14.599128+0000","last_undegraded":"2024-09-12T01:38:14.599128+0000","last_fullsized":"2024-09-12T01:38:14.599128+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T01:38:14.599042+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T01:38:14.599042+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.599042+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:28:27.992122+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":844,"num_read_kb":585,"num_write":185,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2988,"num_omap_keys":6,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.870467+0000","last_change":"2024-09-12T01:38:22.870467+0000","last_active":"2024-09-12T01:38:22.870467+0000","last_peered":"2024-09-12T01:38:22.870467+0000","last_clean":"2024-09-12T01:38:22.870467+0000","last_became_active":"2024-09-12T01:02:03.924934+0000","last_became_peered":"2024-09-12T01:02:03.924934+0000","last_unstale":"2024-09-12T01:38:22.870467+0000","last_undegraded":"2024-09-12T01:38:22.870467+0000","last_fullsized":"2024-09-12T01:38:22.870467+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.870368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.870368+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.870368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:26.023207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.693772+0000","last_change":"2024-09-12T01:38:26.693772+0000","last_active":"2024-09-12T01:38:26.693772+0000","last_peered":"2024-09-12T01:38:26.693772+0000","last_clean":"2024-09-12T01:38:26.693772+0000","last_became_active":"2024-09-12T00:43:43.821288+0000","last_became_peered":"2024-09-12T00:43:43.821288+0000","last_unstale":"2024-09-12T01:38:26.693772+0000","last_undegraded":"2024-09-12T01:38:26.693772+0000","last_fullsized":"2024-09-12T01:38:26.693772+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:26.693678+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:26.693678+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.693678+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:08.289087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"0'0","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.552114+0000","last_change":"2024-09-12T01:38:24.552114+0000","last_active":"2024-09-12T01:38:24.552114+0000","last_peered":"2024-09-12T01:38:24.552114+0000","last_clean":"2024-09-12T01:38:24.552114+0000","last_became_active":"2024-09-12T00:43:38.797782+0000","last_became_peered":"2024-09-12T00:43:38.797782+0000","last_unstale":"2024-09-12T01:38:24.552114+0000","last_undegraded":"2024-09-12T01:38:24.552114+0000","last_fullsized":"2024-09-12T01:38:24.552114+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.552020+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.552020+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.552020+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:58.592170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'33","reported_seq":156,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:51.120066+0000","last_change":"2024-09-12T01:38:51.120066+0000","last_active":"2024-09-12T01:38:51.120066+0000","last_peered":"2024-09-12T01:38:51.120066+0000","last_clean":"2024-09-12T01:38:51.120066+0000","last_became_active":"2024-09-12T00:39:17.768151+0000","last_became_peered":"2024-09-12T00:39:17.768151+0000","last_unstale":"2024-09-12T01:38:51.120066+0000","last_undegraded":"2024-09-12T01:38:51.120066+0000","last_fullsized":"2024-09-12T01:38:51.120066+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T01:38:51.119978+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T01:38:51.119978+0000","last_clean_scrub_stamp":"2024-09-12T01:38:51.119978+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:06:37.209792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":171,"num_read_kb":121,"num_write":61,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:46.097705+0000","last_change":"2024-09-12T01:38:46.097566+0000","last_active":"2024-09-12T01:38:46.097705+0000","last_peered":"2024-09-12T01:38:46.097705+0000","last_clean":"2024-09-12T01:38:46.097705+0000","last_became_active":"2024-09-12T01:02:03.921595+0000","last_became_peered":"2024-09-12T01:02:03.921595+0000","last_unstale":"2024-09-12T01:38:46.097705+0000","last_undegraded":"2024-09-12T01:38:46.097705+0000","last_fullsized":"2024-09-12T01:38:46.097705+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:46.097465+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:46.097465+0000","last_clean_scrub_stamp":"2024-09-12T01:38:46.097465+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:46.353672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"266'9","reported_seq":69,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.719936+0000","last_change":"2024-09-12T01:38:28.719936+0000","last_active":"2024-09-12T01:38:28.719936+0000","last_peered":"2024-09-12T01:38:28.719936+0000","last_clean":"2024-09-12T01:38:28.719936+0000","last_became_active":"2024-09-12T00:43:43.819990+0000","last_became_peered":"2024-09-12T00:43:43.819990+0000","last_unstale":"2024-09-12T01:38:28.719936+0000","last_undegraded":"2024-09-12T01:38:28.719936+0000","last_fullsized":"2024-09-12T01:38:28.719936+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T01:38:28.719833+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T01:38:28.719833+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.719833+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:57:36.029595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":8217,"num_write":14,"num_write_kb":5143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'2","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.680163+0000","last_change":"2024-09-12T01:38:21.680163+0000","last_active":"2024-09-12T01:38:21.680163+0000","last_peered":"2024-09-12T01:38:21.680163+0000","last_clean":"2024-09-12T01:38:21.680163+0000","last_became_active":"2024-09-12T00:43:38.798374+0000","last_became_peered":"2024-09-12T00:43:38.798374+0000","last_unstale":"2024-09-12T01:38:21.680163+0000","last_undegraded":"2024-09-12T01:38:21.680163+0000","last_fullsized":"2024-09-12T01:38:21.680163+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:21.680052+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:21.680052+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.680052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:51.883942+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":175,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.871137+0000","last_change":"2024-09-12T01:38:14.871137+0000","last_active":"2024-09-12T01:38:14.871137+0000","last_peered":"2024-09-12T01:38:14.871137+0000","last_clean":"2024-09-12T01:38:14.871137+0000","last_became_active":"2024-09-12T00:39:17.757795+0000","last_became_peered":"2024-09-12T00:39:17.757795+0000","last_unstale":"2024-09-12T01:38:14.871137+0000","last_undegraded":"2024-09-12T01:38:14.871137+0000","last_fullsized":"2024-09-12T01:38:14.871137+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'41","last_scrub_stamp":"2024-09-12T01:38:14.871052+0000","last_deep_scrub":"266'41","last_deep_scrub_stamp":"2024-09-12T01:38:14.871052+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.871052+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:31:14.098929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":206,"num_read_kb":145,"num_write":77,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.841113+0000","last_change":"2024-09-12T01:38:23.841035+0000","last_active":"2024-09-12T01:38:23.841113+0000","last_peered":"2024-09-12T01:38:23.841113+0000","last_clean":"2024-09-12T01:38:23.841113+0000","last_became_active":"2024-09-12T01:02:03.923774+0000","last_became_peered":"2024-09-12T01:02:03.923774+0000","last_unstale":"2024-09-12T01:38:23.841113+0000","last_undegraded":"2024-09-12T01:38:23.841113+0000","last_fullsized":"2024-09-12T01:38:23.841113+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.840947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.840947+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.840947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:14.358788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"266'9","reported_seq":64,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.723897+0000","last_change":"2024-09-12T01:38:31.723897+0000","last_active":"2024-09-12T01:38:31.723897+0000","last_peered":"2024-09-12T01:38:31.723897+0000","last_clean":"2024-09-12T01:38:31.723897+0000","last_became_active":"2024-09-12T00:43:43.819044+0000","last_became_peered":"2024-09-12T00:43:43.819044+0000","last_unstale":"2024-09-12T01:38:31.723897+0000","last_undegraded":"2024-09-12T01:38:31.723897+0000","last_fullsized":"2024-09-12T01:38:31.723897+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T01:38:31.723806+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T01:38:31.723806+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.723806+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:47.665405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":6160,"num_write":14,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"0'0","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.683362+0000","last_change":"2024-09-12T01:38:22.683362+0000","last_active":"2024-09-12T01:38:22.683362+0000","last_peered":"2024-09-12T01:38:22.683362+0000","last_clean":"2024-09-12T01:38:22.683362+0000","last_became_active":"2024-09-12T00:43:38.797343+0000","last_became_peered":"2024-09-12T00:43:38.797343+0000","last_unstale":"2024-09-12T01:38:22.683362+0000","last_undegraded":"2024-09-12T01:38:22.683362+0000","last_fullsized":"2024-09-12T01:38:22.683362+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.683272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.683272+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.683272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:25:21.575947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'33","reported_seq":146,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.367708+0000","last_change":"2024-09-12T01:38:16.367708+0000","last_active":"2024-09-12T01:38:16.367708+0000","last_peered":"2024-09-12T01:38:16.367708+0000","last_clean":"2024-09-12T01:38:16.367708+0000","last_became_active":"2024-09-12T00:39:17.759701+0000","last_became_peered":"2024-09-12T00:39:17.759701+0000","last_unstale":"2024-09-12T01:38:16.367708+0000","last_undegraded":"2024-09-12T01:38:16.367708+0000","last_fullsized":"2024-09-12T01:38:16.367708+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T01:38:16.367624+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T01:38:16.367624+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.367624+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:43.217655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":99,"num_write":64,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.802543+0000","last_change":"2024-09-12T01:38:41.802543+0000","last_active":"2024-09-12T01:38:41.802543+0000","last_peered":"2024-09-12T01:38:41.802543+0000","last_clean":"2024-09-12T01:38:41.802543+0000","last_became_active":"2024-09-12T01:02:03.923440+0000","last_became_peered":"2024-09-12T01:02:03.923440+0000","last_unstale":"2024-09-12T01:38:41.802543+0000","last_undegraded":"2024-09-12T01:38:41.802543+0000","last_fullsized":"2024-09-12T01:38:41.802543+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:41.802436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:41.802436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.802436+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:54:03.698172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'5","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:43.155185+0000","last_change":"2024-09-12T01:38:43.155185+0000","last_active":"2024-09-12T01:38:43.155185+0000","last_peered":"2024-09-12T01:38:43.155185+0000","last_clean":"2024-09-12T01:38:43.155185+0000","last_became_active":"2024-09-12T00:43:43.819247+0000","last_became_peered":"2024-09-12T00:43:43.819247+0000","last_unstale":"2024-09-12T01:38:43.155185+0000","last_undegraded":"2024-09-12T01:38:43.155185+0000","last_fullsized":"2024-09-12T01:38:43.155185+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:43.155100+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:43.155100+0000","last_clean_scrub_stamp":"2024-09-12T01:38:43.155100+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:17:34.762482+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":1032,"num_write":10,"num_write_kb":1028,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"266'5","reported_seq":67,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.643141+0000","last_change":"2024-09-12T01:38:19.643141+0000","last_active":"2024-09-12T01:38:19.643141+0000","last_peered":"2024-09-12T01:38:19.643141+0000","last_clean":"2024-09-12T01:38:19.643141+0000","last_became_active":"2024-09-12T00:43:38.794286+0000","last_became_peered":"2024-09-12T00:43:38.794286+0000","last_unstale":"2024-09-12T01:38:19.643141+0000","last_undegraded":"2024-09-12T01:38:19.643141+0000","last_fullsized":"2024-09-12T01:38:19.643141+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:19.643059+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:19.643059+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.643059+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:21.395512+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6160,"num_write":10,"num_write_kb":5128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'28","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.354805+0000","last_change":"2024-09-12T01:38:14.354805+0000","last_active":"2024-09-12T01:38:14.354805+0000","last_peered":"2024-09-12T01:38:14.354805+0000","last_clean":"2024-09-12T01:38:14.354805+0000","last_became_active":"2024-09-12T00:39:17.761738+0000","last_became_peered":"2024-09-12T00:39:17.761738+0000","last_unstale":"2024-09-12T01:38:14.354805+0000","last_undegraded":"2024-09-12T01:38:14.354805+0000","last_fullsized":"2024-09-12T01:38:14.354805+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'28","last_scrub_stamp":"2024-09-12T01:38:14.354706+0000","last_deep_scrub":"266'28","last_deep_scrub_stamp":"2024-09-12T01:38:14.354706+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.354706+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:49.967919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":137,"num_read_kb":96,"num_write":53,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.542659+0000","last_change":"2024-09-12T01:38:26.542659+0000","last_active":"2024-09-12T01:38:26.542659+0000","last_peered":"2024-09-12T01:38:26.542659+0000","last_clean":"2024-09-12T01:38:26.542659+0000","last_became_active":"2024-09-12T01:02:03.928475+0000","last_became_peered":"2024-09-12T01:02:03.928475+0000","last_unstale":"2024-09-12T01:38:26.542659+0000","last_undegraded":"2024-09-12T01:38:26.542659+0000","last_fullsized":"2024-09-12T01:38:26.542659+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:26.542527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:26.542527+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.542527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:09.925002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"263'2","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.546533+0000","last_change":"2024-09-12T01:38:23.546533+0000","last_active":"2024-09-12T01:38:23.546533+0000","last_peered":"2024-09-12T01:38:23.546533+0000","last_clean":"2024-09-12T01:38:23.546533+0000","last_became_active":"2024-09-12T00:43:43.821149+0000","last_became_peered":"2024-09-12T00:43:43.821149+0000","last_unstale":"2024-09-12T01:38:23.546533+0000","last_undegraded":"2024-09-12T01:38:23.546533+0000","last_fullsized":"2024-09-12T01:38:23.546533+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:23.546436+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:23.546436+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.546436+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:54.182163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'9","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.707999+0000","last_change":"2024-09-12T01:38:25.707999+0000","last_active":"2024-09-12T01:38:25.707999+0000","last_peered":"2024-09-12T01:38:25.707999+0000","last_clean":"2024-09-12T01:38:25.707999+0000","last_became_active":"2024-09-12T00:43:38.798510+0000","last_became_peered":"2024-09-12T00:43:38.798510+0000","last_unstale":"2024-09-12T01:38:25.707999+0000","last_undegraded":"2024-09-12T01:38:25.707999+0000","last_fullsized":"2024-09-12T01:38:25.707999+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T01:38:25.707910+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T01:38:25.707910+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.707910+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:02.643408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":16416,"num_write":14,"num_write_kb":12320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'28","reported_seq":144,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.676599+0000","last_change":"2024-09-12T01:38:15.676599+0000","last_active":"2024-09-12T01:38:15.676599+0000","last_peered":"2024-09-12T01:38:15.676599+0000","last_clean":"2024-09-12T01:38:15.676599+0000","last_became_active":"2024-09-12T00:39:17.770779+0000","last_became_peered":"2024-09-12T00:39:17.770779+0000","last_unstale":"2024-09-12T01:38:15.676599+0000","last_undegraded":"2024-09-12T01:38:15.676599+0000","last_fullsized":"2024-09-12T01:38:15.676599+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'28","last_scrub_stamp":"2024-09-12T01:38:15.676512+0000","last_deep_scrub":"266'28","last_deep_scrub_stamp":"2024-09-12T01:38:15.676512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.676512+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:52.231916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":148,"num_read_kb":103,"num_write":50,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.769638+0000","last_change":"2024-09-12T01:38:19.769638+0000","last_active":"2024-09-12T01:38:19.769638+0000","last_peered":"2024-09-12T01:38:19.769638+0000","last_clean":"2024-09-12T01:38:19.769638+0000","last_became_active":"2024-09-12T01:02:03.925618+0000","last_became_peered":"2024-09-12T01:02:03.925618+0000","last_unstale":"2024-09-12T01:38:19.769638+0000","last_undegraded":"2024-09-12T01:38:19.769638+0000","last_fullsized":"2024-09-12T01:38:19.769638+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:19.769541+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:19.769541+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.769541+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:13.515910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"266'5","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.521264+0000","last_change":"2024-09-12T01:38:23.521264+0000","last_active":"2024-09-12T01:38:23.521264+0000","last_peered":"2024-09-12T01:38:23.521264+0000","last_clean":"2024-09-12T01:38:23.521264+0000","last_became_active":"2024-09-12T00:43:43.825380+0000","last_became_peered":"2024-09-12T00:43:43.825380+0000","last_unstale":"2024-09-12T01:38:23.521264+0000","last_undegraded":"2024-09-12T01:38:23.521264+0000","last_fullsized":"2024-09-12T01:38:23.521264+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:23.521124+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:23.521124+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.521124+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:57.370216+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8232,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"263'2","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.636339+0000","last_change":"2024-09-12T01:38:20.636339+0000","last_active":"2024-09-12T01:38:20.636339+0000","last_peered":"2024-09-12T01:38:20.636339+0000","last_clean":"2024-09-12T01:38:20.636339+0000","last_became_active":"2024-09-12T00:43:38.791586+0000","last_became_peered":"2024-09-12T00:43:38.791586+0000","last_unstale":"2024-09-12T01:38:20.636339+0000","last_undegraded":"2024-09-12T01:38:20.636339+0000","last_fullsized":"2024-09-12T01:38:20.636339+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:20.636233+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:20.636233+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.636233+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:00.740486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3080,"num_write":2,"num_write_kb":3080,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'54","reported_seq":214,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.683082+0000","last_change":"2024-09-12T01:38:24.683082+0000","last_active":"2024-09-12T01:38:24.683082+0000","last_peered":"2024-09-12T01:38:24.683082+0000","last_clean":"2024-09-12T01:38:24.683082+0000","last_became_active":"2024-09-12T00:39:17.762435+0000","last_became_peered":"2024-09-12T00:39:17.762435+0000","last_unstale":"2024-09-12T01:38:24.683082+0000","last_undegraded":"2024-09-12T01:38:24.683082+0000","last_fullsized":"2024-09-12T01:38:24.683082+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'54","last_scrub_stamp":"2024-09-12T01:38:24.682985+0000","last_deep_scrub":"266'54","last_deep_scrub_stamp":"2024-09-12T01:38:24.682985+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.682985+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:47.728351+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":202,"num_write":91,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.665472+0000","last_change":"2024-09-12T01:38:33.665472+0000","last_active":"2024-09-12T01:38:33.665472+0000","last_peered":"2024-09-12T01:38:33.665472+0000","last_clean":"2024-09-12T01:38:33.665472+0000","last_became_active":"2024-09-12T01:02:03.925866+0000","last_became_peered":"2024-09-12T01:02:03.925866+0000","last_unstale":"2024-09-12T01:38:33.665472+0000","last_undegraded":"2024-09-12T01:38:33.665472+0000","last_fullsized":"2024-09-12T01:38:33.665472+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:33.665384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:33.665384+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.665384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:53.898358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'3","reported_seq":55,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.802693+0000","last_change":"2024-09-12T01:38:17.802693+0000","last_active":"2024-09-12T01:38:17.802693+0000","last_peered":"2024-09-12T01:38:17.802693+0000","last_clean":"2024-09-12T01:38:17.802693+0000","last_became_active":"2024-09-12T00:43:43.820153+0000","last_became_peered":"2024-09-12T00:43:43.820153+0000","last_unstale":"2024-09-12T01:38:17.802693+0000","last_undegraded":"2024-09-12T01:38:17.802693+0000","last_fullsized":"2024-09-12T01:38:17.802693+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:38:17.802589+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:38:17.802589+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.802589+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:44.846562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'3","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:41.127605+0000","last_change":"2024-09-12T01:38:41.127605+0000","last_active":"2024-09-12T01:38:41.127605+0000","last_peered":"2024-09-12T01:38:41.127605+0000","last_clean":"2024-09-12T01:38:41.127605+0000","last_became_active":"2024-09-12T00:43:38.789945+0000","last_became_peered":"2024-09-12T00:43:38.789945+0000","last_unstale":"2024-09-12T01:38:41.127605+0000","last_undegraded":"2024-09-12T01:38:41.127605+0000","last_fullsized":"2024-09-12T01:38:41.127605+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:38:41.127506+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:38:41.127506+0000","last_clean_scrub_stamp":"2024-09-12T01:38:41.127506+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:17.032445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":8,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'34","reported_seq":159,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.794692+0000","last_change":"2024-09-12T01:38:12.794692+0000","last_active":"2024-09-12T01:38:12.794692+0000","last_peered":"2024-09-12T01:38:12.794692+0000","last_clean":"2024-09-12T01:38:12.794692+0000","last_became_active":"2024-09-12T00:39:17.759741+0000","last_became_peered":"2024-09-12T00:39:17.759741+0000","last_unstale":"2024-09-12T01:38:12.794692+0000","last_undegraded":"2024-09-12T01:38:12.794692+0000","last_fullsized":"2024-09-12T01:38:12.794692+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'34","last_scrub_stamp":"2024-09-12T01:38:12.794595+0000","last_deep_scrub":"266'34","last_deep_scrub_stamp":"2024-09-12T01:38:12.794595+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.794595+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:13:04.466537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":120,"num_write":67,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.764487+0000","last_change":"2024-09-12T01:38:18.764487+0000","last_active":"2024-09-12T01:38:18.764487+0000","last_peered":"2024-09-12T01:38:18.764487+0000","last_clean":"2024-09-12T01:38:18.764487+0000","last_became_active":"2024-09-12T01:02:03.918998+0000","last_became_peered":"2024-09-12T01:02:03.918998+0000","last_unstale":"2024-09-12T01:38:18.764487+0000","last_undegraded":"2024-09-12T01:38:18.764487+0000","last_fullsized":"2024-09-12T01:38:18.764487+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:18.764368+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:18.764368+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.764368+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:49.004598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.709836+0000","last_change":"2024-09-12T01:38:32.709836+0000","last_active":"2024-09-12T01:38:32.709836+0000","last_peered":"2024-09-12T01:38:32.709836+0000","last_clean":"2024-09-12T01:38:32.709836+0000","last_became_active":"2024-09-12T00:43:43.821691+0000","last_became_peered":"2024-09-12T00:43:43.821691+0000","last_unstale":"2024-09-12T01:38:32.709836+0000","last_undegraded":"2024-09-12T01:38:32.709836+0000","last_fullsized":"2024-09-12T01:38:32.709836+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:32.709751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:32.709751+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.709751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:39:16.213860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:40.078337+0000","last_change":"2024-09-12T01:38:40.078337+0000","last_active":"2024-09-12T01:38:40.078337+0000","last_peered":"2024-09-12T01:38:40.078337+0000","last_clean":"2024-09-12T01:38:40.078337+0000","last_became_active":"2024-09-12T00:43:38.797711+0000","last_became_peered":"2024-09-12T00:43:38.797711+0000","last_unstale":"2024-09-12T01:38:40.078337+0000","last_undegraded":"2024-09-12T01:38:40.078337+0000","last_fullsized":"2024-09-12T01:38:40.078337+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:40.078228+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:40.078228+0000","last_clean_scrub_stamp":"2024-09-12T01:38:40.078228+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:18.325950+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'32","reported_seq":149,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.381497+0000","last_change":"2024-09-12T01:38:22.381497+0000","last_active":"2024-09-12T01:38:22.381497+0000","last_peered":"2024-09-12T01:38:22.381497+0000","last_clean":"2024-09-12T01:38:22.381497+0000","last_became_active":"2024-09-12T00:39:17.760839+0000","last_became_peered":"2024-09-12T00:39:17.760839+0000","last_unstale":"2024-09-12T01:38:22.381497+0000","last_undegraded":"2024-09-12T01:38:22.381497+0000","last_fullsized":"2024-09-12T01:38:22.381497+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'32","last_scrub_stamp":"2024-09-12T01:38:22.381412+0000","last_deep_scrub":"266'32","last_deep_scrub_stamp":"2024-09-12T01:38:22.381412+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.381412+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:30:25.888813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":154,"num_read_kb":108,"num_write":60,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.774169+0000","last_change":"2024-09-12T01:38:23.774169+0000","last_active":"2024-09-12T01:38:23.774169+0000","last_peered":"2024-09-12T01:38:23.774169+0000","last_clean":"2024-09-12T01:38:23.774169+0000","last_became_active":"2024-09-12T01:02:03.919706+0000","last_became_peered":"2024-09-12T01:02:03.919706+0000","last_unstale":"2024-09-12T01:38:23.774169+0000","last_undegraded":"2024-09-12T01:38:23.774169+0000","last_fullsized":"2024-09-12T01:38:23.774169+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:23.774067+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:23.774067+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.774067+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:45:59.231629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"266'2","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.736137+0000","last_change":"2024-09-12T01:38:30.736137+0000","last_active":"2024-09-12T01:38:30.736137+0000","last_peered":"2024-09-12T01:38:30.736137+0000","last_clean":"2024-09-12T01:38:30.736137+0000","last_became_active":"2024-09-12T00:43:43.818321+0000","last_became_peered":"2024-09-12T00:43:43.818321+0000","last_unstale":"2024-09-12T01:38:30.736137+0000","last_undegraded":"2024-09-12T01:38:30.736137+0000","last_fullsized":"2024-09-12T01:38:30.736137+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:30.736052+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:30.736052+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.736052+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:37.453306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":96,"num_write":2,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'4","reported_seq":66,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.378189+0000","last_change":"2024-09-12T01:38:27.378189+0000","last_active":"2024-09-12T01:38:27.378189+0000","last_peered":"2024-09-12T01:38:27.378189+0000","last_clean":"2024-09-12T01:38:27.378189+0000","last_became_active":"2024-09-12T00:43:38.792154+0000","last_became_peered":"2024-09-12T00:43:38.792154+0000","last_unstale":"2024-09-12T01:38:27.378189+0000","last_undegraded":"2024-09-12T01:38:27.378189+0000","last_fullsized":"2024-09-12T01:38:27.378189+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:27.378099+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:27.378099+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.378099+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:05.015242+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":1034,"num_write":4,"num_write_kb":1034,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"266'40","reported_seq":172,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:50.158323+0000","last_change":"2024-09-12T01:38:50.158323+0000","last_active":"2024-09-12T01:38:50.158323+0000","last_peered":"2024-09-12T01:38:50.158323+0000","last_clean":"2024-09-12T01:38:50.158323+0000","last_became_active":"2024-09-12T00:39:17.767962+0000","last_became_peered":"2024-09-12T00:39:17.767962+0000","last_unstale":"2024-09-12T01:38:50.158323+0000","last_undegraded":"2024-09-12T01:38:50.158323+0000","last_fullsized":"2024-09-12T01:38:50.158323+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'40","last_scrub_stamp":"2024-09-12T01:38:50.158233+0000","last_deep_scrub":"266'40","last_deep_scrub_stamp":"2024-09-12T01:38:50.158233+0000","last_clean_scrub_stamp":"2024-09-12T01:38:50.158233+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:32.424948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":197,"num_read_kb":136,"num_write":78,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.795444+0000","last_change":"2024-09-12T01:38:38.795444+0000","last_active":"2024-09-12T01:38:38.795444+0000","last_peered":"2024-09-12T01:38:38.795444+0000","last_clean":"2024-09-12T01:38:38.795444+0000","last_became_active":"2024-09-12T01:02:03.918216+0000","last_became_peered":"2024-09-12T01:02:03.918216+0000","last_unstale":"2024-09-12T01:38:38.795444+0000","last_undegraded":"2024-09-12T01:38:38.795444+0000","last_fullsized":"2024-09-12T01:38:38.795444+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:38.795348+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:38.795348+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.795348+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:07.256077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'10","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.765459+0000","last_change":"2024-09-12T01:38:13.765459+0000","last_active":"2024-09-12T01:38:13.765459+0000","last_peered":"2024-09-12T01:38:13.765459+0000","last_clean":"2024-09-12T01:38:13.765459+0000","last_became_active":"2024-09-12T00:43:43.820194+0000","last_became_peered":"2024-09-12T00:43:43.820194+0000","last_unstale":"2024-09-12T01:38:13.765459+0000","last_undegraded":"2024-09-12T01:38:13.765459+0000","last_fullsized":"2024-09-12T01:38:13.765459+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T01:38:13.765346+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T01:38:13.765346+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.765346+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:37.499066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":10,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"266'10","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.549561+0000","last_change":"2024-09-12T01:38:22.549561+0000","last_active":"2024-09-12T01:38:22.549561+0000","last_peered":"2024-09-12T01:38:22.549561+0000","last_clean":"2024-09-12T01:38:22.549561+0000","last_became_active":"2024-09-12T00:43:38.797428+0000","last_became_peered":"2024-09-12T00:43:38.797428+0000","last_unstale":"2024-09-12T01:38:22.549561+0000","last_undegraded":"2024-09-12T01:38:22.549561+0000","last_fullsized":"2024-09-12T01:38:22.549561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T01:38:22.549469+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T01:38:22.549469+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.549469+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:35:27.315172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":12282,"num_write":20,"num_write_kb":9212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'86","reported_seq":380,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.760111+0000","last_change":"2024-09-12T01:38:13.760111+0000","last_active":"2024-09-12T01:38:13.760111+0000","last_peered":"2024-09-12T01:38:13.760111+0000","last_clean":"2024-09-12T01:38:13.760111+0000","last_became_active":"2024-09-12T00:39:17.767517+0000","last_became_peered":"2024-09-12T00:39:17.767517+0000","last_unstale":"2024-09-12T01:38:13.760111+0000","last_undegraded":"2024-09-12T01:38:13.760111+0000","last_fullsized":"2024-09-12T01:38:13.760111+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'86","last_scrub_stamp":"2024-09-12T01:38:13.760025+0000","last_deep_scrub":"266'86","last_deep_scrub_stamp":"2024-09-12T01:38:13.760025+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.760025+0000","objects_scrubbed":1,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:26:04.380421+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":615,"num_read_kb":395,"num_write":114,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4990,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:47.137782+0000","last_change":"2024-09-12T01:38:47.137782+0000","last_active":"2024-09-12T01:38:47.137782+0000","last_peered":"2024-09-12T01:38:47.137782+0000","last_clean":"2024-09-12T01:38:47.137782+0000","last_became_active":"2024-09-12T01:02:03.922479+0000","last_became_peered":"2024-09-12T01:02:03.922479+0000","last_unstale":"2024-09-12T01:38:47.137782+0000","last_undegraded":"2024-09-12T01:38:47.137782+0000","last_fullsized":"2024-09-12T01:38:47.137782+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:47.137686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:47.137686+0000","last_clean_scrub_stamp":"2024-09-12T01:38:47.137686+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:34:02.240541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"263'4","reported_seq":62,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:52.165887+0000","last_change":"2024-09-12T01:38:52.165887+0000","last_active":"2024-09-12T01:38:52.165887+0000","last_peered":"2024-09-12T01:38:52.165887+0000","last_clean":"2024-09-12T01:38:52.165887+0000","last_became_active":"2024-09-12T00:43:43.821303+0000","last_became_peered":"2024-09-12T00:43:43.821303+0000","last_unstale":"2024-09-12T01:38:52.165887+0000","last_undegraded":"2024-09-12T01:38:52.165887+0000","last_fullsized":"2024-09-12T01:38:52.165887+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T01:38:52.165786+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T01:38:52.165786+0000","last_clean_scrub_stamp":"2024-09-12T01:38:52.165786+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:35.344751+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16370,"num_write":4,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'2","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:38.042646+0000","last_change":"2024-09-12T01:38:38.042646+0000","last_active":"2024-09-12T01:38:38.042646+0000","last_peered":"2024-09-12T01:38:38.042646+0000","last_clean":"2024-09-12T01:38:38.042646+0000","last_became_active":"2024-09-12T00:43:38.799623+0000","last_became_peered":"2024-09-12T00:43:38.799623+0000","last_unstale":"2024-09-12T01:38:38.042646+0000","last_undegraded":"2024-09-12T01:38:38.042646+0000","last_fullsized":"2024-09-12T01:38:38.042646+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:38.042545+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:38.042545+0000","last_clean_scrub_stamp":"2024-09-12T01:38:38.042545+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:16.881875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":59,"num_write":2,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'30","reported_seq":148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.581377+0000","last_change":"2024-09-12T01:38:13.581377+0000","last_active":"2024-09-12T01:38:13.581377+0000","last_peered":"2024-09-12T01:38:13.581377+0000","last_clean":"2024-09-12T01:38:13.581377+0000","last_became_active":"2024-09-12T00:39:17.768143+0000","last_became_peered":"2024-09-12T00:39:17.768143+0000","last_unstale":"2024-09-12T01:38:13.581377+0000","last_undegraded":"2024-09-12T01:38:13.581377+0000","last_fullsized":"2024-09-12T01:38:13.581377+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'30","last_scrub_stamp":"2024-09-12T01:38:13.581243+0000","last_deep_scrub":"266'30","last_deep_scrub_stamp":"2024-09-12T01:38:13.581243+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.581243+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:42.561923+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":109,"num_write":48,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.693031+0000","last_change":"2024-09-12T01:38:32.692957+0000","last_active":"2024-09-12T01:38:32.693031+0000","last_peered":"2024-09-12T01:38:32.693031+0000","last_clean":"2024-09-12T01:38:32.693031+0000","last_became_active":"2024-09-12T01:02:03.926699+0000","last_became_peered":"2024-09-12T01:02:03.926699+0000","last_unstale":"2024-09-12T01:38:32.693031+0000","last_undegraded":"2024-09-12T01:38:32.693031+0000","last_fullsized":"2024-09-12T01:38:32.693031+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:32.692862+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:32.692862+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.692862+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:16.889559+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'7","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:28.397880+0000","last_change":"2024-09-12T01:38:28.397880+0000","last_active":"2024-09-12T01:38:28.397880+0000","last_peered":"2024-09-12T01:38:28.397880+0000","last_clean":"2024-09-12T01:38:28.397880+0000","last_became_active":"2024-09-12T00:43:43.819254+0000","last_became_peered":"2024-09-12T00:43:43.819254+0000","last_unstale":"2024-09-12T01:38:28.397880+0000","last_undegraded":"2024-09-12T01:38:28.397880+0000","last_fullsized":"2024-09-12T01:38:28.397880+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T01:38:28.397795+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T01:38:28.397795+0000","last_clean_scrub_stamp":"2024-09-12T01:38:28.397795+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:56:41.062741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":24570,"num_write":12,"num_write_kb":8188,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"0'0","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.647787+0000","last_change":"2024-09-12T01:38:16.647787+0000","last_active":"2024-09-12T01:38:16.647787+0000","last_peered":"2024-09-12T01:38:16.647787+0000","last_clean":"2024-09-12T01:38:16.647787+0000","last_became_active":"2024-09-12T00:43:38.798431+0000","last_became_peered":"2024-09-12T00:43:38.798431+0000","last_unstale":"2024-09-12T01:38:16.647787+0000","last_undegraded":"2024-09-12T01:38:16.647787+0000","last_fullsized":"2024-09-12T01:38:16.647787+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.647689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.647689+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.647689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:10.062955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'26","reported_seq":132,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.714325+0000","last_change":"2024-09-12T01:38:14.714325+0000","last_active":"2024-09-12T01:38:14.714325+0000","last_peered":"2024-09-12T01:38:14.714325+0000","last_clean":"2024-09-12T01:38:14.714325+0000","last_became_active":"2024-09-12T00:39:17.768901+0000","last_became_peered":"2024-09-12T00:39:17.768901+0000","last_unstale":"2024-09-12T01:38:14.714325+0000","last_undegraded":"2024-09-12T01:38:14.714325+0000","last_fullsized":"2024-09-12T01:38:14.714325+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T01:38:14.714227+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T01:38:14.714227+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.714227+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:14.636195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":119,"num_read_kb":84,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.406934+0000","last_change":"2024-09-12T01:38:29.406868+0000","last_active":"2024-09-12T01:38:29.406934+0000","last_peered":"2024-09-12T01:38:29.406934+0000","last_clean":"2024-09-12T01:38:29.406934+0000","last_became_active":"2024-09-12T01:02:03.922500+0000","last_became_peered":"2024-09-12T01:02:03.922500+0000","last_unstale":"2024-09-12T01:38:29.406934+0000","last_undegraded":"2024-09-12T01:38:29.406934+0000","last_fullsized":"2024-09-12T01:38:29.406934+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:29.406767+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:29.406767+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.406767+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:46.533720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"0'0","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.075338+0000","last_change":"2024-09-12T01:38:39.075338+0000","last_active":"2024-09-12T01:38:39.075338+0000","last_peered":"2024-09-12T01:38:39.075338+0000","last_clean":"2024-09-12T01:38:39.075338+0000","last_became_active":"2024-09-12T00:43:43.823554+0000","last_became_peered":"2024-09-12T00:43:43.823554+0000","last_unstale":"2024-09-12T01:38:39.075338+0000","last_undegraded":"2024-09-12T01:38:39.075338+0000","last_fullsized":"2024-09-12T01:38:39.075338+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.075247+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.075247+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.075247+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:01.960706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"0'0","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:37.008896+0000","last_change":"2024-09-12T01:38:37.008896+0000","last_active":"2024-09-12T01:38:37.008896+0000","last_peered":"2024-09-12T01:38:37.008896+0000","last_clean":"2024-09-12T01:38:37.008896+0000","last_became_active":"2024-09-12T00:43:38.798117+0000","last_became_peered":"2024-09-12T00:43:38.798117+0000","last_unstale":"2024-09-12T01:38:37.008896+0000","last_undegraded":"2024-09-12T01:38:37.008896+0000","last_fullsized":"2024-09-12T01:38:37.008896+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:37.008802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:37.008802+0000","last_clean_scrub_stamp":"2024-09-12T01:38:37.008802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:04:22.178386+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'16","reported_seq":107,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:32.957703+0000","last_change":"2024-09-12T01:38:32.957703+0000","last_active":"2024-09-12T01:38:32.957703+0000","last_peered":"2024-09-12T01:38:32.957703+0000","last_clean":"2024-09-12T01:38:32.957703+0000","last_became_active":"2024-09-12T00:39:17.768503+0000","last_became_peered":"2024-09-12T00:39:17.768503+0000","last_unstale":"2024-09-12T01:38:32.957703+0000","last_undegraded":"2024-09-12T01:38:32.957703+0000","last_fullsized":"2024-09-12T01:38:32.957703+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'16","last_scrub_stamp":"2024-09-12T01:38:32.957591+0000","last_deep_scrub":"266'16","last_deep_scrub_stamp":"2024-09-12T01:38:32.957591+0000","last_clean_scrub_stamp":"2024-09-12T01:38:32.957591+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:43.460982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":51,"num_write":32,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:39.774843+0000","last_change":"2024-09-12T01:38:39.774843+0000","last_active":"2024-09-12T01:38:39.774843+0000","last_peered":"2024-09-12T01:38:39.774843+0000","last_clean":"2024-09-12T01:38:39.774843+0000","last_became_active":"2024-09-12T01:02:03.928430+0000","last_became_peered":"2024-09-12T01:02:03.928430+0000","last_unstale":"2024-09-12T01:38:39.774843+0000","last_undegraded":"2024-09-12T01:38:39.774843+0000","last_fullsized":"2024-09-12T01:38:39.774843+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:39.774745+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:39.774745+0000","last_clean_scrub_stamp":"2024-09-12T01:38:39.774745+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:48.613287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"0'0","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.512944+0000","last_change":"2024-09-12T01:38:21.512944+0000","last_active":"2024-09-12T01:38:21.512944+0000","last_peered":"2024-09-12T01:38:21.512944+0000","last_clean":"2024-09-12T01:38:21.512944+0000","last_became_active":"2024-09-12T00:43:43.822996+0000","last_became_peered":"2024-09-12T00:43:43.822996+0000","last_unstale":"2024-09-12T01:38:21.512944+0000","last_undegraded":"2024-09-12T01:38:21.512944+0000","last_fullsized":"2024-09-12T01:38:21.512944+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:21.512843+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:21.512843+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.512843+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:05.059540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"263'2","reported_seq":63,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.483184+0000","last_change":"2024-09-12T01:38:21.483184+0000","last_active":"2024-09-12T01:38:21.483184+0000","last_peered":"2024-09-12T01:38:21.483184+0000","last_clean":"2024-09-12T01:38:21.483184+0000","last_became_active":"2024-09-12T00:43:38.797367+0000","last_became_peered":"2024-09-12T00:43:38.797367+0000","last_unstale":"2024-09-12T01:38:21.483184+0000","last_undegraded":"2024-09-12T01:38:21.483184+0000","last_fullsized":"2024-09-12T01:38:21.483184+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T01:38:21.483069+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T01:38:21.483069+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.483069+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:49.131655+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4092,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'9","reported_seq":91,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:33.979713+0000","last_change":"2024-09-12T01:38:33.979713+0000","last_active":"2024-09-12T01:38:33.979713+0000","last_peered":"2024-09-12T01:38:33.979713+0000","last_clean":"2024-09-12T01:38:33.979713+0000","last_became_active":"2024-09-12T00:39:17.759327+0000","last_became_peered":"2024-09-12T00:39:17.759327+0000","last_unstale":"2024-09-12T01:38:33.979713+0000","last_undegraded":"2024-09-12T01:38:33.979713+0000","last_fullsized":"2024-09-12T01:38:33.979713+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T01:38:33.979612+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T01:38:33.979612+0000","last_clean_scrub_stamp":"2024-09-12T01:38:33.979612+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:18.592523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":31,"num_write":23,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:48.177731+0000","last_change":"2024-09-12T01:38:48.177731+0000","last_active":"2024-09-12T01:38:48.177731+0000","last_peered":"2024-09-12T01:38:48.177731+0000","last_clean":"2024-09-12T01:38:48.177731+0000","last_became_active":"2024-09-12T01:02:03.925081+0000","last_became_peered":"2024-09-12T01:02:03.925081+0000","last_unstale":"2024-09-12T01:38:48.177731+0000","last_undegraded":"2024-09-12T01:38:48.177731+0000","last_fullsized":"2024-09-12T01:38:48.177731+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:48.177646+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:48.177646+0000","last_clean_scrub_stamp":"2024-09-12T01:38:48.177646+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:02.170818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'4","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.581279+0000","last_change":"2024-09-12T01:38:18.581279+0000","last_active":"2024-09-12T01:38:18.581279+0000","last_peered":"2024-09-12T01:38:18.581279+0000","last_clean":"2024-09-12T01:38:18.581279+0000","last_became_active":"2024-09-12T00:43:43.822237+0000","last_became_peered":"2024-09-12T00:43:43.822237+0000","last_unstale":"2024-09-12T01:38:18.581279+0000","last_undegraded":"2024-09-12T01:38:18.581279+0000","last_fullsized":"2024-09-12T01:38:18.581279+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:18.581176+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:18.581176+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.581176+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:25.657953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8184,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'6","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.761259+0000","last_change":"2024-09-12T01:38:17.761259+0000","last_active":"2024-09-12T01:38:17.761259+0000","last_peered":"2024-09-12T01:38:17.761259+0000","last_clean":"2024-09-12T01:38:17.761259+0000","last_became_active":"2024-09-12T00:43:38.793943+0000","last_became_peered":"2024-09-12T00:43:38.793943+0000","last_unstale":"2024-09-12T01:38:17.761259+0000","last_undegraded":"2024-09-12T01:38:17.761259+0000","last_fullsized":"2024-09-12T01:38:17.761259+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T01:38:17.761175+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T01:38:17.761175+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.761175+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:03:37.005205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":11272,"num_write":6,"num_write_kb":7180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"266'26","reported_seq":138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.707662+0000","last_change":"2024-09-12T01:38:11.707662+0000","last_active":"2024-09-12T01:38:11.707662+0000","last_peered":"2024-09-12T01:38:11.707662+0000","last_clean":"2024-09-12T01:38:11.707662+0000","last_became_active":"2024-09-12T00:39:17.770093+0000","last_became_peered":"2024-09-12T00:39:17.770093+0000","last_unstale":"2024-09-12T01:38:11.707662+0000","last_undegraded":"2024-09-12T01:38:11.707662+0000","last_fullsized":"2024-09-12T01:38:11.707662+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T01:38:11.707576+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T01:38:11.707576+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.707576+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:31.726573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'194","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.782554+0000","last_change":"2024-09-12T01:37:51.782461+0000","last_active":"2024-09-12T01:37:51.782554+0000","last_peered":"2024-09-12T01:37:51.782554+0000","last_clean":"2024-09-12T01:37:51.782554+0000","last_became_active":"2024-09-12T00:25:00.479764+0000","last_became_peered":"2024-09-12T00:25:00.479764+0000","last_unstale":"2024-09-12T01:37:51.782554+0000","last_undegraded":"2024-09-12T01:37:51.782554+0000","last_fullsized":"2024-09-12T01:37:51.782554+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T01:37:51.782310+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T01:37:51.782310+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.782310+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:39.097138+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":446,"num_read_kb":6490,"num_write":862,"num_write_kb":17717,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,2],"acting":[0,3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'386","reported_seq":1940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.837693+0000","last_change":"2024-09-12T01:37:59.837693+0000","last_active":"2024-09-12T01:37:59.837693+0000","last_peered":"2024-09-12T01:37:59.837693+0000","last_clean":"2024-09-12T01:37:59.837693+0000","last_became_active":"2024-09-12T00:25:02.474473+0000","last_became_peered":"2024-09-12T00:25:02.474473+0000","last_unstale":"2024-09-12T01:37:59.837693+0000","last_undegraded":"2024-09-12T01:37:59.837693+0000","last_fullsized":"2024-09-12T01:37:59.837693+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'386","last_scrub_stamp":"2024-09-12T01:37:59.837583+0000","last_deep_scrub":"266'386","last_deep_scrub_stamp":"2024-09-12T01:37:59.837583+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.837583+0000","objects_scrubbed":3,"log_size":86,"log_dups_size":300,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:41.730695+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2167,"num_read_kb":2073,"num_write":418,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'235","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.616677+0000","last_change":"2024-09-12T01:37:57.616619+0000","last_active":"2024-09-12T01:37:57.616677+0000","last_peered":"2024-09-12T01:37:57.616677+0000","last_clean":"2024-09-12T01:37:57.616677+0000","last_became_active":"2024-09-12T00:25:00.469588+0000","last_became_peered":"2024-09-12T00:25:00.469588+0000","last_unstale":"2024-09-12T01:37:57.616677+0000","last_undegraded":"2024-09-12T01:37:57.616677+0000","last_fullsized":"2024-09-12T01:37:57.616677+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'235","last_scrub_stamp":"2024-09-12T01:37:57.616503+0000","last_deep_scrub":"266'235","last_deep_scrub_stamp":"2024-09-12T01:37:57.616503+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.616503+0000","objects_scrubbed":5,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:16.143384+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2038976,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":700,"num_read_kb":64068,"num_write":1104,"num_write_kb":30148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0,3],"acting":[5,6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'892","reported_seq":2586,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.970072+0000","last_change":"2024-09-12T01:38:08.970072+0000","last_active":"2024-09-12T01:38:08.970072+0000","last_peered":"2024-09-12T01:38:08.970072+0000","last_clean":"2024-09-12T01:38:08.970072+0000","last_became_active":"2024-09-12T00:25:02.476131+0000","last_became_peered":"2024-09-12T00:25:02.476131+0000","last_unstale":"2024-09-12T01:38:08.970072+0000","last_undegraded":"2024-09-12T01:38:08.970072+0000","last_fullsized":"2024-09-12T01:38:08.970072+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'892","last_scrub_stamp":"2024-09-12T01:38:08.969967+0000","last_deep_scrub":"266'892","last_deep_scrub_stamp":"2024-09-12T01:38:08.969967+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.969967+0000","objects_scrubbed":3,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:34.555648+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4103,"num_read_kb":3695,"num_write":1128,"num_write_kb":399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":248,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'210","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.565091+0000","last_change":"2024-09-12T01:37:58.565004+0000","last_active":"2024-09-12T01:37:58.565091+0000","last_peered":"2024-09-12T01:37:58.565091+0000","last_clean":"2024-09-12T01:37:58.565091+0000","last_became_active":"2024-09-12T00:25:00.458072+0000","last_became_peered":"2024-09-12T00:25:00.458072+0000","last_unstale":"2024-09-12T01:37:58.565091+0000","last_undegraded":"2024-09-12T01:37:58.565091+0000","last_fullsized":"2024-09-12T01:37:58.565091+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T01:37:58.564864+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T01:37:58.564864+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.564864+0000","objects_scrubbed":1,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:40:34.721743+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":483,"num_read_kb":12854,"num_write":984,"num_write_kb":25223,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,1],"acting":[5,4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'1328","reported_seq":2890,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.970587+0000","last_change":"2024-09-12T01:38:09.970587+0000","last_active":"2024-09-12T01:38:09.970587+0000","last_peered":"2024-09-12T01:38:09.970587+0000","last_clean":"2024-09-12T01:38:09.970587+0000","last_became_active":"2024-09-12T00:25:02.470249+0000","last_became_peered":"2024-09-12T00:25:02.470249+0000","last_unstale":"2024-09-12T01:38:09.970587+0000","last_undegraded":"2024-09-12T01:38:09.970587+0000","last_fullsized":"2024-09-12T01:38:09.970587+0000","mapping_epoch":28,"log_start":"266'1300","ondisk_log_start":"266'1300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1328","last_scrub_stamp":"2024-09-12T01:38:09.970500+0000","last_deep_scrub":"266'1328","last_deep_scrub_stamp":"2024-09-12T01:38:09.970500+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.970500+0000","objects_scrubbed":3,"log_size":28,"log_dups_size":1300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:18.710168+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5936,"num_read_kb":5183,"num_write":1890,"num_write_kb":851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'198","reported_seq":841,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.701005+0000","last_change":"2024-09-12T01:37:49.701005+0000","last_active":"2024-09-12T01:37:49.701005+0000","last_peered":"2024-09-12T01:37:49.701005+0000","last_clean":"2024-09-12T01:37:49.701005+0000","last_became_active":"2024-09-12T00:25:00.482357+0000","last_became_peered":"2024-09-12T00:25:00.482357+0000","last_unstale":"2024-09-12T01:37:49.701005+0000","last_undegraded":"2024-09-12T01:37:49.701005+0000","last_fullsized":"2024-09-12T01:37:49.701005+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'198","last_scrub_stamp":"2024-09-12T01:37:49.700861+0000","last_deep_scrub":"266'198","last_deep_scrub_stamp":"2024-09-12T01:37:49.700861+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.700861+0000","objects_scrubbed":4,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:41.600504+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":404,"num_read_kb":30861,"num_write":868,"num_write_kb":33122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3,5],"acting":[2,4,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'568","reported_seq":2123,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.305956+0000","last_change":"2024-09-12T01:38:01.305956+0000","last_active":"2024-09-12T01:38:01.305956+0000","last_peered":"2024-09-12T01:38:01.305956+0000","last_clean":"2024-09-12T01:38:01.305956+0000","last_became_active":"2024-09-12T00:25:02.467378+0000","last_became_peered":"2024-09-12T00:25:02.467378+0000","last_unstale":"2024-09-12T01:38:01.305956+0000","last_undegraded":"2024-09-12T01:38:01.305956+0000","last_fullsized":"2024-09-12T01:38:01.305956+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'568","last_scrub_stamp":"2024-09-12T01:38:01.305854+0000","last_deep_scrub":"266'568","last_deep_scrub_stamp":"2024-09-12T01:38:01.305854+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.305854+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:30:08.402665+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2918,"num_read_kb":2656,"num_write":743,"num_write_kb":254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'211","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.817464+0000","last_change":"2024-09-12T01:37:50.817464+0000","last_active":"2024-09-12T01:37:50.817464+0000","last_peered":"2024-09-12T01:37:50.817464+0000","last_clean":"2024-09-12T01:37:50.817464+0000","last_became_active":"2024-09-12T00:25:00.475340+0000","last_became_peered":"2024-09-12T00:25:00.475340+0000","last_unstale":"2024-09-12T01:37:50.817464+0000","last_undegraded":"2024-09-12T01:37:50.817464+0000","last_fullsized":"2024-09-12T01:37:50.817464+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T01:37:50.817350+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T01:37:50.817350+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.817350+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:44.835143+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133679,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":13966,"num_write":1015,"num_write_kb":23620,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'576","reported_seq":2287,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.816314+0000","last_change":"2024-09-12T01:37:58.816314+0000","last_active":"2024-09-12T01:37:58.816314+0000","last_peered":"2024-09-12T01:37:58.816314+0000","last_clean":"2024-09-12T01:37:58.816314+0000","last_became_active":"2024-09-12T00:25:02.474229+0000","last_became_peered":"2024-09-12T00:25:02.474229+0000","last_unstale":"2024-09-12T01:37:58.816314+0000","last_undegraded":"2024-09-12T01:37:58.816314+0000","last_fullsized":"2024-09-12T01:37:58.816314+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'576","last_scrub_stamp":"2024-09-12T01:37:58.816221+0000","last_deep_scrub":"266'576","last_deep_scrub_stamp":"2024-09-12T01:37:58.816221+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.816221+0000","objects_scrubbed":5,"log_size":76,"log_dups_size":500,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:01.221779+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":3129,"num_read_kb":2896,"num_write":736,"num_write_kb":256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1072,"num_omap_keys":5,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'188","reported_seq":939,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.754127+0000","last_change":"2024-09-12T01:37:50.754127+0000","last_active":"2024-09-12T01:37:50.754127+0000","last_peered":"2024-09-12T01:37:50.754127+0000","last_clean":"2024-09-12T01:37:50.754127+0000","last_became_active":"2024-09-12T00:25:00.487589+0000","last_became_peered":"2024-09-12T00:25:00.487589+0000","last_unstale":"2024-09-12T01:37:50.754127+0000","last_undegraded":"2024-09-12T01:37:50.754127+0000","last_fullsized":"2024-09-12T01:37:50.754127+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:50.754013+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:50.754013+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.754013+0000","objects_scrubbed":6,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:08.640403+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8822595,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":942,"num_read_kb":45033,"num_write":954,"num_write_kb":42108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,0,6],"acting":[2,4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'529","reported_seq":2429,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.856271+0000","last_change":"2024-09-12T01:37:59.856187+0000","last_active":"2024-09-12T01:37:59.856271+0000","last_peered":"2024-09-12T01:37:59.856271+0000","last_clean":"2024-09-12T01:37:59.856271+0000","last_became_active":"2024-09-12T00:25:02.477395+0000","last_became_peered":"2024-09-12T00:25:02.477395+0000","last_unstale":"2024-09-12T01:37:59.856271+0000","last_undegraded":"2024-09-12T01:37:59.856271+0000","last_fullsized":"2024-09-12T01:37:59.856271+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'529","last_scrub_stamp":"2024-09-12T01:37:59.856094+0000","last_deep_scrub":"266'529","last_deep_scrub_stamp":"2024-09-12T01:37:59.856094+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.856094+0000","objects_scrubbed":7,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:03.807614+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3189,"num_read_kb":3033,"num_write":616,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2555,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'234","reported_seq":903,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.867960+0000","last_change":"2024-09-12T01:37:49.867960+0000","last_active":"2024-09-12T01:37:49.867960+0000","last_peered":"2024-09-12T01:37:49.867960+0000","last_clean":"2024-09-12T01:37:49.867960+0000","last_became_active":"2024-09-12T00:25:00.477590+0000","last_became_peered":"2024-09-12T00:25:00.477590+0000","last_unstale":"2024-09-12T01:37:49.867960+0000","last_undegraded":"2024-09-12T01:37:49.867960+0000","last_fullsized":"2024-09-12T01:37:49.867960+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'234","last_scrub_stamp":"2024-09-12T01:37:49.867814+0000","last_deep_scrub":"266'234","last_deep_scrub_stamp":"2024-09-12T01:37:49.867814+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.867814+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:35.864908+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048652,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":503,"num_read_kb":24485,"num_write":1039,"num_write_kb":27596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1,3],"acting":[0,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'375","reported_seq":1766,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.698712+0000","last_change":"2024-09-12T01:37:55.698644+0000","last_active":"2024-09-12T01:37:55.698712+0000","last_peered":"2024-09-12T01:37:55.698712+0000","last_clean":"2024-09-12T01:37:55.698712+0000","last_became_active":"2024-09-12T00:25:02.466439+0000","last_became_peered":"2024-09-12T00:25:02.466439+0000","last_unstale":"2024-09-12T01:37:55.698712+0000","last_undegraded":"2024-09-12T01:37:55.698712+0000","last_fullsized":"2024-09-12T01:37:55.698712+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'375","last_scrub_stamp":"2024-09-12T01:37:55.698565+0000","last_deep_scrub":"266'375","last_deep_scrub_stamp":"2024-09-12T01:37:55.698565+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.698565+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":300,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:29.902650+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1824,"num_read_kb":1739,"num_write":422,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'188","reported_seq":801,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.564948+0000","last_change":"2024-09-12T01:37:56.564948+0000","last_active":"2024-09-12T01:37:56.564948+0000","last_peered":"2024-09-12T01:37:56.564948+0000","last_clean":"2024-09-12T01:37:56.564948+0000","last_became_active":"2024-09-12T00:25:00.472046+0000","last_became_peered":"2024-09-12T00:25:00.472046+0000","last_unstale":"2024-09-12T01:37:56.564948+0000","last_undegraded":"2024-09-12T01:37:56.564948+0000","last_fullsized":"2024-09-12T01:37:56.564948+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:56.564688+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:56.564688+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.564688+0000","objects_scrubbed":2,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:04.119213+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":378,"num_read_kb":23076,"num_write":837,"num_write_kb":28135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,2],"acting":[5,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'364","reported_seq":1848,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.628354+0000","last_change":"2024-09-12T01:38:07.628354+0000","last_active":"2024-09-12T01:38:07.628354+0000","last_peered":"2024-09-12T01:38:07.628354+0000","last_clean":"2024-09-12T01:38:07.628354+0000","last_became_active":"2024-09-12T00:25:02.474791+0000","last_became_peered":"2024-09-12T00:25:02.474791+0000","last_unstale":"2024-09-12T01:38:07.628354+0000","last_undegraded":"2024-09-12T01:38:07.628354+0000","last_fullsized":"2024-09-12T01:38:07.628354+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'364","last_scrub_stamp":"2024-09-12T01:38:07.628270+0000","last_deep_scrub":"266'364","last_deep_scrub_stamp":"2024-09-12T01:38:07.628270+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.628270+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":300,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:42.047911+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2089,"num_read_kb":2020,"num_write":422,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'478","reported_seq":2155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.938318+0000","last_change":"2024-09-12T01:38:07.938318+0000","last_active":"2024-09-12T01:38:07.938318+0000","last_peered":"2024-09-12T01:38:07.938318+0000","last_clean":"2024-09-12T01:38:07.938318+0000","last_became_active":"2024-09-12T00:25:02.471545+0000","last_became_peered":"2024-09-12T00:25:02.471545+0000","last_unstale":"2024-09-12T01:38:07.938318+0000","last_undegraded":"2024-09-12T01:38:07.938318+0000","last_fullsized":"2024-09-12T01:38:07.938318+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'478","last_scrub_stamp":"2024-09-12T01:38:07.938236+0000","last_deep_scrub":"266'478","last_deep_scrub_stamp":"2024-09-12T01:38:07.938236+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.938236+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:00.495364+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2642,"num_read_kb":2498,"num_write":559,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2298,"num_omap_keys":9,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'202","reported_seq":1070,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.902175+0000","last_change":"2024-09-12T01:37:48.902175+0000","last_active":"2024-09-12T01:37:48.902175+0000","last_peered":"2024-09-12T01:37:48.902175+0000","last_clean":"2024-09-12T01:37:48.902175+0000","last_became_active":"2024-09-12T00:25:00.464783+0000","last_became_peered":"2024-09-12T00:25:00.464783+0000","last_unstale":"2024-09-12T01:37:48.902175+0000","last_undegraded":"2024-09-12T01:37:48.902175+0000","last_fullsized":"2024-09-12T01:37:48.902175+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'202","last_scrub_stamp":"2024-09-12T01:37:48.902072+0000","last_deep_scrub":"266'202","last_deep_scrub_stamp":"2024-09-12T01:37:48.902072+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.902072+0000","objects_scrubbed":3,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:23.439697+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33204,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":967,"num_read_kb":27994,"num_write":1073,"num_write_kb":26373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5,2],"acting":[1,3,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'504","reported_seq":2079,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.764743+0000","last_change":"2024-09-12T01:37:54.764743+0000","last_active":"2024-09-12T01:37:54.764743+0000","last_peered":"2024-09-12T01:37:54.764743+0000","last_clean":"2024-09-12T01:37:54.764743+0000","last_became_active":"2024-09-12T00:25:02.475032+0000","last_became_peered":"2024-09-12T00:25:02.475032+0000","last_unstale":"2024-09-12T01:37:54.764743+0000","last_undegraded":"2024-09-12T01:37:54.764743+0000","last_fullsized":"2024-09-12T01:37:54.764743+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'504","last_scrub_stamp":"2024-09-12T01:37:54.764639+0000","last_deep_scrub":"266'504","last_deep_scrub_stamp":"2024-09-12T01:37:54.764639+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.764639+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":400,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:07.905496+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2653,"num_read_kb":2473,"num_write":625,"num_write_kb":204,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'211","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.771568+0000","last_change":"2024-09-12T01:37:52.771568+0000","last_active":"2024-09-12T01:37:52.771568+0000","last_peered":"2024-09-12T01:37:52.771568+0000","last_clean":"2024-09-12T01:37:52.771568+0000","last_became_active":"2024-09-12T00:25:00.479635+0000","last_became_peered":"2024-09-12T00:25:00.479635+0000","last_unstale":"2024-09-12T01:37:52.771568+0000","last_undegraded":"2024-09-12T01:37:52.771568+0000","last_fullsized":"2024-09-12T01:37:52.771568+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T01:37:52.771466+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T01:37:52.771466+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.771466+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:45.884259+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1279168,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":509,"num_read_kb":30051,"num_write":937,"num_write_kb":51711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,6],"acting":[0,2,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'1151","reported_seq":2940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.880921+0000","last_change":"2024-09-12T01:37:54.880921+0000","last_active":"2024-09-12T01:37:54.880921+0000","last_peered":"2024-09-12T01:37:54.880921+0000","last_clean":"2024-09-12T01:37:54.880921+0000","last_became_active":"2024-09-12T00:25:02.467224+0000","last_became_peered":"2024-09-12T00:25:02.467224+0000","last_unstale":"2024-09-12T01:37:54.880921+0000","last_undegraded":"2024-09-12T01:37:54.880921+0000","last_fullsized":"2024-09-12T01:37:54.880921+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1151","last_scrub_stamp":"2024-09-12T01:37:54.880810+0000","last_deep_scrub":"266'1151","last_deep_scrub_stamp":"2024-09-12T01:37:54.880810+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.880810+0000","objects_scrubbed":1,"log_size":51,"log_dups_size":1100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:14.639713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5645,"num_read_kb":4973,"num_write":1729,"num_write_kb":865,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'210","reported_seq":855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.874315+0000","last_change":"2024-09-12T01:37:48.874315+0000","last_active":"2024-09-12T01:37:48.874315+0000","last_peered":"2024-09-12T01:37:48.874315+0000","last_clean":"2024-09-12T01:37:48.874315+0000","last_became_active":"2024-09-12T00:25:00.477184+0000","last_became_peered":"2024-09-12T00:25:00.477184+0000","last_unstale":"2024-09-12T01:37:48.874315+0000","last_undegraded":"2024-09-12T01:37:48.874315+0000","last_fullsized":"2024-09-12T01:37:48.874315+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T01:37:48.874041+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T01:37:48.874041+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.874041+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:11.950680+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3321654,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":408,"num_read_kb":20227,"num_write":1015,"num_write_kb":31572,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4,1],"acting":[0,3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'487","reported_seq":2026,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.351017+0000","last_change":"2024-09-12T01:37:59.351017+0000","last_active":"2024-09-12T01:37:59.351017+0000","last_peered":"2024-09-12T01:37:59.351017+0000","last_clean":"2024-09-12T01:37:59.351017+0000","last_became_active":"2024-09-12T00:25:02.469463+0000","last_became_peered":"2024-09-12T00:25:02.469463+0000","last_unstale":"2024-09-12T01:37:59.351017+0000","last_undegraded":"2024-09-12T01:37:59.351017+0000","last_fullsized":"2024-09-12T01:37:59.351017+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'487","last_scrub_stamp":"2024-09-12T01:37:59.350932+0000","last_deep_scrub":"266'487","last_deep_scrub_stamp":"2024-09-12T01:37:59.350932+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.350932+0000","objects_scrubbed":2,"log_size":87,"log_dups_size":400,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:05.093460+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2575,"num_read_kb":2387,"num_write":615,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'190","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.874423+0000","last_change":"2024-09-12T01:37:47.874423+0000","last_active":"2024-09-12T01:37:47.874423+0000","last_peered":"2024-09-12T01:37:47.874423+0000","last_clean":"2024-09-12T01:37:47.874423+0000","last_became_active":"2024-09-12T00:25:00.483327+0000","last_became_peered":"2024-09-12T00:25:00.483327+0000","last_unstale":"2024-09-12T01:37:47.874423+0000","last_undegraded":"2024-09-12T01:37:47.874423+0000","last_fullsized":"2024-09-12T01:37:47.874423+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T01:37:47.874305+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T01:37:47.874305+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.874305+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:25.303987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1395812,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":532,"num_read_kb":12020,"num_write":922,"num_write_kb":12011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,4],"acting":[0,1,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'411","reported_seq":2010,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.626361+0000","last_change":"2024-09-12T01:38:06.626361+0000","last_active":"2024-09-12T01:38:06.626361+0000","last_peered":"2024-09-12T01:38:06.626361+0000","last_clean":"2024-09-12T01:38:06.626361+0000","last_became_active":"2024-09-12T00:25:02.471598+0000","last_became_peered":"2024-09-12T00:25:02.471598+0000","last_unstale":"2024-09-12T01:38:06.626361+0000","last_undegraded":"2024-09-12T01:38:06.626361+0000","last_fullsized":"2024-09-12T01:38:06.626361+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'411","last_scrub_stamp":"2024-09-12T01:38:06.626274+0000","last_deep_scrub":"266'411","last_deep_scrub_stamp":"2024-09-12T01:38:06.626274+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.626274+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":400,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:26.680294+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2389,"num_read_kb":2272,"num_write":462,"num_write_kb":100,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3460,"num_omap_keys":14,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'177","reported_seq":844,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.284808+0000","last_change":"2024-09-12T01:37:52.284808+0000","last_active":"2024-09-12T01:37:52.284808+0000","last_peered":"2024-09-12T01:37:52.284808+0000","last_clean":"2024-09-12T01:37:52.284808+0000","last_became_active":"2024-09-12T00:25:00.478202+0000","last_became_peered":"2024-09-12T00:25:00.478202+0000","last_unstale":"2024-09-12T01:37:52.284808+0000","last_undegraded":"2024-09-12T01:37:52.284808+0000","last_fullsized":"2024-09-12T01:37:52.284808+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T01:37:52.284701+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T01:37:52.284701+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.284701+0000","objects_scrubbed":2,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:47.992887+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":445,"num_read_kb":78408,"num_write":837,"num_write_kb":24955,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4,2],"acting":[6,0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'665","reported_seq":2206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.925694+0000","last_change":"2024-09-12T01:37:55.925694+0000","last_active":"2024-09-12T01:37:55.925694+0000","last_peered":"2024-09-12T01:37:55.925694+0000","last_clean":"2024-09-12T01:37:55.925694+0000","last_became_active":"2024-09-12T00:25:02.470278+0000","last_became_peered":"2024-09-12T00:25:02.470278+0000","last_unstale":"2024-09-12T01:37:55.925694+0000","last_undegraded":"2024-09-12T01:37:55.925694+0000","last_fullsized":"2024-09-12T01:37:55.925694+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'665","last_scrub_stamp":"2024-09-12T01:37:55.925590+0000","last_deep_scrub":"266'665","last_deep_scrub_stamp":"2024-09-12T01:37:55.925590+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.925590+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":600,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:59.829971+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3455,"num_read_kb":3151,"num_write":936,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'238","reported_seq":915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.212407+0000","last_change":"2024-09-12T01:37:50.212407+0000","last_active":"2024-09-12T01:37:50.212407+0000","last_peered":"2024-09-12T01:37:50.212407+0000","last_clean":"2024-09-12T01:37:50.212407+0000","last_became_active":"2024-09-12T00:25:00.456765+0000","last_became_peered":"2024-09-12T00:25:00.456765+0000","last_unstale":"2024-09-12T01:37:50.212407+0000","last_undegraded":"2024-09-12T01:37:50.212407+0000","last_fullsized":"2024-09-12T01:37:50.212407+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'238","last_scrub_stamp":"2024-09-12T01:37:50.212298+0000","last_deep_scrub":"266'238","last_deep_scrub_stamp":"2024-09-12T01:37:50.212298+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.212298+0000","objects_scrubbed":3,"log_size":38,"log_dups_size":200,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:59.941924+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4496550,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":628,"num_read_kb":22861,"num_write":1212,"num_write_kb":42313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4,1],"acting":[6,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'130","reported_seq":650,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.818021+0000","last_change":"2024-09-12T01:38:10.818021+0000","last_active":"2024-09-12T01:38:10.818021+0000","last_peered":"2024-09-12T01:38:10.818021+0000","last_clean":"2024-09-12T01:38:10.818021+0000","last_became_active":"2024-09-12T00:25:10.523187+0000","last_became_peered":"2024-09-12T00:25:10.523187+0000","last_unstale":"2024-09-12T01:38:10.818021+0000","last_undegraded":"2024-09-12T01:38:10.818021+0000","last_fullsized":"2024-09-12T01:38:10.818021+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'130","last_scrub_stamp":"2024-09-12T01:38:10.817927+0000","last_deep_scrub":"266'130","last_deep_scrub_stamp":"2024-09-12T01:38:10.817927+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.817927+0000","objects_scrubbed":1,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:05:55.101000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":144,"num_read_kb":140,"num_write":320,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'452","reported_seq":2147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.335059+0000","last_change":"2024-09-12T01:37:57.335059+0000","last_active":"2024-09-12T01:37:57.335059+0000","last_peered":"2024-09-12T01:37:57.335059+0000","last_clean":"2024-09-12T01:37:57.335059+0000","last_became_active":"2024-09-12T00:25:02.464035+0000","last_became_peered":"2024-09-12T00:25:02.464035+0000","last_unstale":"2024-09-12T01:37:57.335059+0000","last_undegraded":"2024-09-12T01:37:57.335059+0000","last_fullsized":"2024-09-12T01:37:57.335059+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'452","last_scrub_stamp":"2024-09-12T01:37:57.334965+0000","last_deep_scrub":"266'452","last_deep_scrub_stamp":"2024-09-12T01:37:57.334965+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.334965+0000","objects_scrubbed":5,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:08:23.139483+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2614,"num_read_kb":2487,"num_write":526,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2810,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'214","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.033783+0000","last_change":"2024-09-12T01:37:51.033783+0000","last_active":"2024-09-12T01:37:51.033783+0000","last_peered":"2024-09-12T01:37:51.033783+0000","last_clean":"2024-09-12T01:37:51.033783+0000","last_became_active":"2024-09-12T00:25:00.479335+0000","last_became_peered":"2024-09-12T00:25:00.479335+0000","last_unstale":"2024-09-12T01:37:51.033783+0000","last_undegraded":"2024-09-12T01:37:51.033783+0000","last_fullsized":"2024-09-12T01:37:51.033783+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'214","last_scrub_stamp":"2024-09-12T01:37:51.033591+0000","last_deep_scrub":"266'214","last_deep_scrub_stamp":"2024-09-12T01:37:51.033591+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.033591+0000","objects_scrubbed":7,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:04:30.332562+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1920160,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":444,"num_read_kb":7515,"num_write":984,"num_write_kb":32910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,4],"acting":[3,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.898679+0000","last_change":"2024-09-12T01:38:14.898679+0000","last_active":"2024-09-12T01:38:14.898679+0000","last_peered":"2024-09-12T01:38:14.898679+0000","last_clean":"2024-09-12T01:38:14.898679+0000","last_became_active":"2024-09-12T00:25:04.485389+0000","last_became_peered":"2024-09-12T00:25:04.485389+0000","last_unstale":"2024-09-12T01:38:14.898679+0000","last_undegraded":"2024-09-12T01:38:14.898679+0000","last_fullsized":"2024-09-12T01:38:14.898679+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:14.898574+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:14.898574+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.898574+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:20.316403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'226","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.400672+0000","last_change":"2024-09-12T01:38:13.400672+0000","last_active":"2024-09-12T01:38:13.400672+0000","last_peered":"2024-09-12T01:38:13.400672+0000","last_clean":"2024-09-12T01:38:13.400672+0000","last_became_active":"2024-09-12T00:25:06.499933+0000","last_became_peered":"2024-09-12T00:25:06.499933+0000","last_unstale":"2024-09-12T01:38:13.400672+0000","last_undegraded":"2024-09-12T01:38:13.400672+0000","last_fullsized":"2024-09-12T01:38:13.400672+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:38:13.400555+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:38:13.400555+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.400555+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:20:34.461485+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7477,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":301,"num_read_kb":376,"num_write":176,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.815984+0000","last_change":"2024-09-12T01:38:09.815984+0000","last_active":"2024-09-12T01:38:09.815984+0000","last_peered":"2024-09-12T01:38:09.815984+0000","last_clean":"2024-09-12T01:38:09.815984+0000","last_became_active":"2024-09-12T00:25:08.501137+0000","last_became_peered":"2024-09-12T00:25:08.501137+0000","last_unstale":"2024-09-12T01:38:09.815984+0000","last_undegraded":"2024-09-12T01:38:09.815984+0000","last_fullsized":"2024-09-12T01:38:09.815984+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.815888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.815888+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.815888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:39:44.572150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2437","reported_seq":4343,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.824280+0000","last_change":"2024-09-12T01:38:12.824280+0000","last_active":"2024-09-12T01:38:12.824280+0000","last_peered":"2024-09-12T01:38:12.824280+0000","last_clean":"2024-09-12T01:38:12.824280+0000","last_became_active":"2024-09-12T00:25:10.526016+0000","last_became_peered":"2024-09-12T00:25:10.526016+0000","last_unstale":"2024-09-12T01:38:12.824280+0000","last_undegraded":"2024-09-12T01:38:12.824280+0000","last_fullsized":"2024-09-12T01:38:12.824280+0000","mapping_epoch":36,"log_start":"266'2400","ondisk_log_start":"266'2400","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2437","last_scrub_stamp":"2024-09-12T01:38:12.824166+0000","last_deep_scrub":"266'2437","last_deep_scrub_stamp":"2024-09-12T01:38:12.824166+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.824166+0000","objects_scrubbed":2,"log_size":37,"log_dups_size":2400,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:50.109401+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":186,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6097,"num_read_kb":6097,"num_write":4851,"num_write_kb":1790,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'892","reported_seq":2339,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.973679+0000","last_change":"2024-09-12T01:38:04.973679+0000","last_active":"2024-09-12T01:38:04.973679+0000","last_peered":"2024-09-12T01:38:04.973679+0000","last_clean":"2024-09-12T01:38:04.973679+0000","last_became_active":"2024-09-12T00:25:02.477360+0000","last_became_peered":"2024-09-12T00:25:02.477360+0000","last_unstale":"2024-09-12T01:38:04.973679+0000","last_undegraded":"2024-09-12T01:38:04.973679+0000","last_fullsized":"2024-09-12T01:38:04.973679+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'892","last_scrub_stamp":"2024-09-12T01:38:04.973568+0000","last_deep_scrub":"266'892","last_deep_scrub_stamp":"2024-09-12T01:38:04.973568+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.973568+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":800,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:59.857176+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4073,"num_read_kb":3587,"num_write":1238,"num_write_kb":484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'213","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.310189+0000","last_change":"2024-09-12T01:37:47.310189+0000","last_active":"2024-09-12T01:37:47.310189+0000","last_peered":"2024-09-12T01:37:47.310189+0000","last_clean":"2024-09-12T01:37:47.310189+0000","last_became_active":"2024-09-12T00:25:00.452236+0000","last_became_peered":"2024-09-12T00:25:00.452236+0000","last_unstale":"2024-09-12T01:37:47.310189+0000","last_undegraded":"2024-09-12T01:37:47.310189+0000","last_fullsized":"2024-09-12T01:37:47.310189+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T01:37:47.310082+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T01:37:47.310082+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.310082+0000","objects_scrubbed":5,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:22:32.824803+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2084046,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":477,"num_read_kb":27979,"num_write":1022,"num_write_kb":43410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7,5],"acting":[6,3,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.365412+0000","last_change":"2024-09-12T01:38:06.365412+0000","last_active":"2024-09-12T01:38:06.365412+0000","last_peered":"2024-09-12T01:38:06.365412+0000","last_clean":"2024-09-12T01:38:06.365412+0000","last_became_active":"2024-09-12T00:25:04.481218+0000","last_became_peered":"2024-09-12T00:25:04.481218+0000","last_unstale":"2024-09-12T01:38:06.365412+0000","last_undegraded":"2024-09-12T01:38:06.365412+0000","last_fullsized":"2024-09-12T01:38:06.365412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.365322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.365322+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.365322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:31.549095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'131","reported_seq":688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.820345+0000","last_change":"2024-09-12T01:38:03.820345+0000","last_active":"2024-09-12T01:38:03.820345+0000","last_peered":"2024-09-12T01:38:03.820345+0000","last_clean":"2024-09-12T01:38:03.820345+0000","last_became_active":"2024-09-12T00:25:06.490463+0000","last_became_peered":"2024-09-12T00:25:06.490463+0000","last_unstale":"2024-09-12T01:38:03.820345+0000","last_undegraded":"2024-09-12T01:38:03.820345+0000","last_fullsized":"2024-09-12T01:38:03.820345+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'131","last_scrub_stamp":"2024-09-12T01:38:03.820249+0000","last_deep_scrub":"266'131","last_deep_scrub_stamp":"2024-09-12T01:38:03.820249+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.820249+0000","objects_scrubbed":4,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:39.548081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":141,"num_read_kb":131,"num_write":102,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.820695+0000","last_change":"2024-09-12T01:38:08.820695+0000","last_active":"2024-09-12T01:38:08.820695+0000","last_peered":"2024-09-12T01:38:08.820695+0000","last_clean":"2024-09-12T01:38:08.820695+0000","last_became_active":"2024-09-12T00:25:08.505492+0000","last_became_peered":"2024-09-12T00:25:08.505492+0000","last_unstale":"2024-09-12T01:38:08.820695+0000","last_undegraded":"2024-09-12T01:38:08.820695+0000","last_fullsized":"2024-09-12T01:38:08.820695+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.820592+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.820592+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.820592+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:47.296176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'143","reported_seq":672,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.324625+0000","last_change":"2024-09-12T01:38:13.324625+0000","last_active":"2024-09-12T01:38:13.324625+0000","last_peered":"2024-09-12T01:38:13.324625+0000","last_clean":"2024-09-12T01:38:13.324625+0000","last_became_active":"2024-09-12T00:25:10.522822+0000","last_became_peered":"2024-09-12T00:25:10.522822+0000","last_unstale":"2024-09-12T01:38:13.324625+0000","last_undegraded":"2024-09-12T01:38:13.324625+0000","last_fullsized":"2024-09-12T01:38:13.324625+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'143","last_scrub_stamp":"2024-09-12T01:38:13.324526+0000","last_deep_scrub":"266'143","last_deep_scrub_stamp":"2024-09-12T01:38:13.324526+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.324526+0000","objects_scrubbed":4,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:12.809401+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":271,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":216,"num_read_kb":196,"num_write":350,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'484","reported_seq":2032,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.634426+0000","last_change":"2024-09-12T01:38:03.634426+0000","last_active":"2024-09-12T01:38:03.634426+0000","last_peered":"2024-09-12T01:38:03.634426+0000","last_clean":"2024-09-12T01:38:03.634426+0000","last_became_active":"2024-09-12T00:25:02.478850+0000","last_became_peered":"2024-09-12T00:25:02.478850+0000","last_unstale":"2024-09-12T01:38:03.634426+0000","last_undegraded":"2024-09-12T01:38:03.634426+0000","last_fullsized":"2024-09-12T01:38:03.634426+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'484","last_scrub_stamp":"2024-09-12T01:38:03.634343+0000","last_deep_scrub":"266'484","last_deep_scrub_stamp":"2024-09-12T01:38:03.634343+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.634343+0000","objects_scrubbed":2,"log_size":84,"log_dups_size":400,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:27:40.357076+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2482,"num_read_kb":2311,"num_write":575,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'203","reported_seq":871,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.039288+0000","last_change":"2024-09-12T01:37:59.039288+0000","last_active":"2024-09-12T01:37:59.039288+0000","last_peered":"2024-09-12T01:37:59.039288+0000","last_clean":"2024-09-12T01:37:59.039288+0000","last_became_active":"2024-09-12T00:25:00.475628+0000","last_became_peered":"2024-09-12T00:25:00.475628+0000","last_unstale":"2024-09-12T01:37:59.039288+0000","last_undegraded":"2024-09-12T01:37:59.039288+0000","last_fullsized":"2024-09-12T01:37:59.039288+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'203","last_scrub_stamp":"2024-09-12T01:37:59.039165+0000","last_deep_scrub":"266'203","last_deep_scrub_stamp":"2024-09-12T01:37:59.039165+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.039165+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:59.337559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":487,"num_read_kb":1110,"num_write":851,"num_write_kb":26405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,6],"acting":[3,2,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.359178+0000","last_change":"2024-09-12T01:38:05.359178+0000","last_active":"2024-09-12T01:38:05.359178+0000","last_peered":"2024-09-12T01:38:05.359178+0000","last_clean":"2024-09-12T01:38:05.359178+0000","last_became_active":"2024-09-12T00:25:04.483774+0000","last_became_peered":"2024-09-12T00:25:04.483774+0000","last_unstale":"2024-09-12T01:38:05.359178+0000","last_undegraded":"2024-09-12T01:38:05.359178+0000","last_fullsized":"2024-09-12T01:38:05.359178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:05.359093+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:05.359093+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.359093+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:49.765095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'150","reported_seq":734,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.403260+0000","last_change":"2024-09-12T01:38:12.403260+0000","last_active":"2024-09-12T01:38:12.403260+0000","last_peered":"2024-09-12T01:38:12.403260+0000","last_clean":"2024-09-12T01:38:12.403260+0000","last_became_active":"2024-09-12T00:25:06.500991+0000","last_became_peered":"2024-09-12T00:25:06.500991+0000","last_unstale":"2024-09-12T01:38:12.403260+0000","last_undegraded":"2024-09-12T01:38:12.403260+0000","last_fullsized":"2024-09-12T01:38:12.403260+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'150","last_scrub_stamp":"2024-09-12T01:38:12.403148+0000","last_deep_scrub":"266'150","last_deep_scrub_stamp":"2024-09-12T01:38:12.403148+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.403148+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:48.895619+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":175,"num_write":120,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'798","reported_seq":4875,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.825438+0000","last_change":"2024-09-12T01:38:23.825438+0000","last_active":"2024-09-12T01:38:23.825438+0000","last_peered":"2024-09-12T01:38:23.825438+0000","last_clean":"2024-09-12T01:38:23.825438+0000","last_became_active":"2024-09-12T00:25:08.514360+0000","last_became_peered":"2024-09-12T00:25:08.514360+0000","last_unstale":"2024-09-12T01:38:23.825438+0000","last_undegraded":"2024-09-12T01:38:23.825438+0000","last_fullsized":"2024-09-12T01:38:23.825438+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'798","last_scrub_stamp":"2024-09-12T01:38:23.825351+0000","last_deep_scrub":"266'798","last_deep_scrub_stamp":"2024-09-12T01:38:23.825351+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.825351+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:59.908771+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'204","reported_seq":1047,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.745394+0000","last_change":"2024-09-12T01:38:12.745394+0000","last_active":"2024-09-12T01:38:12.745394+0000","last_peered":"2024-09-12T01:38:12.745394+0000","last_clean":"2024-09-12T01:38:12.745394+0000","last_became_active":"2024-09-12T00:25:10.518861+0000","last_became_peered":"2024-09-12T00:25:10.518861+0000","last_unstale":"2024-09-12T01:38:12.745394+0000","last_undegraded":"2024-09-12T01:38:12.745394+0000","last_fullsized":"2024-09-12T01:38:12.745394+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'204","last_scrub_stamp":"2024-09-12T01:38:12.745294+0000","last_deep_scrub":"266'204","last_deep_scrub_stamp":"2024-09-12T01:38:12.745294+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.745294+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:23.575790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":607,"num_read_kb":600,"num_write":435,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'469","reported_seq":1997,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.640342+0000","last_change":"2024-09-12T01:38:04.640342+0000","last_active":"2024-09-12T01:38:04.640342+0000","last_peered":"2024-09-12T01:38:04.640342+0000","last_clean":"2024-09-12T01:38:04.640342+0000","last_became_active":"2024-09-12T00:25:02.477052+0000","last_became_peered":"2024-09-12T00:25:02.477052+0000","last_unstale":"2024-09-12T01:38:04.640342+0000","last_undegraded":"2024-09-12T01:38:04.640342+0000","last_fullsized":"2024-09-12T01:38:04.640342+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'469","last_scrub_stamp":"2024-09-12T01:38:04.640258+0000","last_deep_scrub":"266'469","last_deep_scrub_stamp":"2024-09-12T01:38:04.640258+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.640258+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:55:13.597150+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2388,"num_read_kb":2234,"num_write":549,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'224","reported_seq":877,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.855846+0000","last_change":"2024-09-12T01:37:47.855846+0000","last_active":"2024-09-12T01:37:47.855846+0000","last_peered":"2024-09-12T01:37:47.855846+0000","last_clean":"2024-09-12T01:37:47.855846+0000","last_became_active":"2024-09-12T00:25:00.457828+0000","last_became_peered":"2024-09-12T00:25:00.457828+0000","last_unstale":"2024-09-12T01:37:47.855846+0000","last_undegraded":"2024-09-12T01:37:47.855846+0000","last_fullsized":"2024-09-12T01:37:47.855846+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'224","last_scrub_stamp":"2024-09-12T01:37:47.855735+0000","last_deep_scrub":"266'224","last_deep_scrub_stamp":"2024-09-12T01:37:47.855735+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.855735+0000","objects_scrubbed":5,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:26:52.029177+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":459,"num_read_kb":9782,"num_write":1039,"num_write_kb":35060,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3,6],"acting":[1,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.933842+0000","last_change":"2024-09-12T01:38:13.933842+0000","last_active":"2024-09-12T01:38:13.933842+0000","last_peered":"2024-09-12T01:38:13.933842+0000","last_clean":"2024-09-12T01:38:13.933842+0000","last_became_active":"2024-09-12T00:25:04.482173+0000","last_became_peered":"2024-09-12T00:25:04.482173+0000","last_unstale":"2024-09-12T01:38:13.933842+0000","last_undegraded":"2024-09-12T01:38:13.933842+0000","last_fullsized":"2024-09-12T01:38:13.933842+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:13.933756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:13.933756+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.933756+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:45.433581+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'162","reported_seq":763,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.723613+0000","last_change":"2024-09-12T01:38:03.723613+0000","last_active":"2024-09-12T01:38:03.723613+0000","last_peered":"2024-09-12T01:38:03.723613+0000","last_clean":"2024-09-12T01:38:03.723613+0000","last_became_active":"2024-09-12T00:25:06.491337+0000","last_became_peered":"2024-09-12T00:25:06.491337+0000","last_unstale":"2024-09-12T01:38:03.723613+0000","last_undegraded":"2024-09-12T01:38:03.723613+0000","last_fullsized":"2024-09-12T01:38:03.723613+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'162","last_scrub_stamp":"2024-09-12T01:38:03.723515+0000","last_deep_scrub":"266'162","last_deep_scrub_stamp":"2024-09-12T01:38:03.723515+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.723515+0000","objects_scrubbed":5,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:22.002913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5611,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":207,"num_read_kb":280,"num_write":118,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'802","reported_seq":2777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.623540+0000","last_change":"2024-09-12T01:38:15.623540+0000","last_active":"2024-09-12T01:38:15.623540+0000","last_peered":"2024-09-12T01:38:15.623540+0000","last_clean":"2024-09-12T01:38:15.623540+0000","last_became_active":"2024-09-12T00:25:08.512125+0000","last_became_peered":"2024-09-12T00:25:08.512125+0000","last_unstale":"2024-09-12T01:38:15.623540+0000","last_undegraded":"2024-09-12T01:38:15.623540+0000","last_fullsized":"2024-09-12T01:38:15.623540+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'802","last_scrub_stamp":"2024-09-12T01:38:15.623462+0000","last_deep_scrub":"266'802","last_deep_scrub_stamp":"2024-09-12T01:38:15.623462+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.623462+0000","objects_scrubbed":1,"log_size":102,"log_dups_size":700,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:32:58.941127+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'2026","reported_seq":3655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.975531+0000","last_change":"2024-09-12T01:38:02.975474+0000","last_active":"2024-09-12T01:38:02.975531+0000","last_peered":"2024-09-12T01:38:02.975531+0000","last_clean":"2024-09-12T01:38:02.975531+0000","last_became_active":"2024-09-12T00:25:02.465239+0000","last_became_peered":"2024-09-12T00:25:02.465239+0000","last_unstale":"2024-09-12T01:38:02.975531+0000","last_undegraded":"2024-09-12T01:38:02.975531+0000","last_fullsized":"2024-09-12T01:38:02.975531+0000","mapping_epoch":28,"log_start":"266'2000","ondisk_log_start":"266'2000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2026","last_scrub_stamp":"2024-09-12T01:38:02.975389+0000","last_deep_scrub":"266'2026","last_deep_scrub_stamp":"2024-09-12T01:38:02.975389+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.975389+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":2000,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:35.114687+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8773,"num_read_kb":7539,"num_write":2902,"num_write_kb":1299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":707,"num_omap_keys":3,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'179","reported_seq":799,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.933037+0000","last_change":"2024-09-12T01:37:44.933037+0000","last_active":"2024-09-12T01:37:44.933037+0000","last_peered":"2024-09-12T01:37:44.933037+0000","last_clean":"2024-09-12T01:37:44.933037+0000","last_became_active":"2024-09-12T00:25:00.466899+0000","last_became_peered":"2024-09-12T00:25:00.466899+0000","last_unstale":"2024-09-12T01:37:44.933037+0000","last_undegraded":"2024-09-12T01:37:44.933037+0000","last_fullsized":"2024-09-12T01:37:44.933037+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'179","last_scrub_stamp":"2024-09-12T01:37:44.932938+0000","last_deep_scrub":"266'179","last_deep_scrub_stamp":"2024-09-12T01:37:44.932938+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.932938+0000","objects_scrubbed":3,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:07.942233+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133668,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":366,"num_read_kb":8806,"num_write":851,"num_write_kb":18983,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,7],"acting":[0,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.916283+0000","last_change":"2024-09-12T01:37:57.916231+0000","last_active":"2024-09-12T01:37:57.916283+0000","last_peered":"2024-09-12T01:37:57.916283+0000","last_clean":"2024-09-12T01:37:57.916283+0000","last_became_active":"2024-09-12T00:25:04.482885+0000","last_became_peered":"2024-09-12T00:25:04.482885+0000","last_unstale":"2024-09-12T01:37:57.916283+0000","last_undegraded":"2024-09-12T01:37:57.916283+0000","last_fullsized":"2024-09-12T01:37:57.916283+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:57.916140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:57.916140+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.916140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:21.912079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'273","reported_seq":935,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.883554+0000","last_change":"2024-09-12T01:38:03.883497+0000","last_active":"2024-09-12T01:38:03.883554+0000","last_peered":"2024-09-12T01:38:03.883554+0000","last_clean":"2024-09-12T01:38:03.883554+0000","last_became_active":"2024-09-12T00:25:06.497881+0000","last_became_peered":"2024-09-12T00:25:06.497881+0000","last_unstale":"2024-09-12T01:38:03.883554+0000","last_undegraded":"2024-09-12T01:38:03.883554+0000","last_fullsized":"2024-09-12T01:38:03.883554+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'273","last_scrub_stamp":"2024-09-12T01:38:03.883401+0000","last_deep_scrub":"266'273","last_deep_scrub_stamp":"2024-09-12T01:38:03.883401+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.883401+0000","objects_scrubbed":10,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:39:36.967915+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20748,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":371,"num_read_kb":470,"num_write":222,"num_write_kb":38,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.310704+0000","last_change":"2024-09-12T01:38:10.310704+0000","last_active":"2024-09-12T01:38:10.310704+0000","last_peered":"2024-09-12T01:38:10.310704+0000","last_clean":"2024-09-12T01:38:10.310704+0000","last_became_active":"2024-09-12T00:25:08.507993+0000","last_became_peered":"2024-09-12T00:25:08.507993+0000","last_unstale":"2024-09-12T01:38:10.310704+0000","last_undegraded":"2024-09-12T01:38:10.310704+0000","last_fullsized":"2024-09-12T01:38:10.310704+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.310587+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.310587+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.310587+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:38:52.686063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'577","reported_seq":1431,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.706235+0000","last_change":"2024-09-12T01:38:09.706235+0000","last_active":"2024-09-12T01:38:09.706235+0000","last_peered":"2024-09-12T01:38:09.706235+0000","last_clean":"2024-09-12T01:38:09.706235+0000","last_became_active":"2024-09-12T00:25:10.528021+0000","last_became_peered":"2024-09-12T00:25:10.528021+0000","last_unstale":"2024-09-12T01:38:09.706235+0000","last_undegraded":"2024-09-12T01:38:09.706235+0000","last_fullsized":"2024-09-12T01:38:09.706235+0000","mapping_epoch":36,"log_start":"266'500","ondisk_log_start":"266'500","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'577","last_scrub_stamp":"2024-09-12T01:38:09.706127+0000","last_deep_scrub":"266'577","last_deep_scrub_stamp":"2024-09-12T01:38:09.706127+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.706127+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":500,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:59:29.078031+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":869,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1390,"num_read_kb":1363,"num_write":1223,"num_write_kb":408,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'495","reported_seq":2165,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.901052+0000","last_change":"2024-09-12T01:37:49.900930+0000","last_active":"2024-09-12T01:37:49.901052+0000","last_peered":"2024-09-12T01:37:49.901052+0000","last_clean":"2024-09-12T01:37:49.901052+0000","last_became_active":"2024-09-12T00:25:02.467846+0000","last_became_peered":"2024-09-12T00:25:02.467846+0000","last_unstale":"2024-09-12T01:37:49.901052+0000","last_undegraded":"2024-09-12T01:37:49.901052+0000","last_fullsized":"2024-09-12T01:37:49.901052+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'495","last_scrub_stamp":"2024-09-12T01:37:49.900834+0000","last_deep_scrub":"266'495","last_deep_scrub_stamp":"2024-09-12T01:37:49.900834+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.900834+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":400,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:58.878364+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2600,"num_read_kb":2447,"num_write":570,"num_write_kb":132,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'208","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.530686+0000","last_change":"2024-09-12T01:37:44.530686+0000","last_active":"2024-09-12T01:37:44.530686+0000","last_peered":"2024-09-12T01:37:44.530686+0000","last_clean":"2024-09-12T01:37:44.530686+0000","last_became_active":"2024-09-12T00:25:00.486471+0000","last_became_peered":"2024-09-12T00:25:00.486471+0000","last_unstale":"2024-09-12T01:37:44.530686+0000","last_undegraded":"2024-09-12T01:37:44.530686+0000","last_fullsized":"2024-09-12T01:37:44.530686+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:37:44.530555+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:37:44.530555+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.530555+0000","objects_scrubbed":6,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:48:59.391104+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4706427,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":458,"num_read_kb":18784,"num_write":969,"num_write_kb":38470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5,3],"acting":[2,0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.372296+0000","last_change":"2024-09-12T01:38:00.372242+0000","last_active":"2024-09-12T01:38:00.372296+0000","last_peered":"2024-09-12T01:38:00.372296+0000","last_clean":"2024-09-12T01:38:00.372296+0000","last_became_active":"2024-09-12T00:25:04.480469+0000","last_became_peered":"2024-09-12T00:25:04.480469+0000","last_unstale":"2024-09-12T01:38:00.372296+0000","last_undegraded":"2024-09-12T01:38:00.372296+0000","last_fullsized":"2024-09-12T01:38:00.372296+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.372086+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.372086+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.372086+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:06:46.172826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'153","reported_seq":761,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.421598+0000","last_change":"2024-09-12T01:38:10.421598+0000","last_active":"2024-09-12T01:38:10.421598+0000","last_peered":"2024-09-12T01:38:10.421598+0000","last_clean":"2024-09-12T01:38:10.421598+0000","last_became_active":"2024-09-12T00:25:06.500036+0000","last_became_peered":"2024-09-12T00:25:06.500036+0000","last_unstale":"2024-09-12T01:38:10.421598+0000","last_undegraded":"2024-09-12T01:38:10.421598+0000","last_fullsized":"2024-09-12T01:38:10.421598+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'153","last_scrub_stamp":"2024-09-12T01:38:10.421495+0000","last_deep_scrub":"266'153","last_deep_scrub_stamp":"2024-09-12T01:38:10.421495+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.421495+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:01.772925+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11217,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":192,"num_read_kb":248,"num_write":100,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.346866+0000","last_change":"2024-09-12T01:38:17.346786+0000","last_active":"2024-09-12T01:38:17.346866+0000","last_peered":"2024-09-12T01:38:17.346866+0000","last_clean":"2024-09-12T01:38:17.346866+0000","last_became_active":"2024-09-12T00:25:08.509780+0000","last_became_peered":"2024-09-12T00:25:08.509780+0000","last_unstale":"2024-09-12T01:38:17.346866+0000","last_undegraded":"2024-09-12T01:38:17.346866+0000","last_fullsized":"2024-09-12T01:38:17.346866+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:17.346660+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:17.346660+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.346660+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:08.883336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'146","reported_seq":660,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.775739+0000","last_change":"2024-09-12T01:38:10.775680+0000","last_active":"2024-09-12T01:38:10.775739+0000","last_peered":"2024-09-12T01:38:10.775739+0000","last_clean":"2024-09-12T01:38:10.775739+0000","last_became_active":"2024-09-12T00:25:10.527984+0000","last_became_peered":"2024-09-12T00:25:10.527984+0000","last_unstale":"2024-09-12T01:38:10.775739+0000","last_undegraded":"2024-09-12T01:38:10.775739+0000","last_fullsized":"2024-09-12T01:38:10.775739+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'146","last_scrub_stamp":"2024-09-12T01:38:10.775577+0000","last_deep_scrub":"266'146","last_deep_scrub_stamp":"2024-09-12T01:38:10.775577+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.775577+0000","objects_scrubbed":2,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:53.577692+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":849,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":129,"num_read_kb":124,"num_write":356,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'456","reported_seq":2028,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.745935+0000","last_change":"2024-09-12T01:37:53.745822+0000","last_active":"2024-09-12T01:37:53.745935+0000","last_peered":"2024-09-12T01:37:53.745935+0000","last_clean":"2024-09-12T01:37:53.745935+0000","last_became_active":"2024-09-12T00:25:02.469155+0000","last_became_peered":"2024-09-12T00:25:02.469155+0000","last_unstale":"2024-09-12T01:37:53.745935+0000","last_undegraded":"2024-09-12T01:37:53.745935+0000","last_fullsized":"2024-09-12T01:37:53.745935+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T01:37:53.745726+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T01:37:53.745726+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.745726+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:07.128486+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2613,"num_read_kb":2451,"num_write":541,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2546,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'226","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.078785+0000","last_change":"2024-09-12T01:37:52.078785+0000","last_active":"2024-09-12T01:37:52.078785+0000","last_peered":"2024-09-12T01:37:52.078785+0000","last_clean":"2024-09-12T01:37:52.078785+0000","last_became_active":"2024-09-12T00:25:32.563811+0000","last_became_peered":"2024-09-12T00:25:32.563811+0000","last_unstale":"2024-09-12T01:37:52.078785+0000","last_undegraded":"2024-09-12T01:37:52.078785+0000","last_fullsized":"2024-09-12T01:37:52.078785+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:37:52.078628+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:37:52.078628+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.078628+0000","objects_scrubbed":4,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:51:10.725907+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":442172,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":15150,"num_write":1090,"num_write_kb":21884,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.666498+0000","last_change":"2024-09-12T01:38:08.666498+0000","last_active":"2024-09-12T01:38:08.666498+0000","last_peered":"2024-09-12T01:38:08.666498+0000","last_clean":"2024-09-12T01:38:08.666498+0000","last_became_active":"2024-09-12T00:25:04.484029+0000","last_became_peered":"2024-09-12T00:25:04.484029+0000","last_unstale":"2024-09-12T01:38:08.666498+0000","last_undegraded":"2024-09-12T01:38:08.666498+0000","last_fullsized":"2024-09-12T01:38:08.666498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.666375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.666375+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.666375+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:44:47.538392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'226","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.956418+0000","last_change":"2024-09-12T01:38:19.956358+0000","last_active":"2024-09-12T01:38:19.956418+0000","last_peered":"2024-09-12T01:38:19.956418+0000","last_clean":"2024-09-12T01:38:19.956418+0000","last_became_active":"2024-09-12T00:25:06.496348+0000","last_became_peered":"2024-09-12T00:25:06.496348+0000","last_unstale":"2024-09-12T01:38:19.956418+0000","last_undegraded":"2024-09-12T01:38:19.956418+0000","last_fullsized":"2024-09-12T01:38:19.956418+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:38:19.956252+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:38:19.956252+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.956252+0000","objects_scrubbed":9,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:51.627975+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22554,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":293,"num_read_kb":420,"num_write":176,"num_write_kb":49,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'801","reported_seq":4598,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.604017+0000","last_change":"2024-09-12T01:38:14.603922+0000","last_active":"2024-09-12T01:38:14.604017+0000","last_peered":"2024-09-12T01:38:14.604017+0000","last_clean":"2024-09-12T01:38:14.604017+0000","last_became_active":"2024-09-12T00:25:08.512086+0000","last_became_peered":"2024-09-12T00:25:08.512086+0000","last_unstale":"2024-09-12T01:38:14.604017+0000","last_undegraded":"2024-09-12T01:38:14.604017+0000","last_fullsized":"2024-09-12T01:38:14.604017+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T01:38:14.603818+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T01:38:14.603818+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.603818+0000","objects_scrubbed":1,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:14.911689+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'132","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.309614+0000","last_change":"2024-09-12T01:38:12.309541+0000","last_active":"2024-09-12T01:38:12.309614+0000","last_peered":"2024-09-12T01:38:12.309614+0000","last_clean":"2024-09-12T01:38:12.309614+0000","last_became_active":"2024-09-12T00:25:10.521322+0000","last_became_peered":"2024-09-12T00:25:10.521322+0000","last_unstale":"2024-09-12T01:38:12.309614+0000","last_undegraded":"2024-09-12T01:38:12.309614+0000","last_fullsized":"2024-09-12T01:38:12.309614+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'132","last_scrub_stamp":"2024-09-12T01:38:12.309452+0000","last_deep_scrub":"266'132","last_deep_scrub_stamp":"2024-09-12T01:38:12.309452+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.309452+0000","objects_scrubbed":2,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:02.874478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":421,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":110,"num_read_kb":104,"num_write":292,"num_write_kb":71,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'397","reported_seq":1849,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.583073+0000","last_change":"2024-09-12T01:38:00.583073+0000","last_active":"2024-09-12T01:38:00.583073+0000","last_peered":"2024-09-12T01:38:00.583073+0000","last_clean":"2024-09-12T01:38:00.583073+0000","last_became_active":"2024-09-12T00:25:02.468609+0000","last_became_peered":"2024-09-12T00:25:02.468609+0000","last_unstale":"2024-09-12T01:38:00.583073+0000","last_undegraded":"2024-09-12T01:38:00.583073+0000","last_fullsized":"2024-09-12T01:38:00.583073+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'397","last_scrub_stamp":"2024-09-12T01:38:00.582971+0000","last_deep_scrub":"266'397","last_deep_scrub_stamp":"2024-09-12T01:38:00.582971+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.582971+0000","objects_scrubbed":8,"log_size":97,"log_dups_size":300,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:02.412743+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":2038,"num_read_kb":1930,"num_write":430,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'219","reported_seq":978,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.965862+0000","last_change":"2024-09-12T01:37:43.965862+0000","last_active":"2024-09-12T01:37:43.965862+0000","last_peered":"2024-09-12T01:37:43.965862+0000","last_clean":"2024-09-12T01:37:43.965862+0000","last_became_active":"2024-09-12T00:25:00.472065+0000","last_became_peered":"2024-09-12T00:25:00.472065+0000","last_unstale":"2024-09-12T01:37:43.965862+0000","last_undegraded":"2024-09-12T01:37:43.965862+0000","last_fullsized":"2024-09-12T01:37:43.965862+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'219","last_scrub_stamp":"2024-09-12T01:37:43.965697+0000","last_deep_scrub":"266'219","last_deep_scrub_stamp":"2024-09-12T01:37:43.965697+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.965697+0000","objects_scrubbed":6,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:29.632688+0000","scrub_duration":8,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9573531,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":1000,"num_read_kb":31471,"num_write":994,"num_write_kb":39869,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"266'5","reported_seq":987,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.364476+0000","last_change":"2024-09-12T01:38:01.364416+0000","last_active":"2024-09-12T01:38:01.364476+0000","last_peered":"2024-09-12T01:38:01.364476+0000","last_clean":"2024-09-12T01:38:01.364476+0000","last_became_active":"2024-09-12T00:25:04.482518+0000","last_became_peered":"2024-09-12T00:25:04.482518+0000","last_unstale":"2024-09-12T01:38:01.364476+0000","last_undegraded":"2024-09-12T01:38:01.364476+0000","last_fullsized":"2024-09-12T01:38:01.364476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T01:38:01.364313+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T01:38:01.364313+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.364313+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:47.761280+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'231","reported_seq":908,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.417390+0000","last_change":"2024-09-12T01:38:09.417330+0000","last_active":"2024-09-12T01:38:09.417390+0000","last_peered":"2024-09-12T01:38:09.417390+0000","last_clean":"2024-09-12T01:38:09.417390+0000","last_became_active":"2024-09-12T00:25:06.497269+0000","last_became_peered":"2024-09-12T00:25:06.497269+0000","last_unstale":"2024-09-12T01:38:09.417390+0000","last_undegraded":"2024-09-12T01:38:09.417390+0000","last_fullsized":"2024-09-12T01:38:09.417390+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'231","last_scrub_stamp":"2024-09-12T01:38:09.417231+0000","last_deep_scrub":"266'231","last_deep_scrub_stamp":"2024-09-12T01:38:09.417231+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.417231+0000","objects_scrubbed":7,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:57:22.167254+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14775,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":319,"num_read_kb":439,"num_write":162,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.587232+0000","last_change":"2024-09-12T01:38:13.587151+0000","last_active":"2024-09-12T01:38:13.587232+0000","last_peered":"2024-09-12T01:38:13.587232+0000","last_clean":"2024-09-12T01:38:13.587232+0000","last_became_active":"2024-09-12T00:25:08.513758+0000","last_became_peered":"2024-09-12T00:25:08.513758+0000","last_unstale":"2024-09-12T01:38:13.587232+0000","last_undegraded":"2024-09-12T01:38:13.587232+0000","last_fullsized":"2024-09-12T01:38:13.587232+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:13.587070+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:13.587070+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.587070+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:46.236900+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'133","reported_seq":676,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.598770+0000","last_change":"2024-09-12T01:38:10.598660+0000","last_active":"2024-09-12T01:38:10.598770+0000","last_peered":"2024-09-12T01:38:10.598770+0000","last_clean":"2024-09-12T01:38:10.598770+0000","last_became_active":"2024-09-12T00:25:10.524500+0000","last_became_peered":"2024-09-12T00:25:10.524500+0000","last_unstale":"2024-09-12T01:38:10.598770+0000","last_undegraded":"2024-09-12T01:38:10.598770+0000","last_fullsized":"2024-09-12T01:38:10.598770+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'133","last_scrub_stamp":"2024-09-12T01:38:10.598557+0000","last_deep_scrub":"266'133","last_deep_scrub_stamp":"2024-09-12T01:38:10.598557+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.598557+0000","objects_scrubbed":2,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:03:16.839450+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":493,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":224,"num_read_kb":199,"num_write":306,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'395","reported_seq":2036,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.771482+0000","last_change":"2024-09-12T01:37:57.771482+0000","last_active":"2024-09-12T01:37:57.771482+0000","last_peered":"2024-09-12T01:37:57.771482+0000","last_clean":"2024-09-12T01:37:57.771482+0000","last_became_active":"2024-09-12T00:25:02.476549+0000","last_became_peered":"2024-09-12T00:25:02.476549+0000","last_unstale":"2024-09-12T01:37:57.771482+0000","last_undegraded":"2024-09-12T01:37:57.771482+0000","last_fullsized":"2024-09-12T01:37:57.771482+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'395","last_scrub_stamp":"2024-09-12T01:37:57.771387+0000","last_deep_scrub":"266'395","last_deep_scrub_stamp":"2024-09-12T01:37:57.771387+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.771387+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":300,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:48.184452+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2368,"num_read_kb":2274,"num_write":449,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2987,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'195","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.440332+0000","last_change":"2024-09-12T01:37:48.440332+0000","last_active":"2024-09-12T01:37:48.440332+0000","last_peered":"2024-09-12T01:37:48.440332+0000","last_clean":"2024-09-12T01:37:48.440332+0000","last_became_active":"2024-09-12T00:25:00.471314+0000","last_became_peered":"2024-09-12T00:25:00.471314+0000","last_unstale":"2024-09-12T01:37:48.440332+0000","last_undegraded":"2024-09-12T01:37:48.440332+0000","last_fullsized":"2024-09-12T01:37:48.440332+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'195","last_scrub_stamp":"2024-09-12T01:37:48.440227+0000","last_deep_scrub":"266'195","last_deep_scrub_stamp":"2024-09-12T01:37:48.440227+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.440227+0000","objects_scrubbed":5,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:08.826724+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190278,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":438,"num_read_kb":11373,"num_write":891,"num_write_kb":19982,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0,4],"acting":[7,6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.455784+0000","last_change":"2024-09-12T01:37:59.455784+0000","last_active":"2024-09-12T01:37:59.455784+0000","last_peered":"2024-09-12T01:37:59.455784+0000","last_clean":"2024-09-12T01:37:59.455784+0000","last_became_active":"2024-09-12T00:25:04.486111+0000","last_became_peered":"2024-09-12T00:25:04.486111+0000","last_unstale":"2024-09-12T01:37:59.455784+0000","last_undegraded":"2024-09-12T01:37:59.455784+0000","last_fullsized":"2024-09-12T01:37:59.455784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:59.455680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:59.455680+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.455680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:07.373369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'208","reported_seq":820,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.785612+0000","last_change":"2024-09-12T01:38:02.785612+0000","last_active":"2024-09-12T01:38:02.785612+0000","last_peered":"2024-09-12T01:38:02.785612+0000","last_clean":"2024-09-12T01:38:02.785612+0000","last_became_active":"2024-09-12T00:25:06.497247+0000","last_became_peered":"2024-09-12T00:25:06.497247+0000","last_unstale":"2024-09-12T01:38:02.785612+0000","last_undegraded":"2024-09-12T01:38:02.785612+0000","last_fullsized":"2024-09-12T01:38:02.785612+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:38:02.785506+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:38:02.785506+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.785506+0000","objects_scrubbed":7,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:48.928001+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12109,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":269,"num_read_kb":347,"num_write":208,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.405837+0000","last_change":"2024-09-12T01:38:04.405837+0000","last_active":"2024-09-12T01:38:04.405837+0000","last_peered":"2024-09-12T01:38:04.405837+0000","last_clean":"2024-09-12T01:38:04.405837+0000","last_became_active":"2024-09-12T00:25:08.516949+0000","last_became_peered":"2024-09-12T00:25:08.516949+0000","last_unstale":"2024-09-12T01:38:04.405837+0000","last_undegraded":"2024-09-12T01:38:04.405837+0000","last_fullsized":"2024-09-12T01:38:04.405837+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:04.405722+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:04.405722+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.405722+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:04.855375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'128","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.696334+0000","last_change":"2024-09-12T01:38:18.696334+0000","last_active":"2024-09-12T01:38:18.696334+0000","last_peered":"2024-09-12T01:38:18.696334+0000","last_clean":"2024-09-12T01:38:18.696334+0000","last_became_active":"2024-09-12T00:25:10.530731+0000","last_became_peered":"2024-09-12T00:25:10.530731+0000","last_unstale":"2024-09-12T01:38:18.696334+0000","last_undegraded":"2024-09-12T01:38:18.696334+0000","last_fullsized":"2024-09-12T01:38:18.696334+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'128","last_scrub_stamp":"2024-09-12T01:38:18.696231+0000","last_deep_scrub":"266'128","last_deep_scrub_stamp":"2024-09-12T01:38:18.696231+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.696231+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:55.932641+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":892,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":136,"num_read_kb":124,"num_write":317,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'668","reported_seq":2312,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.971255+0000","last_change":"2024-09-12T01:38:03.971255+0000","last_active":"2024-09-12T01:38:03.971255+0000","last_peered":"2024-09-12T01:38:03.971255+0000","last_clean":"2024-09-12T01:38:03.971255+0000","last_became_active":"2024-09-12T00:25:02.474113+0000","last_became_peered":"2024-09-12T00:25:02.474113+0000","last_unstale":"2024-09-12T01:38:03.971255+0000","last_undegraded":"2024-09-12T01:38:03.971255+0000","last_fullsized":"2024-09-12T01:38:03.971255+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'668","last_scrub_stamp":"2024-09-12T01:38:03.971165+0000","last_deep_scrub":"266'668","last_deep_scrub_stamp":"2024-09-12T01:38:03.971165+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.971165+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":600,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:26.531769+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3250,"num_read_kb":2990,"num_write":879,"num_write_kb":281,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'185","reported_seq":906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.072064+0000","last_change":"2024-09-12T01:37:50.071985+0000","last_active":"2024-09-12T01:37:50.072064+0000","last_peered":"2024-09-12T01:37:50.072064+0000","last_clean":"2024-09-12T01:37:50.072064+0000","last_became_active":"2024-09-12T00:25:32.562005+0000","last_became_peered":"2024-09-12T00:25:32.562005+0000","last_unstale":"2024-09-12T01:37:50.072064+0000","last_undegraded":"2024-09-12T01:37:50.072064+0000","last_fullsized":"2024-09-12T01:37:50.072064+0000","mapping_epoch":39,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:50.071880+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:50.071880+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.071880+0000","objects_scrubbed":2,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:27.878944+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568762,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":643,"num_read_kb":135425,"num_write":898,"num_write_kb":30438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.654606+0000","last_change":"2024-09-12T01:38:09.654606+0000","last_active":"2024-09-12T01:38:09.654606+0000","last_peered":"2024-09-12T01:38:09.654606+0000","last_clean":"2024-09-12T01:38:09.654606+0000","last_became_active":"2024-09-12T00:25:04.482744+0000","last_became_peered":"2024-09-12T00:25:04.482744+0000","last_unstale":"2024-09-12T01:38:09.654606+0000","last_undegraded":"2024-09-12T01:38:09.654606+0000","last_fullsized":"2024-09-12T01:38:09.654606+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:09.654507+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:09.654507+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.654507+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:59:26.656064+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'199","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.620669+0000","last_change":"2024-09-12T01:38:10.620669+0000","last_active":"2024-09-12T01:38:10.620669+0000","last_peered":"2024-09-12T01:38:10.620669+0000","last_clean":"2024-09-12T01:38:10.620669+0000","last_became_active":"2024-09-12T00:25:06.497448+0000","last_became_peered":"2024-09-12T00:25:06.497448+0000","last_unstale":"2024-09-12T01:38:10.620669+0000","last_undegraded":"2024-09-12T01:38:10.620669+0000","last_fullsized":"2024-09-12T01:38:10.620669+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'199","last_scrub_stamp":"2024-09-12T01:38:10.620543+0000","last_deep_scrub":"266'199","last_deep_scrub_stamp":"2024-09-12T01:38:10.620543+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.620543+0000","objects_scrubbed":7,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:40.059609+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":247,"num_read_kb":253,"num_write":136,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'764","reported_seq":2729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.490499+0000","last_change":"2024-09-12T01:38:07.490499+0000","last_active":"2024-09-12T01:38:07.490499+0000","last_peered":"2024-09-12T01:38:07.490499+0000","last_clean":"2024-09-12T01:38:07.490499+0000","last_became_active":"2024-09-12T00:25:08.510134+0000","last_became_peered":"2024-09-12T00:25:08.510134+0000","last_unstale":"2024-09-12T01:38:07.490499+0000","last_undegraded":"2024-09-12T01:38:07.490499+0000","last_fullsized":"2024-09-12T01:38:07.490499+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'764","last_scrub_stamp":"2024-09-12T01:38:07.490413+0000","last_deep_scrub":"266'764","last_deep_scrub_stamp":"2024-09-12T01:38:07.490413+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.490413+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":700,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:12.012845+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'129","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.289694+0000","last_change":"2024-09-12T01:38:11.289694+0000","last_active":"2024-09-12T01:38:11.289694+0000","last_peered":"2024-09-12T01:38:11.289694+0000","last_clean":"2024-09-12T01:38:11.289694+0000","last_became_active":"2024-09-12T00:25:10.521992+0000","last_became_peered":"2024-09-12T00:25:10.521992+0000","last_unstale":"2024-09-12T01:38:11.289694+0000","last_undegraded":"2024-09-12T01:38:11.289694+0000","last_fullsized":"2024-09-12T01:38:11.289694+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'129","last_scrub_stamp":"2024-09-12T01:38:11.289614+0000","last_deep_scrub":"266'129","last_deep_scrub_stamp":"2024-09-12T01:38:11.289614+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.289614+0000","objects_scrubbed":4,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:02.917202+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1428,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":127,"num_read_kb":122,"num_write":300,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1939,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.708159+0000","last_change":"2024-09-12T01:37:52.708159+0000","last_active":"2024-09-12T01:37:52.708159+0000","last_peered":"2024-09-12T01:37:52.708159+0000","last_clean":"2024-09-12T01:37:52.708159+0000","last_became_active":"2024-09-12T00:25:02.468401+0000","last_became_peered":"2024-09-12T00:25:02.468401+0000","last_unstale":"2024-09-12T01:37:52.708159+0000","last_undegraded":"2024-09-12T01:37:52.708159+0000","last_fullsized":"2024-09-12T01:37:52.708159+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T01:37:52.708072+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T01:37:52.708072+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.708072+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:38:38.220170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2162,"num_read_kb":2053,"num_write":481,"num_write_kb":94,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'266","reported_seq":945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.032571+0000","last_change":"2024-09-12T01:37:57.032506+0000","last_active":"2024-09-12T01:37:57.032571+0000","last_peered":"2024-09-12T01:37:57.032571+0000","last_clean":"2024-09-12T01:37:57.032571+0000","last_became_active":"2024-09-12T00:25:00.474471+0000","last_became_peered":"2024-09-12T00:25:00.474471+0000","last_unstale":"2024-09-12T01:37:57.032571+0000","last_undegraded":"2024-09-12T01:37:57.032571+0000","last_fullsized":"2024-09-12T01:37:57.032571+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'266","last_scrub_stamp":"2024-09-12T01:37:57.032348+0000","last_deep_scrub":"266'266","last_deep_scrub_stamp":"2024-09-12T01:37:57.032348+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.032348+0000","objects_scrubbed":6,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:22:38.613541+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2612534,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":560,"num_read_kb":17654,"num_write":1154,"num_write_kb":37946,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,1],"acting":[3,4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"266'4","reported_seq":1463,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.871477+0000","last_change":"2024-09-12T01:37:58.871477+0000","last_active":"2024-09-12T01:37:58.871477+0000","last_peered":"2024-09-12T01:37:58.871477+0000","last_clean":"2024-09-12T01:37:58.871477+0000","last_became_active":"2024-09-12T00:25:04.482824+0000","last_became_peered":"2024-09-12T00:25:04.482824+0000","last_unstale":"2024-09-12T01:37:58.871477+0000","last_undegraded":"2024-09-12T01:37:58.871477+0000","last_fullsized":"2024-09-12T01:37:58.871477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:37:58.871389+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:37:58.871389+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.871389+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:23:22.816712+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":942,"num_read_kb":942,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'108","reported_seq":654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.360718+0000","last_change":"2024-09-12T01:38:04.360718+0000","last_active":"2024-09-12T01:38:04.360718+0000","last_peered":"2024-09-12T01:38:04.360718+0000","last_clean":"2024-09-12T01:38:04.360718+0000","last_became_active":"2024-09-12T00:25:06.499937+0000","last_became_peered":"2024-09-12T00:25:06.499937+0000","last_unstale":"2024-09-12T01:38:04.360718+0000","last_undegraded":"2024-09-12T01:38:04.360718+0000","last_fullsized":"2024-09-12T01:38:04.360718+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'108","last_scrub_stamp":"2024-09-12T01:38:04.360634+0000","last_deep_scrub":"266'108","last_deep_scrub_stamp":"2024-09-12T01:38:04.360634+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.360634+0000","objects_scrubbed":5,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:51.903468+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":124,"num_read_kb":117,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'774","reported_seq":2640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.819477+0000","last_change":"2024-09-12T01:38:05.819477+0000","last_active":"2024-09-12T01:38:05.819477+0000","last_peered":"2024-09-12T01:38:05.819477+0000","last_clean":"2024-09-12T01:38:05.819477+0000","last_became_active":"2024-09-12T00:25:08.501192+0000","last_became_peered":"2024-09-12T00:25:08.501192+0000","last_unstale":"2024-09-12T01:38:05.819477+0000","last_undegraded":"2024-09-12T01:38:05.819477+0000","last_fullsized":"2024-09-12T01:38:05.819477+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'774","last_scrub_stamp":"2024-09-12T01:38:05.819387+0000","last_deep_scrub":"266'774","last_deep_scrub_stamp":"2024-09-12T01:38:05.819387+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.819387+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:02:39.786391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'108","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.742781+0000","last_change":"2024-09-12T01:38:08.742781+0000","last_active":"2024-09-12T01:38:08.742781+0000","last_peered":"2024-09-12T01:38:08.742781+0000","last_clean":"2024-09-12T01:38:08.742781+0000","last_became_active":"2024-09-12T00:25:10.524610+0000","last_became_peered":"2024-09-12T00:25:10.524610+0000","last_unstale":"2024-09-12T01:38:08.742781+0000","last_undegraded":"2024-09-12T01:38:08.742781+0000","last_fullsized":"2024-09-12T01:38:08.742781+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'108","last_scrub_stamp":"2024-09-12T01:38:08.742692+0000","last_deep_scrub":"266'108","last_deep_scrub_stamp":"2024-09-12T01:38:08.742692+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.742692+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:44.228250+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":620,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":86,"num_read_kb":82,"num_write":231,"num_write_kb":54,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'791","reported_seq":2446,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.447463+0000","last_change":"2024-09-12T01:37:50.447463+0000","last_active":"2024-09-12T01:37:50.447463+0000","last_peered":"2024-09-12T01:37:50.447463+0000","last_clean":"2024-09-12T01:37:50.447463+0000","last_became_active":"2024-09-12T00:25:02.478793+0000","last_became_peered":"2024-09-12T00:25:02.478793+0000","last_unstale":"2024-09-12T01:37:50.447463+0000","last_undegraded":"2024-09-12T01:37:50.447463+0000","last_fullsized":"2024-09-12T01:37:50.447463+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'791","last_scrub_stamp":"2024-09-12T01:37:50.447358+0000","last_deep_scrub":"266'791","last_deep_scrub_stamp":"2024-09-12T01:37:50.447358+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.447358+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:11:46.059048+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4006,"num_read_kb":3638,"num_write":1039,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2042,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'228","reported_seq":954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.371610+0000","last_change":"2024-09-12T01:37:49.371550+0000","last_active":"2024-09-12T01:37:49.371610+0000","last_peered":"2024-09-12T01:37:49.371610+0000","last_clean":"2024-09-12T01:37:49.371610+0000","last_became_active":"2024-09-12T00:25:32.561102+0000","last_became_peered":"2024-09-12T00:25:32.561102+0000","last_unstale":"2024-09-12T01:37:49.371610+0000","last_undegraded":"2024-09-12T01:37:49.371610+0000","last_fullsized":"2024-09-12T01:37:49.371610+0000","mapping_epoch":39,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":40,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'228","last_scrub_stamp":"2024-09-12T01:37:49.371405+0000","last_deep_scrub":"266'228","last_deep_scrub_stamp":"2024-09-12T01:37:49.371405+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.371405+0000","objects_scrubbed":4,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:27.224790+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":554,"num_read_kb":71561,"num_write":1047,"num_write_kb":46306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6,0],"acting":[4,7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.948026+0000","last_change":"2024-09-12T01:38:11.948026+0000","last_active":"2024-09-12T01:38:11.948026+0000","last_peered":"2024-09-12T01:38:11.948026+0000","last_clean":"2024-09-12T01:38:11.948026+0000","last_became_active":"2024-09-12T00:25:04.484543+0000","last_became_peered":"2024-09-12T00:25:04.484543+0000","last_unstale":"2024-09-12T01:38:11.948026+0000","last_undegraded":"2024-09-12T01:38:11.948026+0000","last_fullsized":"2024-09-12T01:38:11.948026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:11.947905+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:11.947905+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.947905+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:14.132174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'313","reported_seq":959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.822832+0000","last_change":"2024-09-12T01:38:01.822832+0000","last_active":"2024-09-12T01:38:01.822832+0000","last_peered":"2024-09-12T01:38:01.822832+0000","last_clean":"2024-09-12T01:38:01.822832+0000","last_became_active":"2024-09-12T00:25:06.496949+0000","last_became_peered":"2024-09-12T00:25:06.496949+0000","last_unstale":"2024-09-12T01:38:01.822832+0000","last_undegraded":"2024-09-12T01:38:01.822832+0000","last_fullsized":"2024-09-12T01:38:01.822832+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'313","last_scrub_stamp":"2024-09-12T01:38:01.822725+0000","last_deep_scrub":"266'313","last_deep_scrub_stamp":"2024-09-12T01:38:01.822725+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.822725+0000","objects_scrubbed":9,"log_size":13,"log_dups_size":300,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:05:53.190581+0000","scrub_duration":10,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9140,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":1014,"num_read_kb":1082,"num_write":1556,"num_write_kb":1379,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487892,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.684493+0000","last_change":"2024-09-12T01:38:05.684493+0000","last_active":"2024-09-12T01:38:05.684493+0000","last_peered":"2024-09-12T01:38:05.684493+0000","last_clean":"2024-09-12T01:38:05.684493+0000","last_became_active":"2024-09-12T00:25:08.511103+0000","last_became_peered":"2024-09-12T00:25:08.511103+0000","last_unstale":"2024-09-12T01:38:05.684493+0000","last_undegraded":"2024-09-12T01:38:05.684493+0000","last_fullsized":"2024-09-12T01:38:05.684493+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:05.684405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:05.684405+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.684405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:26.132586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'158","reported_seq":671,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.562464+0000","last_change":"2024-09-12T01:38:09.562402+0000","last_active":"2024-09-12T01:38:09.562464+0000","last_peered":"2024-09-12T01:38:09.562464+0000","last_clean":"2024-09-12T01:38:09.562464+0000","last_became_active":"2024-09-12T00:25:10.524399+0000","last_became_peered":"2024-09-12T00:25:10.524399+0000","last_unstale":"2024-09-12T01:38:09.562464+0000","last_undegraded":"2024-09-12T01:38:09.562464+0000","last_fullsized":"2024-09-12T01:38:09.562464+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'158","last_scrub_stamp":"2024-09-12T01:38:09.562318+0000","last_deep_scrub":"266'158","last_deep_scrub_stamp":"2024-09-12T01:38:09.562318+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.562318+0000","objects_scrubbed":3,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:43.334096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":160,"num_read_kb":152,"num_write":348,"num_write_kb":88,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'526","reported_seq":2120,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.008055+0000","last_change":"2024-09-12T01:38:02.007992+0000","last_active":"2024-09-12T01:38:02.008055+0000","last_peered":"2024-09-12T01:38:02.008055+0000","last_clean":"2024-09-12T01:38:02.008055+0000","last_became_active":"2024-09-12T00:25:02.470508+0000","last_became_peered":"2024-09-12T00:25:02.470508+0000","last_unstale":"2024-09-12T01:38:02.008055+0000","last_undegraded":"2024-09-12T01:38:02.008055+0000","last_fullsized":"2024-09-12T01:38:02.008055+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'526","last_scrub_stamp":"2024-09-12T01:38:02.007907+0000","last_deep_scrub":"266'526","last_deep_scrub_stamp":"2024-09-12T01:38:02.007907+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.007907+0000","objects_scrubbed":1,"log_size":26,"log_dups_size":500,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:07.439245+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2852,"num_read_kb":2640,"num_write":653,"num_write_kb":195,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:43.840509+0000","last_change":"2024-09-12T01:37:43.840458+0000","last_active":"2024-09-12T01:37:43.840509+0000","last_peered":"2024-09-12T01:37:43.840509+0000","last_clean":"2024-09-12T01:37:43.840509+0000","last_became_active":"2024-09-12T00:24:40.255060+0000","last_became_peered":"2024-09-12T00:24:40.255060+0000","last_unstale":"2024-09-12T01:37:43.840509+0000","last_undegraded":"2024-09-12T01:37:43.840509+0000","last_fullsized":"2024-09-12T01:37:43.840509+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T01:37:43.840360+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T01:37:43.840360+0000","last_clean_scrub_stamp":"2024-09-12T01:37:43.840360+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:24.816378+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":545,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.023075+0000","last_change":"2024-09-12T01:37:47.023075+0000","last_active":"2024-09-12T01:37:47.023075+0000","last_peered":"2024-09-12T01:37:47.023075+0000","last_clean":"2024-09-12T01:37:47.023075+0000","last_became_active":"2024-09-12T00:24:46.449286+0000","last_became_peered":"2024-09-12T00:24:46.449286+0000","last_unstale":"2024-09-12T01:37:47.023075+0000","last_undegraded":"2024-09-12T01:37:47.023075+0000","last_fullsized":"2024-09-12T01:37:47.023075+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:37:47.022957+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:37:47.022957+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.022957+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:19.767332+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.001069263,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'200","reported_seq":835,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.350405+0000","last_change":"2024-09-12T01:37:46.350307+0000","last_active":"2024-09-12T01:37:46.350405+0000","last_peered":"2024-09-12T01:37:46.350405+0000","last_clean":"2024-09-12T01:37:46.350405+0000","last_became_active":"2024-09-12T00:25:00.465691+0000","last_became_peered":"2024-09-12T00:25:00.465691+0000","last_unstale":"2024-09-12T01:37:46.350405+0000","last_undegraded":"2024-09-12T01:37:46.350405+0000","last_fullsized":"2024-09-12T01:37:46.350405+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'200","last_scrub_stamp":"2024-09-12T01:37:46.350175+0000","last_deep_scrub":"266'200","last_deep_scrub_stamp":"2024-09-12T01:37:46.350175+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.350175+0000","objects_scrubbed":2,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:03.453089+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262165,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":388,"num_read_kb":3125,"num_write":969,"num_write_kb":16262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.872809+0000","last_change":"2024-09-12T01:38:01.872809+0000","last_active":"2024-09-12T01:38:01.872809+0000","last_peered":"2024-09-12T01:38:01.872809+0000","last_clean":"2024-09-12T01:38:01.872809+0000","last_became_active":"2024-09-12T00:25:04.483893+0000","last_became_peered":"2024-09-12T00:25:04.483893+0000","last_unstale":"2024-09-12T01:38:01.872809+0000","last_undegraded":"2024-09-12T01:38:01.872809+0000","last_fullsized":"2024-09-12T01:38:01.872809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:01.872703+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:01.872703+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.872703+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:44.504728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'341","reported_seq":1073,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.954334+0000","last_change":"2024-09-12T01:38:15.954237+0000","last_active":"2024-09-12T01:38:15.954334+0000","last_peered":"2024-09-12T01:38:15.954334+0000","last_clean":"2024-09-12T01:38:15.954334+0000","last_became_active":"2024-09-12T00:25:06.497261+0000","last_became_peered":"2024-09-12T00:25:06.497261+0000","last_unstale":"2024-09-12T01:38:15.954334+0000","last_undegraded":"2024-09-12T01:38:15.954334+0000","last_fullsized":"2024-09-12T01:38:15.954334+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'341","last_scrub_stamp":"2024-09-12T01:38:15.954131+0000","last_deep_scrub":"266'341","last_deep_scrub_stamp":"2024-09-12T01:38:15.954131+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.954131+0000","objects_scrubbed":7,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:23.333266+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":36159,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":620,"num_read_kb":873,"num_write":540,"num_write_kb":387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":90450,"num_omap_keys":220,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.663353+0000","last_change":"2024-09-12T01:38:16.663298+0000","last_active":"2024-09-12T01:38:16.663353+0000","last_peered":"2024-09-12T01:38:16.663353+0000","last_clean":"2024-09-12T01:38:16.663353+0000","last_became_active":"2024-09-12T00:25:08.509183+0000","last_became_peered":"2024-09-12T00:25:08.509183+0000","last_unstale":"2024-09-12T01:38:16.663353+0000","last_undegraded":"2024-09-12T01:38:16.663353+0000","last_fullsized":"2024-09-12T01:38:16.663353+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.663221+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.663221+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.663221+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:07:38.187616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'218","reported_seq":938,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.859772+0000","last_change":"2024-09-12T01:38:09.859715+0000","last_active":"2024-09-12T01:38:09.859772+0000","last_peered":"2024-09-12T01:38:09.859772+0000","last_clean":"2024-09-12T01:38:09.859772+0000","last_became_active":"2024-09-12T00:25:10.525441+0000","last_became_peered":"2024-09-12T00:25:10.525441+0000","last_unstale":"2024-09-12T01:38:09.859772+0000","last_undegraded":"2024-09-12T01:38:09.859772+0000","last_fullsized":"2024-09-12T01:38:09.859772+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T01:38:09.859599+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T01:38:09.859599+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.859599+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:13.164657+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":453,"num_read_kb":448,"num_write":488,"num_write_kb":138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'808","reported_seq":2400,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.602928+0000","last_change":"2024-09-12T01:37:59.602855+0000","last_active":"2024-09-12T01:37:59.602928+0000","last_peered":"2024-09-12T01:37:59.602928+0000","last_clean":"2024-09-12T01:37:59.602928+0000","last_became_active":"2024-09-12T00:25:02.478919+0000","last_became_peered":"2024-09-12T00:25:02.478919+0000","last_unstale":"2024-09-12T01:37:59.602928+0000","last_undegraded":"2024-09-12T01:37:59.602928+0000","last_fullsized":"2024-09-12T01:37:59.602928+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'808","last_scrub_stamp":"2024-09-12T01:37:59.602772+0000","last_deep_scrub":"266'808","last_deep_scrub_stamp":"2024-09-12T01:37:59.602772+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.602772+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:16:55.142030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4003,"num_read_kb":3616,"num_write":1060,"num_write_kb":390,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":545,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.985972+0000","last_change":"2024-09-12T01:37:44.985922+0000","last_active":"2024-09-12T01:37:44.985972+0000","last_peered":"2024-09-12T01:37:44.985972+0000","last_clean":"2024-09-12T01:37:44.985972+0000","last_became_active":"2024-09-12T00:24:46.216398+0000","last_became_peered":"2024-09-12T00:24:46.216398+0000","last_unstale":"2024-09-12T01:37:44.985972+0000","last_undegraded":"2024-09-12T01:37:44.985972+0000","last_fullsized":"2024-09-12T01:37:44.985972+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:44.985834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:44.985834+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.985834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:51.621846+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00080348300000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'237","reported_seq":911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.350538+0000","last_change":"2024-09-12T01:37:46.350466+0000","last_active":"2024-09-12T01:37:46.350538+0000","last_peered":"2024-09-12T01:37:46.350538+0000","last_clean":"2024-09-12T01:37:46.350538+0000","last_became_active":"2024-09-12T00:25:00.467622+0000","last_became_peered":"2024-09-12T00:25:00.467622+0000","last_unstale":"2024-09-12T01:37:46.350538+0000","last_undegraded":"2024-09-12T01:37:46.350538+0000","last_fullsized":"2024-09-12T01:37:46.350538+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'237","last_scrub_stamp":"2024-09-12T01:37:46.350355+0000","last_deep_scrub":"266'237","last_deep_scrub_stamp":"2024-09-12T01:37:46.350355+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.350355+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":200,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:45.435839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":667699,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":566,"num_read_kb":22643,"num_write":1048,"num_write_kb":21929,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.985551+0000","last_change":"2024-09-12T01:38:10.985481+0000","last_active":"2024-09-12T01:38:10.985551+0000","last_peered":"2024-09-12T01:38:10.985551+0000","last_clean":"2024-09-12T01:38:10.985551+0000","last_became_active":"2024-09-12T00:25:04.483752+0000","last_became_peered":"2024-09-12T00:25:04.483752+0000","last_unstale":"2024-09-12T01:38:10.985551+0000","last_undegraded":"2024-09-12T01:38:10.985551+0000","last_fullsized":"2024-09-12T01:38:10.985551+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:10.985395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:10.985395+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.985395+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:52:15.823115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'935","reported_seq":2768,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.428621+0000","last_change":"2024-09-12T01:38:02.428563+0000","last_active":"2024-09-12T01:38:02.428621+0000","last_peered":"2024-09-12T01:38:02.428621+0000","last_clean":"2024-09-12T01:38:02.428621+0000","last_became_active":"2024-09-12T00:25:06.491919+0000","last_became_peered":"2024-09-12T00:25:06.491919+0000","last_unstale":"2024-09-12T01:38:02.428621+0000","last_undegraded":"2024-09-12T01:38:02.428621+0000","last_fullsized":"2024-09-12T01:38:02.428621+0000","mapping_epoch":32,"log_start":"266'900","ondisk_log_start":"266'900","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'935","last_scrub_stamp":"2024-09-12T01:38:02.428459+0000","last_deep_scrub":"266'935","last_deep_scrub_stamp":"2024-09-12T01:38:02.428459+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.428459+0000","objects_scrubbed":12,"log_size":35,"log_dups_size":900,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:52:06.583646+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26860,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1263,"num_read_kb":1464,"num_write":378,"num_write_kb":180,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.852101+0000","last_change":"2024-09-12T01:38:22.852101+0000","last_active":"2024-09-12T01:38:22.852101+0000","last_peered":"2024-09-12T01:38:22.852101+0000","last_clean":"2024-09-12T01:38:22.852101+0000","last_became_active":"2024-09-12T00:25:08.514284+0000","last_became_peered":"2024-09-12T00:25:08.514284+0000","last_unstale":"2024-09-12T01:38:22.852101+0000","last_undegraded":"2024-09-12T01:38:22.852101+0000","last_fullsized":"2024-09-12T01:38:22.852101+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:22.852005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:22.852005+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.852005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:27.984299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'201","reported_seq":739,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.725082+0000","last_change":"2024-09-12T01:38:19.725082+0000","last_active":"2024-09-12T01:38:19.725082+0000","last_peered":"2024-09-12T01:38:19.725082+0000","last_clean":"2024-09-12T01:38:19.725082+0000","last_became_active":"2024-09-12T00:25:10.521686+0000","last_became_peered":"2024-09-12T00:25:10.521686+0000","last_unstale":"2024-09-12T01:38:19.725082+0000","last_undegraded":"2024-09-12T01:38:19.725082+0000","last_fullsized":"2024-09-12T01:38:19.725082+0000","mapping_epoch":36,"log_start":"263'100","ondisk_log_start":"263'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'201","last_scrub_stamp":"2024-09-12T01:38:19.725001+0000","last_deep_scrub":"266'201","last_deep_scrub_stamp":"2024-09-12T01:38:19.725001+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.725001+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:28:02.902788+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":337,"num_read_kb":329,"num_write":450,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'458","reported_seq":1928,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.324299+0000","last_change":"2024-09-12T01:37:56.324237+0000","last_active":"2024-09-12T01:37:56.324299+0000","last_peered":"2024-09-12T01:37:56.324299+0000","last_clean":"2024-09-12T01:37:56.324299+0000","last_became_active":"2024-09-12T00:25:02.472379+0000","last_became_peered":"2024-09-12T00:25:02.472379+0000","last_unstale":"2024-09-12T01:37:56.324299+0000","last_undegraded":"2024-09-12T01:37:56.324299+0000","last_fullsized":"2024-09-12T01:37:56.324299+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'458","last_scrub_stamp":"2024-09-12T01:37:56.324159+0000","last_deep_scrub":"266'458","last_deep_scrub_stamp":"2024-09-12T01:37:56.324159+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.324159+0000","objects_scrubbed":1,"log_size":58,"log_dups_size":400,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:20.183702+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2328,"num_read_kb":2161,"num_write":552,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":541,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.478045+0000","last_change":"2024-09-12T01:37:47.478045+0000","last_active":"2024-09-12T01:37:47.478045+0000","last_peered":"2024-09-12T01:37:47.478045+0000","last_clean":"2024-09-12T01:37:47.478045+0000","last_became_active":"2024-09-12T00:24:46.219148+0000","last_became_peered":"2024-09-12T00:24:46.219148+0000","last_unstale":"2024-09-12T01:37:47.478045+0000","last_undegraded":"2024-09-12T01:37:47.478045+0000","last_fullsized":"2024-09-12T01:37:47.478045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:47.477953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:47.477953+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.477953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:54:34.844122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00040735800000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'221","reported_seq":909,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.547177+0000","last_change":"2024-09-12T01:37:47.547177+0000","last_active":"2024-09-12T01:37:47.547177+0000","last_peered":"2024-09-12T01:37:47.547177+0000","last_clean":"2024-09-12T01:37:47.547177+0000","last_became_active":"2024-09-12T00:25:00.468270+0000","last_became_peered":"2024-09-12T00:25:00.468270+0000","last_unstale":"2024-09-12T01:37:47.547177+0000","last_undegraded":"2024-09-12T01:37:47.547177+0000","last_fullsized":"2024-09-12T01:37:47.547177+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'221","last_scrub_stamp":"2024-09-12T01:37:47.547063+0000","last_deep_scrub":"266'221","last_deep_scrub_stamp":"2024-09-12T01:37:47.547063+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.547063+0000","objects_scrubbed":4,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:53:35.859232+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":53,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":512,"num_read_kb":34464,"num_write":950,"num_write_kb":30398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.454089+0000","last_change":"2024-09-12T01:37:58.454003+0000","last_active":"2024-09-12T01:37:58.454089+0000","last_peered":"2024-09-12T01:37:58.454089+0000","last_clean":"2024-09-12T01:37:58.454089+0000","last_became_active":"2024-09-12T00:25:04.486554+0000","last_became_peered":"2024-09-12T00:25:04.486554+0000","last_unstale":"2024-09-12T01:37:58.454089+0000","last_undegraded":"2024-09-12T01:37:58.454089+0000","last_fullsized":"2024-09-12T01:37:58.454089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:37:58.453898+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:37:58.453898+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.453898+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:32.185064+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'319","reported_seq":1761,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.892800+0000","last_change":"2024-09-12T01:38:02.892740+0000","last_active":"2024-09-12T01:38:02.892800+0000","last_peered":"2024-09-12T01:38:02.892800+0000","last_clean":"2024-09-12T01:38:02.892800+0000","last_became_active":"2024-09-12T00:25:06.495269+0000","last_became_peered":"2024-09-12T00:25:06.495269+0000","last_unstale":"2024-09-12T01:38:02.892800+0000","last_undegraded":"2024-09-12T01:38:02.892800+0000","last_fullsized":"2024-09-12T01:38:02.892800+0000","mapping_epoch":32,"log_start":"266'301","ondisk_log_start":"266'301","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'319","last_scrub_stamp":"2024-09-12T01:38:02.892622+0000","last_deep_scrub":"266'319","last_deep_scrub_stamp":"2024-09-12T01:38:02.892622+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.892622+0000","objects_scrubbed":9,"log_size":18,"log_dups_size":301,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:42:22.199556+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":267,"num_read_kb":257,"num_write":249,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.357753+0000","last_change":"2024-09-12T01:38:15.357753+0000","last_active":"2024-09-12T01:38:15.357753+0000","last_peered":"2024-09-12T01:38:15.357753+0000","last_clean":"2024-09-12T01:38:15.357753+0000","last_became_active":"2024-09-12T00:25:08.511783+0000","last_became_peered":"2024-09-12T00:25:08.511783+0000","last_unstale":"2024-09-12T01:38:15.357753+0000","last_undegraded":"2024-09-12T01:38:15.357753+0000","last_fullsized":"2024-09-12T01:38:15.357753+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:15.357673+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:15.357673+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.357673+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:32.899032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'272","reported_seq":894,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.324690+0000","last_change":"2024-09-12T01:38:20.324690+0000","last_active":"2024-09-12T01:38:20.324690+0000","last_peered":"2024-09-12T01:38:20.324690+0000","last_clean":"2024-09-12T01:38:20.324690+0000","last_became_active":"2024-09-12T00:25:10.525594+0000","last_became_peered":"2024-09-12T00:25:10.525594+0000","last_unstale":"2024-09-12T01:38:20.324690+0000","last_undegraded":"2024-09-12T01:38:20.324690+0000","last_fullsized":"2024-09-12T01:38:20.324690+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'272","last_scrub_stamp":"2024-09-12T01:38:20.324599+0000","last_deep_scrub":"266'272","last_deep_scrub_stamp":"2024-09-12T01:38:20.324599+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.324599+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":200,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:08.489446+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":491,"num_read_kb":513,"num_write":584,"num_write_kb":166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'413","reported_seq":1899,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.287559+0000","last_change":"2024-09-12T01:37:53.287502+0000","last_active":"2024-09-12T01:37:53.287559+0000","last_peered":"2024-09-12T01:37:53.287559+0000","last_clean":"2024-09-12T01:37:53.287559+0000","last_became_active":"2024-09-12T00:25:02.467022+0000","last_became_peered":"2024-09-12T00:25:02.467022+0000","last_unstale":"2024-09-12T01:37:53.287559+0000","last_undegraded":"2024-09-12T01:37:53.287559+0000","last_fullsized":"2024-09-12T01:37:53.287559+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'413","last_scrub_stamp":"2024-09-12T01:37:53.287417+0000","last_deep_scrub":"266'413","last_deep_scrub_stamp":"2024-09-12T01:37:53.287417+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.287417+0000","objects_scrubbed":1,"log_size":13,"log_dups_size":400,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:09.800269+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2131,"num_read_kb":2016,"num_write":472,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":546,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.973514+0000","last_change":"2024-09-12T01:37:45.973514+0000","last_active":"2024-09-12T01:37:45.973514+0000","last_peered":"2024-09-12T01:37:45.973514+0000","last_clean":"2024-09-12T01:37:45.973514+0000","last_became_active":"2024-09-12T00:24:46.296014+0000","last_became_peered":"2024-09-12T00:24:46.296014+0000","last_unstale":"2024-09-12T01:37:45.973514+0000","last_undegraded":"2024-09-12T01:37:45.973514+0000","last_fullsized":"2024-09-12T01:37:45.973514+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T01:37:45.973447+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T01:37:45.973447+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.973447+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:56.580285+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00055221999999999997,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'227","reported_seq":868,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.739740+0000","last_change":"2024-09-12T01:37:55.739740+0000","last_active":"2024-09-12T01:37:55.739740+0000","last_peered":"2024-09-12T01:37:55.739740+0000","last_clean":"2024-09-12T01:37:55.739740+0000","last_became_active":"2024-09-12T00:25:00.480242+0000","last_became_peered":"2024-09-12T00:25:00.480242+0000","last_unstale":"2024-09-12T01:37:55.739740+0000","last_undegraded":"2024-09-12T01:37:55.739740+0000","last_fullsized":"2024-09-12T01:37:55.739740+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'227","last_scrub_stamp":"2024-09-12T01:37:55.739594+0000","last_deep_scrub":"266'227","last_deep_scrub_stamp":"2024-09-12T01:37:55.739594+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.739594+0000","objects_scrubbed":4,"log_size":27,"log_dups_size":200,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:19:04.195794+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":8697,"num_write":1016,"num_write_kb":33114,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.412878+0000","last_change":"2024-09-12T01:37:56.412798+0000","last_active":"2024-09-12T01:37:56.412878+0000","last_peered":"2024-09-12T01:37:56.412878+0000","last_clean":"2024-09-12T01:37:56.412878+0000","last_became_active":"2024-09-12T00:25:04.483224+0000","last_became_peered":"2024-09-12T00:25:04.483224+0000","last_unstale":"2024-09-12T01:37:56.412878+0000","last_undegraded":"2024-09-12T01:37:56.412878+0000","last_fullsized":"2024-09-12T01:37:56.412878+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:56.412697+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:56.412697+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.412697+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:36.333449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'168","reported_seq":740,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.576556+0000","last_change":"2024-09-12T01:38:12.576475+0000","last_active":"2024-09-12T01:38:12.576556+0000","last_peered":"2024-09-12T01:38:12.576556+0000","last_clean":"2024-09-12T01:38:12.576556+0000","last_became_active":"2024-09-12T00:25:06.500406+0000","last_became_peered":"2024-09-12T00:25:06.500406+0000","last_unstale":"2024-09-12T01:38:12.576556+0000","last_undegraded":"2024-09-12T01:38:12.576556+0000","last_fullsized":"2024-09-12T01:38:12.576556+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'168","last_scrub_stamp":"2024-09-12T01:38:12.576363+0000","last_deep_scrub":"266'168","last_deep_scrub_stamp":"2024-09-12T01:38:12.576363+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.576363+0000","objects_scrubbed":7,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:43.416406+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":204,"num_read_kb":195,"num_write":150,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:25.877080+0000","last_change":"2024-09-12T01:38:25.877023+0000","last_active":"2024-09-12T01:38:25.877080+0000","last_peered":"2024-09-12T01:38:25.877080+0000","last_clean":"2024-09-12T01:38:25.877080+0000","last_became_active":"2024-09-12T00:25:08.510287+0000","last_became_peered":"2024-09-12T00:25:08.510287+0000","last_unstale":"2024-09-12T01:38:25.877080+0000","last_undegraded":"2024-09-12T01:38:25.877080+0000","last_fullsized":"2024-09-12T01:38:25.877080+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:25.876939+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:25.876939+0000","last_clean_scrub_stamp":"2024-09-12T01:38:25.876939+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:32:03.157923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'161","reported_seq":727,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.793678+0000","last_change":"2024-09-12T01:38:11.793611+0000","last_active":"2024-09-12T01:38:11.793678+0000","last_peered":"2024-09-12T01:38:11.793678+0000","last_clean":"2024-09-12T01:38:11.793678+0000","last_became_active":"2024-09-12T00:25:10.523589+0000","last_became_peered":"2024-09-12T00:25:10.523589+0000","last_unstale":"2024-09-12T01:38:11.793678+0000","last_undegraded":"2024-09-12T01:38:11.793678+0000","last_fullsized":"2024-09-12T01:38:11.793678+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'161","last_scrub_stamp":"2024-09-12T01:38:11.793512+0000","last_deep_scrub":"266'161","last_deep_scrub_stamp":"2024-09-12T01:38:11.793512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.793512+0000","objects_scrubbed":3,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:20:42.925878+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":866,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":192,"num_read_kb":189,"num_write":355,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'1615","reported_seq":3220,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.249739+0000","last_change":"2024-09-12T01:37:51.249637+0000","last_active":"2024-09-12T01:37:51.249739+0000","last_peered":"2024-09-12T01:37:51.249739+0000","last_clean":"2024-09-12T01:37:51.249739+0000","last_became_active":"2024-09-12T00:25:02.471491+0000","last_became_peered":"2024-09-12T00:25:02.471491+0000","last_unstale":"2024-09-12T01:37:51.249739+0000","last_undegraded":"2024-09-12T01:37:51.249739+0000","last_fullsized":"2024-09-12T01:37:51.249739+0000","mapping_epoch":28,"log_start":"266'1600","ondisk_log_start":"266'1600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1615","last_scrub_stamp":"2024-09-12T01:37:51.249541+0000","last_deep_scrub":"266'1615","last_deep_scrub_stamp":"2024-09-12T01:37:51.249541+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.249541+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":1600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:54.798728+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7163,"num_read_kb":6213,"num_write":2294,"num_write_kb":1011,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":476,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'243","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.567520+0000","last_change":"2024-09-12T01:37:45.567458+0000","last_active":"2024-09-12T01:37:45.567520+0000","last_peered":"2024-09-12T01:37:45.567520+0000","last_clean":"2024-09-12T01:37:45.567520+0000","last_became_active":"2024-09-12T00:25:00.484147+0000","last_became_peered":"2024-09-12T00:25:00.484147+0000","last_unstale":"2024-09-12T01:37:45.567520+0000","last_undegraded":"2024-09-12T01:37:45.567520+0000","last_fullsized":"2024-09-12T01:37:45.567520+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'243","last_scrub_stamp":"2024-09-12T01:37:45.567385+0000","last_deep_scrub":"266'243","last_deep_scrub_stamp":"2024-09-12T01:37:45.567385+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.567385+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:40.545937+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":499,"num_read_kb":38062,"num_write":1135,"num_write_kb":41091,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":540,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.537738+0000","last_change":"2024-09-12T01:37:46.537738+0000","last_active":"2024-09-12T01:37:46.537738+0000","last_peered":"2024-09-12T01:37:46.537738+0000","last_clean":"2024-09-12T01:37:46.537738+0000","last_became_active":"2024-09-12T00:24:46.295839+0000","last_became_peered":"2024-09-12T00:24:46.295839+0000","last_unstale":"2024-09-12T01:37:46.537738+0000","last_undegraded":"2024-09-12T01:37:46.537738+0000","last_fullsized":"2024-09-12T01:37:46.537738+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:46.537656+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:46.537656+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.537656+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:55.749892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045367200000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.299479+0000","last_change":"2024-09-12T01:38:03.299479+0000","last_active":"2024-09-12T01:38:03.299479+0000","last_peered":"2024-09-12T01:38:03.299479+0000","last_clean":"2024-09-12T01:38:03.299479+0000","last_became_active":"2024-09-12T00:25:04.478947+0000","last_became_peered":"2024-09-12T00:25:04.478947+0000","last_unstale":"2024-09-12T01:38:03.299479+0000","last_undegraded":"2024-09-12T01:38:03.299479+0000","last_fullsized":"2024-09-12T01:38:03.299479+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:03.299354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:03.299354+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.299354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:24.646538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'324","reported_seq":1033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.470886+0000","last_change":"2024-09-12T01:38:01.470886+0000","last_active":"2024-09-12T01:38:01.470886+0000","last_peered":"2024-09-12T01:38:01.470886+0000","last_clean":"2024-09-12T01:38:01.470886+0000","last_became_active":"2024-09-12T00:25:06.496693+0000","last_became_peered":"2024-09-12T00:25:06.496693+0000","last_unstale":"2024-09-12T01:38:01.470886+0000","last_undegraded":"2024-09-12T01:38:01.470886+0000","last_fullsized":"2024-09-12T01:38:01.470886+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'324","last_scrub_stamp":"2024-09-12T01:38:01.470784+0000","last_deep_scrub":"266'324","last_deep_scrub_stamp":"2024-09-12T01:38:01.470784+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.470784+0000","objects_scrubbed":11,"log_size":24,"log_dups_size":300,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:15:43.306882+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17563,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":458,"num_read_kb":584,"num_write":266,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.715151+0000","last_change":"2024-09-12T01:38:04.715080+0000","last_active":"2024-09-12T01:38:04.715151+0000","last_peered":"2024-09-12T01:38:04.715151+0000","last_clean":"2024-09-12T01:38:04.715151+0000","last_became_active":"2024-09-12T00:25:08.509962+0000","last_became_peered":"2024-09-12T00:25:08.509962+0000","last_unstale":"2024-09-12T01:38:04.715151+0000","last_undegraded":"2024-09-12T01:38:04.715151+0000","last_fullsized":"2024-09-12T01:38:04.715151+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:04.714993+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:04.714993+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.714993+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:04.273955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'146","reported_seq":666,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:22.667907+0000","last_change":"2024-09-12T01:38:22.667907+0000","last_active":"2024-09-12T01:38:22.667907+0000","last_peered":"2024-09-12T01:38:22.667907+0000","last_clean":"2024-09-12T01:38:22.667907+0000","last_became_active":"2024-09-12T00:25:10.521670+0000","last_became_peered":"2024-09-12T00:25:10.521670+0000","last_unstale":"2024-09-12T01:38:22.667907+0000","last_undegraded":"2024-09-12T01:38:22.667907+0000","last_fullsized":"2024-09-12T01:38:22.667907+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'146","last_scrub_stamp":"2024-09-12T01:38:22.667807+0000","last_deep_scrub":"266'146","last_deep_scrub_stamp":"2024-09-12T01:38:22.667807+0000","last_clean_scrub_stamp":"2024-09-12T01:38:22.667807+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:34.880802+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":167,"num_read_kb":156,"num_write":347,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'1211","reported_seq":2867,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.294939+0000","last_change":"2024-09-12T01:37:55.294828+0000","last_active":"2024-09-12T01:37:55.294939+0000","last_peered":"2024-09-12T01:37:55.294939+0000","last_clean":"2024-09-12T01:37:55.294939+0000","last_became_active":"2024-09-12T00:25:02.473158+0000","last_became_peered":"2024-09-12T00:25:02.473158+0000","last_unstale":"2024-09-12T01:37:55.294939+0000","last_undegraded":"2024-09-12T01:37:55.294939+0000","last_fullsized":"2024-09-12T01:37:55.294939+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1211","last_scrub_stamp":"2024-09-12T01:37:55.294717+0000","last_deep_scrub":"266'1211","last_deep_scrub_stamp":"2024-09-12T01:37:55.294717+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.294717+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":1200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:49.131916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5668,"num_read_kb":5007,"num_write":1669,"num_write_kb":704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2709,"num_omap_keys":11,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'191","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.291895+0000","last_change":"2024-09-12T01:37:48.291829+0000","last_active":"2024-09-12T01:37:48.291895+0000","last_peered":"2024-09-12T01:37:48.291895+0000","last_clean":"2024-09-12T01:37:48.291895+0000","last_became_active":"2024-09-12T00:25:00.465896+0000","last_became_peered":"2024-09-12T00:25:00.465896+0000","last_unstale":"2024-09-12T01:37:48.291895+0000","last_undegraded":"2024-09-12T01:37:48.291895+0000","last_fullsized":"2024-09-12T01:37:48.291895+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T01:37:48.291667+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T01:37:48.291667+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.291667+0000","objects_scrubbed":4,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:56.140550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702969,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":438,"num_read_kb":13303,"num_write":931,"num_write_kb":18974,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":543,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.043936+0000","last_change":"2024-09-12T01:37:49.043879+0000","last_active":"2024-09-12T01:37:49.043936+0000","last_peered":"2024-09-12T01:37:49.043936+0000","last_clean":"2024-09-12T01:37:49.043936+0000","last_became_active":"2024-09-12T00:24:46.213839+0000","last_became_peered":"2024-09-12T00:24:46.213839+0000","last_unstale":"2024-09-12T01:37:49.043936+0000","last_undegraded":"2024-09-12T01:37:49.043936+0000","last_fullsized":"2024-09-12T01:37:49.043936+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:49.043790+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:49.043790+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.043790+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:29:54.944893+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00050495300000000004,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.864056+0000","last_change":"2024-09-12T01:38:00.864056+0000","last_active":"2024-09-12T01:38:00.864056+0000","last_peered":"2024-09-12T01:38:00.864056+0000","last_clean":"2024-09-12T01:38:00.864056+0000","last_became_active":"2024-09-12T00:25:04.481137+0000","last_became_peered":"2024-09-12T00:25:04.481137+0000","last_unstale":"2024-09-12T01:38:00.864056+0000","last_undegraded":"2024-09-12T01:38:00.864056+0000","last_fullsized":"2024-09-12T01:38:00.864056+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.863967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.863967+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.863967+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:46.951205+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'261","reported_seq":864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.387347+0000","last_change":"2024-09-12T01:38:07.387347+0000","last_active":"2024-09-12T01:38:07.387347+0000","last_peered":"2024-09-12T01:38:07.387347+0000","last_clean":"2024-09-12T01:38:07.387347+0000","last_became_active":"2024-09-12T00:25:06.501118+0000","last_became_peered":"2024-09-12T00:25:06.501118+0000","last_unstale":"2024-09-12T01:38:07.387347+0000","last_undegraded":"2024-09-12T01:38:07.387347+0000","last_fullsized":"2024-09-12T01:38:07.387347+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'261","last_scrub_stamp":"2024-09-12T01:38:07.387238+0000","last_deep_scrub":"266'261","last_deep_scrub_stamp":"2024-09-12T01:38:07.387238+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.387238+0000","objects_scrubbed":9,"log_size":61,"log_dups_size":200,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:26.161968+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":326,"num_read_kb":318,"num_write":296,"num_write_kb":122,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'774","reported_seq":2933,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.824281+0000","last_change":"2024-09-12T01:38:04.824281+0000","last_active":"2024-09-12T01:38:04.824281+0000","last_peered":"2024-09-12T01:38:04.824281+0000","last_clean":"2024-09-12T01:38:04.824281+0000","last_became_active":"2024-09-12T00:25:08.509511+0000","last_became_peered":"2024-09-12T00:25:08.509511+0000","last_unstale":"2024-09-12T01:38:04.824281+0000","last_undegraded":"2024-09-12T01:38:04.824281+0000","last_fullsized":"2024-09-12T01:38:04.824281+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'774","last_scrub_stamp":"2024-09-12T01:38:04.824196+0000","last_deep_scrub":"266'774","last_deep_scrub_stamp":"2024-09-12T01:38:04.824196+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.824196+0000","objects_scrubbed":1,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:41.848726+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'131","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.605406+0000","last_change":"2024-09-12T01:38:11.605406+0000","last_active":"2024-09-12T01:38:11.605406+0000","last_peered":"2024-09-12T01:38:11.605406+0000","last_clean":"2024-09-12T01:38:11.605406+0000","last_became_active":"2024-09-12T00:25:10.524804+0000","last_became_peered":"2024-09-12T00:25:10.524804+0000","last_unstale":"2024-09-12T01:38:11.605406+0000","last_undegraded":"2024-09-12T01:38:11.605406+0000","last_fullsized":"2024-09-12T01:38:11.605406+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'131","last_scrub_stamp":"2024-09-12T01:38:11.605314+0000","last_deep_scrub":"266'131","last_deep_scrub_stamp":"2024-09-12T01:38:11.605314+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.605314+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:23:05.600758+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":178,"num_read_kb":162,"num_write":315,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'468","reported_seq":2167,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.368204+0000","last_change":"2024-09-12T01:37:52.368204+0000","last_active":"2024-09-12T01:37:52.368204+0000","last_peered":"2024-09-12T01:37:52.368204+0000","last_clean":"2024-09-12T01:37:52.368204+0000","last_became_active":"2024-09-12T00:25:02.463232+0000","last_became_peered":"2024-09-12T00:25:02.463232+0000","last_unstale":"2024-09-12T01:37:52.368204+0000","last_undegraded":"2024-09-12T01:37:52.368204+0000","last_fullsized":"2024-09-12T01:37:52.368204+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'468","last_scrub_stamp":"2024-09-12T01:37:52.368113+0000","last_deep_scrub":"266'468","last_deep_scrub_stamp":"2024-09-12T01:37:52.368113+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.368113+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":400,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:14.544213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2494,"num_read_kb":2382,"num_write":536,"num_write_kb":101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'241","reported_seq":950,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.376472+0000","last_change":"2024-09-12T01:37:48.376413+0000","last_active":"2024-09-12T01:37:48.376472+0000","last_peered":"2024-09-12T01:37:48.376472+0000","last_clean":"2024-09-12T01:37:48.376472+0000","last_became_active":"2024-09-12T00:25:00.452591+0000","last_became_peered":"2024-09-12T00:25:00.452591+0000","last_unstale":"2024-09-12T01:37:48.376472+0000","last_undegraded":"2024-09-12T01:37:48.376472+0000","last_fullsized":"2024-09-12T01:37:48.376472+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'241","last_scrub_stamp":"2024-09-12T01:37:48.376282+0000","last_deep_scrub":"266'241","last_deep_scrub_stamp":"2024-09-12T01:37:48.376282+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.376282+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":200,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:07:09.221130+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":777,"num_read_kb":13125,"num_write":984,"num_write_kb":40186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":550,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.359531+0000","last_change":"2024-09-12T01:37:45.359471+0000","last_active":"2024-09-12T01:37:45.359531+0000","last_peered":"2024-09-12T01:37:45.359531+0000","last_clean":"2024-09-12T01:37:45.359531+0000","last_became_active":"2024-09-12T00:24:46.426160+0000","last_became_peered":"2024-09-12T00:24:46.426160+0000","last_unstale":"2024-09-12T01:37:45.359531+0000","last_undegraded":"2024-09-12T01:37:45.359531+0000","last_fullsized":"2024-09-12T01:37:45.359531+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:45.359384+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:45.359384+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.359384+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:46.994285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00041087699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.957234+0000","last_change":"2024-09-12T01:38:12.957234+0000","last_active":"2024-09-12T01:38:12.957234+0000","last_peered":"2024-09-12T01:38:12.957234+0000","last_clean":"2024-09-12T01:38:12.957234+0000","last_became_active":"2024-09-12T00:25:04.482856+0000","last_became_peered":"2024-09-12T00:25:04.482856+0000","last_unstale":"2024-09-12T01:38:12.957234+0000","last_undegraded":"2024-09-12T01:38:12.957234+0000","last_fullsized":"2024-09-12T01:38:12.957234+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:12.957150+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:12.957150+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.957150+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:39.102722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'147","reported_seq":721,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.975688+0000","last_change":"2024-09-12T01:38:17.975688+0000","last_active":"2024-09-12T01:38:17.975688+0000","last_peered":"2024-09-12T01:38:17.975688+0000","last_clean":"2024-09-12T01:38:17.975688+0000","last_became_active":"2024-09-12T00:25:06.497888+0000","last_became_peered":"2024-09-12T00:25:06.497888+0000","last_unstale":"2024-09-12T01:38:17.975688+0000","last_undegraded":"2024-09-12T01:38:17.975688+0000","last_fullsized":"2024-09-12T01:38:17.975688+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'147","last_scrub_stamp":"2024-09-12T01:38:17.975589+0000","last_deep_scrub":"266'147","last_deep_scrub_stamp":"2024-09-12T01:38:17.975589+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.975589+0000","objects_scrubbed":6,"log_size":47,"log_dups_size":100,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:49:15.586228+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":175,"num_read_kb":168,"num_write":116,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'803","reported_seq":2666,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.569758+0000","last_change":"2024-09-12T01:38:11.569758+0000","last_active":"2024-09-12T01:38:11.569758+0000","last_peered":"2024-09-12T01:38:11.569758+0000","last_clean":"2024-09-12T01:38:11.569758+0000","last_became_active":"2024-09-12T00:25:08.512784+0000","last_became_peered":"2024-09-12T00:25:08.512784+0000","last_unstale":"2024-09-12T01:38:11.569758+0000","last_undegraded":"2024-09-12T01:38:11.569758+0000","last_fullsized":"2024-09-12T01:38:11.569758+0000","mapping_epoch":34,"log_start":"266'700","ondisk_log_start":"266'700","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'803","last_scrub_stamp":"2024-09-12T01:38:11.569667+0000","last_deep_scrub":"266'803","last_deep_scrub_stamp":"2024-09-12T01:38:11.569667+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.569667+0000","objects_scrubbed":1,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:56.839480+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'246","reported_seq":782,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.733053+0000","last_change":"2024-09-12T01:38:20.733053+0000","last_active":"2024-09-12T01:38:20.733053+0000","last_peered":"2024-09-12T01:38:20.733053+0000","last_clean":"2024-09-12T01:38:20.733053+0000","last_became_active":"2024-09-12T00:25:10.523258+0000","last_became_peered":"2024-09-12T00:25:10.523258+0000","last_unstale":"2024-09-12T01:38:20.733053+0000","last_undegraded":"2024-09-12T01:38:20.733053+0000","last_fullsized":"2024-09-12T01:38:20.733053+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'246","last_scrub_stamp":"2024-09-12T01:38:20.732964+0000","last_deep_scrub":"266'246","last_deep_scrub_stamp":"2024-09-12T01:38:20.732964+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.732964+0000","objects_scrubbed":3,"log_size":46,"log_dups_size":200,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:03.600893+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":236,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":243,"num_read_kb":213,"num_write":467,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'490","reported_seq":2085,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.705966+0000","last_change":"2024-09-12T01:37:51.705892+0000","last_active":"2024-09-12T01:37:51.705966+0000","last_peered":"2024-09-12T01:37:51.705966+0000","last_clean":"2024-09-12T01:37:51.705966+0000","last_became_active":"2024-09-12T00:25:02.468436+0000","last_became_peered":"2024-09-12T00:25:02.468436+0000","last_unstale":"2024-09-12T01:37:51.705966+0000","last_undegraded":"2024-09-12T01:37:51.705966+0000","last_fullsized":"2024-09-12T01:37:51.705966+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'490","last_scrub_stamp":"2024-09-12T01:37:51.705797+0000","last_deep_scrub":"266'490","last_deep_scrub_stamp":"2024-09-12T01:37:51.705797+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.705797+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":400,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:59.947035+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2713,"num_read_kb":2534,"num_write":588,"num_write_kb":144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'194","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.345563+0000","last_change":"2024-09-12T01:37:47.345506+0000","last_active":"2024-09-12T01:37:47.345563+0000","last_peered":"2024-09-12T01:37:47.345563+0000","last_clean":"2024-09-12T01:37:47.345563+0000","last_became_active":"2024-09-12T00:25:00.456071+0000","last_became_peered":"2024-09-12T00:25:00.456071+0000","last_unstale":"2024-09-12T01:37:47.345563+0000","last_undegraded":"2024-09-12T01:37:47.345563+0000","last_fullsized":"2024-09-12T01:37:47.345563+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T01:37:47.345386+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T01:37:47.345386+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.345386+0000","objects_scrubbed":2,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:11.275739+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":425,"num_read_kb":39651,"num_write":895,"num_write_kb":24320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":542,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.028063+0000","last_change":"2024-09-12T01:37:48.027962+0000","last_active":"2024-09-12T01:37:48.028063+0000","last_peered":"2024-09-12T01:37:48.028063+0000","last_clean":"2024-09-12T01:37:48.028063+0000","last_became_active":"2024-09-12T00:24:46.425908+0000","last_became_peered":"2024-09-12T00:24:46.425908+0000","last_unstale":"2024-09-12T01:37:48.028063+0000","last_undegraded":"2024-09-12T01:37:48.028063+0000","last_fullsized":"2024-09-12T01:37:48.028063+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:48.027858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:48.027858+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.027858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:11:23.250488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00085110299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"266'4","reported_seq":1001,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.324004+0000","last_change":"2024-09-12T01:38:02.324004+0000","last_active":"2024-09-12T01:38:02.324004+0000","last_peered":"2024-09-12T01:38:02.324004+0000","last_clean":"2024-09-12T01:38:02.324004+0000","last_became_active":"2024-09-12T00:25:04.481193+0000","last_became_peered":"2024-09-12T00:25:04.481193+0000","last_unstale":"2024-09-12T01:38:02.324004+0000","last_undegraded":"2024-09-12T01:38:02.324004+0000","last_fullsized":"2024-09-12T01:38:02.324004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T01:38:02.323921+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T01:38:02.323921+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.323921+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:10.000536+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'363","reported_seq":1124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.905478+0000","last_change":"2024-09-12T01:38:07.905478+0000","last_active":"2024-09-12T01:38:07.905478+0000","last_peered":"2024-09-12T01:38:07.905478+0000","last_clean":"2024-09-12T01:38:07.905478+0000","last_became_active":"2024-09-12T00:25:06.492189+0000","last_became_peered":"2024-09-12T00:25:06.492189+0000","last_unstale":"2024-09-12T01:38:07.905478+0000","last_undegraded":"2024-09-12T01:38:07.905478+0000","last_fullsized":"2024-09-12T01:38:07.905478+0000","mapping_epoch":32,"log_start":"266'300","ondisk_log_start":"266'300","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'363","last_scrub_stamp":"2024-09-12T01:38:07.905398+0000","last_deep_scrub":"266'363","last_deep_scrub_stamp":"2024-09-12T01:38:07.905398+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.905398+0000","objects_scrubbed":9,"log_size":63,"log_dups_size":300,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:03.334289+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35877,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":534,"num_read_kb":729,"num_write":282,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":516,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.320472+0000","last_change":"2024-09-12T01:38:16.320472+0000","last_active":"2024-09-12T01:38:16.320472+0000","last_peered":"2024-09-12T01:38:16.320472+0000","last_clean":"2024-09-12T01:38:16.320472+0000","last_became_active":"2024-09-12T00:25:08.510167+0000","last_became_peered":"2024-09-12T00:25:08.510167+0000","last_unstale":"2024-09-12T01:38:16.320472+0000","last_undegraded":"2024-09-12T01:38:16.320472+0000","last_fullsized":"2024-09-12T01:38:16.320472+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.320380+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.320380+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.320380+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:41.231640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'114","reported_seq":638,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:10.715272+0000","last_change":"2024-09-12T01:38:10.715272+0000","last_active":"2024-09-12T01:38:10.715272+0000","last_peered":"2024-09-12T01:38:10.715272+0000","last_clean":"2024-09-12T01:38:10.715272+0000","last_became_active":"2024-09-12T00:25:10.525850+0000","last_became_peered":"2024-09-12T00:25:10.525850+0000","last_unstale":"2024-09-12T01:38:10.715272+0000","last_undegraded":"2024-09-12T01:38:10.715272+0000","last_fullsized":"2024-09-12T01:38:10.715272+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'114","last_scrub_stamp":"2024-09-12T01:38:10.715162+0000","last_deep_scrub":"266'114","last_deep_scrub_stamp":"2024-09-12T01:38:10.715162+0000","last_clean_scrub_stamp":"2024-09-12T01:38:10.715162+0000","objects_scrubbed":2,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:45:08.764289+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":143,"num_read_kb":133,"num_write":273,"num_write_kb":64,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'145","reported_seq":725,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.343143+0000","last_change":"2024-09-12T01:38:21.343143+0000","last_active":"2024-09-12T01:38:21.343143+0000","last_peered":"2024-09-12T01:38:21.343143+0000","last_clean":"2024-09-12T01:38:21.343143+0000","last_became_active":"2024-09-12T00:25:10.526982+0000","last_became_peered":"2024-09-12T00:25:10.526982+0000","last_unstale":"2024-09-12T01:38:21.343143+0000","last_undegraded":"2024-09-12T01:38:21.343143+0000","last_fullsized":"2024-09-12T01:38:21.343143+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'145","last_scrub_stamp":"2024-09-12T01:38:21.343057+0000","last_deep_scrub":"266'145","last_deep_scrub_stamp":"2024-09-12T01:38:21.343057+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.343057+0000","objects_scrubbed":1,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:16:23.156543+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":215,"num_read_kb":212,"num_write":342,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'496","reported_seq":2085,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.678973+0000","last_change":"2024-09-12T01:37:58.678973+0000","last_active":"2024-09-12T01:37:58.678973+0000","last_peered":"2024-09-12T01:37:58.678973+0000","last_clean":"2024-09-12T01:37:58.678973+0000","last_became_active":"2024-09-12T00:25:02.472013+0000","last_became_peered":"2024-09-12T00:25:02.472013+0000","last_unstale":"2024-09-12T01:37:58.678973+0000","last_undegraded":"2024-09-12T01:37:58.678973+0000","last_fullsized":"2024-09-12T01:37:58.678973+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'496","last_scrub_stamp":"2024-09-12T01:37:58.678883+0000","last_deep_scrub":"266'496","last_deep_scrub_stamp":"2024-09-12T01:37:58.678883+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.678883+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":400,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:48.894785+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2517,"num_read_kb":2353,"num_write":593,"num_write_kb":139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":915,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'215","reported_seq":925,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.079193+0000","last_change":"2024-09-12T01:37:54.079193+0000","last_active":"2024-09-12T01:37:54.079193+0000","last_peered":"2024-09-12T01:37:54.079193+0000","last_clean":"2024-09-12T01:37:54.079193+0000","last_became_active":"2024-09-12T00:25:00.473591+0000","last_became_peered":"2024-09-12T00:25:00.473591+0000","last_unstale":"2024-09-12T01:37:54.079193+0000","last_undegraded":"2024-09-12T01:37:54.079193+0000","last_fullsized":"2024-09-12T01:37:54.079193+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'215","last_scrub_stamp":"2024-09-12T01:37:54.079022+0000","last_deep_scrub":"266'215","last_deep_scrub_stamp":"2024-09-12T01:37:54.079022+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.079022+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:47.035499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1308446,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":607,"num_read_kb":52508,"num_write":917,"num_write_kb":35191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,0],"acting":[3,2,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.358724+0000","last_change":"2024-09-12T01:38:02.358724+0000","last_active":"2024-09-12T01:38:02.358724+0000","last_peered":"2024-09-12T01:38:02.358724+0000","last_clean":"2024-09-12T01:38:02.358724+0000","last_became_active":"2024-09-12T00:25:04.479701+0000","last_became_peered":"2024-09-12T00:25:04.479701+0000","last_unstale":"2024-09-12T01:38:02.358724+0000","last_undegraded":"2024-09-12T01:38:02.358724+0000","last_fullsized":"2024-09-12T01:38:02.358724+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:02.358607+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:02.358607+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.358607+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:07:44.972389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'165","reported_seq":769,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.346059+0000","last_change":"2024-09-12T01:38:05.346059+0000","last_active":"2024-09-12T01:38:05.346059+0000","last_peered":"2024-09-12T01:38:05.346059+0000","last_clean":"2024-09-12T01:38:05.346059+0000","last_became_active":"2024-09-12T00:25:06.500315+0000","last_became_peered":"2024-09-12T00:25:06.500315+0000","last_unstale":"2024-09-12T01:38:05.346059+0000","last_undegraded":"2024-09-12T01:38:05.346059+0000","last_fullsized":"2024-09-12T01:38:05.346059+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'165","last_scrub_stamp":"2024-09-12T01:38:05.345948+0000","last_deep_scrub":"266'165","last_deep_scrub_stamp":"2024-09-12T01:38:05.345948+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.345948+0000","objects_scrubbed":6,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:32:21.892254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6391,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":221,"num_read_kb":264,"num_write":122,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.455856+0000","last_change":"2024-09-12T01:38:05.455856+0000","last_active":"2024-09-12T01:38:05.455856+0000","last_peered":"2024-09-12T01:38:05.455856+0000","last_clean":"2024-09-12T01:38:05.455856+0000","last_became_active":"2024-09-12T00:25:08.516921+0000","last_became_peered":"2024-09-12T00:25:08.516921+0000","last_unstale":"2024-09-12T01:38:05.455856+0000","last_undegraded":"2024-09-12T01:38:05.455856+0000","last_fullsized":"2024-09-12T01:38:05.455856+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:05.455763+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:05.455763+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.455763+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:59.136353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'117","reported_seq":646,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:12.600520+0000","last_change":"2024-09-12T01:38:12.600520+0000","last_active":"2024-09-12T01:38:12.600520+0000","last_peered":"2024-09-12T01:38:12.600520+0000","last_clean":"2024-09-12T01:38:12.600520+0000","last_became_active":"2024-09-12T00:25:10.524416+0000","last_became_peered":"2024-09-12T00:25:10.524416+0000","last_unstale":"2024-09-12T01:38:12.600520+0000","last_undegraded":"2024-09-12T01:38:12.600520+0000","last_fullsized":"2024-09-12T01:38:12.600520+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'117","last_scrub_stamp":"2024-09-12T01:38:12.600439+0000","last_deep_scrub":"266'117","last_deep_scrub_stamp":"2024-09-12T01:38:12.600439+0000","last_clean_scrub_stamp":"2024-09-12T01:38:12.600439+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":100,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:39:05.748283+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":450,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":157,"num_read_kb":134,"num_write":274,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'452","reported_seq":2023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.345223+0000","last_change":"2024-09-12T01:37:55.345223+0000","last_active":"2024-09-12T01:37:55.345223+0000","last_peered":"2024-09-12T01:37:55.345223+0000","last_clean":"2024-09-12T01:37:55.345223+0000","last_became_active":"2024-09-12T00:25:02.471242+0000","last_became_peered":"2024-09-12T00:25:02.471242+0000","last_unstale":"2024-09-12T01:37:55.345223+0000","last_undegraded":"2024-09-12T01:37:55.345223+0000","last_fullsized":"2024-09-12T01:37:55.345223+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'452","last_scrub_stamp":"2024-09-12T01:37:55.345130+0000","last_deep_scrub":"266'452","last_deep_scrub_stamp":"2024-09-12T01:37:55.345130+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.345130+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":400,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:12.582586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2437,"num_read_kb":2317,"num_write":523,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'218","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.943850+0000","last_change":"2024-09-12T01:37:45.943850+0000","last_active":"2024-09-12T01:37:45.943850+0000","last_peered":"2024-09-12T01:37:45.943850+0000","last_clean":"2024-09-12T01:37:45.943850+0000","last_became_active":"2024-09-12T00:25:00.480801+0000","last_became_peered":"2024-09-12T00:25:00.480801+0000","last_unstale":"2024-09-12T01:37:45.943850+0000","last_undegraded":"2024-09-12T01:37:45.943850+0000","last_fullsized":"2024-09-12T01:37:45.943850+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T01:37:45.943735+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T01:37:45.943735+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.943735+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:49.180449+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288330,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":555,"num_read_kb":14522,"num_write":924,"num_write_kb":19421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3,2],"acting":[0,6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":520,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.322852+0000","last_change":"2024-09-12T01:38:04.322852+0000","last_active":"2024-09-12T01:38:04.322852+0000","last_peered":"2024-09-12T01:38:04.322852+0000","last_clean":"2024-09-12T01:38:04.322852+0000","last_became_active":"2024-09-12T00:25:04.482891+0000","last_became_peered":"2024-09-12T00:25:04.482891+0000","last_unstale":"2024-09-12T01:38:04.322852+0000","last_undegraded":"2024-09-12T01:38:04.322852+0000","last_fullsized":"2024-09-12T01:38:04.322852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:04.322768+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:04.322768+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.322768+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:45.135306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'71","reported_seq":603,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:11.383729+0000","last_change":"2024-09-12T01:38:11.383729+0000","last_active":"2024-09-12T01:38:11.383729+0000","last_peered":"2024-09-12T01:38:11.383729+0000","last_clean":"2024-09-12T01:38:11.383729+0000","last_became_active":"2024-09-12T00:25:06.501049+0000","last_became_peered":"2024-09-12T00:25:06.501049+0000","last_unstale":"2024-09-12T01:38:11.383729+0000","last_undegraded":"2024-09-12T01:38:11.383729+0000","last_fullsized":"2024-09-12T01:38:11.383729+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'71","last_scrub_stamp":"2024-09-12T01:38:11.383640+0000","last_deep_scrub":"266'71","last_deep_scrub_stamp":"2024-09-12T01:38:11.383640+0000","last_clean_scrub_stamp":"2024-09-12T01:38:11.383640+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:10.663064+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":53,"num_read_kb":50,"num_write":40,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":588,"num_omap_keys":4,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.719255+0000","last_change":"2024-09-12T01:38:06.719255+0000","last_active":"2024-09-12T01:38:06.719255+0000","last_peered":"2024-09-12T01:38:06.719255+0000","last_clean":"2024-09-12T01:38:06.719255+0000","last_became_active":"2024-09-12T00:25:08.506052+0000","last_became_peered":"2024-09-12T00:25:08.506052+0000","last_unstale":"2024-09-12T01:38:06.719255+0000","last_undegraded":"2024-09-12T01:38:06.719255+0000","last_fullsized":"2024-09-12T01:38:06.719255+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.719155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.719155+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.719155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:43:28.734275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'180","reported_seq":715,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:15.347388+0000","last_change":"2024-09-12T01:38:15.347388+0000","last_active":"2024-09-12T01:38:15.347388+0000","last_peered":"2024-09-12T01:38:15.347388+0000","last_clean":"2024-09-12T01:38:15.347388+0000","last_became_active":"2024-09-12T00:25:10.524992+0000","last_became_peered":"2024-09-12T00:25:10.524992+0000","last_unstale":"2024-09-12T01:38:15.347388+0000","last_undegraded":"2024-09-12T01:38:15.347388+0000","last_fullsized":"2024-09-12T01:38:15.347388+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'180","last_scrub_stamp":"2024-09-12T01:38:15.347294+0000","last_deep_scrub":"266'180","last_deep_scrub_stamp":"2024-09-12T01:38:15.347294+0000","last_clean_scrub_stamp":"2024-09-12T01:38:15.347294+0000","objects_scrubbed":3,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:38:01.054437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":843,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":300,"num_read_kb":289,"num_write":406,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'595","reported_seq":2223,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.346689+0000","last_change":"2024-09-12T01:37:54.346689+0000","last_active":"2024-09-12T01:37:54.346689+0000","last_peered":"2024-09-12T01:37:54.346689+0000","last_clean":"2024-09-12T01:37:54.346689+0000","last_became_active":"2024-09-12T00:25:02.468715+0000","last_became_peered":"2024-09-12T00:25:02.468715+0000","last_unstale":"2024-09-12T01:37:54.346689+0000","last_undegraded":"2024-09-12T01:37:54.346689+0000","last_fullsized":"2024-09-12T01:37:54.346689+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'595","last_scrub_stamp":"2024-09-12T01:37:54.346601+0000","last_deep_scrub":"266'595","last_deep_scrub_stamp":"2024-09-12T01:37:54.346601+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.346601+0000","objects_scrubbed":2,"log_size":95,"log_dups_size":500,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:05.177000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2927,"num_read_kb":2680,"num_write":750,"num_write_kb":214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":709,"num_omap_keys":3,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'255","reported_seq":912,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.596087+0000","last_change":"2024-09-12T01:37:46.596087+0000","last_active":"2024-09-12T01:37:46.596087+0000","last_peered":"2024-09-12T01:37:46.596087+0000","last_clean":"2024-09-12T01:37:46.596087+0000","last_became_active":"2024-09-12T00:25:00.481741+0000","last_became_peered":"2024-09-12T00:25:00.481741+0000","last_unstale":"2024-09-12T01:37:46.596087+0000","last_undegraded":"2024-09-12T01:37:46.596087+0000","last_fullsized":"2024-09-12T01:37:46.596087+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'255","last_scrub_stamp":"2024-09-12T01:37:46.595992+0000","last_deep_scrub":"266'255","last_deep_scrub_stamp":"2024-09-12T01:37:46.595992+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.595992+0000","objects_scrubbed":4,"log_size":55,"log_dups_size":200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:06.212123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2267306,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":534,"num_read_kb":2782,"num_write":1086,"num_write_kb":27824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4,5],"acting":[2,3,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.701698+0000","last_change":"2024-09-12T01:37:56.701698+0000","last_active":"2024-09-12T01:37:56.701698+0000","last_peered":"2024-09-12T01:37:56.701698+0000","last_clean":"2024-09-12T01:37:56.701698+0000","last_became_active":"2024-09-12T00:25:04.476356+0000","last_became_peered":"2024-09-12T00:25:04.476356+0000","last_unstale":"2024-09-12T01:37:56.701698+0000","last_undegraded":"2024-09-12T01:37:56.701698+0000","last_fullsized":"2024-09-12T01:37:56.701698+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:56.701593+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:56.701593+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.701593+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:08.927814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'190","reported_seq":805,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.376453+0000","last_change":"2024-09-12T01:38:03.376453+0000","last_active":"2024-09-12T01:38:03.376453+0000","last_peered":"2024-09-12T01:38:03.376453+0000","last_clean":"2024-09-12T01:38:03.376453+0000","last_became_active":"2024-09-12T00:25:06.496372+0000","last_became_peered":"2024-09-12T00:25:06.496372+0000","last_unstale":"2024-09-12T01:38:03.376453+0000","last_undegraded":"2024-09-12T01:38:03.376453+0000","last_fullsized":"2024-09-12T01:38:03.376453+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T01:38:03.376353+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T01:38:03.376353+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.376353+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:08.691744+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11132,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":274,"num_read_kb":379,"num_write":160,"num_write_kb":37,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.840360+0000","last_change":"2024-09-12T01:38:07.840360+0000","last_active":"2024-09-12T01:38:07.840360+0000","last_peered":"2024-09-12T01:38:07.840360+0000","last_clean":"2024-09-12T01:38:07.840360+0000","last_became_active":"2024-09-12T00:25:08.508336+0000","last_became_peered":"2024-09-12T00:25:08.508336+0000","last_unstale":"2024-09-12T01:38:07.840360+0000","last_undegraded":"2024-09-12T01:38:07.840360+0000","last_fullsized":"2024-09-12T01:38:07.840360+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.840285+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.840285+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.840285+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:52:32.057572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'123","reported_seq":654,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.955167+0000","last_change":"2024-09-12T01:38:31.955167+0000","last_active":"2024-09-12T01:38:31.955167+0000","last_peered":"2024-09-12T01:38:31.955167+0000","last_clean":"2024-09-12T01:38:31.955167+0000","last_became_active":"2024-09-12T00:25:10.522375+0000","last_became_peered":"2024-09-12T00:25:10.522375+0000","last_unstale":"2024-09-12T01:38:31.955167+0000","last_undegraded":"2024-09-12T01:38:31.955167+0000","last_fullsized":"2024-09-12T01:38:31.955167+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'123","last_scrub_stamp":"2024-09-12T01:38:31.955067+0000","last_deep_scrub":"266'123","last_deep_scrub_stamp":"2024-09-12T01:38:31.955067+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.955067+0000","objects_scrubbed":1,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:48:16.929043+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":171,"num_write":308,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'820","reported_seq":2393,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.393858+0000","last_change":"2024-09-12T01:37:53.393858+0000","last_active":"2024-09-12T01:37:53.393858+0000","last_peered":"2024-09-12T01:37:53.393858+0000","last_clean":"2024-09-12T01:37:53.393858+0000","last_became_active":"2024-09-12T00:25:02.473631+0000","last_became_peered":"2024-09-12T00:25:02.473631+0000","last_unstale":"2024-09-12T01:37:53.393858+0000","last_undegraded":"2024-09-12T01:37:53.393858+0000","last_fullsized":"2024-09-12T01:37:53.393858+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'820","last_scrub_stamp":"2024-09-12T01:37:53.393766+0000","last_deep_scrub":"266'820","last_deep_scrub_stamp":"2024-09-12T01:37:53.393766+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.393766+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":800,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:41.670020+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3838,"num_read_kb":3448,"num_write":1071,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'213","reported_seq":864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.499745+0000","last_change":"2024-09-12T01:37:48.499745+0000","last_active":"2024-09-12T01:37:48.499745+0000","last_peered":"2024-09-12T01:37:48.499745+0000","last_clean":"2024-09-12T01:37:48.499745+0000","last_became_active":"2024-09-12T00:25:00.461875+0000","last_became_peered":"2024-09-12T00:25:00.461875+0000","last_unstale":"2024-09-12T01:37:48.499745+0000","last_undegraded":"2024-09-12T01:37:48.499745+0000","last_fullsized":"2024-09-12T01:37:48.499745+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T01:37:48.499573+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T01:37:48.499573+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.499573+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:58:13.359367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":288524,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":40693,"num_write":998,"num_write_kb":39273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1,7],"acting":[5,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":512,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:16.973594+0000","last_change":"2024-09-12T01:38:16.973594+0000","last_active":"2024-09-12T01:38:16.973594+0000","last_peered":"2024-09-12T01:38:16.973594+0000","last_clean":"2024-09-12T01:38:16.973594+0000","last_became_active":"2024-09-12T00:25:04.486195+0000","last_became_peered":"2024-09-12T00:25:04.486195+0000","last_unstale":"2024-09-12T01:38:16.973594+0000","last_undegraded":"2024-09-12T01:38:16.973594+0000","last_fullsized":"2024-09-12T01:38:16.973594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:16.973512+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:16.973512+0000","last_clean_scrub_stamp":"2024-09-12T01:38:16.973512+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:16.357642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'156","reported_seq":753,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:04.901261+0000","last_change":"2024-09-12T01:38:04.901261+0000","last_active":"2024-09-12T01:38:04.901261+0000","last_peered":"2024-09-12T01:38:04.901261+0000","last_clean":"2024-09-12T01:38:04.901261+0000","last_became_active":"2024-09-12T00:25:06.493276+0000","last_became_peered":"2024-09-12T00:25:06.493276+0000","last_unstale":"2024-09-12T01:38:04.901261+0000","last_undegraded":"2024-09-12T01:38:04.901261+0000","last_fullsized":"2024-09-12T01:38:04.901261+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'156","last_scrub_stamp":"2024-09-12T01:38:04.901177+0000","last_deep_scrub":"266'156","last_deep_scrub_stamp":"2024-09-12T01:38:04.901177+0000","last_clean_scrub_stamp":"2024-09-12T01:38:04.901177+0000","objects_scrubbed":4,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:48:57.450229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7881,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":196,"num_read_kb":282,"num_write":108,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.500037+0000","last_change":"2024-09-12T01:38:06.500037+0000","last_active":"2024-09-12T01:38:06.500037+0000","last_peered":"2024-09-12T01:38:06.500037+0000","last_clean":"2024-09-12T01:38:06.500037+0000","last_became_active":"2024-09-12T00:25:08.512647+0000","last_became_peered":"2024-09-12T00:25:08.512647+0000","last_unstale":"2024-09-12T01:38:06.500037+0000","last_undegraded":"2024-09-12T01:38:06.500037+0000","last_fullsized":"2024-09-12T01:38:06.500037+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.499944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.499944+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.499944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:02.711620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'319","reported_seq":1624,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.948895+0000","last_change":"2024-09-12T01:38:05.948895+0000","last_active":"2024-09-12T01:38:05.948895+0000","last_peered":"2024-09-12T01:38:05.948895+0000","last_clean":"2024-09-12T01:38:05.948895+0000","last_became_active":"2024-09-12T00:25:02.475490+0000","last_became_peered":"2024-09-12T00:25:02.475490+0000","last_unstale":"2024-09-12T01:38:05.948895+0000","last_undegraded":"2024-09-12T01:38:05.948895+0000","last_fullsized":"2024-09-12T01:38:05.948895+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'319","last_scrub_stamp":"2024-09-12T01:38:05.948806+0000","last_deep_scrub":"266'319","last_deep_scrub_stamp":"2024-09-12T01:38:05.948806+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.948806+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":300,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:54.471792+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1691,"num_read_kb":1609,"num_write":373,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'212","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.535689+0000","last_change":"2024-09-12T01:37:49.535689+0000","last_active":"2024-09-12T01:37:49.535689+0000","last_peered":"2024-09-12T01:37:49.535689+0000","last_clean":"2024-09-12T01:37:49.535689+0000","last_became_active":"2024-09-12T00:25:00.462022+0000","last_became_peered":"2024-09-12T00:25:00.462022+0000","last_unstale":"2024-09-12T01:37:49.535689+0000","last_undegraded":"2024-09-12T01:37:49.535689+0000","last_fullsized":"2024-09-12T01:37:49.535689+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'212","last_scrub_stamp":"2024-09-12T01:37:49.535559+0000","last_deep_scrub":"266'212","last_deep_scrub_stamp":"2024-09-12T01:37:49.535559+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.535559+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:49.433083+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":375,"num_read_kb":5153,"num_write":1017,"num_write_kb":32149,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3,4],"acting":[5,6,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:03.330858+0000","last_change":"2024-09-12T01:38:03.330858+0000","last_active":"2024-09-12T01:38:03.330858+0000","last_peered":"2024-09-12T01:38:03.330858+0000","last_clean":"2024-09-12T01:38:03.330858+0000","last_became_active":"2024-09-12T00:25:04.487192+0000","last_became_peered":"2024-09-12T00:25:04.487192+0000","last_unstale":"2024-09-12T01:38:03.330858+0000","last_undegraded":"2024-09-12T01:38:03.330858+0000","last_fullsized":"2024-09-12T01:38:03.330858+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:03.330758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:03.330758+0000","last_clean_scrub_stamp":"2024-09-12T01:38:03.330758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:15.689513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'234","reported_seq":889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.365222+0000","last_change":"2024-09-12T01:38:08.365222+0000","last_active":"2024-09-12T01:38:08.365222+0000","last_peered":"2024-09-12T01:38:08.365222+0000","last_clean":"2024-09-12T01:38:08.365222+0000","last_became_active":"2024-09-12T00:25:06.498651+0000","last_became_peered":"2024-09-12T00:25:06.498651+0000","last_unstale":"2024-09-12T01:38:08.365222+0000","last_undegraded":"2024-09-12T01:38:08.365222+0000","last_fullsized":"2024-09-12T01:38:08.365222+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'234","last_scrub_stamp":"2024-09-12T01:38:08.365132+0000","last_deep_scrub":"266'234","last_deep_scrub_stamp":"2024-09-12T01:38:08.365132+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.365132+0000","objects_scrubbed":7,"log_size":34,"log_dups_size":200,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:46.680906+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9365,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":332,"num_read_kb":425,"num_write":210,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.764797+0000","last_change":"2024-09-12T01:38:07.764797+0000","last_active":"2024-09-12T01:38:07.764797+0000","last_peered":"2024-09-12T01:38:07.764797+0000","last_clean":"2024-09-12T01:38:07.764797+0000","last_became_active":"2024-09-12T00:25:08.507090+0000","last_became_peered":"2024-09-12T00:25:08.507090+0000","last_unstale":"2024-09-12T01:38:07.764797+0000","last_undegraded":"2024-09-12T01:38:07.764797+0000","last_fullsized":"2024-09-12T01:38:07.764797+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:07.764725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:07.764725+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.764725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:45.746935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'189","reported_seq":718,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.683694+0000","last_change":"2024-09-12T01:38:21.683694+0000","last_active":"2024-09-12T01:38:21.683694+0000","last_peered":"2024-09-12T01:38:21.683694+0000","last_clean":"2024-09-12T01:38:21.683694+0000","last_became_active":"2024-09-12T00:25:10.521886+0000","last_became_peered":"2024-09-12T00:25:10.521886+0000","last_unstale":"2024-09-12T01:38:21.683694+0000","last_undegraded":"2024-09-12T01:38:21.683694+0000","last_fullsized":"2024-09-12T01:38:21.683694+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'189","last_scrub_stamp":"2024-09-12T01:38:21.683585+0000","last_deep_scrub":"266'189","last_deep_scrub_stamp":"2024-09-12T01:38:21.683585+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.683585+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:20:09.718529+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":280,"num_read_kb":274,"num_write":435,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'457","reported_seq":1954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.372563+0000","last_change":"2024-09-12T01:37:59.372563+0000","last_active":"2024-09-12T01:37:59.372563+0000","last_peered":"2024-09-12T01:37:59.372563+0000","last_clean":"2024-09-12T01:37:59.372563+0000","last_became_active":"2024-09-12T00:25:02.463187+0000","last_became_peered":"2024-09-12T00:25:02.463187+0000","last_unstale":"2024-09-12T01:37:59.372563+0000","last_undegraded":"2024-09-12T01:37:59.372563+0000","last_fullsized":"2024-09-12T01:37:59.372563+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'457","last_scrub_stamp":"2024-09-12T01:37:59.372473+0000","last_deep_scrub":"266'457","last_deep_scrub_stamp":"2024-09-12T01:37:59.372473+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.372473+0000","objects_scrubbed":1,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:38.818995+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2353,"num_read_kb":2190,"num_write":565,"num_write_kb":141,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'299","reported_seq":996,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.379895+0000","last_change":"2024-09-12T01:37:50.379895+0000","last_active":"2024-09-12T01:37:50.379895+0000","last_peered":"2024-09-12T01:37:50.379895+0000","last_clean":"2024-09-12T01:37:50.379895+0000","last_became_active":"2024-09-12T00:25:00.467785+0000","last_became_peered":"2024-09-12T00:25:00.467785+0000","last_unstale":"2024-09-12T01:37:50.379895+0000","last_undegraded":"2024-09-12T01:37:50.379895+0000","last_fullsized":"2024-09-12T01:37:50.379895+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'299","last_scrub_stamp":"2024-09-12T01:37:50.379775+0000","last_deep_scrub":"266'299","last_deep_scrub_stamp":"2024-09-12T01:37:50.379775+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.379775+0000","objects_scrubbed":4,"log_size":99,"log_dups_size":200,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:11:15.751538+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":44,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":731,"num_read_kb":946,"num_write":1133,"num_write_kb":20145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,1,2],"acting":[4,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":519,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.756573+0000","last_change":"2024-09-12T01:38:02.756573+0000","last_active":"2024-09-12T01:38:02.756573+0000","last_peered":"2024-09-12T01:38:02.756573+0000","last_clean":"2024-09-12T01:38:02.756573+0000","last_became_active":"2024-09-12T00:25:04.484608+0000","last_became_peered":"2024-09-12T00:25:04.484608+0000","last_unstale":"2024-09-12T01:38:02.756573+0000","last_undegraded":"2024-09-12T01:38:02.756573+0000","last_fullsized":"2024-09-12T01:38:02.756573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:02.756483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:02.756483+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.756483+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:30.789022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'206","reported_seq":821,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:20.911197+0000","last_change":"2024-09-12T01:38:20.911197+0000","last_active":"2024-09-12T01:38:20.911197+0000","last_peered":"2024-09-12T01:38:20.911197+0000","last_clean":"2024-09-12T01:38:20.911197+0000","last_became_active":"2024-09-12T00:25:06.489578+0000","last_became_peered":"2024-09-12T00:25:06.489578+0000","last_unstale":"2024-09-12T01:38:20.911197+0000","last_undegraded":"2024-09-12T01:38:20.911197+0000","last_fullsized":"2024-09-12T01:38:20.911197+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T01:38:20.911089+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T01:38:20.911089+0000","last_clean_scrub_stamp":"2024-09-12T01:38:20.911089+0000","objects_scrubbed":8,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:13.469452+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7791,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":284,"num_read_kb":342,"num_write":192,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:17.642906+0000","last_change":"2024-09-12T01:38:17.642906+0000","last_active":"2024-09-12T01:38:17.642906+0000","last_peered":"2024-09-12T01:38:17.642906+0000","last_clean":"2024-09-12T01:38:17.642906+0000","last_became_active":"2024-09-12T00:25:08.513330+0000","last_became_peered":"2024-09-12T00:25:08.513330+0000","last_unstale":"2024-09-12T01:38:17.642906+0000","last_undegraded":"2024-09-12T01:38:17.642906+0000","last_fullsized":"2024-09-12T01:38:17.642906+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:17.642819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:17.642819+0000","last_clean_scrub_stamp":"2024-09-12T01:38:17.642819+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:07.634535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'224","reported_seq":1114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:27.965993+0000","last_change":"2024-09-12T01:38:27.965993+0000","last_active":"2024-09-12T01:38:27.965993+0000","last_peered":"2024-09-12T01:38:27.965993+0000","last_clean":"2024-09-12T01:38:27.965993+0000","last_became_active":"2024-09-12T00:25:10.527649+0000","last_became_peered":"2024-09-12T00:25:10.527649+0000","last_unstale":"2024-09-12T01:38:27.965993+0000","last_undegraded":"2024-09-12T01:38:27.965993+0000","last_fullsized":"2024-09-12T01:38:27.965993+0000","mapping_epoch":36,"log_start":"266'200","ondisk_log_start":"266'200","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'224","last_scrub_stamp":"2024-09-12T01:38:27.965920+0000","last_deep_scrub":"266'224","last_deep_scrub_stamp":"2024-09-12T01:38:27.965920+0000","last_clean_scrub_stamp":"2024-09-12T01:38:27.965920+0000","objects_scrubbed":6,"log_size":24,"log_dups_size":200,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:55.228327+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1215,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":660,"num_read_kb":648,"num_write":596,"num_write_kb":150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'368","reported_seq":1826,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.442383+0000","last_change":"2024-09-12T01:37:54.442383+0000","last_active":"2024-09-12T01:37:54.442383+0000","last_peered":"2024-09-12T01:37:54.442383+0000","last_clean":"2024-09-12T01:37:54.442383+0000","last_became_active":"2024-09-12T00:25:02.479051+0000","last_became_peered":"2024-09-12T00:25:02.479051+0000","last_unstale":"2024-09-12T01:37:54.442383+0000","last_undegraded":"2024-09-12T01:37:54.442383+0000","last_fullsized":"2024-09-12T01:37:54.442383+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'368","last_scrub_stamp":"2024-09-12T01:37:54.442292+0000","last_deep_scrub":"266'368","last_deep_scrub_stamp":"2024-09-12T01:37:54.442292+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.442292+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:20.538747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1895,"num_read_kb":1824,"num_write":392,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'196","reported_seq":837,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:45.788273+0000","last_change":"2024-09-12T01:37:45.788273+0000","last_active":"2024-09-12T01:37:45.788273+0000","last_peered":"2024-09-12T01:37:45.788273+0000","last_clean":"2024-09-12T01:37:45.788273+0000","last_became_active":"2024-09-12T00:25:00.454796+0000","last_became_peered":"2024-09-12T00:25:00.454796+0000","last_unstale":"2024-09-12T01:37:45.788273+0000","last_undegraded":"2024-09-12T01:37:45.788273+0000","last_fullsized":"2024-09-12T01:37:45.788273+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T01:37:45.788160+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T01:37:45.788160+0000","last_clean_scrub_stamp":"2024-09-12T01:37:45.788160+0000","objects_scrubbed":5,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:06:20.838772+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":661693,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":2462,"num_write":975,"num_write_kb":27053,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,7],"acting":[1,5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.708068+0000","last_change":"2024-09-12T01:38:01.708068+0000","last_active":"2024-09-12T01:38:01.708068+0000","last_peered":"2024-09-12T01:38:01.708068+0000","last_clean":"2024-09-12T01:38:01.708068+0000","last_became_active":"2024-09-12T00:25:04.475432+0000","last_became_peered":"2024-09-12T00:25:04.475432+0000","last_unstale":"2024-09-12T01:38:01.708068+0000","last_undegraded":"2024-09-12T01:38:01.708068+0000","last_fullsized":"2024-09-12T01:38:01.708068+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:01.707983+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:01.707983+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.707983+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:32:20.862812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'180","reported_seq":788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:09.331794+0000","last_change":"2024-09-12T01:38:09.331794+0000","last_active":"2024-09-12T01:38:09.331794+0000","last_peered":"2024-09-12T01:38:09.331794+0000","last_clean":"2024-09-12T01:38:09.331794+0000","last_became_active":"2024-09-12T00:25:06.499452+0000","last_became_peered":"2024-09-12T00:25:06.499452+0000","last_unstale":"2024-09-12T01:38:09.331794+0000","last_undegraded":"2024-09-12T01:38:09.331794+0000","last_fullsized":"2024-09-12T01:38:09.331794+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'180","last_scrub_stamp":"2024-09-12T01:38:09.331674+0000","last_deep_scrub":"266'180","last_deep_scrub_stamp":"2024-09-12T01:38:09.331674+0000","last_clean_scrub_stamp":"2024-09-12T01:38:09.331674+0000","objects_scrubbed":6,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:36:03.045246+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6920,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":229,"num_read_kb":302,"num_write":132,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.518586+0000","last_change":"2024-09-12T01:38:08.518586+0000","last_active":"2024-09-12T01:38:08.518586+0000","last_peered":"2024-09-12T01:38:08.518586+0000","last_clean":"2024-09-12T01:38:08.518586+0000","last_became_active":"2024-09-12T00:25:08.514591+0000","last_became_peered":"2024-09-12T00:25:08.514591+0000","last_unstale":"2024-09-12T01:38:08.518586+0000","last_undegraded":"2024-09-12T01:38:08.518586+0000","last_fullsized":"2024-09-12T01:38:08.518586+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.518472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.518472+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.518472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:53.955684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'123","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:30.016171+0000","last_change":"2024-09-12T01:38:30.016171+0000","last_active":"2024-09-12T01:38:30.016171+0000","last_peered":"2024-09-12T01:38:30.016171+0000","last_clean":"2024-09-12T01:38:30.016171+0000","last_became_active":"2024-09-12T00:25:10.527125+0000","last_became_peered":"2024-09-12T00:25:10.527125+0000","last_unstale":"2024-09-12T01:38:30.016171+0000","last_undegraded":"2024-09-12T01:38:30.016171+0000","last_fullsized":"2024-09-12T01:38:30.016171+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'123","last_scrub_stamp":"2024-09-12T01:38:30.016066+0000","last_deep_scrub":"266'123","last_deep_scrub_stamp":"2024-09-12T01:38:30.016066+0000","last_clean_scrub_stamp":"2024-09-12T01:38:30.016066+0000","objects_scrubbed":3,"log_size":23,"log_dups_size":100,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:51.613078+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":209,"num_read_kb":179,"num_write":283,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'798","reported_seq":2256,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.352870+0000","last_change":"2024-09-12T01:37:56.352870+0000","last_active":"2024-09-12T01:37:56.352870+0000","last_peered":"2024-09-12T01:37:56.352870+0000","last_clean":"2024-09-12T01:37:56.352870+0000","last_became_active":"2024-09-12T00:25:02.464409+0000","last_became_peered":"2024-09-12T00:25:02.464409+0000","last_unstale":"2024-09-12T01:37:56.352870+0000","last_undegraded":"2024-09-12T01:37:56.352870+0000","last_fullsized":"2024-09-12T01:37:56.352870+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'798","last_scrub_stamp":"2024-09-12T01:37:56.352774+0000","last_deep_scrub":"266'798","last_deep_scrub_stamp":"2024-09-12T01:37:56.352774+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.352774+0000","objects_scrubbed":1,"log_size":98,"log_dups_size":700,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:02:36.258745+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3724,"num_read_kb":3326,"num_write":1070,"num_write_kb":405,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'248","reported_seq":936,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.355633+0000","last_change":"2024-09-12T01:37:51.355633+0000","last_active":"2024-09-12T01:37:51.355633+0000","last_peered":"2024-09-12T01:37:51.355633+0000","last_clean":"2024-09-12T01:37:51.355633+0000","last_became_active":"2024-09-12T00:25:00.466015+0000","last_became_peered":"2024-09-12T00:25:00.466015+0000","last_unstale":"2024-09-12T01:37:51.355633+0000","last_undegraded":"2024-09-12T01:37:51.355633+0000","last_fullsized":"2024-09-12T01:37:51.355633+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'248","last_scrub_stamp":"2024-09-12T01:37:51.355483+0000","last_deep_scrub":"266'248","last_deep_scrub_stamp":"2024-09-12T01:37:51.355483+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.355483+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:21:25.590012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133705,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":553,"num_read_kb":59883,"num_write":1086,"num_write_kb":30675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.424591+0000","last_change":"2024-09-12T01:38:08.424591+0000","last_active":"2024-09-12T01:38:08.424591+0000","last_peered":"2024-09-12T01:38:08.424591+0000","last_clean":"2024-09-12T01:38:08.424591+0000","last_became_active":"2024-09-12T00:25:04.482091+0000","last_became_peered":"2024-09-12T00:25:04.482091+0000","last_unstale":"2024-09-12T01:38:08.424591+0000","last_undegraded":"2024-09-12T01:38:08.424591+0000","last_fullsized":"2024-09-12T01:38:08.424591+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:08.424471+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:08.424471+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.424471+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:45:04.775940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'132","reported_seq":691,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:21.875332+0000","last_change":"2024-09-12T01:38:21.875332+0000","last_active":"2024-09-12T01:38:21.875332+0000","last_peered":"2024-09-12T01:38:21.875332+0000","last_clean":"2024-09-12T01:38:21.875332+0000","last_became_active":"2024-09-12T00:25:06.491582+0000","last_became_peered":"2024-09-12T00:25:06.491582+0000","last_unstale":"2024-09-12T01:38:21.875332+0000","last_undegraded":"2024-09-12T01:38:21.875332+0000","last_fullsized":"2024-09-12T01:38:21.875332+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'132","last_scrub_stamp":"2024-09-12T01:38:21.875228+0000","last_deep_scrub":"266'132","last_deep_scrub_stamp":"2024-09-12T01:38:21.875228+0000","last_clean_scrub_stamp":"2024-09-12T01:38:21.875228+0000","objects_scrubbed":8,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:52.692943+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":169,"num_read_kb":163,"num_write":166,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'765","reported_seq":2564,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.858683+0000","last_change":"2024-09-12T01:38:06.858683+0000","last_active":"2024-09-12T01:38:06.858683+0000","last_peered":"2024-09-12T01:38:06.858683+0000","last_clean":"2024-09-12T01:38:06.858683+0000","last_became_active":"2024-09-12T00:25:08.506288+0000","last_became_peered":"2024-09-12T00:25:08.506288+0000","last_unstale":"2024-09-12T01:38:06.858683+0000","last_undegraded":"2024-09-12T01:38:06.858683+0000","last_fullsized":"2024-09-12T01:38:06.858683+0000","mapping_epoch":34,"log_start":"266'701","ondisk_log_start":"266'701","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'765","last_scrub_stamp":"2024-09-12T01:38:06.858588+0000","last_deep_scrub":"266'765","last_deep_scrub_stamp":"2024-09-12T01:38:06.858588+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.858588+0000","objects_scrubbed":1,"log_size":64,"log_dups_size":701,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:00.301952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'126","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:29.008235+0000","last_change":"2024-09-12T01:38:29.008235+0000","last_active":"2024-09-12T01:38:29.008235+0000","last_peered":"2024-09-12T01:38:29.008235+0000","last_clean":"2024-09-12T01:38:29.008235+0000","last_became_active":"2024-09-12T00:25:10.525045+0000","last_became_peered":"2024-09-12T00:25:10.525045+0000","last_unstale":"2024-09-12T01:38:29.008235+0000","last_undegraded":"2024-09-12T01:38:29.008235+0000","last_fullsized":"2024-09-12T01:38:29.008235+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'126","last_scrub_stamp":"2024-09-12T01:38:29.008106+0000","last_deep_scrub":"266'126","last_deep_scrub_stamp":"2024-09-12T01:38:29.008106+0000","last_clean_scrub_stamp":"2024-09-12T01:38:29.008106+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:03.560503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":115,"num_write":298,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'459","reported_seq":2081,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.681716+0000","last_change":"2024-09-12T01:38:00.681716+0000","last_active":"2024-09-12T01:38:00.681716+0000","last_peered":"2024-09-12T01:38:00.681716+0000","last_clean":"2024-09-12T01:38:00.681716+0000","last_became_active":"2024-09-12T00:25:02.471255+0000","last_became_peered":"2024-09-12T00:25:02.471255+0000","last_unstale":"2024-09-12T01:38:00.681716+0000","last_undegraded":"2024-09-12T01:38:00.681716+0000","last_fullsized":"2024-09-12T01:38:00.681716+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'459","last_scrub_stamp":"2024-09-12T01:38:00.681548+0000","last_deep_scrub":"266'459","last_deep_scrub_stamp":"2024-09-12T01:38:00.681548+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.681548+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:54:56.359987+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2599,"num_read_kb":2460,"num_write":533,"num_write_kb":117,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'175","reported_seq":819,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:44.829012+0000","last_change":"2024-09-12T01:37:44.829012+0000","last_active":"2024-09-12T01:37:44.829012+0000","last_peered":"2024-09-12T01:37:44.829012+0000","last_clean":"2024-09-12T01:37:44.829012+0000","last_became_active":"2024-09-12T00:25:00.456853+0000","last_became_peered":"2024-09-12T00:25:00.456853+0000","last_unstale":"2024-09-12T01:37:44.829012+0000","last_undegraded":"2024-09-12T01:37:44.829012+0000","last_fullsized":"2024-09-12T01:37:44.829012+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'175","last_scrub_stamp":"2024-09-12T01:37:44.828838+0000","last_deep_scrub":"266'175","last_deep_scrub_stamp":"2024-09-12T01:37:44.828838+0000","last_clean_scrub_stamp":"2024-09-12T01:37:44.828838+0000","objects_scrubbed":6,"log_size":75,"log_dups_size":100,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:03.195827+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1794910,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":16809,"num_write":841,"num_write_kb":28613,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5,6],"acting":[1,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":514,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.857909+0000","last_change":"2024-09-12T01:38:06.857909+0000","last_active":"2024-09-12T01:38:06.857909+0000","last_peered":"2024-09-12T01:38:06.857909+0000","last_clean":"2024-09-12T01:38:06.857909+0000","last_became_active":"2024-09-12T00:25:04.482441+0000","last_became_peered":"2024-09-12T00:25:04.482441+0000","last_unstale":"2024-09-12T01:38:06.857909+0000","last_undegraded":"2024-09-12T01:38:06.857909+0000","last_fullsized":"2024-09-12T01:38:06.857909+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:06.857801+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:06.857801+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.857801+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:24.285527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'229","reported_seq":873,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.911624+0000","last_change":"2024-09-12T01:38:05.911624+0000","last_active":"2024-09-12T01:38:05.911624+0000","last_peered":"2024-09-12T01:38:05.911624+0000","last_clean":"2024-09-12T01:38:05.911624+0000","last_became_active":"2024-09-12T00:25:06.493625+0000","last_became_peered":"2024-09-12T00:25:06.493625+0000","last_unstale":"2024-09-12T01:38:05.911624+0000","last_undegraded":"2024-09-12T01:38:05.911624+0000","last_fullsized":"2024-09-12T01:38:05.911624+0000","mapping_epoch":32,"log_start":"266'200","ondisk_log_start":"266'200","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T01:38:05.911522+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T01:38:05.911522+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.911522+0000","objects_scrubbed":11,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:47.127866+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9308,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":303,"num_read_kb":374,"num_write":180,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.388205+0000","last_change":"2024-09-12T01:38:18.388205+0000","last_active":"2024-09-12T01:38:18.388205+0000","last_peered":"2024-09-12T01:38:18.388205+0000","last_clean":"2024-09-12T01:38:18.388205+0000","last_became_active":"2024-09-12T00:25:08.511024+0000","last_became_peered":"2024-09-12T00:25:08.511024+0000","last_unstale":"2024-09-12T01:38:18.388205+0000","last_undegraded":"2024-09-12T01:38:18.388205+0000","last_fullsized":"2024-09-12T01:38:18.388205+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:18.388125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:18.388125+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.388125+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:41:57.927807+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'104","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:13.837798+0000","last_change":"2024-09-12T01:38:13.837798+0000","last_active":"2024-09-12T01:38:13.837798+0000","last_peered":"2024-09-12T01:38:13.837798+0000","last_clean":"2024-09-12T01:38:13.837798+0000","last_became_active":"2024-09-12T00:25:10.525981+0000","last_became_peered":"2024-09-12T00:25:10.525981+0000","last_unstale":"2024-09-12T01:38:13.837798+0000","last_undegraded":"2024-09-12T01:38:13.837798+0000","last_fullsized":"2024-09-12T01:38:13.837798+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'104","last_scrub_stamp":"2024-09-12T01:38:13.837710+0000","last_deep_scrub":"266'104","last_deep_scrub_stamp":"2024-09-12T01:38:13.837710+0000","last_clean_scrub_stamp":"2024-09-12T01:38:13.837710+0000","objects_scrubbed":2,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:27.183275+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":200,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":100,"num_write":244,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'803","reported_seq":2407,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.688246+0000","last_change":"2024-09-12T01:37:57.688246+0000","last_active":"2024-09-12T01:37:57.688246+0000","last_peered":"2024-09-12T01:37:57.688246+0000","last_clean":"2024-09-12T01:37:57.688246+0000","last_became_active":"2024-09-12T00:25:02.463545+0000","last_became_peered":"2024-09-12T00:25:02.463545+0000","last_unstale":"2024-09-12T01:37:57.688246+0000","last_undegraded":"2024-09-12T01:37:57.688246+0000","last_fullsized":"2024-09-12T01:37:57.688246+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'803","last_scrub_stamp":"2024-09-12T01:37:57.688138+0000","last_deep_scrub":"266'803","last_deep_scrub_stamp":"2024-09-12T01:37:57.688138+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.688138+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:10:00.009792+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4018,"num_read_kb":3630,"num_write":1061,"num_write_kb":398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2807,"num_omap_keys":11,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'201","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.073754+0000","last_change":"2024-09-12T01:37:56.073754+0000","last_active":"2024-09-12T01:37:56.073754+0000","last_peered":"2024-09-12T01:37:56.073754+0000","last_clean":"2024-09-12T01:37:56.073754+0000","last_became_active":"2024-09-12T00:25:00.478561+0000","last_became_peered":"2024-09-12T00:25:00.478561+0000","last_unstale":"2024-09-12T01:37:56.073754+0000","last_undegraded":"2024-09-12T01:37:56.073754+0000","last_fullsized":"2024-09-12T01:37:56.073754+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'201","last_scrub_stamp":"2024-09-12T01:37:56.073631+0000","last_deep_scrub":"266'201","last_deep_scrub_stamp":"2024-09-12T01:37:56.073631+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.073631+0000","objects_scrubbed":3,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:59:46.426001+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":568262,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":431,"num_read_kb":8616,"num_write":923,"num_write_kb":24681,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":513,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:59.702621+0000","last_change":"2024-09-12T01:37:59.702621+0000","last_active":"2024-09-12T01:37:59.702621+0000","last_peered":"2024-09-12T01:37:59.702621+0000","last_clean":"2024-09-12T01:37:59.702621+0000","last_became_active":"2024-09-12T00:25:04.481146+0000","last_became_peered":"2024-09-12T00:25:04.481146+0000","last_unstale":"2024-09-12T01:37:59.702621+0000","last_undegraded":"2024-09-12T01:37:59.702621+0000","last_fullsized":"2024-09-12T01:37:59.702621+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:37:59.702524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:37:59.702524+0000","last_clean_scrub_stamp":"2024-09-12T01:37:59.702524+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:01.125016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'160","reported_seq":766,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:14.376066+0000","last_change":"2024-09-12T01:38:14.376066+0000","last_active":"2024-09-12T01:38:14.376066+0000","last_peered":"2024-09-12T01:38:14.376066+0000","last_clean":"2024-09-12T01:38:14.376066+0000","last_became_active":"2024-09-12T00:25:06.499065+0000","last_became_peered":"2024-09-12T00:25:06.499065+0000","last_unstale":"2024-09-12T01:38:14.376066+0000","last_undegraded":"2024-09-12T01:38:14.376066+0000","last_fullsized":"2024-09-12T01:38:14.376066+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'160","last_scrub_stamp":"2024-09-12T01:38:14.375983+0000","last_deep_scrub":"266'160","last_deep_scrub_stamp":"2024-09-12T01:38:14.375983+0000","last_clean_scrub_stamp":"2024-09-12T01:38:14.375983+0000","objects_scrubbed":5,"log_size":60,"log_dups_size":100,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:14.670939+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18667,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":212,"num_read_kb":326,"num_write":120,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:24.831061+0000","last_change":"2024-09-12T01:38:24.831061+0000","last_active":"2024-09-12T01:38:24.831061+0000","last_peered":"2024-09-12T01:38:24.831061+0000","last_clean":"2024-09-12T01:38:24.831061+0000","last_became_active":"2024-09-12T00:25:08.510416+0000","last_became_peered":"2024-09-12T00:25:08.510416+0000","last_unstale":"2024-09-12T01:38:24.831061+0000","last_undegraded":"2024-09-12T01:38:24.831061+0000","last_fullsized":"2024-09-12T01:38:24.831061+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:24.830963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:24.830963+0000","last_clean_scrub_stamp":"2024-09-12T01:38:24.830963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:16.618145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'119","reported_seq":649,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:23.645711+0000","last_change":"2024-09-12T01:38:23.645711+0000","last_active":"2024-09-12T01:38:23.645711+0000","last_peered":"2024-09-12T01:38:23.645711+0000","last_clean":"2024-09-12T01:38:23.645711+0000","last_became_active":"2024-09-12T00:25:10.520808+0000","last_became_peered":"2024-09-12T00:25:10.520808+0000","last_unstale":"2024-09-12T01:38:23.645711+0000","last_undegraded":"2024-09-12T01:38:23.645711+0000","last_fullsized":"2024-09-12T01:38:23.645711+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'119","last_scrub_stamp":"2024-09-12T01:38:23.645619+0000","last_deep_scrub":"266'119","last_deep_scrub_stamp":"2024-09-12T01:38:23.645619+0000","last_clean_scrub_stamp":"2024-09-12T01:38:23.645619+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":100,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:58.532369+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1152,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":171,"num_read_kb":169,"num_write":290,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'801","reported_seq":2320,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.378858+0000","last_change":"2024-09-12T01:37:52.378858+0000","last_active":"2024-09-12T01:37:52.378858+0000","last_peered":"2024-09-12T01:37:52.378858+0000","last_clean":"2024-09-12T01:37:52.378858+0000","last_became_active":"2024-09-12T00:25:02.470607+0000","last_became_peered":"2024-09-12T00:25:02.470607+0000","last_unstale":"2024-09-12T01:37:52.378858+0000","last_undegraded":"2024-09-12T01:37:52.378858+0000","last_fullsized":"2024-09-12T01:37:52.378858+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T01:37:52.378752+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T01:37:52.378752+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.378752+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:24:52.413766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3788,"num_read_kb":3387,"num_write":1064,"num_write_kb":418,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1177,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'177","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.584965+0000","last_change":"2024-09-12T01:37:51.584965+0000","last_active":"2024-09-12T01:37:51.584965+0000","last_peered":"2024-09-12T01:37:51.584965+0000","last_clean":"2024-09-12T01:37:51.584965+0000","last_became_active":"2024-09-12T00:25:00.465095+0000","last_became_peered":"2024-09-12T00:25:00.465095+0000","last_unstale":"2024-09-12T01:37:51.584965+0000","last_undegraded":"2024-09-12T01:37:51.584965+0000","last_fullsized":"2024-09-12T01:37:51.584965+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T01:37:51.584835+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T01:37:51.584835+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.584835+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:10:25.271916+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":57,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":466,"num_read_kb":87968,"num_write":861,"num_write_kb":34661,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3,6],"acting":[5,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":515,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.833398+0000","last_change":"2024-09-12T01:38:00.833398+0000","last_active":"2024-09-12T01:38:00.833398+0000","last_peered":"2024-09-12T01:38:00.833398+0000","last_clean":"2024-09-12T01:38:00.833398+0000","last_became_active":"2024-09-12T00:25:04.483232+0000","last_became_peered":"2024-09-12T00:25:04.483232+0000","last_unstale":"2024-09-12T01:38:00.833398+0000","last_undegraded":"2024-09-12T01:38:00.833398+0000","last_fullsized":"2024-09-12T01:38:00.833398+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:00.833313+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:00.833313+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.833313+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:11:19.117932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'122","reported_seq":700,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.379862+0000","last_change":"2024-09-12T01:38:06.379862+0000","last_active":"2024-09-12T01:38:06.379862+0000","last_peered":"2024-09-12T01:38:06.379862+0000","last_clean":"2024-09-12T01:38:06.379862+0000","last_became_active":"2024-09-12T00:25:06.499749+0000","last_became_peered":"2024-09-12T00:25:06.499749+0000","last_unstale":"2024-09-12T01:38:06.379862+0000","last_undegraded":"2024-09-12T01:38:06.379862+0000","last_fullsized":"2024-09-12T01:38:06.379862+0000","mapping_epoch":32,"log_start":"266'100","ondisk_log_start":"266'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'122","last_scrub_stamp":"2024-09-12T01:38:06.379758+0000","last_deep_scrub":"266'122","last_deep_scrub_stamp":"2024-09-12T01:38:06.379758+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.379758+0000","objects_scrubbed":3,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:20.201626+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8122,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":152,"num_read_kb":217,"num_write":76,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:26.920038+0000","last_change":"2024-09-12T01:38:26.920038+0000","last_active":"2024-09-12T01:38:26.920038+0000","last_peered":"2024-09-12T01:38:26.920038+0000","last_clean":"2024-09-12T01:38:26.920038+0000","last_became_active":"2024-09-12T00:25:08.513977+0000","last_became_peered":"2024-09-12T00:25:08.513977+0000","last_unstale":"2024-09-12T01:38:26.920038+0000","last_undegraded":"2024-09-12T01:38:26.920038+0000","last_fullsized":"2024-09-12T01:38:26.920038+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:26.919953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:26.919953+0000","last_clean_scrub_stamp":"2024-09-12T01:38:26.919953+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:03.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'148","reported_seq":1260,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:31.005038+0000","last_change":"2024-09-12T01:38:31.005038+0000","last_active":"2024-09-12T01:38:31.005038+0000","last_peered":"2024-09-12T01:38:31.005038+0000","last_clean":"2024-09-12T01:38:31.005038+0000","last_became_active":"2024-09-12T00:25:10.530103+0000","last_became_peered":"2024-09-12T00:25:10.530103+0000","last_unstale":"2024-09-12T01:38:31.005038+0000","last_undegraded":"2024-09-12T01:38:31.005038+0000","last_fullsized":"2024-09-12T01:38:31.005038+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'148","last_scrub_stamp":"2024-09-12T01:38:31.004943+0000","last_deep_scrub":"266'148","last_deep_scrub_stamp":"2024-09-12T01:38:31.004943+0000","last_clean_scrub_stamp":"2024-09-12T01:38:31.004943+0000","objects_scrubbed":4,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:50:00.895189+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":633,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":764,"num_read_kb":760,"num_write":344,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'1252","reported_seq":2953,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.749655+0000","last_change":"2024-09-12T01:37:54.749655+0000","last_active":"2024-09-12T01:37:54.749655+0000","last_peered":"2024-09-12T01:37:54.749655+0000","last_clean":"2024-09-12T01:37:54.749655+0000","last_became_active":"2024-09-12T00:25:02.467159+0000","last_became_peered":"2024-09-12T00:25:02.467159+0000","last_unstale":"2024-09-12T01:37:54.749655+0000","last_undegraded":"2024-09-12T01:37:54.749655+0000","last_fullsized":"2024-09-12T01:37:54.749655+0000","mapping_epoch":28,"log_start":"266'1200","ondisk_log_start":"266'1200","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1252","last_scrub_stamp":"2024-09-12T01:37:54.749564+0000","last_deep_scrub":"266'1252","last_deep_scrub_stamp":"2024-09-12T01:37:54.749564+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.749564+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":1200,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:45.375412+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5713,"num_read_kb":5033,"num_write":1731,"num_write_kb":699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'181","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.585023+0000","last_change":"2024-09-12T01:37:50.584954+0000","last_active":"2024-09-12T01:37:50.585023+0000","last_peered":"2024-09-12T01:37:50.585023+0000","last_clean":"2024-09-12T01:37:50.585023+0000","last_became_active":"2024-09-12T00:25:00.458519+0000","last_became_peered":"2024-09-12T00:25:00.458519+0000","last_unstale":"2024-09-12T01:37:50.585023+0000","last_undegraded":"2024-09-12T01:37:50.585023+0000","last_fullsized":"2024-09-12T01:37:50.585023+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'181","last_scrub_stamp":"2024-09-12T01:37:50.584829+0000","last_deep_scrub":"266'181","last_deep_scrub_stamp":"2024-09-12T01:37:50.584829+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.584829+0000","objects_scrubbed":1,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:31:45.672695+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":174575,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":384,"num_read_kb":854,"num_write":913,"num_write_kb":13833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,6],"acting":[5,1,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"266'2","reported_seq":521,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:07.380392+0000","last_change":"2024-09-12T01:38:07.380392+0000","last_active":"2024-09-12T01:38:07.380392+0000","last_peered":"2024-09-12T01:38:07.380392+0000","last_clean":"2024-09-12T01:38:07.380392+0000","last_became_active":"2024-09-12T00:25:04.481393+0000","last_became_peered":"2024-09-12T00:25:04.481393+0000","last_unstale":"2024-09-12T01:38:07.380392+0000","last_undegraded":"2024-09-12T01:38:07.380392+0000","last_fullsized":"2024-09-12T01:38:07.380392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T01:38:07.380252+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T01:38:07.380252+0000","last_clean_scrub_stamp":"2024-09-12T01:38:07.380252+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:36.278038+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'199","reported_seq":818,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:18.932702+0000","last_change":"2024-09-12T01:38:18.932702+0000","last_active":"2024-09-12T01:38:18.932702+0000","last_peered":"2024-09-12T01:38:18.932702+0000","last_clean":"2024-09-12T01:38:18.932702+0000","last_became_active":"2024-09-12T00:25:06.490384+0000","last_became_peered":"2024-09-12T00:25:06.490384+0000","last_unstale":"2024-09-12T01:38:18.932702+0000","last_undegraded":"2024-09-12T01:38:18.932702+0000","last_fullsized":"2024-09-12T01:38:18.932702+0000","mapping_epoch":32,"log_start":"263'100","ondisk_log_start":"263'100","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'199","last_scrub_stamp":"2024-09-12T01:38:18.932589+0000","last_deep_scrub":"266'199","last_deep_scrub_stamp":"2024-09-12T01:38:18.932589+0000","last_clean_scrub_stamp":"2024-09-12T01:38:18.932589+0000","objects_scrubbed":6,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:42.938759+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8836,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":255,"num_read_kb":319,"num_write":144,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:19.365895+0000","last_change":"2024-09-12T01:38:19.365895+0000","last_active":"2024-09-12T01:38:19.365895+0000","last_peered":"2024-09-12T01:38:19.365895+0000","last_clean":"2024-09-12T01:38:19.365895+0000","last_became_active":"2024-09-12T00:25:08.507837+0000","last_became_peered":"2024-09-12T00:25:08.507837+0000","last_unstale":"2024-09-12T01:38:19.365895+0000","last_undegraded":"2024-09-12T01:38:19.365895+0000","last_fullsized":"2024-09-12T01:38:19.365895+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":34,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T01:38:19.365805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T01:38:19.365805+0000","last_clean_scrub_stamp":"2024-09-12T01:38:19.365805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:54.035348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'138","reported_seq":693,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:08.899999+0000","last_change":"2024-09-12T01:38:08.899999+0000","last_active":"2024-09-12T01:38:08.899999+0000","last_peered":"2024-09-12T01:38:08.899999+0000","last_clean":"2024-09-12T01:38:08.899999+0000","last_became_active":"2024-09-12T00:25:10.528040+0000","last_became_peered":"2024-09-12T00:25:10.528040+0000","last_unstale":"2024-09-12T01:38:08.899999+0000","last_undegraded":"2024-09-12T01:38:08.899999+0000","last_fullsized":"2024-09-12T01:38:08.899999+0000","mapping_epoch":36,"log_start":"266'100","ondisk_log_start":"266'100","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'138","last_scrub_stamp":"2024-09-12T01:38:08.899912+0000","last_deep_scrub":"266'138","last_deep_scrub_stamp":"2024-09-12T01:38:08.899912+0000","last_clean_scrub_stamp":"2024-09-12T01:38:08.899912+0000","objects_scrubbed":2,"log_size":38,"log_dups_size":100,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:42.982946+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":203,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":293,"num_read_kb":238,"num_write":307,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'1098","reported_seq":2618,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.389104+0000","last_change":"2024-09-12T01:37:57.388999+0000","last_active":"2024-09-12T01:37:57.389104+0000","last_peered":"2024-09-12T01:37:57.389104+0000","last_clean":"2024-09-12T01:37:57.389104+0000","last_became_active":"2024-09-12T00:25:02.474282+0000","last_became_peered":"2024-09-12T00:25:02.474282+0000","last_unstale":"2024-09-12T01:37:57.389104+0000","last_undegraded":"2024-09-12T01:37:57.389104+0000","last_fullsized":"2024-09-12T01:37:57.389104+0000","mapping_epoch":28,"log_start":"266'1000","ondisk_log_start":"266'1000","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1098","last_scrub_stamp":"2024-09-12T01:37:57.388881+0000","last_deep_scrub":"266'1098","last_deep_scrub_stamp":"2024-09-12T01:37:57.388881+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.388881+0000","objects_scrubbed":2,"log_size":98,"log_dups_size":1000,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:25:34.723161+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4991,"num_read_kb":4398,"num_write":1510,"num_write_kb":618,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'185","reported_seq":862,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:47.631943+0000","last_change":"2024-09-12T01:37:47.631887+0000","last_active":"2024-09-12T01:37:47.631943+0000","last_peered":"2024-09-12T01:37:47.631943+0000","last_clean":"2024-09-12T01:37:47.631943+0000","last_became_active":"2024-09-12T00:25:00.478259+0000","last_became_peered":"2024-09-12T00:25:00.478259+0000","last_unstale":"2024-09-12T01:37:47.631943+0000","last_undegraded":"2024-09-12T01:37:47.631943+0000","last_fullsized":"2024-09-12T01:37:47.631943+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:47.631770+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:47.631770+0000","last_clean_scrub_stamp":"2024-09-12T01:37:47.631770+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:29.806652+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":515600,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":481,"num_read_kb":41144,"num_write":873,"num_write_kb":35919,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,0],"acting":[2,6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'755","reported_seq":2242,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:57.417599+0000","last_change":"2024-09-12T01:37:57.417543+0000","last_active":"2024-09-12T01:37:57.417599+0000","last_peered":"2024-09-12T01:37:57.417599+0000","last_clean":"2024-09-12T01:37:57.417599+0000","last_became_active":"2024-09-12T00:25:02.479450+0000","last_became_peered":"2024-09-12T00:25:02.479450+0000","last_unstale":"2024-09-12T01:37:57.417599+0000","last_undegraded":"2024-09-12T01:37:57.417599+0000","last_fullsized":"2024-09-12T01:37:57.417599+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'755","last_scrub_stamp":"2024-09-12T01:37:57.417454+0000","last_deep_scrub":"266'755","last_deep_scrub_stamp":"2024-09-12T01:37:57.417454+0000","last_clean_scrub_stamp":"2024-09-12T01:37:57.417454+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":700,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:04.776702+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3526,"num_read_kb":3183,"num_write":976,"num_write_kb":348,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":962,"num_omap_keys":4,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'207","reported_seq":851,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.446489+0000","last_change":"2024-09-12T01:37:49.446397+0000","last_active":"2024-09-12T01:37:49.446489+0000","last_peered":"2024-09-12T01:37:49.446489+0000","last_clean":"2024-09-12T01:37:49.446489+0000","last_became_active":"2024-09-12T00:25:00.468280+0000","last_became_peered":"2024-09-12T00:25:00.468280+0000","last_unstale":"2024-09-12T01:37:49.446489+0000","last_undegraded":"2024-09-12T01:37:49.446489+0000","last_fullsized":"2024-09-12T01:37:49.446489+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'207","last_scrub_stamp":"2024-09-12T01:37:49.446249+0000","last_deep_scrub":"266'207","last_deep_scrub_stamp":"2024-09-12T01:37:49.446249+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.446249+0000","objects_scrubbed":2,"log_size":107,"log_dups_size":100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:17.110576+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133669,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":421,"num_read_kb":15096,"num_write":1006,"num_write_kb":29184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,5,2],"acting":[7,1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'368","reported_seq":1896,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:06.941203+0000","last_change":"2024-09-12T01:38:06.941131+0000","last_active":"2024-09-12T01:38:06.941203+0000","last_peered":"2024-09-12T01:38:06.941203+0000","last_clean":"2024-09-12T01:38:06.941203+0000","last_became_active":"2024-09-12T00:25:02.476993+0000","last_became_peered":"2024-09-12T00:25:02.476993+0000","last_unstale":"2024-09-12T01:38:06.941203+0000","last_undegraded":"2024-09-12T01:38:06.941203+0000","last_fullsized":"2024-09-12T01:38:06.941203+0000","mapping_epoch":28,"log_start":"266'300","ondisk_log_start":"266'300","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'368","last_scrub_stamp":"2024-09-12T01:38:06.941039+0000","last_deep_scrub":"266'368","last_deep_scrub_stamp":"2024-09-12T01:38:06.941039+0000","last_clean_scrub_stamp":"2024-09-12T01:38:06.941039+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":300,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:55.933049+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2221,"num_read_kb":2131,"num_write":417,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'201","reported_seq":894,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.122989+0000","last_change":"2024-09-12T01:37:53.122891+0000","last_active":"2024-09-12T01:37:53.122989+0000","last_peered":"2024-09-12T01:37:53.122989+0000","last_clean":"2024-09-12T01:37:53.122989+0000","last_became_active":"2024-09-12T00:25:00.477872+0000","last_became_peered":"2024-09-12T00:25:00.477872+0000","last_unstale":"2024-09-12T01:37:53.122989+0000","last_undegraded":"2024-09-12T01:37:53.122989+0000","last_fullsized":"2024-09-12T01:37:53.122989+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'201","last_scrub_stamp":"2024-09-12T01:37:53.122774+0000","last_deep_scrub":"266'201","last_deep_scrub_stamp":"2024-09-12T01:37:53.122774+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.122774+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":100,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:42:56.089470+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590195,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":692,"num_read_kb":9353,"num_write":799,"num_write_kb":34820,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7,2],"acting":[3,5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'480","reported_seq":1992,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:02.625492+0000","last_change":"2024-09-12T01:38:02.625423+0000","last_active":"2024-09-12T01:38:02.625492+0000","last_peered":"2024-09-12T01:38:02.625492+0000","last_clean":"2024-09-12T01:38:02.625492+0000","last_became_active":"2024-09-12T00:25:02.468180+0000","last_became_peered":"2024-09-12T00:25:02.468180+0000","last_unstale":"2024-09-12T01:38:02.625492+0000","last_undegraded":"2024-09-12T01:38:02.625492+0000","last_fullsized":"2024-09-12T01:38:02.625492+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'480","last_scrub_stamp":"2024-09-12T01:38:02.625346+0000","last_deep_scrub":"266'480","last_deep_scrub_stamp":"2024-09-12T01:38:02.625346+0000","last_clean_scrub_stamp":"2024-09-12T01:38:02.625346+0000","objects_scrubbed":2,"log_size":80,"log_dups_size":400,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:54.703998+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2321,"num_read_kb":2166,"num_write":540,"num_write_kb":112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'179","reported_seq":797,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.564089+0000","last_change":"2024-09-12T01:37:53.564029+0000","last_active":"2024-09-12T01:37:53.564089+0000","last_peered":"2024-09-12T01:37:53.564089+0000","last_clean":"2024-09-12T01:37:53.564089+0000","last_became_active":"2024-09-12T00:25:00.471412+0000","last_became_peered":"2024-09-12T00:25:00.471412+0000","last_unstale":"2024-09-12T01:37:53.564089+0000","last_undegraded":"2024-09-12T01:37:53.564089+0000","last_fullsized":"2024-09-12T01:37:53.564089+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'179","last_scrub_stamp":"2024-09-12T01:37:53.563879+0000","last_deep_scrub":"266'179","last_deep_scrub_stamp":"2024-09-12T01:37:53.563879+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.563879+0000","objects_scrubbed":4,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:32:48.342923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":432317,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":354,"num_read_kb":25493,"num_write":898,"num_write_kb":19511,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0,6],"acting":[5,7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'502","reported_seq":2197,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.585527+0000","last_change":"2024-09-12T01:38:01.585436+0000","last_active":"2024-09-12T01:38:01.585527+0000","last_peered":"2024-09-12T01:38:01.585527+0000","last_clean":"2024-09-12T01:38:01.585527+0000","last_became_active":"2024-09-12T00:25:02.469251+0000","last_became_peered":"2024-09-12T00:25:02.469251+0000","last_unstale":"2024-09-12T01:38:01.585527+0000","last_undegraded":"2024-09-12T01:38:01.585527+0000","last_fullsized":"2024-09-12T01:38:01.585527+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'502","last_scrub_stamp":"2024-09-12T01:38:01.585337+0000","last_deep_scrub":"266'502","last_deep_scrub_stamp":"2024-09-12T01:38:01.585337+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.585337+0000","objects_scrubbed":4,"log_size":102,"log_dups_size":400,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:04:58.395669+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2750,"num_read_kb":2605,"num_write":624,"num_write_kb":185,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":236,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'206","reported_seq":841,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:49.248892+0000","last_change":"2024-09-12T01:37:49.248829+0000","last_active":"2024-09-12T01:37:49.248892+0000","last_peered":"2024-09-12T01:37:49.248892+0000","last_clean":"2024-09-12T01:37:49.248892+0000","last_became_active":"2024-09-12T00:25:00.466945+0000","last_became_peered":"2024-09-12T00:25:00.466945+0000","last_unstale":"2024-09-12T01:37:49.248892+0000","last_undegraded":"2024-09-12T01:37:49.248892+0000","last_fullsized":"2024-09-12T01:37:49.248892+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T01:37:49.248703+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T01:37:49.248703+0000","last_clean_scrub_stamp":"2024-09-12T01:37:49.248703+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:40:28.604127+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262187,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":394,"num_read_kb":18851,"num_write":965,"num_write_kb":35048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,3],"acting":[6,0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'499","reported_seq":2048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.776962+0000","last_change":"2024-09-12T01:37:56.776897+0000","last_active":"2024-09-12T01:37:56.776962+0000","last_peered":"2024-09-12T01:37:56.776962+0000","last_clean":"2024-09-12T01:37:56.776962+0000","last_became_active":"2024-09-12T00:25:02.475225+0000","last_became_peered":"2024-09-12T00:25:02.475225+0000","last_unstale":"2024-09-12T01:37:56.776962+0000","last_undegraded":"2024-09-12T01:37:56.776962+0000","last_fullsized":"2024-09-12T01:37:56.776962+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T01:37:56.776795+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T01:37:56.776795+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.776795+0000","objects_scrubbed":3,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:37:34.741261+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2510,"num_read_kb":2326,"num_write":604,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":947,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'195","reported_seq":837,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.258913+0000","last_change":"2024-09-12T01:37:54.258842+0000","last_active":"2024-09-12T01:37:54.258913+0000","last_peered":"2024-09-12T01:37:54.258913+0000","last_clean":"2024-09-12T01:37:54.258913+0000","last_became_active":"2024-09-12T00:25:00.468245+0000","last_became_peered":"2024-09-12T00:25:00.468245+0000","last_unstale":"2024-09-12T01:37:54.258913+0000","last_undegraded":"2024-09-12T01:37:54.258913+0000","last_fullsized":"2024-09-12T01:37:54.258913+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'195","last_scrub_stamp":"2024-09-12T01:37:54.258714+0000","last_deep_scrub":"266'195","last_deep_scrub_stamp":"2024-09-12T01:37:54.258714+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.258714+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:03.360749+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262200,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":398,"num_read_kb":27275,"num_write":960,"num_write_kb":19137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,2],"acting":[6,7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'529","reported_seq":2295,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.334078+0000","last_change":"2024-09-12T01:37:58.334020+0000","last_active":"2024-09-12T01:37:58.334078+0000","last_peered":"2024-09-12T01:37:58.334078+0000","last_clean":"2024-09-12T01:37:58.334078+0000","last_became_active":"2024-09-12T00:25:02.469044+0000","last_became_peered":"2024-09-12T00:25:02.469044+0000","last_unstale":"2024-09-12T01:37:58.334078+0000","last_undegraded":"2024-09-12T01:37:58.334078+0000","last_fullsized":"2024-09-12T01:37:58.334078+0000","mapping_epoch":28,"log_start":"266'500","ondisk_log_start":"266'500","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'529","last_scrub_stamp":"2024-09-12T01:37:58.333929+0000","last_deep_scrub":"266'529","last_deep_scrub_stamp":"2024-09-12T01:37:58.333929+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.333929+0000","objects_scrubbed":2,"log_size":29,"log_dups_size":500,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:16:57.684362+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2889,"num_read_kb":2724,"num_write":624,"num_write_kb":147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3030,"num_omap_keys":12,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'185","reported_seq":819,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:48.658331+0000","last_change":"2024-09-12T01:37:48.658264+0000","last_active":"2024-09-12T01:37:48.658331+0000","last_peered":"2024-09-12T01:37:48.658331+0000","last_clean":"2024-09-12T01:37:48.658331+0000","last_became_active":"2024-09-12T00:25:00.487526+0000","last_became_peered":"2024-09-12T00:25:00.487526+0000","last_unstale":"2024-09-12T01:37:48.658331+0000","last_undegraded":"2024-09-12T01:37:48.658331+0000","last_fullsized":"2024-09-12T01:37:48.658331+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'185","last_scrub_stamp":"2024-09-12T01:37:48.658138+0000","last_deep_scrub":"266'185","last_deep_scrub_stamp":"2024-09-12T01:37:48.658138+0000","last_clean_scrub_stamp":"2024-09-12T01:37:48.658138+0000","objects_scrubbed":5,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:27.351203+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306655,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":430,"num_read_kb":3010,"num_write":923,"num_write_kb":19090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1186","reported_seq":2787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:50.889719+0000","last_change":"2024-09-12T01:37:50.889645+0000","last_active":"2024-09-12T01:37:50.889719+0000","last_peered":"2024-09-12T01:37:50.889719+0000","last_clean":"2024-09-12T01:37:50.889719+0000","last_became_active":"2024-09-12T00:25:02.465257+0000","last_became_peered":"2024-09-12T00:25:02.465257+0000","last_unstale":"2024-09-12T01:37:50.889719+0000","last_undegraded":"2024-09-12T01:37:50.889719+0000","last_fullsized":"2024-09-12T01:37:50.889719+0000","mapping_epoch":28,"log_start":"266'1100","ondisk_log_start":"266'1100","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1186","last_scrub_stamp":"2024-09-12T01:37:50.889557+0000","last_deep_scrub":"266'1186","last_deep_scrub_stamp":"2024-09-12T01:37:50.889557+0000","last_clean_scrub_stamp":"2024-09-12T01:37:50.889557+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":1100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:33.235013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5507,"num_read_kb":4876,"num_write":1621,"num_write_kb":662,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'262","reported_seq":919,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.605261+0000","last_change":"2024-09-12T01:37:52.605167+0000","last_active":"2024-09-12T01:37:52.605261+0000","last_peered":"2024-09-12T01:37:52.605261+0000","last_clean":"2024-09-12T01:37:52.605261+0000","last_became_active":"2024-09-12T00:25:00.469159+0000","last_became_peered":"2024-09-12T00:25:00.469159+0000","last_unstale":"2024-09-12T01:37:52.605261+0000","last_undegraded":"2024-09-12T01:37:52.605261+0000","last_fullsized":"2024-09-12T01:37:52.605261+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'262","last_scrub_stamp":"2024-09-12T01:37:52.605010+0000","last_deep_scrub":"266'262","last_deep_scrub_stamp":"2024-09-12T01:37:52.605010+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.605010+0000","objects_scrubbed":3,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:46.615461+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262189,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":503,"num_read_kb":57821,"num_write":1101,"num_write_kb":41989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,0],"acting":[5,1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'489","reported_seq":1932,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.485490+0000","last_change":"2024-09-12T01:38:00.485490+0000","last_active":"2024-09-12T01:38:00.485490+0000","last_peered":"2024-09-12T01:38:00.485490+0000","last_clean":"2024-09-12T01:38:00.485490+0000","last_became_active":"2024-09-12T00:25:02.470623+0000","last_became_peered":"2024-09-12T00:25:02.470623+0000","last_unstale":"2024-09-12T01:38:00.485490+0000","last_undegraded":"2024-09-12T01:38:00.485490+0000","last_fullsized":"2024-09-12T01:38:00.485490+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'489","last_scrub_stamp":"2024-09-12T01:38:00.485373+0000","last_deep_scrub":"266'489","last_deep_scrub_stamp":"2024-09-12T01:38:00.485373+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.485373+0000","objects_scrubbed":3,"log_size":89,"log_dups_size":400,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:53:54.174690+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2404,"num_read_kb":2207,"num_write":594,"num_write_kb":162,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":704,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'242","reported_seq":916,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.083055+0000","last_change":"2024-09-12T01:37:55.082986+0000","last_active":"2024-09-12T01:37:55.083055+0000","last_peered":"2024-09-12T01:37:55.083055+0000","last_clean":"2024-09-12T01:37:55.083055+0000","last_became_active":"2024-09-12T00:25:00.469918+0000","last_became_peered":"2024-09-12T00:25:00.469918+0000","last_unstale":"2024-09-12T01:37:55.083055+0000","last_undegraded":"2024-09-12T01:37:55.083055+0000","last_fullsized":"2024-09-12T01:37:55.083055+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'242","last_scrub_stamp":"2024-09-12T01:37:55.082838+0000","last_deep_scrub":"266'242","last_deep_scrub_stamp":"2024-09-12T01:37:55.082838+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.082838+0000","objects_scrubbed":4,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:51:33.200370+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262198,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":488,"num_read_kb":51750,"num_write":1103,"num_write_kb":39694,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,0,1],"acting":[3,5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'615","reported_seq":2423,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.742975+0000","last_change":"2024-09-12T01:37:53.742975+0000","last_active":"2024-09-12T01:37:53.742975+0000","last_peered":"2024-09-12T01:37:53.742975+0000","last_clean":"2024-09-12T01:37:53.742975+0000","last_became_active":"2024-09-12T00:25:02.475864+0000","last_became_peered":"2024-09-12T00:25:02.475864+0000","last_unstale":"2024-09-12T01:37:53.742975+0000","last_undegraded":"2024-09-12T01:37:53.742975+0000","last_fullsized":"2024-09-12T01:37:53.742975+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'615","last_scrub_stamp":"2024-09-12T01:37:53.742862+0000","last_deep_scrub":"266'615","last_deep_scrub_stamp":"2024-09-12T01:37:53.742862+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.742862+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":600,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:34.727742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3105,"num_read_kb":2885,"num_write":734,"num_write_kb":194,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":934,"num_omap_keys":4,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'287","reported_seq":994,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:54.594953+0000","last_change":"2024-09-12T01:37:54.594953+0000","last_active":"2024-09-12T01:37:54.594953+0000","last_peered":"2024-09-12T01:37:54.594953+0000","last_clean":"2024-09-12T01:37:54.594953+0000","last_became_active":"2024-09-12T00:25:00.468228+0000","last_became_peered":"2024-09-12T00:25:00.468228+0000","last_unstale":"2024-09-12T01:37:54.594953+0000","last_undegraded":"2024-09-12T01:37:54.594953+0000","last_fullsized":"2024-09-12T01:37:54.594953+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'287","last_scrub_stamp":"2024-09-12T01:37:54.594827+0000","last_deep_scrub":"266'287","last_deep_scrub_stamp":"2024-09-12T01:37:54.594827+0000","last_clean_scrub_stamp":"2024-09-12T01:37:54.594827+0000","objects_scrubbed":5,"log_size":87,"log_dups_size":200,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:15.134217+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":681,"num_read_kb":67032,"num_write":1230,"num_write_kb":28377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0,7],"acting":[5,2,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'952","reported_seq":2525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:05.669075+0000","last_change":"2024-09-12T01:38:05.669075+0000","last_active":"2024-09-12T01:38:05.669075+0000","last_peered":"2024-09-12T01:38:05.669075+0000","last_clean":"2024-09-12T01:38:05.669075+0000","last_became_active":"2024-09-12T00:25:02.473441+0000","last_became_peered":"2024-09-12T00:25:02.473441+0000","last_unstale":"2024-09-12T01:38:05.669075+0000","last_undegraded":"2024-09-12T01:38:05.669075+0000","last_fullsized":"2024-09-12T01:38:05.669075+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'952","last_scrub_stamp":"2024-09-12T01:38:05.668932+0000","last_deep_scrub":"266'952","last_deep_scrub_stamp":"2024-09-12T01:38:05.668932+0000","last_clean_scrub_stamp":"2024-09-12T01:38:05.668932+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":900,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:23:46.937367+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4462,"num_read_kb":3929,"num_write":1316,"num_write_kb":523,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":268,"num_omap_keys":1,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'215","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.822790+0000","last_change":"2024-09-12T01:37:46.822790+0000","last_active":"2024-09-12T01:37:46.822790+0000","last_peered":"2024-09-12T01:37:46.822790+0000","last_clean":"2024-09-12T01:37:46.822790+0000","last_became_active":"2024-09-12T00:25:00.465127+0000","last_became_peered":"2024-09-12T00:25:00.465127+0000","last_unstale":"2024-09-12T01:37:46.822790+0000","last_undegraded":"2024-09-12T01:37:46.822790+0000","last_fullsized":"2024-09-12T01:37:46.822790+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'215","last_scrub_stamp":"2024-09-12T01:37:46.822705+0000","last_deep_scrub":"266'215","last_deep_scrub_stamp":"2024-09-12T01:37:46.822705+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.822705+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:55:52.870895+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":478,"num_read_kb":16638,"num_write":1049,"num_write_kb":34754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2,4],"acting":[1,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'829","reported_seq":2458,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.894009+0000","last_change":"2024-09-12T01:37:53.894009+0000","last_active":"2024-09-12T01:37:53.894009+0000","last_peered":"2024-09-12T01:37:53.894009+0000","last_clean":"2024-09-12T01:37:53.894009+0000","last_became_active":"2024-09-12T00:25:02.464386+0000","last_became_peered":"2024-09-12T00:25:02.464386+0000","last_unstale":"2024-09-12T01:37:53.894009+0000","last_undegraded":"2024-09-12T01:37:53.894009+0000","last_fullsized":"2024-09-12T01:37:53.894009+0000","mapping_epoch":28,"log_start":"266'800","ondisk_log_start":"266'800","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'829","last_scrub_stamp":"2024-09-12T01:37:53.893911+0000","last_deep_scrub":"266'829","last_deep_scrub_stamp":"2024-09-12T01:37:53.893911+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.893911+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:55:08.882315+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3899,"num_read_kb":3522,"num_write":1059,"num_write_kb":371,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'166","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:53.385520+0000","last_change":"2024-09-12T01:37:53.385520+0000","last_active":"2024-09-12T01:37:53.385520+0000","last_peered":"2024-09-12T01:37:53.385520+0000","last_clean":"2024-09-12T01:37:53.385520+0000","last_became_active":"2024-09-12T00:25:00.465400+0000","last_became_peered":"2024-09-12T00:25:00.465400+0000","last_unstale":"2024-09-12T01:37:53.385520+0000","last_undegraded":"2024-09-12T01:37:53.385520+0000","last_fullsized":"2024-09-12T01:37:53.385520+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'166","last_scrub_stamp":"2024-09-12T01:37:53.385357+0000","last_deep_scrub":"266'166","last_deep_scrub_stamp":"2024-09-12T01:37:53.385357+0000","last_clean_scrub_stamp":"2024-09-12T01:37:53.385357+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:01:28.894338+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":440,"num_read_kb":4582,"num_write":828,"num_write_kb":26519,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6,3],"acting":[4,2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'783","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:52.880976+0000","last_change":"2024-09-12T01:37:52.880976+0000","last_active":"2024-09-12T01:37:52.880976+0000","last_peered":"2024-09-12T01:37:52.880976+0000","last_clean":"2024-09-12T01:37:52.880976+0000","last_became_active":"2024-09-12T00:25:02.469046+0000","last_became_peered":"2024-09-12T00:25:02.469046+0000","last_unstale":"2024-09-12T01:37:52.880976+0000","last_undegraded":"2024-09-12T01:37:52.880976+0000","last_fullsized":"2024-09-12T01:37:52.880976+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'783","last_scrub_stamp":"2024-09-12T01:37:52.880841+0000","last_deep_scrub":"266'783","last_deep_scrub_stamp":"2024-09-12T01:37:52.880841+0000","last_clean_scrub_stamp":"2024-09-12T01:37:52.880841+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":700,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:39.288474+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3834,"num_read_kb":3478,"num_write":1008,"num_write_kb":358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2140,"num_omap_keys":9,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'208","reported_seq":886,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:46.906129+0000","last_change":"2024-09-12T01:37:46.906129+0000","last_active":"2024-09-12T01:37:46.906129+0000","last_peered":"2024-09-12T01:37:46.906129+0000","last_clean":"2024-09-12T01:37:46.906129+0000","last_became_active":"2024-09-12T00:25:00.468581+0000","last_became_peered":"2024-09-12T00:25:00.468581+0000","last_unstale":"2024-09-12T01:37:46.906129+0000","last_undegraded":"2024-09-12T01:37:46.906129+0000","last_fullsized":"2024-09-12T01:37:46.906129+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T01:37:46.906027+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T01:37:46.906027+0000","last_clean_scrub_stamp":"2024-09-12T01:37:46.906027+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:01.027597+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323902,"num_objects":4,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":515,"num_read_kb":48643,"num_write":1011,"num_write_kb":19361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6,7],"acting":[0,1,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'801","reported_seq":2374,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.444482+0000","last_change":"2024-09-12T01:37:55.444482+0000","last_active":"2024-09-12T01:37:55.444482+0000","last_peered":"2024-09-12T01:37:55.444482+0000","last_clean":"2024-09-12T01:37:55.444482+0000","last_became_active":"2024-09-12T00:25:02.476825+0000","last_became_peered":"2024-09-12T00:25:02.476825+0000","last_unstale":"2024-09-12T01:37:55.444482+0000","last_undegraded":"2024-09-12T01:37:55.444482+0000","last_fullsized":"2024-09-12T01:37:55.444482+0000","mapping_epoch":28,"log_start":"266'700","ondisk_log_start":"266'700","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T01:37:55.444397+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T01:37:55.444397+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.444397+0000","objects_scrubbed":4,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:39.143798+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3888,"num_read_kb":3500,"num_write":1075,"num_write_kb":396,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'188","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.077782+0000","last_change":"2024-09-12T01:37:58.077782+0000","last_active":"2024-09-12T01:37:58.077782+0000","last_peered":"2024-09-12T01:37:58.077782+0000","last_clean":"2024-09-12T01:37:58.077782+0000","last_became_active":"2024-09-12T00:25:00.480122+0000","last_became_peered":"2024-09-12T00:25:00.480122+0000","last_unstale":"2024-09-12T01:37:58.077782+0000","last_undegraded":"2024-09-12T01:37:58.077782+0000","last_fullsized":"2024-09-12T01:37:58.077782+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T01:37:58.077623+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T01:37:58.077623+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.077623+0000","objects_scrubbed":3,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:08:26.959203+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399183,"num_objects":3,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":553,"num_read_kb":7914,"num_write":895,"num_write_kb":29144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2,5],"acting":[3,4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'692","reported_seq":2154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:58.377713+0000","last_change":"2024-09-12T01:37:58.377713+0000","last_active":"2024-09-12T01:37:58.377713+0000","last_peered":"2024-09-12T01:37:58.377713+0000","last_clean":"2024-09-12T01:37:58.377713+0000","last_became_active":"2024-09-12T00:25:02.465790+0000","last_became_peered":"2024-09-12T00:25:02.465790+0000","last_unstale":"2024-09-12T01:37:58.377713+0000","last_undegraded":"2024-09-12T01:37:58.377713+0000","last_fullsized":"2024-09-12T01:37:58.377713+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'692","last_scrub_stamp":"2024-09-12T01:37:58.377612+0000","last_deep_scrub":"266'692","last_deep_scrub_stamp":"2024-09-12T01:37:58.377612+0000","last_clean_scrub_stamp":"2024-09-12T01:37:58.377612+0000","objects_scrubbed":2,"log_size":92,"log_dups_size":600,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:07:21.790646+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3268,"num_read_kb":2971,"num_write":903,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":245,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'258","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.401918+0000","last_change":"2024-09-12T01:37:51.401918+0000","last_active":"2024-09-12T01:37:51.401918+0000","last_peered":"2024-09-12T01:37:51.401918+0000","last_clean":"2024-09-12T01:37:51.401918+0000","last_became_active":"2024-09-12T00:25:00.469634+0000","last_became_peered":"2024-09-12T00:25:00.469634+0000","last_unstale":"2024-09-12T01:37:51.401918+0000","last_undegraded":"2024-09-12T01:37:51.401918+0000","last_fullsized":"2024-09-12T01:37:51.401918+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'258","last_scrub_stamp":"2024-09-12T01:37:51.401778+0000","last_deep_scrub":"266'258","last_deep_scrub_stamp":"2024-09-12T01:37:51.401778+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.401778+0000","objects_scrubbed":5,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:11:00.034860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1155756,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":510,"num_read_kb":1718,"num_write":1162,"num_write_kb":27079,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3,0],"acting":[7,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'436","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:51.872784+0000","last_change":"2024-09-12T01:37:51.872718+0000","last_active":"2024-09-12T01:37:51.872784+0000","last_peered":"2024-09-12T01:37:51.872784+0000","last_clean":"2024-09-12T01:37:51.872784+0000","last_became_active":"2024-09-12T00:25:02.464112+0000","last_became_peered":"2024-09-12T00:25:02.464112+0000","last_unstale":"2024-09-12T01:37:51.872784+0000","last_undegraded":"2024-09-12T01:37:51.872784+0000","last_fullsized":"2024-09-12T01:37:51.872784+0000","mapping_epoch":28,"log_start":"266'400","ondisk_log_start":"266'400","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'436","last_scrub_stamp":"2024-09-12T01:37:51.872608+0000","last_deep_scrub":"266'436","last_deep_scrub_stamp":"2024-09-12T01:37:51.872608+0000","last_clean_scrub_stamp":"2024-09-12T01:37:51.872608+0000","objects_scrubbed":2,"log_size":36,"log_dups_size":400,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T13:01:01.236298+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2410,"num_read_kb":2284,"num_write":511,"num_write_kb":110,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":893,"num_omap_keys":4,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'226","reported_seq":884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.008992+0000","last_change":"2024-09-12T01:38:00.008992+0000","last_active":"2024-09-12T01:38:00.008992+0000","last_peered":"2024-09-12T01:38:00.008992+0000","last_clean":"2024-09-12T01:38:00.008992+0000","last_became_active":"2024-09-12T00:25:00.468600+0000","last_became_peered":"2024-09-12T00:25:00.468600+0000","last_unstale":"2024-09-12T01:38:00.008992+0000","last_undegraded":"2024-09-12T01:38:00.008992+0000","last_fullsized":"2024-09-12T01:38:00.008992+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T01:38:00.008790+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T01:38:00.008790+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.008790+0000","objects_scrubbed":6,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:56.789743+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1133763,"num_objects":6,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":507,"num_read_kb":7263,"num_write":1147,"num_write_kb":27569,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,7,2],"acting":[3,0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'182","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:01.002937+0000","last_change":"2024-09-12T01:38:01.002937+0000","last_active":"2024-09-12T01:38:01.002937+0000","last_peered":"2024-09-12T01:38:01.002937+0000","last_clean":"2024-09-12T01:38:01.002937+0000","last_became_active":"2024-09-12T00:25:00.469382+0000","last_became_peered":"2024-09-12T00:25:00.469382+0000","last_unstale":"2024-09-12T01:38:01.002937+0000","last_undegraded":"2024-09-12T01:38:01.002937+0000","last_fullsized":"2024-09-12T01:38:01.002937+0000","mapping_epoch":26,"log_start":"266'100","ondisk_log_start":"266'100","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'182","last_scrub_stamp":"2024-09-12T01:38:01.002819+0000","last_deep_scrub":"266'182","last_deep_scrub_stamp":"2024-09-12T01:38:01.002819+0000","last_clean_scrub_stamp":"2024-09-12T01:38:01.002819+0000","objects_scrubbed":5,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:54:33.648707+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262188,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":440,"num_read_kb":14411,"num_write":860,"num_write_kb":23706,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6,4],"acting":[3,2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'918","reported_seq":2496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:38:00.350546+0000","last_change":"2024-09-12T01:38:00.350546+0000","last_active":"2024-09-12T01:38:00.350546+0000","last_peered":"2024-09-12T01:38:00.350546+0000","last_clean":"2024-09-12T01:38:00.350546+0000","last_became_active":"2024-09-12T00:25:02.475004+0000","last_became_peered":"2024-09-12T00:25:02.475004+0000","last_unstale":"2024-09-12T01:38:00.350546+0000","last_undegraded":"2024-09-12T01:38:00.350546+0000","last_fullsized":"2024-09-12T01:38:00.350546+0000","mapping_epoch":28,"log_start":"266'900","ondisk_log_start":"266'900","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'918","last_scrub_stamp":"2024-09-12T01:38:00.350456+0000","last_deep_scrub":"266'918","last_deep_scrub_stamp":"2024-09-12T01:38:00.350456+0000","last_clean_scrub_stamp":"2024-09-12T01:38:00.350456+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":900,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:25.819056+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4224,"num_read_kb":3778,"num_write":1247,"num_write_kb":500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":473,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'230","reported_seq":963,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:55.567919+0000","last_change":"2024-09-12T01:37:55.567919+0000","last_active":"2024-09-12T01:37:55.567919+0000","last_peered":"2024-09-12T01:37:55.567919+0000","last_clean":"2024-09-12T01:37:55.567919+0000","last_became_active":"2024-09-12T00:25:00.471411+0000","last_became_peered":"2024-09-12T00:25:00.471411+0000","last_unstale":"2024-09-12T01:37:55.567919+0000","last_undegraded":"2024-09-12T01:37:55.567919+0000","last_fullsized":"2024-09-12T01:37:55.567919+0000","mapping_epoch":26,"log_start":"266'200","ondisk_log_start":"266'200","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'230","last_scrub_stamp":"2024-09-12T01:37:55.567768+0000","last_deep_scrub":"266'230","last_deep_scrub_stamp":"2024-09-12T01:37:55.567768+0000","last_clean_scrub_stamp":"2024-09-12T01:37:55.567768+0000","objects_scrubbed":2,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:16.993814+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5323861,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":694,"num_read_kb":157504,"num_write":954,"num_write_kb":45267,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,6],"acting":[5,0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'651","reported_seq":2402,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T01:37:56.941466+0000","last_change":"2024-09-12T01:37:56.941466+0000","last_active":"2024-09-12T01:37:56.941466+0000","last_peered":"2024-09-12T01:37:56.941466+0000","last_clean":"2024-09-12T01:37:56.941466+0000","last_became_active":"2024-09-12T00:25:02.462993+0000","last_became_peered":"2024-09-12T00:25:02.462993+0000","last_unstale":"2024-09-12T01:37:56.941466+0000","last_undegraded":"2024-09-12T01:37:56.941466+0000","last_fullsized":"2024-09-12T01:37:56.941466+0000","mapping_epoch":28,"log_start":"266'600","ondisk_log_start":"266'600","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'651","last_scrub_stamp":"2024-09-12T01:37:56.941361+0000","last_deep_scrub":"266'651","last_deep_scrub_stamp":"2024-09-12T01:37:56.941361+0000","last_clean_scrub_stamp":"2024-09-12T01:37:56.941361+0000","objects_scrubbed":4,"log_size":51,"log_dups_size":600,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:09:04.170101+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3586,"num_read_kb":3293,"num_write":883,"num_write_kb":378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1767,"num_omap_keys":7,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5955,"num_read_kb":4160,"num_write":1937,"num_write_kb":835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7978,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1010,"ondisk_log_size":1010,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":15084,"num_read_kb":14735,"num_write":16735,"num_write_kb":4888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2619,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1550,"ondisk_log_size":1550,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":680,"ondisk_log_size":680,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":318753,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":10187,"num_read_kb":12369,"num_write":7087,"num_write_kb":3082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":673448,"num_omap_keys":1560,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1781,"ondisk_log_size":1781,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2373,"num_read_kb":2833,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212728,"num_read_kb":194072,"num_write":55276,"num_write_kb":18842,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43270,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4154,"ondisk_log_size":4154,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":79547187,"num_objects":235,"num_object_clones":0,"num_object_copies":940,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":235,"num_whiteouts":0,"num_read":33257,"num_read_kb":1810768,"num_write":62815,"num_write_kb":1904228,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":108691456,"data_stored":108691456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4112,"ondisk_log_size":4112,"up":256,"acting":256,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":166,"num_read_kb":174385,"num_write":182,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":163,"num_read_kb":174274,"num_write":182,"num_write_kb":115892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":16,"seq":68719477636,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":145280,"kb_used_data":15536,"kb_used_omap":1,"kb_used_meta":129726,"kb_avail":94226560,"statfs":{"total":96636764160,"available":96487997440,"internally_reserved":0,"allocated":15908864,"data_stored":13922526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":132839877},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":16,"seq":68719477634,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":136056,"kb_used_data":24360,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94235784,"statfs":{"total":96636764160,"available":96497442816,"internally_reserved":0,"allocated":24944640,"data_stored":22945833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":15,"seq":64424510339,"num_pgs":105,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":214292,"kb_used_data":16580,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94157548,"statfs":{"total":96636764160,"available":96417329152,"internally_reserved":0,"allocated":16977920,"data_stored":14990871,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424510337,"num_pgs":111,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":106896,"kb_used_data":17408,"kb_used_omap":1,"kb_used_meta":89470,"kb_avail":94264944,"statfs":{"total":96636764160,"available":96527302656,"internally_reserved":0,"allocated":17825792,"data_stored":15808424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":91617734},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424510338,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":239100,"kb_used_data":13548,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94132740,"statfs":{"total":96636764160,"available":96391925760,"internally_reserved":0,"allocated":13873152,"data_stored":11862637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424510339,"num_pgs":132,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":253088,"kb_used_data":19216,"kb_used_omap":1,"kb_used_meta":233854,"kb_avail":94118752,"statfs":{"total":96636764160,"available":96377602048,"internally_reserved":0,"allocated":19677184,"data_stored":17673901,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":239466951},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424510339,"num_pgs":101,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":291176,"kb_used_data":17048,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94080664,"statfs":{"total":96636764160,"available":96338599936,"internally_reserved":0,"allocated":17457152,"data_stored":15457736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":280689093},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575750,"num_pgs":128,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":188040,"kb_used_data":16696,"kb_used_omap":1,"kb_used_meta":171326,"kb_avail":94183800,"statfs":{"total":96636764160,"available":96444211200,"internally_reserved":0,"allocated":17096704,"data_stored":15102370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":175438277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20709376,"data_stored":20709376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12632064,"data_stored":12632064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":11685888,"data_stored":11685888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":15437824,"data_stored":15437824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12865536,"data_stored":12865536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":9035776,"data_stored":9035776,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":13570048,"data_stored":13570048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12754944,"data_stored":12754944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":470,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":516,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":1139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2480,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":2484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4502,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3992,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":4167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":5002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":3747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T01:39:08.804 DEBUG:teuthology.orchestra.run.smithi019:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T01:39:09.150 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T01:39:09.150 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T01:39:09.150 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T01:39:09.150 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.211 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T01:39:09.212 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T01:39:09.212 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.268 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T01:39:09.268 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T01:39:09.268 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.317 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T01:39:09.317 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T01:39:09.317 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.363 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T01:39:09.364 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T01:39:09.364 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.418 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T01:39:09.418 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T01:39:09.418 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.473 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T01:39:09.473 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T01:39:09.473 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.525 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T01:39:09.525 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T01:39:09.525 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.573 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T01:39:09.573 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T01:39:09.573 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T01:39:09.573 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.599 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T01:39:09.600 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T01:39:09.600 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.629 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T01:39:09.630 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T01:39:09.630 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T01:39:09.630 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-12T01:39:09.657 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T01:39:09.657 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T01:39:09.657 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.710 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T01:39:09.711 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T01:39:09.711 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T01:39:09.723 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T01:39:09.724 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T01:39:09.725 DEBUG:teuthology.orchestra.run.smithi019:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T01:39:09.794 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:39:09.795 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T01:39:10.120 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:39:10.120 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T01:39:10.277 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:39:10.277 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T01:39:10.351 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:39:10.351 DEBUG:teuthology.orchestra.run.smithi019:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T01:39:10.433 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:39:10.433 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T01:39:10.617 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:39:10.617 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T01:39:10.738 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:39:10.738 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T01:39:10.813 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:39:10.814 DEBUG:teuthology.orchestra.run.smithi135:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T01:39:10.894 INFO:tasks.ceph:Archiving mon data... 2024-09-12T01:39:10.895 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860/data/mon.a.tgz 2024-09-12T01:39:10.895 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T01:39:10.928 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.rWHbnQSOZ1 2024-09-12T01:39:10.928 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.rWHbnQSOZ1 2024-09-12T01:39:11.154 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.rWHbnQSOZ1 2024-09-12T01:39:11.267 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.rWHbnQSOZ1 is 567KB 2024-09-12T01:39:11.364 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.rWHbnQSOZ1 2024-09-12T01:39:11.394 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860/data/mon.c.tgz 2024-09-12T01:39:11.394 DEBUG:teuthology.orchestra.run.smithi019:> mktemp 2024-09-12T01:39:11.463 INFO:teuthology.orchestra.run.smithi019.stdout:/tmp/tmp.mCqfjiwMSb 2024-09-12T01:39:11.463 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.mCqfjiwMSb 2024-09-12T01:39:11.685 DEBUG:teuthology.orchestra.run.smithi019:> sudo chmod 0666 /tmp/tmp.mCqfjiwMSb 2024-09-12T01:39:11.798 DEBUG:teuthology.orchestra.remote:smithi019:/tmp/tmp.mCqfjiwMSb is 600KB 2024-09-12T01:39:11.896 DEBUG:teuthology.orchestra.run.smithi019:> rm -fr /tmp/tmp.mCqfjiwMSb 2024-09-12T01:39:11.925 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860/data/mon.b.tgz 2024-09-12T01:39:11.926 DEBUG:teuthology.orchestra.run.smithi135:> mktemp 2024-09-12T01:39:11.960 INFO:teuthology.orchestra.run.smithi135.stdout:/tmp/tmp.dv5XXOXWqZ 2024-09-12T01:39:11.960 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.dv5XXOXWqZ 2024-09-12T01:39:12.434 DEBUG:teuthology.orchestra.run.smithi135:> sudo chmod 0666 /tmp/tmp.dv5XXOXWqZ 2024-09-12T01:39:13.426 DEBUG:teuthology.orchestra.remote:smithi135:/tmp/tmp.dv5XXOXWqZ is 600KB 2024-09-12T01:39:14.054 DEBUG:teuthology.orchestra.run.smithi135:> rm -fr /tmp/tmp.dv5XXOXWqZ 2024-09-12T01:39:14.086 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T01:39:14.086 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:39:14.090 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T01:39:14.281 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:39:14.311 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T01:39:14.311 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T01:39:15.132 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860/remote/smithi019/crash 2024-09-12T01:39:15.310 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:39:15.311 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-12T01:39:15.541 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860/remote/smithi135/crash 2024-09-12T01:39:15.581 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T01:39:15.627 INFO:tasks.ceph:Compressing logs... 2024-09-12T01:39:15.627 DEBUG:teuthology.orchestra.run.smithi019:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:39:15.630 DEBUG:teuthology.orchestra.run.smithi135:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T01:39:15.676 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32921.log 2024-09-12T01:39:15.676 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32833.log 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.32921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32921.log.gz 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.32833.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32833.log.gz 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32646.log 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32789.log 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.32646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32646.log.gz 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32734.log 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32877.log 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.32789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32789.log.gz 2024-09-12T01:39:15.677 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.32734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32734.log.gz 2024-09-12T01:39:15.678 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T01:39:15.678 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T01:39:15.678 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.32877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32877.log.gz 2024-09-12T01:39:15.678 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.6.log: 90.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:39:15.678 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:39:15.678 INFO:teuthology.orchestra.run.smithi135.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T01:39:15.678 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32602.log 2024-09-12T01:39:15.678 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T01:39:15.678 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.32602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32602.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32690.log 2024-09-12T01:39:15.678 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-09-12T01:39:15.681 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T01:39:15.681 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67985.log 2024-09-12T01:39:15.681 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127006.log 2024-09-12T01:39:15.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5/var/log/ceph/ceph-client.admin.67985.log: --verbose -- /var/log/ceph/ceph-client.admin.147624.log 2024-09-12T01:39:15.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110512.log 2024-09-12T01:39:15.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98142.log 2024-09-12T01:39:15.681 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.147624.log.gz 2024-09-12T01:39:15.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.110512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115814.log 2024-09-12T01:39:15.681 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.110512.log.gz 2024-09-12T01:39:15.681 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.98142.log: gzip 86.1% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.127006.log.gz -- 2024-09-12T01:39:15.681 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.39449.log 2024-09-12T01:39:15.682 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164186.log 2024-09-12T01:39:15.690 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-mon.b.log: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:39:15.691 INFO:teuthology.orchestra.run.smithi135.stderr:/var/log/ceph/ceph-client.admin.32690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32690.log.gz 2024-09-12T01:39:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.115814.log: /var/log/ceph/ceph-client.admin.39449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39449.log.gz 2024-09-12T01:39:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40437.log 2024-09-12T01:39:15.778 INFO:teuthology.orchestra.run.smithi019.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.115814.log.gz 2024-09-12T01:39:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39103.log 2024-09-12T01:39:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164186.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.98142.log.gz 2024-09-12T01:39:15.778 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164186.log.gz 2024-09-12T01:39:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138789.log 2024-09-12T01:39:15.778 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40437.log.gz 2024-09-12T01:39:15.778 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190133.log 2024-09-12T01:39:15.778 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39103.log.gz 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.138789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124650.log 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.138789.log.gz 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190133.log.gz 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39701.log 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.124650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164234.log 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.124650.log.gz 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39701.log.gz 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114636.log 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88129.log 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.164234.log: /var/log/ceph/ceph-client.admin.114636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.185883.log 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.164234.log.gz 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.114636.log.gz 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40049.log 2024-09-12T01:39:15.779 INFO:teuthology.orchestra.run.smithi019.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.88129.log.gz 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.185883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59418.log 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40049.log: gzip -5 --verbose -- 82.7% /var/log/ceph/ceph-client.admin.190777.log 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.185883.log.gz 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40049.log.gz 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59418.log.gz 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40122.log 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181705.log 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190777.log.gz 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40122.log.gz 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178660.log 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.181705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191143.log 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr: 84.0% -- replaced with /var/log/ceph/ceph-client.0.181705.log.gz 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.178660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92252.log 2024-09-12T01:39:15.780 INFO:teuthology.orchestra.run.smithi019.stderr: 83.4% -- replaced with /var/log/ceph/ceph-client.0.178660.log.gz 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.191143.log: -- /var/log/ceph/ceph-client.admin.145268.log 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191143.log.gz 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.92252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132896.log 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.92252.log.gz 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38957.log 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.145268.log.gz 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.132896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85184.log 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.132896.log.gz 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39962.log 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38957.log.gz 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.85184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62949.log 2024-09-12T01:39:15.781 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39962.log: 81.2% -- replaced with /var/log/ceph/ceph-client.admin.85184.log.gz 2024-09-12T01:39:15.782 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39962.log.gz 2024-09-12T01:39:15.782 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96375.log 2024-09-12T01:39:15.782 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95197.log 2024-09-12T01:39:15.782 INFO:teuthology.orchestra.run.smithi019.stderr: 22.9% -- replaced with /var/log/ceph/ceph-client.admin.62949.log.gz 2024-09-12T01:39:15.782 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.96375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62885.log 2024-09-12T01:39:15.782 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.96375.log.gz 2024-09-12T01:39:15.782 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.95197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151747.log 2024-09-12T01:39:15.782 INFO:teuthology.orchestra.run.smithi019.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.95197.log.gz 2024-09-12T01:39:15.782 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103444.log 2024-09-12T01:39:15.782 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62885.log: 21.2% -- replaced with /var/log/ceph/ceph-client.admin.62885.log.gz 2024-09-12T01:39:15.782 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.151747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99320.log 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.103444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156459.log 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.103444.log.gz 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.99320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102855.log 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.99320.log.gz 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.156459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174977.log 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.151747.log.gz 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.156459.log.gz 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135844.log 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.102855.log: /var/log/ceph/ceph-client.admin.174977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158226.log 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.102855.log.gz 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39044.log 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.135844.log.gz 2024-09-12T01:39:15.783 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146446.log 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158226.log: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.174977.log.gz 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.158226.log.gz 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39044.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39044.log.gz 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.146446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120526.log 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.146446.log.gz 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118170.log 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.120526.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182923.log 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.120526.log.gz 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62224.log 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.118170.log: /var/log/ceph/ceph-client.0.182923.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.118170.log.gz 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.182923.log.gz 2024-09-12T01:39:15.784 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39795.log 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119937.log 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39795.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72201.log 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39795.log.gz 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.119937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69855.log 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.119937.log.gz 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167650.log 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.72201.log.gz 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39455.log 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.69855.log: /var/log/ceph/ceph-client.admin.167650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89307.log 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39455.log.gz 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.167650.log.gz 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96964.log 2024-09-12T01:39:15.785 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144679.log 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr: 95.0% -- replaced with /var/log/ceph/ceph-client.admin.67985.log.gz 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.89307.log.gz 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.69855.log.gz/var/log/ceph/ceph-client.admin.96964.log: 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117581.log 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.96964.log.gz 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191053.log 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.144679.log.gz 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.117581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76620.log 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.191053.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.139378.log 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.117581.log.gz 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191053.log.gz 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.76620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108156.log 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr: 50.1% -- replaced with /var/log/ceph/ceph-client.admin.76620.log.gz 2024-09-12T01:39:15.786 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164823.log 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139378.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.139378.log.gz 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.108156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39454.log 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.164823.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.88718.log 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108156.log.gz 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43384.log 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39454.log.gz 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.164823.log.gz 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.88718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123472.log 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.88718.log.gz 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.43384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170642.log 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.43384.log.gz 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.123472.log: -5 --verbose -- /var/log/ceph/ceph-client.0.41569.log 2024-09-12T01:39:15.787 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.123472.log.gz/var/log/ceph/ceph-client.admin.170642.log: 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57651.log 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.170642.log.gz 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.0.41569.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.104033.log 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr: 44.2% -- replaced with /var/log/ceph/ceph-client.0.41569.log.gz 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190823.log 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.57651.log.gz 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.104033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159405.log 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104033.log.gz 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143501.log 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190823.log.gz 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157637.log 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159405.log.gz 2024-09-12T01:39:15.788 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.143501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190501.log 2024-09-12T01:39:15.789 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157637.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105800.log 2024-09-12T01:39:15.789 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.143501.log.gz 2024-09-12T01:39:15.789 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.157637.log.gz 2024-09-12T01:39:15.789 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122883.log 2024-09-12T01:39:15.789 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190501.log.gz 2024-09-12T01:39:15.789 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.105800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33205.log 2024-09-12T01:39:15.789 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105800.log.gz 2024-09-12T01:39:15.789 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47494.log 2024-09-12T01:39:15.789 INFO:teuthology.orchestra.run.smithi019.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.122883.log.gz 2024-09-12T01:39:15.789 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179269.log 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33205.log.gz 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.47494.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.187817.log 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.47494.log.gz 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.179269.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.179269.log.gz 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190179.log 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39447.log 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62224.log.gz 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187817.log.gz 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176224.log 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190179.log.gz 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39447.log.gz 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40483.log 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.176224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46316.log 2024-09-12T01:39:15.790 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40483.log: 83.8% -- replaced with /var/log/ceph/ceph-client.0.176224.log.gz 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40483.log.gz 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94608.log 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100498.log 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.46316.log.gz 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.94608.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.188536.log 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.94608.log.gz 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.100498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128773.log 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100498.log.gz 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191099.log 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.188536.log: /var/log/ceph/ceph-client.admin.128773.log: 80.6% -- replaced with /var/log/ceph/ceph-client.0.188536.log.gz 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187768.log 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.128773.log.gz 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61511.log 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191099.log.gz 2024-09-12T01:39:15.791 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.187768.log: -- /var/log/ceph/ceph-client.admin.135255.log 2024-09-12T01:39:15.792 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187768.log.gz 2024-09-12T01:39:15.792 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49898.log 2024-09-12T01:39:15.792 INFO:teuthology.orchestra.run.smithi019.stderr: 59.7% -- replaced with /var/log/ceph/ceph-client.admin.61511.log.gz 2024-09-12T01:39:15.792 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.135255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.181096.log 2024-09-12T01:39:15.792 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.135255.log.gz 2024-09-12T01:39:15.792 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169426.log 2024-09-12T01:39:15.792 INFO:teuthology.orchestra.run.smithi019.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.49898.log.gz 2024-09-12T01:39:15.792 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.181096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52302.log 2024-09-12T01:39:15.792 INFO:teuthology.orchestra.run.smithi019.stderr: 80.2% -- replaced with /var/log/ceph/ceph-client.0.181096.log.gz 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.169426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190041.log 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152336.log 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.52302.log.gz 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163597.log 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190041.log.gz 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152336.log: 93.7% -- replaced with /var/log/ceph/ceph-client.admin.169426.log.gz 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39452.log 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.152336.log.gz 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187108.log 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163597.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.163597.log.gz 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148802.log 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39452.log.gz 2024-09-12T01:39:15.793 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190685.log 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187108.log.gz 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40391.log 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148802.log: /var/log/ceph/ceph-client.admin.190685.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.148802.log.gz 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190685.log.gz 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60644.log 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67365.log 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40391.log.gz 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.60644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40228.log 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.60644.log.gz 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.67365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48720.log 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93430.log 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40228.log.gz 2024-09-12T01:39:15.794 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60055.log 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.48720.log.gz 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.93430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84595.log 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.93430.log.gz 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.60055.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49309.log 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.67365.log.gz 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84595.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140556.log 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.60055.log.gz 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.84595.log.gz 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141734.log 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.49309.log: /var/log/ceph/ceph-client.admin.140556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132307.log 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.49309.log.gz 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.140556.log.gz 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77282.log 2024-09-12T01:39:15.795 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.132307.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T01:39:15.796 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.132307.log.gz 2024-09-12T01:39:15.796 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.77282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165412.log 2024-09-12T01:39:15.796 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.audit.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.77282.log.gz 2024-09-12T01:39:15.796 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57038.log 2024-09-12T01:39:15.796 INFO:teuthology.orchestra.run.smithi019.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.141734.log.gz 2024-09-12T01:39:15.796 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.165412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134074.log 2024-09-12T01:39:15.796 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.165412.log.gz 2024-09-12T01:39:15.796 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.57038.log: -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57038.log.gz 2024-09-12T01:39:15.796 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.104622.log 2024-09-12T01:39:15.796 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.134074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95786.log 2024-09-12T01:39:15.796 INFO:teuthology.orchestra.run.smithi019.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.134074.log.gz 2024-09-12T01:39:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.104622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39453.log 2024-09-12T01:39:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.95786.log: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154103.log 2024-09-12T01:39:15.797 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.104622.log.gz 2024-09-12T01:39:15.797 INFO:teuthology.orchestra.run.smithi019.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.95786.log.gz 2024-09-12T01:39:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39689.log 2024-09-12T01:39:15.797 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39453.log.gz 2024-09-12T01:39:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154103.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T01:39:15.797 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.184141.log 2024-09-12T01:39:15.797 INFO:teuthology.orchestra.run.smithi019.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.154103.log.gz 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39689.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39689.log.gz 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42172.log 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.184141.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133485.log 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr: 84.2% -- replaced with /var/log/ceph/ceph-client.0.184141.log.gz 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.42172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160015.log 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.42172.log.gz 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75910.log 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.133485.log: /var/log/ceph/ceph-client.admin.160015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.183532.log 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160015.log.gz 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.75910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50487.log 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr: 84.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79294.log 2024-09-12T01:39:15.798 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.0.75910.log.gz/var/log/ceph/ceph-client.0.183532.log: 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.50487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149980.log 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.183532.log.gz 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.133485.log.gz 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.50487.log.gz 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61873.log 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.79294.log.gz 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175585.log 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142323.log 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr: 51.2% -- replaced with /var/log/ceph/ceph-client.admin.61873.log.gz 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.175585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162419.log 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142323.log: gzip -5 92.2% -- replaced with /var/log/ceph/ceph-client.admin.175585.log.gz 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.90485.log 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.142323.log.gz 2024-09-12T01:39:15.799 INFO:teuthology.orchestra.run.smithi019.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.149980.log.gz 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167001.log 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.162419.log.gz 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40960.log 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.90485.log: /var/log/ceph/ceph-client.0.167001.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.90485.log.gz 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62288.log 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.0.167001.log.gz 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.40960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136433.log 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56425.log 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62288.log: 52.4% -- replaced with /var/log/ceph/ceph-client.admin.62288.log.gz 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.136433.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154692.log 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr: 95.9% -- replaced with /var/log/ceph/ceph-client.0.40960.log.gz 2024-09-12T01:39:15.800 INFO:teuthology.orchestra.run.smithi019.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.136433.log.gz 2024-09-12T01:39:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.56425.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139967.log 2024-09-12T01:39:15.801 INFO:teuthology.orchestra.run.smithi019.stderr: 83.1% -- replaced with /var/log/ceph/ceph-client.admin.56425.log.gz 2024-09-12T01:39:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.154692.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T01:39:15.801 INFO:teuthology.orchestra.run.smithi019.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.154692.log.gz 2024-09-12T01:39:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55836.log 2024-09-12T01:39:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.139967.log: /var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98731.log 2024-09-12T01:39:15.801 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.139967.log.gz 2024-09-12T01:39:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48083.log 2024-09-12T01:39:15.801 INFO:teuthology.orchestra.run.smithi019.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.55836.log.gz 2024-09-12T01:39:15.801 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.98731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150569.log 2024-09-12T01:39:15.802 INFO:teuthology.orchestra.run.smithi019.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.98731.log.gz 2024-09-12T01:39:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92841.log 2024-09-12T01:39:15.802 INFO:teuthology.orchestra.run.smithi019.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.48083.log.gz 2024-09-12T01:39:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.150569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94019.log 2024-09-12T01:39:15.802 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.150569.log.gz 2024-09-12T01:39:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.92841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52891.log 2024-09-12T01:39:15.802 INFO:teuthology.orchestra.run.smithi019.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.92841.log.gz 2024-09-12T01:39:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.94019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127595.log 2024-09-12T01:39:15.802 INFO:teuthology.orchestra.run.smithi019.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94019.log.gz 2024-09-12T01:39:15.802 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.52891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79883.log 2024-09-12T01:39:15.803 INFO:teuthology.orchestra.run.smithi019.stderr: 85.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187132.log 2024-09-12T01:39:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.127595.log: -- replaced with /var/log/ceph/ceph-client.admin.52891.log.gz 2024-09-12T01:39:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.79883.log: 82.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.127595.log.gz 2024-09-12T01:39:15.803 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.106389.log 2024-09-12T01:39:15.803 INFO:teuthology.orchestra.run.smithi019.stderr: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.79883.log.gz 2024-09-12T01:39:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62083.log 2024-09-12T01:39:15.803 INFO:teuthology.orchestra.run.smithi019.stderr: 94.2% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T01:39:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187132.log: /var/log/ceph/ceph-client.admin.106389.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.187132.log.gz 2024-09-12T01:39:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101087.log 2024-09-12T01:39:15.803 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147035.log 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.62083.log.gz 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.101087.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161193.log 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.101087.log.gz 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.147035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84006.log 86.1% -- replaced with /var/log/ceph/ceph-client.admin.106389.log.gz 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.147035.log.gz 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161193.log: gzip 81.6% -- replaced with /var/log/ceph/ceph-client.admin.161193.log.gz -5 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.82239.log 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.84006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191007.log 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.84006.log.gz 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.82239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125239.log 2024-09-12T01:39:15.804 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.82239.log.gz 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.191007.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191007.log.gz 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40051.log 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125239.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53480.log 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40051.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.0.184750.log 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.40051.log.gz 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.125239.log.gz 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.53480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142912.log 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.53480.log.gz 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.184750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40233.log 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.184750.log.gz 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.142912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124061.log 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.142912.log.gz 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83417.log 2024-09-12T01:39:15.805 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40233.log.gz 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr:gzip/var/log/ceph/ceph-client.admin.124061.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.145857.log 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.124061.log.gz 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.83417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151158.log 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.83417.log.gz 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39796.log 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.145857.log: /var/log/ceph/ceph-client.admin.151158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48672.log 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr: 85.3%/var/log/ceph/ceph-client.admin.39796.log: -- replaced with /var/log/ceph/ceph-client.admin.151158.log.gz 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39796.log.gz 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159426.log 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48672.log.gz 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.189995.log 2024-09-12T01:39:15.806 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.159426.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.145857.log.gz 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51076.log 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.159426.log.gz 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.189995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144090.log 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.189995.log.gz 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97553.log 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51076.log.gz 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.144090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131129.log 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.144090.log.gz 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.97553.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161782.log 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.97553.log.gz 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.131129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32772.log 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126417.log 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.161782.log: -- replaced with /var/log/ceph/ceph-client.admin.131129.log.gz 2024-09-12T01:39:15.807 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.32772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70475.log 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% 89.5% -- replaced with /var/log/ceph/ceph-client.admin.161782.log.gz 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32772.log.gz 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160604.log 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.126417.log: /var/log/ceph/ceph-client.admin.70475.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.126417.log.gz 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69223.log 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33110.log 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.160604.log: /var/log/ceph/ceph-client.admin.69223.log: 80.4% -- replaced with /var/log/ceph/ceph-client.admin.160604.log.gz 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190225.log 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.33110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33110.log.gz 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109923.log 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190225.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.69223.log.gz 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190225.log.gz 2024-09-12T01:39:15.808 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.130540.log 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.109923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190593.log 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.130540.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.109923.log.gz 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187084.log 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.130540.log.gz 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190593.log: 92.0% -- replaced with /var/log/ceph/ceph-client.admin.70475.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190593.log.gz 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155870.log 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.180487.log 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187084.log.gz 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38866.log 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.155870.log.gz 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.180487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58829.log 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr: 80.3% -- replaced with /var/log/ceph/ceph-client.0.180487.log.gz 2024-09-12T01:39:15.809 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.38866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38866.log.gz 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82828.log 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190869.log 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58829.log: /var/log/ceph/ceph-client.admin.82828.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.58829.log.gz 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65507.log 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.82828.log.gz 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190869.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190869.log.gz 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.65507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59442.log 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101677.log 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59442.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39195.log 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.59442.log.gz 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.101677.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.101677.log.gz 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128184.log 2024-09-12T01:39:15.810 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54658.log 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39195.log.gz 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.128184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63061.log 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.128184.log.gz 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54658.log: 83.9% -- replaced with /var/log/ceph/ceph-client.admin.54658.log.gz 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131718.log 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.177442.log 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63061.log: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.65507.log.gz 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.131718.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.63061.log.gz 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose 89.2% -- replaced with /var/log/ceph/ceph-client.admin.131718.log.gz 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr: -- /var/log/ceph/ceph-client.admin.116992.log 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.177442.log: gzip 83.8% -- replaced with /var/log/ceph/ceph-client.0.177442.log.gz 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.43987.log 2024-09-12T01:39:15.811 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.116992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39021.log 2024-09-12T01:39:15.812 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.116992.log.gz 2024-09-12T01:39:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.43987.log: 43.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134663.log 2024-09-12T01:39:15.812 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.0.43987.log.gz 2024-09-12T01:39:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99909.log 2024-09-12T01:39:15.812 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39021.log.gz 2024-09-12T01:39:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.134663.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.134663.log.gz 2024-09-12T01:39:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119348.log 2024-09-12T01:39:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.99909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164210.log 2024-09-12T01:39:15.812 INFO:teuthology.orchestra.run.smithi019.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.99909.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48696.log 2024-09-12T01:39:15.812 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T01:39:15.812 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.119348.log: /var/log/ceph/ceph-client.admin.164210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164210.log.gz 2024-09-12T01:39:15.813 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.119348.log.gz 2024-09-12T01:39:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66746.log 2024-09-12T01:39:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.48696.log: gzip -5 --verbose -- 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48696.log.gz 2024-09-12T01:39:15.813 INFO:teuthology.orchestra.run.smithi019.stderr: /var/log/ceph/ceph-client.admin.64269.log 2024-09-12T01:39:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116403.log 2024-09-12T01:39:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162371.log 2024-09-12T01:39:15.813 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.116403.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.64269.log.gz 2024-09-12T01:39:15.813 INFO:teuthology.orchestra.run.smithi019.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.116403.log.gz 2024-09-12T01:39:15.814 INFO:teuthology.orchestra.run.smithi019.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.66746.log.gz 2024-09-12T01:39:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T01:39:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5/var/log/ceph/ceph-client.admin.162371.log: --verbose -- /var/log/ceph/ceph-client.0.42781.log 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162371.log.gz 2024-09-12T01:39:15.814 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T01:39:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190547.log 2024-09-12T01:39:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.42781.log: 43.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63650.log 2024-09-12T01:39:15.814 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.0.42781.log.gz 2024-09-12T01:39:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190547.log.gz 2024-09-12T01:39:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112868.log 2024-09-12T01:39:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39451.log 2024-09-12T01:39:15.814 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.63650.log: /var/log/ceph/ceph-client.admin.112868.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.112868.log.gz 2024-09-12T01:39:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87540.log 2024-09-12T01:39:15.822 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39451.log.gz 2024-09-12T01:39:15.824 INFO:teuthology.orchestra.run.smithi019.stderr: 93.8% -- replaced with /var/log/ceph/ceph-client.admin.63650.log.gz 2024-09-12T01:39:15.824 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118759.log 2024-09-12T01:39:15.824 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/valgrind/ceph.client.0.log 2024-09-12T01:39:15.824 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.87540.log: /var/log/ceph/ceph-client.admin.118759.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.87540.log.gz 2024-09-12T01:39:15.824 INFO:teuthology.orchestra.run.smithi019.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.118759.log.gz 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172614.log 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/valgrind/ceph.client.0.log: 62.7% -- replaced with /var/log/ceph/valgrind/ceph.client.0.log.gz 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190915.log 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190455.log 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172614.log: /var/log/ceph/ceph-client.admin.190915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190915.log.gz 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172614.log.gz 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153514.log 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190271.log 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190455.log.gz 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.153514.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190271.log.gz 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76673.log 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-mgr.y.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.153514.log.gz 2024-09-12T01:39:15.825 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78705.log 2024-09-12T01:39:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.76673.log: 92.1% -- replaced with /var/log/ceph/ceph-client.0.76673.log.gz 2024-09-12T01:39:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122294.log 2024-09-12T01:39:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78705.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.78705.log.gz 2024-09-12T01:39:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66126.log 2024-09-12T01:39:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.122294.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.122294.log.gz 2024-09-12T01:39:15.826 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190363.log 2024-09-12T01:39:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.66126.log: 92.9% -- replaced with /var/log/ceph/ceph-client.admin.66126.log.gz 2024-09-12T01:39:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74564.log 2024-09-12T01:39:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190363.log.gz 2024-09-12T01:39:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176833.log 2024-09-12T01:39:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.74564.log: 94.4% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T01:39:15.831 INFO:teuthology.orchestra.run.smithi019.stderr: 82.8% -- replaced with /var/log/ceph/ceph-client.admin.74564.log.gz 2024-09-12T01:39:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141145.log 2024-09-12T01:39:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.176833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.182314.log 2024-09-12T01:39:15.831 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.141145.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.176833.log.gz 2024-09-12T01:39:15.831 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.141145.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40937.log 2024-09-12T01:39:15.831 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T01:39:15.832 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.182314.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T01:39:15.832 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40937.log: 84.4% -- replaced with /var/log/ceph/ceph-client.0.182314.log.gz 2024-09-12T01:39:15.832 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40937.log.gz 2024-09-12T01:39:15.832 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105211.log 2024-09-12T01:39:15.832 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173830.log 2024-09-12T01:39:15.834 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.105211.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.105211.log.gz 2024-09-12T01:39:15.834 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59466.log 2024-09-12T01:39:15.834 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173830.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173830.log.gz 2024-09-12T01:39:15.835 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173222.log 2024-09-12T01:39:15.835 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.59466.log: 83.2% -- replaced with /var/log/ceph/ceph-client.admin.59466.log.gz 2024-09-12T01:39:15.835 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58240.log 2024-09-12T01:39:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.173222.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.173222.log.gz 2024-09-12T01:39:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73973.log 2024-09-12T01:39:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.58240.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.58240.log.gz 2024-09-12T01:39:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.44590.log 2024-09-12T01:39:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.73973.log: 81.0% -- replaced with /var/log/ceph/ceph-client.admin.73973.log.gz 2024-09-12T01:39:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72790.log 2024-09-12T01:39:15.838 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.44590.log: 43.5% -- replaced with /var/log/ceph/ceph-client.0.44590.log.gz 2024-09-12T01:39:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39700.log 2024-09-12T01:39:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.72790.log: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.72790.log.gz 2024-09-12T01:39:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187744.log 2024-09-12T01:39:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39700.log.gz 2024-09-12T01:39:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114046.log 2024-09-12T01:39:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187744.log.gz 2024-09-12T01:39:15.842 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168258.log 2024-09-12T01:39:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.114046.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.114046.log.gz 2024-09-12T01:39:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89896.log 2024-09-12T01:39:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.168258.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.168258.log.gz 2024-09-12T01:39:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190087.log 2024-09-12T01:39:15.872 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.89896.log: 93.5% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T01:39:15.872 INFO:teuthology.orchestra.run.smithi019.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.89896.log.gz 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62350.log 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178051.log 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62350.log: /var/log/ceph/ceph-client.admin.190087.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190087.log.gz 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.admin.62350.log.gz 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80472.log 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187062.log 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.178051.log: /var/log/ceph/ceph-client.admin.80472.log: 80.1% -- replaced with /var/log/ceph/ceph-client.0.178051.log.gz 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55247.log 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.80472.log.gz 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137022.log 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr: 95.1% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.55247.log: 24.3% -- replaced with /var/log/ceph/ceph-client.admin.187062.log.gz 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.55247.log.gz 2024-09-12T01:39:15.873 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46905.log 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.137022.log: /var/log/ceph/ceph-client.admin.137611.log 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.46905.log: 87.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39797.log 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.137022.log.gz 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr: 83.3% -- replaced with /var/log/ceph/ceph-client.admin.46905.log.gz 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40893.log 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.137611.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.137611.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91074.log 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39797.log: /var/log/ceph/ceph-client.admin.40893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39797.log.gz 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40893.log.gz 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71139.log 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.91074.log: -- /var/log/ceph/ceph-client.admin.129362.log 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 81.6% -- replaced with /var/log/ceph/ceph-client.admin.91074.log.gz 2024-09-12T01:39:15.874 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.81061.log 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129362.log: /var/log/ceph/ceph-client.admin.71139.log: gzip -5 --verbose 81.9% -- /var/log/ceph/ceph-client.admin.129951.log 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.129362.log.gz 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81061.log: 84.2% -- replaced with /var/log/ceph/ceph-client.admin.71139.log.gzgzip -5 --verbose -- 81.9% /var/log/ceph/ceph-client.admin.152925.log 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.81061.log.gz 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.129951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138200.log 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.129951.log.gz 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108745.log 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.152925.log: /var/log/ceph/ceph-client.admin.138200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111101.log 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.152925.log.gz 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.108745.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.138200.log.gz 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:gzip 82.0% -- replaced with /var/log/ceph/ceph-client.admin.108745.log.gz -5 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51713.log 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102266.log 2024-09-12T01:39:15.875 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.111101.log: /var/log/ceph/ceph-client.admin.51713.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51124.log 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.111101.log.gz 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.102266.log: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.51713.log.gz 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149391.log 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.51124.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.102266.log.gz 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 84.2% -- replaced with /var/log/ceph/ceph-client.admin.51124.log.gz 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.149391.log: gzip 81.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.39445.log 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.149391.log.gz 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/rgw.ceph.client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162395.log 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40075.log 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39445.log.gz 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.162395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162395.log.gzgzip 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61763.log 2024-09-12T01:39:15.876 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107567.log 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40075.log.gz 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.61763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121704.log 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.61763.log.gz 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.107567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86362.log 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.107567.log.gz 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.121704.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.121704.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86951.log 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106978.log 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.86362.log.gz 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.86951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155281.log 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.86951.log.gz 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.106978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187841.log 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.155281.log: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.106978.log.gz 2024-09-12T01:39:15.877 INFO:teuthology.orchestra.run.smithi019.stderr: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.155281.log.gz 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172006.log 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78116.log 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.172006.log: /var/log/ceph/ceph-client.admin.187841.log: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.187841.log.gz 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.172006.log.gz 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73383.log 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187792.log 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.78116.log: /var/log/ceph/ceph-client.admin.73383.log: 82.7% -- replaced with /var/log/ceph/ceph-client.admin.78116.log.gz 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111690.log 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.73383.log.gz 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.187792.log.gz 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40174.log 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.111690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170034.log 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.111690.log.gz 2024-09-12T01:39:15.878 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40849.log 2024-09-12T01:39:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.170034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40174.log.gz 2024-09-12T01:39:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40761.log 2024-09-12T01:39:15.879 INFO:teuthology.orchestra.run.smithi019.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.170034.log.gz 2024-09-12T01:39:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190317.log 2024-09-12T01:39:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40761.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40849.log.gz 2024-09-12T01:39:15.879 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40761.log.gz 2024-09-12T01:39:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.189230.log 2024-09-12T01:39:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68604.log 2024-09-12T01:39:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190317.log.gz 2024-09-12T01:39:15.879 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.189230.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39241.log 2024-09-12T01:39:15.891 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.68604.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.189230.log.gz 2024-09-12T01:39:15.891 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57014.log 2024-09-12T01:39:15.891 INFO:teuthology.orchestra.run.smithi019.stderr: 92.5% -- replaced with /var/log/ceph/ceph-client.admin.68604.log.gz 2024-09-12T01:39:15.891 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39241.log.gz 2024-09-12T01:39:15.891 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.179878.log 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171250.log 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57014.log.gz 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.179878.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.26680.log 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr: 83.9% -- replaced with /var/log/ceph/ceph-client.0.179878.log.gz 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.171250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.187722.log 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph.tmp-client.admin.26680.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.26680.log.gz 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.171250.log.gz 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190409.log 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.187722.log: 24.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113457.log 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.187722.log.gz 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.186472.log 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190409.log.gz 2024-09-12T01:39:15.892 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.113457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62162.log 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.113457.log.gz 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.186472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75301.log 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.62162.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.186472.log.gz 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62162.log.gz 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85773.log 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190639.log 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.0.75301.log: /var/log/ceph/ceph-client.admin.85773.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.75301.log.gz 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.85773.log.gz 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91663.log 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109334.log 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190639.log.gz 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.91663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64888.log 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.91663.log.gz 2024-09-12T01:39:15.893 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.109334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75155.log 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.64888.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.109334.log.gz 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190961.log 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.75155.log: 24.6% -- replaced with /var/log/ceph/ceph-client.admin.75155.log.gz 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39149.log 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190961.log.gz 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163008.log 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39149.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39149.log.gz 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112279.log 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.163008.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.163008.log.gz 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39794.log 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.112279.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.112279.log.gz 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148213.log 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.39794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39794.log.gz 2024-09-12T01:39:15.894 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157048.log 2024-09-12T01:39:15.895 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.148213.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.148213.log.gz 2024-09-12T01:39:15.895 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T01:39:15.895 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.157048.log: 93.3% 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157048.log.gz 2024-09-12T01:39:15.895 INFO:teuthology.orchestra.run.smithi019.stderr: -- replaced with /var/log/ceph/ceph-client.admin.64888.log.gz 2024-09-12T01:39:15.895 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51100.log 2024-09-12T01:39:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.190731.log 2024-09-12T01:39:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.51100.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51100.log.gz 2024-09-12T01:39:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121115.log 2024-09-12T01:39:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.190731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.190731.log.gz 2024-09-12T01:39:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125828.log 2024-09-12T01:39:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.121115.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.121115.log.gz 2024-09-12T01:39:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81650.log 2024-09-12T01:39:15.907 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.125828.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.125828.log.gz 2024-09-12T01:39:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54069.log 2024-09-12T01:39:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.81650.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.81650.log.gz 2024-09-12T01:39:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40231.log 2024-09-12T01:39:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.54069.log: 84.0% -- replaced with /var/log/ceph/ceph-client.admin.54069.log.gz 2024-09-12T01:39:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115225.log 2024-09-12T01:39:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40231.log.gz 2024-09-12T01:39:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40805.log 2024-09-12T01:39:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.115225.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.115225.log.gz 2024-09-12T01:39:15.908 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57062.log 2024-09-12T01:39:15.909 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.40805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40805.log.gz 2024-09-12T01:39:15.909 INFO:teuthology.orchestra.run.smithi019.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158815.log 2024-09-12T01:39:15.909 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.57062.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.57062.log.gz 2024-09-12T01:39:15.909 INFO:teuthology.orchestra.run.smithi019.stderr:/var/log/ceph/ceph-client.admin.158815.log: 80.9% -- replaced with /var/log/ceph/ceph-client.admin.158815.log.gz 2024-09-12T01:39:16.125 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T01:39:16.673 INFO:teuthology.orchestra.run.smithi019.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T01:39:16.879 INFO:teuthology.orchestra.run.smithi135.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T01:39:19.326 INFO:teuthology.orchestra.run.smithi019.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T01:39:20.385 INFO:teuthology.orchestra.run.smithi019.stderr: 92.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T01:39:24.979 INFO:teuthology.orchestra.run.smithi135.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T01:39:25.973 INFO:teuthology.orchestra.run.smithi135.stderr: 94.6% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T01:39:26.023 INFO:teuthology.orchestra.run.smithi019.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T01:39:26.705 INFO:teuthology.orchestra.run.smithi019.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T01:39:28.524 INFO:teuthology.orchestra.run.smithi019.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T01:39:29.505 INFO:teuthology.orchestra.run.smithi135.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T01:39:35.676 INFO:teuthology.orchestra.run.smithi135.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T01:39:35.678 INFO:teuthology.orchestra.run.smithi135.stderr: 2024-09-12T01:39:35.678 INFO:teuthology.orchestra.run.smithi135.stderr:real 0m20.018s 2024-09-12T01:39:35.678 INFO:teuthology.orchestra.run.smithi135.stderr:user 0m52.999s 2024-09-12T01:39:35.679 INFO:teuthology.orchestra.run.smithi135.stderr:sys 0m1.946s 2024-09-12T01:39:37.982 INFO:teuthology.orchestra.run.smithi019.stderr: 94.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T01:39:37.984 INFO:teuthology.orchestra.run.smithi019.stderr: 2024-09-12T01:39:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:real 0m22.322s 2024-09-12T01:39:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:user 1m3.409s 2024-09-12T01:39:37.984 INFO:teuthology.orchestra.run.smithi019.stderr:sys 0m2.264s 2024-09-12T01:39:37.984 INFO:tasks.ceph:Archiving logs... 2024-09-12T01:39:37.985 DEBUG:teuthology.misc:Transferring archived files from smithi019:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860/remote/smithi019/log 2024-09-12T01:39:37.986 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:39:46.182 DEBUG:teuthology.misc:Transferring archived files from smithi135:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860/remote/smithi135/log 2024-09-12T01:39:46.183 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T01:39:55.901 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T01:39:55.911 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T01:39:55.912 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:39:55.914 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T01:39:56.037 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T01:39:56.047 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T01:39:56.047 DEBUG:teuthology.orchestra.run.smithi019:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:39:56.050 DEBUG:teuthology.orchestra.run.smithi135:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T01:39:56.081 INFO:teuthology.orchestra.run.smithi135.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:39:56.081 INFO:teuthology.orchestra.run.smithi019.stderr:bash: line 1: ntpq: command not found 2024-09-12T01:39:56.085 INFO:teuthology.orchestra.run.smithi135.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:39:56.085 INFO:teuthology.orchestra.run.smithi135.stdout:=============================================================================== 2024-09-12T01:39:56.085 INFO:teuthology.orchestra.run.smithi135.stdout:^* hv01.front.sepia.ceph.com 3 7 377 54 -1997us[-1982us] +/- 60ms 2024-09-12T01:39:56.085 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 46 -186us[ -186us] +/- 58ms 2024-09-12T01:39:56.085 INFO:teuthology.orchestra.run.smithi135.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 44 +2554us[+2554us] +/- 69ms 2024-09-12T01:39:56.085 INFO:teuthology.orchestra.run.smithi135.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:56.087 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-12T01:39:56.087 INFO:teuthology.orchestra.run.smithi019.stdout:=============================================================================== 2024-09-12T01:39:56.087 INFO:teuthology.orchestra.run.smithi019.stdout:^* hv01.front.sepia.ceph.com 3 7 377 45 -2020us[-1994us] +/- 60ms 2024-09-12T01:39:56.087 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 41 -203us[ -203us] +/- 58ms 2024-09-12T01:39:56.087 INFO:teuthology.orchestra.run.smithi019.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 50 +2575us[+2602us] +/- 69ms 2024-09-12T01:39:56.087 INFO:teuthology.orchestra.run.smithi019.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-09-12T01:39:56.087 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T01:39:56.097 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T01:39:56.098 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T01:39:56.108 DEBUG:teuthology.orchestra.run.smithi019:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:39:56.214 DEBUG:teuthology.orchestra.run.smithi135:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-12T01:39:56.294 DEBUG:teuthology.orchestra.run.smithi019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:39:56.339 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:39:56.340 DEBUG:teuthology.orchestra.run.smithi135:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-12T01:39:56.385 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:39:56.385 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T01:39:56.398 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T01:39:56.409 INFO:teuthology.task.internal:Duration was 4935.465899 seconds 2024-09-12T01:39:56.409 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T01:39:56.420 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T01:39:56.420 DEBUG:teuthology.orchestra.run.smithi019:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:39:56.422 DEBUG:teuthology.orchestra.run.smithi135:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T01:39:56.477 INFO:teuthology.orchestra.run.smithi019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:39:56.478 INFO:teuthology.orchestra.run.smithi135.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-12T01:39:56.635 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T01:39:56.635 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi019.front.sepia.ceph.com 2024-09-12T01:39:56.636 DEBUG:teuthology.orchestra.run.smithi019:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:39:56.670 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi135.front.sepia.ceph.com 2024-09-12T01:39:56.670 DEBUG:teuthology.orchestra.run.smithi135:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T01:39:56.713 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T01:39:56.713 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:39:56.716 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T01:39:56.794 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T01:39:56.795 DEBUG:teuthology.orchestra.run.smithi019:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:39:56.797 DEBUG:teuthology.orchestra.run.smithi135:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T01:39:56.949 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T01:39:56.963 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T01:39:56.964 DEBUG:teuthology.orchestra.run.smithi019:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:39:57.005 DEBUG:teuthology.orchestra.run.smithi135:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T01:39:57.044 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T01:39:57.058 DEBUG:teuthology.orchestra.run.smithi019:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:39:57.060 DEBUG:teuthology.orchestra.run.smithi135:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:39:57.096 INFO:teuthology.orchestra.run.smithi019.stdout:kernel.core_pattern = core 2024-09-12T01:39:57.121 INFO:teuthology.orchestra.run.smithi135.stdout:kernel.core_pattern = core 2024-09-12T01:39:57.142 DEBUG:teuthology.orchestra.run.smithi019:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:39:57.181 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:39:57.182 DEBUG:teuthology.orchestra.run.smithi135:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T01:39:57.210 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T01:39:57.211 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T01:39:57.223 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T01:39:57.223 DEBUG:teuthology.misc:Transferring archived files from smithi019:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860/remote/smithi019 2024-09-12T01:39:57.224 DEBUG:teuthology.orchestra.run.smithi019:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:39:57.277 DEBUG:teuthology.misc:Transferring archived files from smithi135:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901860/remote/smithi135 2024-09-12T01:39:57.277 DEBUG:teuthology.orchestra.run.smithi135:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T01:39:57.324 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T01:39:57.325 DEBUG:teuthology.orchestra.run.smithi019:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:39:57.328 DEBUG:teuthology.orchestra.run.smithi135:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T01:39:57.388 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T01:39:57.401 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T01:39:57.401 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T01:39:57.412 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T01:39:57.412 DEBUG:teuthology.orchestra.run.smithi019:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:39:57.415 DEBUG:teuthology.orchestra.run.smithi135:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T01:39:57.442 INFO:teuthology.orchestra.run.smithi019.stdout: 265852 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:39 /home/ubuntu/cephtest 2024-09-12T01:39:57.456 INFO:teuthology.orchestra.run.smithi135.stdout: 265325 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 01:39 /home/ubuntu/cephtest 2024-09-12T01:39:57.458 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T01:39:57.469 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T01:39:57.495 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/https rgw_pool_type/ec-profile s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{centos_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/valgrind} duration: 4935.465898990631 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T01:39:57.495 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T01:39:57.581 INFO:teuthology.run:pass